|
Well done, sounds like a good job.
Sander Rossel wrote: We had about two records of test data for this process (and despite me asking several times it was impossible to get more), but in production we have 5000+ records and apparently, the Excel (Open XML) library that I'm using can't handle that much data very well.
Agh, I hate it when this kind of capacity/reliability issues rears its head. It's so frustrating.
Sander Rossel wrote: The work around is now that I run this process on my laptop every day at noon.
Hehe... be careful, in case the client gets used to this. 
|
|
|
|
|
That's called "repeat business"*
* As in "automate it, and still invoice the sucker every week".
"I have no idea what I did, but I'm taking full credit for it." - ThisOldTony
"Common sense is so rare these days, it should be classified as a super power" - Random T-shirt
AntiTwitter: @DalekDave is now a follower!
|
|
|
|
|
markrlondon wrote: Agh, I hate it when this kind of capacity/reliability issues rears its head. It's so frustrating.
Yeah, we expected some issues, but not this.
markrlondon wrote: Hehe... be careful, in case the client gets used to this.
They don't even notice, nothing changes for them 
|
|
|
|
|
congratulations !
«One day it will have to be officially admitted that what we have christened reality is an even greater illusion than the world of dreams.» Salvador Dali
|
|
|
|
|
Thanks! 
|
|
|
|
|
Congrats! 
|
|
|
|
|
Thanks
|
|
|
|
|
Sander Rossel wrote: We had about two records of test data for this process
Sometimes you gotta make your own test data.  This reminds me of the worst product rollout (over 5 years ago) that I've ever been a part of involving a super tight deadline for an Azure web app. The client promised at least 5 pilot sites (out of 70) for testing during the month leading up to rollout. Only 1 participated and then only half-assed...it wasn't pretty.
Quote: Every day at noon, the application comes to a grinding halt because the Azure service app goes to max CPU and memory for about 20 minutes.
This is why we do batch processing/backups in the wee hours. Does it have to be done at noon? 
Good luck! My current issue involves a pesky unhandled exception in a web application that occurs only on iOS when the user closes the web page/browser using the h/w button, then re-opens it with the shortcut. It apparently tries to go back where it left off instead of going to the login page like it does on any other browser...even Safari on Windows!  Nobody is complaining, but I can't stand seeing 500s in the logs.
"Go forth into the source" - Neal Morse
"Hope is contagious"
|
|
|
|
|
kmoorevs wrote: Only 1 participated and then only half-assed...it wasn't pretty.
The worst part is, you can't even blame the customer... Well you can, but they won't be happy about it. Probably even less happy than when you take the blame and fix it 
kmoorevs wrote: Does it have to be done at noon?
Yeah, the generated reports show unpaid invoices and credit limits.
The bank payments are read at around 11:00 so my reports are generated at 12:00 and credit control checks them in the afternoon and they want the most recent payments to be there.
kmoorevs wrote: My current issue involves a pesky unhandled exception in a web application that occurs only on iOS
Ouch, good luck with that!
kmoorevs wrote: Safari on Windows
Isn't that an abandoned project from years ago?
|
|
|
|
|
Sander Rossel wrote: We had about two records of test data for this process (and despite me asking several times it was impossible to get more), but in production we have 5000+ records and apparently, the Excel (Open XML) library that I'm using can't handle that much data very well.
FYI Research I did a year or two back had EPPlus (also in nuget) as the C# full featured Excel output library most capable of generating large files. It's still an order of magnitude more of a ramhog than Excel itself; which matters when you're creating spreadsheets with 10s of millions of cells (hundreds of MB of ram, vs several GB; then OOM at around 100m) maybe 0.1% of which can have paragraph size freeform text.
Prior to the customer finally admitting that they didn't actually want everything in every single export of the dataset, the dump everything report was running up within about half of that limit. One of my even more bloated test sets did go over it, triggering my searching for alternatives. The only maybe more capable one I found was from someone else whose client needs were even more immense who ended up writing his own file writer that only supported the minimum subset of .xlsx that he needed. (This seemed too risky to take into production to me.)
Did you ever see history portrayed as an old man with a wise brow and pulseless heart, weighing all things in the balance of reason?
Is not rather the genius of history like an eternal, imploring maiden, full of fire, with a burning heart and flaming soul, humanly warm and humanly beautiful?
--Zachris Topelius
Training a telescope on one’s own belly button will only reveal lint. You like that? You go right on staring at it. I prefer looking at galaxies.
-- Sarah Hoyt
|
|
|
|
|
Yeah, I know EPPlus and I've used it in the past.
I think I still have an older application that still uses it (I think it's on v3 or v4).
Unfortunately, they moved to a new license that's not free for commercial use.
Your link is to the old repository, they've moved to GitHub - EPPlusSoftware/EPPlus: EPPlus 5-Excel spreadsheets for .NET[^].
At this point I'm not willing to pay $299 per year if I have a free alternative available.
I really have just one report, just generated 10-15 times, and it's not fancy, just lots of records.
In this particular case, I also couldn't charge the customer as they already had an expensive solution in place, just not one they ultimately liked.
They asked me if I could make something real quick and at low costs, which I could.
I actually had to lower my costs a bit (read: lower my cost estimate  ), but I got the job.
They were a bit frustrated that I could deliver something that did what they wanted after they paid so much for the other solution that they'd never use in production
I avoid licenses because I have to keep track of them and for which customers I use them.
And if I'm not careful I'll soon end up with lots of licenses for many different things.
For example, I've looked at some HTML-to-PDF libraries, PDF libraries, control (both web and WinForms) libraries, Office/Excel/Word libraries, etc.
The costs aren't always an issue, especially with EPPlus, but PDF libraries, for example, can be extremely expensive.
For a one-off report, such costs really don't pay themselves back.
|
|
|
|
|
Not a request, but some recommendations ... I've included a totally accurate summary, which gives no spoilers.
Breaking Bad:
"US School teacher called Walter White gets cancer; changes name and career to pay his medical bills. Things get out of hand."
The series, even if you have seen it. If you haven't, what rock have you been hiding under?
Bingeable on: Netflix.
Better Call Saul:
"Walter's lawyer gets started in his career. Things get out of hand. Again."
Prequel to Breaking Bad, it starts pretty slow, but gets better and better. Watch BB first.
Bingeable on: Netflix
The Expanse:
"Crew loses ship, gets a new one. Things get out of hand."
The best SciFi series, bar none. Watch it, then read the books, or read the books and then watch it. Doesn't matter which, but do read the books as well.
Bingeable on: Amazon Prime
Game of Thrones:
"Swords. Dragons. Armies. Things get out of hand."
Some nudity may be glimpsed. Just don't get too fond of any character ...
Bingeable on: NowTV
Those should keep you going ... for a few days ...
Anything I should have added?
"I have no idea what I did, but I'm taking full credit for it." - ThisOldTony
"Common sense is so rare these days, it should be classified as a super power" - Random T-shirt
AntiTwitter: @DalekDave is now a follower!
|
|
|
|
|
|
What about older British series, like Waking The Dead (Amazon Prime) and some other cop shows?
Get me coffee and no one gets hurt!
|
|
|
|
|
Waking the Dead. When it was running, I couldn't wait for all of it to get released in Pond West, so I got a zoneless DVD player and ordered the DVDs from the UK.
|
|
|
|
|
"Pond West?" - I like it! ![Java | [Coffee]](https://codeproject.global.ssl.fastly.net/script/Forums/Images/coffee.gif)
Get me coffee and no one gets hurt!
|
|
|
|
|
Dark Matter:
Crew of 6 wakes up on spaceship with no memories. Things get out of hand.
- Netflix
Altered Carbon:
Guy wakes up in a new body after 250 years of not having one. Things get out of hand.
- Netflix
The Umbrella Academy:
Dysfunctional superhero kids, now adults, reunite for dad's funeral and to save the world which is going to end in 8 days. Things get out of hand.
- Netflix
Software Zen: delete this;
|
|
|
|
|
Oooo, Dark Matter. I forgot about that show. I can vouch for that one. Gave me Firefly vibes
|
|
|
|
|
Quote: Just don't get too fond of any character ...
Except Sean Bean, it's always ok to get too fond of Sean Bean.
|
|
|
|
|
Got to add...
Resident Alien.
Alien crash lands near the rural town of Patience, Colorado, Things get out of hand.
Funny not to dark comedy.
|
|
|
|
|
OriginalGriff wrote: what rock have you been hiding under?
The one whare I don't have Netflix, or Amazon Prime, or NowTV, or ... any of the others.
|
|
|
|
|
To be honest you are missing quite a bit - the "normal TV Channels" have really become pretty cheap and tedious over the last few years - and lockdowns haven't helped - so the "good stuff" is generally not available on them. And fiction well presented give you a chance to both relax and think outside your normal mind-set. Yes, books are good - but they are a solitary exercise, a good piece of TV shared with a partner can give you insights into the story and your partner that you may have otherwise missed.
Don't get me started on movies though: they are just scared to do anything original and different in case it doesn't top the box office ...
"I have no idea what I did, but I'm taking full credit for it." - ThisOldTony
"Common sense is so rare these days, it should be classified as a super power" - Random T-shirt
AntiTwitter: @DalekDave is now a follower!
|
|
|
|
|
Maybe, but we are not serious enough telly addicts.
|
|
|
|
|
Quote: the "normal TV Channels" have really become pretty cheap and tedious
Ditto for "normal" TV in the USA. Probably even worse than UK TV. We only use normal TV to watch the news headlines. Now we spend our TV time streaming older shows, especially older British shows via Britbox.
Get me coffee and no one gets hurt!
|
|
|
|
|
Richard MacCutchan wrote: The one whare I don't have Netflix, or Amazon Prime, or NowTV, or ... any of the others.
I hope you like to read....or, something.
|
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
