Click here to Skip to main content
15,887,027 members

Welcome to the Lounge

   

For discussing anything related to a software developer's life but is not for programming questions. Got a programming question?

The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.

 
GeneralRe: Holy Moly Pin
BernardIE531712-Sep-22 14:20
BernardIE531712-Sep-22 14:20 
GeneralRe: Holy Moly Pin
Richard Deeming12-Sep-22 21:33
mveRichard Deeming12-Sep-22 21:33 
GeneralI was hospitalized with UTI Pin
Vivi Chellappa12-Sep-22 4:13
professionalVivi Chellappa12-Sep-22 4:13 
GeneralRe: I was hospitalized with UTI Pin
OriginalGriff12-Sep-22 4:21
mveOriginalGriff12-Sep-22 4:21 
GeneralRe: I was hospitalized with UTI Pin
Rage12-Sep-22 4:54
professionalRage12-Sep-22 4:54 
GeneralRe: I was hospitalized with UTI Pin
Amarnath S12-Sep-22 5:39
professionalAmarnath S12-Sep-22 5:39 
GeneralRe: I was hospitalized with UTI Pin
Rage12-Sep-22 6:06
professionalRage12-Sep-22 6:06 
RantExasperated Pin
kmoorevs12-Sep-22 1:14
kmoorevs12-Sep-22 1:14 
Several months back, we got a new customer using a cloud-based POS system that we hadn't worked with before. They are actually the first vendor we have encountered that had a real API for which they gave us a key and basically just said 'have fun!'.

I'm used to figuring things out myself so no problem, after all, it's just a web request that gets a response and does something with it. I dug in and using their Swagger UI found 90% of what I was looking for and started pulling data by the month. There are 2 different requests/pulls, 1 returns around 120K records/month and the other around 240K records/month. These ran fine until last weekend when they both started timing out.

I decided to break up the requests into smaller parts to maybe help things along so I added an outside loop to request one date at a time. Nope, still timing out. Increase the read timeout in the header. Still times out so double it...still times out so double it...

Now I'm up to a read timeout of 3,000,000 (50 minutes!!!) and it's finally running, albeit very slowly and still with some timeouts that I am currently manually re-running. It won't do any good to increase that value anymore as the timeouts are coming @ 2 minutes likely due to a server setting beyond my control.

It kind of worked up to 38K recs, then flat out refused to go any further. I just wrapped the request in a conditional loop so it can't get out until it actually finishes, or I manually stop it.

7 hours later and it's been hitting their server all night and no more progress...oh well, just keep on trying then. I wonder if they every check their logs?
"Go forth into the source" - Neal Morse
"Hope is contagious"

GeneralRe: Exasperated Pin
Rage12-Sep-22 4:57
professionalRage12-Sep-22 4:57 
GeneralRe: Exasperated Pin
abmv12-Sep-22 5:38
professionalabmv12-Sep-22 5:38 
GeneralRe: Exasperated Pin
Rage12-Sep-22 6:08
professionalRage12-Sep-22 6:08 
GeneralRe: Exasperated Pin
kmoorevs12-Sep-22 6:48
kmoorevs12-Sep-22 6:48 
GeneralRe: Exasperated Pin
Gerry Schmitz12-Sep-22 6:47
mveGerry Schmitz12-Sep-22 6:47 
GeneralRe: Exasperated Pin
kmoorevs12-Sep-22 6:54
kmoorevs12-Sep-22 6:54 
GeneralRe: Exasperated Pin
Gerry Schmitz12-Sep-22 7:48
mveGerry Schmitz12-Sep-22 7:48 
JokeAnd that's how the fight started Pin
Mike Hankey12-Sep-22 0:44
mveMike Hankey12-Sep-22 0:44 
GeneralRe: And that's how the fight started Pin
pkfox12-Sep-22 1:42
professionalpkfox12-Sep-22 1:42 
GeneralRe: And that's how the fight started Pin
Mike Hankey12-Sep-22 1:44
mveMike Hankey12-Sep-22 1:44 
GeneralRe: And that's how the fight started Pin
Daniel Pfeffer12-Sep-22 1:45
professionalDaniel Pfeffer12-Sep-22 1:45 
GeneralRe: And that's how the fight started Pin
Gerry Schmitz12-Sep-22 6:51
mveGerry Schmitz12-Sep-22 6:51 
GeneralCCC 12-09-2022 Pin
pkfox11-Sep-22 21:48
professionalpkfox11-Sep-22 21:48 
GeneralRe: CCC 12-09-2022 Pin
Randor 11-Sep-22 22:26
professional Randor 11-Sep-22 22:26 
GeneralRe: CCC 12-09-2022 Pin
pkfox11-Sep-22 23:08
professionalpkfox11-Sep-22 23:08 
GeneralRe: CCC 12-09-2022 Pin
FreedMalloc12-Sep-22 8:23
FreedMalloc12-Sep-22 8:23 
GeneralRe: CCC 12-09-2022 Pin
Randor 12-Sep-22 9:51
professional Randor 12-Sep-22 9:51 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.