|
My instinct is to say you need to instrument the application and measure it to identify where exactly the bottleneck is - anything else is really speculation. You could get a rough idea as to where the hold-ups are by watching perfmon but that will not tell you the underlying cause.
|
|
|
|
|
Sound like file read is the real bottleneck or is it "the visible part" of your slow database, but are you really "only" reading or is some processing after reading done. Like some database stuff: fetchting, indexing or temp table.
Multi-threading and multi-cpu makes only sense if it solves the problem. But it isnt - so I think a bunch of RAM is fine enough.
My tip is, that the problem is in the database (design?) or on the db-server. The reads are so slow 
Press F1 for help or google it.
Greetings from Germany
|
|
|
|
|
Okay, whenever I hear someone say they've made a multi-threaded version of anything that wasn't multi-threaded before, alarm bells start to go off in my head. Multi-threading is hard to get right, and reading that post made me think that you have a lot of contention going on in there. You mentioned that it's taking a long time to read files but not to write to disk - that suggests to me that you have more than one process trying to get access to the same file at the same time. Looking at that would be the first thing I would prioritise if I were profiling the application.
|
|
|
|
|
I find this a very interesting scenario, and I would like to have a better sense of what's involved ... what the trade-offs are ... in using single-box lotsa-cores, lotsa-boxes few cores, lotsa ram, server-client configurations (SSD where ? spinning-platters where ?), network structure, server software, db choice andd configuration, optimal storage strategies, etc.
I would very much enjoy reading an article here on how you went about profiling and how your implementation strategy was planned, how it evolved as you profiled and experimented, etc.
thanks, Bill
«A man will be imprisoned in a room with a door that's unlocked and opens inwards ... as long as it does not occur to him to pull rather than push» Wittgenstein
|
|
|
|
|
FYI Bob, the bottleneck is then the memory swapping at the L1 and L2 cache memory of the CPU, including the memory "Bridges". So CPU count does not matter.
|
|
|
|
|
|
Looks like they are learning from Japan. Youtube link[^] SFW at least where I work.
|
|
|
|
|
How did you happen upon that site? 
"the debugger doesn't tell me anything because this code compiles just fine" - random QA comment
"Facebook is where you tell lies to your friends. Twitter is where you tell the truth to strangers." - chriselst
|
|
|
|
|
In all honesty 'twas IM'ed to the whole company. We tried to get to the bottom of how he found it, but no reply.
|
|
|
|
|
That is probably cheaper than $95 in drinks at a bar.
|
|
|
|
|
Wouldn't you need to spend the $95 at the bar first?
Life is like a s**t sandwich; the more bread you have, the less s**t you eat.
|
|
|
|
|
Movie Quote Of The Day
Even the tiniest flea can drive a big dog crazy.
Which movie?
|
|
|
|
|
|
|
Lassie, the brutal massacre?
Geek code v 3.12
GCS d--- s-/++ a- C++++ U+++ P- L- E-- W++ N++ o+ K- w+++ O? M-- V? PS+ PE- Y+ PGP t++ 5? X R++ tv-- b+ DI+++ D++ G e++>+++ h--- r++>+++ y+++*
Weapons extension: ma- k++ F+2 X
|
|
|
|
|
Minions the movie ? 
if(this.signature != "")
{
MessageBox.Show("This is my signature: " + Environment.NewLine + signature);
}
else
{
MessageBox.Show("404-Signature not found");
}
|
|
|
|
|
Rambo: The flea market stories
|
|
|
|
|
Diary of a Wimpy Kid
How do you know so much about swallows? Well, you have to know these things when you're a king, you know.
modified 31-Aug-21 21:01pm.
|
|
|
|
|
On Night in Paris' Snatch
=========================================================
I'm an optoholic - my glass is always half full of vodka.
=========================================================
|
|
|
|
|
300[^]
Software Zen: delete this;
|
|
|
|
|
Medieval bush, the movie.
"I had the right to remain silent, but I didn't have the ability!"
Ron White, Comedian
|
|
|
|
|
The life cycle of the software bug ?
Microsoft ... the only place where VARIANT_TRUE != true
|
|
|
|
|
|
Honey, I Shrank the Bugs
Life is like a s**t sandwich; the more bread you have, the less s**t you eat.
|
|
|
|
|
USA: If you have oil, your people need peace and freedom.
Madagascar: Let's be honest; nobody gave a f*ck about us till the movies came out.
Afghanistan: You came; you saw; you got slaughtered.
Greece: We did a bunch of sh*t for mankind 10000 years ago and now we are bankrupt.
Australia: USA in training.
Italy: We were really important once but now we make shoes.
Switzerland: Sure, we will take your money.
Canada: Are we not America yet?
Greenland: Once upon a time, a couple of people showed up; that's it.
Malaysia: Dude, where's my plane?
Pakistan: Have a blast till you last.
France: We like eating cheese and surrendering in wars.
Saudi Arabia: Family business disguised as a country.
India: You don't cast your vote; you vote your caste.
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
