Click here to Skip to main content
15,867,835 members

Welcome to the Lounge

   

For discussing anything related to a software developer's life but is not for programming questions. Got a programming question?

The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.

 
AnswerRe: high server config Pin
musefan11-Mar-20 2:22
musefan11-Mar-20 2:22 
GeneralRe: high server config Pin
Nand3211-Mar-20 4:15
Nand3211-Mar-20 4:15 
AnswerRe: high server config Pin
W Balboos, GHB11-Mar-20 2:24
W Balboos, GHB11-Mar-20 2:24 
GeneralRe: high server config Pin
musefan11-Mar-20 2:30
musefan11-Mar-20 2:30 
AnswerRe: high server config Pin
Dan Neely11-Mar-20 2:57
Dan Neely11-Mar-20 2:57 
AnswerRe: high server config Pin
Daniel Pfeffer11-Mar-20 5:04
professionalDaniel Pfeffer11-Mar-20 5:04 
GeneralRe: high server config Pin
musefan11-Mar-20 6:08
musefan11-Mar-20 6:08 
GeneralRe: high server config Pin
Daniel Pfeffer11-Mar-20 6:39
professionalDaniel Pfeffer11-Mar-20 6:39 
OK, here's my first attempt at analysis:
  1. It is just possible to handle this amount of data with a dedicated 10 Gbps connection (the actual data rate is 6.6 Gbps), but once you take into account framing, collisions, etc., it looks very iffy.
    [Probably have multiple systems receiving the data]
  2. The interfaces (NVMe, etc.) can handle this data rate, but building a storage system that can handle this sort of sustained write rate is non-trivial.
    [Probably use multiple disks running in parallel]
  3. Once you have the data stored locally, you must read it off the storage at the same rate (otherwise you will eventually run out of space), process it, and store it somewhere else.
    [The initial processing of this much data would presumably require a massively parallel system, with all the communication and synchronization issues that this entails. Have at least one primary processing node for each receiving system]
  4. How will secondary, tertiary, etc. processing be done?
    [Whether you have one secondary processor for one or more primary processors or vice versa depends on the amount of data and the processing required. Again, we have synchronization and communication issues]
  5. Presentation of the results?
    [Presumably requires that the results of the processing be sent to a single node. Synchronization, communication issues...]
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows.
-- 6079 Smith W.

AnswerRe: high server config Pin
dan!sh 11-Mar-20 5:33
professional dan!sh 11-Mar-20 5:33 
AnswerRe: high server config Pin
Jörgen Andersson11-Mar-20 6:08
professionalJörgen Andersson11-Mar-20 6:08 
GeneralRe: high server config Pin
musefan11-Mar-20 6:21
musefan11-Mar-20 6:21 
AnswerRe: high server config Pin
Gerry Schmitz11-Mar-20 7:01
mveGerry Schmitz11-Mar-20 7:01 
AnswerRe: high server config Pin
AndyChisholm12-Mar-20 0:43
AndyChisholm12-Mar-20 0:43 
GeneralRe: high server config Pin
Nand3212-Mar-20 3:00
Nand3212-Mar-20 3:00 
GeneralCCC Pin
pkfox10-Mar-20 23:38
professionalpkfox10-Mar-20 23:38 
GeneralRe: CCC Pin
musefan11-Mar-20 1:58
musefan11-Mar-20 1:58 
GeneralRe: CCC - Solution Pin
pkfox11-Mar-20 2:53
professionalpkfox11-Mar-20 2:53 
GeneralRe: CCC - Solution Pin
musefan11-Mar-20 3:20
musefan11-Mar-20 3:20 
GeneralRe: CCC - Solution Pin
pkfox11-Mar-20 3:56
professionalpkfox11-Mar-20 3:56 
GeneralRe: CCC - Solution Pin
OriginalGriff11-Mar-20 23:11
mveOriginalGriff11-Mar-20 23:11 
GeneralRe: CCC - Solution Pin
pkfox12-Mar-20 0:22
professionalpkfox12-Mar-20 0:22 
GeneralRe: CCC - Solution Pin
OriginalGriff12-Mar-20 1:02
mveOriginalGriff12-Mar-20 1:02 
GeneralRe: CCC - Solution Pin
pkfox12-Mar-20 2:16
professionalpkfox12-Mar-20 2:16 
GeneralI am a brilliant young developer... Pin
CPallini10-Mar-20 22:39
mveCPallini10-Mar-20 22:39 
GeneralRe: I am a brilliant young developer... Pin
OriginalGriff10-Mar-20 22:43
mveOriginalGriff10-Mar-20 22:43 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.