Click here to Skip to main content
16,020,666 members
Home / Discussions / Database
   

Database

 
AnswerRe: Could anyone recommend an interactive application for mass data analysis? Pin
jschell24-May-12 8:44
jschell24-May-12 8:44 
GeneralRe: Could anyone recommend an interactive application for mass data analysis? Pin
bestbird778824-May-12 17:14
bestbird778824-May-12 17:14 
AnswerRe: Could anyone recommend an interactive application for mass data analysis? Pin
Jörgen Andersson26-May-12 9:43
professionalJörgen Andersson26-May-12 9:43 
GeneralRe: Could anyone recommend an interactive application for mass data analysis? Pin
bestbird778827-May-12 23:24
bestbird778827-May-12 23:24 
QuestionConversion failed when converting the varchar value in SQLSERVER 2008 Pin
ChandrakanthGaddam22-May-12 5:47
ChandrakanthGaddam22-May-12 5:47 
AnswerRe: Conversion failed when converting the varchar value in SQLSERVER 2008 Pin
scottgp22-May-12 6:02
professionalscottgp22-May-12 6:02 
GeneralRe: Conversion failed when converting the varchar value in SQLSERVER 2008 Pin
ChandrakanthGaddam22-May-12 6:20
ChandrakanthGaddam22-May-12 6:20 
QuestionHandling big tables Pin
V.21-May-12 23:28
professionalV.21-May-12 23:28 
My boss just tells me that I could have a table in the database that receives about 3x10^9 records a year (3 000 000 000). I could split this table in roughly four equal parts, but it still remains a lot. The user can choose to view just a day a year or even the entire history. (eg. the last 2 years wich still means 1 500 000 000 records)

I generally held a rule for myself to keep a production database around maximum 100 000 to 1 000 000 records total and put the rest in history, but this doesn't seem to be an option here and I'm very worried about the performance.

Has anyone got any experience with this size of database and how to solve the issue of getting the data quickly?

(Additonal info. The data are datapoints that need to be plotted on a graph in a certain time period. Performance is one of the top priorities.)

I see two major problems:
1. Keep table size reasonable, so how to split the data into different tables easily?
2. Getting the data to the user. (eg create average graph on the server, because a graph with more then, let's say 1000-2000 points is not useful on the screen anyway.)


Many thanks for any advice in advance.



(PS: Only thing I could find on google is splitting into smaller tables, but that doesn't immediately solve the problem of sending data to the user)

V.

AnswerRe: Handling big tables Pin
Mycroft Holmes21-May-12 23:56
professionalMycroft Holmes21-May-12 23:56 
GeneralRe: Handling big tables Pin
V.22-May-12 0:01
professionalV.22-May-12 0:01 
GeneralRe: Handling big tables Pin
Mycroft Holmes22-May-12 14:15
professionalMycroft Holmes22-May-12 14:15 
GeneralRe: Handling big tables Pin
R. Giskard Reventlov22-May-12 6:26
R. Giskard Reventlov22-May-12 6:26 
AnswerRe: Handling big tables Pin
Eddy Vluggen22-May-12 9:32
professionalEddy Vluggen22-May-12 9:32 
AnswerRe: Handling big tables Pin
jschell23-May-12 10:46
jschell23-May-12 10:46 
GeneralRe: Handling big tables Pin
V.23-May-12 20:45
professionalV.23-May-12 20:45 
Questionerd concepts Pin
mido_h_8921-May-12 22:34
mido_h_8921-May-12 22:34 
AnswerRe: erd concepts Pin
Mycroft Holmes21-May-12 23:53
professionalMycroft Holmes21-May-12 23:53 
QuestionError while declaring a cursor Pin
VC_RYK21-May-12 19:16
VC_RYK21-May-12 19:16 
AnswerRe: Error while declaring a cursor Pin
R. Giskard Reventlov22-May-12 6:23
R. Giskard Reventlov22-May-12 6:23 
QuestionHow to get delete/Update row + SQL Pin
jojoba201118-May-12 22:00
jojoba201118-May-12 22:00 
AnswerRe: How to get delete/Update row + SQL Pin
Eddy Vluggen19-May-12 0:42
professionalEddy Vluggen19-May-12 0:42 
QuestionRe: How to get delete/Update row + SQL Pin
jojoba201119-May-12 4:38
jojoba201119-May-12 4:38 
AnswerRe: How to get delete/Update row + SQL Pin
Eddy Vluggen19-May-12 5:05
professionalEddy Vluggen19-May-12 5:05 
QuestionRe: How to get delete/Update row + SQL Pin
jojoba201120-May-12 2:42
jojoba201120-May-12 2:42 
AnswerRe: How to get delete/Update row + SQL Pin
Eddy Vluggen20-May-12 3:03
professionalEddy Vluggen20-May-12 3:03 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.