Click here to Skip to main content
15,851,242 members
Home / Discussions / Database
   

Database

 
QuestionDatabase management Pin
Otekpo Emmanuel19-Jul-15 10:22
Otekpo Emmanuel19-Jul-15 10:22 
GeneralRe: Database management Pin
PIEBALDconsult19-Jul-15 10:40
mvePIEBALDconsult19-Jul-15 10:40 
AnswerRe: Database management Pin
Richard MacCutchan19-Jul-15 23:00
mveRichard MacCutchan19-Jul-15 23:00 
AnswerRe: Database management Pin
Mycroft Holmes19-Jul-15 23:32
professionalMycroft Holmes19-Jul-15 23:32 
AnswerRe: Database management Pin
Wendelius20-Jul-15 7:50
mentorWendelius20-Jul-15 7:50 
QuestionDatabase management Pin
Otekpo Emmanuel19-Jul-15 10:38
Otekpo Emmanuel19-Jul-15 10:38 
QuestionRe: Database management Pin
ZurdoDev22-Jul-15 10:48
professionalZurdoDev22-Jul-15 10:48 
Questionlarge database Pin
V.16-Jul-15 22:46
professionalV.16-Jul-15 22:46 
I'm using a postgresql database and managing it becomes harder and harder due to the sheer size of it.
the largest table contains about 2.5-3 billion records and there are some tables reaching about 10 million records. Database size is about 1.2 TB on disk. I believe the large table (and the tables around it) is the most problematic since there are (very roughly) 10 million write statements a day.

I have had issues with the transaction id's overflowing. Luckily by now I know the cure, but I would like to avoid this issue (and any other issue!) if possible. Especially since the database is expected to grow even further. VACUUM takes like forever on that large table.

I did a search on managing large databases, but most results are for other databases. Only found a not so helpful presentation on slideshare.

If anyone has good (practical) tips about keeping such a large database into good shape, please let me know.
(I hope I explained things well enough)
V.

(MQOTD rules and previous solutions)

AnswerRe: large database Pin
Wendelius16-Jul-15 23:03
mentorWendelius16-Jul-15 23:03 
GeneralRe: large database Pin
V.16-Jul-15 23:10
professionalV.16-Jul-15 23:10 
GeneralRe: large database Pin
Wendelius16-Jul-15 23:20
mentorWendelius16-Jul-15 23:20 
GeneralRe: large database Pin
Mycroft Holmes17-Jul-15 15:02
professionalMycroft Holmes17-Jul-15 15:02 
GeneralRe: large database Pin
V.18-Jul-15 1:12
professionalV.18-Jul-15 1:12 
GeneralRe: large database Pin
Mycroft Holmes18-Jul-15 1:45
professionalMycroft Holmes18-Jul-15 1:45 
GeneralRe: large database Pin
V.18-Jul-15 9:25
professionalV.18-Jul-15 9:25 
GeneralRe: large database Pin
Jörgen Andersson20-Jul-15 12:01
professionalJörgen Andersson20-Jul-15 12:01 
AnswerRe: large database Pin
GuyThiebaut18-Jul-15 2:19
professionalGuyThiebaut18-Jul-15 2:19 
GeneralRe: large database Pin
V.18-Jul-15 9:23
professionalV.18-Jul-15 9:23 
GeneralRe: large database Pin
GuyThiebaut18-Jul-15 9:37
professionalGuyThiebaut18-Jul-15 9:37 
QuestionSQL Linq, updating multiple records Pin
jkirkerx15-Jul-15 11:50
professionaljkirkerx15-Jul-15 11:50 
QuestionSave value of PREPARE into a variable Pin
Jassim Rahma14-Jul-15 23:23
Jassim Rahma14-Jul-15 23:23 
AnswerRe: Save value of PREPARE into a variable Pin
Wendelius14-Jul-15 23:45
mentorWendelius14-Jul-15 23:45 
GeneralRe: Save value of PREPARE into a variable Pin
Jassim Rahma15-Jul-15 23:22
Jassim Rahma15-Jul-15 23:22 
GeneralRe: Save value of PREPARE into a variable Pin
Wendelius15-Jul-15 23:51
mentorWendelius15-Jul-15 23:51 
AnswerRe: Save value of PREPARE into a variable Pin
jschell15-Jul-15 11:45
jschell15-Jul-15 11:45 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.