Click here to Skip to main content
15,893,368 members
Home / Discussions / Database
   

Database

 
AnswerRe: ORA-01033: ORACLE initialization or shutdown in progress Pin
Om Prakash Pant18-Apr-11 20:48
Om Prakash Pant18-Apr-11 20:48 
AnswerRe: ORA-01033: ORACLE initialization or shutdown in progress Pin
Ravi Sant18-Apr-11 21:04
Ravi Sant18-Apr-11 21:04 
QuestionFilling a combobox with values from table while still bound to another Pin
Muammar©18-Apr-11 0:33
Muammar©18-Apr-11 0:33 
AnswerRe: Filling a combobox with values from table while still bound to another Pin
Md. Marufuzzaman18-Apr-11 4:11
professionalMd. Marufuzzaman18-Apr-11 4:11 
QuestionHuge Xml Document(more than 10GB) import to Sql Server 2005 Pin
ntiin18-Apr-11 0:25
ntiin18-Apr-11 0:25 
AnswerRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
Ravi Sant18-Apr-11 1:17
Ravi Sant18-Apr-11 1:17 
GeneralRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
ntiin18-Apr-11 6:03
ntiin18-Apr-11 6:03 
AnswerRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
jschell18-Apr-11 8:03
jschell18-Apr-11 8:03 
I suggest you proceed cautiously.

That is a big file and the vast majority of solutions deal with smaller files.

If it was me I think I would do the following
1. Create an app that does nothing but divide it into smaller files. Might not even do validation.
2. Create a second app that consumes the smaller files, validates, logs the file processed and then post to the database.

Advantages in the above.
1. If an error occurs you are going to need to manually review it. And reviewing a file that is 10/100 meg is easier than 10 gig.
2. If an error occurs you can manually fix and continue with the file that errored, rather than restarting everything.
3. You don't need to deal with the issue that the file is just too big for some part of the process.

Regardless however you must have the following features.
1. Log as you complete each block (insert, whatever) of work so you not only know where something failed but also can track that it succeeded.
2. Insure that transaction blocks are small. 1000 is probably a good number.
3. Design for the possibility that something will fail so you have a way to restart it at the failure point.
GeneralRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
ntiin18-Apr-11 20:00
ntiin18-Apr-11 20:00 
GeneralRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
jschell19-Apr-11 8:29
jschell19-Apr-11 8:29 
GeneralRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
venomation20-Apr-11 7:29
venomation20-Apr-11 7:29 
GeneralRe: Huge Xml Document(more than 10GB) import to Sql Server 2005 Pin
ntiin20-Apr-11 17:43
ntiin20-Apr-11 17:43 
Questionproblem with join [modified] Pin
Nikhil Bhivgade17-Apr-11 20:42
professionalNikhil Bhivgade17-Apr-11 20:42 
AnswerRe: problem with join Pin
Luc Pattyn17-Apr-11 22:23
sitebuilderLuc Pattyn17-Apr-11 22:23 
GeneralRe: problem with join Pin
Md. Marufuzzaman18-Apr-11 4:14
professionalMd. Marufuzzaman18-Apr-11 4:14 
QuestionSimple Master/Details relationship?? Pin
Muammar©16-Apr-11 20:24
Muammar©16-Apr-11 20:24 
AnswerRe: Simple Master/Details relationship?? Pin
Om Prakash Pant17-Apr-11 19:52
Om Prakash Pant17-Apr-11 19:52 
GeneralRe: Simple Master/Details relationship?? Pin
Muammar©18-Apr-11 0:29
Muammar©18-Apr-11 0:29 
QuestionStoring Binary Tree Data Pin
nitin316-Apr-11 19:41
nitin316-Apr-11 19:41 
AnswerRe: Storing Binary Tree Data Pin
PIEBALDconsult16-Apr-11 19:55
mvePIEBALDconsult16-Apr-11 19:55 
GeneralRe: Storing Binary Tree Data Pin
nitin316-Apr-11 20:10
nitin316-Apr-11 20:10 
AnswerRe: Storing Binary Tree Data Pin
Prasanta_Prince17-Apr-11 6:19
Prasanta_Prince17-Apr-11 6:19 
QuestionSQL Server 2008 / C# - Update layout of database Pin
archibald7116-Apr-11 6:35
archibald7116-Apr-11 6:35 
AnswerRe: SQL Server 2008 / C# - Update layout of database Pin
PIEBALDconsult16-Apr-11 7:05
mvePIEBALDconsult16-Apr-11 7:05 
AnswerRe: SQL Server 2008 / C# - Update layout of database Pin
jschell16-Apr-11 11:38
jschell16-Apr-11 11:38 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.