how to import data more than 800k records from excel to sql server

Question

0.00/5 (No votes)

See more:

Hi,

can you please help me out this issue. Event I tried out Import and Export Data and run the SSIS package also, but 21148 records only inserted.
I have records 807581 in excel file.

Is there any limitation of the records to import or any missed out.

Regards
Rafi

Posted 26-Nov-15 1:26am

Member 10645463

Updated 26-Nov-15 1:37am

Mohibur Rashid

v2

Add a Solution

Comments

Duncan Edwards Jones 26-Nov-15 7:59am

I don't think there is any limit - are you sure there was no error (duplicate key insert, missing mandatory field etc.) when doing the import?

Member 10645463 27-Nov-15 1:03am

I have checked again, there is no duplicates and blank value..

Richard Deeming 26-Nov-15 10:47am

Excel files are limited to 1048576 rows per sheet, which is much higher than the number of rows you're trying to import.

Are there any blank rows in your Excel file? Have a look at row 21149 / 21150 to see if there's anything odd about them which might cause the import to stop.

Member 10645463 27-Nov-15 1:20am

My records are import to 807581 per sheet. its less than limited records 1048576.

there is no blanks and duplicates.

provi 777 26-Nov-15 14:15pm

https://youtu.be/mReh1-FrlR8

3 solutions

Solution 1

https://youtu.be/mReh1-FrlR8[^]

Posted 26-Nov-15 8:13am

provi 777

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Member 10645463 · Accepted Answer · 2015-11-26T21:48:00

Solution 2

I have imported the records through CSV file.

Thank you guys for responded.

Regards
Rafi

Posted 26-Nov-15 21:48pm

Member 10645463

Comments

Patrice T 27-Nov-15 14:55pm

You should change the status of question with Solved

Jörgen Andersson · Accepted Answer · 2015-11-27T03:02:00

The Ace driver uses quite a lot of memory, so when your excelfile exceeds a certain limit (which is system dependent) it will try to cache to disc.
If I recall correctly, the path to this cache is Temporary Internet Files under AppData.
So if the account SSIS is running under, is not having a profile on your server (this is usually the case) it will not be able to write to the cache.

The simplest workaround you have already discovered, import from a tab delimited file.