Problem in reading Flat file as data in one column have Comma ","

Question

0.00/5 (No votes)

See more:

SSIS

I have to read data from CSV and unfortunately data of one column have comma (",") in it

Posted 17-Jun-15 0:28am

deepakdynamite

Add a Solution

Comments

CHill60 17-Jun-15 6:45am

That is unfortunate. Have you tried defining the string delimiter character - are the strings surrounded by double-quotes for example?
If not, and they are not defined by any other character, then your source data is incorrect.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

F-ES Sitecore · Answer 1 · 2015-06-17T00:52:00

Solution 1

Whatever generates the CSV file needs to wrap the fields in quotes

"field 1", "field 2", "this, that"

then your code needs to treat only commas outside of quote pairs as being the separators so that it knows "this, that" is a single field and not two. There are various libraries out there that will already do this for you if you google "c# csv parser"

C# - Light and Fast CSV Parser[^]

Posted 17-Jun-15 0:52am

F-ES Sitecore

Comments

deepakdynamite 17-Jun-15 6:55am

Thanks for you your solution. we are using c# code under script task to do this. It takes more time then expected as number of records\rows in file are more than 1 lacs and some times goes more than 1 million.

CHill60 17-Jun-15 6:59am

Or just define the text qualifier in the SSIS package?

F-ES Sitecore 17-Jun-15 7:06am

Yeah, my bad, didn't see this was as part of SSIS. The CSV file is still going to need the quote wrappers though.

deepakdynamite 18-Jun-15 0:34am

I used "," (Entire ",") as column delimiter and it works fine for now but there may be other consequences with other columns...