Database

SQL Server- Upload CSV file via Bulk Insert with double Quotation Issue?

8-Jan-09 11:06

No problem and the follow up was useful! Even though I rarely use Access, it's always good to have understanding how it's developping. Thanks!

The need to optimize rises from a bad design.My articles[^]

Tarini Singh5-Jan-09 4:21

Tarini Singh

5-Jan-09 4:21

Hi Team,

Needed functionality is upload csv file via bulk insert only.

1)I Created table structure

CREATE TABLE #Test_temp
(
Name	varchar(100),
Age	varchar(100),
Salary	varchar(100),
Dept	varchar(100)
)

2)
creating the format file (.fmt)
8.0
4

1	SQLCHAR	      0       100     ","			1       NAME		SQL_Latin1_General_CP1_CI_AS
2	SQLCHAR	      0	      100     ","			2	AGE		SQL_Latin1_General_CP1_CI_AS
3	SQLCHAR	      0	      100     ","			3	SALARY		SQL_Latin1_General_CP1_CI_AS
4	SQLCHAR	      0	      100     "\r\n"			4	DEPT		SQL_Latin1_General_CP1_CI_AS

3)
The comma delimited csv data file

Name,Age,Salary,Dept
Scott,21,2343,salary
Tiger,22,34343,acct

It was successfully uploaded but
the input changes is that

In csv file, some filed contains values within (")double quotes with (,) .
like in third row below

Name,Age,Salary,Dept
<code>Scott,21,"23,43",salary</code>
Tiger,22,34343,acct

for this scenario, I took the fmt file as below

1 SQLCHAR 0 100 "," 1 NAME SQL_Latin1_General_CP1_CI_AS

2 SQLCHAR 0 100 "," 2 AGE SQL_Latin1_General_CP1_CI_AS

3 SQLCHAR 0 100 "\"," 3 SALARY SQL_Latin1_General_CP1_CI_AS

4 SQLCHAR 0 100 "\r\n" 4 DEPT SQL_Latin1_General_CP1_CI_AS

Could anyone help me out from this scenario.

Tarini Singh
Sr Software Engg.
email-tksingh@zenta.com

Re: SQL Server- Upload CSV file via Bulk Insert with double Quotation Issue?

Wendelius5-Jan-09 9:18

Problem with large database fetching

5-Jan-09 9:18

I think you could also set quotation marks on the second field like:

2 SQLCHAR 0 100 ",\"" 2 AGE SQL_Latin1_General_CP1_CI_AS

However, it would be better, if the character data is always in quotation marks. Otherwise you may have problems if the data contains commas etc.

So could you get the data in following format (assuming that the number are actually characters as your table defines them):

"Scott","21","23,43","salary"
"Tiger","22","34343","acct"

The need to optimize rises from a bad design.My articles[^]

Member 40015965-Jan-09 2:40

Member 4001596

5-Jan-09 2:40

hi everyone

i have create a web page where i place two DropDownList in First i bound Country List and in second one i am bounding places list according to selected country my problem is that when place list have less items it works fine but when list goes large Ex more than 5000 or more it take so much time some times it it show time out error (Sql Server). i also try with Ajax tool kit with Cascading Dropdownlist extender with web service method but problem not solve. here is my code

// for country selection

Public Shared Function getContry() As DataTable
Dim Ds As DataSet
Dim contry_list As String
contry_list = "SELECT Country_List.CountryNo,Country_List.CountryName From Country_List"
Ds = SqlHelper.ExecuteDataset(connection, CommandType.Text, contry_list) ' "Get_Country_List")

Return Ds.Tables(0)
End Function

/// for Place List

Public Shared Function getplace(ByVal CountryNo As Integer) As DataTable
Dim Ds As DataSet
Dim getplacelist As String
getplacelist = "SELECT Place_List.PlaceNo,Place_List.PlaceName From Place_List " & " WHERE Place_List.CountryNo = " & CountryNo
Ds = SqlHelper.ExecuteDataset(connection, CommandType.Text, getplacelist)
Return Ds.Tables(0)
End Function

and on .aspx page i am using

Private Sub fillCountry()
Dim dt As DataTable
dt = getContry()
ComboBox1.DataSource = dt
ComboBox1.DataValueField = dt.Columns("CountryNo").ToString
ComboBox1.DataTextField = dt.Columns("CountryName").ToString
ComboBox1.DataBind()

End Sub

Private Sub fillPlace(ByVal CountryNo As Integer)
Dim dt As DataTable
dt = getplace(CountryNo)

ListBox1.DataSource = dt
ListBox1.DataValueField = dt.Columns("PlaceNo").ToString
ListBox1.DataTextField = dt.Columns("PlaceName").ToString
ListBox1.DataBind()
ListBox1.Enabled = True
End Sub

where i am wrong plz help me

Ashfield5-Jan-09 2:54

Ashfield

5-Jan-09 2:54

I suspect you need to look at the indices on the tables. An index on Place_List.CountryNo would certainly help. You could also look at caching as the places per country probably do not change much.

Bob
Ashfield Consultants Ltd

Wendelius5-Jan-09 9:22

5-Jan-09 9:22

To add to Ashfield's post, try to also cache the countries. That would help the fillCountry sub. As Ashfield wrote, indexing and caching helps the fillPlace sub.

The need to optimize rises from a bad design.My articles[^]

Aman Bhullar6-Jan-09 5:45

Aman Bhullar

6-Jan-09 5:45

Have you tried using Same query on Query Analyser. Is there same error or it displayes the result(Although it takes time).

Try checking the timeout of SQLCommand object in function
ExecuteDataset

By default there is no value assigned.
Try assisgning 40000, and check where the error of time out is there.

Alo check the indexing of table.

Member 40015966-Jan-09 20:22

Member 4001596

6-Jan-09 20:22

thx for support this was error coz thr was no indexing thx a lot

Need SQl Query

karthigachawla5-Jan-09 0:48

karthigachawla

5-Jan-09 0:48

Hai,

I need a query to list a column in order.it is varchar datatype.column name is accno.I has values like AC1,AC6,AC10,BJ8,BJ20,CK12 etc..

i have to list in order like

AC1
AC2
AC10
BK1
BK2
VH1

please any one help me

SeMartens5-Jan-09 1:09

SeMartens

5-Jan-09 1:09

Hi,

maybe you could work with substrings (if all of your values have two leading chars):

<br />
select * from mytable <br />
ORDER BY substr(mycolumn, 0, 2), cast(substr(mycolumn, 3) as int)<br />

Regards
Sebastian

It's not a bug, it's a feature!

Me in Softwareland.

Ben Fair5-Jan-09 4:13

Ben Fair

5-Jan-09 4:13

Unless I missed something, it seems like you just need an ORDER BY clause:

select * from table order by accno

Keep It Simple Stupid! (KISS)

SeMartens5-Jan-09 4:26

SeMartens

5-Jan-09 4:26

Hmm, I don't think that this is working, because a varchar-column is the order-criteria. So it will end up with this:

AC1
AC10
AC2

since it is ordering it lexicographical.

It's not a bug, it's a feature!

Me in Softwareland.

Confused about instance name in SQL cluster

Ben Fair5-Jan-09 5:51

Ben Fair

5-Jan-09 5:51

Yes, sorry, you are right; substringing will be needed.

Keep It Simple Stupid! (KISS)

George_George3-Jan-09 23:15

George_George

3-Jan-09 23:15

Hello everyone,

I am learning to install SQL Cluster. I am confused about the following concepts, does anyone have any good ideas?

1. I am always confused about the differences between instance/node concept, and also confused about instance name and virtual server name for a SQL cluster during setup process. Could anyone help to clarify please?

2. Do I need a dedicated sub-network to install a SQL Cluster and connect the dedicated sub-network to the LAN (which SQL clients are working on) by hub/switch/router? Or such dedicated sub-network is not needed and all nodes in the SQL cluster could be in the same network of the clients?

thanks in advance,
George

Re: Confused about instance name in SQL cluster

Wendelius4-Jan-09 0:49

Re: Confused about instance name in SQL cluster

4-Jan-09 0:49

George_George wrote:
I am always confused about the differences between instance/node concept

Instance is the overall cluster server which is seen by the clients. It represents the SQL Server independently from how many nodes participate in the cluster. So node is the actual installation of the SQL Server. In a cluster yo would have two or more nodes.

George_George wrote:
Do I need a dedicated sub-network to install a SQL Cluster and connect the dedicated sub-network to the LAN

I think, not exactly a sub-network, but you need two independent network adapters. For example you cannot share a single network card (even if it has several ports). The idea is that you do not have a single point of failure. A heartbeat protocol is used between the nodes so it's typical to have one network card to serve the clients and one network card solely for the node conversations. This conversation between nodes can be isolated (and typically it's a good idea) from other network traffic.

The need to optimize rises from a bad design.My articles[^]

George_George4-Jan-09 22:23

George_George

4-Jan-09 22:23

Thanks Mika,

I have 3 more comments,

1. From your reply, I learned that differnet instances seems means different installation -- does that mean different instances will have different database enginer binary (DLL/EXE files)?

2. From the connection string itself, can we distinguish whether it is connection string for cluster and non-cluster?

3. I want to confirm with you that it is not a must for me to have two network adapter for nodes in cluster in order to deploy SQL Server cluster? i.e. could both server and client could reside on the same Class C sub-network, and each of them have only a single network adapter?

regards,
George

Re: Confused about instance name in SQL cluster

Wendelius5-Jan-09 4:33

5-Jan-09 4:33

George_George wrote:
differnet instances seems means different installation

Not quite, you configure an instance and you add several nodes to it. Every node must have identical installation. Instance is what the client sees, node is the machine that runs the services.

George_George wrote:
can we distinguish whether it is connection string for cluster and non-cluster

I think that a client can point to a specific node, but if you do that there's no point in clustering. Typically the client doesn't realize that there's a cluster configuration.

George_George wrote:
could both server and client could reside on the same Class C sub-network, and each of them have only a single network adapter

I think they can be on the same network, but the server must have two separate network adapters.

Perhaps these would help:
- Installing a SQL Server 2008 Failover Cluster[^]
- How to: Create a New SQL Server Failover Cluster (Setup)[^]

The need to optimize rises from a bad design.My articles[^]

Sql query

sarah_chandran3-Jan-09 3:45

sarah_chandran

3-Jan-09 3:45

If table1 has fields Studentname , departmentid
and table2 has fields departmentid,departmentname then can anyone
give me the sql query to get the department name and the number of students in each department.

Wendelius3-Jan-09 4:13

3-Jan-09 4:13

Sounds like homework.

Simply join and fetch the data from both tables and then group by department name. Use COUNT to calculate the amount of students.

The need to optimize rises from a bad design.My articles[^]

Vimalsoft(Pty) Ltd4-Jan-09 20:09

Vimalsoft(Pty) Ltd

4-Jan-09 20:09

Try this

SELECT Studentname , departmentid
FROM  TABLE1 T1 INNER JOIN TABLE2 T2 ON 
T1.departmentid = T2.departmentid 
ORDER BY departmentid

Hope it helps

Vuyiswa Maseko,

Few companies that installed computers to reduce the employment of clerks have realized their expectations.... They now need more and more expensive clerks even though they call them "Developers" or "Programmers."

C#/VB.NET/ASP.NET/SQL7/2000/2005/2008
http://www.vuyiswamaseko.tiyaneProperties.co.za
vuyiswam@its.co.za

ChandraRam4-Jan-09 22:10

ChandraRam

4-Jan-09 22:10

Vuyiswa Maseko wrote:
Try this

SELECT Studentname , departmentid
FROM TABLE1 T1 INNER JOIN TABLE2 T2 ON
T1.departmentid = T2.departmentid
ORDER BY departmentid

The OP wants department name and count of students - your query returns neither.

Poke tongue | ;-P

how to display the data in monthwise formate in MYSQL

sarah_chandran5-Jan-09 14:01

sarah_chandran

5-Jan-09 14:01

Thank u , just what I needed.
select deptname,COUNT(deptid) from emp,department
where emp.deptid =department.id group by deptname

jenny_anu2-Jan-09 23:16

jenny_anu

2-Jan-09 23:16

hi
in my project i want to display a report to employee by month wise achivement.
if user select starting date to ending date means it has to display
month wise . if user select 1st qtr means it has to display like this.

-------------|-------------|-------------|
JAN | FEB | MAR |
-------------|-------------|-------------|
target|achive|target|achive|target|achive|
------|------|------|------|------|------|
5 | 4 | 5 | 5 | 4 | 2 |

output screen is like this.. can u guide me. pls. how to do.
Frontend is asp.net using c# and backend is MYSQL

Re: how to display the data in monthwise formate in MYSQL

Wendelius2-Jan-09 23:46