Re: Compare 160 million records [modified] - ASP.NET Discussion Boards

First Prev Next

Re: The connection's current state is closed. [modified]

jceresini2-Feb-09 12:44

jceresini

2-Feb-09 12:44

Before you call obj.ExecuteRecordSet(query), you will need to set obj.ConnectionString and call obj.Open() to open the connection.

Depending on your database, your connection string could be any of a number of formats. I would recommend referencing http://www.connectionstrings.com[^] for some help with the connection string

Another useful resource is the MSDN page for the DBConnection class: http://msdn.microsoft.com/en-us/library/system.data.common.dbconnection_members.aspx[^]

Joe Ceresini
Network Engineer
jceresini@hostmysite.com
Hostmysite.com[^]

modified on Monday, February 2, 2009 7:12 PM

Re: The connection's current state is closed.

Franklinlloyd3-Feb-09 3:18

Franklinlloyd

3-Feb-09 3:18

thanks

drag controls asp.net

cooltoad1232-Feb-09 6:26

cooltoad123

2-Feb-09 6:26

Hi,

I am working on asp.net. I want to add the drag and drop functionality on the controls. I managed to draw the controls but could any one tell how I can add drag drop functionality in it. I tried using Microsoft.Web.Preview but it creates a havoc ..is there any other way? Any kind of help or e article/example web link will be good support Smile | :)

.

Thanks in advance!!

Re: drag controls asp.net

mr_muskurahat2-Feb-09 6:50

mr_muskurahat

2-Feb-09 6:50

webparts section in asp.net toolbox will fullfill your requirement to achieve drag and drop functionality..

umerumerumer

Re: drag controls asp.net

Ranjit Viswakumar2-Feb-09 11:18

Ranjit Viswakumar

2-Feb-09 11:18

CodeProject actually has a KB on how to do this-

http://www.codeproject.com/KB/aspnet/drag_drop.aspx[^]

It's very easy to follow. Try that out. Good luck.

Ranjit Viswakumar
Professional Services Specialist
HostMySite.com[^]

Compare 160 million records

RajaAhmed2-Feb-09 5:14

RajaAhmed

2-Feb-09 5:14

Hello EveryBody....
I want help. can any one plz suggest me that what can i do becoz i want to compare the value from a database field that contains about 160 millions records. for Example
table contains a field called Email taht contains about 160 millions Adresses. Now when some one enters new email Address. Now i want to compare with existing records and remove them if a duplicate Entry Exists.

Re: Compare 160 million records

Manas Bhardwaj2-Feb-09 5:22

Manas Bhardwaj

2-Feb-09 5:22

AhmedNisar82 wrote:
what can i do becoz i want to compare the value from a database field that contains about 160 millions records

Index it first.

AhmedNisar82 wrote:
Now i want to compare with existing records and remove them if a duplicate Entry Exists.

Cache this information in your application memory and od the comparision from the in memory records.

Please remember to rate helpful or unhelpful answers, it lets us and people reading the forums know if our answers are any good.

Re: Compare 160 million records [modified]

Colin Angus Mackay2-Feb-09 5:39

Colin Angus Mackay

2-Feb-09 5:39

Manas Bhardwaj wrote:
Cache this information in your application memory and od the comparision from the in memory records

That is a seriously screwed up idea! You are crazy if you think that's a good idea.

Let SQL Server do what SQL Server is best at and have it do the comparison rather than saturate your network with 160 million rows of data and then bring the client PC to its knees because you've just dumped a shed-load of data in it.

What do you think the memory requirements are for 160 million rows?

Assume an integer primary key: 4 bytes
Assume each address is an average of say 32 characters (using a western alphabet) 32 bytes.

36 bytes * 160 million = 5,760,000,000

In total that is just shy of 6Gb you want to dump in RAM! On top of that you have overhead for the operating system, other applications and so on.

[UPDATE] Okay, I misready what sort of address. If we assume 20 bytes for an email address, the memory requirement is less, but it is still significant. 24 * 160 million = 3.8Gb

*Developer Day Scotland - Free community conference
*Colin Angus Mackay's Blog
*Latest Scottish Developers Newsletter

Vogon Building and Loan advise that your planet is at risk if you do not keep up repayments on any mortgage secured upon it. Remember that the force of gravity can go up as well as down.

modified on Monday, February 2, 2009 11:45 AM

Re: Compare 160 million records

RajaAhmed2-Feb-09 19:00

RajaAhmed

2-Feb-09 19:00

thnx 4 ur comments....
my application runs on server not on the client side......
So.?????????

Re: Compare 160 million records

Colin Angus Mackay2-Feb-09 21:30

Colin Angus Mackay

2-Feb-09 21:30

AhmedNisar82 wrote:
my application runs on server not on the client side

Be aware that "client" in the context that I used it meant any process outside of SQL Server i.e. Any client of SQL Server.

The "client" could be on the same machine as SQL server, or another machine. Either way the effect of memory consumption is the same. If the process is on the same machine as SQL Server then you don't have the network bandwidth issues.

*Developer Day Scotland - Free community conference
*Colin Angus Mackay's Blog
*Latest Scottish Developers Newsletter

Vogon Building and Loan advise that your planet is at risk if you do not keep up repayments on any mortgage secured upon it. Remember that the force of gravity can go up as well as down.

Re: Compare 160 million records

Colin Angus Mackay2-Feb-09 5:44

Colin Angus Mackay

2-Feb-09 5:44

AhmedNisar82 wrote:
Now i want to compare with existing records and remove them if a duplicate Entry Exists.

If you do this you won't have to remove stuff because you can prevent the duplicate being inserted in the first place.

IF EXISTS (SELECT * FROM MyTable WHERE Email = @newEmail)
BEGIN
    -- Perform action based on email address already existsin
END
ELSE
BEGIN
    -- Perform action based on email address not existing.
END

*Developer Day Scotland - Free community conference
*Colin Angus Mackay's Blog
*Latest Scottish Developers Newsletter

Vogon Building and Loan advise that your planet is at risk if you do not keep up repayments on any mortgage secured upon it. Remember that the force of gravity can go up as well as down.

Re: Compare 160 million records

RajaAhmed2-Feb-09 19:03

RajaAhmed

2-Feb-09 19:03

thnx Colin. thats nice and helpfull. but what can i do with the old records saved on the server. Any suggestion.

Re: Compare 160 million records

Colin Angus Mackay2-Feb-09 21:40

Colin Angus Mackay

2-Feb-09 21:40

You can find duplicates using something like this:

SELECT MAX(PrimaryKey), COUNT(*)
FROM MyEmailTable
GROUP BY EmailAddress
HAVING COUNT(*) >= 2

The above gives you a list of duplicate rows. You can then use that to delete the duplicates.

e.g.

DELETE FROM MyEmailTable
WHERE PrimaryKey IN
(
    SELECT MAX(PrimaryKey)
    FROM MyEmailTable
    GROUP BY EmailAddress
    HAVING COUNT(*) >= 2
)

Also note that it will only remove one duplicate per email address, if there are multiple duplicates then you have to run it multiple times.

NOTE: The above SQL hasn't been tried and may have some syntax errors. Always test on a development database. Do not run this on a live database until you are sure it works they way you want.

*Developer Day Scotland - Free community conference
*Colin Angus Mackay's Blog
*Latest Scottish Developers Newsletter

Vogon Building and Loan advise that your planet is at risk if you do not keep up repayments on any mortgage secured upon it. Remember that the force of gravity can go up as well as down.

custom Action

siva4552-Feb-09 3:15

siva455

2-Feb-09 3:15

Hi,
May i know how can i run an consoleapplication.exe as a part of MSI package created for asp.net application....

ie whenever i install my msi package in a system and after installing my exe(generated by consoleapplication)(which is attached to msi) should be running...

ie how should i attach my exe to msi (in a nutshell)....

Changing Gridview Color at runtime

BalasubramanianK2-Feb-09 2:11

BalasubramanianK

2-Feb-09 2:11

Hi,

I want to change the gridview cell background color when user clicks it or double click it. User clicks one cell and this cell color is changed and further user clicks another cell also. I've change the latest clicked cell color also and I've to retain the old cell color also, which is clicked by user earlier. Anybody can help for it? Thanks in adv.

Balasubramanian K.

Re: Changing Gridview Color at runtime

Vimalsoft(Pty) Ltd2-Feb-09 3:03

Vimalsoft(Pty) Ltd

2-Feb-09 3:03

override the paint method

Vuyiswa Maseko,

Few companies that installed computers to reduce the employment of clerks have realized their expectations.... They now need more and more expensive clerks even though they call them "Developers" or "Programmers."

C#/VB.NET/ASP.NET/SQL7/2000/2005/2008
http://www.vuyiswamaseko.tiyaneProperties.co.za
vuyiswam@its.co.za

Need help for new website.

Rahul.RK2-Feb-09 1:46

Rahul.RK

2-Feb-09 1:46

Hello friends,

I am wishing to create a website for online examination.

Can any one give me the important points not to be missed.

Like how to maintain session, timer etc.

Some usefull links regarding same will help me.

Any type of help from you is appreciated.

Thanks in advance.

Re: Need help for new website.

SeMartens2-Feb-09 2:07

SeMartens

2-Feb-09 2:07

Hi,

http://www.w3schools.com/ASPNET/default.asp[^]

http://www.asp.net/get-started/[^]

Please be so kind to use google first next time and only post questions about coding problems (e.g. "my class x does y and not z, why?").

Regards
Sebastian

It's not a bug, it's a feature!

Check out my CodeProject article Permission-by-aspect.

Me in Softwareland.

Not enough storage is available to complete this operation in asp

richa0212-Feb-09 1:40

richa021

2-Feb-09 1:40

hi,

I am unable to debug it..dis error has come for twice or thrice and it restarts itself...Plz help me out...

Richa

Re: Not enough storage is available to complete this operation in asp

SeMartens2-Feb-09 1:44

SeMartens

2-Feb-09 1:44

Hi,

so what is you application doing? Storing sth at the disk?

Regards
Sebastian

Maybe you are running out of space...

It's not a bug, it's a feature!

Check out my CodeProject article Permission-by-aspect.

Me in Softwareland.

Re: Not enough storage is available to complete this operation in asp

richa0212-Feb-09 1:57

richa021

2-Feb-09 1:57

Hello,

Its a Web-Application in which web services has been implemented..and i am getting this error on the page in which soap coding has been done..

Richa

Re: Not enough storage is available to complete this operation in asp

SeMartens2-Feb-09 2:03

SeMartens

2-Feb-09 2:03

I just did your work and used google. They say something about the expected client token size. It was solved by setting this size up to 65535 chars. You should give it a try.

Here is the link (look in the comments for the solution):

http://blogs.technet.com/askds/archive/2007/09/21/not-enough-storage-is-available-to-complete-this-operation.aspx[^]

It's not a bug, it's a feature!

Check out my CodeProject article Permission-by-aspect.

Me in Softwareland.

Re: Not enough storage is available to complete this operation in asp

richa0212-Feb-09 20:49

richa021

2-Feb-09 20:49

hello,

How can we limit the length of any data coming from another site.We have set it as
"getrSpice.length - 1" and within loop " strXML = strXML & getrSpice.item(intNode).xml" we have written like this..now plz tell me how the length of "getrSprice" can be limited.

Thnx

Re: Not enough storage is available to complete this operation in asp

SeMartens2-Feb-09 21:04

SeMartens

2-Feb-09 21:04

Hi,

first: What about the problem posted before? Is limiting the token size the solution?
Second: What is getrSprice? How do you get the data from another site? You can limit the size at the point where you retrieve the value for getrSpice. Maybe you can post a bit more code?

Regards
Sebastian

It's not a bug, it's a feature!

Check out my CodeProject article Permission-by-aspect.

Me in Softwareland.

context menu with gidview without ajax toolkit

md_refay2-Feb-09 0:39

md_refay

2-Feb-09 0:39

hello
iam using vs 2005 asp.net web site
i need to create context menu on gridview without using ajaz toolkit

md_refay

Last Visit: 31-Dec-99 18:00 Last Update: 29-Apr-24 11:14

Refresh

ᐊ Prev 1...2360 2361 2362 236323642365 2366 2367 2368 2369 Next ᐅ

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.