Comparing string with list of other strings

Question

0.00/5 (No votes)

See more:

Hi. I have a C# winform app which scrap data from some site. The data which the app extract, holds temporary in datagridview control. The app need to run once a day so when start to scrap data, the app check for duplicates and add just unique data if it found that is not in the datagridview control.

Now my question is: How I can speed this process of comparing the current string with all other strings?

Any ideas, hints etc.

Thanks, Igor

Posted 23-Aug-13 8:59am

Ensiferum77

Add a Solution

Comments

BillWoodruff 23-Aug-13 21:48pm

The assumption I see you making here is that format of the web-page you scrape will not change: a dangerous assumption unless it's a web-site you have control of.

Different strategies might be used here, depending on the reliability of your knowledge of which fields you can rely on not changing, and which fields you expect to change frequently.

3 solutions

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Bert Goens · Answer 1 · 2013-08-23T09:22:00

Solution 1

I don't know but it might be that binairy compairing strings can be faster, may the next commenters help you with this.

Posted 23-Aug-13 9:22am

Bert Goens

Expert Coming · Answer 2 · 2013-08-23T10:56:00

Solution 2

Use a

HashSet<string>

If duplicates are found it won't be added.

HashSet<string> deduped = new HashSet<string>();

deduped.Add("Test");
deduped.Add("blah");
deduped.Add("Test");

Console.WriteLine(deduped.Count); //outputs 2

Posted 23-Aug-13 10:56am

Expert Coming

Updated 23-Aug-13 10:59am

v2

Ensiferum77 · Answer 3 · 2013-08-23T17:22:00

Actually I don't hold my data in some data structure, just temporary hold in datagridview.
Datagridview is like this:

Model Location .... .... .... and othere columns... Now if I have some current model I like to compare the name of the current model with all in the datagridview with the same name... If the model is bmw x6... find all bmw x6 inside the datagridview and compare the current with all other... if have the same name, but different location add in new row the unique model... This is my question about the comparing... I don't like to use one for loop which goes through all rows... I like to know if there is any quick method how to traverse the gridview....