Extracting csv data from HTML page

Question

1.00/5 (2 votes)

See more:

Hi,
I am quite new to programming. I need to extract the data from this HTML page: http://www.bmreports.com/servlet/com.logica.neta.bwp_MarketIndexServlet?displayCsv=false

I need to get the data updated every 30mins or so. Since, this page already has link to extract the current data in csv, i was hoping it might be possible to capture this information in csv using either C#, VB.Net or some VB Script.

Would appreciate any guidance on how I can pull this information in CSV format using any of the 3- C#, VB.NET, VB Script.

Thanks,
J

Posted 26-Nov-15 9:26am

KingJul

Add a Solution

Comments

PIEBALDconsult 26-Nov-15 17:11pm

Absolutely possible. What will you then do with the data?

jgakenhe 26-Nov-15 22:05pm

You can pull the CSV file down real easy with SSIS. You'll need to lookup how to do it with the HttpClientConnection.DownloadFile() inside of a Script Task.

1 solution

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Wombaticus · Answer 1 · 2015-11-27T12:22:00

Solution 1

There are dozens of different ways... if you look at the page source there you'll see that the CSV data is right there in a script tag. You could download the page using .NET's WebClient class, then it'd be pretty straightforward to parse the code to extract this data.

Posted 27-Nov-15 12:22pm

Wombaticus