Need to capture raw HTML of any page displayed on browser and write to file. - Web Development Discussion Boards

Re: Site loads slowly in IE6 only, how to fix?

DoctorMick8-Jul-09 4:16

DoctorMick

8-Jul-09 4:16

Learning Javascript is probably the best option, there are plenty of online tutorials etc.

Re: Site loads slowly in IE6 only, how to fix?

cdietschrun8-Jul-09 4:22

cdietschrun

8-Jul-09 4:22

I know JavaScript, I've made other websites with it, my question is why would something load slower in IE6 than in IE8 or Firefox? Where do I look to optimize?

Re: Site loads slowly in IE6 only, how to fix?

joycejohnson8-Jul-09 17:59

joycejohnson

8-Jul-09 17:59

Does this problem show up on all of your IE6 machines or just one. If just one, then maybe it is not the javascript, but possibly a virus or trojan.

Re: Site loads slowly in IE6 only, how to fix?

cdietschrun8-Jul-09 18:02

cdietschrun

8-Jul-09 18:02

All computers across our company recently updated by IT.

Re: Site loads slowly in IE6 only, how to fix?

joanportman9-Jul-09 2:48

joanportman

9-Jul-09 2:48

I think your problem may be with CSS rather than Javescript, check out the script on a separate empty page and see if it work

Re: Site loads slowly in IE6 only, how to fix?

cdietschrun9-Jul-09 4:52

cdietschrun

9-Jul-09 4:52

This may be the fix, I've only had a few minutes to check, but it might be. I'm curious, why would this be?

Re: Site loads slowly in IE6 only, how to fix?

joanportman9-Jul-09 10:11

joanportman

9-Jul-09 10:11

IE6 has some MAJOR issues with CSS as it adds margins sometimes and misses out transparency, luckily it's dying out tho and you really shouldn't worry too much about it these days

Need to capture raw HTML of any page displayed on browser and write to file.

Antone Eason8-Jul-09 3:13

Antone Eason

8-Jul-09 3:13

Greetings,

I would like to know if anyone has any code or even VB script, Perl etc that can simply be run from a command line to download whatever page is on a browser and write the raw HTML to a file, it can also be MHT for that matter.

I know about using - Navigate etc for a specific web page. This is different. The page I go to require authentication with word art and user name and password etc. Then once there you must click a few times to get where you are going for the data. Therefore running a script to direct me to a certain webpage will not work. The page has to be displayed first and then downloaded.

So, I just want to take whatever is currently on the browser, mainly due to catch refreshes of new data. Understand the page I am getting data from is generated as from a database so I can not simply run a script file to download that page. The program must be able to simple be activated and write to disk what ever is displayed on the browser at the time the program is run.

I have a seperate data extractor to run against the new file to find the data I need. This file can always have the same name as well and be overwritten.

Thanks,

Antone

Re: Need to capture raw HTML of any page displayed on browser and write to file.

David Mujica8-Jul-09 3:24

David Mujica

8-Jul-09 3:24

Check out the code snipet from this posting ...

http://www.codeproject.com/Messages/3111166/Re-how-to-retrieve-data-from-a-website.aspx[^]

Re: Need to capture raw HTML of any page displayed on browser and write to file.

Antone Eason8-Jul-09 3:32

Antone Eason

8-Jul-09 3:32

hi David,

thanks for the quick response,but that is not what I want to do. Imagine a webpage displayed, but you do not know the web address it is just displayed on the browser then the scehduler turns on and downloads the HTML of the page to a file.

Thanks,

Antone

Looking for decent html parser (.NET). [modified]

wout de zeeuw8-Jul-09 2:02

wout de zeeuw

8-Jul-09 2:02

Does anybody have experience with a robust html parser (either commercial or free), that can parse into a DOM model, and hopefully also supports xpath query?

Wout

modified on Wednesday, July 8, 2009 11:08 PM

Re: Looking for decent html parser (.NET).

Super Lloyd8-Jul-09 2:23

Super Lloyd

8-Jul-09 2:23

How about
MIL HTML Parser[^]

From... The Code Project! Poke tongue | ;-P

A train station is where the train stops. A bus station is where the bus stops. On my desk, I have a work station....
_________________________________________________________
My programs never have bugs, they just develop random features.

Re: Looking for decent html parser (.NET).

leppie8-Jul-09 2:33

leppie

8-Jul-09 2:33

wout de zeeuw wrote:
Does anybody have experience with a robust html parser (either commercial or free), that can parse into a DOM model, and hopefully also supports xpath query?

How about the COM interfaces exposed by the WebBrowser control? They should parse anything on the web.

xacc.ide
IronScheme - 1.0 beta 3 - out now!
((lambda (x) `((lambda (x) ,x) ',x)) '`((lambda (x) ,x) ',x))

Re: Looking for decent html parser (.NET).

Stuart Dootson8-Jul-09 2:33

Stuart Dootson

8-Jul-09 2:33

If only you hadn't put the .NET in the title.....

I would have suggested using libxml2, as it has an HTML parser (which constructs an XML-ish DOM internally, IIUC) and also XPath support.

.....but you put .NET in the title, so I haven't suggested that Smile | :)

(A quick Google[^] indicates this[^] - which is commercial)

Java, Basic, who cares - it's all a bunch of tree-hugging hippy cr*p

Re: Looking for decent html parser (.NET).

wout de zeeuw8-Jul-09 9:21

wout de zeeuw

8-Jul-09 9:21

I did see the acrux thing, and I was tempted for a bit. But the price was just a little on the high side for what I think should cost maybe $100-$200. So I ended up trying htmlagilitypack[^], and it works perfectly for what I needed. Only downside is that it looks like a dead project, like so many open source projects end up. But it was absolutely easy to use, and the xpath works fine too. Later on I might revive this dead project when we move to .NET 3.5 or so next year, it's a pity to let a piece of decent code rot away.

Wout

Re: Looking for decent html parser (.NET).

Stuart Dootson8-Jul-09 9:51

Stuart Dootson

8-Jul-09 9:51

I find it difficult to believe that the BCL doesn't include an HTML parser...but it doesn't.

Oh - I found something in Java that would probably have fitted what you want - TagSoup[^] - a SAX compliant HTML parser. If you had a .NET equivalent, I bet you could hook it up to the right bits of System.XML and intermix HTML parsing with XPath querying.

I feel like saying How difficult could it possibly be to port to C#...but I suspect that's a dangerous statement to make Smile | :)

Java, Basic, who cares - it's all a bunch of tree-hugging hippy cr*p

Window from ASP Page [modified]

ahmedmahiuddin7-Jul-09 0:30

ahmedmahiuddin

7-Jul-09 0:30

I call an Window(ASP Page) from an ASP Web Page using Javascript.

window.open('http://localhost:1146/RecordBatch.aspx','Batch Record','width=1000,height=700,left=100,top=50,screenX=100,screenY=50');

I wanna get Access(change value) of some controls in ASP Web Page from my called Window using javascript or C#/VB .Net Code.

modified on Tuesday, July 7, 2009 6:44 AM

Re: Window from ASP Page

Not Active7-Jul-09 2:28

Not Active

7-Jul-09 2:28

The opener property returns a reference to the window that created the window.
http://www.w3schools.com/htmldom/prop_win_opener.asp[^]

only two letters away from being an asset

ajax delay

shabonaa6-Jul-09 12:37

shabonaa

6-Jul-09 12:37

i have a wen application using asp .net 2 and ajax extensions. I'm using ajax to show some text boxes when selecting items from combo box without refreshing the page. the code works normally on local machine, when uploading it to the hosting server i noticed that when selecting item from combo it take about 14 sec to show the text boxes.

how can i decrease the delay between Ajax request and response?or this delay is normal ?

Re: ajax delay

Jeremy Likness9-Jul-09 7:33

Jeremy Likness

9-Jul-09 7:33

Use a serverside solution.

For example, with JQuery, something like this:

<asp:DropDown ID="MyDropDown" runat="server"/>
<asp:TextBox ID="MyTextBox" runat="server"/> 

<script type="text/javascript">

$(document).ready(function(){
   $('<%=MyDropDown.ClientID%>').change(function(){
      $('<%=MyTextBox.ClientID%>').val('<=MyDropDown.ClientID%').val());
   });
})

</script>

Basically, once the page is loaded, you are binding a function to the change event on the drop down. The change event sets the value of the textbox using the value of the drop down.

It's a little more involved without JQuery, you would use $get() to reference the controls and have to iterate the drop down to get the selected value.

Jeremy Likness
http://csharperimage.jeremylikness.com/

ISAPI Extension nooB - .dll functions correctly if accessed directly but not through form POST ?

Mike the Red6-Jul-09 1:06

Mike the Red

6-Jul-09 1:06

I've wrote a basic ISAPI extension:

BOOL APIENTRY DllMain( HANDLE hModule, DWORD  ul_reason_for_call, LPVOID lpReserved) { return TRUE; }
BOOL WINAPI GetExtensionVersion(HSE_VERSION_INFO *pVer) {
	pVer->dwExtensionVersion = HSE_VERSION;
	strncpy(pVer->lpszExtensionDesc, "UL Receiver", HSE_MAX_EXT_DLL_NAME_LEN);
	return TRUE; }
DWORD WINAPI HttpExtensionProc(EXTENSION_CONTROL_BLOCK *pECB) {
	char * szStr = "<HTML><BODY>Hello, world!</BODY></HTML>";
	DWORD dwBytes = sizeof(char) * strlen(szStr);
	pECB->WriteClient(pECB->ConnID, szStr, &dwBytes, HSE_IO_SYNC);
	return HSE_STATUS_SUCCESS; }

Next I made a form directed at the extension:

<html>
<body>
<form action="http://localhost/my.dll" method="post">
<input type="text" name="atextbox"><br>
<input type="checkbox" name="acheckbox"><br>
<input type="submit" name="Submit"><br>
</form>
</body>
</html>

If I access the extension directly, like: http://localhost/my.dll, it displays Hello, World!, as it should. But when I submit the form I get (null) 0 instead of Hello, World!

This is my first foray into ISAPI extensions, and I'm not sure what's going wrong or where to look next...

Can someone point me in the right direction, please ?

Any help is greatly appreciated! -MZR

Font error .....!

RongNK6-Jul-09 0:50

RongNK

6-Jul-09 0:50

if client don't have font that exist on server . So how to display that information on client with that font . D'Oh! | :doh:

Sorry for my english !

Re: Font error .....!

Vasudevan Deepak Kumar6-Jul-09 5:40

Vasudevan Deepak Kumar

6-Jul-09 5:40

The TTF file need to be on the system running only the web browser right? BTW, did you investigate into the feasibility of Unicode?

Vasudevan Deepak Kumar
Personal Homepage
Tech Gossips

The woods are lovely, dark and deep,
But I have promises to keep,
And miles to go before I sleep,
And miles to go before I sleep!

how can i stream videos on my server

ahmedhassan965-Jul-09 23:20

ahmedhassan96

5-Jul-09 23:20

hi every body

i want to know how can i stream videos from my server to client page

like youtube.com

can any body help me ???

Re: how can i stream videos on my server

Sabari MD13-Jul-09 18:22

Sabari MD

13-Jul-09 18:22

to my knowldge , i think there is an ptin to paly audio video files using ActiveX Shell components..

sabarimd

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.