Re: XML file data extraction - Visual Basic Discussion Boards

nhsal69 wrote:
Dim node As System.Xml.XmlNode = odoc.SelectNodes("Folder")

it's 'SelectSingleNode'

nhsal69 wrote:
fullpath = foldernode.Attributes.GetNamedItem("fullpath")

it's 'foldernode.attributes.getnameditem("fullpath").value'

(did say it was from memory, guess my memory is getting holes in it)

Thanks again, I would like to point out that your holy memory contains a lot more than my vaguely complete one...

Right this is what I have so far:

Dim odoc As New System.Xml.XmlDocument

odoc.Load("c:\file.xml")

Dim fullpath As String = ""

Dim node As System.Xml.XmlNode = odoc.SelectSingleNode("Folder")

fullpath = foldernode.Attributes.GetNamedItem("fullpath").Value

Dim name As String

node = odoc.SelectSingleNode("Name")
name = node.InnerText

Console.Write("Folder: " & fullpath _& " FullPathValue: " & fullpath & " SizeValue: " _& name)

Console.Write(vbCrLf)

Console.Read()

Catch errorVariable As Exception

Console.Write(errorVariable.ToString())
Console.Read()

Ignore the Console Write stuff, I just want it to write somthing to the console so that I can see it working...

However, this give an "System.NullReferenceException: Object reference not set to an instance of an object." error for the "foldernode" in the "foldernode.Attributes.Ge....." line.

Any thoughts as to why?

replace 'foldernode' with node

Sorry, I forgot to state in the last post, I had thought of that and tried running the code but got the same error in the console windows..

you don't have a declaration for 'foldernode' so you shouldn't even be able to compile this code.

And you still have to replace it bye 'node' since that is your variable name where you load the "folder" node into.

If it still gives you a error that means that

Dim node As System.Xml.XmlNode = odoc.SelectSingleNode("Folder")

this code isn't working so either the node "folder" isn't found or something else is wrong.

Ok, I have altered the code as follows:

Dim fullpath As String = ""
Dim node As System.Xml.XmlNode = odoc.SelectSingleNode("Root")
fullpath = node.Attributes.GetNamedItem("Type").Value

the 2nd line in the XML code after "<?xml version="1.0" encoding="UTF-8" standalone="no"?>" is:

<Root Type="TRoot">

When I run the altered code I get the correct output of "Troot" in the console window, however, when I change the code to look for "folder" it appears as though the code loads the XML in, looks at the first line and doesn't find "folder" then errors with the "Object reference no...." message.

Does this make any sense to you?

This code gives me

Try
           Dim odoc As New System.Xml.XmlDocument
           odoc.Load("c:\temp\text.xml")
           Dim node As System.Xml.XmlNode = odoc.SelectSingleNode("Folder")
           Dim fullpath As String = node.Attributes.Item("fullpath").Value
           node = odoc.SelectSingleNode("Name")
           Dim name As String = node.InnerText

           Label1.Text = fullpath & "     " & name
       Catch ex As Exception
           MessageBox.Show(ex.Message)
       End Try

the following error (loosely translated): unexpected file end. De folowing elements are not closed: Folder, Folder, Root. Line 36, position 42.

The error is pretty clear. Your XML file isn't correct. The root node isn't closed and neither are your folder nodes.
Without a correct XML format you won't be able to read the file with the XML classes.
If you can't correct the XML files you'll have to do it by using the textreaders (system.io.textreader) and regular expressions and that's going to get very complicated very fast.

Sorry, my bad...

The full XML file is over 10 meg so I didn't want to upload the full thing, the above is a sample of the first x lines until a couple of "folder" elements are visible...

I didn't think up loading the full thing would be sensible, but should have told you....

Needless to say try this as vastly cut down version of the xml, but it is fully formed:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>

<Root Type="TRoot">

<Application>TreeSize Professional</Application>
<Version>5.2.3 (5.2.3.505)</Version>
<Date>15/10/2009 12:30:08</Date>
<Path>C:\</Path>
<ExcludePatterns>
<pattern>*~SNAPSHOT*</pattern>
</ExcludePatterns>
<IncludePatterns>
<pattern>*</pattern>
</IncludePatterns>
<ArchiveBitFilesOnly>0</ArchiveBitFilesOnly>
<ExcludeOfflineFiles>0</ExcludeOfflineFiles>
<CreatedPastDaysOnly>0</CreatedPastDaysOnly>
<Filesystem>NTFS</Filesystem>
<BytesPerCluster>4096</BytesPerCluster>
<Compressed>0</Compressed>
<FileBasedCompression>-1</FileBasedCompression>
<FoldersOccupySpace>0</FoldersOccupySpace>
<IsCompared>0</IsCompared>
<Title>Drive: Local Disk (C Smile | :)

</Title>
<UserDefinedClusterSize>0</UserDefinedClusterSize>
<UsedBytesOnDrive>80023715840</UsedBytesOnDrive>
<FreeBytesOnDrive>7445061632</FreeBytesOnDrive>
<DoCreateFileAges FileAgesDateType="1">-1</DoCreateFileAges>
<Folder fullpath="C:\" IsFilesNode="0">
<Name>C:\</Name>
<Attributes>0</Attributes>
<LastAccessDate Low="322843223" High="30035338"/>
<LastChangeDate Low="322843223" High="30035338"/>
<CreationDate Low="0" High="0"/>
<SizeData Size="74609238013" Allocated="72396726232" Wasted="234062016" CDRom="74727184384" Files="116733" Folders="12272" Compression="3"/>
<FilesSizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
<Folder fullpath="C:\" IsFilesNode="-1">
<Name>[Files]</Name>
<Attributes>0</Attributes>
<LastAccessDate Low="1126896907" High="30035336"/>
<LastChangeDate Low="1142297283" High="30035337"/>
<CreationDate Low="0" High="0"/>
<SizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
<FilesSizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
<FileAgeDistribution Days_1="1" Size_1="2514485248" Days_7="4" Size_7="20480" Days_30="14" Size_30="168693760" Days_182="19" Size_182="232947712" Days_365="10" Size_365="15804166144" Days_730="18" Size_730="24813568" Days_2147483647="3" Size_2147483647="434176"/>

</Folder>
</Folder>
</Root>

this code:

Try
            Dim odoc As New System.Xml.XmlDocument
            odoc.Load("c:\temp\text.xml")
            Dim oXmlLog As System.Xml.XmlElement
            Dim text As String = ""
            For Each oXmlLog In odoc.SelectNodes("Root")
                Dim node As System.Xml.XmlElement
                For Each node In oXmlLog.SelectNodes("Folder")
                    Dim fullpath As String = node.Attributes.GetNamedItem("fullpath").Value
                    Dim subnode = node.SelectSingleNode("Name")
                    Dim name As String = subnode.InnerText
                    text &= fullpath & "      " & name & Environment.NewLine
                Next
            Next
            Label1.Text = text
        Catch ex As Exception
            MessageBox.Show(ex.Message)
        End Try

Will give you the fullpath & name

Considering that you made a small error in your xml. I used this xml:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>

<Root Type="TRoot">

<Application>TreeSize Professional</Application>
<Version>5.2.3   (5.2.3.505)</Version>
<Date>15/10/2009 12:30:08</Date>
<Path>C:\</Path>
<ExcludePatterns>
<pattern>*~SNAPSHOT*</pattern>
</ExcludePatterns>
<IncludePatterns>
<pattern>*</pattern>
</IncludePatterns>
<ArchiveBitFilesOnly>0</ArchiveBitFilesOnly>
<ExcludeOfflineFiles>0</ExcludeOfflineFiles>
<CreatedPastDaysOnly>0</CreatedPastDaysOnly>
<Filesystem>NTFS</Filesystem>
<BytesPerCluster>4096</BytesPerCluster>
<Compressed>0</Compressed>
<FileBasedCompression>-1</FileBasedCompression>
<FoldersOccupySpace>0</FoldersOccupySpace>
<IsCompared>0</IsCompared>
<Title>Drive: Local Disk (C</Title>
<UserDefinedClusterSize>0</UserDefinedClusterSize>
<UsedBytesOnDrive>80023715840</UsedBytesOnDrive>
<FreeBytesOnDrive>7445061632</FreeBytesOnDrive>
<DoCreateFileAges FileAgesDateType="1">-1</DoCreateFileAges>
<Folder fullpath="C:\" IsFilesNode="0">
<Name>C:\</Name>
<Attributes>0</Attributes>
<LastAccessDate Low="322843223" High="30035338"/>
<LastChangeDate Low="322843223" High="30035338"/>
<CreationDate Low="0" High="0"/>
<SizeData Size="74609238013" Allocated="72396726232" Wasted="234062016" CDRom="74727184384" Files="116733" Folders="12272" Compression="3"/>
<FilesSizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
</Folder>
<Folder fullpath="C:\" IsFilesNode="-1">
<Name>[Files]</Name>
<Attributes>0</Attributes>
<LastAccessDate Low="1126896907" High="30035336"/>
<LastChangeDate Low="1142297283" High="30035337"/>
<CreationDate Low="0" High="0"/>
<SizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
<FilesSizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
<FileAgeDistribution Days_1="1" Size_1="2514485248" Days_7="4" Size_7="20480" Days_30="14" Size_30="168693760" Days_182="19" Size_182="232947712" Days_365="10" Size_365="15804166144" Days_730="18" Size_730="24813568" Days_2147483647="3" Size_2147483647="434176"/>
</Folder>
</Root>

Note the closing of the folder nodes (bold text)

Thanks again....

When I run this I get as an output:

C:\                  C:\

So this is outputting one iteration of the loop, but I would expect to see:

C:\                  C:\
C:\                  [Files]

as there are two instances of "Folder" each containing a "Name"...

Stepping though the code seems to suggest that the

For Each node In oXmlLog.SelectNodes("Folder")

Is only being processed once and not then looking to the second instance of "Folder"...

Is this because the second instance is a Sub of the first??

nhsal69 wrote:
Is this because the second instance is a Sub of the first??

Yes

If you check the XML I posted I solved that.
If the real XML is really like that (having folder nodes in folder nodes) you'll have to use recursion for that.

(have a method call itself and process the folder nodes until it finds no more folder nodes)

Cool, I have tried to get some of the recursion sorted out, I know what I want it to do, but not sure of the correct form.. Have come up with this so far:

Dim odoc As New System.Xml.XmlDocument
odoc.Load("C:\test\10g_1.xml")
Dim oXmlLog As System.Xml.XmlElement
Dim text As String = ""

Dim FolderSubNode As System.Xml.XmlElement
Dim FolderExist As Boolean

For Each oXmlLog In odoc.SelectNodes("Root")

Dim node As System.Xml.XmlElement

   For Each node In oXmlLog.SelectNodes("Folder")

         FolderExist = True

               Dim fullpath As String = node.Attributes.GetNamedItem("fullpath").Value

Dim subnode = node.SelectSingleNode("Name")
Dim name As String = subnode.InnerText

text &= fullpath & "         " & name & Environment.NewLine

Do Until FolderExist = False

For Each node In oXmlLog.SelectNodes("Folder")
      If node = "folder" Then FolderExist = True

            Next
            Dim fullpath As String = node.Attributes.GetNamedItem("fullpath").Value
            Dim subnode = node.SelectSingleNode("Name")
            Dim name As String = subnode.InnerText

            text &= fullpath & "         " & name & Environment.NewLine

            Loop

            Next
            Next

Will have a look again later, but any suggestions as to how to go about this would be great..

Cheers

Thanks for you help, have decided that I'll script something to change the XML file so that it is correctly formed and therefore I won't need to do the recursive searches(Which are proving tricky because of the dodgy formatting)...

I'll post the final code when I get it together..
Thanks again.

Well I got stuck on the recursion so got a script to tidy up the XML file so that it is reasonably well formed..

But now I have an issue getting one element out,

<sizedata Size= "VALUE" IGNORE THE REST OF THEM/>

here is a fully formed, but shortened XML file:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<Root Type="TRoot">
<Date>15/10/2009 12:30:08</Date>
<Folder fullpath="C:\" IsFilesNode="0">
<Name>C:\</Name>
<SizeData Size="74609238013" Allocated="72396726232" Wasted="234062016" CDRom="74727184384" Files="116733" Folders="12272" Compression="3"/>
</Folder>
<Folder fullpath="C:\" IsFilesNode="-1">
<Name>[Files]</Name>
<SizeData Size="18745407271" Allocated="18745561088" Wasted="153817" CDRom="18745475072" Files="69" Folders="0" Compression="1"/>
</Folder>
<Folder fullpath="C:\TEMP_\" IsFilesNode="0">
<Name>TEMP_ALAN</Name>
<SizeData Size="15469174140" Allocated="15489126222" Wasted="19886724" CDRom="15478267904" Files="9570" Folders="1832" Compression="1"/>
</Folder>
<Folder fullpath="C:\TEMP_\mp3\" IsFilesNode="0">
<Name>mp3</Name>
<SizeData Size="11504514137" Allocated="11513361814" Wasted="8829863" CDRom="11508457472" Files="4561" Folders="510" Compression="1"/>
</Folder>
</root>

The code I have is below:

<pre>Try

                  Dim odoc As New System.Xml.XmlDocument
                  odoc.Load("C:\test\test.xml")
                  Dim oXmlLog As System.Xml.XmlElement
                  Dim text As String = ""
                  For Each oXmlLog In odoc.SelectNodes("Root")
                        Dim node As System.Xml.XmlElement
                        For Each node In oXmlLog.SelectNodes("Folder")
                              Dim fullpath As String = node.Attributes.GetNamedItem("fullpath").Value
                              Dim SizeData As String = node.Attributes.GetNamedItem("SizeData").Value
                              Dim subnode = node.SelectSingleNode("Name")
                              Dim name As String = subnode.InnerText

                              Dim Date_ As XmlElement = odoc.DocumentElement
                              Dim Date_time As XmlNodeList = Date_.ChildNodes
                              Dim Date__time = (Date_time(0).InnerText)

                              text &= Date__time & "      " & fullpath & "         " & name & SizeData & Environment.NewLine
                        Next
                  Next

                  Console.Write(text)
                  Console.Read()
            Catch ex As Exception
                  Console.Write(ex.ToString())
                  Console.Read()
            End Try</pre>

But I can't get the SIZE from SIZEDATA out and into a variable, can you help???

I have done a bit of VBA before.
Any suggestions to code to find duplicate messages in Microsoft Outlook 2007.

Thanks!

Jwalant Natvarlal Soneji, BE IT, India

There's a bunch of different ways to do this. But, how you do it is going to depend on what you mean by "duplicate", how your mailbox is organized (folders and such,) and what you want to do with the duplicate messages.

A guide to posting questions on CodeProject[^]

Dave Kreskowiak
Microsoft MVP
Visual Developer - Visual Basic
2006, 2007, 2008
But no longer in 2009...

Thanks.
I would like to search for duplicate mails in the complete mailbox and delete all except 1 mail.

Jwalant Natvarlal Soneji, BE IT, India

Well then, with that spectacular explanation, none of which answered any questions I asked of you, all I can tell you is this:

Enumerate over the collection of messages in the mailbox, then start another enumeration of the same mailbox starting after the message you just picked up in the first enumeration. Compare the messages, and if they are the same, delete the one you found and continue on. Get the next message and start enumerating every message from that point on, comparing it, ..., and so on, and so on.

A guide to posting questions on CodeProject[^]

Dave Kreskowiak
Microsoft MVP
Visual Developer - Visual Basic
2006, 2007, 2008
But no longer in 2009...

Ohh great!

Thanks for clearing doubts on the logical front, though I had no doubts about the approach.

As I am a beginner with VBA and not in Outlook code, I would like to know something on that front. A pointer to any good learning resource available online should be enough.

Thanks a lot!

Jwalant Natvarlal Soneji, BE IT, India

how to disconnect my account from mysql server using vb.net 2003 code?

That depends on what you mean by "disconnect my account". What you've asked doesn't make any sense.

A guide to posting questions on CodeProject[^]

Dave Kreskowiak
Microsoft MVP
Visual Developer - Visual Basic
2006, 2007, 2008
But no longer in 2009...

Hi,

I have one user table in sqlexpress

UserTable

User_ID
User_name
Password
Last_Name
First_Name
last_update

Login form in vb.net.

I can validate user information on login but what I want to do is to have the user to change his/her password the very first time he uses this password.

How can I achieve this solution?

I like to have some sample code

Thanks for your guidance in advance..

PLEASE HELP

You have given us fairly limited info here, but one option would be this:

When you create a new user, do not put a date in the last_update field (since you are creating, not updating the user).

Then, in the login form, check for NULL in the last_update field. If it's NULL, trigger the password update screen, setting the new password, and inserting a date into the last_update field.

Done!!

I don't have ADHD, I have ADOS... Attention Deficit oooh SHINY!!

Booger Mobile (n) - A bright green 1964 Ford Falcon - our entry into the Camp Quality esCarpade!!
Do something wonderful - make a donation to Camp Quality today!!

Better yet, add a field to the table: PasswordExpired

I think you can figure out what to do with it.

A guide to posting questions on CodeProject[^]

Dave Kreskowiak
Microsoft MVP
Visual Developer - Visual Basic
2006, 2007, 2008
But no longer in 2009...

Dave Kreskowiak wrote:
I think you can figure out what to do with it.

Wouldn't put my money on it Smile | :)

Bob
Ashfield Consultants Ltd
Proud to be a 2009 Code Project MVP