|
I need to parse Log files with different operations that will require different grammars as each operation is organized differently. I have been using
char[] delimiterChars = { ',' 'WHATEVER' }; to detemine what gets parsed. the problem with that is, it does not seem to discriminate which parameter it chooses and when. Is there anyway to make it a little more automated instead of just creating a whole bunch of delimiter chars and then calling them in order at which they wouldd appear?
|
|
|
|
|
I have no idea as to what you mean... please examplify
My opinion is... If someone has already posted an answer, dont post the SAME answer
|
|
|
|
|
Can you provide a small sample of the various types of data?
|
|
|
|
|
directly from the log file:
E 12:28:45 Line 1 : Dispense
tip 1 : dispense 0.00nl 1, 1 Deep Well, landscape [1,1]
10.00µl ">> Water << 23" Fixed <3 - 50µl> Single
E 12:28:47 Line 2 : Aspirate
tip 1 : aspirate 60.00µl 1, 1 Deep Well, landscape [1,2]
10.00µl "Water" Fixed <3 - 50µl> Multi
E 12:28:45 Line 1 : Dispense
tip 1 : dispense 0.00nl 1, 1 Deep Well, landscape [1,1]
10.00µl ">> Water << 23" Fixed <3 - 50µl> Single
E 12:28:47 Line 2 : Aspirate
tip 1 : aspirate 60.00µl 1, 1 Deep Well, landscape [1,2]
10.00µl "Water" Fixed <3 - 50µl> Multi
|
|
|
|
|
scratch the last reply...
these three commands are the bread and butter of the operations. most are just combination of these 3...
E 12:28:45 Line 1 : Dispense
tip 1 : dispense 0.00nl 1, 1 Deep Well, landscape [1,1]
10.00µl ">> Water << 23" Fixed <3 - 50µl> Single
E 12:28:47 Line 2 : Aspirate
tip 1 : aspirate 60.00µl 1, 1 Deep Well, landscape [1,2]
10.00µl "Water" Fixed <3 - 50µl> Multi
E 12:28:57 Line 3 : Wash Tips
wash (2ml + 1ml), grid 26 and grid 26
now they look similar but each hasa different set of information needed to cut out or set as variables. I do plan on calling a "dispense", "asperate" and "Wash Tips" grammar structure when needed. if i tell it to parse at the comma's, i will get data that i dont want. I could remember each value of the word, and set that to a variable like word[1]=volume and word[5]=fluid type but i dont really want to do that. is there any way to make it a little more automated so that it knows the sequence to skip over bits not biased on charactor length as that will change as well.
|
|
|
|
|
Hi,
I've reviewed your posts on the topic of parsing these instrument log files. What I haven't got from any of your questions is what information you want to extract.
So, for example, in the log just posted what output do you want?
Alan.
|
|
|
|
|
Oh, this is the same thing I've seen posted before.
I'd use a Regular Expression. Not having much else to do today, I think I'll experiment a little... I'll be back.
|
|
|
|
|
So far I've created this Regex:
System.Text.RegularExpressions.Regex reg = new System.Text.RegularExpressions.Regex
(
@"(?'Type'\S)\s(?'Time'\d\d:\d\d:\d\d)\sLine\s*(?'Line'[^:]*)\s:\s(?'Operation'[^\r]*)\r\n(?'Data'([^\r]*\r){1,3})"
,
System.Text.RegularExpressions.RegexOptions.Compiled |
System.Text.RegularExpressions.RegexOptions.Singleline |
System.Text.RegularExpressions.RegexOptions.CultureInvariant
) ;
It matches the three log entries you provided and provides the named groups:
E 12:28:45 Line 1 : Dispense
- -------- - --------
| | | |
| | | Operation
| | Line
| Time
Type
and then the following two or three lines go into Data
You can then use the Operation to determine further processing of the Data, perhaps each operation would have its own Regex to parse its data.
|
|
|
|
|
Sorry for the late reply I thank you for the help. So far you have pretty much hit the pin on the head. The problem here is... I dont know what you mean by regular expressions and how I would build them for each operation. Ill show you the desired data and maybe give some pointers on how to create one for this operation and then Ill be able to use that to create more. This is the dispense operation.
tip 1 : dispense 0.00nl 1, 1 Deep Well, landscape [1,1]
----- | | | |
| | | | |
a b c d e
10.00µl ">> Water << 23" Fixed <3 - 50µl> Single
----- ----
| |
| |
f g
Also, my plan right now is to take each word that is parsed in the array, assign the desired arrays with the proper variables (time=word[8]) and work it that way. Im not sure if that is the most effective way to do it, im sure it will work but maybe not the best.
|
|
|
|
|
Ignore the last post forgot the change HTML setting
Sorry for the late reply I thank you for the help. So far you have pretty much hit the pin on the head. The problem here is... I dont know what you mean by regular expressions and how I would build them for each operation. Ill show you the desired data and maybe give some pointers on how to create one for this operation and then Ill be able to use that to create more. This is the dispense operation.
tip 1 : dispense 0.00nl 1, 1 Deep Well, landscape [1,1]
----- | | | |
| | | | |
a b c d e
10.00µl ">> Water << 23" Fixed <3 - 50µl> Single
----- ----
| |
| |
f g
Also, my plan right now is to take each word that is parsed in the array, assign the desired arrays with the proper variables (time=word[8]) and work it that way. Im not sure if that is the most effective way to do it, im sure it will work but maybe not the best.
|
|
|
|
|
You could put the stuff in a "code block" to have it appear properly in the message.
|
|
|
|
|
Could you explain what each section of this line means?
@"(?'Type'\S)\s(?'Time'\d\d:\d\d:\d\d)\sLine\s*(?'Line'[^:]*)\s:\s(?'Operation'[^\r]*)\r\n(?'Data'([^\r]*\r){1,3})"
Im trying to find a legend for all the possibilities but i dont even know where to start...
|
|
|
|
|
(?'Type'\S) There must be a non-whitespace character, capture it in group Type
\s Then there must be one whitespace character
(?'Time'\d\d:\d\d:\d\d) Then there must be a sequence of six decimal digits separated by colons, capture it in group Time
\sLine\s* Then there must be a whitespace character, the characters L i n e, and zero or more whitespace characters.
(?'Line'[^:]*) Then capture everything up to (but not including) the next colon in group Line
\s:\s Then there must be a whitespace character, a colon, and another whitespace character.
(?'Operation'[^\r]*) Then capture everything up to (but not including) the next carriage return in group Operation
\r\n There must then be a carriage return and a linefeed.
(?'Data'([^\r]*\r){1,3}) And finally capture everything from there through the next few carriage returns, there must be at least one and at most three carriage returns. Capture this into the Data group.
|
|
|
|
|
thanks this is working perfectly except for one thing. under operation, serveral of the operations have spaces between them. I cant seem to find an expression that says "include everything here, and if it has a space include that too" into the operations group. is that even possible?
|
|
|
|
|
The Operation group should contain everything up to the next carriage return. Doesn't it? Culd you post an example of a problematic string?
|
|
|
|
|
example here:
E 10:45:05 Line 5 : Wash Tips
|
|
|
|
|
so i was playing around and it seems it will include if there are spaces as it is. The problem seems to be from the data portion.
|
|
|
|
|
OK, so what's the problem?
|
|
|
|
|
these are the two different operations i have:
E 10:45:03 Line 4 : Dispense
tip 1 : dispense 20.56µl 6, 3 Deep Well, landscape [1,1]
10.00µl ">> Water << 23" Fixed <3 - 50µl> Single
and
E 10:45:05 Line 5 : Wash Tips
wash (2ml + 1ml), grid 20 and grid 20
the first line is great works fine, but with wash tips it doesnt seem to follow the pattern. when i replace the 2nd line in wash tips with the 2nd and 3rd line of dispense everything is kosher.
another problem im having is, id like to have the file read line by line but i cant seem to get that done too.
|
|
|
|
|
sorry for the trouble... i think i fixed it... again thanks and sorry
|
|
|
|
|
I'm developing a vector graphics app and I'm to the part of allowing rotations to the shapes. Since I'm using C# I don't know all of the pros and cons of the two following methods. Could one of you gurus out there clear up the confusion? Keep in mind that I'm using the Matrix class for page scaling and panning. The functionality that I'm refering to must allow independent transforms on each shape.
Method 1: Rotate the shape (vectors) purely by trig. If the user then resizes the shape, the shape must be resized along the rotated axis.
Method 2: Use the matrix class to transform the vectors. My drawback on this method is that on every paint and mouseover, mousedown, mouseout event, the shape would have to be repeatedly transformed. Wouldn't this be a cpu hog?
My code this week has no errors. But it's Monday morning and I haven't got out of bed.
|
|
|
|
|
Didn't you ask this before? I suggested you take a look at Piccolo.
Matrixes are going to be faster than trig. Transforming a point by a matrix is a handful of operations.
If you have a great deal of points, then regardless of using matrixes or trig, you will need to implement view caching / damage and spatial indexing.
|
|
|
|
|
Hey Mark,
Thanks for the info. I'll take a more serious look at Piccolo.
In the mean time I've done some research about matrixes. It does appear to be the way to go! My work will definitely be much easier.
Thanks again,
Richard Blythe
My code this week has no errors. But it's Monday morning and I haven't got out of bed.
|
|
|
|
|
I am coding an override for OnDragDrop, only DataFormat.FileDrop is valid, tested for in OnDragEnter and in the OnDragDrop handler.
I've just reviewed the code and noticed that I have put in a if (File.Exists(filename)) test before allowing the drop.
Is this test redundant? I mean, are there any circumstances in which a DataFormats.FileDrop can occur apart from when dragging from explorer, or other shell source.
This must be a really daft question but my brain is going in circles at the moment and I can't get my head round it.
Henry Minute
Do not read medical books! You could die of a misprint. - Mark Twain
Girl: (staring) "Why do you need an icy cucumber?"
“I want to report a fraud. The government is lying to us all.”
|
|
|
|
|
Henry Minute wrote: are there any circumstances in which a DataFormats.FileDrop can occur apart from when dragging from explorer, or other shell source.
I've never tried it, but I suspect any application can create a FileDrop event. Furthermore I suspect it is possible to do it such that your test would evaluate to false.
|
|
|
|
General 
News 
Suggestion 
Question 
Bug 
Answer 
Joke 
Praise 
Rant 
Admin 
Submit an article or tip
