Regular Expressions

Does anyone have experience with creating the regex rule for a fail2ban filter?

9-Feb-24 12:02

Richard Deeming wrote:
but its never going to be 100% accurate.

Was the phrasing in my response not clear? I thought I was pointing that out in several places.

Member 161948782-Feb-24 4:44

Member 16194878

2-Feb-24 4:44

I am trying to create a filter for AH01264 errors. This is for bots trying to run standard "php"s or "pl"s off of my home server.

While I have figured out how enter and activate new filters in fail2ban, the regex required is way beyond my capabilities.

So was hoping someone here has done this before and could help me out.

Thank you

Re: Does anyone have experience with creating the regex rule for a fail2ban filter?

jschell7-Feb-24 5:38

Regex: more than one identical character next to each other?

7-Feb-24 5:38

This forum is for regex in general. So specifics to fail2ban are not likely to succeed.

Googling I found other posts about this although I did not look into it deeply.

fail2ban ah01264

Based on that seems possible at least.

But in general "error messages" across all applications are seldom well regulated. Thus attempts to capture them either lead to too few or too many. Until one has enough actual examples to code to. Even then updates might change that.

For this forum you can post a regex and examples and we can correct the regex from that.

Help for a regexp

Member 1616830421-Dec-23 23:43

Member 16168304

21-Dec-23 23:43

Good morning

I need to "purify" sentences to be able to use them in an app.
Thanks a lot for your help in helping me build the right code Smile | :)

I think the pattern is:

- 'any sentence' (0 or 1 time) {text here} (0-N times)

example
AB CD {xxxxx}
or AB CD {xxxxx,yyyy}
or {xxxxx}
or AB CD
or AB CD {xxxxx} AB CD {xxxxx}
or AB CD {xxxxx} {xxxxx} {xxxxx}
etc

- the {text here} block looks like {digit|some text}.
For example:
{1|xxxxxxxxx}

- the 'some text' block can (not mandatory) contain 'default=xxx' at any place in the text

ex: {3|abc=d,default=my value} or {2|a b c=d,default=my value,another=valueThatIDontNeed} or {1|default=my value}

I need to isolate the following parts and return them to a string.
- 'any sentence' text (if exists)
- xxx of the 'default=xxx' pattern, as per above explanation

This does not need to be done in one pass, I can script that in loops in Python for example.

Here are a few examples

Example 1
Store bulk masses greater than {0|message=<specify mass="" value="">|filter=^(_)?MASS_VALUE.+|add space after=false.+}{1|message=<specify mass="" unit="">|filter=^(_)?P413_MASS_UNIT.+} at temperatures not exceeding {2|message=<specify temperature="" value="">|filter=^(_)?TEMP_VALUE_.+|add space after=false.+}{3|message=<specify temperature="" unit="">|filter=^(_)?P413_TEMP_UNIT_.+}

this should give
Store bulk masses greater than at temperatures not exceeding

Example 2
Inhoud onder {0|message=<geschikt(e) vloeistof="" of="" gas="" specificeren="">|default=inert gas|filter=^(_)?P231_STORAGE_.+} gebruiken en bewaren. Tegen vocht beschermen.

Should give
Inhoud onder inert gas gebruiken en bewaren. Tegen vocht beschermen.

Example 3
EN CAS DE CONTACT AVEC LA PEAU: Laver abondamment{0|message=<préciser un="" produit="" de="" nettoyage="">|default=à l’eau|filter=^(_)?P352_WASH_.+}. Appeler immédiatement {1|message=<préciser qui="" pourra="" émettre="" comme="" il="" convient="" n="" avis="" médical="" en="" cas="" d’urgence="">|default=un CENTRE ANTIPOISON ou un médecin|filter=^(_)?P310_EMERGENCY_.+}.

Should give
EN CAS DE CONTACT AVEC LA PEAU: Laver abondamment à l’eau . Appeler immédiatement un CENTRE ANTIPOISON ou un médecin

Example 4

{0|message=<specificeren of="" dumpingvoorschriften="" van="" toepassing="" zijn="" op="" inhoud,="" container="">|default=Inhoud/verpakking|filter=^(_)?P501_REQUIREMENT_.+} afvoeren naar {1|message=<specificeer welke="" lokale="" regionale="" nationale="" internationale="" wetgeving="">|default=…|filter=^(_)?P501_DISPOSAL_.+}.

Should give
Inhoud/verpakking afvoeren naar … .

thanks !

Re: Help for a regexp

Member 1616830422-Dec-23 2:53

Member 16168304

22-Dec-23 2:53

I've been able to isolate text vs {} blocks in RegExr: Learn, Build, & Test RegEx[^] and Regex Tester and Debugger Online - Javascript, PCRE, PHP[^]
using

((?![{}])\w| )*|(({.*?}))

I'd then expert to use a python or php script to loop on groups , and for each group launch another regex to grep the "default=xxx" text only.

but using the same regex in python does not work Frown | :(

(
The regex does not isolate block the same way as the 2 websites do Frown | :(

Looking for a bit of help here Smile | :)

Thanks so much

Member 1615168129-Nov-23 7:07

Member 16151681

29-Nov-23 7:07

Hello all,
I'm a newbie to regex and need some help. What I want to do is to check if a filename contains two or more _ beneath each other.

For example: painting__test.pdf or painting___test2.pdf

those should be replaced by only one _

hope you can assist in solving.

kind regards
Franz-Georg

Re: Regex: more than one identical character next to each other?

Richard Deeming29-Nov-23 22:28

Richard Deeming

29-Nov-23 22:28

Find _{2,} and replace with _.

regex101: build, test, and debug regex[^]

"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer

Help me regexp gurus please problem is matching files and copy

Gin Mador11-Nov-23 15:27

Gin Mador

11-Nov-23 15:27

original folder "datasets to optimize" contains 1000s files like this

variable 2-3 dots and 1 dot with numbers 1.87.184 and 0.35643634, and sometimes they contain (#num#) at the end of number

how to copy matching files from "datasets to optimize" to "result"?

~/Documents/optimizer/datasets to optimize #

-rwxr-xr-x 1 root root 170K Nov 11 14:11 'MethodStats 1.87.184_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 193K Nov 11 14:11 'MethodStats 0.206117(4)_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 199K Nov 11 14:11 'MethodStats 9.58.155_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 187K Nov 11 14:11 'MethodStats 9.61.114_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 181K Nov 11 14:11 'MethodStats 9.6.185_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 212K Nov 11 14:11 'MethodStats 9.64.191_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 171K Nov 11 14:11 'MethodStats 9.66.150_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 231K Nov 11 14:11 'MethodStats 9.72.194_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 241K Nov 11 14:11 'MethodStats 9.73.138_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 176K Nov 11 14:11 'MethodStats 9.83.123_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 179K Nov 11 14:11 'MethodStats 9.83.125_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 181K Nov 11 14:11 'MethodStats 9.83.195_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 176K Nov 11 14:11 'MethodStats 9.85.133_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 218K Nov 11 14:11 'MethodStats 9.85.167_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 195K Nov 11 14:11 'MethodStats 9.86.177_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 178K Nov 11 14:11 'MethodStats 23.92.166(1)_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 210K Nov 11 14:11 'MethodStats 9.89.189_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 218K Nov 11 14:11 'MethodStats 0.2048140_vardata_L6_probin.txt'

and output folder "result" has the same but before that is added FW Retest

/root/Documents/optimizer/result

-rwxr-xr-x 1 root root 3.4M Nov 11 14:14 'FW Retest - MethodStats 1.87.184_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 2.7M Nov 11 14:15 'FW Retest - MethodStats 0.2048140_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 2.5M Nov 11 14:15 'FW Retest - MethodStats 0.206117(4)_vardata_L6_probin.txt'

-rwxr-xr-x 1 root root 2.4M Nov 11 14:15 'FW Retest - MethodStats 23.92.166(1)_vardata_L6_probin.txt'

how to copy matching files from "datasets to optimize" to "result"?

Re: Help me regexp gurus please problem is matching files and copy

jschell30-Nov-23 6:17

pattern replace with specific exception

30-Nov-23 6:17

I doubt this is a regular expression problem.

Best I can figure out you have files in directory A and you want to copy some of those to B.

Then I can't follow what you want because it is either to overwrite or for the missing ones.

In either case you will need a loop - which has nothing to do with regular expressions.

Member 1612263424-Oct-23 1:06

Member 16122634

24-Oct-23 1:06

I am looking for a substution RegEx which prefixes all words with a caret, except when followed by a bracket. E.g. "func(x)=y" must be replaced by "func(^x)=^y" .
I came up with (in Python code):
re.sub(r'([A-Za-z][A-Za-z0-9_]*)([^(]|$)', r'^\1\2', 'func(x)=y')
but that does not work. "f(x)=y" is replaced correctly, but it fails when the word before the bracket has more characters.
I suspect it can be done with a single substitution, but I can't figure it out. I guess my solution does not work because the first bracketed regular expression is not greedy enough. What am I doing wrong?

Re: pattern replace with specific exception

Member 1612263426-Oct-23 1:02

Member 16122634

26-Oct-23 1:02

I asked ChatGPT $Shucks | :-\$ and it suggested \b for word boundaries and (?!.) for negative look ahead assertion, so:

re.sub(r'(\b[A-Za-z][A-Za-z0-9_]*\b)(?!\()', r'^\1', 'val1+function(x)=y+val2+f(xx)')

'^val1+function(^x)=^y+^val2+f(^xx)'

works.....

Re: pattern replace with specific exception

Justice Marc20-Nov-23 5:10

Justice Marc

20-Nov-23 5:10

When you want to search and replace specific patterns of text, use regular expressions. They can help you in pattern matching, parsing, filtering of results, and so on. Once you learn the regex syntax, you can use it for almost any language. Press Ctrl 0R to open the search and replace pane.

Replacement of initial words

Luca Smith12-Oct-23 0:47

12-Oct-23 0:47

Good morning everyone,
I can't use regular formulas

I basically have to look for initials

(jolly)"se_meta":90

And I have to replace

Work09Document2023”se_meta”:90

Thanks and best regards

Roberto Grigis

OriginalGriff12-Oct-23 0:50

OriginalGriff

12-Oct-23 0:50

Quote:
I can't use regular formulas

Because you aren't allowed to, or because you don't know how to? It makes a big difference in the answer ...

What have you tried?
Where are you stuck?
What help do you need?

"I have no idea what I did, but I'm taking full credit for it." - ThisOldTony
"Common sense is so rare these days, it should be classified as a super power" - Random T-shirt
AntiTwitter: @DalekDave is now a follower!

Luca Smith12-Oct-23 0:54

12-Oct-23 0:54

I can’t use regular formulas

I have all the files containing:

Work09Document2022"se_meta":9001
Work09Document2022"se_meta":9002
Work09Document2022"se_meta":9003
Work09Document2022"se_meta":9004
Work09Document2022"se_meta":9005
.
.
.
(and so on)

I basically have to look for initials
(Wildcard)"se_meta":90

And I have to replace

Work09Document2023"se_meta":90

Thanks for your help

Roberto Grigis

OriginalGriff12-Oct-23 1:18

OriginalGriff

12-Oct-23 1:18

At the risk of repeating myself...

Quote:
Because you aren't allowed to, or because you don't know how to? It makes a big difference in the answer ...

What have you tried?
Where are you stuck?
What help do you need?

Luca Smith12-Oct-23 1:40

12-Oct-23 1:40

For the REGEX program or also NOTEPAD++

Thanks and best regards

Dave Kreskowiak12-Oct-23 3:02

Dave Kreskowiak

12-Oct-23 3:02

What's a "regular formula"? Are you talking about "regular expressions"?

You're not going to get any answers to whatever question you have until you spell out, in detail, the actual question.

Asking questions is a skill
CodeProject Forum Guidelines
Google: C# How to debug code
Seriously, go read these articles.
Dave Kreskowiak

Richard Deeming12-Oct-23 1:45

Richard Deeming

12-Oct-23 1:45

For a manual process, use something like PowerRename[^].

If you want to do this in code, you're going to need to provide a lot more detail. But since you keep ignoring OG's questions, I won't hold my breath.

"These people looked deep within my soul and assigned me a number based on the order in which I joined."
- Homer

Luca Smith12-Oct-23 1:59

12-Oct-23 1:59

Thanks for your help,
that's not what I'm interested in. Find and replace within the file

Dave Kreskowiak12-Oct-23 3:01

Dave Kreskowiak

12-Oct-23 3:01

STOP TYPING AS LITTLE AS POSSIBLE AND ACTUALLY EXPLAIN WHAT YOU'RE HAVING A PROBLEM DOING!!!!

Asking questions is a skill
CodeProject Forum Guidelines
Google: C# How to debug code
Seriously, go read these articles.
Dave Kreskowiak

Terry R 202313-Oct-23 9:22

Terry R 2023

13-Oct-23 9:22

Given the conversation here and that you were equally sparse on words in your question on the Notepad++ forum https://community.notepad-plus-plus.org/topic/25021/regular-formulas it does seem that you don't read the replies properly and respond with a LOT more information.

If it wasn't for the pigeon English feel I'd almost say this is an AI conversation.

Terry

OriginalGriff12-Oct-23 2:38

OriginalGriff

12-Oct-23 2:38

I think we are witnessing a Miracle Of Life: the birth of a Help Vampire. Fascinating - you don't often get to see them in the wild until they are at least 3 years old ... Big Grin | :-D

jschell12-Oct-23 5:21