Matching compelete words of a string against a list

Question

4.00/5 (1 vote)

See more:

I want to match words of a complete sentence against a list of words, and if contain not to proceed to next step. However, it matches partially as well.

For example, if my list contain a word 'me' and in the sentence there is a word 'some' it fails.

What I have tried:

What I've done,

Python

if not any(word in text_sentence.lower().strip() for word in banned_words):
    # Proceed to next level, as a valid sentence

Once I pass "Some one like you" it fails, as my list contain a word "me". Verified simply printing the words.

Python

for item in banned_words:
    if item in slbot_tweet:
        print(item)

Posted 15-Aug-18 19:46pm

CodingLover

Updated 15-Aug-18 22:14pm

Add a Solution

2 solutions

Solution 3

Your tweet text is not an array of words, but an array of characters. As OriginalGriff says, you need to break it up into a proper array of tokens (words) first. Use the string.split()[^] method.

Posted 15-Aug-18 22:14pm

Richard MacCutchan

Comments

CodingLover 16-Aug-18 4:33am

Yes, it works once tokanized. Was miss-up with strip() and split().

Add a Solution

Add your solution here

Treat my content as plain text, not as HTML

Preview 0

…

Existing Members

Sign in to your account

...or Join us

Download, Vote, Comment, Publish.

Your Email
Password
Forgot your password?

Your Email
This email is in use. Do you need your password?
Optional Password

I have read and agree to the Terms of Service and Privacy Policy
Please subscribe me to the CodeProject newsletters

When answering a question please:

Read the question carefully.
Understand that English isn't everyone's first language so be lenient of bad spelling and grammar.
If a question is poorly phrased then either ask for clarification, ignore it, or edit the question and fix the problem. Insults are not welcome.
Don't tell someone to read the manual. Chances are they have and don't get it. Provide an answer or move on to the next question.

Let's work to help developers, not make them feel stupid.

This content, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

OriginalGriff · Accepted Answer · 2018-08-15T19:57:00

You need to break your sentence down into individual word tokens, using all forms of punctuation as delimiters: quotes, double quotes, comma, space, dot, colon, semicolon, brackets, exclamation, hyphen, and anything else your user is likely to type to mask it: I'd suggest breaking it on anything that isn't a letter of number!

Once you have the string as an array of word tokens, you can check if any of them are in the "banned" list.