Process each word in a sentence

Question

Find words in the sentence and process each word.

Solution

import re

WORD_REGEX = re.compile(r"[\w'-]+")

def do_something_with_word(word):
    print(word)

def words_in_file(file_name):
    with open(file_name) as fh:
        for line in fh:
            for word in WORD_REGEX.finditer(line):
                do_something_with_word(word.group(0))

def main():
    words_in_file('./files_processing_every_word.py')

if __name__ == '__main__':
    main()

Explanation

The program creates a REGEX for matching words and uses regex.finditer(line) to find all the words matching the regular expression in a line.

Running the program over itself produces the output like this.

import
re
WORD_REGEX
re
compile
r
w'-
def
do_something_with_word
word
print
word
def
words_in_file
file_name
with
open
file_name
as
fh
for
line
in
fh
for
word
in
WORD_REGEX
finditer
line
do_something_with_word
word
group
0
def
main
words_in_file
'
files_processing_every_word
py'
if
__name__
'__main__'
main

See also

• Suggest a Code Improvement:files_processing_every_word.py

• Suggest a better explanation for files_processing_every_word.rst

previous

Count Lines in a Large File

next

Using Random Access Input Output