Programming Forums > Script Programming > Python

Ooble · Mar 5th, 2005, 10:53 AM

I'm pretty sure that's the easiest way to do it.

Fred · Mar 5th, 2005, 11:43 AM

Quote:

Originally Posted by al1986

Couldn't you just use the "count" method of the string type?
e.g.

s = "h h h"
s.count("h")

(returns 3)

This only has one problem... You have to know, which words are in the textfile...

Dietrich · Mar 5th, 2005, 6:43 PM

Quote:

Originally Posted by al1986

Couldn't you just use the "count" method of the string type?
e.g.

s = "h h h"
s.count("h")

(returns 3)

This will work, if I look for a particular word. The original intent!

Now I am getting curious, and want to make a full word count. I could make two word lists. One list would only have unique words, let's say wList1. Then I could go through the original word list wList2 with
wCount[k] = wList2.count(wList1[k])
with k in the range 0 to len(wList1), or something like that.
However, I don't know how to make a list of unique words from the original list!

Like Homer says: "Got to use all the power of my brain!"

Dietrich · Mar 5th, 2005, 7:24 PM

This is what I came up with, thanks for the help!

(Toggle Plain Text)

# Read the entire text from file into a string
# How many times does a particular word appear?

fileHandle = open ( 'NationalAnthemUSA.txt', 'r' )
str = fileHandle.read()
print str
fileHandle.close()

wordCount = str.count("free")
print "The word 'free' appears %d times." % (wordCount)

Still curious about the full word count and the list of unique words! Any thoughts?

al1986 · Mar 6th, 2005, 8:26 AM

I think you can remove duplicate words easily enough using the 'set' data type. e.g.

(Toggle Plain Text)

s = "this this is just a test test"
mySet = set(s.split()) # Create a set of unique strings
print " ".join(mySet)

This won't retain the order of the original string though (sets are unordered).

Dietrich · Mar 6th, 2005, 3:18 PM

Quote:

Originally Posted by al1986

I think you can remove duplicate words easily enough using the 'set' data type. e.g.

(Toggle Plain Text)

s = "this this is just a test test"
mySet = set(s.split()) # Create a set of unique strings
print " ".join(mySet)

This won't retain the order of the original string though (sets are unordered).

This sounds interesting. Got to study up on sets real quick. Even though I am importing sets I am getting a
NameError: name 'set' is not defined

Any idea?

al1986 · Mar 6th, 2005, 3:43 PM

As far as I know, in versions of Python prior to 2.4, you have to import the sets module. In version 2.4, they're built-in.

http://www.python.org/doc/2.4/whatsnew/node2.html
http://www.python.org/doc/2.4/tut/no...00000000000000

Dietrich · Mar 7th, 2005, 2:26 AM

Okay, thanks for the hint!

Had to import sets with Python 2.3
Works well now!

Dietrich · Mar 7th, 2005, 11:04 AM

This is where I am with the project:

(Toggle Plain Text)

# Read the entire text from a file into a string
# How many times does each word in the text appear?
# Need to find a way to remove all punctuation marks!
# I am using Python 2.3

import sets

fileHandle = open ( 'NationalAnthemUSA.txt', 'r' )
# read entire text into a string
str = fileHandle.read()
print str
fileHandle.close()

# convert string to a set of unique words
wordSet = sets.Set( str.split() )
print wordSet

# march through the set word by word
for word in wordSet:
  wordCount = str.count( word )
  print word, '=', wordCount

As you can figure out, the problems are the punctuation marks. They are attached to the word and that makes that word unique. So I got to find a way to strip them off or remove them from the whole string. Is there a good way?

al1986 · Mar 7th, 2005, 12:31 PM

You could generate a string containing all the punctuation characters by doing:

(Toggle Plain Text)

>>> import string
>>> punc = string.punctuation
>>> punc
'!"#$%&\'()*+,-./:;<=>?@[\\]^_`{|}~'

Convert the original string into a list using list(str). Call this list 'l'.
Then, you could use a list comprehension to build a new list containing only characters that don't appear in the string 'punc'. In other words, you're getting rid of all the punctuation characters.

The following list comprehension should work:

(Toggle Plain Text)

[x for x in l if x not in punc]

There are other ways to do this e.g. by using the built-in 'filter' function or a simple loop. The list comprehension is short and sweet, though. The final step would be to join the list.

Hope this helps!

Mar 5th, 2005, 10:53 AM	#11
Ooble I eat cake for breakfast. Join Date: Jul 2004 Location: In my box. Posts: 4,434 Rep Power: 9	I'm pretty sure that's the easiest way to do it. __________________ Me :: You :: Them

Mar 5th, 2005, 7:24 PM	#14
Dietrich Professional Programmer Join Date: Feb 2005 Posts: 434 Rep Power: 4	This is what I came up with, thanks for the help! (Toggle Plain Text) # Read the entire text from file into a string # How many times does a particular word appear? fileHandle = open ( 'NationalAnthemUSA.txt', 'r' ) str = fileHandle.read() print str fileHandle.close() wordCount = str.count("free") print "The word 'free' appears %d times." % (wordCount) # Read the entire text from file into a string # How many times does a particular word appear? fileHandle = open ( 'NationalAnthemUSA.txt', 'r' ) str = fileHandle.read() print str fileHandle.close() wordCount = str.count("free") print "The word 'free' appears %d times." % (wordCount) Still curious about the full word count and the list of unique words! Any thoughts? __________________ I looked it up on the Intergnats!

Mar 6th, 2005, 8:26 AM	#15
al1986 Newbie Join Date: Feb 2005 Posts: 24 Rep Power: 0	I think you can remove duplicate words easily enough using the 'set' data type. e.g. (Toggle Plain Text) s = "this this is just a test test" mySet = set(s.split()) # Create a set of unique strings print " ".join(mySet) s = "this this is just a test test" mySet = set(s.split()) # Create a set of unique strings print " ".join(mySet) This won't retain the order of the original string though (sets are unordered).

Mar 7th, 2005, 2:26 AM	#18
Dietrich Professional Programmer Join Date: Feb 2005 Posts: 434 Rep Power: 4	Okay, thanks for the hint! Had to import sets with Python 2.3 Works well now! __________________ I looked it up on the Intergnats!

Mar 7th, 2005, 11:04 AM	#19
Dietrich Professional Programmer Join Date: Feb 2005 Posts: 434 Rep Power: 4	This is where I am with the project: (Toggle Plain Text) # Read the entire text from a file into a string # How many times does each word in the text appear? # Need to find a way to remove all punctuation marks! # I am using Python 2.3 import sets fileHandle = open ( 'NationalAnthemUSA.txt', 'r' ) # read entire text into a string str = fileHandle.read() print str fileHandle.close() # convert string to a set of unique words wordSet = sets.Set( str.split() ) print wordSet # march through the set word by word for word in wordSet: wordCount = str.count( word ) print word, '=', wordCount # Read the entire text from a file into a string # How many times does each word in the text appear? # Need to find a way to remove all punctuation marks! # I am using Python 2.3 import sets fileHandle = open ( 'NationalAnthemUSA.txt', 'r' ) # read entire text into a string str = fileHandle.read() print str fileHandle.close() # convert string to a set of unique words wordSet = sets.Set( str.split() ) print wordSet # march through the set word by word for word in wordSet: wordCount = str.count( word ) print word, '=', wordCount As you can figure out, the problems are the punctuation marks. They are attached to the word and that makes that word unique. So I got to find a way to strip them off or remove them from the whole string. Is there a good way? __________________ I looked it up on the Intergnats!

Mar 6th, 2005, 3:43 PM	#17
al1986 Newbie Join Date: Feb 2005 Posts: 24 Rep Power: 0	As far as I know, in versions of Python prior to 2.4, you have to import the sets module. In version 2.4, they're built-in. http://www.python.org/doc/2.4/whatsnew/node2.html http://www.python.org/doc/2.4/tut/no...00000000000000

Mar 7th, 2005, 12:31 PM	#20
al1986 Newbie Join Date: Feb 2005 Posts: 24 Rep Power: 0	You could generate a string containing all the punctuation characters by doing: (Toggle Plain Text) >>> import string >>> punc = string.punctuation >>> punc '!"#$%&\'()+,-./:;<=>?@[\\]^_`{\|}~' >>> import string >>> punc = string.punctuation >>> punc '!"#$%&\'()+,-./:;<=>?@[\\]^_`{\|}~' Convert the original string into a list using list(str). Call this list 'l'. Then, you could use a list comprehension to build a new list containing only characters that don't appear in the string 'punc'. In other words, you're getting rid of all the punctuation characters. The following list comprehension should work: (Toggle Plain Text) [x for x in l if x not in punc] [x for x in l if x not in punc] There are other ways to do this e.g. by using the built-in 'filter' function or a simple loop. The list comprehension is short and sweet, though. The final step would be to join the list. Hope this helps!

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Programming Forums > Script Programming > Python

Find a word in a text file