Programming Forums
User Name Password Register
 

RSS Feed
FORUM INDEX | TODAY'S POSTS | UNANSWERED THREADS | ADVANCED SEARCH

Reply
 
Thread Tools Display Modes
Old Dec 21st, 2007, 7:03 PM   #11
mbd
Programmer
 
Join Date: Nov 2007
Posts: 74
Rep Power: 1 mbd is on a distinguished road
Re: Count number of occourences of a IP address in a log file.

perl Syntax (Toggle Plain Text)
  1. #!/usr/bin/perl
  2.  
  3. @log = <STDIN>;
  4. $log = join '', @log;
  5. while ($log =~ m/(\d+\.\d+\.\d+\.\d+\s)/g)
  6. {
  7. $ip = $1;
  8. chomp $ip;
  9. $count = ($log =~ s/$1/$1/g);
  10. print "$ip $count\n";
  11. }
$ time cat ipaddr.txt | perl count.pl > report.txt

real	4m9.138s
user	3m7.281s
sys	0m58.301s
if i were going to run this more than once, i would probably change it to your method like this
perl Syntax (Toggle Plain Text)
  1. #!/usr/bin/perl
  2.  
  3. @log = <STDIN>;
  4. $log = join '', @log;
  5. while ($log =~ m/(\d+\.\d+\.\d+\.\d+\s)/g)
  6. {
  7. $ip = $1;
  8. chomp $ip;
  9. ++ $count{$ip};
  10. }
  11. foreach $ip (keys %count)
  12. {
  13. print "$ip $count{$ip}\n";
  14. }
$ time cat ipaddr.txt | perl hashcount.pl > report.txt

real	0m0.501s
user	0m0.433s
sys	0m0.052s
happy holidays all
Attached Files
File Type: txt report.txt (1.55 MB, 11 views)
mbd is offline   Reply With Quote
Old Dec 22nd, 2007, 9:48 AM   #12
Sane
Programming Guru
 
Sane's Avatar
 
Join Date: Apr 2005
Posts: 1,722
Rep Power: 5 Sane is on a distinguished road
Re: Count number of occourences of a IP address in a log file.

Hah, I can't believe Perl can actually do that in a matter of minutes. But it's still pretty clear that the associative array takes the cake with half a second.

Thanks for that demo. Cheers.
Sane is offline   Reply With Quote
Old Dec 22nd, 2007, 10:42 AM   #13
lynxus
Newbie
 
Join Date: Dec 2007
Posts: 4
Rep Power: 0 lynxus is on a distinguished road
Re: Count number of occourences of a IP address in a log file.

Hey guy's,

Glad your all debating how to do this..

I have NO idea what that code does so could anyone clarify what i need to do to achieve my goal hehe.

Thanks again.
Graham
lynxus is offline   Reply With Quote
Old Dec 22nd, 2007, 11:26 AM   #14
Sane
Programming Guru
 
Sane's Avatar
 
Join Date: Apr 2005
Posts: 1,722
Rep Power: 5 Sane is on a distinguished road
Re: Count number of occourences of a IP address in a log file.

mbd's posted code snippet outputs how many instances, of each IP address, are in the log file that Jessehk posted. I'd recommend using his second snippet (which is the psuedocode that I suggested in my first post), since it takes less than half a second to execute. If you know Perl you should be able to modify it to fit your needs.
Sane is offline   Reply With Quote
Reply

Bookmarks

« Previous Thread in Forum | Next Thread in Forum »

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Jumping to a specific line number in a text file Adeil C++ 4 Nov 5th, 2007 9:54 AM
PigLattin Converter, count number of words used in dictionary. MrSmiley Python 2 Oct 17th, 2005 4:47 PM
After execution - Error cannot locate /Skin File? wchar Visual Basic 1 Mar 5th, 2005 9:04 PM
airport Log program using 3D linked List : problem reading from file gemini_shooter C++ 0 Mar 2nd, 2005 4:12 PM
Specific file address... Monkey_features Delphi 0 Feb 8th, 2005 5:05 PM




DaniWeb IT Discussion Community
All times are GMT -5. The time now is 5:42 AM.

Powered by vBulletin® Version 3.7.0, Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Copyright ©2007 DaniWeb® LLC