Komodo

http://"username":"password"@www.crazedmindz.com:2082/frontend/x/index.html
would log me in to the CPanel for crazedmindz.com


Would a script be able to crawl a password protected page like that,
and use something like substr() and strpos() to grab certain
information from the page, like first search the whole page for any
links to pages that are also on that website, and then search the page
for links to a certain type of file, and add them all to a database,
and then go through the pages that were found and do the same thing?


I ain't gonna lie, I plan on using this to crawl porn sites.

Please help...