![]() |
|
![]() |
|
|
Thread Tools | Display Modes |
|
|
#1 |
|
Newbie
Join Date: Aug 2005
Posts: 2
Rep Power: 0
![]() |
Extracting and submitting web data
Hi,
I'm looking for a way to extract data from a website that uses Javascript. I'd like to be able to write a program that monitors the site and build a data file of the information displayed on it. I've no idea how to go about doing this. Any ideas? Also, similarly, I'd like to be able to automatically input data into the javascript forms on the website, i.e. to submit information. Thanks Aled |
|
|
|
|
|
#2 |
|
Expert Programmer
Join Date: Aug 2005
Location: Rotterdam, the Netherlands
Posts: 942
Rep Power: 4
![]() |
I'm not really sure what you want, but can't you let users input data input in the form, post the data to another webpage, and pass the values as parameters for your applet?
|
|
|
|
|
|
#3 |
|
Professional Programmer
|
you can use perl, php, python, ruby or whatever to open a socket to the website, download the page, and grab whatever data you need. The problem might be the javascript, but you should ignore that, cuz it blows anyway.
-Dizz |
|
|
|
|
|
#4 |
|
Programming Guru
![]() ![]() ![]() |
yeah, i was actually goint to suggest Perl or PHP but I didn't know if this individual was die-hard javascript or not... lol
__________________
http://jasonpowers.net "There are a thousand hacking at the branches of evil to one who is striking at the root." |
|
|
|
|
|
#5 |
|
Newbie
Join Date: Aug 2005
Posts: 2
Rep Power: 0
![]() |
Sorry. Its the website that uses javascript. The data is in a javascript website, www.betfair.com, an I'd like to be able to read data from it / input data into it somehow.
|
|
|
|
|
|
#6 |
|
Professional Programmer
|
maybe you could use links2 or lynx to get the data, save it to an html file, and parse it from there, not sure quite sure. That's assuming you're on linux. If you're on windows, you're probably screwed.
|
|
|
|
|
|
#7 |
|
Programming Guru
![]() Join Date: Aug 2005
Location: England
Posts: 1,499
Rep Power: 5
![]() |
Take a look at HTTPUnit; it's a unit testing framework for web applications that supports most javascript functions. Obviously you don't want a unit testing framework, but the libraries that HTTPUnit uses could point you in the right direction.
|
|
|
|
![]() |
| Bookmarks |
| Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
| Thread Tools | |
| Display Modes | |
|
|