Programming Forums > Application Development > Java

megaskins · Feb 17th, 2006, 8:18 PM

I need to read the source HTML of a browser page while that page is up and running and possibly rewrite that source and send it back or intercept the stream going out and change it.

I've never coded anything like this before.

Any ideas on how to do this?

Thanks.

Darkhack · Feb 18th, 2006, 12:39 AM

What language are you planning to write this in? I know several languages that have functions where you simply type in the URL and they can pull the HTML source. Is that what you wanted or did you want it to only pull the HTML from pages that are being viewed by the user at that time? Also, what do you want to do with it. You said something about rewriting the source, but I don't quite understand what you want to do with the HTML once you've rewritten it. Could you be more specific?

Arevos · Feb 18th, 2006, 9:26 AM

Since this is the Java forum, I'll hazard a guess and say he wants to program it in Java

(Toggle Plain Text)

public static void main(String[] args) 
	throws IOException, MalformedURLException
{
	URL url = new URL("http://www.monkeyengines.co.uk");
	
	BufferedReader reader = new BufferedReader(
			new InputStreamReader(url.openStream())
	);
	while (true)
	{
		String line = reader.readLine();
		
		if (line == null) {
			break;
		}
		System.out.println(line);
	}
}

That's some simple code to get the source from a URL. What I guess you want is some sort of HTTP proxy...

Have you thought of using a prewritten HTTP proxy? Some of them are pretty flexible.

Here's a page that lists some java-based HTTP proxies.

megaskins · Feb 18th, 2006, 7:58 PM

Thanks for the responses guys.

I'll write in any language that I have to use, I guess.

The application I'm working on has to intercept the HTTP stream comming in and going out from a particular url.

Feb 17th, 2006, 8:18 PM	#1
megaskins Newbie Join Date: Feb 2006 Posts: 2 Rep Power: 0	Reading source from a browser or intercepting the HTML stream over HTTP I need to read the source HTML of a browser page while that page is up and running and possibly rewrite that source and send it back or intercept the stream going out and change it. I've never coded anything like this before. Any ideas on how to do this? Thanks.

Feb 18th, 2006, 9:26 AM	#3
Arevos Programming Guru Join Date: Aug 2005 Location: England Posts: 1,499 Rep Power: 5	Since this is the Java forum, I'll hazard a guess and say he wants to program it in Java (Toggle Plain Text) public static void main(String[] args) throws IOException, MalformedURLException { URL url = new URL("http://www.monkeyengines.co.uk"); BufferedReader reader = new BufferedReader( new InputStreamReader(url.openStream()) ); while (true) { String line = reader.readLine(); if (line == null) { break; } System.out.println(line); } } public static void main(String[] args) throws IOException, MalformedURLException { URL url = new URL("http://www.monkeyengines.co.uk"); BufferedReader reader = new BufferedReader( new InputStreamReader(url.openStream()) ); while (true) { String line = reader.readLine(); if (line == null) { break; } System.out.println(line); } } That's some simple code to get the source from a URL. What I guess you want is some sort of HTTP proxy... Have you thought of using a prewritten HTTP proxy? Some of them are pretty flexible. Here's a page that lists some java-based HTTP proxies.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Feb 18th, 2006, 12:39 AM	#2
Darkhack Hobbyist Programmer Join Date: Dec 2005 Location: Kansas City Posts: 105 Rep Power: 3	What language are you planning to write this in? I know several languages that have functions where you simply type in the URL and they can pull the HTML source. Is that what you wanted or did you want it to only pull the HTML from pages that are being viewed by the user at that time? Also, what do you want to do with it. You said something about rewriting the source, but I don't quite understand what you want to do with the HTML once you've rewritten it. Could you be more specific?

Feb 18th, 2006, 7:58 PM	#4
megaskins Newbie Join Date: Feb 2006 Posts: 2 Rep Power: 0	Thanks for the responses guys. I'll write in any language that I have to use, I guess. The application I'm working on has to intercept the HTTP stream comming in and going out from a particular url.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)

Programming Forums > Application Development > Java

Reading source from a browser or intercepting the HTML stream over HTTP