Web Client
 

im trying to extract information from a website..
Ive tested my client on my university's email login page
IP is i dont know when to stop reading.. i never get the in what case do i exit this loop?
this is the output my program gives:
then the program hangs until the timeout on the website, then bursts out "=======" forever.. i guess this is becasue the website cut the TCP connection after the timeout and my program continued to recieve and output the result..

You are opening a persistent connection.


This is most likely due to HTTP/1.1; try using HTTP/1.0.

Look at this page for using recv, should help:

http://www.opengroup.org/onlinepubs/...ions/recv.html

Realize that recv returns a value. That value is how many bytes were read.
So read until it stops receiving bytes. Remember, it returns negative if there was an error, so handle that too.

This operation will block- which means, it will hang your application. This is not so great if your application wants to do other stuff while waiting for this data. To solve, you should put this into a seperate thread (unless your app doesn't do anything until it gets the data- in which case its ok BUT if this is GUI app, use thread or GUI will hang).

Also, you shouldn't put the declaration of your pointer inside the loop.
Also, you should consider not new/delete over and over in the loop. Instead, write to a buffer and reallocate the size as needed. There is a function called realloc that can help.


--

OP does have it only reading 1024 bytes at a time, but that can still be problematic for this reason. I would concur with climbnorth's suggestion of threading the recv(); alternatively, OP could use select() rather than recv() to set a timeout on the read.