Re: unusual return (permanently migrated)

On Sun, Nov 9, 2008 at 8:16 AM, Mohan gupta <mohangupta13@gmail.com> wrote:

> but when i try to view this from the browser with exactly the same url
> i have the image .....what can be wrong....

At first glance nothing is wrong. Your server is sending a redirect.
Your browser will follow this redirect without you being aware of it.
The program that produced the output you showed us appears not to
follow redirects. This can be by design, or this can be a bug, or it
can be just an invocation or configuration issue.
This cannot be determined without more knowledge of this program however.

What is the command that produced this output and what do you expect from it?

Krist

--
krist.vanbesien@gmail.com
krist@vanbesien.org
Bremgarten b. Bern, Switzerland
--
A: It reverses the normal flow of conversation.
Q: What's wrong with top-posting?
A: Top-posting.
Q: What's the biggest scourge on plain text email discussions?

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org

thanks man for replying ...
actually the program is my one made
iam trying to make a web crawler so iam using unix socket api's
as i use
write(sockfd,"GEt url HTTP 1.1\r\nHost:\r\n\r\n",30);
and then read it
read(sockfd,buf,sizeof(buf));

but i dont understand what do u mean by redirect ...i mean when someone
redirects it gives a nrw url to follow?????
where do you find that url in the reply if it does so???

thanx
Mohan

On Sun, Nov 9, 2008 at 2:53 PM, Krist van Besien
<krist.vanbesien@gmail.com>wrote:

> On Sun, Nov 9, 2008 at 8:16 AM, Mohan gupta <mohangupta13@gmail.com>
> wrote:
>
> > but when i try to view this from the browser with exactly the same url
> > i have the image .....what can be wrong....
>
> At first glance nothing is wrong. Your server is sending a redirect.
> Your browser will follow this redirect without you being aware of it.
> The program that produced the output you showed us appears not to
> follow redirects. This can be by design, or this can be a bug, or it
> can be just an invocation or configuration issue.
> This cannot be determined without more knowledge of this program however.
>
> What is the command that produced this output and what do you expect from
> it?
>
> Krist
>
> --
> krist.vanbesien@gmail.com
> krist@vanbesien.org
> Bremgarten b. Bern, Switzerland
> --
> A: It reverses the normal flow of conversation.
> Q: What's wrong with top-posting?
> A: Top-posting.
> Q: What's the biggest scourge on plain text email discussions?
>
> ---------------------------------------------------------------------
> The official User-To-User support forum of the Apache HTTP Server Project.
> See <URL:http://httpd.apache.org/userslist.html> for more info.
> To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
> " from the digest: users-digest-unsubscribe@httpd.apache.org
> For additional commands, e-mail: users-help@httpd.apache.org
>
>

On Sun, Nov 9, 2008 at 1:24 PM, Mohan gupta <mohangupta13@gmail.com> wrote:
> thanks man for replying ...
> actually the program is my one made
> iam trying to make a web crawler so iam using unix socket api's
> as i use
> write(sockfd,"GEt url HTTP 1.1\r\nHost:\r\n\r\n",30);
> and then read it
> read(sockfd,buf,sizeof(buf));
>
> but i dont understand what do u mean by redirect ...i mean when someone
> redirects it gives a nrw url to follow?????
> where do you find that url in the reply if it does so???

When a server responds with an http result code of "302" it is telling
you that the resource you requested really exists at some other urls.
The "Location" header in the response contains the real URL for the
resource. Your crawler should then request this redirect in stead.
Browsers usually do this without the user even noticing it.

However, if you really want to write your own crawler you should start
by reading a bit about the http protocol. There are more result codes
that your program might need to be aware of.

Krist
--
krist.vanbesien@gmail.com
krist@vanbesien.org
Bremgarten b. Bern, Switzerland
--
A: It reverses the normal flow of conversation.
Q: What's wrong with top-posting?
A: Top-posting.
Q: What's the biggest scourge on plain text email discussions?

---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: users-unsubscribe@httpd.apache.org
" from the digest: users-digest-unsubscribe@httpd.apache.org
For additional commands, e-mail: users-help@httpd.apache.org