A bit tired and very much tired with how the SLOW response or no response from the AO people lookup almost stops my 0.2.8 today I edited Bot.php and changed the get_site function:
        /*
        Gets a URL
        */
        function get_site($url)
        {
                $fp = fopen($url, "r");
                if (!$fp) {
                        $content = ""; // could not connect
                } else {
                        stream_set_blocking($fp, FALSE);
                        stream_set_timeout($fp, 15);
                        $content = "";

                        while ($buffer = fgets($fp, 1024) && stream_get_meta_data($fp)<>'timed_out')
                        {
                                $content .= $buffer;
                        }
                        if (stream_get_meta_data($fp)=='timed_out') $content='';
                }

                return $content;
        }

I'm sure this is not perfect but it seemed to help me today. (I have not tested this more than a few minutes, though...)

I do not know if just setting that 15 second timeout would result in fgets($fp, 1024)===FALSE in the while loop so I include the "&& stream_get_meta_data($fp)<>'timed_out'"

Maybe this is something that has already been handled in the development branch in which case I suppose this belongs in 0.2.x support.

Please correct me if all of this is just bullshit and the server simply happened to behave better after I had done this...

[edit:] Of course, now I get no whereis results at all and have no way to know whether it is because the 15 sec timeout is too short, the code is bugged, or the people lookup is still dead. At least it does not hang the bot...

0.3 already solves this and the code could be adapted.

Here is the 0.3 code for reference
<?php
/*
Gets a URL
Heavily inspired by Shadowgod's AOXML class and examples from php.net comments.
*/
function get_site($url, $server_timeout = 5, $read_timeout = 10)
{
/*
Parse the URL so we can use it in our raw socket request
*/
$get_url = parse_url($url);

/*
Open the socket
*/
$fd = fsockopen($get_url[host], 80, $errno, $errstr, $server_timeout);

/*
Make sure the socket was created successfully
*/
if (!$fd)
{
$return["error"] = true;
$return["errordesc"] = "Errno: $errno Errstr: $errstr";
return $return;
}
else
{
/*
Set the timeout to prevent it from hanging the bot
*/
socket_set_timeout($fd,$read_timeout);

/*
Send the HTTP request
*/
fputs($fd, "GET $get_url[path] HTTP/1.0\r\n");
fputs($fd, "Host: $get_url[host]\r\n");
fputs($fd, "Connection: Close\r\n");
fputs($fd, "User-Agent: BeBot/$bot_version\r\n\r\n");

/*
Check if the server is giving us what we wanted
*/
$http_response = fgets($fd);

$results = stream_get_meta_data($fd);
/*
Make sure we haven't timed out while waiting for a responce
*/
if ($results[timed_out] == 1)
{
$return["error"] = true;
$return["errordesc"] = "Timed out while reading from $get_url[host]";
$return["content"] = "";
fclose($fd);
return $return;
}

if ( ereg("200 OK", $http_response) )
{
$return["error"] = false;
$return["content"] = "";

/*
Read the contents
*/
while (!feof($fd))
{
$return["content"] .= fgets($fd, 1024);
}

$results = stream_get_meta_data($fd);
/*
Make sure we didn't time out while reading the responce again.
*/
if ($results[timed_out] == 1)
{
$return["error"] = true;
$return["errordesc"] = "Timed out while reading from $get_url[host]";
$return["content"] = "";
fclose($fd);
return $return;
}

fclose($fd);
return $return;
}
else
{
$return["error"] = true;
$return["errordesc"] = "Server returned: $http_response";
fclose($fd);
return $return;
}
}
}
?>


The following code should work for 0.2.
Please provide feedback on it.
<?php
/*
Gets a URL
Heavily inspired by Shadowgod's AOXML class and examples from php.net comments.
*/
function get_site($url, $server_timeout = 5, $read_timeout = 10)
{
/*
Parse the URL so we can use it in our raw socket request
*/
$get_url = parse_url($url);

/*
Open the socket
*/
$fd = fsockopen($get_url[host], 80, $errno, $errstr, $server_timeout);

/*
Make sure the socket was created successfully
*/
if (!$fd)
{
return 0;
}
else
{
/*
Set the timeout to prevent it from hanging the bot
*/
socket_set_timeout($fd,$read_timeout);

/*
Send the HTTP request
*/
fputs($fd, "GET $get_url[path] HTTP/1.0\r\n");
fputs($fd, "Host: $get_url[host]\r\n");
fputs($fd, "Connection: Close\r\n");
fputs($fd, "User-Agent: BeBot/$bot_version\r\n\r\n");

/*
Check if the server is giving us what we wanted
*/
$http_response = fgets($fd);

$results = stream_get_meta_data($fd);
/*
Make sure we haven't timed out while waiting for a response
*/
if ($results[timed_out] == 1)
{
fclose($fd);
return 0;
}

if ( ereg("200 OK", $http_response) )
{
$content = "";

/*
Read the contents
*/
while (!feof($fd))
{
$content .= fgets($fd, 1024);
}

$results = stream_get_meta_data($fd);
/*
Make sure we didn't time out while reading the response again.
*/
if ($results[timed_out] == 1)
{
fclose($fd);
return 0;
}

fclose($fd);
return $content;
}
else
{
fclose($fd);
return 0;
}
}
}
?>


using what Khalem posted if it was someone not in my whoiscache I got an insta "FC too slow to respond".  It looked like it didn't even try and wait at all for a response.  is the $server_timeout and $read_timeout in seconds or is that milliseconds?

It is in seconds.

Use the following code to get debug info to console.
0.3 has get_site sending the errors back to the calling functions, but this can't be done in 0.2 without breaking backwards compactibility.

<?php
/*
Gets a URL
Heavily inspired by Shadowgod's AOXML class and examples from php.net comments.
*/
function get_site($url, $server_timeout = 5, $read_timeout = 10)
{
/*
Parse the URL so we can use it in our raw socket request
*/
$get_url = parse_url($url);

/*
Open the socket
*/
$fd = fsockopen($get_url[host], 80, $errno, $errstr, $server_timeout);

/*
Make sure the socket was created successfully
*/
if (!$fd)
{
echo "get_site debug: Creating socket failed\n";
return 0;
}
else
{
/*
Set the timeout to prevent it from hanging the bot
*/
socket_set_timeout($fd,$read_timeout);

/*
Send the HTTP request
*/
fputs($fd, "GET $get_url[path] HTTP/1.0\r\n");
fputs($fd, "Host: $get_url[host]\r\n");
fputs($fd, "Connection: Close\r\n");
fputs($fd, "User-Agent: BeBot/$bot_version\r\n\r\n");

/*
Check if the server is giving us what we wanted
*/
$http_response = fgets($fd);

$results = stream_get_meta_data($fd);
/*
Make sure we haven't timed out while waiting for a response
*/
if ($results[timed_out] == 1)
{
fclose($fd);
echo "get_site debug: Socket timed out while waiting for server response\n";
return 0;
}

if ( ereg("200 OK", $http_response) )
{
$content = "";

/*
Read the contents
*/
while (!feof($fd))
{
$content .= fgets($fd, 1024);
}

$results = stream_get_meta_data($fd);
/*
Make sure we didn't time out while reading the response again.
*/
if ($results[timed_out] == 1)
{
fclose($fd);
echo "get_site debug: Socket timed out while reading data\n";
return 0;
}

fclose($fd);
echo "get_site debug: Success\n";
return $content;
}
else
{
fclose($fd);
echo "get_site debug: Server error, http response was: $http_response\n";
return 0;
}
}
}
?>


It may be usefull to reduce the timeout in the updatescript a bit, true.

Haven't seen much need though, as I'm running that script daily in the background, and as long as it does it's work, I don't care if it needs 2h or 4h.

The teams module was the culprit, I changed that to also use whois cache for information, will post updated file tonite.

-jj-