[UFO Chicago] [greg@kroah.com: [CrackMonkey] [dave@farber.net: IP: U.S. DoD [seems to be djf] looking for pro-Sklyarov pages?]]

[Lukas Eklund]

Quoting Peter A. Peterson II:
> Get this.
> 
> Chicago is no exception to this trend. My machines have been spidered
> too. And they weren't interested in just Dmitry, either...
> 
> wcs3-cbus.nipr.mil - - [28/Aug/2001:14:01:03 -0500] "GET /ufo.html HTTP/1.0" 200 3767
> wcs3-cbus.nipr.mil - - [28/Aug/2001:14:01:10 -0500] "GET /directions.html HTTP/1.0" 200 8248
> wcs3-cbus.nipr.mil - - [28/Aug/2001:14:02:13 -0500] "GET /history.html HTTP/1.0" 200 6869
> bu-wcs3-kelly.nipr.mil - - [28/Aug/2001:15:37:04 -0500] "GET /robots.txt HTTP/1.0" 404 -
> bu-wcs3-kelly.nipr.mil - - [28/Aug/2001:15:37:06 -0500] "GET /free-sklyarov/chicago-protest-information.txt HTTP/1.0" 200 8830

What's odd, is if you look at rfk and flynn.zork.net logs it just
tries robots.txt (which doesn't exist) and then moves on. It would be
interesting to disallow a few meaningless links and see if those get
crawled. Also, you should turn on user-agents in flynn's logs for ufo to
see if it is the Inktomi bot (assuming it returns).

-- 
lukas  | SELF-EVIDENT, adj.  Evident to one's self and to nobody else.
eklund |    -- Ambrose Bierce