Changes between Version 4 and Version 5 of CrawlerStory

Show
Ignore:
Author:
sgillies (IP: 216.17.251.234)
Timestamp:
10/30/07 14:30:19 (3 years ago)
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • CrawlerStory

    v4 v5  
    66   - Operant properties: <link>, <a> 
    77 - What criteria for assessing links to traverse 
     8   - URLs that refer to Pleiades (from httpd logs) 
    89   - Seed with URLs for recognized types surfaced by established Pleiades collaborators 
    910   - Respect robots.txt