C12: Web Agents
Objectives
This module provides an overview of Web Agents. After learning this module, students should have a general understanding about Web Agents.
Description
This module provides information on web agents and web crawlers (also know as web spiders, web robots, ants, automatic indexers, bots, and worms).
It explores both their practical implementation and the economic and legal issues in using web agents.
It takes approximately 95 minutes to 2 hours to go through the required class notes and practice exercisezes.
Class Notes
- Web Agents [.ppt] | [.doc] | [.pdf]
- Web Crawlers [flash] | [Windows Media] | [.ppt] | [.doc] | [.pdf]
- Crawling Policies [.ppt] | [.doc] | [.pdf]
- Screen Scrapers [.ppt] | [.doc] | [.pdf]
- Legal issues in using Web agents [.ppt] | [.doc] | [.pdf]
- The Robot Exclusion Standard [.ppt] | [.doc] | [.pdf]
Practice Exercise
- Web Agents Crossword (opens in a new window)
Suggested Readings and Resources:
