There are many WWW search engines that work in the following way.
Some automatic indexer program visits a WWW page and indexes its
content against its URL. It then follows the links from that page to
other pages, where it performs the same process. This obviously takes
a long time, so it can't be done by hand. Some autonomous program,
once started, must take care of traversing the WWW structure
automatically.
Scenario
Homer wants to build a search engine that operates over the OHSWG data
stored at his lab. To do this, he wants to construct a program that
visits nodes, indexes their content versus their OHSWG name, and then
traverses all links emanating from points in that node. The nodes at
the ends of those links should be processed in this same way. He
wants the program to operate without intervention on his part. There
are several different OHSWG compliant link servers in his lab, built
by different people on top of different OHS's.