Web crawler is a computer program that browses the World Wide Web in a automated, methodical manner. So, inspite of using Web crawler term, you can also use other terms such as automatic indexers, wor...