Web Crawler definition

Web Crawler means a program that follows URL pointers, which utilize the hypertext transfer protocol (http), from one web page to another in order to access these pages.
View Source
Web Crawler a computer program that browses the World Wide Web in a methodical and automated manner in order to copy/store web documents (html pages, pdf documents, etc.) for later processing (e.g. indexing, creating corpora, etc.) In the initial version of the crawlers to be developed in WP4.1, the acquired corpora will consist only of html pages. In the context of this report, web documents, web pages and html pages are synonymous. Focused web crawler: is a web crawler that downloads html pages that are relevant to a predefined topic in order to build topic-specific web collections. In the context of PANACEA, Seed pages: Web pages known to be relevant to a specific domain. A (focused) web crawler will be initialized with these pages.
View Source
Web Crawler a computer program that browses the World Wide Web in a methodical and automated manner in order to copy/store web documents (html pages, pdf documents, etc.) for later processing (e.g. indexing, creating corpora, etc.) Focused web crawler: is a web crawler that downloads html pages that are relevant to a predefined topic in order to build topic-specific web collections.
View Source

Examples of Web Crawler in a sentence

  • In the event that InfoSpace is unable to (x) transfer to Cingular the licenses listed in Section B(iii) of Exhibit A and/or (y) sublicense to Cingular the Web Crawler software, the parties will use good faith efforts to agree to a mutually agreeable solution.

  • As between Compaq and VerticalNet, Compaq shall own all right, title and interest in and to the AltaVista Search Service, the AltaVista Web Crawler, the AltaVista URL Index, including without limitation all successor products thereof and any current or future intellectual property rights embodied in the foregoing.

  • ICP hereby grants to WorkLife a non-exclusive and limited license to use the ICP tradenames, logos and other ICP trademarks and service marks ("ICP" Marks) on all ICP content shown on the AltaVista Search Service, Web Crawler, URL Index and WorkLife Web Site.

  • The Company owns all proprietary software and software rights to the Web Crawler Search Engine "▇▇▇▇▇▇▇▇▇▇.▇▇▇".

  • Scour Web Crawler and Search Engine • Scour Exchange • Scour MyCaster Streaming MP3 Service ("MyCaster") • Scour Asset Management System • Any and all Marketing Requirements Document (MRD), Product Requirements Document (PRD), Architecture, Specification, and Source Code related to the Purchased Assets, including but not limited to Documentation stored in the Scour's CVS source code management system and Microsoft Exchange server (emails regarding implementation details).

  • Finding what people want: Experiences with the Web Crawler, in Proc.


More Definitions of Web Crawler

Web Crawler means a program that follows URL pointers, which utilize the hypertext transfer protocol (http), from one web page to
View Source