Meta Spider

1
Meta SpiderCompetitive Intelligence Spider

• K.V.Lakshmi,
• Trainee, 2001-2002,
• NCSI.

2
TOC

• Project Site
• Introduction about the Spider
• Meta Spider
• Competitive Spider
• Demo

3
Project Site

• Institution University of Arizona
• Project Web Site High-Performance Digital
  Library Classification Systems From Information
  Retrieval to Knowledge Management
• Project Start Date May 1, 1999
• Project End Date April 30, 2002
• Demos
• Digital Libraries
• Medical Informatics
• Information Analysis and Visualization
• Spiders are Us
• Multilingual Systems
• Data Warehousing
• Workgroup and Collaborative Computing

4
Introduction

• What is a Spider?
• A spider is a program that visits Web sites and
  reads their pages and other information in order
  to create entries for a search engine index.
  Spiders are typically programmed to visit sites
  that have been submitted by their owners as new
  or updated. Entire sites or specific pages can be
  selectively visited and indexed. Spiders are
  called spiders because they usually visit many
  sites in parallel at the same time, their "legs"
  spanning a large area of the "web." Spiders can
  crawl through a site's pages in several ways. One
  way is to follow all the hypertext links in each
  page until all the pages have been read.

5
Spiders are Us

• GA Optimizer I and II
• Meta Spider
• CI Spider
• Cancer Spider
• GIS Textual Knowledge Sources

6
Meta Spider and CI Spider

• Meta Spider
• The Meta Spider starts by querying the selected
  search engines based on the given keywords. The
  spider then fetches the URLs returned from those
  web pages. After collecting the required number
  of web pages, further analysis will be performed.
  Noun phrases will be extracted from them, which
  allows the user to know what key concepts are
  related to the web sites and keywords specified.
  The concepts can also be visualized in a 2-D map,
  which categorizes the web pages by collecting
  them into regions, each of which represents a
  concept. All these functionalities allow the user
  automatically to collect information more
  effectively and represent it in a more meaningful
  way.
• There are 5 basic steps in performing a search
  session using the Meta Spider they include not
  only the search process but also intelligent
  analysis.

7
Steps

• Search Criteria
• Meta Search Results
• Spider Search Results
• Noun Phrase Selection
• Categorization Map

8
CI Spider

• CI, or Competitive Intelligence, is computer
  software that undertakes to monitor the
  competitive Internet environment intelligently.
  CI is becoming more and more important in todays
  business environments, which are changing more
  quickly than ever before. The vast amount of
  information available on the Internet is a
  valuable resource that the CI Spider can help
  people having different objectives use
  effectively.
• The CI Spider starts from the URLs a user
  specifies and follows all the possible links to
  search for particular keywords that have been
  entered, or can just collect all the web pages if
  no keywords are entered.

9
Steps

• Search Criteria
• Search Results
• Noun Phrase Selection
• Categorization Map

10
Demo
11
Thank You