C D F H I M R S T U V W

C

crawler(int) - Method in class CSE494.Webcrawl

The crawler which extracts the links recursively and goes through them

CSE494Analyser - class CSE494.CSE494Analyser.

CSE494Analyser() - Constructor for class CSE494.CSE494Analyser

D

DISALLOW - Static variable in class CSE494.Webcrawl

Document(File) - Static method in class CSE494.FileDocument

Makes a document for a File.

Document(File) - Static method in class CSE494.HTMLDocument

F

FileDocument - class CSE494.FileDocument.

A utility for making Lucene Documents from a File.

H

HTMLDocument - class CSE494.HTMLDocument.

A utility for making Lucene Documents for HTML documents.

I

IndexHTML - class CSE494.IndexHTML.

Generate index for the documents crawled from the web.

IndexHTML() - Constructor for class CSE494.IndexHTML

M

main(String[]) - Static method in class CSE494.IndexHTML

Usage : java IndexHTML [-create] [-index ]

main(String[]) - Static method in class CSE494.SearchFiles

main(String[]) - Static method in class CSE494.VectorViewer

main(String[]) - Static method in class CSE494.Webcrawl

Invoke the crawler from commandline.

R

run() - Method in class CSE494.Webcrawl

S

SEARCH - Static variable in class CSE494.Webcrawl

SEARCH_LIMIT - Static variable in class CSE494.Webcrawl

SearchFiles - class CSE494.SearchFiles.

Gives a interface to ask Booleanqueries on underlying index.

SearchFiles() - Constructor for class CSE494.SearchFiles

setStatus(String) - Method in class CSE494.Webcrawl

Method to print.

showVector() - Method in class CSE494.VectorViewer

For retrieving the (docNo,Freq) pair for each term call TermDocs termdocs = reader.termDocs(termval); For retrieving the (docNo,Freq,(pos1,......posn)) call TermPositions termpositions = termval.termPositions(termval)

STOP - Static variable in class CSE494.Webcrawl

T

tokenStream(Reader) - Method in class CSE494.CSE494Analyser

Method to Stem the tokens and remove stop words.

U

uid(File) - Static method in class CSE494.HTMLDocument

uid2url(String) - Static method in class CSE494.HTMLDocument

URL_OPENED - Static variable in class CSE494.Webcrawl

Limit on Number of URLs Opened

V

VectorViewer - class CSE494.VectorViewer.

Demonstrates how to access the underlying Data Structure to retrieve Term and Document Frequencies

VectorViewer() - Constructor for class CSE494.VectorViewer

W

Webcrawl - class CSE494.Webcrawl.

Crawls the web and stores the first 1000 URLs encountered.

Webcrawl() - Constructor for class CSE494.Webcrawl

C D F H I M R S T U V W