Index

Search in book...
Toggle Font Controls
Create new playlist

Name your new playlist

Playlist description (optional)
Sign In

Email address

Password

Forgot Password?

or

Continue with Facebook

Continue with Google
Sign Up

Full Name

Email address

Confirm Email Address

Password

or

Continue with Facebook

Continue with Google

Previous Chapter

Appendix D. Resources

List of Figures

Index

[A][B][C][D][E][F][G][H][I][J][K][L][M][N][O][P][Q][R][S][T][U][V][W][X]

A

Abstract Window Toolkit. See AWT. access control list. See ACL. ACL Activity Monitor process monitor administration interface Adobe Flash, extracting text from, 2^nd Adobe PDF, extracting text from, 2^nd. See also PDF. AFP used for indexing AgoFilterBuilder AllDocCollector, 2^nd AlreadyClosedException analysis, Snowball, supported languages. See also indexing, analysis. analytics interface Google Analytics Lucene-specific metrics analyzer, provided during indexing AnalyzerDemo, 2^nd, 3^rd AnalyzerUtils, 5^th displayTokens, 2^nd displayTokensWithFullDetails displayTokensWithPositions tokensFromAnalysis AnalyzingQueryParser Another Tool for Language Recognition. See ANTLR. Ant, building Lucene. See also Apache Ant. ANTLR, 2^nd Apache Ant preparing to use to build contrib modules Apache Commons columnar formatting Digester, indexing using Apache Jakarta Apache JMeter Apache POI project Apache Software Foundation Apache Software License Apache subversion instance Apache Tika. See Tika. Aperture open source project Apple Mac OS X, search feature AR Archives, extracting text from ArabicAnalyzer Aroush, George ASCIIFoldingFilter, 2^nd Asian language analysis Attribute AttributeSource addAttribute analysis captureState restoreState audio formats, extracting text from metadata AutoDetectParser, 3^rd Tika class Autonomy AWT

B

backward compatibility. See Version. BalancedMergePolicy BalancedSegmentMergePolicy Balmain, David Beagle, 2^nd benchmark, OpenIndex Berkeley DB, storing index BerkeleyDBJESearcher Bialecki, Andrzej Bobo Browse beyond simple faceting integration with Zoie Runtime FacetHandlers sorting BoboBrowser BoboIndexReader, 2^nd BodyContentHandler, 2^nd BookLinkCollector BooksLikeThis using MoreLikeThis BooleanClause Occur MUST MUST_NOT SHOULD BooleanFilter BooleanQueryBuilder BooleanScorer BoostingQuery negativeQuery positiveQuery boosts BrazilianAnalyzer Browsable Browse Engine, denormalization BrowseFacet BrowseHit BrowseRequest setFilter BrowseResult getFacets getHits BrowseSelection Builder BulletinPayloadsAnalyzer BulletinPayloadsFilter BZIP2 files, extracting text from, 2^nd

C

C#, tokenizing C++, tokenizing CachedFilter caching field values filter CachingSpanFilter CachingTokenFilter used during highlighting CachingWrapperFilter, 2^nd, 3^rd, 4^th CartesianTierPlotter Cascading Style Sheets. See CSS. Catasta, Michele catchall field, for searching multiple fields categorizing documents, using term vectors CellConjunctionScorer CellDisjunctionScorer CellQuery CellReqExclScorer CellScorer ChainedFilter combining with AND combining with ANDNOT combining with OR combining with XOR security filter example chaining filters charades CharFilter CharReader CharStream CharTokenizer Chinese analysis Chinese, Japanese, and Korean. See CJK. ChineseAnalyzer ChineseDemo ChineseTest CIFS. See Samba file system. CJK, analysis of CJKAnalyzer, 2^nd client-server port definition CloseIndex benchmark task CLucene API compatibility supported platforms Unicode support Collator, used for sorting String fields Collector, 3^rd, 4^th acceptsDocsOutOfOrder collect custom setNextReader setScorer using field cache common errors Comparable Compass denormalization ComplexPhraseQueryParser compound index, creating CompressionTools ConcurrentMergeScheduler, 2^nd, 3^rd, 4^th, 5^th setMaxThreadCount ConcurrentModificationException ConstantScoreQuery content acquiring dividing into shards raw, extracting for documents ContentHandler, 2^nd ContentSource, 2^nd contrib modules introduction spatial search coordination, query term CorePlusExtensionsParser CorruptIndexException CPIO Archives, extracting text from createLineFile.alg CreateSpellCheckerIndex CreateThreadedIndexTask CSS in highlighting CustomQueryParser CustomScoreQuery getCustomScoreProvider Cutting, Doug, 3^rd relevant work CzechAnalyzer

D

database primary key storing index inside Berkeley DB DatabaseConfig DateField, dateToString DateFilter, within ChainedFilter DateFormat, SHORT DateRecognizerSinkTokenizer DateTools debugging queries DefaultEncoder DefaultSimilarity Delbru, Renaud DeletionPolicy denormalization DERI Sindice.com search engine Dictionary Digester. See also Apache Commons Digester. addCallMethod addObjectCreate addSetNext addSetProperties DigesterXMLDocument, 2^nd Digg Digital Enterprise Research Institute. See DERI. DirContentSource Directory implementations FileSwitchDirectory MMapDirectory NIOFSDirectory RAMDirectory SimpleFSDirectory directory in Berkeley DB DirectSolrConnection DisjunctionMaxQuery tie-breaker DistanceComparatorSource DistanceQueryBuilder DistanceSortSource DocIdBitSet DocIdSet Document, 3^rd, 4^th, 7^th, 8^th editing with Luke reuse setBoost document type definition. See DTD. documentation documents and fields DOMUtils Donovan, Aaron downloading Lucene Droids DSight, denormalization DTD DuplicateFilter DutchAnalyzer dynamic fragmenting vs. highlighting

E

EdgeNGramFilter EdgeNGramTokenizer Edit distance. See Levenshtein distance. Elastic search, sharding and replication Elschot, Paul encoding UTF-8 entitlements, definition EnvironmentConfig EnwikiContentSource Eventful Excel. See Microsft Excel. Explanation Extensible Hypertext Markup Language. See XHTML. Extensible Stylesheet Language. See XSL.

F

FacetAccessible faceted search Bobo Browse definition FacetHandler, 2^nd FacetSpec setMaxCount setMinHitCount setOrderBy FastVectorHighlighter compared to Highlighter Ferret field cache DEFAULT memory usage, 2^nd per segment readers setInfoStream used by sorting used for sorting field options combinations compressing fields indexing ANALYZED ANALYZED_NO_NORMS NO NOT_ANALYZED NOT_ANALYZED_NO_NORMS sorting storing NO YES term vectors NO WITH_OFFSETS WITH_POSITIONS WITH_POSITIONS_OFFSETS YES FieldCacheRangeFilter, 2^nd FieldCacheSource FieldCacheTermsFilter, 2^nd FieldComparator FieldDocs FieldMaskingSpanQuery FieldNormModifier FieldQuery FieldScoreQuery FieldSelector, 2^nd, 8^th accept loading only specified fields specify fields by set stopping after first field time savings FieldSelectorResult LAZY_LOAD LOAD LOAD_AND_BREAK LOAD_FOR_MERGE NO_LOAD SIZE SIZE_AND_BREAK FieldSortedTermVectorMapper file descriptors, finding the limit FileNotFoundException over remote file systems FileSwitchDirectory FilteredDocIdSet, 2^nd match FilteredQuery, 2^nd, 3^rd filtering token. See TokenFilter. finding similar documents using termvectors FlagsAttribute Flash. See Adobe Flash. Formatter FragmentsBuilder FrenchAnalyzer frequency factor formula fsync Fuller, Robert function queries boosting by recency using field cache FuzzyLikeThisQuery FuzzyQuery, 4^th, 5^th, 6^th, 7^th formula minimumSimilarity prohibiting

G

GermanAnalyzer Glouser, Grant Google Analytics Google Enterprise Connector Manager GradientFormatter Grails search plugin GreekAnalyzer Grub GZIP compression, extracting text from

H

Hadoop, creation of Harwood, Mark, 2^nd, 3^rd hasDeletions Hatcher, Erik Heritrix Hibernate Search, denormalization hierarchical organizational schemes HighFreqTerms highlighting query terms, 2^nd using CSS vs. dynamic fragmenting HightlightIt Hoschek, Wolfgang HTML cookie extracting text from, 2^nd meta tag parsing HtmlParser HTTP headers, indexing Last-Modified header HTTP request, content type HttpServletRequest Humphrey, Marvin, 2^nd

I

I18N. See internationalization. IDF, 2^nd images, extracting text from metadata index structure, converting index, inverted IndexCommit getUserData IndexDeletionPolicy, 2^nd, 3^rd example usage Indexer program IndexFiles IndexHTML indexing classes IndexMergeTool IndexReaderDecorator, 2^nd IndexReaderFactory IndexReaderWarmer IndexSplitter IndexWrter information explosion, dealing with overload specific, locating quickly information retrieval. See IR. InputStream INSO, filters Installing Lucene InstantiatedIndex InstantiatedIndexWriter intelligent agent, creating internationalization InvalidTokenOffsetException inverse document frequency. See IDF. inverted index. See index, inverted. InvIndexer IR definition library vs. search engine ISYS file readers iTunes search feature

J

J2ME JaroWinkler, distance metric for spell correction Java 2 Micro Edition. See J2ME. Java C Compiler. See JCC. Java class files, extracting text from Java JAR files, extracting text from Java Management Extensions. See JMX. Java Native Interface. See JNI. Java Runtime Environment. See JRE. javac, compile with UTF-8 encoding JavaCC, building Lucene JavaServer Page. See JSP. JCC JConsole used by Zoie JEDirectory Jetty JFlex, 2^nd building Lucene usage in SIREn JMX used by Zoie JNI Jones, Tim JRE, 2^nd JSP Jython

K

Katta, sharding and replication KeepOnlyLastCommitDeletionPolicy, 2^nd KeyView filters keyword analyzer KeywordAnalyzer, 2^nd, 3^rd, 4^th KeywordTokenizer KinoSearch differences vs Lucene Krugle enterprise appliance Krugle.org Krugler, Ken KStem

L

language detection Last.fm lemmatization LengthFilter letter ngrams used by spellchecker LetterTokenizer, 2^nd, 3^rd Levenshtein distance distance metric for spell correction LineDocSource, 2^nd LinkedIn, 2^nd, 3^rd LoadFirstFieldSelector local wrapper port, definition LockFactory locking during indexing write.lock file LockObtainFailedException LockStressTest LockVerifyServer LogByteSizeMergePolicy setMaxMergeDocs setMaxMergeMB setMergeFactor setMinMergeMB LogDocMergePolicy LowerCaseFilter, 2^nd, 3^rd, 4^th LowerCaseTokenizer, 2^nd, 3^rd, 4^th lowercasing, order may matter lsof Lucene ports Lucene.Net API compatibility index compatibility performance LUCENE_24 LUCENE_29 Lucy Luke, 2^nd, 3^rd, 19^th Analyzer Tool browsing by term browsing term vectors Custom Similarity document browsing editing documents Hadoop Plugin indexing file view Overview tab scripting with JavaScript search explanation searching searching with QueryParser viewing synonyms viewing term statistics LuSQL, denormalization

M

Mannix, Jake MAP MapFieldSelector MappingCharFilter MatchAllDocsQuery, 2^nd used for browsing facets Maven 2, used by Tika maxDoc vs. numDocs MaxFieldLength UNLIMITED UNLIMITED or LIMITED MD5, reducing field cache memory usage mean average precision. See MAP. mean reciprocal rank. See MRR. MemoryIndex mergeFactor, 3^rd, 4^th, 5^th performance impact MergePolicy, 2^nd, 3^rd, 5^th avoiding large segments MergeScheduler, 2^nd merging LogByteSizeMergePolicy LogDocMergePolicy waiting for merges to finish Metadata, Tika class Metaphone Microsoft Excel, extracting text from, 2^nd Microsoft Office 2007, extracting text from Microsoft Outlook, extracting text from, 2^nd Microsoft PowerPoint, extracting text from, 2^nd Microsoft Visio, extracting text from, 2^nd MIDI files, extracting text from Miller, George and WordNet MMapDirectory, 2^nd Montezuma MoreLikeThis MoreLikeThisQuery MP3 audio, extracting text from tags MRR MultiFieldQueryParser default operator interations with Analyzer multifile index, creating MultiPassIndexSplitter MultiPhraseQuery, 2^nd, 3^rd QueryParser slop MultiSearcher, 2^nd, 3^rd multithreaded searching. See ParallelMultiSearcher.

N

native port, definition native2ascii, Java tool NativeFSLockFactory, 2^nd near-real-time reader near-real-time search, 4^th, 6^th avoiding commit introduction reducing turnaround time Networked File System. See NFS. newBooleanQuery newFuzzyQuery newMatchAllDocsQuery newMultiPhraseQuery newPhraseQuery newPrefixQuery newRangeQuery newTermQuery newWildcardQuery NFS sharing index over used for indexing NGramTokenizer NIOFSDirectory, 2^nd NoLockFactory non-English language analysis normalization field length query NullFragmenter numDocs vs. maxDoc numeric range queries NumericField, 6^th, 9^th, 10^th filtering during searching precisionStep setDoubleValue setIntValue setLongValue sorting NumericPayloadTokenFilter NumericRangeFilter, 2^nd, 3^rd NumericRangeQuery, 2^nd, 3^rd created by QueryParser creation from QueryParser precisionStep NutchDocumentAnalyzer

O

O’Leary, Patrick OfficeParser OffsetAttribute, 2^nd endOffset OLE Open Office, extracting text from open source software, judging success OpenBitSet, used by Filter OpenDocument files, extracting text from OpenSolaris, open file limit optimize Oracle/Lucene integration, denormalization OS, I/O cache Outlook. See Microsoft Outlook. OutOfMemoryError OutOfMemoryException OutputStream

P

paging through results ParallelMultiSearcher, 2^nd, 3^rd Parr, Terr ParseContext ParseException parsing, 3^rd query expressions QueryParser method versus analysis. See QueryParser. ParsingReader partitioning indexes PayloadAttribute, 2^nd PayloadHelper PayloadNearQuery payloads, 9^th access via TermPositions and SpanQuery constructors during analysis during searching example uses usage in SIREn used by SIREn PayloadTermQuery, 2^nd PDF. See also Adobe PDF. PDFBox PDFParser PerFieldAnalyzerWrapper, 2^nd Perl, tokenizing per-segment searching, field cache PersianAnalyzer PHP Bridge PhraseQuery, 7^th, 11^th, 12^th, 14^th contrasted with SpanNearQuery converting to SpanNearQuery forcing term order from QueryParser multiple terms scoring slop slop factor with synonyms PipedReader PipedWriter plain text, detecting character set PLucene Porter stemmer. See Porter stemming algorithm. Porter stemming algorithm Porter, Dr. Martin, 2^nd PorterStemFilter, 2^nd, 3^rd, 4^th PositionalPorterStopAnalyzer PositionBasedTermVectorMapper PositionIncrementAttribute setPositionIncrement positionIncrementGap PowerPoint. See Microsoft PowerPoint. PrecedenceQueryParser precision, definition PrefixFilter, 2^nd PrefixQuery, 2^nd PrintStream, 2^nd probabilistic model Process Monitor properties file, encoding ps Unix process monitor pure Boolean model PyLucene, 2^nd API compatibility Python, tokenizing

Q

queries, built-in query expression. See QueryParser. QueryAutoStopWordAnalyzer QueryBuilder QueryBuilderFactory querying QueryNodeProcessor QueryTemplateManager QueryTermScorer QueryWrapperFilter, 2^nd, 3^rd, 4^th

R

RAID array RAMDirectory, 2^nd, 3^rd, 4^th, 5^th, 6^th RangeFilter RDF, 2^nd creating the Web of Data definition triplestores ReadTokens task RecencyBoostingQuery RegexFragmenter RegexQuery regular expressions. See WildcardQuery. relational database relevance remote file systems Remote Method Invocation. See RMI. remote procedure call. See RPC. remote searching RemoteSearchable RemoteSearcher removing common terms. See stop words. Representational State Transfer. See REST. Resource Description Framework. See RDF. REST ReutersContentSource reverse native port, definition ReverseStringFilter Rich Text Format. See RTF. robocopy, for hot backups of an index RPC RSolr rsync, for hot backups of an index RTF extracting text from, 2^nd Ruby, tokenizing RussianAnalyzer

S

Samba file system, used for indexing SAX parsing using scaling index replication index sharding schema, flexible SCM SCMI score ScoreCachingWrapperSource ScoreDoc, 2^nd, 3^rd ScoreOrderFragmentsBuilder scoring formula raw score scrolling. See paging. search model probabilistic pure Boolean vector space search within search, using Filters Searchable, 2^nd, 3^rd SearchClient Searcher program SearcherManager get maybeReopen release warm SearchFiles searching classes SearchServer security filtering mixed static and dynamic SegmentReader, 2^nd SegmentTermEnum, next Sekiguchi, Koji Semantic Information Retrieval Engine. See SIREn. semantic web semistructured data SerialMergeScheduler, 2^nd SetBasedFieldSelector setMaxBufferedDeleteTerms setRAMBufferSizeMB shard, definition Similarity, 3^rd, 4^th improving default relevance lengthNorm similarity between documents. See term vectors. similarity scoring formula Simple API for XML. See SAX. SimpleDateFormat SimpleFragmenter SimpleFSDirectory, 2^nd SimpleFSLockFactory SimpleHTMLEncoder SimpleHTMLFormatter SimpleSpanFragmenter SingleInstanceLockFactory sinks SinkTokenizer SinusoidalProjector SIREn benchmarks BooleanQuery performance compared to Lucene data model data preparation postings format compare to Lucene searching entities semistructured search, 2^nd SirenPayloadFilter, 2^nd slop factor defined with MultiPhraseQuery with SpanNearQuery SmartChineseAnalyzer, 2^nd, 3^rd Snowball stemmer SnowballAnalyzer, 2^nd solid-state disk. See SSD. SolPerl SolPHP SolPython Solr, 5^th creating analysis chain Ruby response format sharding and replication SIREn integration, 2^nd Solr.pm Solr.QParser Solr.QParserPlugin SortedTermVectorMapper SortField, 3^rd types SortingExample Soundex. See Metaphone. source code management interface. See SCMI. source code management. See SCM. span queries access to payloads combining dumpSpans method excluding matches matching near one another matching near the field start matching single term phrase within phrase matching QueryParser turning into a filter SpanFirstQuery, 2^nd SpanGradientFormatter SpanNearQuery, 2^nd, 3^rd, 8^th, 9^th, 10^th contrasted with PhraseQuery deriving from PhraseQuery inOrder flag slop SpanNotQuery, 2^nd SpanOrQuery, 2^nd, 3^rd SpanQuery, 5^th, 7^th, 8^th aggregating and QueryParser getSpans visualization utility SpanQueryFilter, 2^nd bitSpans SpanRegexQuery SpanScorer, 2^nd SpanTermQuery, 2^nd, 3^rd, 4^th SPARQL query language SPARQLParser SPARQLParserPlugin SPARQLQueryAnalyzer, 2^nd SpecialsAccessor SpecialsFilter, 2^nd SpellChecker setAccuracy suggestSimilar Spencer, David, 2^nd spider. See web crawler. Spolksy, Joel Spotlight search Spring Spring-RPC SSD Stale NFS file handle exception StandardFilter, 2^nd StandardQueryParser StandardTokenizer, 2^nd Stellent document filters. See INSO filters. stemmers, SnowballAnalyzer family stemming analyzer stop words, 4^th default removing StopAnalyzer, 2^nd, 3^rd, 4^th, 5^th StopFilter, 2^nd, 3^rd, 4^th setEnablePositionIncrements StopWordFilter Store, YES stored fields, custom loading String.compareTo, compares by UTF16 code unit StringDistance, getDistance StringUtils swappiness, controlling swapping on Linux SweetSpotSimilarity SynLookup SynonymAnalyzer, 2^nd, 3^rd SynonymAnalyzerViewer SynonymEngine Syns2Index System, nanoTime

T

Tan, Kelvin TAR Archives, extracting text from, 2^nd tar, for hot backups of an index TeeSinkTokenFilter TeeTokenFilter Term TermAttribute TermFreqVector TermPositions TermPositionVector TermRangeFilter, 6^th includeLower includeUpper open-ended ranges with caching TermRangeQuery, 2^nd, 4^th, 5^th created by QueryParser terms, vs. tokens TermsFilter, 2^nd addTerm TermVectorAccessor TermVectorMapper, 2^nd, 8^th, 9^th isIgnoringOffsets isIgnoringPositions map setDocumentNumber setExpectations ThaiAnalyzer The Grinder load testing tool ThreadedIndexWriter, 2^nd Tika alternatives built-in text extraction tool customizing parser selection getFileMetadata installing introduction limitations logical design metadata extraction modular design parse parser implementations using UNIX pipes utility class TikaConfig getParsers TikaException TikaIndexer TimeExceededException TimeLimitingCollector limitations Token TokenFilter, 6^th additional importance of order shingles splitting source code terms TokenFilters, for creating payloads tokenization, definition Tokenizer additional TokenOffsetPayloadTokenFilter TokenRangeSinkTokenizer TokenSources getAnyTokenStream TokenStream, 2^nd architecture buffering incrementToken used for highlighting TokenTypeSinkTokenizer Tomcat, demo application tool, Luke top Unix process monitor top, measuring page faults TopDocs, 2^nd, 3^rd TopFieldCollector TopFieldDocs TopScoreDocCollector, 2^nd Toupikov, Nickolai triplestore, searching the Web of Data troubleshooting truncation. See field truncation. Tummarello, Giovanni TupleAnalyzer, 2^nd TupleQuery addClause TupleScorer TupleTokenizer, 2^nd two-phased commit TypeAsPayloadTokenFilter, 2^nd TypeAttribute

U

UI novel, creating unanalyzed fields, searching Unicode Unix, deletion of open files URINormalisationFilter, 2^nd user interface. See UI. UTF-8

V

Vajda, Andi, 2^nd value, 2^nd ValueSource ValueSourceQuery van Klinken, Ben van Rossum, Guido Vector Space Model, 2^nd VerifyingLockFactory Version Visio. See Microsoft Visio. vmstat, measuring page faults

W

W3C Wall, Larry Wang, John WAVE Audio, extracting text from sampling metadata Web 3.0 web application CSS highlighting demo web application server, thread pool Web of Data Wettin, Karl WhitespaceAnalyzer, 2^nd, 3^rd WhitespaceTokenizer Wikipedia document source indexing WikipediaTokenizer WildcardQuery, 3^rd, 4^th inefficiency prohibiting Windows Explorer Windows Server 2003, open file limit Windows, deletion of open files with payloads Word. See Microsoft Word. WordNet adding synonyms during analysis building synonym index example synonyms WordNetSynonymEngine write.lock WriteLineDoc Writer

X

XHTML used by Tika XmlQueryParser, 2^nd XSL

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.

3.137.210.143