Department of Information Science and Telecommunications

INFSCI 2140 - Information Storage and Retrieval

(Fall 2004, CRN 21665)

INFSCI 2140 Course Materials

This is the Summer 2004 schedule. Since the Summer course had fewer lectures than the regular IS2140 course, the following should be considered as a draft. This draft will be updated along the progress of the course. Lecture slides will be provided at each lecture and posted on this page in .pdf format afterwards.

Lecture	Objectives	Concepts	Readings	Handouts
Lecture 1 Information System Design	Introduction to the course. Logistics. Information Systems: Designer's view. Evolution and Evaluation. Abstractions. Documents and queries. Documents and document surrogates. What is in surrogates? What is in documents?	information retrieval, information system, information, data, information need, ectosystem, endosystem, user, funder, server, medium, device, algorithm, hypertext, effectiveness, efficiency, economy, abstraction, knowledge, wisdom, information theory, knowledge base, expert system, information retrieval system, information retrieval, SGML, HTML, RTF, HTML, GIF, JPEG, JBIG, MIDI, MPEG, EBCDIC, ASCII, MP3, SMILE, QuickTime, query, document, formatted document, unformatted document, document surrogate, matching, mapping, keyword, key phrase, extract, abstract, document identifier, review, uncontrolled vocabulary, vocabulary, controlled vocabulary, byte, atomic data, bit, ANSI, data compression, stemming, Huffman code, Ziv-Lempel code, data model, adaptive model, static model, semi-static model, synchronization point, level of compression, prefix property, markup language, segmentation, integrated media document, integrated media system, multimedia document, multimedia system, geographic information system, run length encoding, fine structure, metadata, document encoding, rich text, bit map	Korfhage: Introduction Chapter 1 Chapter 2 (2.1-2.5, 2.7-2.8) Chapter 13 R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Introduction	Slides
Lecture 2: Models of Information Retrieval: Boolean Model	Search and Browsing. Queries and matching. Classic Boolean model.	exact match, range match, approximate match, proximity, elementary query, Boolean query, conjunctive normal form, conjunct, conjunctive query, disjunctive normal form, disjunct, disjunctive query, proximity operator, normalization, truth table, full disjunctive normal form, term, DeMorgan's Laws, Law of Double Negation, characteristic function, measure, Boolean query matching, Boolean query system, AND, OR, NOT, NOF	Korfhage: Chapter 3 (3.1, 3.2) Chapter 4 (4.1, 4.2)	Slides
Lecture 3: Models of IR - II	Document space, measure, similarity. Classic vector model. Queries and matching for advanced models. Problems with classic Boolean model. Extended Boolean model. Fuzzy model, Other models and aspects of matching.	proximity, vector, vector model, vector of terms, 0-1 vector, weight vector, contingency table, dimensional compatibility, judging dilemma, document space, lexical similarity, distance measure, dissimilarity measure, distance to similarity transformation, cosine measure, inner product, intrinsic measure, extrinsic measure	Korfhage: Chapter 3 (3.3 - 3.8) Chapter 4 (4.3 -4.12)	Slides
Lecture 4: Retrieval Effectiveness	Measures for relevance. Precision, recall, fallout, generality. Coverage ratio, novelty ratio, relative recall, recall effort. Average precision and recall. Expected search length. Normalized precision and recall. Sliding ratio. Satisfaction and frustration.		Korfhage, Chapter 8 (skip 8.5) AND (C. J. van Rijsbergen "Information Retrieval", Chapter 7 OR R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 3: pp. 73-96")	Slides
Lecture 5: Text Analysis	From text to index. Types of indexing. Zipf's law. The problem of choosing significant terms. TF*IDF. Stop lists and stemming.Thesauri. Document similarity. Multi-language retrieval.		Korfhage: Chapter 5 C. J. van Rijsbergen "Information Retrieval", Chapter 2	Slides
Lecture 6: Taking user into account	Improving Effectiveness: Relevance Feedback and Query Expansion; Adapting to the user: User profiles, user models, adaptive information retrieval, adaptive presentation		Korfhage: Chapter 6, Chapter 9 R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 5: Query Operations	Slides
Lecture 7: Data Structures and Algorithms	Document processing, storage, search. Document files. Search problem. Simple search solution. Algorithms for searching and sorting. Complexity. Advanced searchable data structures: index files, inverted files, B-trees.		C. J. van Rijsbergen "Information Retrieval", Chapter 4 Korfhage, Appendix B R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 8: Indexing and Searching Btree tutorial	Slides
Lecture 8: Alternative retrieval techniques	Natural language processing, citation processing, hypertext browsing, dynamic queries and implicit queries. Multimedia IR and digital libraries.		Korfhage: Chapter 10 R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapters 11 and 12	Slides
Lecture 9: Web IR and other modern problems of information retrieval	Characterising the Web. Search engines. Meta-search. Search services. Agents and bots. Clustering and information exploration. Use of hyperlinks. Web recommenders and other adaptive Web-based information systems.		R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 13	Slides
Lecture 10: Output presentation and visualization	What to present, ranking, clustering, output exploration, visual interfaces for output exploration: GUIDO, VIBE, BIRD, TileBars, LyberWorld		Korfhage: Chapter 11, Chapter 7 R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 10: User Interfaces and Visualization	Slides