Pitt Logo SIS Logo

Department of Information Science and Telecommunications

 

INFSCI 2140 - Information Storage and Retrieval

(Summer 2001, CRN 20727)


[ Formal Data | Course Tools | Syllabus & Schedule | Course Book | Course Materials | BlackBoard | Links ]


Course Materials

Since the Summer course has fewer lectures than the regular IS2140 course, I will be posting lecture material incrementally adapting the lecture content to our speed in class. To see an overview of the whole course you can check the "remaining part" of it as it was presented in the Spring 2001 that is shown at the bottom table Over the duration of the course you will see how the material of the Spring course is moving repackaged from the bottom to the top table. The title and the readings for the new lecture will be available a day in advance, the slides will be posted after the lecture.

Course Plan for Summer 2001

Lecture Objectives Concepts Readings Handouts
Lecture 1
Information System Design
Introduction to the course. Logistics. Information Systems: Designer's view. Evolution and Evaluation. Abstractions. Documents and queries. Documents and document surrogates. What is in surrogates? What is in documents? information retrieval, information system, information, data, information need, ectosystem, endosystem, user, funder, server, medium, device, algorithm, hypertext, effectiveness, efficiency, economy, abstraction, knowledge, wisdom, information theory, knowledge base, expert system, information retrieval system, information retrieval, SGML, HTML, RTF, HTML, GIF, JPEG, JBIG, MIDI, MPEG, EBCDIC, ASCII, MP3, SMILE, QuickTime, query, document, formatted document, unformatted document, document surrogate, matching, mapping, keyword, key phrase, extract, abstract, document identifier, review, uncontrolled vocabulary, vocabulary, controlled vocabulary, byte, atomic data, bit, ANSI, data compression, stemming, Huffman code, Ziv-Lempel code, data model, adaptive model, static model, semi-static model, synchronization point, level of compression, prefix property, markup language, segmentation, integrated media document, integrated media system, multimedia document, multimedia system, geographic information system, run length encoding, fine structure, metadata, document encoding, rich text, bit map Korfhage:
  • Introduction
  • Chapter 1
  • Chapter 2
R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval",
Slides
Lecture 2:
Models of Information Retrieval
Search and Browsing. Introduction to Hypertext. Classic IR paradigm. Queries and matching. Classic Boolean model. exact match, range match, approximate match, proximity, elementary query, Boolean query, conjunctive normal form, conjunct, conjunctive query, disjunctive normal form, disjunct, disjunctive query, proximity operator, normalization, truth table, full disjunctive normal form, term, DeMorgan's Laws, Law of Double Negation, characteristic function, measure, Boolean query matching, Boolean query system, AND, OR, NOT, NOF Korfhage:
  • Chapter 3
  • Chapter 4
Slides
Lecture 3:
Models of IR - II
Document space, measure, similarity. Classic vector model. Queries and matching for advanced models. Problems with classic Boolean model. Extended Boolean model. Fuzzy model, Other models and aspects of matching. proximity, vector, vector model, vector of terms, 0-1 vector, weight vector, contingency table, dimensional compatibility, judging dilemma, document space, lexical similarity, distance measure, dissimilarity measure, distance to similarity transformation, cosine measure, inner product, intrinsic measure, extrinsic measure Korfhage:
  • Chapter 3
  • Chapter 4
Slides
Lecture 4:
Retrieval Effectiveness
Measures for relevancy. Precision, recall, fallout, generality. Coverage ratio, novelty ratio, relative recall, recall effort. Average precision and recall. Expected search length. Normalized precision and recall. Sliding ratio. Satisfaction and frustration.   Korfhage, Chapter 8 (skip 8.5)
AND
("R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 3: pp. 73-96"
OR
"Mizzaro, S.:1997. Relevance: the whole history. Journal of the American Society for Information Science 48(9): 810-832.")
Slides
Lecture 5:
Text Analysis
From text to index. Types of indexing. Zipf's law. The problem of choosing significant terms. TF*IDF. Stop lists and stemming.Thesauti. Document similarity. Multi-language retrieval.   Korfhage: Chapter 5 Slides
Lecture 6:
Data Structures and Algorithms
Document processing, storage, search. Document files. Search problem. Simple search solution. Algorithms for searching and sorting. Complexity. Advanced searchable data structures: index files, inverted files, B-trees.   Korfhage, Appendix B
R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 8: Indexing and Searching
Slides
B-Trees Slides
Lecture 7:
Taking user into account
Improving Effectiveness: Relevance Feedback and Query Expansion; Adapting to the user: User profiles, user models, adaptive information retrieval, adaptive presentation   Korfhage: Chapter 6, Chapter 9
R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 5: Query Operations
Lecture Slides

User Modeling in Information Retrieval Slides (Nick Belkin)
Lecture 8:
Output presentation and visualization
What to present, ranking, clustering, output exploration, visual interfaces for output exploration: GUIDO, VIBE, BIRD, TileBars, LyberWorld   Korfhage: Chapter 11, Chapter 7
R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 10: User Interfaces and Visualization
Slides
Lecture 9:
Alternative retrieval techniques
Natural language processing, citation processing, hypertext browsing, dynamic queries and implicit queries. Multimedia IR and digital libraries.   Korfhage: Chapter 10
R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapters 11 and 12
Slides
Lecture 10:
Web IR and other modern problems of information retrieval
Characterising the Web. Search engines. Meta-search. Search services. Agents and bots. Clustering and information exploration. Use of hyperlinks. Web recommenders and other adaptive Web-based information systems.  
R. Baeza-Yates, B. Ribeiro-Neto: 1999. "Modern Information Retrieval", Chapter 13
Slides

Copyright © 2001 Peter Brusilovsky