EITN01 Web Intelligence and Information Retrieval

2011/2012 Vt1

Laboratory Lessons

Laborations: 5 x 4 hours; first mandatory lab Thursday Jan 26, 8:15 - 12:00 in E:4115

Optional, non-mandatory lab on PHP-programming Wednesday Jan 25, 13-17 in E:4115

Laboratory exercises (PDF)

Schedule

• Wednesday Jan 25, 13-17:                     0. Optional lab: PHP programming
• Thursday Jan 26: 1. Information retrieval basics: similarity, tf-idf, recall/precision
• Thursday Feb 2: 2. Link-based ranking, Query languages
• Thursday Feb 9: 3. Text pre-processing for indexing
• Thursday Feb 16: 4. Concepts using LSI; Document classification using SVM
• Thursday Feb 23: 5. Browsing vs searching, Search Engines vs meta-search
• Thursday  March 1: Spare.

Hints, tips and usefull links

If you want to download and run the software needed (PHP, SVD, SVM) for the laboratory exercises on your own machine just talk to me. It is all free software available on the net.The code examples and testdata provided in the S:\ catalogues on the windows machines in the lab-room is available here:Zipped archive, orTar archive.

The Python skelleton is available here:  Zipped archive, orTar archive.

• PHP Cheat Sheets:

  • PCRE cheat sheet.
  • PHP Basics Quick Reference Sheet
  • The PHP cheat sheet is a one-page reference sheet, listing date format arguments, regular expression syntax and common functions.
• A PHP class for stemming.
• An IR book freely available: Introduction to Information Retrieval by Christopher D. Manning, Prabhakar Raghavan and Hinrich Schütze, Cambridge University Press. 2008. Covers aproximately the same methods as the course book, but in a slightly different way.
• LSI:
  • SVD and LSI Tutorial 4: Latent Semantic Indexing (LSI) How-to Calculations
• Vector Model:
  • The Classic Vector Space Model Description, Advantages and Limitations of the Classic Vector Space Model
  • The Term Count Model Demystifying Term Vector Calculations