Home

Introduction and Overview
Introduction (V1.0)


Protocols
Data Mining Process and Weka (V1.0)
Mining Data from Amazon.com (V1.0)
Recommender Systems (V1.0)
Document Classification / Spam Filter (V1.0)
Newsfeed Analysis (V1.0)


Guidelines for Presentations

Contents of Presentations


Student Presentations

Machine Learning Basics
Weka Introduction
Python Introduction
Document Classification and -Clustering
Recommender Systems

General Information on the Lecture, Term WS 09/10:
EDV Nr. 21308
Date: Di 14.15h-17.30h
Room: 136
SWS/ECTS: 3/3

Contents
In this course 5 different data mining and pattern recognition applications are implemented by all student groups. A group contains at most 3 students. The implementation of each application should be done within one afternoon (14.15h-17.30h). The applications are:

Data Mining Process: Steps of the entire Data Mining Process in general are demonstrated using the Weka Data Mining Tool.

Recommender Systems: Recommender Systems are applied in E-commerce for generating customized recommendations. Well known are the Amazon.com recommendations which are either distributed by e-mail or presented on the Amazon web page after login. For generating these recommendations the products which have already purchased or reviewed by the user are taken into account. In this exercise the currently most popular algorithms (Collaborative Filtering) for generating recommendations are implemented, tested and analysed.

Spam Filter: A Naive Bayes Classifier is implemented for filtering spam. It is also shown how to apply this algorithm for document classification in general

Document Clustering: In this excercise a large amount of RSS-Newsfeeds is collected. All articles coming from the different feeds are clustered using non-negative matrix factorisation. Essential features of each document cluster are extracted

Mining Data from Amazon.com:Using the Amazon Web Service (AWS) one can access loads of product and review data from Amazon.com. In this exercise we integrate the data in our programms using a python wrapper for AWS. Then we apply various intelligent algorithms for mining interesting knowledge out of this data. E.g. we perform trend analysis or predict price models. Students are free to develop their own data mining applications

All applications are implemented in Python.
In addition, students have to prepare presentations. Goal of the presentations is a sufficient introduction for the lab exercises. The presentations are therefore scheduled before the first lab exercise.

Groups and Dates
Vortrag Python Machine Learning Weka Recommender Doc Classification
Gruppe Jauker, Teufel Löw, Becker Aras, Mickler, Bürger Petereit, Haarmann Hetzel, Piccolantonio
10.11.09 Presentation Presentation Presentation Audience Audience
17.11.09 Audience Audience Audience Presentation Presentation
24.11.09 Data Mining Process and Weka
08.12.09 Mining Data from Amazon.com
15.12.09 Recommender Systems
22.12.09 Document Classification / Spam Filtering
12.01.10 Feature Extraction & Document Clustering (Newsfeeds)
Announcements
WS 09/10
06.10.2009
First lesson in this term