CS1675  Introduction to Machine Learning


Time:  Tuesday, Thursday 11:00pm-12:15pm
Location: Sennott Square (SENSQ), Room 5502


Instructor:  Milos Hauskrecht
Computer Science Department
5329 Sennott Square
phone: x4-8845
e-mail: milos at cs pitt edu
office hours: Tuesday 2:30-4:00pm, Wednesday 10:30am-noon


TA:  Yanbing Xue
Computer Science Department
5324 Sennot Square
phone: 4-8455
e-mail: yax14 at pitt edu
office hours: Tuesday 4:00-5:00pm, Wednesday 1:00-3:00pm


Announcements !!!!!



Links

Course description
Lectures
Homeworks
Matlab



Abstract

The goal of the field of machine learning is to build computer systems that learn from experience and that are capable to adapt to their environments. Learning techniques and methods developed by researchers in this field have been successfully applied to a variety of learning tasks in a broad range of areas, including, for example, text classification, gene discovery, financial forecasting, credit card fraud detection, collaborative filtering, design of adaptive web agents and others.

This introductory machine learning course will give an overview of many models and algorithms used in modern machine learning including linear models, multi-layer neural networks, support vector machines, density estimation methods, Bayesian belief networks, clustering, ensemble methods, and reinforcement of learning. The course will give the student the basic ideas and intuition behind these methods, as well as, a more formal understanding of how and why they work. Through homework assignments students will have an opportunity to experiment with many machine learning techniques and apply them to various real-world datasets.

Course syllabus

Prerequisites

STAT 1000, 1100, or 1151 (or equivalent), and CS 1501, or the permission of the instructor.



Textbook:

Other ML books:

Lectures
 
 
Lectures  Topic(s)  Assignments
August 29 Introduction to Machine Learning.

Readings: Bishop: Chapter 1

August 31 Math for ML: review.

Readings: your Algebra and Calculus textbooks and notes

September 5 Matlab tutorial

Readings: check Online MATLAB documentation

September 7 Overfitting and generalization error.

Readings: Bishop Chapter 1

Homework assignment 1 ( Data for the assignment)
September 12 Designing an ML system.

Readings: Bishop Chapter 1

.
September 14 Review of probabilities. Density estimation.

Readings: Bishop Chapter 2

Homework assignment 2 ( Data for the assignment)
September 19 Density estimation.

Readings: Bishop: Chapter 2

.
September 21 Review of probabilities. Density estimation II.

Readings: Bishop Chapter 2

Homework assignment 3 ( Data for the assignment)
September 26 Nonparametric Density estimation.
Linear regression.

Readings: Bishop: Chapter 2.5., 3.1.

.
September 28 Linear regression

Readings: Bishop Chapter 3.1.

Homework assignment 4 ( Data for the assignment)
September 28 Logistic regression model. Generative classification model.

Readings: Bishop Chapter 4.2-3.

October 5 Generative classification models. Evaluation of classifiers.

Readings: Bishop 4.2-3.

Homework assignment 5 ( Data for the assignment)
October 12 Support vector machines

Readings: Bishop 7.1., Appendix E.

Homework assignment 6 ( Data for the assignment)
October 17 Multilayer Neural Networks

Readings: Bishop 5 - 5.3.

.
October 19 Midterm exam

.
October 24 Decision trees, Multiclass classification

Readings: Bishop 14.4. (decison tree), 2.5.2. (k-nearest neighbors), 4.3.4. (multiclass)

.
October 26 Midterm exam: solutions

Homework assignment 7 ( Data for the assignment)
October 31 Bayesian belief networks

Readings: Bishop 8.1-2.

.
November 2 Bayesian belief networks: learning and inference

Readings: Bishop 8.1-2, 8.4.

Homework assignment 8 ( Data for the assignment)
November 7 Bayesian belief networks: inference, learning with hidden vars and missing values

Readings: Bishop 9.2, 9.4.

.
November 9 Clustering

Readings: Bishop 8.1-2, 8.4.

Homework assignment 9 ( Data for the assignment)
November 14 Ensamble methods

Readings: Bishop Chapter 14 (14.2, 14.4.)

.
November 16 Ensamble methods: boosting.
Dimensionality reduction: feature selection I

Readings: Bishop Chapter 14,

Homework assignment 10 ( Data for the assignment)
November 21 Dimensionality redution/feature selection

Readings: Bishop Chapter 12.1.

.



Homeworks

The homework assignments will have mostly a character of projects and will require you to implement some of the learning algorithms covered during lectures. Programming assignments will be implemented in Matlab. See rules for the submission of programs.

The assignments (both written and programming parts) are due at the beginning of the class on the day specified on the assignment. In general, no extensions will be granted.

Collaborations: No collaboration on homework assignments, programs, and exams is permitted unless you are specifically instructed to work in groups.



Matlab

Matlab is a mathematical tool for numerical computation and manipulation, with excellent graphing capabilities. It provides a great deal of support and capabilities for things you will need to run Machine Learning experiments. The CSSD at UPitt offers free student licenses for Matlab. The info about how to get a licence please check the following link to the Matlab CSSD page . Note that in addition, Matlab is available for use in the university computing labs. See the CSSD web page for the details.

Other Matlab resources on the web:

Online MATLAB  documentation
Online Mathworks documentation including MATLAB toolboxes


Grading: Your grade for the course will be determined as follows:


Cheating policy: Cheating and any other anti-intellectual behavior, including giving your work to someone else, will be dealt with severely and will result in the Fail (F) grade. If you feel you may have violated the rules speak to us as soon as possible. Please make sure you read, understand and abide by the Academic Integrity Code for the Faculty and College of Arts and Sciences. Cheating and any other anti-intellectual behavior, including giving your work to someone else, will be dealt with severely and will result in the Fail (F) grade. If you feel you may have violated the rules speak to us as soon as possible. Please make sure you read, understand and abide by the Academic Integrity Code for the University of Pittsburgh and Faculty and College of Arts and Sciences.

Students With Disabilities:
If you have a disability for which you are or may be requesting an accommodation, you are encouraged to contact both your instructor and Disability Resources and Services (DRS), 140 William Pitt Union, (412) 648-7890, drsrecep@pitt.edu, (412) 228-5347 for P3 ASL users, as early as possible in the term. DRS will verify your disability and determine reasonable accommodations for this course.



Last updated by Milos on 08/28/2017