CS2770: Computer Vision, Spring 2018

Location: TBD
Time: Tuesday and Thursday, 11am-12:15am
Instructor: Adriana Kovashka (email: kovashka AT cs DOT pitt DOT edu; use "CS2770" at the beginning of the subject line)
Office: Sennott Square 5325
Office hours: Tuesday and Thursday, 9:30am-11am and 1pm-2pm
TA: TBD (email: TBD; use "CS2770" at the beginning of the subject line)
TA's office hours: TBD, Sennott Square TBD

Overview

Course description: In this class, students will learn about modern computer vision. The first part of the course will cover fundamental concepts such as filtering, extracting features and describing images, grouping features, matching features across multiple views, and convolutional neural networks. In the second part, we will cover approaches to classic tasks/topics such as object recognition, vision and language, tracking, and human pose and activity recognition. In the third part, we will overview recent and emerging topics such as self-supervised learning, domain adaptation, and visual discovery. The format will include lectures, homework assignments, exams, and a course project.

Prerequisites: CS1501 and MATH 0280 (or equivalent). The expectation is that you can program and analyze the performance of programs. Some experience with linear algebra (matrix and vector operations), basic calculus, and probability and statistics is recommended.

Piazza: Sign up for it here. Note that we will use Piazza primarily for classmate-to-classmate discussion of homework problems, etc. The instructor will not monitor Piazza, and the TA will monitor it infrequently. The time when you should ask the instructor or TA questions is during office hours.

Programming languages: For homework assignments, you can use Matlab or Python. For the course project, you can use any language of your choice.

Textbooks: [top]

Policies

Grading

Grading will be based on the following components:

Homework Submission Mechanics

You will submit your homework using CourseWeb. Navigate to the CourseWeb page for CS2770, then click on "Assignments" (on the left) and the corresponding homework ID. Your written answers should be a single .pdf/.doc/.docx file. Your source code should be a single zip file (also including images/results if requested). Name the file YourFirstName_YourLastName.[extension]. Please comment your code! Homework is due at 11:59pm on the due date. Grades will be posted on CourseWeb.

Exams

There will be two in-class exams. The second exam is not cumulative and will not cover material from the first exam. There will be no make-up exams unless you or a close relative is seriously ill!

Participation

Students are expected to regularly attend the class lectures, and should actively engage in in-class discussions. Attendance will not be taken, but keep in mind that if you don't attend, you cannot participate. You can actively participate by, for example, responding to the instructor's or others' questions, asking questions or making meaningful remarks and comments about the lecture, answering others' questions on Piazza, or bringing in relevant articles you saw in the news. The grading rubric will be as follows: 1 = you attended infrequently, 2 = you attended frequently but did not speak in class, 3 = you attended frequently and spoke a few times, 5 = you attended and participated frequently, 4 = in between 3 and 5.

Late Policy

On your programming assignments only, you get 3 "free" late days counted in minutes, i.e., you can submit a total of 72 hours late. For example, you can submit one homework 12 hours late, and another 60 hours late. Once you've used up your free late days, you will incur a penalty of 25% from the total assignment credit possible for each late day. A late day is anything from 1 minute to 24 hours. Note this policy does not apply to components of the project.

Collaboration Policy and Academic Honesty

You will do your work (exams and homework) individually. The only exception is the project, which can be done in pairs. The work you turn in must be your own work. You are allowed to discuss the assignments with your classmates, but do not look at code they might have written for the assignments, or at their written answers. You are also not allowed to search for code on the internet, use solutions posted online unless you are explicitly allowed to look at those, or to use Matlab's or Python's implementation if you are asked to write your own code. When in doubt about what you can or cannot use, ask the instructor! Plagiarism will cause you to fail the class and receive disciplinary penalty. Please consult the University Guidelines on Academic Integrity.

Note on Disabilities

If you have a disability for which you are or may be requesting an accommodation, you are encouraged to contact both your instructor and Disability Resources and Services (DRS), 140 William Pitt Union, (412) 648-7890, drsrecep@pitt.edu, (412) 228-5347 for P3 ASL users, as early as possible in the term. DRS will verify your disability and determine reasonable accommodations for this course.

Note on Medical Conditions

If you have a medical condition which will prevent you from doing a certain assignment, you must inform the instructor of this before the deadline. You must then submit documentation of your condition within a week of the assignment deadline.

Statement on Classroom Recording

To ensure the free and open discussion of ideas, students may not record classroom lectures, discussion and/or activities without the advance written permission of the instructor, and any such recording properly approved in advance can be used solely for the student's own private use.

[top]

Project

The project is expected to be a new method for an existing problem or an application of techniques we studied in class (or another method) to a new problem that we have not discussed in class. Below are some tips: Rules and logistics: Rubric for first presentation (all questions except the last one are scored on a scale of 1 to 5, with 5 being best):
  1. How well did the authors (presenters) explain what problem they are trying to solve?
  2. How well did they explain why this problem is important?
  3. How well did they explain why the problem is challenging?
  4. How thorough was the literature review?
  5. How clearly was prior work described?
  6. How well did the authors explain how their proposed work is different than prior work?
  7. How clearly did the authors describe their proposed approach?
  8. How novel is the proposed approach?
  9. How challenging and ambitious is the proposed approach? (1-10)
Rubric for second presentation (all questions except the first one are scored on a scale of 1 to 5, with 5 being best):
  1. To what extent did the authors develop the method as described in the first presentation? (1-10)
  2. How well did the authors describe their experimental validation?
  3. How informative were the figures used?
  4. Were all/most relevant baselines and competitor methods included in the experimental validation?
  5. Were sufficient experimental settings (e.g. datasets) tested?
  6. To what extent is the performance of the proposed method satisfactory?
  7. How informative were the conclusions the authors drew about their method’s performance relative to other methods?
  8. How sensible was the discussion of limitations?
  9. How interesting was the discussion of future work?
Some potential sources of ideas: [top]

Schedule

Date Chapter Topic Readings Lecture slides Due
1/9 Basics Introduction
1/11 Filters HW 1 out
1/16
1/18 Features
1/23
1/25 Grouping
1/30
2/1 Transformations
2/6 Recognition and support vector machines (SVMs) HW1 due
2/8 Convolutional neural networks (CNNs) HW2 out
2/13
2/15
2/20 First exam
2/22 Classics Object recognition
2/27 HW2 due
3/1 proposal due
3/13 Vision and language
3/15
3/20 First project presentations
3/22 slides due; HW3 out
3/27 Video and motion
3/29
4/3 Emergent etc. Domain adaptation and generative adversarial networks
4/5 Self-supervised learning
4/10 HW3 due
4/12 Visual discovery
4/17 Vision for media analysis
4/19 Second exam
4/24 Second project presentations
4/26 slides due

[top]

Resources

This course was inspired by the following courses: Tutorials: Some datasets: Some code of interest: [top]