Göm meny

TSBB15 Computer Vision VT2022

This course is given during the VT1 and VT2 periods. The course is planned to take place on campus. For now, you may want to have a look at last year's course pages, for details on the course.

Registration

Registration

If you intend to take the course but are not registered, make sure to register ASAP in Ladok, using the Student portal. You need to be registered on the course to receive course email, and to have results registered in Ladok. If you take the course but are not registered to any program at Linköping University, please contact the course examiner in order to make sure that you receive email about the course.

Course extent

Course extent

This course is worth 12 ECTS credits, which corresponds to approximately 320h of work per student. The time is divided among the following activities:

More details can be found in Studieinfo (the web interface to the Bilda course database).

People

People

We all have our offices in the B-building, ground floor. Teacher offices are in corridor D (rooms 2D:513 to 2D:527), assistant offices are in Visionen. We recommend the use of email to request meetings.

Literature

Literature

In the course we will use the following literature:

  1. Book: Richard Szeliski, Computer Vision: Algorithms and Applications, Springer Verlag (2nd ed. 2022).
    This book covers topics such as tracking, optical flow and image features.
    The book is available as an campus e-book via the LiU library. See also Book webpage.
  2. Book: Klas Nordberg, Introduction to Representations and Estimation in Geometry (IREG).
    This compendium covers only the 3D geometry part of the course.
  3. GIT: Other relevant literature, e.g. articles and masters theses can be fund in the TSBB15 GIT repository.

We have collected pointers to relevant literature in the column "Material" in both of the "Lecture and Lab schedules" below. These either refer to one of the two books above, or to an article in the TSBB15 GIT repository. There are also additional pointers that may be of use, e.g. to introductory videos and Wikipedia pages.

Examination

Examination

The course has a written examination and a mid-term exam. These are offered at the following occasions during 2022 (see Tentabokning):
  • 2022-03-23, 14-18: voluntary mid-term examination for this years's students (KTR1).
  • 2021-06-01, 14-18: Examination at end of course.
  • 2021-08-16, 8-12: Re-examination opportunity.

Exam related questions may be asked in the Exam Q and A chat in the course teams group. We will answer when we have time. Make sure to tag a teacher to get a response.

Old exams

See the page on previous exams for a selection of old exams given in the course.

How to use the old exams: We recommend that you use these exams as pointers into the literature ("instuderingsfrågor"). To answer the exam, read corresponding discussions in your notes, the course book, and the lecture slides. While it is faster to look at other people's exam answers, this merely gives you answers, while reading and thinking also results in understanding.

Grades

Lecture and lab schedule VT1

Lecture and lab schedule VT1

  • The course schedule for TSBB15 can be found in TimeEdit.
  • A more detailed schedule for VT1, with reading material is given below.
    The course content is similar to last year's course, so you may want to look there for details (e.g. slides). Updated slides for this year will be added below, after each lecture.
Date,Time,Room Activity Teacher Material
Jan 19: 10.15-12
Systemet
Lecture 1
Introduction to Computer Vision
Per-Erik
Jan 20: 13.15-17
ASGÅRD
Computer lessons 1&2
Images in Python
Johan
Jan 21: 10.15-12
Systemet
Zoom Meeting 619 7833 0323
Lecture 2
Image Representations
Mårten
Jan 26: 10.15-12
Systemet
Lecture 3
The structure tensor
Mårten
Jan 27: 13.15-15
Systemet
Lecture 4
Motion estimation and optical flow
Mårten
Jan 28: 10.15-12
Systemet
Lecture 5
Global motion estimation and tracking
Mårten
Feb 1: 8.15-10
ASGÅRD
Computer Execercise 1
Tracking
Preparation
time
Feb 2: 10.15-12
Systemet
Lecture 6
Clustering and learning
Per-Erik
Feb 3: 13.15-17
ASGÅRD
Computer Execercise 1
Tracking
Johan
Feb 4: 10.15-12
Systemet
Lecture 7
Overview of project 1: Tracking
Per-Erik
Feb 8: 8.15-10
ASGÅRD
Computer Execercise 2
Motion estimation
Preparation
time
Feb 9: 10.15-12
Systemet
Lecture 8
Local Features
Per-Erik
Feb 10: 13.15-17.00
ASGÅRD
Computer Execercise 2
Motion estimation
Johan
Feb 16: 10.15-12
Systemet
Lecture 9
Biological Vision
Systems
Per-Erik
Mar 11: 10.15-12
Systemet
Lecture 10
Geometry recap, ML, and RANSAC
Mårten
  • Slides for Lecture 10
  • IREG: 10.3 (F), 12.6 (ML), 16.1.3 (opt.tri.), 17 (robust)
  • CVAA: 6.1.4 (ransac)
  • SHB: 10.2 (ransac)
  • HZ: 4.7 (robust), 11.4 (geometric distances)

Lecture and lab schedule VT2

Lecture and lab schedule VT2

  • The course schedule for TSBB15 can be found in TimeEdit.
  • A more detailed schedule for VT2, with reading material is given below.
    The course content is similar to last year's course, so you may want to look there for details (e.g. slides). Updated slides for this year will be added below, after each lecture.
Date,Time,Room Activity Teacher Material
Mar 28: 10.15-12
Systemet
Lecture 11
RANSAC, Calibrated geometry and PnP
Mårten
Mar 29: 13.15-16
Systemet
Seminar 1
Presentation of project 1
Per-Erik
Mar 31: 8.15-10
Systemet
Lecture 12
Structure from motion, and Project 2
Per-Erik
Apr 4: 10.15-12
Systemet
Lecture 13
Multi-view Stereo
Per-Erik Forssén
Apr 5: 13.15-15
Systemet
Lecture 14
Discrete Optimization
Michael
Apr 11: 10.15-12
ASGÅRD
Computer Exercise 3
Optimisation
Preparation
time
Apr 12: 13.15-17
ASGÅRD
Computer Exercise 3
Optimisation
Johan
Apr 21: 8.15-10
Systemet
NB! new time.
Lecture 15
Image Denoising and Enhancement
Michael Felsberg
Apr 25: 10.15-12

ASGÅRD
Computer Exercise 4
Image Restoration
Preparation
time
Apr 26: 13.15-17

ASGÅRD
Computer Exercise 4
Image Restoration
Johan
May 3: 13.15-15
Systemet
Guest Lectures
Leif Haglund, Maxar
Abdelrahman Eldesokey, Signality
May 17: 13.15-16
Systemet
Seminar 2
Presentation of project 2
Per-Erik

Projects

Projects

The two projects are conducted in groups of 5, 4 or 3 students (in order of preference). We aim for 3 project groups this year. Assignment into groups is made on the introductory lecture for project 1.

List of project groups VT2022

  • Project 1: Object Tracking
    Introductory lecture on February 4
    Design plan due February 11
    Report due March 25 (checked by guide before that)
    Presentation seminar on March 29
  • Project 2: 3D Reconstruction
    Introductory lecture on March 31
    Design plan due April 6
    Report due May 13 (checked by guide before that)
    Presentation seminar on May 17

General resources

We suggest and allow you to use the following software:

  • OpenCV (Open Source Computer Vision). Version 3.4.3 is installed on the department's Linux computers (first you need to issue the module add prog/opencv/3.4.3 command). See also the minimal example OpenCV progam (contributed by Gustav Häger).
    Read the section on OpenCV in the hints and pitfalls page. There is a cheat sheet for OpenCV. An important exception is the Background modelling with mixtures of Gaussians, which you are NOT allowed to use (as you're supposed to learn this in the course).
  • Python with OpenCV bindings. Python 3.6.9 is installed in the computer labs. Essential libraries such as Matplotlib, NumPy, and SciPy are also available.
  • VLFeat has a a useful code library, both for Matlab and C/C++. For example, it has an alternative implementation of SIFT, and also an implementation of MSER. Both are made by Andrea Vedaldi.
  • The Visual Geometry Group at Oxford University maintains code for affine invariant region detectors, produced in cooperation with other groups.
  • The Computer Vision Laboratory at ETH provides an implementation of SURF.
  • An IDE, e.g. PyCharm community edition, which is installed in the computer labs after loading the right module (see module avail) (remember to say no to creation of a shortcut on /usr/local when you start pycharm).

Project repositories

Project code should be developed under versioning control, with changes tracked according to LiU-ID of the participating group members.

  • Project groups should create their repositories in the LiU Git. Note: this is not GitHub, and GitHub should not be used.
  • Project guides and examiner should be given "reporter" access to the group repositories.

Hints and pitfalls

Based on experience from previous year's projects, we have accumulated a list of hints and pitfalls for the projects. Read them carefully before starting your project work.