CMPUT657: Monte Carlo Methods in Games, Planning and Heuristic Search

Basic Information



In this course you will get a broad overview of heuristic search, with a special focus on modern exploration-based methods including Monte Carlo simulation. The course includes a large hands-on component, where you will work on concrete examples and program your own algorithms.


Course Outline

Using exploration techniques, and especially Monte Carlo Methods has recently become a very popular approach in many areas of heuristic search, such as games, planning and robotics. The goal of this course is an in-depth study of the main approaches to using exploration in heuristic search. The course includes a large hands-on component, where Students will work on concrete examples and program their own algorithms.

This course begins with a short introduction to the standard "classical" heuristic search algorithms, and motivates the need for exploration techniques. The main three components of current algorithms: search, knowledge and simulation, are introduced. This will be accomplished by reading, lectures, discussions and by practical exercises.

In the later part of the course, you will deepen and apply your knowledge in planning by doing a software project in a small group. You will have a large degree of freedom in choosing your topic as long as it is relevant to the course.

This course can be a good preparation if you are considering doing an MSc or PhD. The course project could be a starting point for a thesis in this area. (Unfortunately, at this point in time, funding for positions in my group is unclear. But I will know later during the term.)

Course Details

There is a detailed outline on a separate page, and an up-to date course schedule is always on the main eclass course page.

Readings, Course Notes, Slides and Literature

Course Work, Project, and Grading

There will be two programming assignments, two take-home quizzes, and one course project. The course project is split into five steps, some of them quite small. Projects will be done in groups of two or three. Finally, there are assessment components for several different ways of course participation.

Final grades will be based on the 4-point grading system and assigned in accordance with the University of Alberta grade distribution guidelines for graduate courses as specified in the University of Alberta Marking and Grading Guidelines.

Plagiarism and Cheating

Make sure you have read and are familiar with the Code of Student Behaviour for the University of Alberta, especially with Section 30.3.2 Inappropriate Academic Behaviour. Plagiarism and other forms of cheating are considered to be serious academic offences. In case of doubt, consult with your instructor before choosing an action.