Teaching in 2011

Convex Optimization and Machine Learning, Kyoto U. (Fall 2011)

Recommended reading to take the course
Sections A.1, A.2, A.3, A.5.1, A.5.2, C.1, C.2 in Convex Optimization.
Slides:

• Introduction with Matlab code to visualize Unit balls using different norms.
  

• Convex Functions & Optimization Problems

• Convex Problems & Duality

• Algorithms

Assignment 1 Due Dec. 16th 23:59, by email.

Introduction to Information Sciences, Kyoto U. (Fall 2011)

Here are the slides

• 1st lecture on formal languages

• 2nd lecture on formal languages

• 1st lecture on information theory and communications primer movie by C.& R. Eames.

• 2nd lecture on information theory

Assignment write a report (2 to 3 pages) on Kraft's Inequality. Provide some historical context. Due Nov. 15th 23:59, by email.

Foundations of Intelligent Systems, Kyoto U. (Spring 2011)

Part I, Statistical Machine Learning

April 19th - June 7th

• Introduction

• Lecture 1 : Regression (Data: mat or csv file, Scripts)

• Lecture 2 : Regression 2

• Lecture 3 : Classification (Scripts, Perceptron Demo)

• Lecture 4 : Statistical Learning Theory 1 (Scripts)

• Lecture 5 : Statistical Learning Theory 2 (Scripts)

• Lecture 6 : Statistical Learning Theory 3

• Lecture 7 : SVM's and Introduction to Kernel Methods

Homework 1, due June 12th (Sun.)

Homework 2, due July 16th (Sat.)

Part II, Computational Learning Theory

June 14th - July 26th (taught by Prof. Yamamoto)

Language Information Processing, Kyoto U. (Spring 2011)

Chapter on Machine Learning Approaches

June 6th - June 20th

• Lecture 1 : Naive Bayes, SVM

• Lecture 2 : Conditional Random Fields

• Lecture 3 : Topic Models

Assignment

You can choose either of these two tasks:

• Write a reading report on Topic Models by D. Blei and J. Lafferty, 2009.

• Implement a simple prototype of CRF's for shallow parsing based on Shallow Parsing using CRF's by F. Sha and F. Pereira, 2004.

Please complete the assignment by July 15th, 23:59 and send it to me by email.

Please check here for more content on this course.

Guest Lecture in Prof. Avis’ Introduction to Algorithms and Informatics course