Monthly Archives: February 2006

Predictive State Representation and System Identification

I have started reading/thinking about this Predictive State Representation (PSR) concept recently. It is interesting in my opinion, but I am not so sure if it is a “really” good thing or not. Anyway, I am investigating it. I wrote … Continue reading

Posted in Reinforcement Learning | 3 Comments

To Read: Stochastic Differential Equations and more

A bunch of interesting course lecture notes in Lawrence Craig Evans‘s homepage: – An Introduction to Stochastic Differential Equations – An Introduction to Mathematical Optimal Control Theory – Entropy and Partial Differential Equations

Posted in miscellaneous | 2 Comments

SVM: Maximizing the Sum of Gaps

A few days ago, while sitting in the machine learning class, I was thinking about the following problem about designing a classifier: AFAIK, In traditional SVM, the goal is maximizing the minimum gap. To cope with noise, we may add … Continue reading

Posted in Reinforcement Learning | 5 Comments

Busy Semester

Hi everybody after a long time! It is almost a shame that I do not update here regularly. The worst thing is that I do not have a consistent plan about what I want to write here, what I want … Continue reading

Posted in Diary | Leave a comment