Links to sections on various course topics:

Hopfield Nets

Probability theory and Bayesian Nets

Markov Chains and Hidden Markov Models

Linear Algebra, the Singular Value Decomposition, and Latent Semantic Analysis

Entropy

Logic

I'll keep class resources in this site. Please note that I frequently make corrections, additions, and changes to the course slides. What I post here is therefore often an improved version of what I presented in class.

The syllabus as a postscript file, and as a pdf.

My lecture slides on Hopfield nets as a postscript file, and as a pdf. The .pdf has the problem that the diagonal lines in the Hopfield nets don't come out. So if you can print the .ps, it's better.

The first homework: postscript , pdf. Answers are here.

The second homework: postscript , pdf. Answers.

My first lecture slides on probability as a postscript file, and as a pdf.

The second lecture on probability.

The third lecture set on probability, covering variance etc. These lectures actually were after the Bayesian net ones.

Lectures on Bayesian Nets: pdf, to be updated.

A very nice on-line book on probability, by the late Richard Jeffrey.

A web site called the Layman's Guide to Probability Theory. It has some slow discussion of probability, and also examples.

The homework on probability (due February 4) is here.

For Bayesian nets, the best source on the web for the material is probably the course notes of Kathryn Blackmond Laskey of George Mason University, especially unit 2.

Here is a tutorial web site from www.norsys.com that has the example "Chest Clinic" slides that I used in class. This site doesn't explain the math, but it does give an idea of how Bayesian nets might be used in practice. It also has lots of other examples of Bayesian nets.

My Lectures on Markov Chains: pdf, to be updated.

My Lectures on Hidden Markov Models: pdf file, and ps. Not all the arrows come out in the .pdf files, so you might want to print the .ps file.

The HMM homework, due March 2: postscript , pdf.

The main introductory survey article on HMMs, by L. R. Rabiner and B. H. Juang. My lectures are based on their article, and also the survey article on the EM algorithm by Detlef Prescher. What I am trying to do in my lectures is to take that second paper's clear and expansive presentation and then adapt it back to the case of HMMs. I highly recommend Prescher's paper to Linguistics students.

A nice tutorial web site on HMM's is this one by R.D. Boyle. It has a nice treatment of the Viterbi algorithm, for example.

There are lots of other HMM resources on the web. If anyone wants to read a textbook presentation, one source is Rabiner and Juang's book on speech recognition.

The homework on linear algebra is here as a pdf and is here as a ps file.

The solutions are here.

The short homework on eigenvalues, eigenvectors and matrix multiplication here. The answers for this are here.

The web site by Todd Will on the Singular Value Decomposition is here.

The main website on Latent Semantic Analysis. You might click on "What is LSA?".

One paper by Landauer and Dumais on Latent Semantic Analysis is here. And another introductory paper by Landauer, Foltz, and Laham is posted here as a .ps file.

A paper by Sheldon Axler called Down with Determinants! has a proof of the Spectral Theorem and lots more. If you have seen some linear algebra but not the Spectral Theorem, this would be a good source. If you have not seen any linear algebra, there are lots of books on introductory topics. One that I like is Murray Spiegel's book Linear Algebra in the Schaum's Outline Series. In fact, I review from the book each time I teach linear algebra.

Another resource that covers the linear algebra involved in the SVD is posted here. It's by Jody S. Hourigan and Lynn V. McIndoo.

The final lectures on logic: are here. These cover default reasoning, systems P and Z, and the preferential and probabilisitic semantics. You can find the lecture here as a ps file . The arrows in the trees go upwards.

A slower presentation of the systems of natural logic may be found here.

The first homework on logic is here.

The second homework on logic is here.

Incidentally, the logical systems that we started with are fairly close to the very first works in logic, due to Aristotle. What we studied is essentiallly the syllogistic logic developed from a more modern point of view. For a good overview of Aristotle's work on logic, see this article by Robin Smith in the Stanford Enyclopedia of Philosophy.

The material on epsitemic logic is mostly taken from a paper by Alexandru Baltag and me. You can find a version of it here.

A shameless plug: if you enjoy this subject, you might consider taking Philosophy 550 next semester. The course will be about modal logic, the system related to the examples that we are playing with in class. Feel free to ask me if you are considering that class but have questions.

The journal problems: postscript , pdf. I am going to distribute these in class, so you need not print them.

Practice problems for the first exam: are here.

Practice problems for the second exam: are here. And the answers are here .

The Take-Home final is here as a pdf, and it's here as a ps file. .

The Final and Journal are due on Friday, May 7 at 10:00 AM in Rawles 323.