December 20, 2011

Self-Evaluation and Lessons Learned (Introduction to Statistical Computing)

Attention conservation notice: Academic statistico-algorithmic navel-gazing.

With the grading done, but grades not yet posted while we wait for the students to fill out faculty evaluations, it's time to reflect on the class just finished. (Since this is the third time I've done a post like this, I guess it's now one of my traditions.)

Overall, it went a lot better than my worst fears, especially considering this was the first time the class was offered. There was a lot of attrition initially, both from students who had taken a lot of programming, and from students who had done no programming at all. (I was truly surprised by how many students had never used a command-line before.) The ones who stuck around all (I think) learned a lot --- more for those who knew less about programming to start with, naturally. Most of the credit for this goes to Vince, naturally.

Some stuff didn't work well:

Stuff that worked well:

Stuff I'd try to do next time:

Over-all assessment: B; promising, but with clear areas for definite improvement.

Obligatory disclaimer: Don't blame Vince, or anyone else, for what I say here.

Introduction to Statistical Computing

Posted by crshalizi at December 20, 2011 09:35 | permanent link

December 18, 2011

Homework: Baseball Salaries (Introduction to Statistical Computing)

Assignment, database (large!)

Introduction to Statistical Computing

Posted by crshalizi at December 18, 2011 16:35 | permanent link

Databases II (Introduction to Statistical Computing)

Lecture 26: Aggregation in databases is like split/apply/combine. Joining tables: what it is and how to do it. Examples of joinery. Accessing databases from R with the DBI package.

Introduction to Statistical Computing

Posted by crshalizi at December 18, 2011 16:34 | permanent link

Databases I (Introduction to Statistical Computing)

Lecture 25: The idea of a relational database. Tables, fields, keys, normalization. Server-client model. Example of working with a database server. Intro to SQL, especially SELECT.

Introduction to Statistical Computing

Posted by crshalizi at December 18, 2011 16:33 | permanent link

Homework: Get (the 400) Rich(est list) Quick (Introduction to Statistical Computing)

Assignment; solutions (R)

Introduction to Statistical Computing

Posted by crshalizi at December 18, 2011 16:32 | permanent link

Importing Data from Webpages II (Introduction to Statistical Computing)

Lecture 24: Scraping by constructing and debugging regular expressions. R

Introduction to Statistical Computing

Posted by crshalizi at December 18, 2011 16:31 | permanent link

Importing Data from Webpages I (Introduction to Statistical Computing)

Lecture 23: Importing data from webpages. Example: scraping weblinks. Using regular expressions again (with multiple capture groups). Example: how long does a random surfer take to get to Facebook? Exception handling. R

Introduction to Statistical Computing

Posted by crshalizi at December 18, 2011 16:30 | permanent link

December 07, 2011

My Work Here Is Done (Introduction to Statistical Computing)

One of the final projects was to build first- and second- order Markov models based on the text of Heart of Darkness. I present their last slide:

(Whatever merit this might have is due to the students: Jason Capehart, Seung Su Han, Alexander Murray-Watters, and Elizabeth Silver.)

Update, 18 December: Of course, what I should have titled this post is "I'm now becoming my own self-fulfilled prophecy". (I'm really not very good at quotation-capping.)

Introduction to Statistical Computing

Posted by crshalizi at December 07, 2011 11:56 | permanent link

Three-Toed Sloth:   Hosted, but not endorsed, by the Center for the Study of Complex Systems