I noticed that my contact page wasn't working...at some point last year I'd set short_open_tag to off for all of my sites. This means that any PHP code must start with <?php which I was pretty good about doing, except apparently around the form submit buttons on the contact page which had <?.

Ooops