Weird. I've been doing this for the past year or so. I use a rotating VESA mount that just about cost as much as the cheap-ass monitor itself. To answer the above, OS X supports vertical orientation off-the-shelf.

Portrait orientation is great for PDFs... in my work I have to deal with lots of documents. It's also great (the only way imo) for reading comic books on the computer.