Here's some sort of thing in an ornate capital P, from an 1862 issue of Fun magazine.

In 1969, Georges Perec wrote a 300-page novel in French without using the letter e.  Sixty-five years earlier, we have this French passage with only e's.  From L'Album Comique de la Famille, 1904.

Here's the sun sitting on a capital V.  From Judy, Or The London Serio-Comic Journal, 1884.

A skeleton rides a penny farthing on a giant letter S.  From Pick Me Up, 1893.

Riding a penny farthing on a giant letter E.  From Pick Me Up, 1893.

From Pick Me Up, 1891. 

From The Boy's Own Paper, 1880.  This should also be of interest: How to Believe in Your Elf.

Here's an ornate capital Y over which spills an entire alphabet.  From Jugend, 1898.

For the surprising possible meanings of Y (and the rest of the alphabet), see our very own One-Letter Words: A Dictionary, published by HarperCollins.