"I explained that he had discovered the secret sorrow of my soul—the lack of oysters."  From Harmsworth Magazine, 1899.

You've heard of a bearded clam, but here's a mustachioed oyster.  "The gift that fell from heaven."  From Stories in Precious Stones by Helen Zimmern, 1873.

"Noises made by oysters hamper sea radio."  From Popular Mechanics, 1928.  Related: "Photograph noises on ships to end annoying sounds."  (Works like a charm.)  From Popular Mechanics, 1929.

Here's an appariton of the letter R frightening an oyster.  From Judy, Or The London Serio-Comic Journal, 1878.

From Prof. Oddfellow's sketchbook:

The world is figuratively one's oyster, and "the world may undoubtedly be an oyster, though to whom it would belong, to whom it would be answerable in that capacity, is a great deal less certain.  It's something that will have to remain a matter for conjecture until science comes up with a definitive answer." —N.F. Simpson, If So, Then Yes