An oyster. A baby can pick it up from an oyster bed, a penny would buy one in Carroll's day, it cooks quickly, it lies in its own dish, it is easily placed on the table, but the "dish-cover" is hard to raise because it is held to the dish by the oyster in the middle.
The White Queen tells alice this riddle in Through the Looking Glass. The riddle is never answered in the book.