Plastic magazine holders are easy to find and are usually cheap. I picked up a couple for 50 cents each at Goodwill the other day. They were ugly, black plastic pieces, but I'd read a good tip of how to spruce them up.
Buy some wrapping paper you like and wrap them! Above is the finished product. They aren't perfect, but they look a lot better on my shelves than they did before.