I would look at some copy-stand setups with continuous cool (daylight-balanced fluorescent) lighting. That would keep the camera pointed straight down with angle-in lighting from both directions. As the lights are generally at or greater than 45 degrees from the film plane, you should have few problems with reflections, but consider polarizing gels if this becomes a problem.
Either set up low or on the floor so you can see the camera back when you compose the shot or tether the camera so you can arrange the shot without too much guesswork.
If you are a do-it-yourselfer, there's an article here on how to build a simple copy stand. Advantages: Low cost and you can pick out the lights you like best. Disadvantages: You have to do it yourself. If you're not handy, then Adorama, B&H, Calumet and a whole slew of other folks will be more than happy to sell you one.
Finally, these things have been around forever and there have been few improvements to the overall design. It may be worth looking around on eBay for a used one.
Two side notes:
A copy stand kind of setup will work great until you get to the mugs. They have depth, so you will have to work with your aperture to maintain focus acceptably.
If your "large" pictures are too big, you won't be able to fit them into the table of a conventional copy stand. Take this into account when you choose.