Optical filters block some frequencies (colors) of light and allow other frequencies to pass. The IR filter allows infrared light to pass while blocking all other colors. Visually, the IR filter looks opaque. When we image a vista or object that is illumined with visible light (sunlight or artificial) it is likely that some percentage of infrared is also illuminating the subject. If we want to record this scene as seen by IR radiation we mount an IR filter. Its job will be to exclude all but the IR rays.
You can image your artwork illuminated only by IR without a filter. You place the object in an area that can be made pitch black (dark room). If the camera used can record IR radiation, you illuminate it with an IR light source.
Set the object to be imaged in its place and compose and focus in normal room light. Factorial: We focus our camera via visible light. The IR focus is different. You will need to manually offset the focus. Say the object is 4 feet from the camera, try 3 feet and shoot. Examine the resulting image and reset the focused distance a smidge. By trial and error you can obtain focus.
You can test your camera to see if it will image in the IR region. Many TV remote controls operate using IR radiation. In total darkness, activate the TV remote while looking at it via the camera’s viewfinder. Likely you see the IR bursts off the TV remote. Try and photograph them. Note the camera’s IR filter is integral to the cover glass over the image sensor. You might figure out how to remove it! For your purposes, maybe removal is unnecessary.
Now to light the object with IR radiation: IR is also heat radiation. I have seen IR done with a flatiron used as the light source. You can mount your IR filter and try to image the IR from your TV remote. You can purchase an IR heater and/or R40 or R20 IR flood bulbs. These are the reflector heaters with glowing coil. The R40 and R20 are common reflector flood lamps from the hardware store. The IR versions are " people heaters" used in bathroom ceiling light fixtures. Good luck! You are now in the realm of experimentation.