No, not really. The 35/1.4 is probably the closest you can get in that price range. Zeiss Touits aren't exactly cheap, and the Samyang/Rokinon X lenses aren't exactly small and compact, as they're mostly dSLR lens designs with an X mount. And the one that isn't is a fisheye.
Adapting mft to Fuji X is also probably not a good idea. The four-thirds format is smaller than APS-C (2x crop vs. 1.5x crop). If you do find an adapter, chances are very very good that it will vignette (i.e., the image circle of the Olympus lens will not cover the image sensor of the Fuji). In addition, the 45/1.8 has no aperture ring, and there will be no electronic communication from the camera to the lens, so there will be no way to control the aperture, and that means you have to shoot wide open all the time with it.
If you really don't mind the PITAness of a manual-everything lens (stop-down metering, holes in the EXIF lens information, manual focusing, manual aperture setting, etc. etc.) Your best bet might be to find a vintage 50/1.8 or something like the Cosina Voigtländer M-mount rangefinder lenses, like the Nokton 40/1.4. About $450, compact almost-pancake build, built like a tank. But the m.Zuiko 45/1.8 costs less (I got one refurbished off the Olympus website for roughly US$350) and autofocuses.
I hate to say it, but if lower-cost autofocusing lenses are a must for you, then give up the X-Trans colors, and swap out to an MFT body. Just my personal opinion, but you go to MFT for the lens selection, to Fuji for the haptics and colors, and NEX for the sensors. Fuji very much looks like their aesthetic and design for the X mount is going to be high quality fast lenses, which means expensive glass. Note how they come out with a lot of f/1.4 primes, and no f/1.8 ones, and their first portrait prime is an f/1.2. Faster means more expensive.
