Yes, this is normal. It's important to realize that this is almost entirely to do with the lens and not the camera body. See What causes lens flare? for more detailed background, but basically, flare is the result of stray light bouncing around, and is common with lower-cost lenses and with wide-angle lenses — and the 18-55mm kit lens is both.
You can see that the problem is worse with the UV filter. A large, flat, and probably cheaply-coated glass element is ideal for bouncing light (but not so ideal for avoiding artifacts like this). A higher-quality filter will contribute less to the problem, but won't improve the lens itself. A higher-quality lens will have a design intended to protect more against random bouncing light.
A cheap thing you can do to help, though, is to shade the lens from out-of-scene light. You can use your hand or a piece of cardboard in a pinch, but really this is what a lens hood is for. It screws on the front of the lens and keeps some of the "extra" light away. (For your Canon kit lens, the item you want is the EW-60C lens hood.)
Of course, that won't help flare caused by lights in the scene (as in your image, where the blue ghost light appears to be caused by the bright white lamp on the building). For that, the best option is to compose differently — move so that light source is obscured, or just hits the lens in a less-obtrusive way. If that's too limiting — sometimes, that's the picture you want to take! — a lens which better controls flare (which is to say, a more expensive lens) will help get this kind of shot.
