Yeah, I just checked in about:config and prefetch is on by default.
I'm not sure how much difference setting Firefox's priority to High would make. But like Lord said, it can cause other problems. The first thing that comes to mind is that, if Firefox crashes, or some JavaScript tries to tie up your CPU, it'll hurt a lot worse.