This is painfully obvious, but unless you have a pretty deep understanding of Physics, you'd only be able to grasp the really abstract concepts.
I'm not very familiar with the subject, although I have read a few articles on it. Most of them were in scientific magazines. A few were copies that my high school teacher made, so I'm not sure where they came from. I don't know of any good books on the subject, though.
The CS department at my university doesn't offer a quantum computing course, although there are a bunch of quantum physics courses offered outside of the department. I would imagine having courses in the area of quantum computing in a CS department would be contingent upon having a professor who has specialized in that area willing to teach the courses (that's obvious, but I'd also imagine that quantum computing experts are a bit rarer than, say, AI experts).