Yeah, I don't think it's fair to call that racism. I think that what a person finds attractive is somewhat innate, and is therefore misclassified if it's called racism.
If they don't want to date you because you're Asian and they think that means you're going to be frugal and angry about grades below A+, then it's probably fair to call it racism. If they don't want to date you because they prefer how brothas look, then I definitely don't think it's fair to call that racism.
It's completely fair to call it shallow, since I'm guessing it's pretty much based on appearance, but unless you've known the person for a long time, what else do they have to go off of that's as certain as appearance?
That said, you should come to Hawaii -- asian/white couples are pretty much the most common kind here. haha.