That seems really wrong to me.
The first thing that strikes me as odd is your dx/dt equation. The rate in looks right, but the rate out seems a bit odd. Why is there (600+t)gal on the bottom? There should be 600, but why do you have the +t? It makes absolutely no sense to me; the amount of water isn't changing with time. I think the rate out should be x lb/600 gal * 5 gal/min.
And then what you have is dx/dt= (600-x)/120.
dx/(600-x)=dt/120.
Integrate both sides for: -ln|600-x| = t/120 +C.
In the end, I get 567.2 lbs. after 5 hours.
Edit: NOOOOOO! This was my 1337th post, and I didn't even notice it!!