There were some middle eastern people stockpiling weapons in Toronto. Thus, people assume that they were terrorists, and they probably were.
I think that it's pretty unlikely that they had plans to attack Canada, though. It's more likely that they were using Canada as a staging ground to prepare for an attack on the US.
See, we can catch terrorists without infringing on people's rights and privacy.