Is cat grunting normal?

I just picked up my cat and he's making grunting noises like it's hard for him to breathe. Is it something I should be worried about or is it normal?