He's 'having a rough time (of it)'. = He's 'going through a rough time'. [=he is having a difficult time; his life has been difficult recently]
The project still has a few 'rough edges'. [=the project still has a few things that need to be changed or finished]
Don't 'be so rough on them' [=don't punish or criticize them so harshly] for making a mistake.
(..) l don't know how l lost it. l don't know where l lost it. l don't think l ever had it. But l've seen the boss's job and l don't want it. 'Cause that's a rough job, dealing with those people all day. l mean, just dealing with them for an hour is a mess. But you see, l'm a father, and fathers are (..)1983 Bill Cosby: Himself