That moment when someone joke is too harsh

All my friends love joking around and making fun of each other. Its all fun and games honestly. HOWEVER!!
Theres is always that one joke that either goes to far to the point people just sit their in silences with their yes expanded or they just LMFAOOOOOOOOOO.