More infos are needed , when does it usually happen? Where did you play that it happened? Valve casual servers (the one where you just press find game at menu screen 8v8 10v10). Or it happened in Community casual servers?

I'm on 10mbps unifi and have no problems ping wise on Valve servers and some Community made servers , though some of them used to have lower pings , SG hosted servers , occasionally it'll go back to the 10's or 20's ping , though most of the time it's hitting the 50's mark.

And yes , having packet losses are worst than having like say , 100 ping. Type net_graph 1 in your console to check in game.