You may unintentionally be offending people with this common fashion accessory