This discussion came up on the comments the other day so I thought I would chime in here.
I usually do not wear gloves. However when working out in conditions in which I would normally wear gloves I usually wear them. My "gym" is in my unheated barn so whenever the temp gets below 40 the bar is quite cold. I find it helpfull to wear leather gloves when lifting on those days.