“We” speech

When I hear someone speak in first person plural, it always makes me want to ask the person “And who exactly is this ‘we’?”. (I’ll make an exception if I think that this would be a blow to the person’s confidence that would prevent them from participating.)