Skip to Content

17 Phrases Often Used By People Who Are Tough To Be Around

17 Phrases Often Used By People Who Are Tough To Be Around

You know that tight feeling in your chest when you’re around someone who never seems to make things easier—only heavier? Yeah, me too. The truth is, the words we use leave bruises or build bridges, and some people seem to have a favorite playlist of phrases that do the first.

I want to be real here. We’ve all run into someone who makes us feel like we’re walking on glass, wondering why every conversation feels like a battle we didn’t sign up for. Maybe you’ve been that person once or twice—I know I have.

Here are 17 phrases I hear from people who are just plain hard to be around. Call them out, get honest, and see what happens next. If you see yourself in any of them, you’re not alone. You’re just human.

1. “I Told You So”

© Nicole McGuffin

Nothing hits like hearing someone say, “I told you so,” when things go wrong. It’s not just about being right—it’s about making the other person feel small. Instead of sharing the weight, they double it.

I remember my friend Anna, who always pointed out every mistake I made. Every time she said it, I wanted to quit trying. You start to believe you’re just a walking disaster who can’t get things right.

The worst part? It’s never about helping you. It’s always about them being seen as smarter, wiser, or just plain better. Next time you hear this, ask yourself: does it bring you closer, or just shut you down?

2. “That’s Just How I Am”

© Psychology Today

There’s a slap-in-the-face power to, “That’s just how I am.” It’s a wall, not a doorway. You can’t get through, no matter how hard you try.

My ex used to say this every time I brought up something that hurt me. It made me feel like my feelings were the problem, not his actions. After a while, I stopped talking. What’s the point if nothing is ever going to change?

This phrase says, “Don’t expect me to grow.” It’s easier to defend than to reflect. If you catch yourself using it, pause. Are you protecting yourself from growth, or just pushing people away?

3. “You Always/You Never”

© MentalHealth.com

Absolutes are poison. The minute someone says, “You always” or “You never,” it’s like putting someone in a box with no exit.

I remember my sister once told me, “You never listen.” For days, I replayed every conversation, wondering if I was really that bad. It didn’t matter that sometimes I did. It only mattered that in that moment, I felt unseen and misunderstood.

These phrases erase every good thing, every exception, and every effort. They don’t leave room for growth, just blame. If you want a relationship to breathe, drop the absolutes. Try, “Sometimes it feels like…” and see what changes.

4. “With All Due Respect…”

© MIT Sloan Management Review

“With all due respect…” is the universal signal for, “I’m about to say something you won’t like.” It’s wrapped in fake politeness, but everyone hears the dig underneath.

I worked with someone who led every critique with this phrase. It didn’t make her feedback easier to take. It made it harder, because I knew the kindness was a front.

If you need to disagree, just be honest. You don’t need a disguise. People can smell pretense a mile away, and it doesn’t make the truth any softer.

5. “You’re Too Sensitive”

© YourTango

“You’re too sensitive” is the fastest way to shut someone down. It’s like saying their feelings are a flaw they need to fix.

I grew up hearing this from my family. Every time I got upset or spoke up, I was told to toughen up. Eventually, I learned to hide what I felt, even from myself.

It’s not about being tough. It’s about being real. If someone trusts you enough to show you their feelings, don’t punish them for it. Ask why it matters to them. You might learn something new.

6. “I’m Not Saying, I’m Just Saying…”

© Parade

Let’s be real—nothing good ever follows, “I’m not saying, I’m just saying.” It’s like throwing a grenade and pretending you didn’t pull the pin.

Have you had a coworker who used to toss this out when gossiping? Yeah, me too. She’d say something harsh about someone, then duck behind the phrase like a shield. No responsibility, no fallout—just drama.

Using this line is a cheap way to avoid owning your words. If you have something to say, have the guts to stand behind it. Otherwise, maybe it isn’t worth saying at all.

7. “I Know, But…”

© Global English Editing

“I know, but…” is the conversation assassin. It’s the way someone says, “I heard you, but I don’t care.”

My best friend used to do this every time I tried to explain my side. No matter what I said, she had a reason why it didn’t count. After a while, I stopped opening up. Who wants to talk when nobody’s really listening?

If you catch yourself saying this, stop. Let the other person finish. You don’t have to agree, but you do have to listen if you want trust to grow.

8. “It Is What It Is”

© Verywell Mind

There’s this heavy emptiness behind, “It is what it is.” It’s the sound of someone giving up before the fight even starts.

Some people use this every time life gets complicated. No matter what happenes—late rent, broken friendship, bad news—they shrug it off. After a while, their apathy bled into everything around them.

Sometimes, people use this to avoid feeling pain. But if you want connection, you have to care enough to try. Don’t mistake indifference for strength—it’s just another kind of running away.

9. “You’re Overthinking Things”

© Private Therapy Clinic

“You’re overthinking things” lands like a slap. The message? Your worries are a burden, not worth anyone’s time.

I lost count of how many times I heard this from my old boss. Every concern I brought up got brushed aside with a smile. It didn’t make me worry less—it just made me feel invisible.

If someone trusts you with their fears, the least you can do is listen. Dismissing them isn’t kindness; it’s a shutdown. Ask questions instead. You might actually get somewhere.

10. “What’s Your Problem?”

© Bored Panda

“What’s your problem?” isn’t a question. It’s an accusation, shaped like a challenge. It pushes people into defense mode before anything even starts.

Someone snaps this at holiday dinner, and you feel your whole body tense up. The conversation always turns from laughter to silence in seconds. It steals the air from the room.

If you actually want to understand someone, try asking what’s wrong with an open heart. Aggression just begets more aggression. Lead with empathy, not attack.

11. “I Guess So”

© Psychology4u

Passive resistance has a name: “I guess so.” It’s the phrase people use when they don’t want to agree, but don’t want a fight either.

My little sister was a master at this. She’d say it when she didn’t want to do chores—never an outright no, just a wall you couldn’t move.

It’s okay to disagree. You don’t have to hide it behind fake agreement. If you care about someone, be honest, even if it’s uncomfortable.

12. “That’s Crazy/Insane”

© Verywell Mind

“That’s crazy!” can sound playful, but when someone’s sharing something real, it lands like a punch. It turns vulnerability into a joke, shutting the other person down.

Think like this: You open up to a friend about your anxiety, and she just says, “That’s insane.” You feel smaller, like you should just keep your struggles to yourself.

If someone trusts you enough to share the messy parts, don’t dismiss it. Ask them more. Show them you’re there, not just as an audience, but as a friend.

13. “Calm Down”

© Calm

“Calm down” has never actually calmed anyone down. It’s a shortcut to being ignored, or worse, making things escalate.

That phrase doesn’t soothe—it silences. It makes you angry and erodes your trust in the person who said it when you tried to bring up something concerning.

If you care about someone, ask what’s got them upset. Show them you’re willing to listen before you try to fix. That’s where trust starts.

14. “If You Really Loved Me…”

© Allure

Talk about emotional blackmail. “If you really loved me…” is designed to corner, not connect. It’s a cheap shot that turns love into a weapon.

Remember that ex I mentioned earlier? Well, here’s another one of his classics. He wielded this line every time he wanted something. It made me feel like love was a test I could never pass. Even after we broke up, I flinched every time someone questioned my loyalty.

If someone uses this on you, know it’s not about love—it’s about control. Real love doesn’t manipulate or keep score. It invites, it doesn’t demand.

15. “Whatever”

© The Gottman Institute

The word “whatever” is a door slam in conversation form. It signals you’re done, not interested, and don’t care about what comes next.

People use this in arguments, and it builds a wall you have to climb just to feel heard again.

If you want real connection, try staying with the discomfort. Don’t run from the mess. Sometimes, the only way out is through.

16. “You’re Just Jealous”

© Divorced Girl Smiling

Jealousy is a tricky emotion, but tossing, “You’re just jealous” into the mix is a cop-out. It shuts down any real conversation about what’s actually going on.

I once had a friend accuse me of this when I got upset about her new job. The truth was, I felt left behind, not jealous. But she didn’t want to hear that—it was easier to label me than listen.

If someone says this to you, don’t take the bait. Ask for a real conversation, or step back until they’re ready for honesty.

17. “Everyone Thinks So”

© Psychology Today

The phrase “everyone thinks so” is a mob in a sentence. It’s how people make you feel outnumbered and alone, even when you’re not.

My old roommate used to say this when she wanted the group on her side. Even if it wasn’t true, I felt powerless to argue. Who can fight with an invisible crowd?

If you hear this, ask for names. Chances are, “everyone” is just one person. Stand your ground. You’re allowed to have your own opinion.