When the vendor says they have done built this before

“We’ve done this exact thing before.” It’s the most comforting line in a vendor pitch. It’s also the one that needs the most unpacking.

Experience matters. Someone who’s built something similar to what you need will move faster, avoid known pitfalls, and ask better questions on day one. That’s real value. But “we’ve done this before” covers a wide range, from deep domain expertise to a surface resemblance that falls apart under pressure.

Similar is not the same. A team that built a marketplace for one industry hasn’t necessarily solved the specific trust and transaction problems your marketplace faces. A team that built a healthcare app doesn’t automatically understand your compliance requirements. The pattern might look familiar from the outside while the details are completely different underneath.

The real value of experience isn’t the solution they built last time. It’s what went wrong and what they learned from it. Anyone can walk you through a success story. The vendor worth hiring can tell you where their previous project struggled, what surprised them, and what they’d do differently. That kind of honesty is harder to perform and much more useful to you.

The question to ask: “Can you walk me through what went wrong on that project and how you handled it?” Then listen. If they get specific, if they talk about tradeoffs and course corrections, you’re talking to someone who actually learned from the work. If every story is a highlight reel, you’re getting a pitch, not a perspective.

This is true beyond vendor conversations. It applies to any technical recommendation you receive. The quality of advice is not in the confidence of the answer. It’s in how well someone understands the ways things can go sideways.

The best partners don’t just tell you what they’ve built. They tell you what they’d build differently.

What question has helped you most when evaluating a vendor or technical partner?