How to Build a Weighted Vendor Selection Scorecard

Without a scorecard, vendor selection tends to go one of two ways. The loudest stakeholder picks their favorite, or the cheapest bid wins because price is the only number everyone can agree on. Neither is a good way to spend a large budget.

A weighted scorecard fixes this by deciding what matters before anyone sees a proposal. If you need ideas for which criteria to include, start with our list of vendor selection criteria that matter.

Step 1: Write down the gates

Gates are requirements a supplier must meet to be considered at all. Put them first and keep them out of the weighted score. Typical gates include:

• Required certifications (for example, SOC 2 Type II for a vendor hosting your data).
• Minimum insurance coverage.
• Legal and regulatory requirements, such as signing a HIPAA business associate agreement.
• Ability to serve required locations.
• Acceptance of non-negotiable contract terms.

Check gates as responses come in. Any supplier that fails is out, no matter how strong the rest of the proposal looks.

Step 2: Choose five to eight weighted criteria

More criteria feel thorough, but they dilute the ones that matter. With 15 criteria at similar weights, a supplier can lose badly on the most important one and still win overall. Five to eight is the practical range.

A common starting set for a services or software purchase:

1. Functional fit to requirements.
2. Total cost of ownership over the contract term.
3. Implementation approach and timeline.
4. Service and support model.
5. References and relevant experience.
6. Vendor viability and roadmap.

Step 3: Assign weights before you see bids

Agree on weights with stakeholders before proposals arrive. If you set them afterward, people will adjust weights, consciously or not, to favor the supplier they already like.

Weights should add up to 100 and reflect what failure would cost you. Here is an example for a mid-sized SaaS purchase:

For a commodity purchase, cost might carry 50 or 60 percent of the weight. For a critical system that would be painful to replace, functional fit and viability rise.

Step 4: Write scoring rules for each criterion

This is the step that makes a scorecard fair. For every criterion, define what a 1, 3, and 5 look like. Evaluators fill in 2 and 4 with judgment.

Example rule for "support and service levels":

• 5: Named account manager, 24/7 support for critical issues, response time SLA of one hour or better with service credits, and a customer success plan.
• 3: Business-hours support with a defined response SLA, shared support queue, credits available but limited.
• 1: Email support only, no committed response time, no credits.

Scoring rules take an hour or two to write. They save far more time in the debate that follows.

For cost, avoid scoring by gut feel. A simple method: give the lowest total cost a 5 and score others in proportion. If the lowest bid is $400,000 and another is $500,000, the second scores 5 x (400,000 / 500,000) = 4.0.

Step 5: Score independently, then calibrate

Have each evaluator score on their own first, ideally without seeing each other's numbers. Then meet to compare. Where scores differ by two points or more on the same criterion, ask each evaluator to explain. Often one person noticed something the others missed.

Adjust scores after discussion if the reasoning holds up, and record why. That record is useful if a losing supplier asks for a debrief or if the decision is later questioned.

Guard against a few biases:

• Halo effect. A great demo inflates every score. Score each criterion separately.
• Incumbent bias. The current supplier feels safer because it is familiar. Score them on the same rules.
• Anchoring on price. If evaluators see pricing first, it colors how they score everything else. Many teams have pricing scored separately by procurement.

Step 6: Total, sanity-check, and decide

Multiply each score by its weight, sum them, and rank suppliers. Then ask a simple question: does this result make sense? If the top scorer is a supplier nobody on the team wants, something is off, usually a weight that does not reflect what people actually care about. Talk it through rather than overriding the result quietly.

Close scores (within a few points) are effectively a tie. Break ties with a follow-up demo, a reference call, or a best-and-final pricing round.

Step 7: Keep the scorecard for later

After contract signature, the scorecard becomes the baseline for vendor performance reviews. If you chose a supplier for its support model, measure support. Our free vendor scorecard template works for both selection and ongoing reviews.

Store the final scorecard with the contract in your repository. When the renewal comes around, you will know exactly why this supplier was chosen and whether it delivered.