5 Supplier Scorecard Metrics Every eCommerce Brand Should Track

You probably have a gut feeling about which vendors are reliable and which ones aren't. The problem is that gut feelings don't hold up in a vendor review, don't help you negotiate better terms, and don't explain why your stockout rate spiked last quarter.

A supplier scorecard replaces intuition with data. It's a structured set of metrics that measures how well your vendors are delivering against the commitments they made when you signed the purchase agreement. When you track those metrics consistently, patterns emerge. You'll find out which suppliers are costing you more than their pricing suggests, which ones are quietly improving, and which ones are creating problems your team has been absorbing without realizing it.

For midsized eCommerce and distribution brands managing anywhere from five to 50 suppliers, a scorecard doesn't have to be complicated. These five metrics cover the ground that matters most.

1. OTIF: On-Time, In-Full Delivery Rate

OTIF is the single most important metric on any supplier scorecard. It measures whether a vendor delivered exactly what you ordered, in the correct quantity, within the agreed delivery window. Both conditions have to be met. A shipment that arrives on time but is missing 20 percent of the order fails. A complete shipment that arrives a week late also fails.

The calculation is straightforward: Divide the number of orders delivered on time and in full by the total number of orders, then multiply by 100. An OTIF score above 95 percent is generally considered excellent, though major retailers like Walmart now require 98 percent and charge suppliers 3 percent of cost of goods sold for each failure.

For eCommerce brands, OTIF directly affects your ability to keep products in stock and fulfill customer orders on time. A supplier running at 85 percent OTIF means roughly one in seven shipments arrives late or incomplete. That translates to stockouts, expedited shipping costs to compensate, and customer orders that ship late or get canceled.

Track OTIF monthly per supplier. When the number drops below your threshold, you'll have a data point to bring into the conversation instead of a vague sense that "they've been slow lately."

2. Order Accuracy

Order accuracy measures whether the supplier shipped the right products in the right quantities, separate from whether they arrived on time. OTIF catches timing and completeness together, but order accuracy isolates the fulfillment precision.

This matters because the cost of receiving the wrong items goes beyond the missing product. Your warehouse team spends time inspecting, documenting, and processing receiving errors. Your purchasing team has to issue a correction, arrange a return or credit, and place a replacement order. And if the wrong items make it past receiving and into your available inventory, they can end up shipping to a customer. In that case, you'll face a return, a refund, and a customer service interaction that costs more than the product itself.

Track order accuracy as the percentage of line items received that exactly match what was ordered, including SKU, quantity, and condition. A consistent accuracy rate below 98 percent warrants a conversation with the vendor about their picking and packing processes.

3. Defect and Return Rate

Defect rate measures the percentage of units received from a supplier that fail quality inspection or are returned by your end customers due to product issues. This is the metric that tells you whether a low-cost supplier is actually low-cost or whether their pricing advantage is getting eaten by quality problems on the back end.

A supplier with a 5 percent defect rate at a $10 unit cost isn't actually cheaper than a supplier with a 0.5 percent defect rate at $11 per unit. The first supplier's true cost includes the defective inventory, warehouse labor to inspect and segregate it, customer returns, refund processing, and replacement shipments. Those hidden costs add up fast for eCommerce brands processing hundreds or thousands of orders a month.

Track defect rate at receiving (units that fail inspection) and post-sale (units returned by customers attributed to product quality). When both numbers are available, you can see whether quality issues are being caught in your warehouse or making it all the way to the customer, which is a much more expensive failure point.

4. Lead Time Consistency

Average lead time tells you how long a supplier typically takes to deliver. Lead time consistency tells you how reliably they hit that average. The difference matters enormously for inventory planning.

A supplier with a 14-day average lead time and a two-day variance is far more useful than a supplier with a 12-day average and a 10-day variance. The first supplier is predictable. You can set reorder points, plan safety stock, and promise delivery dates to your customers with confidence. The second supplier is faster on paper but forces you to carry extra safety stock to compensate for the unpredictability, which ties up cash and warehouse space.

Track lead time as a range, not just an average. Record the delivery date for every purchase order and calculate the standard deviation over a rolling 90-day window. If the variance is growing, even while the average stays flat, the supplier's reliability is deteriorating. Raising that in a quarterly review with specific data gives the vendor something actionable to address, which is more productive than simply asking them to "be faster."

5. Cost Variance

Cost variance measures the gap between what a supplier quoted or contracted and what they actually charged. This includes unit pricing, but it also includes freight, surcharges, minimum order fees, and any other costs that show up on the invoice but weren't part of the original agreement.

For eCommerce brands managing tight margins, even small cost variances compound quickly. A supplier that consistently invoices 2 to 3 percent above contracted pricing across hundreds of purchase orders per year creates a significant unplanned expense that's easy to miss when invoices are processed individually but obvious when tracked on a scorecard.

Track cost variance as the percentage difference between contracted price and actual invoiced amount, aggregated monthly per supplier. Separate the variance into pricing (unit cost differences) and non-pricing (freight, fees, surcharges) so you can see where the deviation is coming from. Some variance is normal, especially when raw material costs fluctuate. But consistent, unexplained upward variance is a negotiation issue that the scorecard gives you the data to address.

How to Put a Scorecard Into Practice

You don't need specialized software to start. A spreadsheet with these five metrics, updated monthly per supplier, will give you more visibility into vendor performance than most midsized eCommerce brands have. SPS Commerce's scorecard guide walks through the setup process in detail for midsized retailers who are building their scorecards for the first time.

The key is consistency. A scorecard works only if it's updated on a regular cadence and shared with your suppliers. The point isn't to punish underperformers. It's to create a shared language for performance conversations. When a supplier sees that their OTIF dropped from 96 percent to 88 percent over two quarters, they know exactly what they need to fix. When you can show that a vendor's cost variance has been creeping upward for six months, you'll have leverage in the next pricing negotiation that gut feelings simply can't provide.

As your supplier base and transaction volume grow, tracking these metrics in spreadsheets will start to feel the same way tracking inventory in spreadsheets did. That's when an ERP system with built-in purchasing and vendor management will start to pay off. The data will flow automatically from purchase orders, receipts, and AP invoices into the metrics you're already tracking, eliminating the manual collection that makes scorecards hard to maintain.

First, find out where your operational efficiency stands today and whether your current systems can support the vendor management your growth requires. Then, read our guide to the best ERP for eCommerce for a comparison of the platforms built for this exact stage. And if you want a quick read on your readiness, take our ERP readiness quiz below.