How to Set Up a Vendor Quality Rating System for LED Therapy Component Suppliers
After our USB-C port failure incident (7 complaints in 3 months traced to a bad batch from our connector supplier), we realized we had no systematic way to evaluate whether a supplier was getting better or worse over time. We were treating every purchase order as an isolated transaction.
We built a vendor quality rating system that scores every supplier monthly. It took three months to design and implement. In the first year, it helped us identify two deteriorating suppliers before they caused field failures, and it gave us the data to negotiate better terms with our best suppliers.
—
## The Scoring Framework
**Five dimensions, each weighted by importance:**
| Dimension | Weight | What It Measures |
|———–|——–|—————–|
| Quality | 40% | Defect rate, consistency, specification compliance |
| Delivery | 25% | On-time delivery, lead time stability |
| Responsiveness | 15% | Communication speed, problem resolution time |
| Cost | 10% | Price competitiveness, price stability |
| Innovation | 10% | Proactive improvements, new product suggestions |
**Scoring scale:** 1-5 for each dimension
– 5 = Exceptional (top 10% of suppliers)
– 4 = Good (meets all requirements consistently)
– 3 = Acceptable (meets most requirements, occasional issues)
– 2 = Below standard (frequent issues, requires improvement plan)
– 1 = Unacceptable (critical issues, replacement recommended)
**Composite score = Σ (dimension score × weight)**
Maximum composite: 5.0, Minimum: 1.0
**Supplier classification by composite score:**
– **A (4.0-5.0):** Strategic partner — increase volume, offer longer-term contracts
– **B (3.0-3.9):** Approved supplier — maintain current volume, monitor trends
– **C (2.0-2.9):** Probationary — require improvement plan within 60 days
– **D (below 2.0):** Replace — begin sourcing from alternative supplier
## Quality Dimension (40% weight)
**Metrics tracked:**
– Incoming defect rate (PPM — parts per million)
– Batch-to-batch consistency (coefficient of variation on key parameters)
– Specification compliance (% of measured parameters within spec)
– First pass yield at our factory (% of their components that pass our QC without rework)
– Customer field failures attributed to their components (per million units shipped)
**Our scoring:**
| Score | Incoming Defect Rate | Field Failure Rate | Consistency |
|——-|———————|——————-|————-|
| 5 | <500 PPM | <10 PPM | CV <3% |
| 4 | 500-1000 PPM | 10-25 PPM | CV 3-5% |
| 3 | 1000-3000 PPM | 25-50 PPM | CV 5-8% |
| 2 | 3000-10000 PPM | 50-100 PPM | CV 8-12% |
| 1 | >10000 PPM | >100 PPM | CV >12% |
**Example: Our LED chip supplier (Epistar)**
– Incoming defect rate: 340 PPM → 5 points
– Field failure rate: 8 PPM → 5 points
– Wavelength consistency: CV 2.1% → 5 points
– **Quality dimension score: 5.0**
**Example: Our USB-C connector supplier (before incident)**
– Incoming defect rate: 2,400 PPM → 3 points
– Field failure rate: 180 PPM → 2 points
– Solder joint consistency: CV 9.2% → 2 points
– **Quality dimension score: 2.3**
The connector supplier was a C-rated supplier on quality before the incident. We should have acted on the data earlier.
## Delivery Dimension (25% weight)
**Metrics tracked:**
– On-time delivery rate (% of POs delivered on or before the confirmed date)
– Lead time stability (standard deviation of actual vs. quoted lead time)
– Advance shipment notification compliance (% of shipments with proper ASN)
– Packaging and labeling compliance (% of shipments with correct packaging)
| Score | On-Time Rate | Lead Time Variance |
|——-|————-|——————-|
| 5 | >98% | ±2 days |
| 4 | 95-98% | ±3 days |
| 3 | 90-95% | ±5 days |
| 2 | 80-90% | ±7 days |
| 1 | <80% | >±7 days |
## Responsiveness Dimension (15% weight)
**Metrics tracked:**
– Average response time to RFQ (business hours)
– Average response time to quality issues (business hours)
– Problem resolution time (days from issue report to root cause + corrective action)
– Proactive communication (% of issues they identify and notify us about, vs. us discovering them)
| Score | RFQ Response | Quality Issue Response | Resolution Time |
|——-|————-|———————-|—————-|
| 5 | <4 hours | <2 hours | <3 days |
| 4 | 4-8 hours | 2-8 hours | 3-7 days |
| 3 | 8-24 hours | 8-24 hours | 7-14 days |
| 2 | 24-48 hours | 1-3 days | 14-30 days |
| 1 | >48 hours | >3 days | >30 days |
## Cost Dimension (10% weight)
**Metrics tracked:**
– Price competitiveness vs. market average
– Price stability (annual price change)
– Willingness to negotiate volume discounts
– Total cost of ownership (including quality costs, rework, delays)
**Why only 10% weight:** We learned the hard way that optimizing for supplier cost leads to higher total cost. Our cheapest USB-C connector supplier cost $0.08/unit less than the better alternative, but the field failures they caused cost us $12,000. On 50,000 units, the $4,000 we saved on component price was wiped out three times over by quality costs.
## Innovation Dimension (10% weight)
**Metrics tracked:**
– Number of proactive improvement suggestions per year
– New product/technology introductions relevant to our business
– Willingness to co-develop custom solutions
– Technical support quality (application engineering, design reviews)
**This dimension separates commodity suppliers from strategic partners.** Our LED supplier (Epistar) earns a 5 on innovation because they proactively suggested a new binning approach that improved our wavelength consistency. Our battery supplier earns a 2 — they do what we ask but never suggest improvements.
## The Monthly Review Process
**Every month, our procurement team:**
1. Updates incoming quality data from our IQC records
2. Updates delivery data from our purchasing system
3. Assigns responsiveness and innovation scores based on recent interactions
4. Calculates composite scores for all suppliers
5. Flags any supplier that dropped more than 0.5 points from the previous month
**The monthly review meeting (30 minutes):**
– Review flagged suppliers
– Discuss improvement plans for C-rated suppliers
– Identify opportunities to increase volume with A-rated suppliers
– Approve or reject new supplier additions
**Quarterly business review (with A-rated suppliers):**
– Share our rating of their performance
– Discuss upcoming demand forecasts
– Review quality trends and improvement opportunities
– Negotiate volume commitments and pricing
## Using Ratings to Drive Action
**Our supplier management actions by rating:**
| Rating | Volume Allocation | Payment Terms | Contract Type |
|——–|—————–|—————|—————|
| A | 60-80% of category | Net 45-60 | Annual framework agreement |
| B | 20-40% of category | Net 30-45 | Quarterly PO |
| C | Minimal, dual-source only | Net 15-30 | Per-PO basis |
| D | Phasing out | Cash on delivery | Exit plan |
**Success stories from the rating system:**
1. **LED supplier (Epistar) — A-rated:** We negotiated a 3-year framework agreement with locked pricing and priority allocation during shortages. In return, we committed to 70% of our LED spend with them. Win-win.
2. **Connector supplier — C-rated after USB-C incident:** We issued a corrective action request, gave them 60 days to improve, and qualified an alternative supplier. The original supplier improved to B-level within 3 months. We now dual-source connectors.
3. **Silicone supplier — dropped from B to C:** Their consistency score declined over two months (CV went from 4% to 7% on hardness measurements). We raised the issue proactively and discovered they’d changed their mixing process. They reverted to the original process, and their score recovered to B within a month.
## The Data Collection Challenge
**The rating system is only as good as its data.** We invested in:
– **IQC inspection records** — every incoming lot is inspected, results are recorded digitally
– **ERP system tracking** — PO dates, delivery dates, and quantities are tracked automatically
– **Email integration** — response times are tracked from our procurement inbox timestamps
– **Field return analysis** — every returned unit is analyzed, and the root cause is attributed to a component supplier when applicable
**Time investment:** Approximately 4 hours per month for data collection and scoring across 15 active suppliers.
A vendor quality rating system transforms supplier management from reactive to proactive. Instead of waiting for a quality crisis, you see trends before they become problems. The data gives you leverage in negotiations and confidence in your supply chain. Start with quality and delivery metrics (they’re the most objective and important), and add the other dimensions as you build the habit of systematic supplier evaluation.
