Classification Accuracy Benchmark
Independent accuracy testing against the EU's EBTI (European Binding Tariff Information) database — the gold standard for HS code classification.
Methodology
Test Data
Products are sourced from the EU's EBTI (European Binding Tariff Information) database — legally binding classification decisions made by EU customs authorities. Each product includes an official product description, product image, and the correct HS code assigned by certified customs experts.
Classification Process
Each product is classified using Import8's multi-step AI pipeline: semantic keyword extraction, candidate heading search across 16,000+ tariff codes, and final classification with full commodity tree context. The AI receives both product images and descriptions — identical to real-world API usage.
Accuracy by Chapter
| Chapter | Products | 6-Digit | 8-Digit | 6-Digit Accuracy |
|---|---|---|---|---|
| Chapter 39 | 3 | 2/3 | 2/3 |
|
| Chapter 42 | 3 | 3/3 | 2/3 |
|
| Chapter 61 | 3 | 2/3 | 1/3 |
|
| Chapter 62 | 4 | 4/4 | 4/4 |
|
| Chapter 64 | 3 | 3/3 | 3/3 |
|
| Chapter 71 | 1 | 1/1 | 1/1 |
|
| Chapter 73 | 2 | 2/2 | 2/2 |
|
| Chapter 84 | 2 | 1/2 | 1/2 |
|
| Chapter 85 | 3 | 3/3 | 3/3 |
|
| Chapter 90 | 7 | 6/7 | 6/7 |
|
| Chapter 94 | 4 | 4/4 | 4/4 |
|
Error Distribution
Individual Classifications
| Product | Expected | Classified | 6-Digit | 8-Digit | Time |
|---|---|---|---|---|---|
| Maßband, im Wesentlichen bestehend aus einem 150 Zentimeter... | 9017.80 | 9017.80 | Pass | Pass | 30.5s |
| System für die Partikelmessung in Form einer funktionellen E... | 9027.89 | 9027.89 | Pass | Pass | 35.8s |
| Kunststoffkolben -Abbildung siehe Anlage- - in Form eines na... | 8479.90 | 8479.90 | Pass | Pass | 36.1s |
| Stelaże pod materace, złożone z listew sprężynujących lub pr... | 9404.10 | 9404.10 | Pass | Pass | 37.4s |
| Lange Hose, Größe 38, Foto siehe Anlage, - in einem Polybeut... | 6204.63 | 6204.63 | Pass | Pass | 37.4s |
| Halterungen für Handtuchrollenspender (Abbildung siehe Anlag... | 8479.90 | 3926.90 | Fail | Fail | 38.8s |
| Unvollständiges Gerät zum Messen der elektrischen Eigenschaf... | 9030.89 | 9027.89 | Fail | Fail | 39.5s |
| Ähnliches Behältnis, Foto siehe Anlage, - mit einer Außensei... | 4202.92 | 4202.92 | Pass | Pass | 40.3s |
| Stiefel, Größe 43, Foto siehe Anlage, - mit Laufsohlen aus l... | 6403.91 | 6403.91 | Pass | Pass | 44.7s |
| Wyrób w formie kamizelki przeznaczony do założenia na górną... | 6211.43 | 6211.43 | Pass | Pass | 48.1s |
| Es handelt sich um Schrauben aus Stahl (kein nicht rostender... | 7318.15 | 7318.15 | Pass | Pass | 38.7s |
| Tovarom je peňaženka na krk. Rozmery tovaru: 12 x 9 cm, mate... | 4202.32 | 4202.32 | Pass | Pass | 35.1s |
| Bei der sog. "Sitzbank, Artikelnummer: 15920" handelt es sic... | 9403.60 | 9403.60 | Pass | Pass | 33.1s |
| Contaore digitale con funzionamento a vibrazione. Il disposi... | 9029.10 | 9029.10 | Pass | Pass | 37.9s |
| Sog. Wetterstation, im Wesentlichen bestehend aus einem als... | 9025.80 | 9025.80 | Pass | Pass | 36.6s |
| Nach den Antragsangaben sowie der vorliegenden Produktabbild... | 3925.90 | 3925.90 | Pass | Pass | 38.7s |
| Sog. Shiatsu-Massage-Kissen, in Form eines ca. 31 x 23 x 11... | 9019.10 | 9019.10 | Pass | Pass | 41.7s |
| Conform descrierii solicitantului si imaginii publicate in b... | 6210.10 | 6210.10 | Pass | Pass | 38.2s |
| Conform descrierii solicitantului si imaginilor publicate in... | 6402.99 | 6402.99 | Pass | Pass | 35.8s |
| Elektryczna parownica o mocy 1800 W przeznaczona do użytku d... | 8516.40 | 8516.40 | Pass | Pass | 41.5s |
| Wykonane z tworzywa sztucznego szybkozłącze do węża ogrodowe... | 3917.40 | 3917.40 | Pass | Pass | 38.9s |
| Sogenannte Mülltonnenbox (Art-Nr. 29140-209): Es handelt si... | 7308.90 | 7308.90 | Pass | Pass | 35.6s |
| Es handelt sich um einen sog. "Herrendiener, Artikel Nr: 171... | 9403.20 | 9403.20 | Pass | Pass | 35.0s |
| Conform descrierii solicitantului si imaginilor publicate in... | 6402.99 | 6402.99 | Pass | Pass | 39.2s |
| Bei der sog. Fassung Linienlampe für Osram Linestra Ralina 6... | 9405.11 | 9405.11 | Pass | Pass | 38.7s |
| Een zogenoemde handbagage trolley met –volgens opgave– onder... | 4202.12 | 4202.12 | Pass | Fail | 38.2s |
| Es handelt sich um ein rechteckiges, folienartiges Fertigerz... | 7115.90 | 7115.90 | Pass | Pass | 42.7s |
| Dle deklarovaných údajů se jedná o bimetalový termostat s ke... | 9032.10 | 9032.10 | Pass | Pass | 40.7s |
| IP-Kamera GD-CI-CT12617F (Abbildung siehe Anlage) - aus eine... | 8525.89 | 8525.89 | Pass | Pass | 44.0s |
| Warnweste, sog. Sicherheitsweste, Größe L, Foto siehe Anlage... | 6110.30 | 6110.30 | Pass | Fail | 51.1s |
| Varen er et trekantet stykke tekstilstof, som er strikket. D... | 6117.10 | 6117.10 | Pass | Pass | 33.7s |
| Varen er et par strikkede luffer. Den del, der dækker hånden... | 6116.93 | 6116.91 | Fail | Fail | 33.6s |
| Andere Ware aus Kunststoff - in Form eines Fingerhandschuhes... | 3926.20 | 6116.10 | Fail | Fail | 39.0s |
| Reglas generales 1 y 6, y texto de los códigos 6210, 6210 10... | 6210.10 | 6210.10 | Pass | Pass | 34.8s |
| "Flexibles Solarmodul" Kombinierten Maschine, im Wesentliche... | 8501.72 | 8501.72 | Pass | Pass | 36.3s |
Historical Benchmark Runs
| Date | Products | Model | Version | |
|---|---|---|---|---|
| 19 Mar 2026 15:43 | 283 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 13:36 | 99 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 13:06 | 44 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 12:40 | 48 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 11:25 | 50 | claude-sonnet-4-6 | v20-ebti-rules+sonnet-nav | View |
| 19 Mar 2026 10:30 | 50 | claude-sonnet-4-6 | v21-compressed | View |
| 13 Mar 2026 15:44 | 35 | claude-sonnet-4-6 | v20-ebti-rules | Current |
| 13 Mar 2026 15:39 | 20 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 13 Mar 2026 14:35 | 19 | claude-sonnet-4-6 | v19-elimination | View |
| 13 Mar 2026 13:44 | 23 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 13:28 | 19 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 13:13 | 10 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 12:55 | 6 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 12:24 | 20 | claude-sonnet-4-6 | v17-consensus | View |
| 12 Mar 2026 15:44 | 2 | claude-sonnet-4-6 | v17-consensus | View |
| 12 Mar 2026 15:05 | 40 | claude-sonnet-4-6 | v15-topdown | View |
| 12 Mar 2026 14:17 | 21 | claude-sonnet-4-6 | v15-topdown | View |
| 12 Mar 2026 14:16 | 1 | claude-sonnet-4-6 | v15-topdown | View |
| 08 Mar 2026 22:08 | 10 | claude-sonnet-4-5-20250929 | v15-topdown | View |
| 08 Mar 2026 21:56 | 10 | claude-sonnet-4-5-20250929 | v15-topdown | View |
Ready to classify with confidence?
Start with 50 free classifications. No credit card required.