Classification Accuracy Benchmark
Independent accuracy testing against the EU's EBTI (European Binding Tariff Information) database — the gold standard for HS code classification.
Methodology
Test Data
Products are sourced from the EU's EBTI (European Binding Tariff Information) database — legally binding classification decisions made by EU customs authorities. Each product includes an official product description, product image, and the correct HS code assigned by certified customs experts.
Classification Process
Each product is classified using Import8's multi-step AI pipeline: semantic keyword extraction, candidate heading search across 16,000+ tariff codes, and final classification with full commodity tree context. The AI receives both product images and descriptions — identical to real-world API usage.
Accuracy by Chapter
| Chapter | Products | 6-Digit | 8-Digit | 6-Digit Accuracy |
|---|---|---|---|---|
| Chapter 39 | 1 | 0/1 | 0/1 |
|
| Chapter 42 | 5 | 4/5 | 4/5 |
|
| Chapter 61 | 2 | 1/2 | 1/2 |
|
| Chapter 62 | 1 | 1/1 | 1/1 |
|
| Chapter 71 | 2 | 2/2 | 2/2 |
|
| Chapter 73 | 1 | 1/1 | 1/1 |
|
| Chapter 84 | 1 | 0/1 | 0/1 |
|
| Chapter 85 | 3 | 2/3 | 2/3 |
|
| Chapter 90 | 1 | 0/1 | 0/1 |
|
| Chapter 94 | 3 | 3/3 | 3/3 |
|
Error Distribution
Individual Classifications
| Product | Expected | Classified | 6-Digit | 8-Digit | Time |
|---|---|---|---|---|---|
| RGI 1 y 6, y texto de los códigos de NC 7307, 7307 19 y 7307... | 7307.19 | 7307.19 | Pass | Pass | 52.4s |
| Elektrický rozvádzač (Switchgear) predstavuje centralizovaný... | 8537.10 | 8537.10 | Pass | Pass | 33.3s |
| RGI 1, 3b) y 6 y texto de los códigos NC 7116, 7116 10 00.... | 7116.10 | 7116.10 | Pass | Pass | 31.8s |
| Según declaración del solicitante se trata de una cazadora.... | 3926.20 | 6210.20 | Fail | Fail | 39.9s |
| Stelaże pod materace, złożone z listew sprężynujących lub pr... | 9404.10 | 9404.10 | Pass | Pass | 34.8s |
| Produsul reprezinta un modul de detectare a curentului –senz... | 9030.33 | 9026.80 | Fail | Fail | 54.2s |
| "Flexibles Solarmodul" Kombinierten Maschine, im Wesentliche... | 8501.72 | 8501.72 | Pass | Pass | 29.8s |
| A plastic gear shift knob with a PU Leather covering. It is... | 4205.00 | 8708.40 | Fail | Fail | 46.9s |
| Dle deklarovaných údajů se jedná o výrobek kruhového tvaru z... | 8503.00 | 7326.90 | Fail | Fail | 49.6s |
| Ubranie jednorazowego użytku z 3-warstwowej włókniny z włóki... | 6210.10 | 6210.10 | Pass | Pass | 41.4s |
| Schlüsseltasche, sog. Schlüsseletui, Foto siehe Anlage, - mi... | 4202.32 | 4202.32 | Pass | Pass | 35.7s |
| Es handelt sich um synthetische Diamanten in unterschiedlich... | 7105.10 | 7105.10 | Pass | Pass | 29.1s |
| Warenzusammenstellung, bestehend aus vier Reiseorganizern, e... | 4202.92 | 4202.92 | Pass | Pass | 49.8s |
| Bei der Ware handelt es sich um ein Regal aus verchromten Ed... | 9403.20 | 9403.20 | Pass | Pass | 34.3s |
| Bei dem sog. Deko-Weihnachtsbaum mit Solar LED Lichterpusche... | 9405.41 | 9405.41 | Pass | Pass | 42.0s |
| Varen er en strikket sweater med rund halsudskæring og lange... | 6110.11 | 6110.19 | Fail | Fail | 42.0s |
| Tovarom je peňaženka na krk. Rozmery tovaru: 12 x 9 cm, mate... | 4202.32 | 4202.32 | Pass | Pass | 39.5s |
| Ręczny zraszacz pistoletowy wykonany z metalu nieszlachetneg... | 8481.80 | 8424.82 | Fail | Fail | 35.8s |
| Maglietta girocollo a manica corta, in tessuto a maglia sint... | 6109.90 | 6109.90 | Pass | Pass | 39.8s |
| RGI 1 y 6. Texto de los códigos de la NC 4202, 4202.92 y 420... | 4202.92 | 4202.92 | Pass | Pass | 36.0s |
Historical Benchmark Runs
| Date | Products | Model | Version | |
|---|---|---|---|---|
| 19 Mar 2026 15:43 | 283 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 13:36 | 99 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 13:06 | 44 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 12:40 | 48 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 19 Mar 2026 11:25 | 50 | claude-sonnet-4-6 | v20-ebti-rules+sonnet-nav | View |
| 19 Mar 2026 10:30 | 50 | claude-sonnet-4-6 | v21-compressed | View |
| 13 Mar 2026 15:44 | 35 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 13 Mar 2026 15:39 | 20 | claude-sonnet-4-6 | v20-ebti-rules | View |
| 13 Mar 2026 14:35 | 19 | claude-sonnet-4-6 | v19-elimination | View |
| 13 Mar 2026 13:44 | 23 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 13:28 | 19 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 13:13 | 10 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 12:55 | 6 | claude-sonnet-4-6 | v18-elimination | View |
| 13 Mar 2026 12:24 | 20 | claude-sonnet-4-6 | v17-consensus | Current |
| 12 Mar 2026 15:44 | 2 | claude-sonnet-4-6 | v17-consensus | View |
| 12 Mar 2026 15:05 | 40 | claude-sonnet-4-6 | v15-topdown | View |
| 12 Mar 2026 14:17 | 21 | claude-sonnet-4-6 | v15-topdown | View |
| 12 Mar 2026 14:16 | 1 | claude-sonnet-4-6 | v15-topdown | View |
| 08 Mar 2026 22:08 | 10 | claude-sonnet-4-5-20250929 | v15-topdown | View |
| 08 Mar 2026 21:56 | 10 | claude-sonnet-4-5-20250929 | v15-topdown | View |
Ready to classify with confidence?
Start with 50 free classifications. No credit card required.