Classification Accuracy Benchmark
Independent accuracy testing against the EU's EBTI (European Binding Tariff Information) database — the gold standard for HS code classification.
Methodology
Test Data
Products are sourced from the EU's EBTI (European Binding Tariff Information) database — legally binding classification decisions made by EU customs authorities. Each product includes an official product description, product image, and the correct HS code assigned by certified customs experts.
Classification Process
Each product is classified using Customs8's multi-step AI pipeline: semantic keyword extraction, candidate heading search across 16,000+ tariff codes, and final classification with full commodity tree context. The AI receives both product images and descriptions — identical to real-world API usage.
Accuracy by Chapter
| Chapter | Products | 6-Digit | 8-Digit | 6-Digit Accuracy |
|---|---|---|---|---|
| Chapter 39 | 1 | 0/1 | 0/1 |
|
| Chapter 42 | 1 | 1/1 | 1/1 |
|
| Chapter 61 | 2 | 2/2 | 2/2 |
|
| Chapter 62 | 2 | 2/2 | 1/2 |
|
| Chapter 64 | 1 | 1/1 | 1/1 |
|
| Chapter 71 | 1 | 1/1 | 1/1 |
|
| Chapter 73 | 1 | 1/1 | 1/1 |
|
| Chapter 94 | 1 | 1/1 | 1/1 |
|
Error Distribution
Individual Classifications
| Product | Expected | Classified | 6-Digit | 8-Digit | Time |
|---|---|---|---|---|---|
| Es handelt sich um kaltgeformte, schraubenlinienförmige Fede... | 7320.20 | 7320.20 | Pass | Pass | 16.3s |
| Brustbeutel, Foto siehe Anlage, - mit einer Außenseite aus S... | 4202.92 | 4202.92 | Pass | Pass | 92.9s |
| Belysningsartikel i form av en solcellslampa avsedd att häng... | 9405.41 | 9405.41 | Pass | Pass | 72.8s |
| Schuh : - den Knöchel bedeckend (jedoch nicht die Wade), -... | 6404.19 | 6404.19 | Pass | Pass | 74.5s |
| Según declaración del solicitante se trata de una cazadora.... | 3926.20 | 6211.33 | Fail | Fail | 15.1s |
| RGI 1, 3b) y 6 y texto de los códigos NC 7116, 7116 10 00.... | 7116.10 | 7116.10 | Pass | Pass | 55.6s |
| Lange Hose, Größe 38, Foto siehe Anlage, - in einem Polybeut... | 6204.63 | 6204.63 | Pass | Fail | 20.4s |
| Modisches Unterhemd, Größe 36/38, Foto siehe Anlage, - aus ü... | 6109.10 | 6109.10 | Pass | Pass | 14.7s |
| De algemene regels 1 en 6 voor de interpretatie van de gecom... | 6214.30 | 6214.30 | Pass | Pass | 13.1s |
| Lange Hose, in Erwachsenengröße, Foto siehe Anlage, - in ein... | 6103.43 | 6103.43 | Pass | Pass | 62.1s |
Historical Benchmark Runs
| Date | Products | Model | Version | |
|---|---|---|---|---|
| 06 Mar 2026 20:22 | 2 | claude-sonnet-4-5-20250929 | v8-db-candidates | View |
| 06 Mar 2026 19:47 | 10 | claude-sonnet-4-5-20250929 | v8-db-candidates | View |
| 06 Mar 2026 19:41 | 3 | claude-sonnet-4-5-20250929 | v10-hybrid | View |
| 06 Mar 2026 19:35 | 4 | claude-sonnet-4-5-20250929 | v10-hybrid | View |
| 06 Mar 2026 19:15 | 10 | claude-sonnet-4-5-20250929 | v9-haiku-candidates | Current |
| 06 Mar 2026 19:00 | 10 | claude-sonnet-4-5-20250929 | v9-haiku-candidates | View |
| 06 Mar 2026 18:38 | 9 | claude-sonnet-4-5-20250929 | v8-db-candidates | View |
| 06 Mar 2026 17:51 | 10 | claude-sonnet-4-5-20250929 | v7-function-over-material | View |
| 06 Mar 2026 17:48 | 2 | claude-sonnet-4-5-20250929 | v7-function-over-material | View |
| 06 Mar 2026 17:46 | 1 | claude-sonnet-4-5-20250929 | v7-function-over-material | View |
| 06 Mar 2026 17:41 | 1 | claude-sonnet-4-5-20250929 | v7-function-over-material | View |
| 06 Mar 2026 17:39 | 1 | claude-sonnet-4-5-20250929 | v7-function-over-material | View |
| 06 Mar 2026 16:58 | 10 | claude-sonnet-4-5-20250929 | v7-function-over-material | View |
| 06 Mar 2026 16:44 | 10 | claude-sonnet-4-5-20250929 | v6-confidence | View |
| 06 Mar 2026 16:28 | 3 | claude-sonnet-4-5-20250929 | v6-confidence | View |
| 06 Mar 2026 15:56 | 3 | claude-sonnet-4-5-20250929 | v6-confidence | View |
| 06 Mar 2026 15:43 | 10 | claude-sonnet-4-5-20250929 | v6-confidence | View |
| 06 Mar 2026 15:40 | 1 | claude-sonnet-4-5-20250929 | v6-confidence | View |
| 06 Mar 2026 15:36 | 2 | claude-sonnet-4-5-20250929 | v6-confidence | View |
| 06 Mar 2026 15:32 | 3 | claude-sonnet-4-5-20250929 | v6-confidence | View |
Ready to classify with confidence?
Start with 50 free classifications. No credit card required.
