CVAT Tool

Configuration

Input Data ⓘThe tool requires four data files: a Confidence Matrix (how well each test detects each defect), Cost/Time (price and duration per test), Defect Frequency (how common each defect is), and a Counterfeit Type Matrix (which defects map to which counterfeit categories).

Standard — uses the AS6171 SME dataset included with the tool.
Custom — upload your own data files, or select a previously saved dataset.

Component Type ⓘWhat kind of electronic component are you testing?
Active — chips, ICs, memory, transistors, diodes (components that process signals).
Passive — resistors, capacitors, inductors (devices that receive energy which is dissipated, stored, or absorbed without an independent power source).
This changes which test methods and detection data are available.

Part Type ⓘHow complex is the part you are testing?
Simple — basic parts without internal die or bond wires (e.g. discrete devices).
Complex — parts with internal die or bond wires (e.g. processors, memory chips).
Complex parts generally have more test methods available.

Data Source ⓘWhere do the detection confidence values come from?

SME Only — uses values from Subject Matter Experts (experienced professionals who rated how well each AS6171 test method can detect each defect type). These ratings represent theoretical detectability based on expert judgment.

SME & Round Robin — combines expert ratings with empirical lab data from a round-robin study where multiple well-established test labs independently evaluated each test method on comparable samples. A slider will appear so you can control how much weight to give each source.

Note: CTC values and optimal test sequences may differ between these modes. This reflects a genuine difference between theoretical and demonstrated detectability, not an error. Some methods that experts rated highly showed lower effectiveness in practice, and vice versa.

Target Confidence ⓘHow confident do you need to be that every defect type is detected?
Higher values (e.g. 90%) mean the tool will recommend more tests to be thorough.
Lower values (e.g. 50%) allow fewer tests but you accept more risk of missing a defect.
Most users start with 90%.

Cost Budget ⓘSet a maximum total cost for all tests combined. The tool will not recommend a test plan that exceeds this amount.
Leave blank if you have no cost limit.
You can edit individual test costs in the Methods section below.

Time Budget ⓘSet a maximum total time (in minutes) for all tests combined. The tool will not recommend a test plan that takes longer than this.
Leave blank if you have no time limit.
You can edit individual test times in the Methods section below.

min

Custom data

File format reference ⓘUpload as a single .xlsx workbook (one sheet per file) or as separate .csv files. The tool auto-detects each file’s type from its content.

	Defect A	Defect B
Method 1	0.85	0.20
Method 2	0.10	0.95

If you have your own test data or subject-matter expert ratings, replace the default scores with values that reflect your actual detection capabilities. You can also add or remove rows to change which test methods are available, or add/remove columns to change which defects are considered.

Header row: first cell blank or “Method”, then one column per defect. Data rows: method name, then a 0–1 confidence value for each defect.

Method	Cost ($)	Time (min)
Method 1	3600	480
Method 2	1200	120

Replace the defaults with your actual lab costs and turnaround times. This lets the optimizer recommend methods that fit your real budget and schedule instead of generic estimates.

Exactly 3 columns. Method names must match the Confidence Matrix.

Defect	Frequency
Defect A	0.42
Defect B	0.15

If certain defects are more common in your supply chain than the default assumes, increase their frequency so the optimizer prioritizes detecting them. Set rare defects to lower values to reduce their influence on method selection.

Exactly 2 columns. Defect names must match the Confidence Matrix columns.

	Type 1	Type 2
Defect A	1	0
Defect B	0	1

If your defect list differs from the default, update this mapping so each defect is assigned to the correct counterfeit type. You can also add new categories or reclassify defects based on your own taxonomy.

Header row: first cell blank or “Defect”, then counterfeit type names. Values are 0 or 1. Defect names must match the Confidence Matrix.

Download a template ⓘDownload pre-filled CSV or XLSX files based on the built-in AS6171 data. Edit the values in a spreadsheet to match your organization’s test capabilities, costs, and risk profile, then upload below.

Pick your configuration, download, edit the values, then upload below.

Upload your files ⓘDrag and drop your data files here or click to browse. You can upload up to 4 individual CSVs (one per data type) or a single multi-tab XLSX with each sheet named after its data type.

The tool will auto-detect which file is which based on column headers and values. Review the assignments below before clicking Upload dataset.

Drag & drop files here, or browse Up to 4 CSVs (one per data type) or a single multi-tab XLSX — files are auto-detected

Saved Datasets 0 saved · stored in browser only

Methods ⓘAll the tests available for your selected component and part type.
Checkbox — check a test to include it, uncheck to leave it out.
Cost ($) & Time (min) — you can edit these values to match your lab's actual costs and durations. These are used when you set a budget.
+ Requires — some tests need another test to be done first. Click this to set up those dependencies. For example, if "Detailed EVI" requires "General EVI", then any plan that includes Detailed EVI will automatically include General EVI too.

Select All

Defects ⓘAll the defect types (ways a part could be counterfeit) that the tool will try to detect, organized by category.
Checkbox — check a defect to include it, uncheck to ignore it. You can also check or uncheck an entire category at once.
Unchecked defects are excluded from the optimization — the tool will not try to cover them when recommending tests.

Select All

Run History 0 runs · saved in browser only

Compare Runs 0 runs · select 2+ to export

Select at least 2 runs to compare

Counterfeit Vulnerability Assessment Tool (CVAT)

Features

Potential Users

Research Team

Standard Mode

Custom Data Mode

Configuration

Custom data

SME Only

SME & Round Robin