🔥🔥 Don’t Miss Out on Our End of Autumn Sale. If you have any questions, feel free to click the bottom right corner to contact our customer service..

Concat us[email protected]
Shopping Cart

No products in the cart.

🔍
BS ISO/IEC 19795-1:2021 – TC

BS ISO/IEC 19795-1:2021 – TC

$280.87

Tracked Changes. Information technology. Biometric performance testing and reporting – Principles and framework

Published By Publication Date Number of Pages
BSI 2021 212
PDF Format Searchable Printable Preview Now
Guaranteed Safe Checkout
Categories: ,

If you have any questions, feel free to reach out to our online customer service team by clicking on the bottom right corner. We’re here to assist you 24/7.
Email:[email protected]

This document:

  1. establishes general principles for testing the performance of biometrics systems in terms of error rates and throughput rates for purposes including measurement of performance, prediction of performance, comparison of performance, and verifying conformance with specified performance requirements;

  2. specifies performance metrics for biometric systems;

  3. specifies requirements on the recording of test data and reporting of test results; and

  4. specifies requirements on test protocols in order to:

    1. reduce bias due to inappropriate data collection or analytic procedures;

    2. help achieve the best estimate of field performance for the expended effort;

    3. improve understanding of the limits of applicability of the test results.

This document is applicable to empirical performance testing of biometric systems and algorithms through analysis of the comparison scores and decisions output by the system, without requiring detailed knowledge of the system’s algorithms or of the underlying distribution of biometric characteristics in the population of interest.

Not within the scope of this document is the measurement of error and throughput rates for people deliberately trying to subvert the intended operation of the biometric system (e.g. by presentation attacks).

PDF Catalog

PDF Pages PDF Title
126 National foreword
132 Foreword
133 Introduction
135 1 Scope
2 Normative references
3 Terms and definitions
139 4 Abbreviated terms
140 5 Conformance
6 General biometric system
6.1 Conceptual representation of general biometric system
141 6.2 Conceptual components of a general biometric system
6.2.1 Data capture subsystem
6.2.2 Transmission subsystem
6.2.3 Signal processing subsystem
142 6.2.4 Data storage subsystem
6.2.5 Comparison subsystem
6.2.6 Decision subsystem
143 6.2.7 Administration subsystem
6.2.8 Interface to external application
6.3 Functions of general biometric system
6.3.1 Enrolment
144 6.3.2 Verification of a positive biometric claim
145 6.3.3 Identification
6.4 Enrolment, verification and identification transactions
146 6.5 Performance measures
6.5.1 Error rates
6.5.2 Throughput rates
147 6.5.3 Types of performance testing
7 Planning the evaluation
7.1 General
148 7.2 Determine information about the system
149 7.3 Controlling factors that influence performance
150 7.4 Test subject selection
151 7.5 Test size
7.5.1 General
7.5.2 Collecting multiple recognition transactions per test subject per system
152 7.5.3 Requirements on test size
7.6 Multiple tests
153 8 Data collection
8.1 Avoidance of data collection errors
8.2 Data and details collected
154 8.3 Enrolments
8.3.1 Enrolment transactions
155 8.3.2 Enrolment conditions
8.3.3 Enrolment failures and presentation errors
156 8.4 One-to-one comparison trials
8.4.1 General
8.4.2 Collection conditions
8.4.3 Frequency of use
157 8.4.4 Systems performing optimization based on enrolled references
8.4.5 Systems performing reference adaptation
8.4.6 Processes for data entry errors and system misuse
8.4.7 Failures to acquire
8.4.8 Adding test data to the corpus
8.4.9 Online comparison trials
158 8.4.10 Offline comparison trials
159 8.4.11 Offline non-mated comparison trials when references are dependent
8.4.12 Offline non-mated comparison trials based on comparison of references
8.4.13 Use of samples from multi-capture comparison transactions
160 8.5 Identification trials
8.5.1 General
8.5.2 Identification testing with non-enrolled test subjects
8.5.3 Use of jack-knife approach for identification testing
9 Analyses
9.1 General
161 9.2 Performance of biometric enrolment
9.2.1 Failure-to-enrol rate
9.2.2 Enrolment transaction duration
162 9.3 Performance of biometric acquisition
9.3.1 Failure-to-acquire rate
9.3.2 Acquisition process duration
9.3.3 Other aspects of acquisition performance
163 9.4 One-to-one comparison performance
9.4.1 False non-match rate
9.4.2 False match rate
164 9.5 Verification system performance metrics
9.5.1 General
9.5.2 False reject rate
165 9.5.3 False accept rate
9.5.4 Verification transaction duration
9.5.5 Generalized false reject rate and generalized false accept rate
166 9.6 Identification system performance metrics
9.6.1 General
167 9.6.2 False-negative identification rate
9.6.3 False-positive identification rate
168 9.6.4 Generalized false-negative identification rate and generalized false-positive identification rate
9.6.5 Selectivity
9.6.6 Closed-set test of identification performance
169 9.6.7 Estimation of identification error rates from one-to-one comparison results
9.6.8 Predicting identification error rates in larger populations
170 9.7 Analysis of performance across controlled experimental factors
9.7.1 Longitudinal analyses
9.7.2 Pairwise analyses
9.8 Detection error trade-off
171 9.9 Transaction durations
9.10 Computational workload
172 9.11 Uncertainty of estimates
173 10 Graphical presentation of results
10.1 Score distributions
10.1.1 General
10.1.2 Boxplots
10.2 Error rate vs threshold plot
174 10.3 DET plot
176 10.4 CMC plot / FNIR over rank plot
178 10.5 FNIR over number of enrolees plot
179 10.6 Heat maps
180 11 Record keeping
181 12 Reporting performance results
12.1 Reporting test details
182 12.2 Summary statistics
12.3 Reporting enrolment performance
12.4 Reporting acquisition performance
183 12.5 Reporting one-to-one comparison performance
12.6 Reporting verification system performance
12.7 Reporting identification system performance
184 12.8 Reporting performance across factors
186 Annex A (informative) Differences between evaluation types
187 Annex B (Informative) Test size and random uncertainty
195 Annex C (informative) Factors influencing performance
200 Annex D (Informative) Pre-selection algorithm performance
202 Annex E (informative) Identification performance as a function of database size
203 Annex F (informative) Algorithms for generating DET and CMC
206 Annex G (informative) DET properties and interpretation
210 Bibliography

Related products

BS ISO/IEC 19795-1:2021 - TC
$280.87