Publications & Presentations

DNA mixture

• Hicklin RA, Richetelli N, Emerick BL, Bever RA, Davoren JM (2023). Variation in Assessments of Suitability and Number of Contributors for DNA Mixtures. Forensic Science International: Genetics. https://doi.org/10.1016/j.fsigen.2023.102892 (paid access; accepted manuscript)
• Noblis. (2023). “DNAmix 2021 Archive.” https://doi.org/10.17605/OSF.IO/B3MZW (open access)
• Brinkac LM, Richetelli N, Davoren JM, Bever RA, Hicklin RA, (2023) “DNAmix 2021: Laboratory policies, procedures, and casework scenarios summary and dataset”, Data in Brief 48(109150), 2023. https://doi.org/10.1016/j.dib.2023.109150 (open access)
• Noblis, “Laboratory Policies, Procedures, and Casework Scenario Decisions Relevant to DNA Mixture Interpretation: Data from the DNAmix 2021 Study,” OSF, 2023. http://doi.org/10.17605/OSF.IO/87SM4 (open access)

Latent print examination

Evaluations of latent print examiners

• Hicklin RA, Richetelli N, Taylor A, Buscaglia J. “Accuracy and reproducibility of latent print decisions on comparisons from searches of an automated fingerprint identification system.” Forensic Science International, 370 (2025) 112457. https://doi.org/10.1016/j.forsciint.2025.112457 (open access)
• Busey TA, Heise N, Hicklin RA, Ulery BT, Buscaglia J. “Characterizing missed identifications and errors in latent fingerprint comparisons using eye-tracking data.” PLOS ONE 16(5): e0251674, 2021. https://doi.org/10.1371/journal.pone.0251674 (open access)
• Hicklin RA, Ulery BT, Ausdemore M, Buscaglia J. “Why do latent fingerprint examiners differ in their conclusions?” Forensic Science International 320, Nov 2020. https://doi.org/10.1016/j.forsciint.2020.110542 (paid access; accepted manuscript)
• Hicklin RA, Ulery BT, Busey TA, Roberts MA, Buscaglia J. “Gaze behavior and cognitive states during fingerprint target group localization.” Cognitive Research: Principles and Implications, 2019 4:12. https://doi.org/10.1186/s41235-019-0160-9 (open access)
• Ulery BT, Hicklin RA, Roberts MA, Buscaglia J. “Factors associated with latent fingerprint exclusion determinations.” Forensic Science International, 275:65-75, June 2017.   https://doi.org/10.1016/j.forsciint.2017.02.011 (paid access; accepted manuscript)
• Ulery BT, Hicklin RA, Roberts MA, Buscaglia J. “Data on the interexaminer variation of minutia markup on latent fingerprints.” Data in Brief, 8: 158–190, September 2016.   https://doi.org/10.1016/j.dib.2016.04.068 (open access)
• Ulery BT, Hicklin RA, Roberts MA, Buscaglia J. “Interexaminer variation of minutia markup on latent fingerprints.” Forensic Science International, 264:89-99, July 2016.   http://dx.doi.org/10.1016/j.forsciint.2016.03.014 (paid access; accepted manuscript)
• Ulery BT, Hicklin RA, Roberts MA, Buscaglia J. “Changes in latent fingerprint examiners’ markup between Analysis and Comparison.” Forensic Science International 247(2014):54-61; Feb 2015. https://doi.org/10.1016/j.forsciint.2014.11.021 (paid access; accepted manuscript)
• Ulery BT, Hicklin RA, Roberts MA, Buscaglia J. “Measuring what latent fingerprint examiners consider sufficient information for individualization determinations.” PLoS ONE 9(11): e110179, Nov 2014. https://doi.org/10.1371/journal.pone.0110179 (open access)
• Hicklin RA, Ulery BT, Buscaglia J, Roberts MA. (2014). “In response to Haber and Haber, ‘Experimental results of fingerprint comparison validity and reliability: A review and critical analysis.’” Science & Justice, 54(5), 390–391. https://doi.org/10.1016/j.scijus.2014.06.007 (accepted manuscript)
• Hicklin RA, Ulery BT, Buscaglia J, Roberts MA. (2014). “Annex to R.A. Hicklin, et al., In response to Haber and Haber, ‘Experimental results of fingerprint comparison validity and reliability: A review and critical analysis’ — Detailed list of errors.” Science & Justice. https://www.fbi.gov/file-repository/sj-letter-to-editor-supplement.pdf
• Ulery BT, Hicklin RA, Kiebuzinski GI, Buscaglia J, Roberts MA. “Understanding the sufficiency of information for latent fingerprint value determinations”; Forensic Science International 230(1-3):99-106; July 2013. https://doi.org/10.1016/j.forsciint.2013.01.012 (paid access; accepted manuscript)
• “Black Box Latent Print Examiner Repeatability and Reproducibility” (Public dataset). OSF. https://osf.io/xvft3/?view_only=ccaeedbfabf54230a5f593b8cd10be5e
• Ulery BT, Hicklin RA, Buscaglia J, Roberts MA. “Repeatability and Reproducibility of Decisions by Latent Fingerprint Examiners”; PLoS ONE 7(3), March 2012. https://doi.org/10.1371/journal.pone.0032800 (open access)
• “Black Box Latent Print Examiner” (Public dataset). OSF. https://osf.io/e6nuj/?view_only=3fa5d6678b5441eea3377e4fdadaf960
• Ulery BT, Hicklin RA, Buscaglia J, Roberts MA. “Accuracy and Reliability of Forensic Latent Fingerprint Decisions”; Proceedings of the National Academy of Sciences 108(19), April 2011.   https://doi.org/10.1073/pnas.1018707108

Latent print quality

• Kalka ND, Beachler M, Hicklin RA. “LQMetric: A Latent Fingerprint Quality Metric for Predicting AFIS Performance and Assessing the Value of Latent Fingerprints.” Journal of Forensic Identification 70(4) 443-463, Oct 2020. (local download)
• Kalka ND, Hicklin RA. “On relative distortion in fingerprint comparison.” Forensic Science International 244(2014), 78-84, Nov 2014. https://doi.org/10.1016/j.forsciint.2014.08.007 (paid access; accepted manuscript)
• Hicklin RA, Buscaglia J, Roberts MA. “Assessing the Clarity of Friction Ridge Impressions”; Forensic Science International 226(1-3):106-17; March 2013.   https://doi.org/10.1016/j.forsciint.2012.12.015 (paid access; accepted manuscript)
• Hicklin RA, et al; “Latent Fingerprint Quality: A Survey of Examiners”; Journal of Forensic Identification 61(4), July 2011. (local download)

Latent print casework metrics

• Kiebuzinski GI, Hicklin RA, Taylor M. “Making a Case for Effective Latent Print Casework Metrics.” IDentification News, 47(2):12-13, Spring 2017. (local download)

Latent print specifications

• Chapman WJ, Hicklin RA, Kiebuzinski GI, Komarinski PD, Mayer-Splain J, Taylor M, Wallner R. “Latent Interoperability Transmission Specification”; NIST Special Publication 1152, January 2013. http://dx.doi.org/10.6028/NIST.SP.1152 (open access)
• Chapman WJ, Hicklin RA, Kiebuzinski GI, Komarinski PD, Mayer-Splain J, Taylor M, Wallner R. “Markup Instructions for Extended Friction Ridge Features”; NIST Special Publication 1151, January 2013. http://dx.doi.org/10.6028/NIST.SP.1151 (open access)
• Chapman WJ, Hicklin RA, Kiebuzinski GI, Komarinski PD, Mayer-Splain J, Taylor M, Wallner R. “Extended Feature Set Profile Specification”; NIST Special Publication 1134, January 2013. http://dx.doi.org/10.6028/NIST.SP.1134 (open access)

Latent print identification system evaluations

• Indovina M, Dvornychenko V, Hicklin RA, Kiebuzinski GI. “ELFT‐EFS Evaluation of Latent Fingerprint Technologies: Extended Feature Sets, Evaluation #2.” NIST Interagency Report 7859, May 2012. https://doi.org/10.6028/NIST.IR.7859 (open access)
• Indovina M, Hicklin RA, Kiebuzinski GI; “ELFT‐EFS Evaluation of Latent Fingerprint Technologies: Extended Feature Sets, Evaluation #1”; NIST Interagency Report 7775, March 2011. https://doi.org/10.6028/NIST.IR.7775 (open access)

Firearms examination

• Hicklin RA, Parks CL, Dunagan KM, Emerick BL, Richetelli N, Chapman WJ, Taylor M, Thompson RM. (2024). “Accuracy and Reproducibility of Bullet Comparison Decisions by Forensic Examiners.” Forensic Science International, 365(112287). https://doi.org/10.1016/j.forsciint.2024.112287 (paid access).

Footwear examination

• Hicklin RA, McVicker BC, Parks C, LeMay J, Richetelli N, Smith M, Buscaglia J, Schwartz Perlman R, Peters EM, Eckenrode BA. “Accuracy, Reproducibility, and Repeatability of Forensic Footwear Examiner Decisions.” Forensic Science International, 339(111418), 2022. https://doi.org/10.1016/j.forsciint.2022.111418 (paid access; local download)
• McVicker BC, Parks C, LeMay J, Eckenrode BA, Hicklin RA. “A Method for Characterizing Questioned Footwear Impression Quality.” Journal of Forensic Identification 71 (3), 2021, 205-216. (local download)

Handwriting examination

• Hicklin RA, Eisenhart L, Richetelli N, Belcastro P, Burkes TM, Smith M, Buscaglia J, Perlman RS, Peters EM. (2022) “Reply to Kukucka: Calculating error rates in forensic handwriting examiner decisions.” Proceedings of the National Academy of Sciences, 119(52), e2217508119. https://doi.org/10.1073/pnas.2217508119 (open access)
• Hicklin RA, Eisenhart L, Richetelli N, Miller MD, Belcastro P, Burkes TM, Parks C, Smith M, Buscaglia J, Peters EM, Perlman RS, Abonamah JV, Eckenrode BA. “Accuracy and Reliability of Forensic Handwriting Comparisons.” Proceedings of the National Academy of Sciences 119 (32) e2119944119, 2022. https://doi.org/10.1073/pnas.2119944119 (open access)

Tire examination

• Richetelli N, LeMay J, Dunagan KM, Parks CL, Hicklin RA, Chapman WJ (2024). “Accuracy and Reproducibility of Forensic Tire Examination Decisions.” Forensic Science International, 358(1112009). https://doi.org/10.1016/j.forsciint.2024.112009 (paid access)

Bloodstain pattern analysis

• Hicklin RA, Winer KR, Kish PE, Parks CL, Chapman W, Dunagan K, Richetelli N, Epstein EG, Ausdemore MA, Busey TA. “Accuracy and Reproducibility of Conclusions by Forensic Bloodstain Pattern Analysts” Forensic Science International 2021, 110856, ISSN 0379-0738. https://doi.org/10.1016/j.forsciint.2021.110856 (open access)
• Noblis, “Bloodstain Pattern Analysis Black Box Study Dataset”. OSF, 2020. https://doi.org/10.17605/osf.io/2ckhw (open access)

Forensic science (general)

• Chapman WJ, Hicklin RA, Taylor M. “Beginners Guide to Biometric and Forensic Science Human Subjects Research Protections.” NIST Special Publication 1289, January 2023. https://doi.org/10.6028/NIST.SP.1289 (open access)
• Hicklin RA, Kiebuzinski GI, Taylor M. “Best practices in the collection and use of biometric and forensic datasets.” NIST Interagency Report 8361, March 2021. https://doi.org/10.6028/NIST.IR.8361 (open access)

Facial recognition

• Kalka ND, Duncan J, Dawson J, Otto C, “IARPA Janus Benchmark Multi-Domain Face”, in Proc of IEEE Conference on Biometrics, Theory, Applications, and Systems, 2019. https://doi.org/10.1109/BTAS46853.2019.9186007
• Duncan J, Kalka ND, Maze B, Jain A, “End-to-End Protocols and Performance Metrics For Unconstrained Face Recognition”, in Proc of IEEE International Conference on Biometrics, 2019. https://biometrics.cse.msu.edu/Publications/Face/e2e_evaluation_icb2019-112219.pdf
• Anderson, Otto C, Maze B, Kalka ND, Duncan J, “Understanding Confounding Factors in Face Detection and Recognition”, in Proc of IEEE International Conference on Biometrics, 2019. https://doi.org/10.1109/ICB45273.2019.8987419
• Kalka ND, Maze B, Duncan J, O’Connor K, Elliott S, Hebert K, Bryan J, Jain AK, “IJB–S: IARPA Janus Surveillance Video Benchmark”, IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS), Redondo Beach, CA, USA, 2018. https://doi.org/10.1109/BTAS.2018.8698584
• Maze B, Adams J, Duncan JA, Kalka ND, T. Miller, Otto C, Jain AK, Niggel WT, Cheney J, Grother P, IARPA Janus Benchmark–C: Face Dataset and Protocol, in International Conference on Biometrics, Gold Coast, Australia, 2018. https://doi.org/10.1109/ICB2018.2018.00033
• Whitelam C, Taborsky E, Blanton A, Maze B, Adams J, Miller T, Kalka ND, Jain AK, Duncan J, Allen KC, Cheney J, Grother P, IARPA Janus Benchmark-B Face Dataset, in IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA, 2017. https://doi.org/10.1109/CVPRW.2017.87
• Adams C, Allen KC, Miller T, Kalka ND, Jain AK. “Grouper: Optimizing Crowdsourced Face Annotations”, CVPR, Workshop on Biometrics, June 26, 2016. http://biometrics.cse.msu.edu/Publications/Face/AdamsAllenMillerKalkaJain_CVPRWB2016_GRPR.pdf (open access)
• Blanton A, Allen KC, Miller T, Kalka ND, Jain AK. “A Comparison of Human and Automated Face Verification Accuracy on Unconstrained Image Sets”, CVPR, Workshop on Biometrics, June 26, 2016. http://biometrics.cse.msu.edu/Publications/Face/BlantonAllenMillerKalkaJain_CVPRWB2016_HID.pdf (open access)
• Ice J, Narang N, Whitelam C, Kalka ND, Hornak L, Dawson J, Bourlai T. (2012). SWIR Imaging for Facial Image Capture through Tinted Materials, SPIE 8353, Infrared Technology and Applications XXXVIII, 83530S, 2012 https://doi.org/10.1117/12.919105
• Kalka ND, Bourlai T, Cukic B, Hornak L (2011). Cross-spectral Face Recognition in Heterogeneous Environments: A Case Study on Matching Visible to Short-wave Infrared Imagery, International Joint Conference on Biometrics (IJCB), Washington, DC, USA, 2011. https://doi.org/10.1109/IJCB.2011.6117586
• Bourlai T, Kalka N, Cao D, Decann B, Jafri Z, Nicolo F, Whitelam C, Zuo J, Adjeroh D, Cukic B, Dawson J, Hornak L, Ross A, Schmid NA (2011). In: Bhanu, B. et. al. (eds) Distributed Video Sensor Networks, Springer, London, Part 7, 471-478. https://doi.org/10.1007/978-0-85729-127-1_30
• Bourlai T, Kalka N, Ross A, Cukic B, Hornak L (2010). Cross-spectral Face Verification in the Short Wave Infrared (SWIR) Band, 20th International Conference on Pattern Recognition, Istanbul, Turkey, 2010, pp. 1343-1347. https://doi.org/10.1109/ICPR.2010.1115

Iris recognition

• Kalka ND, Bartlow N, Cukic B, Ross A. “A Preliminary Study on Identifying Sensors from Iris Images,” Proc. of IEEE Computer Society Workshop on Biometrics at the Computer Vision and Pattern Recognition (CVPR) Conference, (Boston, USA), June 2015. https://www.cse.msu.edu/~rossarun/pubs/KalkaBartlowCukicRossIrisSensorForensics_CVPRW2015.pdf (open access)
• Kalka ND, Zuo J, Schmid NA, Cukic B. (2010). Estimating and Fusing Quality Factors for Iris Biometric Images, IEEE Transactions on Systems, Man and Cybernetics – Part A: Systems and Humans, Vol 40(3), pp. 509-524. https://doi.org/10.1109/TSMCA.2010.2041658
• Kalka ND, Bartlow N, Cukic B, “An automated method for predicting iris segmentation failures”, in Proc of IEEE Conference on Biometrics, Theory, Applications, and Systems, 2009. https://doi.org/10.1109/BTAS.2009.5339062
• Bartlow N, Kalka ND, Cukic B, Ross A (2007). Protecting Iris Images through Asymmetric Digital Watermarking, of 5th IEEE Workshop on Automatic Identification Advanced Technologies (AutoID), Alghero, Italy, pp. 191-197. https://doi.org/10.1109/AUTOID.2007.380618
• Zuo J, Kalka ND, Schmid NA (2006). A Robust Iris Procedure for Unconstrained Subject Presentation, in Proc. Biometrics Consortium Conf., Baltimore, Maryland. September 19-21. https://doi.org/10.1109/BCC.2006.4341623