Fairware, May 9 2022

Fairware22 , International Workshop on Equitable Data & Technology, colocated with ICSE22

Panel: The Role of Software Engineering Foundations in Critical Automated Decision-Making Systems

Marc Canellas, Bruce Hedin, Nathan Adams, Jeanna Matthews (moderator)

Resources from panelist and moderator Jeanna Matthews(Clarkson University/ACM/IEEE)

Criminal Justice Software Testing/ Probabilistic Genotyping Software (PGS) Systems	J. Matthews, S. Lorenz, M. Babaeianjelodar, A. Matthews, M. Njie, N. Adams, D. Krane, J. Goldthwaite, C. Hughes The Right To Confront Your Accusers: Opening the Black Box of Forensic DNA Software Proceedings of the 2019 AAAI/ACM Conference on Artificial Intelligence, Ethics and Society (AIES) , Honolulu, Hawaii, January 27-28 2019. PDF Brown Institute Magic Grant, Decoding Differences in DNA Forensic Software , 2018-2019. Magic Grant Profile Example of impact: STRmix ruled inadmissable in US v. Gissantaner, October 16 2019. ( PDF) J. Matthews, G. Northup, I. Grasso, S. Lorenz, M. Babaeianjelodar, H. Bashaw, S. Mondal, A. Matthews, M. Njie, J. Goldthwaite When Trusted Black Boxes Don't Agree: Incentivizing Iterative Improvement and Accountability in Critical Software Systems Proceedings of the 2020 AAAI/ACM Conference on Artificial Intelligence, Ethics and Society (AIES) , New York, New York, USA, February 7-8 2020. PDF (Paper), Slides Mats Heimdahl and Jeanna Matthews, Amici Curiae Brief in New Jersey v. Pickett , October 14 2020. Full Decision , Some key quotes Declaration in US v. Ellis, Heimdahl and Matthews, November 16 2020. Response, Nathan Adams and Jeanna Matthews, February 16 2021. Decision , Some key quotes You're just complaining because you're guilty: A DEF CON Guide to Adversarial Testing of Software Used In the Criminal Justice System DEF CON 26 , Las Vegas, August 9-12 2018. Video (English) Schedule , Slides .
IEEE IEEE-USA AI Policy Commmitee	IEEE Letter to NIST responding to request for comments on NIST Internal Report 8351-DRAFT DNA Mixture Interpretation: A NIST Scientific Foundation Review, November 2021. IEEE P7000 suite of standards including IEEE 7010-2020 IEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being and IEEE 7000-2021 IEEE Standard Model Process for Addressing Ethical Concerns during System Design Ethics Certification Program for Autonomous and Intelligent Systems (ECPAIS) Ethically Aligned Design especially the chapter on Well-being IEEE 1012-2016 , IEEE Standard for System, Software, and Hardware Verification and Validation IEEE 829-2008, IEEE Standard for Software and System Test Documentation. IEEE P3119, Standard for the Procurement of Artificial Intelligence and Automated Decision Systems Privacy, Equity and Justice in Artificial Intelligence , Policy Statement, November 2021. Democratic Use of Artificial Intelligence , Policy Statement, November 2021. Artificial Intelligence: Job, Education, Workforce and Diversity , Policy Statement, November 2021. Effective Governance of Artificial Intelligence , Policy Statement, June 2021. K. Karachalios, N. Stern and J, Havens Measuring What Matters in the Era of Global Warming and Algorithmic Promises, 2019. Gabriela Bar, Gabriela Wiktorzak, Jeanna Matthews Four Conditions for Building Trusted AI Systems: Effectiveness, Competence, Accountability, and Transparency IEEE Beyond Standards, July 13 2021. C. Ignacio Gutierrez, G. Marchant, K. Michael Effective and Trustworthy Implementation of AI Soft Law Governance IEEE Transaction on Technology and Society 2021, February 18 2021. C. Ignacio Gutierrez, G. Marchant A Global Perspective of Soft Law Programs for the Governance of Artificial Intelligence
ACM ACM Technology Policy Council ACM US-Technology Policy Council	ACM US Public Policy Council (US-ACM) Statement on Algorithmic Transparency and Accountability , January 12 2017. S. Garfinkel, J. Matthews, S. Shapiro, J. Smith Toward Algorithmic Transparency and Accountability , Communications of the ACM , Vol. 60, No. 9, Page 5, Sept. 2017, 10.1145/3125780. Panel session at National Press Club (9/14/2017), Summary . R. Baeza-Yates, T. Chen, N. Diakopoulos, A. Matthews, J. Matthews, E. Moss, A. Rosenthal ACM US-TPC Comments on NIST Artificial Intelligence Risk Management Framework, January 27 2022. Comments relative to: NIST Concept Paper , Previous Comments, and Workshop ACM Code of Ethics and Professional Conduct

Criminal Justice Software Testing/ Probabilistic Genotyping Software (PGS) Systems

J. Matthews, S. Lorenz, M. Babaeianjelodar, A. Matthews, M. Njie, N. Adams, D. Krane, J. Goldthwaite, C. Hughes
The Right To Confront Your Accusers: Opening the Black Box of Forensic DNA Software
Proceedings of the 2019 AAAI/ACM Conference on Artificial Intelligence, Ethics and Society (AIES) , Honolulu, Hawaii, January 27-28 2019.
PDF

Brown Institute Magic Grant,
Decoding Differences in DNA Forensic Software , 2018-2019.
Magic Grant Profile
Example of impact: STRmix ruled inadmissable in US v. Gissantaner, October 16 2019. ( PDF)

J. Matthews, G. Northup, I. Grasso, S. Lorenz, M. Babaeianjelodar, H. Bashaw, S. Mondal, A. Matthews, M. Njie, J. Goldthwaite
When Trusted Black Boxes Don't Agree: Incentivizing Iterative Improvement and Accountability in Critical Software Systems
Proceedings of the 2020 AAAI/ACM Conference on Artificial Intelligence, Ethics and Society (AIES) , New York, New York, USA, February 7-8 2020.
PDF (Paper), Slides

Mats Heimdahl and Jeanna Matthews,
Amici Curiae Brief in New Jersey v. Pickett , October 14 2020. Full Decision , Some key quotes
Declaration in US v. Ellis, Heimdahl and Matthews, November 16 2020. Response, Nathan Adams and Jeanna Matthews, February 16 2021. Decision , Some key quotes

You're just complaining because you're guilty: A DEF CON Guide to Adversarial Testing of Software Used In the Criminal Justice System
DEF CON 26 , Las Vegas, August 9-12 2018.
Video (English)
Schedule , Slides .

IEEE
IEEE-USA AI Policy Commmitee

IEEE Letter to NIST responding to request for comments on NIST Internal Report 8351-DRAFT DNA Mixture Interpretation: A NIST Scientific Foundation Review, November 2021.

IEEE P7000 suite of standards including
IEEE 7010-2020 IEEE Recommended Practice for Assessing the Impact of Autonomous and Intelligent Systems on Human Well-Being and
IEEE 7000-2021 IEEE Standard Model Process for Addressing Ethical Concerns during System Design

Ethics Certification Program for Autonomous and Intelligent Systems (ECPAIS)

Ethically Aligned Design especially the chapter on Well-being

IEEE 1012-2016 , IEEE Standard for System, Software, and Hardware Verification and Validation

IEEE 829-2008, IEEE Standard for Software and System Test Documentation.

IEEE P3119, Standard for the Procurement of Artificial Intelligence and Automated Decision Systems

Privacy, Equity and Justice in Artificial Intelligence , Policy Statement, November 2021.

Democratic Use of Artificial Intelligence , Policy Statement, November 2021.

Artificial Intelligence: Job, Education, Workforce and Diversity , Policy Statement, November 2021.

Effective Governance of Artificial Intelligence , Policy Statement, June 2021.

K. Karachalios, N. Stern and J, Havens
Measuring What Matters in the Era of Global Warming and Algorithmic Promises, 2019.

Gabriela Bar, Gabriela Wiktorzak, Jeanna Matthews
Four Conditions for Building Trusted AI Systems: Effectiveness, Competence, Accountability, and Transparency
IEEE Beyond Standards, July 13 2021.

C. Ignacio Gutierrez, G. Marchant, K. Michael
Effective and Trustworthy Implementation of AI Soft Law Governance
IEEE Transaction on Technology and Society 2021, February 18 2021.

C. Ignacio Gutierrez, G. Marchant
A Global Perspective of Soft Law Programs for the Governance of Artificial Intelligence

ACM
ACM Technology Policy Council
ACM US-Technology Policy Council

ACM US Public Policy Council (US-ACM)
Statement on Algorithmic Transparency and Accountability ,
January 12 2017.

S. Garfinkel, J. Matthews, S. Shapiro, J. Smith
Toward Algorithmic Transparency and Accountability ,
Communications of the ACM , Vol. 60, No. 9, Page 5, Sept. 2017, 10.1145/3125780.
Panel session at National Press Club (9/14/2017), Summary .

R. Baeza-Yates, T. Chen, N. Diakopoulos, A. Matthews, J. Matthews, E. Moss, A. Rosenthal
ACM US-TPC Comments on NIST Artificial Intelligence Risk Management Framework, January 27 2022.
Comments relative to: NIST Concept Paper , Previous Comments, and Workshop

ACM Code of Ethics and Professional Conduct