ACLU (2019) ‘Facebook agrees to sweeping reforms to curb discriminatory ad targeting practices’. Available from: https://www.aclu.org/press-releases/facebook-agrees-
sweeping-reforms-curb-discriminatory-ad-
targeting-practices

Al Feel, H. T. and Khafagy, M. H. (2011) ‘OCSS: Ontology cloud storage system’. In Proceedings of the IEEE International Symposium on Network Cloud Computing and Applications. 9–13.

Ali, M., Sapiezynski, P., Bogen, M., Korolova, A., Mislove, A. and Rieke, A. (2019) ‘Discrimination through optimization: How Facebook’s ad delivery can lead to biased outcomes’. In Proceedings of the ACM on Human-Computer Interaction. 3. 1–30.

Alqahtani, S. S., Eghan, E. E. and Rilling, J. (2017) ‘Recovering semantic traceability links between APIs and security vulnerabilities: An ontological modeling approach’. In Proceedings of the IEEE International Conference on Software Testing, Verification and Validation. 80–91.

Alzantot, M., Sharma, Y., Elgohary, A., Ho, B-J., Srivastava, M. and Chang, K.-W. (2018) ‘Generating natural language adversarial examples’. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 2890–2896.

Alsudais, A. (2021) ‘Incorrect data in the widely used Inside Airbnb dataset’. Decision Support Systems, 141. 113453.

Angwin, J., Mattu, S. and Larson, J. (2015) ‘The tiger mom tax: Asians are nearly twice as likely to get a higher price from Princeton Review’. Available from: https://www.propublica.org/article/asians-nearly-
twice-as-likely-to-get-higher-price-from-
princeton-review

Angwin, J., Larson, J., Mattu, S. and Kirchner, L. (2016)‚ ‘Machine bias. There is software that is used across the country to predict future criminals. And it is biased against blacks’. Available from: https://www.propublica.org/article/machine-bias-
risk-assessments-in-criminal-sentencing

Arpirez, J. C., Corcho, O., Fernandez-Lopez, M. and Gomez-Perez, A. (2001) ‘WebODE: A scalable ontological engineering workbench’. In Proceedings of the ACM International Conference on Knowledge Capture (K-CAP). 6–13.

Arya, V., Bellamy, R. K. E., Chen, P.-Y., Dhurandhar, A., Hind, M., Hoffman, S. C., Houde, S., Liao, Q. V., Luss, R., Mojsilović, A., Mourad, S., Pedemonte, P., Raghavendra, R., Richards, J., Sattigeri, P., Shanmugam, K., Singh, M., Varshney, K. R., Wei, D., Zhang, Y. (2019) ‘One explanation does not fit all: A toolkit and taxonomy of AI explainability techniques’. Available from: http://arxiv.org/abs/1909.03012

Avdeenko, T. V. and Pustovalova, N. V. (2016) ‘The ontology-based approach to support the requirements engineering process’. In Proceedings of the IEEE International Scientific-Technical Conference on Actual Problems of Electronics Instrument Engineering. 513–518.

Baader, F., Calvanese, D., McGuinness, D., Nardi, D. and Patel-Schneider, P. (eds) (2003) The Description Logic Handbook: Theory, Implementation, and Applications. Cambridge University Press.

Barbosa, E. F., Nakagawa, E. Y. and Maldonado, J. C. (2006) ‘Towards the establishment of an ontology of software testing’. In Proceedings of IEEE International Conference on Software Engineering and Knowledge Engineering (SEKE). 522–525.

Basic Linux Ontology (BLO) (2021). Available from: http://wwwis.win.tue.nl/~swale/blo

Bayat, B., Bermejo-Alonso, J., Carbonera, J. L., Facchinetti, T., Fiorini, S. R., Goncalves, P., Jorge, V., Habib, M., Khamis, A., Melo, K., Nguyen, B., Olszewska, J. I., Paull, L., Prestes, E., Ragavan, S. V., Saeedi. S., Sanz, R., Seto, M., Spencer, B., Trentini, M., Vosughi, A. and Li, H. (2016) ‘Requirements for building an ontology for autonomous robots’. Industrial Robot: An International Journal, 43 (5). 469–480.

BCS (2020a) ‘The public don’t trust computer algorithms to make decisions about them, survey finds’. Available from: https://www.bcs.org/more/about-us/press-office/
press-releases/the-public-don-t-trust-computer-algorithms-
to-make-decisions-about-them-survey-finds/

BCS (2020b) ‘The exam question: How do we make algorithms do the right thing?’ Available from: https://www.bcs.org/media/6135/algorithms-
report-2020.pdf

Beizer, B. (1990) Software Testing Techniques. Van Nostrand Reinhold.

Bermejo-Alonso, J., Chibani, A., Goncalves, P., Li, H., Jordan, S., Olivares, A., Olszewska, J. I., Prestes, E., Rama Fiorini, S. and Sanz, R. (2018) ‘Collaboratively working towards ontology-based standards for robotics and automation’. In IEEE International Conference on Intelligent Robots and Systems (IROS). 79.

Berrani, S., Yachir, A., Djemaa, B. and Aissani, M. (2018) ‘Extended multi-agent system based service composition in the Internet of Things’. In Proceedings of the IEEE International Conference on Pattern Analysis and Intelligent Systems. 1–8.

Bertrand, M. and Mullainathan, S. (2004) ‘Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination’. The American Economic Review, 94. 991–1013.

Bettenburg, N., Premraj, R., Zimmermann, T. and Kim, S. (2008) ‘Duplicate bug reports considered harmful … really?’ In Proceedings of the IEEE International Conference on Software Maintenance (ICSM). 337–345. DOI: 10.1109/ICSM.2008.4658082

Bezerra, D., Costa, A. and Okada, K. (2009) ‘SwTOI (Software Test Ontology Integrated) and its application in Linux test’. In Proceedings of IEEE International Workshop on Ontology, Conceptualization and Epistemology for Information Systems, Software Engineering and Service Science. 25–36.

Bickel, P., Hammel, E. and O’Connell, J. (1975) ‘Sex bias in graduate admissions: Data from Berkeley’. Science, 187 (4175). 398–404.

Binas, J., Neil, D., Liu, S.-C. and Delbruck, T. (2017) ‘DDD17: End-to-end DAVIS driving dataset’. Available from: https://arxiv.org/abs/1711.01458

Black, R. (2015) ‘Dimensions of test coverage’. RBCS. Available from: https://rbcs-us.com/site/assets/files/1222/
dimensions-of-test-coverage.pdf

Black, R., Van Veenendaal, E. and Graham, D. (2012) Foundations of Software Testing – ISTQB Certification. CENGAGE Learning.

Boardman, J. and Sauser, B. (2006) ‘System of Systems: The meaning of’. In Proceedings of the IEEE/SMC International Conference on System of Systems Engineering. 118–123.

Bonferroni, C. E. (1936) ‘Teoria statistica delle classi e calcolo delle probabilità’. Pubblicazioni del R. Istituto Superiore di Scienze Economiche e Commerciali di Firenze, 8. 3–62.

Bourque, P. and Fairley, R. E. (2014) SWEBOK: Guide to Software Engineering Body of Knowledge, 3rd ed., IEEE.

Breck, E., Cai, S., Nielsen, E., Salib, M. and Sculley, D. (2017) ‘The ML test score: A rubric for ML production readiness and technical debt reduction’. In Proceedings of the IEEE International Conference on Big Data (Big Data). 1123–1132. DOI: 10.1109/BigData.2017.8258038

Caliskan, A., Bryson, J. and Narayanan, A. (2017) ‘Semantics derived automatically from language corpora contain human-like biases’. Science, 356. 183–186.

Campos, H., Acacio, C., Braga, R., Araujo, M. A. P., David, J. M. N. and Campos, F. (2017) ‘Regression tests provenance data in the continuous software engineering context’. In Proceedings of the IEEE Brazilian Symposium on Systematic and Automated Software Testing. 1–6.

Chari, S., Seneviratne, O., Gruen, D. M., Foreman, M. A., Das, A. K. and McGuinness, D. L. (2020) ‘Explanation ontology: A model of explanations for user-centered AI’. In Proceedings of the International Semantic Web Conference (ISWC). 228–243.

Chaudhuri, A., Smith, A. L., Gardner, A., Gu, L., Salem, M. B. and Lévesque, M. (2018) ‘Regulatory frameworks relating to data privacy and algorithmic decision making in the context of emerging standards on algorithmic bias’. In Thirty-fifth Conference on Neural Information Processing Systems. 6.

Chen, P. and Xi, A. (2020) ‘Research on industrial software testing knowledge database based on ontology’. In Proceedings of the IEEE International Conference on Dependable Systems and Their Applications. 425–429.

Clarke, E. M., Klieber, W., Nováček, M. and Zuliani, P. (2012) ‘Model checking and the state explosion problem’. In B. Meyer and M. Nordio (eds). Tools for Practical Software Verification. LASER 2011. Lecture Notes in Computer Science, vol. 7682. Springer. DOI: 10.1007/978-3-642-35746-6_1

Clarke, G. M., Anderson, C., Pettersson, F., Cardon, L., Morris, A. and Zondervan, K. (2011) ‘Basic statistical analysis in genetic case-control studies’. Nature Protocols, 6 (2). 121–133.

Clean Code Developer (n.d.) ‘Clean code initiative’. Available from: https://clean-code-developer.de

CMS Collaboration (2012) ‘Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC’. Physics Letters B, 716 (1). 30–61.

Cohn, M. (2009) Succeeding with Agile. Addison-Wesley Professional.

Collins, K. (2017) ‘Google collects Android users’ locations even when location services are disabled’. Quartz. Available from: https://qz.com/1131515/google-collects-android-users-
locations-even-when-location-services-are-disabled/

Creel, K. A. (2020) ‘Transparency in complex computational systems’. Philosophy of Science, 87 (4). 709–729.

Dal Pozzolo, A., Boracchi, G., Caelen, O., Alippi, C. and Bontempi, G. (2015) ‘Credit card fraud detection and concept-drift adaptation with delayed supervised information’. In Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN). 1–8. DOI: 10.1109/IJCNN.2015.7280527

Da Silva, J. P. S., DallOglio, P., Coelho Da Silva Pinto, S. C., Bittencourt, I. I. and Sardi Mergen, S. L. (2015) ‘OntoQAI: An ontology to support quality assurance inspections’. In Proceedings of the IEEE Brazilian Symposium on Software Engineering. 11–20.

Davenport, J. (In press) Dataset for chapter ‘Quality and Bias’. University of Bath Research Data Archive. DOI: 10.15125/BATH-01099

Davis, R., Shrobe, H. and Szolovits, P. (1993) ‘What is a knowledge representation?’ AI Magazine, 14 (1). 17–33.

de Almeida Falbo, R., Cruz Natali, A. C., Gomes Mian, P., Bertollo, G. and Borges Ruy, F. (2003) ‘ODE: Ontology-based software development environment’. CACIC. 1124–1135.

Descriptive Ontology for Linguistic and Cognitive Engineering (DOLCE) (2021). Available from: www.loa.istc.cnr.it/dolce/overview.html

Dietz, J. and Mulder, H. (2020) Enterprise Ontology. Springer.

Ding, L., Finin, T., Joshi, A., Pan, R., Cost, R. S., Peng, Y., Reddivari, P., Doshi, V. C. and Sachs, J. (2004) ‘Swoogle: A semantic web search and metadata engine’. In Proceedings of the ACM Conference on Information and Knowledge Management. 652–659.

Dragoni, M., Donadello, I. and Eccher, C. (2020) ‘Explainable AI meets persuasiveness: Translating reasoning results into behavioral change advice’. Artificial Intelligence in Medicine, 105. 1–17.

Dunn, O. J. (1961) ‘Multiple comparisons among means’. Journal of the American Statistical Association, 56 (293). 52–64.

Edelman, B. G., Luca, M. and Svirsky, D. (2016) ‘Racial discrimination in the sharing economy: Evidence from a field experiment.’ Available from: https://hbswk.hbs.edu/item/racial-discrimination-
in-the-sharing-economy-evidence-from-a-
field-experiment

European Court of Justice (2011) Association Belge des Consommateurs Test-Achats ASBL and Others v Conseil des ministres. Available from: http://curia.europa.eu/juris/liste.jsf?td=
ALL&language=en&jur=C,T,F&parties=
test%20achats

European Parliament (2016) Regulation (EU) 2016/679 of the European Parliament and of the Council on the protection of natural persons with regard to the processing of personal data and on the free movement of such data. Available from: https://eur-lex.europa.eu/eli/reg/2016/679/oj

European Parliament (2021) Proposal for a Regulation laying down harmonised rules on artificial intelligence. Available from: https://digital-strategy.ec.europa.eu/en/library/proposal-
regulation-laying-down-harmonised-rules-
artificial-intelligence

Feldmann, S., Roeschm S., Legat, C. and Vogel-Heuser, B. (2014) ‘Keeping requirements and test cases consistent: Towards an ontology-based approach’. In Proceedings of the IEEE International Conference on Industrial Informatics (INDIN). 726–732.

Fernandez, M., Gomez-Perez, A. and Juristo, N. (1997) ‘Methontology: From ontological art towards ontological engineering’. In Proceedings of the AAAI Spring Symposium Series. 33–40.

Ferreira de Souza, E., de Almeida Falbo, R. and Vijaykumar, N. L. (2013) ‘Ontologies in software testing: A systematic literature review’. In Proceedings of the Seminar on Ontology Research in Brazil. 71–82.

Ferreira de Souza, E., de Almeida Falbo, R. and Vijaykumar, N. L. (2017) ‘ROoST: Reference ontology on software testing’. Applied Ontology, 12 (1). 59–90.

Fiorini, S., Bermejo-Alonso, J., Goncalves, P., Pignaton de Freitas, E., Olivares, A., Olszewska, J. I., Prestes, E., Schlenoff, C., Ragavan, S. V., Redfield, S., Spencer, B., and Li, H. (2017) ‘A suite of ontologies for robotics and automation’. IEEE Robotics and Automation Magazine, 24 (1). 8–11.

Fraser, G. (n.d.). Available from: https://www.evosuite.org/

Freitas, A. and Vieira, R. (2014) ‘An ontology for guiding performance testing’. In Proceedings of the IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT). 400–407.

Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé III, H. and Crawford, K. (2021) ‘Datasheets for datasets’. Communications of the ACM, 64 (12). 86–92.

Gilvoich, T. and Griffin, D. (2010) ‘Judgement and decision-making’. In S. T. Fiske, D. T. Gilbert and Lindzey, G. (eds). Handbook of Social Psychology, vol. 1. John Wiley & Sons. 542–589.

Gladwell, M. (2021) ‘I love you Waymo’. Revisionist History podcast. Available from: http://podcasts.pushkin.fm/revisionist-history-
waymo?sid=mg&c=2_SiuQY8fGIlo_E3KAHK-
g&h=b8c24575b15cc6ec7

Glimm, B., Horrocks, I., Motik, B., Stoilos, G. and Wang, Z. (2014) ‘HermiT: An OWL 2 reasoner’. Journal of Automated Reasoning, 53 (3). 245–269.

Gomez-Perez, A., Fernandez-Lopez, M. and Corcho, O. (2004) Ontological Engineering. Springer-Verlag.

Google (2021) Machine learning glossary. Available from: https://developers.google.com/machine-learning/
glossary/#r

Gordon, P. M. K., Barker, K. and Sensen, C. W. (2010) ‘Programming-by-example meets the semantic web: Using ontologies and web services to close the semantic gap’. In Proceedings of the IEEE Symposium on Visual Languages and Human-Centric Computing. 133–140.

Griffor, E. R., Greer, C., Wollman, D. A. and Burns, M. J. (2017) Framework for cyber-physical systems: Volume 2, Working group reports. NIST SP 1500-202. National Institute of Standards and Technology. DOI: 10.6028/NIST.SP.1500-202

Gross, F., Fraser, G. and Zeller, A. (2012) ‘Search-based system testing: High coverage, no false alarms’. In Proceedings of the ACM International Symposium on Software Testing and Analysis (ISSTA). 67–77. DOI: 10.1145/2338965.2336762

Grosse, K., Papernot, N., Manoharan, P., Backes, M. and McDaniel, P. (2017) ‘Adversarial examples for malware detection’. In Proceedings of the European Symposium on Research in Computer Security. Lecture Notes in Computer Science. 62–79. DOI: 10.1007/978-3-319-66399-9_4

Gruber, T. (1995) ‘Towards principles for the design of ontologies used for knowledge sharing’. International Journal of Human-Computer Studies, 43 (5–6). 907–928.

Gruninger, M. and Fox, M. (1995) ‘Methodologies for the design and evaluation of ontologies’. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI) Workshop. 1–10.

Grzymek, V. and Puntschuh, M. (2019) ‘What Europe knows and thinks about algorithms: Results of a representative survey’. Bertelsmann Stiftung. Available from: https://www.bertelsmann-stiftung.de/fileadmin/
files/BSt/Publikationen/GrauePublikationen/
WhatEuropeKnowsAndThinkAboutAlgorithm.pdf

The Guardian (2004) ‘Why are men worse drivers than women?’ Available from: https://www.theguardian.com/science/2004/may/
13/thisweekssciencequestions1

Guizzardi, G. (2005) ‘Ontological foundations for structural conceptual models’. Telematica Instituut Fundamental Research Series, No. 015 (TI/FRS/015). 1–416.

Hao, K. (2019) ‘There’s an easy way to make lending fairer for women. Trouble is, it’s illegal’. Available from: https://www.technologyreview.com/2019/11/15/131935/
theres-an-easy-way-to-make-lending-fairer-
for-women-trouble-is-its-illegal/

Herbold, S. and Haar, T. (2022) ‘Smoke testing for machine learning: Simple tests to discover severe defects’. Empirical Software Engineering, 27. 45. DOI: 10.1007/s10664-021-10073-7

High-Level Expert Group on Artificial Intelligence (2020) ‘Ethics guidelines for trustworthy AI’. Available from: https://www.aepd.es/sites/default/files/
2019-12/ai-ethics-guidelines.pdf

Hohenecker, P. and Lukasiewicz, T. (2020) ‘Ontology reasoning with deep neural networks’. Journal of Artificial Intelligence Research, 68. 503–540.

Holzinger, A., Kieseberg, P., Weippl, E. and Tjoa, A. M. (2018) ‘Current advances, trends and challenges of machine learning and knowledge extraction: From machine learning to explainable AI’. In Proceedings of the International Cross-Domain Conference for Machine Learning and Knowledge Extraction. 1–8.

Horridge, M. (2011) ‘A practical guide to building OWL ontologies using Protégé 4 and CO-ODE tools’. 1.3 ed. Available from: http://owl.cs.manchester.ac.uk/research/co-ode/

Horridge, M. and Bechhofer, S. (2011) ‘The OWL API: A Java API for OWL ontologies’. Semantic Web, 2 (1). 11–21.

Huh, M., Agrawal, P. and Efros, A. A. (2016) ‘What makes ImageNet good for transfer learning?’ Available from: http://arxiv.org/abs/1608.08614

Huo, Q., Zhu, H. and Greenwood, S. (2003) ‘A multi-agent software engineering environment for testing web-based applications’. In Proceedings of IEEE International Computer Software and Applications Conference. 210–215.

IBM Cloud Education (2020) ‘AIOps’. Available from: https://www.ibm.com/uk-en/cloud/learn/aiops

IEEE (2008) ‘IEEE 829-2008 – IEEE Standard for software and system test documentation’. Available from: https://standards.ieee.org/standard/829-2008.html

IEEE (2015) ‘IEEE 1872-2015 – IEEE Standard ontologies for robotics and automation’. Available from: https://standards.ieee.org/standard/1872-2015.html

IEEE (2020) ‘IEEE 7010-2020 – IEEE Recommended practice for assessing the impact of autonomous and intelligent systems on human well-being’. Available from: https://standards.ieee.org/standard/7010-2020.html

Imana, B., Korolova, A. and Heidemann, J. (2021) ‘Auditing for discrimination in algorithms delivering job ads’. In Proceedings of the ACM Web Conference (WWW). 3767–3778. DOI: 10.1145/3442381.3450077

Institute and Faculty of Actuaries (2018) ‘Continuous mortality investigation’. CMI 2017 Briefing note. Available from: https://www.actuaries.org.uk/learn-and-develop/
continuous-mortality-investigation/cmiworking-papers/
mortality-projections/cmi-working-paper-105

International Software Testing Qualifications Board (ISTQB) (2021). Available from: https://www.istqb.org

Ishikawa, F. and Yoshioka, N. (2019) ‘How do engineers perceive difficulties in engineering of machine-learning systems? Questionnaire survey’. In Proceedings of the IEEE/ACM Joint International Workshop on Conducting Empirical Studies in Industry (CESI) and the International Workshop on Software Engineering Research and Industrial Practice (SER&IP). 2–9. DOI: 10.1109/CESSER-IP.2019.00009

ISO (2005) ‘ISO 9000:2005 Quality management systems – Fundamentals and vocabulary’. Available from: https://www.iso.org/obp/ui/#iso:std:
iso:9000:ed-3:v1:en

ISO/IEC (2011) ‘ISO/IEC 25010:2011 Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE)’. Available from: https://www.iso.org/standard/35733.html

ISO/IEC (2017) ‘ISO/IEC/IEEE 12207:2017 Systems and software engineering – Software life cycle processes’. Available from: https://www.iso.org/standard/63712.html

ISO/IEC (2020) ‘ISO/IEC TR 29119-11:2020 Software and systems engineering – Software testing – Part 11: Guidelines on the testing of AI-based systems’. Available from: https://www.iso.org/standard/79016.html

ISO/IEC (2021a) ‘ISO/IEC DIS 22989 – Information technology – Artificial intelligence – Artificial intelligence concepts and terminology’. Available from: https://www.iso.org/standard/74296.html

ISO/IEC (2021b) ‘ISO/IEC TR 24027:2021 Information technology – Artificial intelligence (AI) – Bias in AI systems and AI aided decision making’. Available from: https://www.iso.org/standard/77607.html

ISO/IEC (2021c) ‘ISO/IEC CD 25059: Software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – Quality model for AI systems’. Available from: https://www.iso.org/cms/render/live/en/sites/
isoorg/contents/data/standard/08/06/80655.html

ISO/IEC (2022) ‘ISO/IEC DTR 24368 Information technology – Artificial intelligence – Overview of ethical and societal concerns’. Available from: https://www.iso.org/standard/78507.html

ISO/IEC/IEEE (2013a) ‘ISO/IEC/IEEE 29119-1:2013 Software and systems engineering – Software testing – Part 1: Concepts and definitions’. Available from: https://www.iso.org/standard/45142.html

ISO/IEC/IEEE (2013b) ‘ISO/IEC/IEEE 29119-2:2013 Software and systems engineering – Software testing – Part 2: Test processes’. Available from: https://www.iso.org/standard/56736.html

ISO/IEC/IEEE (2013c) ‘ISO/IEC/IEEE 29119-3:2013 Software and systems engineering – Software testing – Part 3: Test documentation’. Available from: https://www.iso.org/standard/56737.html

ISO/IEC/IEEE (2015) ‘ISO/IEC/IEEE 29119-4:2015 Software and systems engineering – Software testing – Part 4: Test techniques’. Available from: https://www.iso.org/standard/60245.html

ISO/IEC/IEEE (2017) ‘ISO/IEC/IEEE 24765:2017 Systems and software engineering – Vocabulary’. Available from: https://www.iso.org/standard/71952.html

ISTQB (2021) ‘Glossary’. Available from: https://glossary.istqb.org/en/search/

Jia, Y., Mao, K. and Harmon, M. (2018) ‘Finding and fixing software bugs automatically with SapFix and Sapienz’. Available from: https://engineering.fb.com/2018/09/13/developer-
tools/finding-and-fixing-software-bugs-
automatically-with-sapfix-and-sapienz/

Juergens, E., Hummel, B., Deissenboeck, F., Feilkas, M., Schlögel, C. and Wübbeke, A. (2011) ‘Regression test selection of manual system tests in practice’. In Proceedings of the IEEE European Conference on Software Maintenance and Reengineering (CSMR). 309–312. DOI: 10.1109/CSMR.2011.44

Katsumi, M. and Gruninger, M. (2016) ‘What is ontology reuse?’ In Proceedings of the International Conference on Formal Ontology in Information Systems (FOIS). 9–22.

Khan, J. H., Magnetti, S., Davis, E. and Zhang, J. (2000) ‘Late outcomes of open heart surgery in patients 70 years old or later’. The Annals of Thoracic Surgery, 69 (1). 165–170. Available from: https://www.annalsthoracicsurgery.org/article/
S0003-4975(99)01185-6/fulltext#relatedArticles

Kinsbruner, E. (2020) Accelerating Software Quality: Machine Learning and Artificial Intelligence in the Age of DevOps. Perforce.

Kloumann, I. and Tanner, J. (2021) ‘How we’re using Fairness Flow to help build AI that works better for everyone’. Facebook AI. Available from: https://ai.facebook.com/blog/how-were-using-
fairness-flow-to-help-build-ai-that-works-
better-for-everyone/

Klueck, F., Li, Y., Nica, M., Tao, J. and Wotawa, F. (2018) ‘Using ontologies for test suites generation for automated and autonomous driving functions’. In Proceedings of the IEEE International Symposium on Software Reliability Engineering Workshops. 1–6.

Koch, C. (2016) ‘How the computer beat the Go Master’. Scientific American. Available from: https://www.scientificamerican.com/article/how-
the-computer-beat-the-go-master/

Kogut, P., Cranefield, S., Hart, L., Dutra, M., Baclawski, K., Kokar, M. and Smith, J. (2002) ‘UML for ontology development’. The Knowledge Engineering Review, 17 (1). 61–64.

Koh, L., Orzes, G. and Jia, F. J. (2019) ‘The fourth industrial revolution (Industry 4.0): Technologies disruption on operations and supply chain management’. International Journal of Operations and Production Management, 39 (6–8). 817–828.

Krisher (2019) ‘Official: Safety lacking before Uber self-driving car crash’. Techxplore. Available from: https://techxplore.com/news/2019-11-safety-lacking-
uber-self-driving-car.html

Kuleshov, A. (2018) ‘Formalizing AI system parameters in standardization of AI’. In Proceedings of the IEEE International Conference on Artificial Intelligence Applications and Innovations (IC-AIAI). 51–54.

Kurakin, A., Goodfellow, I. and Bengio, S. (2017) ‘Adversarial machine learning at scale’. Available from: http://arxiv.org/abs/1611.01236

Kuwajima, H. and Ishikawa, F. (2019) ‘Adapting SQuaRE for quality assessment of artificial intelligence systems’. In Proceedings of the IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). 13–18. DOI: 10.1109/ISSREW.2019.00035

Landhausser, M. and Genaid, A. (2012) ‘Connecting user stories and code for test development’. In Proceedings of the IEEE International Workshop on Recommendation Systems for Software Engineering. 33–37.

Larson, J., Mattu, S., Kirchner, L. and Angwin, J. (2016) ‘How we analyzed the COMPAS recidivism algorithm’. ProPublica. Available from: https://www.propublica.org/article/how-we-analyzed-
the-compas-recidivism-algorithm

Lenarduzzi, V., Lomio, F., Moreschini, S., Taibi, D. and Tamburri, D. A. (2021). ‘Software quality for AI: Where we are now?’ In D. Winkler, S. Biffl, D. Mendez, M. Wimmer and J. Bergsmann (eds). Software Quality: Future Perspectives on Software Engineering Quality, vol. 404. Springer International Publishing. 43–53. DOI: 10.1007/978-3-030-65854-0_4

Li, H., Chen, F., Yang, H., Guo, H., Chu, W. C.-C. and Yang, Y. (2009) ‘An ontology-based approach for GUI testing’. In Proceedings of the IEEE International Computer Software and Applications Conference. 632–633.

Lim, X. and Zhang, W. (2012) ‘Ontology-based testing platform for reusing’. In Proceedings of the IEEE International Conference on Internet Computing for Science and Engineering. 86–89.

Linux Test Project (LTP) (2021). Available from: https://github.com/linux-test-project/ltp

Looker, N., Gwynne, B., Xu, J. and Munro, M. (2005) ‘An ontology-based approach for determining the dependability of service-oriented architectures’. In Proceedings of the Annual IEEE International Workshop on Object-Oriented Real-Time Dependable Systems. 1–8.

Lu, D. (2020) ‘Uber and Lyft pricing algorithms charge more in non-white areas’. New Scientist. Available from: https://www.newscientist.com/article/2246202-
uber-and-lyft-pricing-algorithms-charge-more-
in-non-white-areas/

Ma, M., Wang, P. and Chu, C.-H. (2014) ‘Ontology-based semantic modeling and evaluation for Internet of Things applications’. In Proceedings of the IEEE International Conference on Green Computing and Communications. 24–30.

Maedche, A. and Staab, S. (2004) ‘Ontology learning’. In Handbook on Ontologies. Springer. 173–190.

Manifesto for Software Craftsmanship (n.d.). Available from: https://manifesto.softwarecraftsmanship.org

Martin, R. C. (2008) Clean Code: A Handbook of Agile Software Craftsmanship. Prentice Hall.

McDonald, S. (2015) ‘Indirect gender discrimination and the “Test-Achats Ruling”: An Examination of the UK motor insurance market’. Presentation to the Royal Economic Society. Available from: https://editorialexpress.com/cgi-bin/conference/
download.cgi?db_name=RES2015&paper_id=791

Merriam-Webster (2021) ‘Non-fungible token’. Available from: https://www.merriam-webster.com/dictionary/
non-fungible%20token

Metz, C. (2019) ‘We teach A.I. systems everything, including our biases’. New York Times. Available from: https://www.nytimes.com/2019/11/11/technology/artificial-
intelligence-bias.html

MMC (2019) ‘The State of AI: Divergence’. Available from: https://www.stateofai2019.com/

Murtazinam, M. S. and Avdeenko, T. V. (2018) ‘The ontology-driven approach to support the requirements engineering process in Scrum framework’. CEUR-WS 2212. 287–295.

Nasser, V. H., Du, W. and MacIsaac, D. (2010) ‘An ontology-based software test generation framework’. In Proceedings of the IEEE International Conference on Software Engineering and Knowledge Engineering (SEKE). 192–197.

Newberry, C. (2019) ‘The Facebook Pixel: What it is and how to use it’. Available from: https://blog.hootsuite.com/facebook-pixel/

Nie, C. and Leung, H. (2011) ‘A survey of combinatorial testing’. ACM Computing Surveys, 43 (2). 1–29. DOI: 10.1145/1883612.1883618

Nor, M. Z. M., Abdullah, R., Selamat, M. H. and Murad, M. A. A. (2012) ‘An agent-based knowledge management system for collaborative software maintenance environment design and evaluation’. In Proceedings of the IEEE International Conference on Information Retrieval and Knowledge Management. 115–120.

Northcutt, C. G., Athalye, A. and Mueller, J. (2021) ‘Pervasive label errors in test sets destabilize machine learning benchmarks’. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1 Pre-Proceedings (NeurIPS Datasets and Benchmarks). 1–13.

Noy, N. and McGuinness, L. (2001) ‘Ontology development 101: A guide to creating your first ontology’. Available from: http://protege.stanford.edu/publications/ontology_
development/ontology101.pdf

Olivares-Alarcos, A., Bessler, D., Khamis, A., Goncalves, P., Habib, M., Bermejo-Alonso, J., Barreto, M., Diab, M., Rosell, J., Quintas, J., Olszewska, J. I., Nakawala, H., Pignaton de Freitas, E., Gyrard, A., Borgo, S., Alenya, G., Beetz, M. and Li, H. (2019) ‘A review and comparison of ontology-based approaches to robot autonomy’. The Knowledge Engineering Review, 34. 1–38.

Olszewska, J. I. (2011) ‘Spatio-temporal visual ontology’. In EPSRC/BMVA Workshop on Vision and Language (VL). 1–2.

Olszewska, J. I. (2015) ‘UML activity diagrams for OWL ontology building’. In Proceedings of the International Conference on Knowledge Engineering and Ontology Development, 2. 370–374.

Olszewska, J. I. (2018a) ‘Ontologies for vision agents’. In IEEE International Conference on Intelligent Robots and Systems (IROS).

Olszewska, J. I. (2018b) ‘Ontologies for intelligent vision systems’. In International Conference on Knowledge Engineering and Ontology Development (KEOD). Available from: http://www.keod.ic3k.org/Tutorials.aspx?y=2018

Olszewska, J. I. (2018c) ‘Visual ontologies for intelligent robotics’. In BMVA Symposium on Enabling Human-Level Understanding in Robots.

Olszewska, J. I. (2019a) ‘Designing transparent and autonomous intelligent vision systems’. In Proceedings of the International Conference on Agents and Artificial Intelligence. 850–856.

Olszewska, J. I. (2019b) ‘D7-R4: Software development life-cycle for intelligent vision systems’. In Proceedings of the International Conference on Knowledge Engineering and Ontology Development. 435–441.

Olszewska, J. I. (2020) ‘AI-T: Software testing ontology for AI-based systems’. In Proceedings of the International Conference on Knowledge Engineering and Ontology Development. 291–298.

Olszewska, J. I. and Allison, I. K. (2018). ‘ODYSSEY: Software development lifecycle ontology’. In Proceedings of the International Conference on Knowledge Engineering and Ontology Development. 303–311.

Olszewska, J. I. and McCluskey, T. L. (2011) ‘Ontology-coupled active contours for dynamic video scene understanding’. In Proceedings of the IEEE International Conference on Intelligent Engineering Systems. 369–374.

Olszewska, J. I., Houghtaling, M., Goncalves, P., Fabiano, N., Haidegger, T., Carbonera, J. L., Patterson, W. R., Ragavan, S. V., Fiorini, S. and Prestes, E. (2020) ‘Robotic standard development life cycle in action’. Journal of Intelligent & Robotic Systems, 98 (1). 119–131.

Olszewska, J. I., Houghtaling, M., Goncalves, P., Haidegger, T., Fabiano, N., Carbonera, J. L., Fiorini, S. and Prestes, E. (2018) ‘Robotic ontological standard development life cycle’. In IEEE International Conference on Robotics and Automation (ICRA). 1–6.

Olszewska, J. I., Simpson, R. M. and McCluskey, T. L. (2014) ‘Dynamic OWL ontology design based on UML and BPMN’. In Proceedings of the International Conference on Knowledge Engineering and Ontology Development. 436–444.

Pandey, A. and Caliskan, A. (2020) ‘Iterative effect-size bias in ridehailing: Measuring social bias in dynamic pricing of 100 million rides’. Available from: https://arxiv.org/abs/2006.04599

Pandey, C. and Caliskan, A. (2021) ‘Disparate impact of artificial intelligence bias in ridehailing economy’s price discrimination algorithms’. In Proceedings of the AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society. 822–833.

PathCheck Foundation (n.d.). Available from: https://www.pathcheck.org/

Paydar, S. and Kahani, M. (2010) ‘Ontology-based web application testing’. In Proceedings of IEEE Conference on Novel Algorithms and Techniques in Telecommunications and Networking. 23–27.

Perry, T. (2019) ‘San Diego’s connected street lights learn to spot bicycles’. Available from: https://spectrum.ieee.org/view-from-the-valley/
computing/software/san-diegos-streetlights-
are-now-counting-bicycles

Petrucci, G., Ghidini, C. and Rospocher, M. (2016) ‘Ontology learning in the deep’. In Proceedings of the European Knowledge Acquisition Workshop. 480–495.

Pignaton de Freitas, E., Bermejo-Alonso, J., Khamis, A., Li, H. and Olszewska, J. I. (2020a) ‘Ontologies for cloud robotics’. The Knowledge Engineering Review, 35. 1–19.

Pignaton de Freitas, E., Olszewska, J. I., Carbonera, J., Fiorini, S. R., Khamis, A., Ragavan, S. V., Barreto, M., Prestes, E., Habib, M. K., Redfield, S., Chibani, A., Goncalves, P., Bermejo-Alonso, J., Sanz, R., Tosello, E., Olivares-Alarcos, A., Konzen, A. A., Quintas, J. and Li, H. (2020b) ‘Ontological concepts for information sharing in cloud robotics’. Journal of Ambient Intelligence and Humanized Computing. 1–14. DOI: 10.1007/s12652-020-02150-4

Pinto, H. S. (1999) ‘Towards ontology reuse’. In Proceedings of AAAI Workshop on Ontology Management. 67–73.

PK, M. A., Sheriff, M. R. and Chatterjee, D. (2021) ‘Measure of quality of finite-dimensional linear systems: A frame-theoretic view’. Systems & Control Letters, 151. 104911. DOI: 10.1016/j.sysconle.2021.104911

Pop, C., Moldovan, D., Antal, M., Valea, D., Cioara, T., Anghel, I. and Salomie, I. (2014) ‘M2O: A library for using ontologies in software engineering’. In Proceedings of the IEEE International Conference on Intelligent Computer Communication and Processing. 69–75.

Portoraro, F. (2021) ‘Automated reasoning’. In The Stanford Encyclopedia of Philosophy (Fall 2021 edition). Edward N. Zalta (ed.). Available from: https://plato.stanford.edu/archives/fall2021/
entries/reasoning-automated/

Principles of Chaos Engineering (2019). Available from: https://principlesofchaos.org/

Protégé tool website (2021). Available from: http://protege.stanford.edu/

Resource Description Framework (RDF) (2021). Available from: https://www.w3.org/RDF/

Ritchson, M. (2021) ‘Teamwork, AI, and containerization (with NASA’s Michael Ritchson)’. The QA Lead Podcast. Available from: TheQALead.com/Podcasts

Robal, T., Marenkov, J. and Kalja, A. (2017) ‘Ontology design for automatic evaluation of web user interface usability’. In Proceedings of the IEEE Portland International Conference on Management of Engineering and Technology. 1–8.

Rocha Silva, T., Hak, J.-L. and Winckler, M. (2017) ‘A behavior-based ontology for supporting automated assessment of interactive systems’. In Proceedings of the IEEE International Conference on Semantic Computing. 250–257.

Rothstein, R. (2017) The Color of Law. Liveright.

Sampath Kumar, V. R., Khamis, A., Fiorini, S. R., Carbonera, J. L., Olivares-Alarcos, A., Habib, M., Goncalves, P., Li, H. and Olszewska, J. I. (2019) ‘Ontologies for Industry 4.0’. The Knowledge Engineering Review, 34. 1–14.

Sapna, P. G. and Mohanty, H. (2011) ‘An ontology based approach for test scenario management’. In Proceedings of the International Conference on Information Intelligence, Systems, Technology and Management. 91–100.

Seeliger, A., Pfaff, M. and Krcmar, H. (2019) ‘Semantic web technologies for explainable machine learning models: A literature review’. In International Semantic Web Conference (ISWC). 30–45.

Serrano, J. (2022) ‘Airbnb will hide guests’ first names in Oregon until bookings are confirmed to fight discrimination’. Available from: https://gizmodo.com/airbnb-will-hide-guests-first-
names-in-oregon-until-bo-1848294121

Shankar, S., Halpern, Y., Breck, E., Atwood, J., Wilson, J. and Sculley, D. (2017) ‘No classification without representation: Assessing geodiversity issues in open data sets for the developing world’. Available from: https://arxiv.org/abs/1711.08536

Šidak, Z. (1968) ‘On multivariate normal probabilities of rectangles: Their dependence on correlations’. Annals of Mathematical Statistics, 39. 1425–1434.

Simmons, C. B., Shiva, S. G. and Simmons, L. L. (2014) ‘A qualitative analysis of an ontology based issue resolution system for cyber attack management’. In Proceedings of the IEEE International Conference on Cyber Technology in Automation, Control and Intelligent. 323–329.

Simpson, E. H. (1951) ‘The interpretation of interaction in contingency tables’. Journal of the Royal Statistical Society. Series B (Methodological), 13 (2). 238–241.

Siqueira Bueno, P. M., de Franco Rosa, F., Jino, M. and Bonacin, R. (2018) ‘A security testing process supported by an ontology environment: A conceptual proposal’. In Proceedings of the IEEE/ACS International Conference on Computer Systems and Applications. 1–8.

Slee, D., Cain, S., Vichare, P. and Olszewska, J. I. (2021) ‘Smart lifts: An ontological approach’. In Proceedings of the International Conference on Knowledge Engineering and Ontology Development. 210–219.

Smith, A. (2018) ‘Public attitudes toward computer algorithms’. Pew Research Center. Available from: https://www.pewresearch.org/internet/2018/11/16/public-
attitudes-toward-computer-algorithms/

Spocchia, G. and Morris, H. (2020) ‘Revealed: The “daylight robbery”of school holiday price increases’. The Telegraph. Available from: https://www.telegraph.co.uk/travel/news/half-
term-holiday-prices/

Staab, S. and Maedche, A. (2000) ‘Ontology engineering beyond the modeling of concepts and relations’. In Proceedings of the European Conference on Artificial Intelligence (ECAI) Workshop. 1–6.

Steed, R. and Caliskan, A. (2021) ‘Image representations learned with unsupervised pre-training contain human-like biases’. In ACM Conference on Fairness Accountability and Transparency (FAccT ‘21). 701–713. DOI: 10.1145/3442188.3445932

Stokel-Walker, C. (2021) ‘Recruiters less likely to contact ethnic minority groups on Swiss site’. New Scientist. Available from: https://www.newscientist.com/article/2265372-
recruiters-less-likely-to-contact-ethnic-minority-
groups-on-swiss-site/

Sugawara, K., Manabe, Y., Moulin, C. and Barthes, J.-P. (2011) ‘Design assistant agents for supporting requirement specification definition in a distributed design team’. In Proceedings of the IEEE International Conference on Computer Supported Cooperative Work in Design. 329–334.

Suggested Upper Merged Ontology (SUMO) (2021). Available from: www.ontologyportal.org/

Thrun, S. (2018) ‘Reputation in the age of artificial intelligence’. PRSA. Available from: https://apps.prsa.org/StrategiesTactics/Articles/view/
12194/1155/Reputation_in_the_Age_of_Artificial_
Intelligence#.YajjKJH7S2I

Tiffany, R. (2020) ‘Fighting COVID-19 with digital twins’. YouTube, 9 April 2020. Available from: https://youtu.be/XKINvqiTgxQ

Tsarkov, D. (2014) ‘Incremental and persistent reasoning in FaCT++’. In Proceedings of OWL Reasoner Evaluation Workshop. 16–22.

Tudorache, T. (2020) ‘Ontology engineering: Current state, challenges, and future directions’. Semantic Web, 11 (1). 125–138.

Uschold, M. and Gruninger, M. (1996) ‘Ontologies: Principles, methods and applications’. Knowledge Engineering Review, 11 (2). 93–136.

Uschold, M., Healy, M., Williamson, K., Clark, P. and Woods, S. (1998) ‘Ontology reuse and application’. In Proceedings of the International Conference on Formal Ontology in Information Systems (FOIS). 179–192.

Vasilecas, O., Kalibatiene, D. and Guizzardi, G. (2009) ‘Towards a formal method for the transformation of ontology axioms to application domain rules’. Information Technology and Control, 38 (4). 271–282.

Venkatadri, G., Andreou, A., Liu, Y., Mislove, A., Gummadi, K., Loiseau, P. and Goga, O. (2018) ‘Privacy risks with Facebook’s PII-based targeting: Auditing a data broker’s advertising interface’. In Proceedings of the IEEE Symposium on Security and Privacy. 89–107.

Vincent, J. (2016) ‘Twitter taught Microsoft’s AI chatbot to be a racist asshole in less than a day’. The Verge. Available from: https://www.theverge.com/2016/3/24/11297050/tay-
microsoft-chatbot-racist

Wang, X., Huang, N. and Wang, R. (2009) ‘Mutation test based on OWL-S requirement model’. In Proceedings of the IEEE International Conference on Web Services. 1006–1007.

Wang, Y., Bai, X., Li, J. and Huang, R. (2007) ‘Ontology-based test case generation for testing web services’. In Proceedings of the IEEE International Symposium on Autonomous Decentralized Systems. 43–50.

Ward, E. J. (2020) ‘Abandoned NHS contact tracing app cost almost £12 million’. LBC. Available from: https://www.lbc.co.uk/politics/abandoned-nhs-contact-
tracing-app-cost-almost-12-million/

Web Ontology Language (OWL) (2021). Available from: https://www.w3.org/OWL/

Wikipedia (2020) ‘Trolley problem’. Available from: https://en.wikipedia.org/w/index.php?title=Trolley_
problem&oldid=987726957

Wikipedia (2021) ‘All-pairs testing’. Available from: https://en.wikipedia.org/wiki/All-pairs_testing

Wilson, K. M., Helton, W. S. and Wiggins, M. W. (2013) ‘Cognitive engineering’. Wiley Interdisciplinary Reviews: Cognitive Science, 4 (1). 17–31.

Winfield, A. F. T., Booth, S., Dennis, L. A., Egawa, T., Hastie, H., Jacobs, N., Muttram, R., Olszewska, J. I., Rajabiyazdi, F., Theodorou, A., Underwood, M., Wortham, R. H. and Watson, E. (2021) ‘IEEE P7001: A proposed standard on transparency’. Frontiers on Robotics and AI, 8. 1–16.

Wisniewski, D., Potoniec, J., Lawrynowicz, A. and Keet, C. M. (2019) ‘Analysis of ontology competency questions and their formalizations in SPARQL-OWL’. Journal of Web Semantics, 59. 1–19.

Wos, L., Overbeck, R., Lusk, E. and Boyle, J. (2021) ‘Automated reasoning: Introduction and applications’. U.S. Department of Energy – Office of Scientific and Technical Information. Available from: https://www.osti.gov/biblio/6003867

Wright, J. (2016a) ‘STARWest - Think you can just “Test” that API? Think again’. YouTube. Available from: https://youtu.be/Xu-rXUJ4IOQ

Wright, J. (2016b) ‘The Digital Manifesto’. Available from: https://leanpub.com/digital

Wright, J. (2017) ‘Cognitive Learning – “Digital Evolution, Over Revolution”’. TEDxWilmingtonSalon. Available from: https://www.ted.com/talks/jonathon_wright_cognitive_
learning_digital_evolution_over_revolution

Wu, D. and Hakansson, A. (2014) ‘A method of identifying ontology domain’. Procedia Computer Science, 35. 504–513.

Yan, H., Jing, Z., Li-Qun, Y., Ze-Min, L. and Li-Jian, T. (2014) ‘Based on ontology methodology to model and evaluate System of Systems (SoS)’. In Proceedings of the IEEE International Conference on System of Systems Engineering (SOSE). 101–106.

Yu, L., Zhang, L., Xiang, H., Su, Y., Zhao, W. and Zhu, J. (2009) ‘A framework of testing as a service’. In Proceedings of the IEEE International Conference on Management and Service Science. 1–4.

Zimmermann, T., Nagappan, N., Gall, H., Giger, E. and Murphy, B. (2009) ‘Cross-project defect prediction: A large scale experiment on data vs. domain vs. process’. In Proceedings of the ACM Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on the Foundations of Software Engineering. 91–100. DOI: 10.1145/1595696.1595713

Zuckerberg, M. (2021) ‘Introducing Meta: A social technology company’. Available from: https://about.fb.com/news/2021/10/facebook-
company-is-now-meta