Artificial Intelligence (AI) is here. It is already shaping the battlefield and how organisations operate. However, for organisations to achieve operational advantage, purposeful and ethical use of AI is critical. Successful implementation of AI to augment performance needs to consider whether the organisation is “AI ready”. Such readiness and subsequent informed implementation of AI requires a socio-technical approach so that the impact of the AI technology is understood in the context of the users (direct and indirect) and their organisation. Opportunities need to be harnessed, and anticipated benefits need to be balanced against risks.
To help with this, QinetiQ’s Human Performance specialists developed the People Implications of AI (PIAI) Toolkit to guide the identification and evaluation of the people implications of using AI. It comprises two integrated elements:
The AI Use Case Characterisation to help stakeholders develop a shared understanding of the AI system and its proposed use.
The PIAI Framework, supporting the evaluation of 78 socio-technical factors through tailored consideration prompts, structured across 24 topics and seven themes.
The seven themes and associated topics can be explored below.
Safety and Security – Factors related to the safety and security of the information used for training the AI, accessed by the AI, and generated by the AI.
Validity and Reliability – Factors related to the quality of the information used by the AI (training, processing) and generated by it.
Human-AI Interface – Factors related to the level of understanding and clarity of information afforded to human users by the AI system.
Human Agent Teaming – Factors related to the impact of AI on collaboration both human-human and human-AI.
Interoperability and Compatibility – Factors related to the level of compatibility between current workflows and processes and the intended AI system.
Work Arrangements & Modes – Factors related to the implications of AI adoption on personnel's work arrangements and ability to maintain operational capability during disruptions.
Knowledge Management – Factors related to the impact of AI on knowledge management and transfer.
Organisational Design, Culture and Performance – Factors related to the level of compatibility between wider organisational aspects and the proposed AI system.
Accountability and Responsibility – Factors related to the clarity of lines of accountability and responsibility when using the AI system.
Situational Awareness and Control – Factors related to the situational awareness of personnel of the AI system and the level of control over outputs.
Conditions of Use – Factors related to the safe use of AI and potential implications on personnel's behaviours.
Job Roles – Factors related to the impact of AI on job roles.
Workforce Fluctuations – Factors related to the impact of AI on workforce movements.
Job Performance and Career Progression – Factors related to the impact of AI on reward and recognition.
Skills, Expertise and Competence – Factors related to skills and expertise for an AI ready workforce.
Decision Making – Factors related to the quality and appropriateness of AI involvement in the decision-making process.
Mental Models and Understanding – Factors related to establishing and updating personnel's mental models when using AI.
Workload – Factors related to the effect of AI adoption on personnel's workload and operational capability.
Job Morale – Factors related to the impact of AI on personnel's morale.
Wellbeing and Psychological Safety – Factors related to the psychological effect of AI use on wellbeing.
Ethics and Values – Factors related to the ethical use of AI and consideration of people's and organisations' values.
Social Connection and Cohesion – Factors related to the impact of AI on social aspects of wellbeing.
AI Literacy and Norms – Factors related to the preparedness of personnel for AI.
Acceptance – Factors related to the acceptance of AI by people.
The themes presented above provide a high-level overview of the PIAI Framework. The full PIAI Toolkit combines AI Use Case Characterisation with socio-technical assessment guidance to help organisations identify, evaluate, and communicate people-related opportunities, risks, and mitigations associated with AI adoption.
To discuss how the PIAI Toolkit can help your organisation realise the benefits of AI while managing associated people implications, please get in touch.
Contact us
Looking for more information? Get in touch with our team
