Under active development Content is continuously updated and improved

MAP-3.3Targeted application scope is specified and documented based on the system’s capability, established context, and AI system categorization.

>Control Description

Targeted application scope is specified and documented based on the system’s capability, established context, and AI system categorization.

>About

Systems that function in a narrow scope tend to enable better mapping, measurement, and management of risks in the learning or decision-making tasks and the system context. A narrow application scope also helps ease TEVV functions and related resources within an organization.

For example, large language models or open-ended chatbot systems that interact with the public on the internet have a large number of risks that may be difficult to map, measure, and manage due to the variability from both the decision-making task and the operational context. Instead, a task-specific chatbot utilizing templated responses that follow a defined “user journey” is a scope that can be more easily mapped, measured and managed.

>Suggested Actions

  • Consider narrowing contexts for system deployment, including factors related to:
  • How outcomes may directly or indirectly affect users, groups, communities and the environment.
  • Length of time the system is deployed in between re-trainings.
  • Geographical regions in which the system operates.
  • Dynamics related to community standards or likelihood of system misuse or abuses (either purposeful or unanticipated).
  • How AI system features and capabilities can be utilized within other applications, or in place of other existing processes.
  • Engage AI actors from legal and procurement functions when specifying target application scope.

>Documentation Guidance

Organizations can document the following

  • To what extent has the entity clearly defined technical specifications and requirements for the AI system?
  • How do the technical specifications and requirements align with the AI system’s goals and objectives?

AI Transparency Resources

  • GAO-21-519SP: AI Accountability Framework for Federal Agencies & Other Entities.
  • Assessment List for Trustworthy AI (ALTAI) - The High-Level Expert Group on AI – 2019. LINK,

>References

Mark J. Van der Laan and Sherri Rose (2018). Targeted Learning in Data Science. Cham: Springer International Publishing, 2018.

Alice Zheng. 2015. Evaluating Machine Learning Models (2015). O'Reilly.

Brenda Leong and Patrick Hall (2021). 5 things lawyers should know about artificial intelligence. ABA Journal.

UK Centre for Data Ethics and Innovation, “The roadmap to an effective AI assurance ecosystem”.

>AI Actors

AI Design
AI Development
Human Factors

>Topics

Context of Use
Documentation

>Cross-Framework Mappings

Ask AI

Configure your API key to use AI features.