MAP-3.3—Targeted application scope is specified and documented based on the system’s capability, established context, and AI system categorization.
>Control Description
>About
Systems that function in a narrow scope tend to enable better mapping, measurement, and management of risks in the learning or decision-making tasks and the system context. A narrow application scope also helps ease TEVV functions and related resources within an organization.
For example, large language models or open-ended chatbot systems that interact with the public on the internet have a large number of risks that may be difficult to map, measure, and manage due to the variability from both the decision-making task and the operational context. Instead, a task-specific chatbot utilizing templated responses that follow a defined “user journey” is a scope that can be more easily mapped, measured and managed.
>Suggested Actions
- Consider narrowing contexts for system deployment, including factors related to:
- How outcomes may directly or indirectly affect users, groups, communities and the environment.
- Length of time the system is deployed in between re-trainings.
- Geographical regions in which the system operates.
- Dynamics related to community standards or likelihood of system misuse or abuses (either purposeful or unanticipated).
- How AI system features and capabilities can be utilized within other applications, or in place of other existing processes.
- Engage AI actors from legal and procurement functions when specifying target application scope.
>Documentation Guidance
Organizations can document the following
- To what extent has the entity clearly defined technical specifications and requirements for the AI system?
- How do the technical specifications and requirements align with the AI system’s goals and objectives?
AI Transparency Resources
- GAO-21-519SP: AI Accountability Framework for Federal Agencies & Other Entities.
- Assessment List for Trustworthy AI (ALTAI) - The High-Level Expert Group on AI – 2019. LINK,
>References
Mark J. Van der Laan and Sherri Rose (2018). Targeted Learning in Data Science. Cham: Springer International Publishing, 2018.
Alice Zheng. 2015. Evaluating Machine Learning Models (2015). O'Reilly.
Brenda Leong and Patrick Hall (2021). 5 things lawyers should know about artificial intelligence. ABA Journal.
UK Centre for Data Ethics and Innovation, “The roadmap to an effective AI assurance ecosystem”.
>AI Actors
>Topics
>Cross-Framework Mappings
Ask AI
Configure your API key to use AI features.