This chapter presents a methodologically innovative case study assessing the performance of Canada’s two principal intelligence agencies—CSIS and CSE—within the post-2017 framework of enhanced oversight. It begins by outlining a structured performance assessment approach based on a custom-designed Key Performance Indicator (KPI) model tailored for intelligence organizations operating under unique legal and operational constraints. The model evaluates each agency’s alignment with national security objectives across three dimensions: operational effectiveness, legal compliance, and adaptability to oversight demands from bodies. The evaluation is based strictly on open-source material, drawing on public annual and special reports published by both the intelligence agencies and the oversight bodies. To support systematic analysis across a large volume of qualitative and quantitative data, artificial intelligence tools were trained on a defined corpus of documents and data. These tools enhanced efficiency and consistency in applying the KPI model, while all AI-generated outputs were subject to a formal human-in-the-loop validation process to ensure methodological rigor. This case study contributes to evidence-based policy discourse by demonstrating a scalable, transparent model for assessing intelligence organizations’ performance, and highlights key lessons for reconciling accountability with operational efficacy in the national security domain.