Review of The Fund’s Capacity Development Strategy—Background Papers

REVIEW OF THE FUND’S CAPACITY DEVELOPMENTSTRATEGY—BACKGROUND PAPERS IMF staff regularly produces papers proposing new IMF policies, exploring options forreform, or reviewing existing IMFpolicies and operations. The following documenthavebeen released andisincluded in this package: •Review of the Fund’s Capacity Development Strategy—Background Papers The documentslisted below have been or will be separately released. APress Releasesummarizing the views of the Executive Board as expressed during itsApril 4, 2024considerationof the staff report. TheStaff Report,preparedby IMF staff and completed onMarch 4, 2024for theExecutive Board’s consideration onApril 4, 2024. TheIMF’stransparency policy allows for the deletion ofmarket-sensitive information andpremature disclosure of the authorities’ policy intentions in published staff reports andother documents. Electronic copies of IMF Policy Papersare available to the public fromhttp://www.imf.org/external/pp/ppindex.aspx International Monetary FundWashington, D.C. REVIEWOFTHE FUND’S CAPACITY DEVELOPMENTSTRATEGY—BACKGROUND PAPERS Approved ByMichaela Erbenova(ICD) Prepared by an interdepartmental team inconsultation withthe Institute for Capacity Development (ICD) Glossary___________________________________________________________________________________4 CD DELIVERY MODALITIES______________________________________________________________7 A. Overview_______________________________________________________________________________7B. Introduction____________________________________________________________________________8C. The New Normal________________________________________________________________________9D. Path Forward__________________________________________________________________________13 BOX 1. The New Normal for Other CDProviders______________________________________________12 FIGURES 1. CD Delivery Modalities by Activity Count, FY2021–FY2023______________________________92. Delivery and Participation in IMF Online Courses, FY2022–FY2023_____________________11 ANNEXES I. Delivery Modalities Terminology_______________________________________________________17II. Transition to the New Normal in CD Departments_____________________________________21III. RCDC Case Studies of the New Normal_______________________________________________31IV. Blended Training Case Studies________________________________________________________35 References_______________________________________________________________________________45 EVALUATION AND IMPACT____________________________________________________________46 A. Overview______________________________________________________________________________46B. Introduction___________________________________________________________________________47C. The State of M&E at the Fund_________________________________________________________48D. Tailoring, Effectiveness, and Impact of CD_____________________________________________54E. Conclusion_____________________________________________________________________________65 FIGURES 1. Distribution of Evaluation of CD Completed between FY2018–FY2023_____________________________502. Improvement in DataCompleteness_______________________________________________________________523. Increase in Single Country Project__________________________________________________________________524. Evidence of Tailoring in Project Design_____________________________________________________________565. Text Mining of CD Country Strategy Notes_________________________________________________________566. Factors influencing RBM Outcome Ratings_________________________________________________________587. CARTAC Outcome Results vs. Resources Person Days______________________________________________598.ICD Course Learning Gains_________________________________________________________________________609. Factors Influencing Learning Gains of ICD Courses_________________________________________________6010. Average Differences in Outcome Improvements Between Treated and Untreated________________6211. Long-Run Impact of CD on Tax Revenue__________________________________________________________6212. Impact of CD on VAT Revenues___________________________________________________________________6313. Correlation Matrix Macroeconomic Variables & Completed CD Projects_________________________64 ANNEXES I. RBM Risk Assessment and CD-Surveillance Integration_____________________________________________67II. Analysis of Evaluations_____________________________________________________________________________69III. Comparing Internal and ExternalEvaluations______________________________________________________72IV. MOPAN Findings: Organizations Learning from and Applying Evaluation Findings_______________74V. The Fund’s RBM Framework_______________________________________________________________________75VI. Synchronous Training Survey Results______________________________________________________