How Effectively Can Current LLMs Analyze Macrofinancial Issues?
By International Monetary Fund
This paper empirically evaluates the ability of current Large Language Models (LLMs) to analyze macrofinancial coverage in IMF Article IV staff reports, using human economists' assessments as a benchmark. We test several GPT models on reports from 2016-2024, assessing their performance on both qualitative ratings and binary questions.
- Use cases, geography and tags
- Organizations that created, adopted or are mentioned
- Ecosystem position
- Link to the original asset
- Comments and reactions