Evidence-based policy or beauty contest?: An LLM-based meta-analysis of EU cohesion policy evaluations
Independent and high-quality evaluations of government policies are an important input for designing evidence-based policy. Institutional frictions and lack of incentives to write such evaluations, on the other hand, carry the risk of turning the system into a costly beauty contest. We study one of...
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
20 December 2024
|
| In: |
International tax and public finance
Year: 2024, Pages: 1-31 |
| ISSN: | 1573-6970 |
| DOI: | 10.1007/s10797-024-09875-4 |
| Online-Zugang: | Resolving-System, kostenfrei, Volltext: https://doi.org/10.1007/s10797-024-09875-4 Verlag, kostenfrei, Volltext: https://link.springer.com/article/10.1007/s10797-024-09875-4 
|
| Verfasserangaben: | Zareh Asatryan, Carlo Birkholz, Friedrich Heinemann |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1920437789 | ||
| 003 | DE-627 | ||
| 005 | 20250717002710.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 250324s2024 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1007/s10797-024-09875-4 |2 doi | |
| 035 | |a (DE-627)1920437789 | ||
| 035 | |a (DE-599)KXP1920437789 | ||
| 035 | |a (OCoLC)1528043595 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 16 |2 sdnb | ||
| 100 | 1 | |a Asatryan, Zareh |e VerfasserIn |0 (DE-588)1152036319 |0 (DE-627)1013254406 |0 (DE-576)392362821 |4 aut | |
| 245 | 1 | 0 | |a Evidence-based policy or beauty contest? |b An LLM-based meta-analysis of EU cohesion policy evaluations |c Zareh Asatryan, Carlo Birkholz, Friedrich Heinemann |
| 264 | 1 | |c 20 December 2024 | |
| 300 | |a 31 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 24.03.2025 | ||
| 520 | |a Independent and high-quality evaluations of government policies are an important input for designing evidence-based policy. Institutional frictions and lack of incentives to write such evaluations, on the other hand, carry the risk of turning the system into a costly beauty contest. We study one of the most advanced markets of policy evaluations in the world, the evaluations of EU Cohesion Policy interventions by the EU Member States. We use a large language model to quantify the findings of about 2,300 evaluations, and complement this data with our own survey of the evaluation authors. We show that the findings of evaluations are inconsistent with those of the academic literature on the output impacts of Cohesion Policy. Using further variation across Member States, our analysis suggests that the market of evaluations is rather oligopolistic within Member States, that it is very fragmented across the EU, and that there is often a strong involvement of managing authorities in the work of formally independent evaluators. These factors contribute to making the findings of the evaluations overly optimistic (beautiful) risking their relevance for (evidence-based) policy. We conclude by discussing reform options to make the evaluations of EU Cohesion Policy more unbiased and effective. | ||
| 650 | 4 | |a A11 | |
| 650 | 4 | |a C45 | |
| 650 | 4 | |a D83 | |
| 650 | 4 | |a EU cohesion policy | |
| 650 | 4 | |a H43 | |
| 650 | 4 | |a H54 | |
| 650 | 4 | |a Large language model | |
| 650 | 4 | |a Policy evaluation | |
| 700 | 1 | |a Birkholz, Carlo |d 1992- |e VerfasserIn |0 (DE-588)1232420638 |0 (DE-627)1756560803 |4 aut | |
| 700 | 1 | |a Heinemann, Friedrich |d 1964- |e VerfasserIn |0 (DE-588)131390244 |0 (DE-627)508766591 |0 (DE-576)169084329 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t International tax and public finance |d New York, NY : Springer Science + Business Media B.V., 1994 |g (2024), Seite 1-31 |h Online-Ressource |w (DE-627)320568768 |w (DE-600)2016247-9 |w (DE-576)102669341 |x 1573-6970 |7 nnas |a Evidence-based policy or beauty contest? An LLM-based meta-analysis of EU cohesion policy evaluations |
| 773 | 1 | 8 | |g year:2024 |g pages:1-31 |g extent:31 |a Evidence-based policy or beauty contest? An LLM-based meta-analysis of EU cohesion policy evaluations |
| 856 | 4 | 0 | |u https://doi.org/10.1007/s10797-024-09875-4 |x Resolving-System |x Verlag |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://link.springer.com/article/10.1007/s10797-024-09875-4 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20250324 | ||
| 993 | |a Article | ||
| 994 | |a 2024 | ||
| 998 | |g 131390244 |a Heinemann, Friedrich |m 131390244:Heinemann, Friedrich |d 180000 |e 180000PH131390244 |k 0/180000/ |p 3 |y j | ||
| 999 | |a KXP-PPN1920437789 |e 4691361006 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"person":[{"display":"Asatryan, Zareh","roleDisplay":"VerfasserIn","role":"aut","family":"Asatryan","given":"Zareh"},{"display":"Birkholz, Carlo","roleDisplay":"VerfasserIn","role":"aut","family":"Birkholz","given":"Carlo"},{"given":"Friedrich","family":"Heinemann","role":"aut","roleDisplay":"VerfasserIn","display":"Heinemann, Friedrich"}],"title":[{"title_sort":"Evidence-based policy or beauty contest?","title":"Evidence-based policy or beauty contest?","subtitle":"An LLM-based meta-analysis of EU cohesion policy evaluations"}],"recId":"1920437789","language":["eng"],"type":{"media":"Online-Ressource","bibl":"article-journal"},"note":["Gesehen am 24.03.2025"],"name":{"displayForm":["Zareh Asatryan, Carlo Birkholz, Friedrich Heinemann"]},"id":{"eki":["1920437789"],"doi":["10.1007/s10797-024-09875-4"]},"origin":[{"dateIssuedKey":"2024","dateIssuedDisp":"20 December 2024"}],"relHost":[{"physDesc":[{"extent":"Online-Ressource"}],"id":{"zdb":["2016247-9"],"eki":["320568768"],"issn":["1573-6970"]},"origin":[{"publisherPlace":"New York, NY ; Boston, Mass. [u.a.]","publisher":"Springer Science + Business Media B.V. ; Kluwer","dateIssuedKey":"1994","dateIssuedDisp":"1994-"}],"part":{"pages":"1-31","year":"2024","extent":"31","text":"(2024), Seite 1-31"},"pubHistory":["1.1994 -"],"language":["eng"],"recId":"320568768","note":["Gesehen am 21.10.05"],"type":{"bibl":"periodical","media":"Online-Ressource"},"disp":"Evidence-based policy or beauty contest? An LLM-based meta-analysis of EU cohesion policy evaluationsInternational tax and public finance","title":[{"title_sort":"International tax and public finance","title":"International tax and public finance"}]}],"physDesc":[{"extent":"31 S."}]} | ||
| SRT | |a ASATRYANZAEVIDENCEBA2020 | ||