Tuition fee EU nationals (2024/2025)
1450.00 €Programme Structure for 2024/2025
Curricular Courses | Credits | |
---|---|---|
Design and Monitoring of Policy Evaluation Processes
6.0 ECTS
|
Mandatory Courses | 6.0 |
Fundamentals of Public Policy Evaluation
6.0 ECTS
|
Mandatory Courses | 6.0 |
Policy Evaluation Methods
6.0 ECTS
|
Mandatory Courses | 6.0 |
Planning and Public Policy
6.0 ECTS
|
Mandatory Courses | 6.0 |
Policy Evaluation Project Work
6.0 ECTS
|
Mandatory Courses | 6.0 |
Public Policy Evaluation Experiences
3.0 ECTS
|
Mandatory Courses | 3.0 |
Design and Monitoring of Policy Evaluation Processes
1 ? Understanding a public policy evaluation strategy and identifying critical issues in its implementation;
2 - Developing technical specifications to contract evaluation services;
3 ? Defining a management model and a follow-up system;
4 ? Identifying the evaluation outputs quality requirements? and developing a critical sense to judge those products;
5 ? Designing a communication strategy for the evaluation findings and a follow-up system to track the recommendations? implementation.
1. Evaluation in the context of EU funding:
1.1. Developing a public policy evaluation strategy
1.2. Developing technical specifications to contract evaluation services
1.3. Management model and follow-up system;
1.4. The purpose of Evaluation from the standing point of public sector: critical reflexion
2. Evaluation in the context of International Development:
2.1. Norms, standards and code of conduct;
2.2. Evaluation planning, managing and quality control
2.3. Reflexion about the Evaluation function from the standpoint of International Development
Individual essay - 90%
Attendance and participation - 10%
Title: United Nations Evaluation Group (2016), Norms and Standards for Evaluation. New York: UNEG.
OECD/DAC (2019), Better Criteria for Better Evaluation. Revised Evaluation Criteria Definitions and Principles for Use, Paris, OECD DAC Network on Development Evaluation (EvalNet).
European Commission (2015), Guidance Document on Evaluation Plans ? Terms of Reference for Impact Evaluations ? Guidance on Quality Management of External Evaluations, fevereiro.
AD&C (2016), Orientações para o acompanhamento da implementação das recomendações das avaliações do Portugal 2020 (follow-up), Julho.
AD&C (2016), Orientações para o planeamento e preparação das avaliações do Portugal 2020, Dezembro.
Authors:
Reference: null
Year:
Title: UNEG (2010), Quality Checklist for Evaluation Terms of Reference and Inception Reports.
UNEG (2019), Reference Document: Mapping & Review of Evaluation Ethics - Final Report.
European Commission (2012), Evaluation of Innovation Activities. Guidance on methods and practices, Directorate-General for Regional Policy.
European Commission (2015), Examples of EU added value. Accompanying the document Report from the Commission to the European Parliament and the Council on the evaluation of the Union's finances based on the results achieved, junho.
European Commission (2014), Monitoring and Evaluation of European Cohesion Policy. Guidance document on ex-ante evaluation ? European Regional Development Fund. European Social Fund. Cohesion Fund, janeiro.
European Commission (2014), Guidance Document on Indicators of Public Administration Capacity Building, Employment, Employment, Social Affairs and Inclusion DG, junho.
European Commission (2015), Guidance on Evaluation of the Youth Employment Initiative, Setembro 2015
European Commission (2013), Guidance for the Terms of Reference for Impact Evaluations, European Regional Development Fund and Cohesion Fund, outubro.
European Commission (2011), Outcome indicators and targets. Towards a new system of monitoring and evaluation in EU Cohesion Policy, Revised version.
European Commission (2018), Monitoring and Evaluation of European Cohesion Policy. Guidance Document, European Social Fund. Programming period 2014-2020, agosto.
European Commission (2014), Guidance Document on Monitoring and Evaluation, Concepts and Recommendations, Concepts and Recommendations, European Cohesion Fund, European Regional Development Fund, março.
European Commission (2013), EVALSED: The resource for the evaluation of Socio-Economic Development, setembro.
Comissão Europeia (2008) EVALSED: A Avaliação do Desenvolvimento Socioeconómico ? O GUIA, tradução: Observatório do QREN.
European Commission (2008), EVALSED: The Resource for the Evaluation of Socio-Economic Development, Julho.
European Commission (s.d.), Better Regulation Toolbox.
Agência para o Desenvolvimento e Coesão (AD&C) (2019), Plano Global de Avaliação do Portugal 2020, dezembro
Authors:
Reference: null
Year:
Fundamentals of Public Policy Evaluation
At the end of the course, the student will be able to:
LO1. Be familiar with the concepts and language of evaluation
LO2. Identify the main types of public policí evaluation
LO3. Choose the evaluation approach appropriate to different contexts and objectives
1. Evaluation: social research applied to the analysis of public policy
2. Theory-based evaluation and method-oriented evaluation
3. Realistic evaluation and its explanatory elements: context, mechanism, regularity
4. The needs assessment
5. The evaluation of program theory
6. Analysis of execution and process evaluation
7. Evaluation questions
8. Introduction to results measurement and impact evaluation
9. The uses of evaluation - accountability and learning in public policies
10. Professional ethics in evaluation
Individual essay - 90%
Attendance and participation - 10%
Title: Weiss, C. 1998. Evaluation. New Jersey. Prentice-Hall. 2a Edição
Rossi, P.; Lipsey, M.; Henry, G. 2019. Evaluation. A Systematic Approach. Thousand Oaks. Sage. 8a Edição
Patton, M. Q. .2008. Utilization-focused evaluation. Thousand Oaks. Sage. 4a Edição
Chen, H. T. 1990. Theory-driven evaluations. Newbury Park. Sage.
Chelimsky, E., & Shadish, W. R. (Eds.). 1997. Evaluation for the 21st century: A handbook. Thousand Oaks. Sage
Authors:
Reference: null
Year:
Title: Weimer, D.; Vining, A. 2020. Policy Analysis. Concepts and practice. Nova Iorque. Routledge. 6a Edição
Watkins, R., & Kavale, J. 2014. «Needs: Defining what you are assessing». New Directions for Evaluation, 2014(144), 19-31.
Varone, F., & Jacob, S. (2004). «Institutionnalisation de l'évaluation et nouvelle gestion publique: un état des lieux comparative». Revue internationale de politique comparée, 11(2), 271-292.
Trevisan, A. P., & Van Bellen, H. M. 2008. «Avaliação de políticas públicas: uma revisão teórica de um campo em construção». Revista de Administração Pública, 42(3), 529-550.
Stufflebeam, D. L., Madaus, G. F., & Kellaghan, T. (Eds.). 2006. Evaluation models: Viewpoints on educational and human services evaluation. Nova Iorque, Kluwer, 2a Edição
Stockmann, R.; Meyer, W.; Taube, L. (eds.) 2020. The Institutionalisation of Evaluation in Europe, Cham, Springer Nature
Stevens, C. J.; Dial, M. (eds). 1994. Preventing the misuse of evaluation. San Francisco. Jossey-Bass
Serapioni, M. (2016). «Conceitos e métodos para a avaliação de programas sociais e políticas públicas». Sociologia, 31, 59-80.
Scriven, M. (1991). Evaluation thesaurus. Newbury Park. Sage. 4a Edição
Rose, R. Lesson-Drawing in Public Policy. 1993. Londres. Sage
Rogers, P. J., Hacsi, T. A., Petrosino, A., & Huebner, T. A. 2000. «Program theory in evaluation: Challenges and opportunities.» New Directions for Evaluation, 87
Preskill, H., & Jones, N. 2009. A practical guide for engaging stakeholders in developing evaluation questions. Robert Wood Johnson Foundation. Acessível em https://folio.iupui.edu/bitstream/handle/10244/683/091022.stakeholder.involvement.fullreport.draft.pdf?sequence=2&sa=U&ei=IwNWU5WAFIqL4gTK-4DgAg&ved=0CEQQFjAH&usg=AFQjCNGl7ktAkP6jWjiIcuAznrqvj5b3Lg
Pedroso, P.; Seiceira, Filipa; Solla, L.; Matias, N. Alves, T. Avaliação Externa ao Projeto Escola+ Fase II em São Tomé e Príncipe, LSiboa. IMVF/Camões
Pedroso, P. 1992. «A avaliação das políticas de formação como processo de pesquisa». Emprego e Formação, Lisboa, n.18, p.5-14.
Patton, M. Q. (1998). «Discovering process use». Evaluation, 4(2), 225-233.
Pawson, R., Tilley, N., & Tilley, N. 1997. Realistic evaluation. Londres. Sage.
Paixão, J. M. P., & Ferrão, J. 2019. Metodologias de Avaliação de Políticas Públicas. Lisboa. Imprensa da Universidade de Lisboa
OECD, 2016. Evaluation Systems in Development Co-operation 2016 Review. Paris.OECD
McConnell, Alan. 2013. Learning from Success and Failure? In Eduardo Araral, Scott Fritzen, Michael Howlett, M. Ramesh, and Xun Wu (Eds), Routledge Handbook of Public Policy, pp. 484-494. Abingdon. Routledge.
Markiewicz, A. 2005. ?A balancing act?: Resolving multiple stakeholder interests in program evaluation. Evaluation Journal of Australasia, 4(1-2), 13-21.
Moore, M. 1983. "Social Science and Policy Analysis," in Daniel Callahan and Bruce Jennings eds. Ethics, the Social Sciences, and Policy Analysis. New York. Plenum. chapter 11, pp. 271-291
Instituto Nacional de Administração, (Org.). (1998) A avaliação na administração pública?, Acta Geral do 1º Encontro INA, Lisboa, Instituto Nacional de Administração. Acessível em http://ina.pt/images/stories/sumarios/Aval_AP..pdf
Fischer, F. 1999. Evaluating Public Policy. Chcago, Nelson-Hall Publishers
Ferrão, J., & Mourato, J. 2010. «A Avaliação de Políticas Públicas como Factor de Aprendizagem, Inovação Institucional e Cidadania. O Caso da Política de Ordenamento do Território em Portugal». Revista Brasileira de Estudos Urbanos e Regionais (RBEUR), 12(1), 9-28.
Faria, C. A.. 2005. «A política da avaliação de políticas públicas». Revista brasileira de ciências sociais, 20(59), 97-110.
European Comission, 2013. EVALSED: The resource for the evaluation of Socio-Economic Development. Acessível em https://ec.europa.eu/regional_policy/en/information/publications/evaluations-guidance-documents/2013/evalsed-the-resource-for-the-evaluation-of-socio-economic-development-evaluation-guide
Dale, R. (Ed.). 2004. Evaluating Development Programmes and Projects. New Delhi. Sage. 2a Edição.
Capucha, Luís e Paulo Pedroso (1996) (orgs.), Sociologia - Problemas e Práticas, nº 22 (Número especial sobre metodologias de avaliação)
Capucha, L.; Almeida, J. F.; Pedroso, P.; Silva, J. A. 1996. ?Metodologias de avaliação: o estado da arte em Portugal?, Sociologia - Problemas e Práticas, 22, 11-17
Capucha, Luís et. al (1998), Rendimento Mínimo Garantido: avaliação da fase experimental, Lisboa, Centro de Investigação e Estudos de Sociologia.
Capucha, Luís (2008), Planeamento e avaliação de projectos - guião prático, Lisboa, DGIDC/ME. Acessível em https://www.dge.mec.pt/sites/default/files/EPIPSE/planeamento_e_avaliacao_de_projectos_-_guiao_pratico_capucha_2008.pdf
Boyle, R., & Lemaire, D. (Eds.). 1999. Building effective evaluation capacity: Lessons from practice. New Brunswick .Transaction Publishers.
Beach, D., & Pedersen, R. B. .2013. Process-tracing methods: Foundations and guidelines. University of Michigan Press.
Bardach, E., & Patashnik, E. M. 2020. A practical guide for policy analysis: The eightfold path to more effective problem solving. Washongton D.C. CQ press. 6a Edição
Bamberger, J.; Witkin, B. 2000. From needs assessment to action: transforming needs into solutions strategies. Londres Sage.
American Evaluation Association. 2018. Evaluators? Ethical Guiding Principles. Acessível em https://www.eval.org/p/cm/ld/fid=51
Altschuld, J. W. 2004. «Emerging dimensions of needs assessment». Performance Improvement, 43(1), 10-15.
Alkin, M. C. (Ed.). 2013. Evaluation roots. Thousand Oaks. Sage.2a edição
Authors:
Reference: null
Year:
Policy Evaluation Methods
At the end of the course, the student will be able to:
LO1. Identify the main methods and techniques of policy evaluation
LO2. Understand the advantages, limitations and challenges associated with each of the methods and techniques involved in policy evaluation
LO3. Relate the various approaches and techniques of impact assessment with different theoretical models of causality
LO4. Choose approaches to evaluation appropriate to different contexts
P1. Introduction
P1.1 Diversity of assessment methods
P1.2. The context of assessment and choice of methods
P1.3 The challenges of impact assessment
P2. Qualitative methods
P2.1 Theoretical-based impact assessment
P2.2 Qualitative approaches to causal methods
P3. Quantitative methods
P3.1. Naive approaches
P3.2 Experimental methods
P3.3 Non-experimental methods
Expository lessons with discussion (TP)
|
Periodic evaluation:
- individual essay (50%)
- written test (50%)
Final exam: written test (100%)
Title: Gertler, Paul J.; Martinez, Sebastian; Premand, Patrick; Rawlings, Laura B.; Vermeersch, Christel M. J.. (2016). Impact Evaluation in Practice, Second Edition. Washington, DC: Inter-American Development Bank and World Bank.
EC (2013). EVALSED: The resource for the evaluation of Socio-Economic Development ? Sourcebook. Luxembourg: European Commission.
Authors:
Reference: null
Year:
Title: Stuart, E. A. (2010). ?Matching methods for causal inference: A review and a look forward?. Statistical science: a review journal of the Institute of Mathematical Statistics, 25(1), 1-21.
Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R., & Befani, B. (2012). ?Broadening the range of designs and methods for impact evaluations?, DFID Working Paper 38, Department for International Development.
Shaw, I. (1999). Qualitative Evaluation. London: Sage Publications.
Ritchie, J., Lewis, J., Nicholls, C. M., & Ormston, R. (Eds.). (2013). Qualitative research practice: A guide for social science students and researchers. London: Sage Publications.
Rihoux, B., & Ragin, C. C. (2008). Configurational comparative methods: Qualitative comparative analysis (QCA) and related techniques. Sage Publications.
Purdon, S.; Lessof, C.; Woodfield, K.; Bryson, C. (2001). ?Research Methods For Policy Evaluation.? Department for Work and Pensions Research Working Paper No 2. National Centre for Social Research.
Mayne, J. (2011). ?Contribution analysis: Addressing cause and effect?. In Forss, K., Marra, M., & Schwartz, R. (Eds.). Evaluating the complex: Attribution, contribution, and beyond (Vol. 1). Transaction Publishers.Pp. 53-96.
Mamede et al. (2018). Avaliação do Impacto dos Fundos Europeus Estruturais e de Investimento (FEEI) no Desempenho das Empresas ? Relatório Final. Agência para o Desenvolvimento e Coesão.
Leeuw, F. L. (2003). ?Reconstructing program theories: Methods available and problems to be solved.? American Journal of Evaluation, 24(1), 5-20.
Garbarino, S.; Holland, J. (2009). ?Quantitative and Qualitative Methods in Impact Evaluation and Measuring Results?. GSDRC Emerging Issues Research Service.
GAO (1990). Prospective Evaluation Synthesis. Washington: United States General Account Office.
EC (2008). Guide to cost-benefit analysis of investment projects (Structural Fund-ERDF, Cohesion Fund and IPA). Evaluation Unit, DG Regional Policy, European Commission.
Befani, B., & Mayne, J. (2014). ?Process tracing and contribution analysis: A combined approach to generative causal inference for impact evaluation?. IDS bulletin, 45(6), 17-36.
Angrist, J. D.; Pischke, J.-S. (2009). Mostly Harmless Econometrics: An Empiricist´s Companion. Princeton University Press.
Authors:
Reference: null
Year:
Planning and Public Policy
OA1 - Acquisition of theoretical knowledge about the framework of the design and planning of public policies in the context of the Public Policy Studies;
OA2 - Identification and appropriation of theoretical reference frameworks used in the process of design and planning of public policies and their respective methodologies of intervention.
OA3 - Acquisition of methodological and technical-operational knowledge concerning the methods, tools and contents of the main phases of a methodology of design and planning of public policies.
CP1. DESIGN AND PROGRAMMING WITHIN PUBLIC POLICIES
1. Fundamental concepts
2. Public Policy Studies epistemological framework
3. Operationalising public policy concept o
4. Ethics in public policies design and programming
CP2. CONCEPTUAL REFERENCE FRAMEWORKS
1. Systemic vision
2. Programme theories
2. Theory of change
3. Logical models
CP3. OPERATIONAL FRAMEWORK
1. Diagnosis and priorities selection
- Needs assessment
- Identifying problems
- Mobilisation of actors
- Selection of priorities
2. Strategy definition
- Alternatives analysis
- Intervention conceptual framework
- Objectives and goals
3.3 Action plan
- Operational framework design
- Programmatic content
- Resource mobilisation and budget
- Management model
- Monitoring structure and information systems
- Dissemination and communication
- Longitudinal programming
- Ex-ante evaluation and evaluation plan
The assessment of the course Public Policy Planning in continuous assessment mode is carried out through group work and an individual report. The final grade will be obtained using the following weighting:
- Group work: 70% of the final grade;
- Individual report: 30% of the final grade.
The course does not include a written exam. As an alternative to continuous assessment, the two elements provided for in the continuous assessment modality may be presented individually and at exam period. These assessment elements must be entirely original and may not have been assessed in whole or in part previously.
Title: Capano, G., Howlett, M., Ramesh, M & Virani, A. (2019). Making policies work: First- and second-order mechanisms in policy design. Edward Elgar Publishing.
Chen, H. (2015). Practical program evaluation: theory-driven evaluation and the integrated evaluation perspective. (2nd. Ed.). Sage.
Howlett, M. & Mukherjee, I. (eds.) (2018). Routledge handbook of policy design. Routledge.
Howlett, M. (2019). Designing public policies: Principles and instruments. (2nd. Ed.). Routledge.
Howlett, M., Ramesh, M & Perl, A. (2020). Studying public policy: policy cycles and policy subsystems. (4th. Ed.). Oxford University Press.
McNabb, D. & Lee, C. (2020). Public sector strategy design: Theory and practice for government and nonprofit organization. Routledge.
Chow, J. (2020). Strategic policy design: a practitioner's guide to statecraft. Routledge.
Peters, B. & Fontaine, G. (eds.) (2022). Research handbook of policy design. Edward Elgar.
Authors:
Reference: null
Year:
Title: Bamberger, M. & Mabry, L. (2020). RealWorld evaluation. Working under budget, time, data and political constrains. (3rd. Ed.). Sage.
Bardach, E. & Patashnik, E. (2020). A practical guide for policy analysis: the eightfold path to more effective problem solving. (6th. Ed.). Thousand Oaks: Sage/ CQ Press.
Birkland, T. (2020). An introduction to the policy process: theories, concepts, and models of public policy making. (5th. Ed.). Routledge.
Bovens, M. & Hart, P. (2017). Understanding policy fiascoes. Routledge.
Cairney, P. (2016). The politics of evidence-based policy making. Palgrave Macmillan.
Cairney, P. (2019). Understanding public policy: theories and issues. (2nd. Ed.). Palgrave Macmillan.
Calley, N. (2011). Program development in the 21st Century: an evidence-based approach to design, implementation and evaluation. Sage.
Capano, G., & Howlett, M. (eds.). (2020). A modern guide to public policy. Edward Elgar Publishing.
Chrisinger, D. (2017). Public policy writing that matters. Baltimore: Johns Hopkins University Press.
Compton, M., & Hart, P. (eds.) (2019). Great policy successes. Oxford University Press.
Durose, C. & Richardson, L. (2016). Designing public policy for co-prodution: Theory, practice and change. Policy Press.
Dye, T. (2017). Understanding Public Policy. (15th. Ed.). Pearson.
Friedman, L. (2018). Does policy analysis matter? Exploring its effectiveness in theory and practice. University of California Press.
Funnell, S. & Rogers, P. (2011). Purposeful program theory: effective use of theories of change and logic models. Jossey-Bass.
Guerra, I. (2006). Participação e acção colectiva: interesses, conflitos e consensos. Princípia.
Guerra, I. (2007). Fundamentos e processos de uma sociologia de acção: o planeamento em ciências sociais. (2nd. Ed.). Princípia.
Howlett, M. & Tosun, J. (eds.) (2018). Policy styles and policy-making: exploring the linkages. Routledge.
Howlett, M. & Tosun, J. (eds.) (2021). The Routledge handbook of policy styles. Routledge.
Howlett, M. (2019). The policy design primer: Choosing the right tools for the job. Routledge.
Howlett, M., Fraser, S. & Mukherjee, I. (eds.) (2018). Handbook of policy formulation. Edward Elgar.
Innes, J., & Booher, D. (2018). Planning with complexity: An introduction to collaborative rationality (2nd Ed.). Routledge.
Kettner, P., Moroney, R. & Martin, L. (2016). Designing and managing programs: an effectiveness-based approach. (5th. Ed.). Sage.
Khan, M. (2015). Program governance. CRC Press.
Knoepfel, P. (2018). Public policy resources. Policy Press.
Knowlton, L. & Phillips, C. (2012). The logic model guidebook. (2nd. Ed.). Sage.
Kraft, M. & Furlong, S. (2020). Public policy: politics, analysis, and alternatives. (7th. Ed.). CQ Press.
Laing, K. & Todd, L. (eds.) (2015). Theory based methodology: using theories of change for development, research and evaluation. Research Centre for Learning and Teaching, Newcastle University.
Menchén, M., Caro, C. & Gil, A. (2020). Guía para el diseño de estudios piloto de políticas públicas. Instituto Andaluz de Administración Pública.
Pasanen, T. & Shaxson, L. (2016). How to design a monitoring and evaluation framework for a policy research project. Methods Lab.
Patton, C., Sawicki, D. & Clark, J. (2012).Basic methods of policy analysis and planning. (3rd. Ed.). Routledge.
Pennock, A. (2018). The CQ press writing guide for public policy. CQ Press.
Peters, B., Capano, G., Howlett, M., Mukherjee, I., Chou, M., & Ravinet, P. (2018). Designing for policy effectiveness: defining and understanding a concept. Cambridge University Press.
Peters, G. (2018). Policy problems and policy design. Edward Elgar.
Schiefer, U. (et al) (2006). MAPA ? Manual de planeamento e avaliação de projetos. Princípia.
Vining, A. & Weimer, D. (2017). Policy analysis: concepts and practice. (6th. Ed.). Routledge.
Wu, X., Ramesh, M., Howlett, M. & Fritzen, S. (2017). The public policy primer: managing the policy process. (2nd. Ed.). Routledge.
Authors:
Reference: null
Year:
Policy Evaluation Project Work
At the end of the course, the student will be able to:
OA1. Be familiar with the design and the steps of an evaluation process
OA2. Identification of the main types of evaluation reports and their requirements
OA3. Be familiar with the most appropriate approaches and methodologies for each type of evaluation and how it reflects in an evaluation report
OA4. Structure and elaborate an evaluation report
1 Design of an evaluation strategy
1.1 Purpose, Scope, Approach
1.2 Thematic structuring: policy, pillars, program, projects, themes
1.3 Evaluation methodologies
1.4 Research methodologies
1.5 The formulation of evaluation questions
1.6 Field visits
1.7 Cases Studies
1.8 Surveys
1.9 Elaboration of the Evaluation Matrix
1.10 Ranking of evidence
1.11 Risk analysis and mitigation measures
1.12 Lessons learned, conclusions and recommendations
1.13 Evaluation guiding principles and code of conduct
1.14 Work Plan
1.15 Evaluation Team
1.16 Writing and synthesis
2 Types of evaluation reports
2.1 Sequential structure of evaluation reports
2.2 Expression of Interest
2.3 Evaluability Report
2.4 Inception report
2.5 Data Collection Report
2.6 Mid-term Evaluation Reports
2.7 End-term Evaluation Reports
2.8 Results reports based on the SDGs
2.9 Examples of different types of reports
3 Project work
Group work - 90%
Attendance and participation - 10%
Title: Teddlie, C. and Tashakkori, A. (2009). Foundations of Mixed Methods Research, Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences. Sage.
Patrick Forsyth (2010). How to Write Reports and Proposals. Revised Second Edition. Sunday Times. Kogan Page.
Morra Imas, Linda and Rist, Ray (2009). The Road to Results: Designing and Conducting Effective Development Evaluations. World Bank.
Marczyk, G., DeMatteo, D. and Festinger, D. (2005). Essentials of Research Design and Methodology. Wiley.
Locharoenrat, K. (2017). Research Methodologies for Beginners. Taylor and Francis.
Edmonds, W. A. and Kennedy, T. (2017). An Applied Guide to Research Designs: Quantitative, Qualitative, and Mixed Methods. Sage.
Authors:
Reference: null
Year:
Title: Yin, R. (2018). ?Case Study Research and Applications: Design and Methods?, Sage.
World Bank (2012), ?World Bank Group Impact Evaluations, Relevance and Effectiveness?.
World Bank (2004). ?Monitoring & Evaluation: Some Tools, Methods & Approaches?, Washington.
Weiss, B. D. (2004). SOR T: Strength of Recommendation Taxonomy. Essays and Commentaries, 36(2).
UNODC (n.i.). ?Guidelines for Inception Reports?.
Spilsbury, M. J., Perch, C., Norgbey, S. G. et al. (2007). ?Lessons Learned from Evaluation, A Platform for Sharing Knowledge?. Special Study Paper Number 2. United Nations Environment Programme
Rasiel, E. M. (1999). The McKinsey Way: Using the Techniques of the World?s Top Strategic Consultants to Help You and Your Business. McGRAW-HILL.
OCDE (2010). ?Quality Standards for Development Evaluation?m DAC Guidelines and Reference Series.
Langbein, L. and. Felbinger, C. L. (2006). Public Program Evaluation, A Statistical Guide. M. E.Sharpe.
International Labour Organization (2014). ?Evaluation lessons Learned?. Guidance Note 3, Evaluation Unit.
Ebell, M. H., Siwek, J., Weiss, B. D. et al. (2004). ?Strength of Recommendation Taxonomy (SORT): A Patient-Centered Approach to Grading Evidence in the Medical Literature?. Special communication. Am Fam Physician, 69(3):548?556.
Authors:
Reference: null
Year:
Public Policy Evaluation Experiences
At the end of the course, the student will be able to:
LO1. Know the main evaluation works carried out recently in Portugal
LO2. Identify different practical approaches for assessment professionals
1. Evaluation, learning and accountability in the development of public policies
2. Mapping the evaluation of public policies in Portugal
3. The experience of policy evaluation in the context of European funds
4. Evaluation of development cooperation
5. Approaches to sectoral policies evaluation- human resource development and infrastructure investments
Individual essay - 30%
Attendance and participation - 70%
Title: Lopes, J. V. 2020. «O Sistema nacional de avaliação de políticas públicas», Forum das Políticas Públicas
Ferrão, J., & Mourato, J. 2010. «A Avaliação de Políticas Públicas como Factor de Aprendizagem, Inovação Institucional e Cidadania. O Caso da Política de Ordenamento do Território em Portugal». Revista Brasileira de Estudos Urbanos e Regionais (RBEUR), 12(1), 9-28.
Carneiro, I. F. (2007). A avaliação de políticas públicas no discurso político português (1926-2005). Tese de Mestrado em Política Comparada. Universidade de Lisboa, Instituto de Ciências Sociais.
Capucha, L.; Almeida, J. F.; Pedroso, P.; Silva, J. A. 1996. ?Metodologias de avaliação: o estado da arte em Portugal?, Sociologia - Problemas e Práticas, 22, 11-17
Authors:
Reference: null
Year:
Title: Valente, A. C. (Coord.). 2018. Avaliação da implementação, eficácia e eficiência da Iniciativa Emprego Jovem (IEJ). Acessível em https://www.adcoesao.pt/sites/default/files/avaliacao/avaiej_relfinal_cesop-ucp_final_08janeiro2018.pdf
Quaternaire Portugal. 2019. Avaliação da implementação das Estratégias Nacional e Regionais para uma Especialização Inteligente (RIS3): Rede, Realizações e Resultados Esperados. Acessível em https://www.adcoesao.pt/sites/default/files/ava_ris3_final_25112019_0.pdf
Preskill, H., & Jones, N. 2009. A practical guide for engaging stakeholders in developing evaluation questions. Robert Wood Johnson Foundation. Acessível em https://folio.iupui.edu/bitstream/handle/10244/683/091022.stakeholder.involvement.fullreport.draft.pdf?sequence=2&sa=U&ei=IwNWU5WAFIqL4gTK-4DgAg&ved=0CEQQFjAH&usg=AFQjCNGl7ktAkP6jWjiIcuAznrqvj5b3Lg
Pereira, C; Duarte, N. (Coord,) 2018. Avaliação do contributo dos FEEI para a formação avançada. Acessível em https://www.adcoesao.pt/sites/default/files/avaliacao/resultados_das_avaliacoes_pt2020/avaliacaodaformacaoavancada_relatoriofinal2018comresumoing.pdf
Pedroso, P.; Seiceira, Filipa; Solla, L.; Matias, N. Alves, T. 2017. Avaliação Externa ao Projeto Escola+ Fase II em São Tomé e Príncipe, LSiboa. IMVF/Camões
Pedroso, P. 1992. «A avaliação das políticas de formação como processo de pesquisa». Emprego e Formação, Lisboa, n.18, p.5-14.
Paixão, J. M. P., & Ferrão, J. 2019. Metodologias de Avaliação de Políticas Públicas. Lisboa. Imprensa da Universidade de Lisboa
Mamede, R. P (Coord.) 2018. Avaliação do impacto dos FEEI no desempenho das empresas portuguesas. Acessível em https://www.adcoesao.pt/sites/default/files/avaliacao/resultados_das_avaliacoes_pt2020/01_dinamiacet_relatoriofinal_vf.pdf
Instituto Nacional de Administração, (Org.). (1998) A avaliação na administração pública?, Acta Geral do 1º Encontro INA, Lisboa, Instituto Nacional de Administração. Acessível em http://ina.pt/images/stories/sumarios/Aval_AP..pdf
Godinho, R.; Capucha. L. (Coord.) Avaliação de Impacto dos Contratos Locais de Desenvolvimento Social (CLDS). Acessível em https://www.adcoesao.pt/sites/default/files/avaliacao/resultados_das_avaliacoes_pt2020/avaliacaoclds_relatoriofinal.pdf
EY ? Augusto Mateus & Associados. 2018. Avaliação do Contributo dos Fundos Europeus Estruturais e de Investimento (FEEI) para as Dinâmicas de Transferência e Valorização de Conhecimento. Acessível em https://www.adcoesao.pt/sites/default/files/avaliacao/resultados_das_avaliacoes_pt2020/feei_tvc_relatoriofinal_volume1_201812.pdf
Centeno, M., & Novo, A. (2006). Avaliação do Impacto de um Programa de Apoio à Procura de Emprego. Banco de Portugal, Boletim Económico.
CEDRU / EY ? Augusto Mateus & Associados. 2019. Avaliação da Operacionalização da Abordagem Territorial do Portugal 2020 no contexto da Convergência e Coesão Territoria. Acessível em l https://www.adcoesao.pt/sites/default/files/relatorio_final_22nov2019.pdf
Capucha, Luís et. al (1998), Rendimento Mínimo Garantido: avaliação da fase experimental, Lisboa, Centro de Investigação e Estudos de Sociologia.
Capucha, Luís e Paulo Pedroso (1996) (orgs.), Sociologia - Problemas e Práticas, nº 22 (Número especial sobre metodologias de avaliação)
Capucha, Luís (2008), Planeamento e avaliação de projectos - guião prático, Lisboa, DGIDC/ME. Acessível em https://www.dge.mec.pt/sites/default/files/EPIPSE/planeamento_e_avaliacao_de_projectos_-_guiao_pratico_capucha_2008.pdf
Baptista, A., & Henriques, J. M. (1992). Avaliação do Programa ILE. Lisboa: Escher.
Abrantes, P., Mauritti, R., Roldão, C., Alves, L., 2011. Efeitos TEIP: Avaliação de impactos escolares e sociais em sete territórios educativos de intervenção prioritária. Síntese dos Resultados
Authors:
Reference: null
Year: