OECD - BMBF Workshop

Am 26./27. September 2005 fand im Wissenschaftszentrum Berlin der gemeinsam von OECD und BMBF organisierte Workshop zum Thema "EVALUATION OF PUBLICLY FUNDED RESEARCH" statt.

 REPORT ON THE EVALUATION WORKSHOP-download here

 

DAY 1: MONDAY, 26 SEPTEMBER 2005
___________________________________________

Opening and Welcome

  • State Secretary Prof. Frieder MEYER-KRAHMER, Federal Ministry of Education and Research (BMBF), Germany
  • Deputy Secretary General Mr. Herwig SCHLÖGL, Organisation for Economic Co-operation and Development (OECD)

SESSION 1: Objectives, methodologies, procedures and tools
Chair: Prof. Sir Gareth ROBERTS, President, Wolfson College, Oxford, United Kingdom (

  • New ways of strategic research planning and evaluation in the Helmholtz Association
    Prof. Dr. Jörn THIEDE, Vice President of the Helmholtz Association, Germany (Präsentation)
  • Science based evaluation at the level of the institute, the country and an international organization
    Mr. Jan TAPLICK, European Molecular Biology Organisation (EMBO) (Präsentation)
  • Investing in Australia’s publicly funded research: comparison of approaches to measuring outputs, quality, impact and relevance
    Dr. Evan ARTHUR, Head, Innovation and Research Systems Group, Department of Education Science and Training, Australia (Präsentation)
  • A novel evaluation system of public research institutes in Japan
    Dr. Naoto KOBAYASHI, Vice President, National Institute of Advanced Industrial Science and Technology (AIST), Japan (Präsentation)

 

SESSION 2: Evaluation of multidisciplinary research and transinstitutional cooperation
Chair: Prof. Janne HUKKINEN, Helsinki University of Technology, Finland (Präsentation)

  • After evaluation: Policy consequences from evaluations of transinstitutional RTD funding in Austria
    Dr. Rupert PICHLER, Mr. Wolfgang HEIN,  Federal Ministry for Transport, Innovation and Technology, Austria (Präsentation
  • Quantitative models for guiding complex S&T investment strategies
    Dr. Pamela Ebert FLATTAU, IDA Science and Technology Policy Institute (STPI), United States (Präsentation
    Ms. Bhavya LAL, Director, C-STPS, LLC, United States
  • Evaluating public-private partnerships: The competence centre movement in the Netherlands and other countries
    Mr. Erik ARNOLD, Managing Director, Technopolis, United Kingdom (Präsentation)

 

SESSION 3: Impacts of Evaluations
Chair:  Prof. Masayuki KONDO, Professor, Yokohama National University; and affiliated Senior Research Fellow, National Institute of Science and Technology Policy (NISTEP), MEXT, Japan (Präsentation)

  • How to make good use of research evaluations?
    Dr. Anneli PAULI, Vice President, Academy of Finland (Präsentation)
  • The role of institutional evaluation in the CSIC strategic planning and its consequences
    Prof. Jose Manuel FERNANDEZ-DE-LABASTIDA, Vice President of Consejo Superior de Investigaciones Científicas (CSIC), Spanish National Research Centre, Spain (Präsentation)
  • Summative evaluations and their effects on institutional strategy and performance. Experiences from the German Wissenschaftsrat’s evaluations of Blue List institutions
    Prof. Dr. Dr. h.c. Reinhard HÜTTL, BTU Cottbus, Chairman of the Scientific Commission of the Wissenschaftsrat, Germany (Präsentation)

 

DAY 2: TUESDAY, 27 SEPTEMBER 2005
___________________________________________

SESSION 4: Costs and Effects of Evaluations
Chair:  Dr. John BELL, Associate Director, The Allen Consulting Group, Canberra, Australia

  • German results of the OECD/TIP project “Behavioural Additionality”
    Dr. Georg LICHT, Ms. Birgit ASCHHOFF, Centre for European Economic Research (ZEW), Germany (Präsentation)
  • National research programs and evaluation methods of research proposals in Turkey
    Prof. Ömer CEBECI, Vice President of  the Scientific and Technical Research Council of Turkey (TÜBITAK), Turkey (Präsentation)

 

SESSION 5: Challenges for the future
Chair:  Prof. Stefan KUHLMANN, Fraunhofer-ISI, Germany

  • Evaluation for a changing research base
    Mr. Paul HUBBARD, HEFCE, United Kingdom (Präsentation)
  • „5 myths about funding scientific research (in Austria) - and how evaluation can make them more evidence-based"
    Mr. Klaus ZINÖCKER, Platform Research & Technology Policy Evaluation, Austria (Präsentation)
  • Ex-Ante and Ex-Post evaluation of a public/private cost-sharing program:
    evidence from the U.S. Advanced Technology Program

    Dr. John NAIL, National Institute of Science and Technology, Department of Commerce, United States (Präsentation)

 

Rapporteurs’ Summary

  • Mr. Luke GEORGHIOU, PREST, United Kingdom
  • Mr. Philippe LAREDO, PREST, United Kingdom. and ENPC, France

Final Discussion (including recommendations for further OECD/CSTP work)
Chair: Mr. Klaus MATTHES, Federal Ministry of Education and Research (BMBF), Germany

  • Mr. Michel FERRIER, President of CNER (Comité National d’Evaluation de la Recherche, National Committee for Research Evaluation), France
  • Mr. Nobuo TANAKA, Director STI, OECD
  • Ms. Naoko OKAMURA, Director, Office of Research and Development Evaluation, MEXT (Ministry for Education, Culture, Sports, Science and Technology), Japan (Präsentation)