Monitoring and evaluation

Monitoring and evaluation

Alberta Innovates developed a Health Research to Impact Framework (sidebar image) that is used to track research activities across the continuum from investment to results. The framework is based on the Canadian Academy of Health Sciences (2009) model. We are interested in using the framework and associated evaluation results to measure value for money of research investments.

>>Click the image to the right to expand and read this published peer-reviewed article for more information.

More specifically we assess whether our organizational and funding activities are relevant (strategically aligned; meet the needs they are trying to address), effective (meet our mission; achieve their objectives and outcomes), and efficient (timeliness; maximize cost to benefit). Designed through the application of practice- and evidence-based approaches, the framework guides the systematic collection, analysis and reporting of results in order to inform decision-making and facilitate action within our organization and our stakeholder community.

Assessing Research Impact | Alberta Innovates

The Health Research to Impact Framework illustrates how investing in health research and innovation activities ultimately contributes to better health outcomes. The outcomes of health research are measured across five areas: capacity building, advancing knowledge, informing decision making, health and socio-economic benefits. AI uses best evidence and best practices in the development of the Health Research to Impact Framework, and we work together with end users in implementing the framework:

  • Plan: A plan is developed with key stakeholders to assess the research impact of AI programs and operations. The plan was developed by AI and reviewed by international experts in the field of research evaluation.
  • Implement: The plan then gets implemented to monitor progress in achieving results, as well as evaluating whether the program achieved its goals and results. We use a mix of methods (quantitative and qualitative), a variety of data sources, and a number of success indicators so that the evaluation is balanced and feasible, and reflects the true value of the research and innovation. Methods and tools include but are not limited to:
    • Logic models
    • Balanced scorecards
    • Surveys
    • Peer review
    • Bibliometrics
    • Econometrics
    • Case studies
  • Communicate: Results are communicated to those who are directly impacted as well as to other audiences such as funders, the research community, etc. Results of the evaluations and important achievements are reported to key stakeholders to inform decision making and action as appropriate. Check out our 2010 Interdisciplinary Team Grants Program Highlights. [PDF 466 KB]
  • Use and Improve: Assessment results are used to reflect on what worked, lessons learned etc. Management actions are developed based on identified areas for improvement.