2019 Research and Innovation Impact Assessment Course

Registration Deadline Extended to May 21, 2019

We are pleased to announce our fifth regional Research and Innovation Impact Assessment course: June 3–5, 2019. Registration is now open and program updates can be found on our LinkedIn, Facebook and Twitter accounts. Use #RIIA19


Banff, Alberta, Canada

Optimizing impact through evidence  

The course is designed to increase participants’ competitive advantage through:

  • Advance knowledge about RIIA frameworks, tools and approaches used in this emerging and specialized discipline
  • “Skilling up” in an area of increasingly high demand
  • Provide access to RIIA resources, decision support tools and a course workbook that reflect evidence-based practices and practice-based evidence
  • Facilitate collaborations and networks that connect participants to a local and international community of RIIA practitioners

The Business Case:

Need help securing support from your employer to attend? The RIIA course has enormous benefits for employers by providing valuable skills you can take back to your organization.

  • The course offers an intense, hands-on, practical curriculum that provides participants with the knowledge and skills necessary to assess the impact of research and innovation. Material is delivered through a combination of plenary and panel presentations, learning exercises, discussions, breakout sessions and network opportunities.
  • The course is delivered by national and international experts in the fields of performance management, evaluation and impact assessment with a local focus. As an affiliate of the International School on Research Impact Assessment, this regional course is offered at a significant discount compared to comparable training options around the world.
  • Participants will learn the why, what, who, and how of research assessment and take home knowledge about research assessment theory and its practical applications.

You can download a full summary of our business case that can be presented to your organization here.

Meet Our Faculty

Kathryn Graham, PhD

Kathryn Graham, PhD

Course Director and Faculty Executive Director, Performance Management and Evaluation, Alberta Innovates - Canada

Kathryn is a co-founder of the International School on Research Impact Assessment and was Director of the School when it was hosted in Banff in 2014. She is the Executive Director of Performance Measurement and Evaluation at Alberta Innovates, a Canadian-based publicly-funded provincial health research and innovation organization. She has over 20 years of strategic evaluation experience in health care and health research and innovation. Her expertise is in developing performance management, evaluation and impact assessment strategies as well as implementing measurement frameworks for various systems, organizations and programs. She and her team customized the implementation of the Canadian Academy of Health Sciences (2009) research impact assessment framework. Kathryn is an adviser on numerous national and international committees that focus on the assessment of research and innovation and invited to present nationally and internationally.

Deanne Langlois-Klassen, PhD

Deanne Langlois-Klassen, PhD

Program Director and Faculty Executive Director, Corporate Planning & Portfolio Management, Alberta Innovates - Canada

Deanne brings broad public and population health experience to the development of systems approaches for the assessment of research and innovation impacts. She also provides research expertise to ensure scientific rigor and appropriate methodological approaches in the assessment of Alberta Innovates cross-sectoral research and innovation investments. Deanne has a M.Sc. in Medical Sciences (Population Health) and a Ph.D. in Epidemiology from the University of Alberta, Canada in addition to her experience as a physiotherapist and health program manager.

Laura Hillier

Laura Hillier

Director of Performance, Analytics and Evaluation, Canada Foundation for Innovation (CFI) - Canada

Laura leads a team responsible for monitoring corporate performance and assessing the outcomes and impacts of the investments in research infrastructure made by the CFI.  Laura has a keen interest in methodologies for research impact assessment that provide relevant and useful information while not disadvantaging any type or area of research. She works collaboratively with others in the Science & Technology community to ensure the teams work meets the needs of the CFI and its stakeholders. Laura holds a BSc in biology, an MSc in epidemiology and the Canadian Evaluation Society’s Credentialed Evaluator (CE) designation. She has worked in research evaluation at three different funding organizations over the past 10+ years. Laura brings to her work in research performance and impact assessment past experience working across the different areas of health research – basic biomedical research, clinical research, health services research as well as population health research.

Vincent Lariviere, PhD

Vincent Lariviere, PhD

Canada Research Chair on the Transformations of Scholarly Communications - Canada

Vincent is associate professor of information science at the École de bibliothéconomie et des sciences de l’information, l’Université de Montréal, where he teaches research methods and bibliometrics. He is also the scientific director of the Érudit journal platform, associate scientific director of the Observatoire des sciences et des technologies and a regular member of the Centre interuniversitaire de recherche sur la science et la technologie. He holds a B.A. in Science, Technology and Society (UQAM), a M.A. in history of science (UQAM), a PhD in information science (McGill), and has performed postdoctoral work at Indiana University’s Department of Information and Library Science.

Maxi Miciak, PhD

Maxi Miciak, PhD

Cy Frank Fellow: Impact Assessment, Alberta Innovates - Canada

Maxi Miciak completed her doctoral studies in Rehabilitation Science at the University of Alberta. Maxi is presently the Alberta Innovates Cy Frank Fellow in Impact Assessment. She is interested in understanding and evaluating how the implementation of health services, policy, and research impact health systems. She is currently focused on developing frameworks to evaluate informed decision making, and scale and spread of research and innovation in the health system. Maxi’s research focuses on operationalizing patient-centred care by developing and implementing care models that impact health services and policies and the patient-practitioner relationship.

Tom Keenan, PhD

Tom Keenan, PhD

Senior Advisor for Impact and Evaluation -CSIRO - Australia

Tom Keenan has a PhD in Business from the Queensland University of Technology. He joined the Planning, Performance and Evaluation (PP&E) team of Australia’s Commonwealth Scientific and Industrial Research Organisation (CSIRO) as its Senior Advisor in 2016. He leads the Impact team within the broader PP&E team, which is responsible for the planning for, and monitoring and evaluation of, impact across CSIRO, both nationally and internationally. He has a great depth of understanding of, and extensive experience in, all aspects of planning, performance, and evaluation. In addition to his work within the PP&E space, Tom has over 25 years’ experience as both a practitioner and researcher within the field of business management. He has been engaged as an executive leader within, and a consultant to, Australian for-profit and not-for-profit SMEs, as well as government agencies and private corporations.

Alan O'Connor

Alan O'Connor

Senior Economics and Director Innovation Economics, RTI International - United States

Alan C. O’Connor is a senior economist and the director of innovation economics at RTI. Mr. O’Connor’s core research practice consists of benefit-cost analyses and program evaluations for R&D organizations, government, and supporters of regional innovation systems. He works with a diverse group of clients active in or supporting different phases of the innovation cycle, including NIST, DOE, CDC, the Canada Foundation for Innovation, the New York Academy of Sciences, and the Richard King Mellon Foundation as well as a myriad of regional governments. The unifying theme of his research is the role of public funding and public-private partnership in catalyzing and accelerating innovation to overcome technical and market barriers to socially optimal outcomes. His diverse research interests include renewable energy, medical imaging, technical infrastructure and standardization, immunization technology, start-up company support, and advanced manufacturing.

Alexandra Pollitt

Alexandra Pollitt

Research Fellow, Policy Institute, Kings College - London, United Kingdom

Alexandra Pollitt is a Research Fellow at the Policy Institute at King’s College London. She works on a wide range of topics, but her main focus areas are science policy, research evaluation and mental health. Alex’s recent work includes a series of studies estimating the economic returns of biomedical research, a study mapping the global mental health research funding landscape and a scientometric evaluation of the European Research Council’s portfolio. She has carried out extensive work on the societal impact of research, including a comparison of the relative value researchers and the public place on different kinds of impact. Alex has expertise in a range of qualitative and quantitative methodologies, and has taught research methods, communications and project management internationally. She holds an MA in Experimental Psychology from Oxford University and previously worked in psychiatry research at the University of Cambridge. Before joining King’s, Alex spent six years working in policy research and analysis at RAND Europe. She has also worked in impact evaluation for an international NGO.

Course Feedback

“The [RIIA] Course was the most significant educational experience I have had since I completed my post-doctoral training.”

Frank P. MacMaster, PhD

Associate Professor, University of Calgary, Scientific Director, Strategic Clinical Network, Addictions and Mental Health

“I would recommend this course [to] anyone with an interest in the emerging practice of research impact assessment. It
is exciting. Learn from skilled trainers on the ‘cutting edge’ of this work.”

Michele Moon, BScOT, MSc

Former Manager, Program Development and Evaluation, Orion Health/CBI Health Group

Preliminary Program

Welcome! This is an exciting time to have a training course on assessing the impact of investments in research and innovation (R&I). Our goal is to develop a common understanding and language for developing and implementing research and innovation impact assessments (RIIA) and to build local capacity in this area in Alberta and across Canada. This hands-on course will increase your knowledge of current best practices, build your skills and offer practical applications that will benefit you and your organization. Our course, which arose out of the International School on Research Impact Assessment (ISRIA), offers an international perspective while addressing local needs. To date nearly 500 participants from 34 countries have participated in ISRIA or local courses. Take advantage of being part of this growing and highly enthusiastic community of practice. We look forward to meeting you!

 – Kathryn Graham, Course Director

Download a PDF version of the RIIA 2019 program (current as of May 30, 2019)

Monday, June 3, 2019

7:00 am – 8:00 am Registration and Breakfast
8:00 am – 8:15 am Opening Remarks (Rollie Dykstra)
8:15 am – 8:45 am
 Genesis & Course Introduction (Kathryn Graham and Deanne Langlois-Klassen)
8:45 am – 9:15 am Network Meet & Greet (Maxi Miciak)
9:15 am – 9:45 am Foundations of RIIA (Kathryn Graham)
9:45 am – 10:15 am Refreshment Break
10:15 am – 11:15 am Panel: Shifting to an Impact Culture (Sharon McIntyre, Tom Keenan, and Reesa John)

Block 1 – Understanding the Context

11:15 am – 12:00 pm Introduction: RIIA Theory & Frameworks, Part I (Kathryn Graham)
12:00 pm – 1:00 pm Lunch
1:00 pm – 1:45 pm RIIA Theory & Frameworks, Part II (Kathryn Graham)
1:45 pm – 2:45 pm Build Your Expertise (Kathryn Graham and Deanne Langlois-Klassen)
2:45 pm – 3:15 pm Refreshment Break

Block 2 – Identify the Assessment Purpose

3:15 pm – 4:00 pm Understanding Stakeholder Needs (Tom Keenan)
4:00 pm – 4:15 pm
Learning Reflection (Deanne Langlois-Klassen)
4:15 pm – 4:30 pm Group Photo
6:00 pm – 8:00 pm Welcome Dinner

Tuesday, June 4, 2019

Block 2 – Identifying the Assessment Purpose

7:00 am – 8:00 am Breakfast
8:00 am – 8:45 am Assessment Purpose: the 4 As (Laura Hillier)
8:45 am – 9:30 am Develop Assessment Questions (presented by Deanne Langlois-Klassen)
9:30 am – 10:00 am Refreshment Break

Block 3 – Define Indicators of Success

10:00 am – 11:30 am Define Indicators of Success (Kathryn Graham and Terry Rachwalksi)
11:30 am – 12:30 pm Lunch
12:30 pm – 1:30 pm Build Your Expertise (Kathryn Graham and Deanne Langlois-Klassen)

Block 4 – Develop the Design, Methods and Data Collection

1:30 pm – 2:300 pm RIIA Designs & Mixed Methods (Laura Hillier)
2:30 pm – 3:00 pm Refreshment Break
3:00 pm – 4:15 pm Bibliometrics (Vincent Lariviere)
4:15 pm – 4:30 pm Learning Reflections (Deanne Langlois-Klassen)
4:30 pm Personal Time

Wednesday, June 5, 2019

7:00 am – 8:00 am Breakfast
8:00 am – 9:30 am Economic Evaluation (Alan O’Connor)
9:30 am – 10:15 am Refreshment Break and Room Checkout

Block 5 – Communicate and Use Findings

10:15 am – 12:00 pm Communicating Impact to Decision Makers (Alexandra Pollitt)
12:00 pm – 1:00 pm Lunch
1:00 pm – 1:30 pm Making an Impact with Impact (Maxi Miciak)
1:30 pm – 2:15 pm Hot Topics in Impact Assessment: Social Media Platforms for Impact & Gender Based Impact Analysis/Assessment (Jeannett Cable and Pavel Ovseiko)
2:15 pm – 2:30 pm Refreshment Break

Block 6 – Manage the Assessment

2:30 pm – 3:15 pm RIIA Management (Laura Hillier and Tom Keenan)
3:15 pm – 3:30 pm Closing Remarks (Kathryn Graham)


The course (formally the Training Course on Health Research Impact Assessment hosted by Alberta Innovates – Health Solutions, AIHS) is a local affiliate of the International School on Research Impact Assessment (ISRIA) that was co-founded by Dr. Kathryn Graham of Alberta Innovates and has been designed to focus more exclusively on the development and implementation of RIIA within the regional context. Establishment of the federal ministry of Innovation, Science and Economic Development is creating exciting times for the research and innovation impact agenda in Canada. This action signifies a renewed focus on performance measurement and evidence-informed decision making in Canada. We are working with our partners throughout government, academic institutions, non-profit organizations, industry and the health research and innovation system locally, nationally and internationally to measure and report on impacts created through our collaborative efforts. It is an opportune time for a practical training course on how to assess the impact of research and innovation, one that incorporates both performance measurement and evaluation teachings. For more information contact pme@albertainnovates.ca.

Other Events


June 5-7, 2019
Calgary, Alberta, Canada

Save up to $749!

By attending either the Research and Innovation Assessment Course or the In the Trenches Implementation to Impact Summit, you will receive free registration for Inventure$, the must-attend “unconference” for creative minds, entrepreneurs, investors and thought leaders.


June 7-8, 2019
Banff, Alberta, Canada

Looking to scale up and spread your business, or translate your groundbreaking research into on-the-ground impact? In the Trenches is a one-of-a-kind summit for entrepreneurs, researchers, policy-makers, program managers, and anyone else working in research and innovation. Connect with global experts, learn from relevant case studies, and share best practices at this inspirational day-and-a-half summit.