Design, Evaluate

A Guided Tour Through: Measuring Outcomes [video resource]

Evaluation, Tool/toolkit, Video

The Expert Panel Project Team at AIFS have published this instructional video to guide you through measuring for outcomes. It explain why and how we want to measure outcomes to demonstrate impact in child and family services. This video also guides you how to choose which short, medium and long term outcomes to measure given limited resources.

Design, Implement, Evaluate

A guided tour through: program logic models [video resource]

Evaluation, Tool/toolkit, Video

The Expert Panel Project Team at AIFS have published this instructional video to guide you through program logic models. It guides you step-by-step through the terminology of program logic models, and how to build your own model, including writing a problem statement, understanding inputs and outputs, and identifying short, medium and long term outcomes.

Evaluate

Aboriginal and Torres Strait Islander Child and Family Services: Evaluation Readiness Toolkit

Aboriginal and Torres Strait Islander, Evaluation, Tool/toolkit

This new toolkit from SNAICC gives fantastic guidance on designing and measuring for outcomes in Aboriginal and Torres Strait Islander child and family services. It compiles an insightful list of 21 key outcomes for this sector, drawn from the 8 key principles of The Aboriginal and Torres Strait Islander Child and Family Services Wellbeing Framework. It also features a detailed, yet accessible, step-by-step guide to help you develop a theory of change to support and measure for outcomes. This toolkit centres on evaluation work in Aboriginal and Torres Strait Islander child and family services, but its clear and concise explanation of how to use outcomes, an outcomes framework, and a theory of change will be relevant and useful to many workers across the wider child and family services sector.

ARPNet Dilly Bag: a practical field guide and research tools for use by Aboriginal research practitioners in Australia

Aboriginal and Torres Strait Islander, Tool/toolkit

This is a practical guide to participatory and other research tools for Aboriginal research practitioners. It was developed by a network of Aboriginal Research Practitioners in the Top End who want to use participatory tools that enable participants to better understand why and what is being done.

Evaluate

Clear Horizon – Resources

Evaluation, Tool/toolkit

Clear Horizon offers a range of tools and resources specific to monitoring and evaluation to measure the impact and achievement of project outcomes. These include the Most Significant Change Technique and Collaborative Outcomes Reporting.

Connections Activity – Hope-filled Engagement Tool

Young People, Client Engagement, Tool/toolkit

In this activity young people are encouraged to fill in the page with words or pictures identifying different points of connection at various levels. This will open up conversations about a young person’s place in the world and encourage them to see themselves as one part of a connected network of support. If a young person doesn’t have strong connections in “Family”, they may be led to see that they do have connections elsewhere – perhaps via a connection to nature, culture, or a particular worker or friend.

Evaluators may come across situations where they have to work in a cultural context other than of their own. Culturally competent evaluators not only respect the cultures represented in the evaluation but recognize their own ‘culturally based assumptions’; take into account the ‘differing world view of evaluation stakeholders and target communities’ and select culturally appropriate evaluation options and strategies.

Evaluate

DHHS Centre for Evaluation and Research – Evaluation Guide

Evaluation, Tool/toolkit

This guide from the Department of Health and Human Services (2017) is designed to support staff in the planning and commissioning of an evaluation. It is suitable for anyone responsible for program development, implementation or evaluation.

Doing good business: A resource for researchers about conducting research with Aboriginal and Torres Strait Islander children about family violence.

Aboriginal and Torres Strait Islander, Family Violence, Tool/toolkit

This research tool, prepared by staff at the ACU Institute of Child Protection Studies (ICPS) is designed for people who may be interested in funding or conducting research with Aboriginal and Torres Strait Islander children on the topic of family violence. Its guidance is informed by the views of Indigenous researchers, research ethics committee members, Elders and senior community members, service providers, parents and young people from remote, rural, regional and urban Australia.

Education Endowment Foundation – Teaching and Learning Toolkit

Education, Tool/toolkit

The Education Endowment Foundation (EEF) is an independent charity dedicated to breaking the link between family income and educational achievement. This resource features evidence summaries, tools, projects and case studies.

Favourite Things Activity – Hope-filled Engagement Tool

Young People, Client Engagement, Tool/toolkit

An alternative to starting with the question, “What subjects are you good at in school”, recognising that for many disconnected young people this can trigger feelings of inadequacy and frustration. Instead, the activity encourages young people to simply reflect on things they like, not necessarily things they are good at or activities with a strong careers focus or pathway. This helps the young person with the practitioner to open up stories and reflection about favourite things, activities, people, and draw out useful stories and experiences that demonstrate skill, character, connection and competency.

Implement

Implementation Stages Action Plan

Tool/toolkit

This action plan from the National Implementation and Research Institute provides a handy way to identify the next steps in implementing your program.

Implement

Implementing evidence-informed practice: a practical toolkit

Mental Health, Tool/toolkit

This toolkit by the Ontario Centre for Excellence for Child and Youth Mental Health provides a comprehensive framework and tools to kick start the implementation process.

Implement

Implementing Evidence-Informed Practice: A Practical Toolkit

Evidence Informed Practice, Tool/toolkit

This toolkit contains practical insight, strategies and resources for the planning phase of implementation. It couples theory and research findings with practical strategies and real-life experiences from the field that may be relevant to your organization.

This collection of infographics published by the Center on the Developing Child at Harvard University features accessible infographics accompanied by explanations and links to further resources. These resources will be particularly relevant to practitioners working directly with families and children, as they explain a number of related concepts- including toxic stress, executive function and ACEs (adverse childhood experiences). These infographics can help you identify how these issues might be effecting families, and some approaches you might use to improve their outcomes.

Implement

Key Factors For Implementation

Tool/toolkit

This tool by the Ontario Centre for Excellence for Child and Youth Mental Health helps to comprehensively assess both the internal and external factors that may impact implementation.

Identify, Design, Implement, Evaluate

Life Changes Trust Evaluation Toolkit

Evaluation, Tool/toolkit

The Life Changes Trust Evaluation Toolkit provides a range of resources across the journey to better outcomes including creating a theory of change and program logic, designing an evaluation and methods for collecting data.

My Hero is You, Storybook for Children on COVID-19

COVID-19, Tool/toolkit

This book was a project developed by the Inter-Agency Standing Committee (IASC), supported by global, regional and country based experts from Member Agencies, in addition to parents, caregivers, teachers and children in 104 countries. It was developed based a global survey to assess children’s mental health and psychosocial needs during the COVID-19 outbreak - and is available in multiple different languages.

Implement

National Implementation Research Network – Active Implementation Hub

Tool/toolkit, Database

The National Implementation Research Network offers a variety of tools, publications and information on implementation science including e-learning modules and downloadable checklists to aid the implementation process.

National Strategic Framework for Aboriginal and Torres Strait Islander Peoples’ Mental Health and Social and Emotional Wellbeing 2017-2023.

Aboriginal and Torres Strait Islander, Mental Health, Tool/toolkit

During this year’s World Mental Health Week, the Federal Government launched a framework for Aboriginal and Torres Strait Islander people’s mental health. This framework sets out a comprehensive and culturally appropriate guide to inform Aboriginal and Torres Strait Islander mental health and wellbeing reforms. The framework is vital to the healing and wellbeing of Aboriginal and Torres Strait Islander communities, who continue to experience greater levels of mental health issues than the broader population.

NHRMC National Statement on Ethical Conduct in Human Research (2007) – Updated 2018

Safety and wellbeing, Evaluation, Tool/toolkit

High quality data can help us understand if we are on track, and if clients are benefiting as they would like to. If you are responsible for collecting data for evaluation there is lots to consider, including respecting client confidentiality, being cautious of potential power imbalances and accommodating for diverse literacy levels. Ensuring that methods and tools are fit for purpose and our processes are ethical is essential. Become familiar with the National Statement on Ethical Conduct in Human Research (2007) – Updated 2018.

Identify, Design, Implement, Evaluate

OPEN Tool: Reflect and Review Guiding Questions

Reflect and Review, Tool/toolkit

This OPEN Tool provides some key questions to support the Reflect and Review process. In order to make high-quality decisions it is important to systematically reflect on, and review data, practice and client feedback to adapt and enhance your approach.

Implement

Organisational Readiness for Implementation – Checklist

Tool/toolkit

An assessment tool developed by Melanie Barwick from the University of Toronto to identify organisational readiness for implementation.

Outcomes Rating Scale (ORS) and Session Rating Scales (SRS)

Evaluation, Tool/toolkit

Developed by Scott Miller PhD, psychologist and co-founder of the International Center for Clinical Excellence and the Institute for the Study of Therapeutic Change, The Outcome Rating Scale (ORS) and Session Rating Scale (SRS) are brief measures for tracking client functioning and the quality of the therapeutic alliance. Each instrument takes less than a minute for clients to complete and for clinicians to score and interpret. Versions of the scales are available for adults, children, adolescents in 18 different languages.

Access a range of facilitation tools, journey mapping tools, role playing tips and techniques, voting systems and more, to better manage co-design processes with multiple stakeholders. Created by Iriss and used in Pilotlight, these tools will be relevant to lots of different organisations and situations.

Quality of School Life – Adventure (Motivation) subscale (QSL)

Education, Journal article, Tool/toolkit

The QSL measures primary-school-aged students’ perceptions towards school against three dimensions, 1) general satisfaction with school 2) commitment to school work 3) attitudes towards teachers. Learn more about the QSL

School Attitudes Assessment Survey-Revised

Education, Journal article, Tool/toolkit

This article describes the School Attitudes Assessment Survey - Revised (SAAS-R). This survey is a validated instrument used to measure the attitudes of adolescents toward school and teachers as well as their goal-valuation, motivation and academic self-perceptions. It is also used to explore below average academic achievement in high school students.

Identify, Design, Evaluate

Strength and Difficulties Questionnaire (SDQ)

Education, Mental Health, Tool/toolkit

The SDQ is a well validated and population-normed instrument which assesses in respect of emotional problems, peer problems, conduct problems, hyperactivity, and prosocial behaviour. Learn more about the SDQ...

The Australian Centre for Social Innovation (TACSI) Toolkit

Evaluation, Tool/toolkit

The Australian Centre for Social Innovation (TACSI) has a range of useful tools for co-design including a webinar exploring what is human centred design, and what does it take to do well?

UNICEF Toolkit: Useful Tools for Engaging Young People in Participatory Evaluation

Evaluation, Young People, Tool/toolkit

UNICEF developed this toolkit in 2005 to increase young people's participation in evaluation of projects in Europe and Central Asia. There are a number of evaluation tools/methods with ethical and practical guidelines to engage children and young people. There are also a number of energizers and ice-breakers to facilitate group sessions with children and young people where they can safely voice their opinions. Each tool and activity has a detailed set of instructions to guide the facilitator through the process.

Working together to keep children and families safe: Strategies for developing collaborative competence

Out of Home Care (OOHC), Safety and wellbeing, Tool/toolkit

This practice paper from AIFS focuses on improving cross-sectoral relationships between child protection and child and family welfare practitioners, who are often required to work together to keep children and families safe. This paper offers tips and techniques to build practitioners’ collaborative competence; that is, their skills in developing and sustaining effective cross-sectoral relationships in the many and varied circumstances of daily practice.

Youth Leading Community Change: An Evaluation Toolkit

Evaluation, Young People, Tool/toolkit

This practical toolkit is designed to engage young people to evaluate and measure the impact of youth projects. It has been developed by Evaluation Access using resources and activities from Girl Scouts of the United States of America, the National 4-H Council, and the National FFA Organization. There are a number of creative activities and handouts to support young people to plan, develop, and implement community projects.

Youth-Adult Partnership in Evaluation: A Resource Guide For Translating Research Into Practice

Evaluation, Young People, Tool/toolkit

This guide has a series of “tip sheets” that identify practical ways to conduct a youth-adult partnership evaluation project. The tip sheets talk about various “leverage points” or those key processes and moments in implementation that can influence the outcomes of projects. It also provides tips on creating a culture of evaluation in an organisation, developing the right evaluation questions and practical and youth-friendly data collection/analysis strategies.