Learning
There can be a tendency to neglect the ‘L’ in MEL, but not by NIRAS. We work with clients to help them use monitoring and evaluation processes and data for learning and adaptive management – identifying what works and what doesn’t to drive ongoing improvement in implementation and impact. Our approach encompasses and recognises the distinctions between different forms of learning: content/thematic, operational/process, strategic, responsive, single and double loop learning. This means that we understand how to use monitoring data to provide real-time reflections of performance to inform timely course correction, and how to use evaluation data to produce robust and nuanced evidence-based learning on key issues and questions, including through deep dives.
We have developed strong capacity to communicate learning in engaging ways for a variety of audiences (internal, including cross-portfolio, and external), making use of digital learning platform technology and data storytelling and visualisation techniques and technologies, as well as social media. We seek to constructively engage and share learning with peers and other stakeholders in our field, and are active members of numerous MEL communities of practice, such as the European Evaluation Society.
Driving cross-programme learning on a major, multi-country economic reform and development initiative
NIRAS was co-lead of evaluation and learning for the GBP 1.3 billion FCDO Prosperity Fund (2017-2022) - designing and implementing a cross-programme learning function, with a two-stranded learning strategy focused on learning within (learning through the evaluation cycle) and learning alongside (learning across programmes). Both strands featured a diverse set of learning processes, including validation workshops, sense-making and action planning workshops, after-action reviews, peer learning groups, as well as annual reflection events, e-newsletters and knowledge products. There were fully integrated learning touch points, or co-creation sessions, with programme teams. The design of the service enabled evaluators and programme teams to engage on learning needs and jointly develop contextually relevant recommendations that were owned by the programme teams.
This helped ensure uptake and utility of recommendations and learning. These touch points were complemented by a variety of bite-sized learning products the service made available in different formats – from animations and talking head videos to audio recordings and infographics. These were published on the Fund's learning platform, which NIRAS helped to build and manage. This Fund-wide learning website and digital learning platform - the first ever cross-government digital platform - wa used to exchange knowledge, deliver training and learning events, and disseminate a range of multimedia evaluation products. The platform had over 620 users from over 14 government departments. The Annual Review found the approach to learning products accessible, inventive and carefully considered, and awarded it an A+ rating.
An award-winning approach to evaluation and learning for transformational change in sustainable forestry
NIRAS led a consortium to fulfil the role of Evaluation Manager for DFID's Investments in Forests and Sustainable Land Use for Partnerships for Forests (P4F) initiative (2017-2021), which aimed to catalyse increased private investment in sustainable forestry and ‘zero-deforestation’ agriculture through convening companies and governments, building support for demand-side measures, generating momentum for improved enabling conditions and providing technical assistance through a technical assistance facility (TAF). NIRAS designed and implemented an evaluation and learning strategy focused on supporting adaptive management and knowledge management within P4F, using theory-based and case-based approaches. This included developing a programme evaluation and learning framework, including fully articulating a theory of change and assumptions, and conducting several deep-dive case studies on different strands of the programme.
A key aspect of the role was creating and applying an evaluative framework for measuring and promoting transformational change. In September 2022, our report on the findings of this work, ‘Transformative Change in Tropical Forest Landscape Initiatives’, won the 2022 IDEAS Evaluation for Transformational Change Award, under the category ‘evaluation in support of transformation’. The Award was supported by the Independent Office of Evaluation (IOE), the Independent Evaluation Group of the World Bank and the International Development Evaluation Association (IDEAS) and was assigned by an external panel of international evaluation specialists.
Establishing a collaborative knowledge management platform in the Lake Chad region
Between 2021 and 2023, NIRAS led the establishment of a knowledge management platform in the Lake Chad region, working together with the Lake Chad Basin Commission and the World Bank. During a collaborative series of workshops with the different regional institutions and stakeholders, NIRAS developed a list of key socio-economic and security indicators and collected data through perception surveys and focus group discussions to establish an accurate, objective and up-to-date picture of communities’ situations at the local levels in peripheral, marginalised and hard-to-reach areas.
The findings were used to support the reflection/thinking processes on the implementation of regional development and/or stabilisation strategies to support multi-sectoral programming processes, which were designed to foster long-term sustainable stability and encourage political reflection on effective regional cooperation between the Lake Chad Basin Commission Member States and technical and financial partners around common challenges.