The methods for the evaluation were divided into three tasks: (1) secondary data collection and inception report, (2) primary data collection in Mappi and Boven Digoel, and (3) data analysis and report drafting. Each task is detailed below. The evaluation team comprised Dr Rodd Myers and Ms Dati Fatimah.
The primary data collection relied on (a) key informant interviews and (b) focus group discussions (i.e. group interviews). The latter methodology was used in the villages, with separate groups of women and men to alleviate power discrepancies. The former was used for other actors, focussing on SPL itself and government and civil society actors. The evaluation team interviewed SPL in a series of meetings with both groups and individuals. Interviews were conducted in Bahasa Indonesia: in some of the women’s focus groups translation into the local language was provided by one of the women in the group.
Generally the key informant interviews were with one to three people from a particular working unit, e.g. a government department, organisation or team, and lasted 60-90 minutes. The focus groups comprised 10-20 community members and were held concurrently with men in one group and women in another, and lasted about two hours.
The team conducted 22 interviews for the evaluation.
Below: Sago worms, a delicacy in the project area, important source of nutrition, and tourist attraction. (photo: Dati Fatimah)
Evaluation of Perkumpulan Silva Papua Lestari (SPL)
Silva Papua Lestari (SPL) was established in 2010 with a mission to develop an approach to forest protection that actively empowers and engages with indigenous communities. The Forest Management in Southern Papua project includes spatial planning that combines the rights and needs of indigenous people supported by governmental policies. The general objective of the project is to protect 550,730.65 ha of intact forest in Southern Papua based on a balance of use and protection (conservation), recognising the rights of indigenous groups. The project focusses on the Korowai, Kombai, Anu, Banano and Kopaka indigenous peoples, advocating their rights and recognition to the government with the aim of formalising their territory and right to use the forest. SPL also works to develop the capacity of indigenous groups, focusing on their livelihoods, education, health, and gender equality. The Ministry of Environment and Forestry defines 96 per cent of the project area as production or limited production forest (including Business Rights Forest/Hak Pengusahaan Hutan), making it susceptible to legal deforestation and forest degradation.
Rainforest Foundation Norway (RFN) appointed the Dala Institute to undertake an evaluation of SPL in 2019 and 2020 towards the end of the current contract between RFN and SPL. The evaluation assesses the impact and effectiveness of SPL’s work in reaching the project’s goals in its geographical area and RFN’s added value, and provides recommendations for the way forward following the questions posed in the Terms of Reference provided by RFN. The evaluation team took an inductive approach and oriented the evaluation towards learning rather than confirming SPL’s reports to RFN. It used the SPL’s logical framework as a guide and focused on outcome-level results and ‘elevated’ indicators pointing to overall programme effectiveness and impact.
The evaluation team made 20 action-oriented recommendations for programming and management. Based on detailed findings and conclusion comprising 30-page report to the client in both Bahasa Indonesia and English.