1. Program Summary
Project Location 19 villages of UCs Hangrai and Satbani, Balakot Tehsil, Mansehra, NWFP
LIFE: 2 villages i..e Patika Uc Hangrai 1 and Patlang of UC Satbani (1,230 females)
No. and Type of Beneficiaries LIGHT: 588 women and adolescent girls for IGA and Adult Literacy sessions, direct beneficiaries. Indirect beneficiaries include other direct family members including children.
LIFE: 1230 Females
Project starting and ending dates LIGHT: From November 2008 up to 60 months
LIFE : From March 2009 up to 24 months
2. Rationale for Starting a New Programme/Project
Balakot Tehsil in the North Western Frontier Province (NWFP) of Pakistan is one of the most affected areas of the earthquake that occurred on 8th October, 2005. In the last census before the earthquake, the total population in the area was 214,630 composed of 30,357 households . The average household size in Kaghan is 5.9 persons while the male and female ratio is 51:49 percent respectively. Among the male population, adults constitute 27%, under-5 years of age 7% while the rest are between the ages of 5-17 years. Likewise, out of the total number of females, 25% are adults, 7% are under-5 years of age and the rest are between 5-17 years reflective of a young population.
The same baseline study also found out that Kaghan has an adult literacy ratio of 40.3%. This is lower (males 57.4% and females 21.7%), compared to overall project areas of WVP at 44.6% (males 61.7% and females 25.5%). Survey results reveal that the economic situation of the family correlates with the literacy rates of the family members. As the economic situation improves the literacy rate in some instances may also improve. Demographic trends indicate that the literacy rates for the younger generation is improving. For example, the literacy rate for the 12-17 age group is 70.3% (85.7% boys and 56% girls). Enrolment ratio for the 5-11 age groups is encouraging but still far from reaching a 100% enrolment rate and eliminating gender disparity. Current primary enrolment of Kaghan is 68.9% (boys 69.9% and girls 67.8%), which is slightly lower than the overall average in the project areas in the same region.
Balakot is rich in natural resources with 70% forest coverage. Natural hazards, unsustainable use of the forest, water, grasslands, including river system and lack of enforcement of environmental laws are big contributors to the rapid depletion of natural resources. The earthquake magnified the impact of environmental degradation, causing significant land destabilization and damage to the natural capital assets of rural people. Seismic shifts resulted in several major landslides and thousands of minor landslips, affecting about 10 percent of hillside arable land, forests and rangelands. Many natural springs feeding irrigation and rural water supply schemes dried up as a result of these landslides and landslips. In downstream areas, major water channels, roads and paths were blocked by rocks and debris thrown down by the earthquake. Flash floods and mudslides destroyed agricultural land and fruit tree plantations, and altered runoff routes on hillsides and in valley lowlands.
2.1 National Office Strategy
WVP developed strategy for the relief and rehabilitation phase of the earthquake response from 2005-2008. The strategy has two phases
Phase 1: Emergency response (October 2005 – June 2006)
The emergency response strategy focused on the following areas:
Emergency Relief (Distribution of NFIs, including temporary shelter materials):
Phase 1I: Transition into Early Recovery and Reconstruction (April 2006 – September 2008)
The rehabilitation phase of the response is focusing on the following areas. The rehabilitation phase has three strategic focus areas called Pillars. The Pillars include Children, Livelihood and HEA.
Children in Crisis
III. HUMANITARIAN AND EMERGENCY AFFAIRS
Humanitarian Protection (including Disability and Gender)
The WVP Strategy covers the Health sector in 2008.
3. Summary of Assessment
The study has been proposed for LIGHT and LIFE projects recently being started in KIP. The initial idea raised by the team was to have an assessment study for particular individual interventions that included current status of literacy, vocational skills and gender. Afterwards, while keeping focus over LEAP framework and application of level of efforts for individual assessment, DME recommended performing a comprehensive study baseline exercise for the ongoing two projects in complete to optimally use the human, financial and time resources with a broader scale; and hence would be more useful during monitoring and evaluation of the projects.
The idea for conducting the assessment was talked about with Program Development Manager and consented agreement to it.
Furthermore, the assessment study is designed to necessarily take account of the individual assessment (literacy, gender, vocational and Disaster Risk reduction) in a justified manner. The design in this respect would cover number and type of respondents, construction of tools and analysis & reporting.
Projects covered in the Assessment study 1. Literacy and Girls Hope Towards Transformation (LIGHT)
2. Protecting LIFE : A Community Resource & Water Management Project
Purposes of the Assessment • Asses the existing situation of the ongoing WV Pakistan project / program goal and outcome indicators
• Identify benchmark values for the selected indicator
• Identify major issues that will likely affect program implementation and draw constructive lessons for the future
Primary Methodology • Household Survey
• Focus group discussions
• Participatory exercises with community representatives
Target Area • 19 villages of KIP (covering 250 HHs)
Specification of Team • 5 Female and 5 Male enumerators.
• 2 CPOs
• 2 data operators
• PCs LIGHT and LIFE projects
• Project Officers
• Monitoring and Evaluation Officer
• Design, Monitoring and Evaluation Coordinator
Baseline Start and End Dates: • March - May 2009
Anticipated Baseline Draft Report Date: • TBD
Anticipated Baseline Final Report Date: • TBD
4. Principles of the Assessment Study
The main principles that will underlie the design of the assessment study are:
- Assessment report is evidence-based
- Competent Performance from planning to implementation of the assessment study process
- Respect for the security and dignity of respondents, program participants, staff and other Stakeholders
5. Assessment Study Methodology
5.1. Initial Planning
The following processes have been followed to develop this baseline term of reference:
- Decision on the scope of the study
- Review of the project documents especially project proposals
Finalize beneficiary list and selection of sample households
Beneficiary list and village profile of the areas will be used to select villages and households for interview. Households will be randomly selected from the beneficiary list provided by the respective Project Coordinators. The appropriate sample size for such population-based study is determined largely by three factors: (i) the estimated prevalence of the variable of interest (ii) the desired level of confidence and (iii) the acceptable margin of error. For a study design based on a simple random sample, the sample size required can be calculated using the following standard formula.
n = t2 x p (1-p)
Where n = required sample size
t = value for selected alpha level of 0.025 in each tail = 1.96
p = proportion;
d = acceptable margin of error for proportion (0.05 standard practice)
Cochran’s (1977) correction formula for sample size exceeds 5% of the population
n1 = n .
(1 + n/population)
n1 = adjusted sample size using population size
Following WV International LEAP Management Policy, all figures will be reported with 95% confidence level and 5% margin of error.
5.2 Data Collection and Analysis
The following secondary sources will be reviewed for better understanding of the context and type information already available
Projects’ Proposals focusing on outcome and output level indicators
Relevant government institution records (e.g. Health and education institutions)
Primary Data Collection
(This is already conducted by WV). Primary sources of information will be the target community members including men, women and boys and girls. The following methods will be used for primary data collection:
• HH Survey
• Focus Group Discussion
• Picture taking
Achievement: The data has been collected from 250 HHs in two UCs i.e. Hangrai and Satbani in Tehsil Balakot. Focus group discussion will be conducted in 3 villages with men and women community. The tools used for HHs collection is attached as an annex. Consultant will be provided with the soft data of HHs and FGD reports for making analysis and report.
The type of analysis will depend on the nature of the performance indicators described in the project monitoring and evaluation plans. The quantitative analysis will include percentage, comparisons and averages. Quantitative data will be analyzed using the Statistical Packages for Social Sciences (SPSS) software.
Final Assessment Report
Findings will be presented by project focusing on project outcome indicators. In addition to specific indicators, the findings regarding participation, sustainability and selected TDI indicators will be covered. The results will be presented in the form of narration with quantitative and qualitative information along with tables and graphs. The final assessment report will follow the outline in the attached file
6. Authority and Responsibility
6.1 Detail of Responsibilities of WV and the consultant
6.1.a Responsibilities of the Consultant
Review and final cleaning of data to make it ready for analysis
Visit Kaghan AIP to understand the context, meet staff and community
Review of information related to WV Pakistan program using internal sources
Analyze and interpret data following project outcome indicators for LIGHT and LIFE projects separately.
Present top line finding to WVP for review
Submit draft narrative report covering both quantitative and qualitative (FGD) information to WVP.
Arrange logistical needs while communicating in the field for meeting and follow-ups
Incorporate comments and produce final report following WVP format. The final report will be submitted in hard and soft copies.
Submit soft copies of raw data on CD
6.1.b Responsibilities of World Vision Pakistan
Provide data and relevant secondary documents
Facilitate in arranging meetings with staff and community
Review and give feedback for tools and draft report in a timely manner
Effect payments based on agreed terms and conditions in the contract
Manage and facilitate the overall assessment process
o PC LIGHT/LIFE: Facilitate in providing necessary information and following up
o M&E Officer: Technical support and facilitate PC when needed.
o ADM/IPM: Will support and facilitate team as needed
o CDO’s: Faciliate meeting arrangements with community
o DME Coordinator: Manage the overall assessment process and coordinate with the
7. Team Advisor
• Sharon Kane – Quality Enhancement Unit Manager
• Imran Ali Chishtie – Design, Monitoring & Evaluation Coordinator
The exercise in relation to the specific objective and consultant’s roles and responsibilities will be completed in 3 weeks. The following activity plan will be observed.
Kaghan AIP Assessment Study timeframe (tentative)
Activity Timeline Remarks
Data Cleaning 2 days Consultant Firm
Visit to KIP 1 day Consultant/WVP
Data Analysis and presentation of top-line results 8 days Consultant firm
Draft Report for comment 5 days Consultant/WVP
Final Report 3 days Consultant
The expected last date of completing the reporting preferably would be 10 June, 09.
Consultant will be responsible for logistic arrangements for their survey teams.
The following products are expected from the KIP Assessment study process
• Draft report following standard reporting format
• Final Report following standard reporting format
To be determined. The consultant will submit their proposal and finalized by committee within WVP.