“M&E Consultancy for the Enhanced Palestinian Justice Project (EPJP).” Chemonics International. 2014 – 2018.
AWRAD is contracted to implement M&E surveys of the EPJP project, which aims to strengthen the Palestinian justice sector by providing improved services and training to key stakeholders. AWRAD has completed a baseline assessment, and will conduct a midline and end line assessment across four years to measure a variety of indicators relevant to justice sector performance. To do this, AWRAD has designed a mixed-methods approach, utilizing questionnaires, interviews and focus groups, that will inform EPJP planning and strategy.
“Program Baseline and Impact Assessment and end-of-project evaluation of the School Support Program.” AMIDEAST. 2014 – 2017.
AWRAD has been contracted by AMIDEAST to perform the baseline and impact assessment and end-of-project evaluation of the interventions developed to support the 2014-2017 School Support Program. AWRAD will be working across the 14 educational directorates to evaluate AMIDEAST’s educational interventions. The objectives of these assessments are fourfold: (1) support the provision of transparent and accountable reporting on program results and outcomes, (2) evaluate the extent of SSP’s effectiveness in meeting its objectives and goals, (3) elicit successes and lessons learned to inform the design of future projects, and (4) enable a better understanding of how gender, school location, grade level and rate of community poverty impact student achievement and overall program effectiveness. The baseline survey was completed in January 2015.
“Five-year Citizen’s Perception Survey (M & E) for the Local Governance and Infrastructure (LGI) Program.” Global Communities. 2011 – 2016.
This endeavor is a five-year assignment informing the work of Global Communities in implementing its $100 million USAID-funded LGI. It consists of an evaluation of the multiple project interventions of the program and the hundreds of stakeholder communities involved. It addresses the nuances of measuring and testing quality of life indicators, the importance of participatory approaches in both project implementation and evaluation, and the importance of incorporating evaluation findings into the feedback loops for on-going project design and implementation. The project began in 2011 with a baseline assessment, specifically designed for comparison over the five-year duration of the program established through questionnaires and focus groups. The central focus of this project is the evaluation by the community of existing infrastructure across seven separate but related sectors, as well as interventions implemented by various partners. In 2014 AWRAD completed the mid-line evaluation, and produced a series of recommendations aimed at modifying programming and targeting. These were informed by critical disaggregation across age and income level to provide a nuanced view of community perceptions, and improve mechanisms for targeting. The most significant of these recommendations focused on improving the impact of infrastructure projects on marginalized groups, as well as fostering greater vertical engagement between central municipal government, local directorates and local municipalities and the constituents they serve. On-the-job training was conducted in citizen perception surveys and focus group implementation.
“Baseline and End Line Surveys for the Sharaka Public Prosecution Project.” Canadian International Development Agency (CIDA), Sharaka Project. 2013 – 2016.
AWRAD collected baseline data on eleven performance indicators designed to measure progress towards the development of a fair and effective public prosecution system that protects the rights of Palestinians. Data was collected from seven stakeholder groups: the Palestinian public in the West Bank, judges, lawyers, prosecutors and employees of the Office of the Attorney General and Public Prosecution (OAG/PP), prosecution service users, international donors in the Palestinian legal system and non-state actors, including leaders of relevant NGOs, human rights organizations and academic and research institutions. Fieldwork was conducted simultaneously with all seven stakeholders using 35 qualified field researchers. In 2014, AWRAD was asked to conduct an end line survey to measure the changes and progress achieved as a result of programming in the previous year. The same stakeholder groups were targeted, using a similar survey to the baseline round, together with additional questions targeted at the various implemented interventions. AWRAD submitted a final report identifying major trends and changes in perceptions, as well as possible explanations for these changes to aid future policy and program development within the justice sector.
“Final Evaluation of Program: Community Resilience and Development Program (CRDP).” United Nations Development Programme (UNDP). 2014.
AWRAD has concluded the evaluation of the $16 million CRDP program managed by UNDP and funded by a group of European donors notably Sweden, Austria and the UK. The CRDP was designed to prevent the erosion of living conditions for Palestinians living in Area C and East Jerusalem, protect their land and property and prevent migration by enhancing their resilience. As part of the evaluation, AWRAD developed a comprehensive set of evaluation questions addressing relevance, performance management, management and coordination, impact, harmonization and alignment and future outlook. AWRAD interviewed representative samples of all stakeholders including NGOs, CSOs, Palestinian government ministries and international donors throughout the West Bank and East Jerusalem to assess and benchmark the achievements of the program to date. A mixed-methods approach was used incorporating qualitative and quantitative methods utilizing focus groups, in-depth semi-structured interviews and questionnaires as analytical tools.
“Final Evaluation of the Post Trauma Rehabilitation of Palestinian Child Ex-Detainees in the West Bank project.” Save the Children International. 2014.
AWRAD partnered with Save the Children to carry out an evaluation of assignment of their five year $1.8 million EU-funded and EJ YMCA implemented rehabilitation program focusing on child ex-detainees. The central goal of this assignment was assessing the impact of the program on child ex-detainees, their families, and the broader communities, including educational institutions and decision-makers. The evaluation also assessed the program’s contributions to the monitoring and reporting system established under UN Resolution 1612 and the role this played in establishing an effective and efficient feedback loop. This research, and its results, generated lessons learned from program design and implementation as well as providing actionable recommendations for immediate and longer term changes to improve impact on the program beneficiaries. AWRAD adopted a mixed-method approach to the evaluation, reviewing EJ YMCA’s detainee database, project records and reports and conducted semi-structured interviews and focus groups with project stakeholders including direct beneficiaries, parents, program managers and staff, staff of educational institutions (vocational and regular public schools) involved in the program and PA institutions responsible for rehabilitation of ex-detainee children. Ethical considerations were integrated into all evaluation tools.
“M&E Baseline Youth Assessment.” International Research & Exchanges Board (IREX) – The Partnership with Youth (PwY) Program. 2014.
AWRAD worked with PwY staff to develop three assessment indicators to establish the baseline for the program which targets youth between the ages of 14-29 to assess levels of 21st century competencies, levels of participation and engagement, and gender sensitivity. AWRAD conducted a rapid assessment, a comprehensive and detailed literature review, and developed appropriate typology and definitions of these indicators and their unique circumstances within the Palestinian context. Additionally, AWRAD developed a framework to measure "21st century competencies" among youth in Palestine. AWRAD conducted a baseline, face-to-face survey of 2,900 Palestinian youth to measure these indicators. The results of both the quantitative and qualitative data collection were presented to leading IREX partners to ensure maximum comprehension and partner buy-in. A series of recommendations and concerns to be addressed were prepared in a final report.
“Assessment of Public Sector Services (A Specialized Survey of Citizens’ Satisfaction and Priorities.)" Development Alternatives Incorporated (DAI) – Effective Governance Program (EGP). 2013-2014.
AWRAD conducted an assessment of public sector services, in partnership with EGP and various Palestinian ministries. The assessment determined the factors which impact public perceptions of satisfaction of the quality of services delivered, and how these levels of satisfaction differ across different categories of service users. AWRAD identified service delivery improvement priorities across ministries and benchmarked current ministry performance against customer needs and expectations. To accomplish this goal, AWRAD prepared two surveys: a nationally representative public survey and another targeted at end users of government services which measured perceptions across 25 services across six ministries. This survey generated a Public Service Sector Satisfaction Index (PSSSI), developed from key indicators, that provides ministries and EGP with program baseline benchmarks.
“Midterm Review of the Local Governance and Infrastructure (LGI) Program.” Global Communities. 2013.
AWRAD completed the midterm review of the five year $100 million program to assess progress against program objectives and to make recommendations for ways to improve program performance for the next period of implementation. Five areas were examined including performance management, current levels of beneficiary satisfaction, project processes, program organizational structure and the outlook for the future. A mixed method approach was used throughout. Interviews and focus groups were conducted with program staff, beneficiaries, Ministry of Local Government representatives, and USAID program managers, AWRAD produced a series of midterm program recommendations aimed at improving overall program delivery to achieve program objectives by the end of the project. This review was conducted in parallel with a midline assessment of program progress against baseline data. Data from this assessment was incorporated into the midterm review.
“Gender Assessment of Local Government and Infrastructure (LGI) Program.” Global Communities. 2013.
This gender assessment focused on two distinct gender gaps within local governance. Firstly the limited representation of women as elected officials in local councils and staff within LGUs and the MoLG. Secondly, gender disparities in the provision of municipal services. AWRAD developed a mixed-methods methodology to assess the extent both of these gender gaps and provided recommendations for how LGI could increase both accessibility of and uptake by women of these services through on-going programming and implementation.
“Monitoring and Evaluation of CPP’s Impact on Civil Society and Local Governments, Civic Participation Program (CPP).” Catholic Relief Services (CRS). 2011- 2014.
AWRAD implemented a series of evaluations to gauge the $20 million USAID-funded CPP’s on-going and cumulative impact on all beneficiaries. Over a three years period, AWRAD produced regular performance and impact data for learning, decision-making and reporting purposes. The assignment included the conducting of baseline and end-line surveys, thematic studies and periodic reporting. The thematic studies focused on gender and civic participation, youth and civic participation and promoting partnership and networking. Stakeholders included NGOs, CBOs, PA ministries and local government entities. A mixed method approach was adopted throughout.
“Beneficiary Impact Assessment (BIA): Village and Neighborhood Development Project (VNDP)” World Bank, Ministry of Local Government. 2012-2013.
The BIA provided an independent evaluation of the involvement of marginalized groups in the development process in the targeted communities and the equitable distribution of the VNDP benefits, with particular focus on issues of impact of implemented activities on all project stakeholders including Joints Service Councils, District offices, and project support group members, social exclusion based on gender, vulnerability and social power. The assessment included surveys with direct stakeholders and community members in addition to in-depth interviews and focus groups. At the conclusion of the evaluation, AWRAD authored a report, complete with a series of recommendations for programming in the final phase of implementation, which could assist in meeting program goals and benchmarks.
“External Evaluation of the Project: Support to Palestinian Democrats.” Creative Associates International. 2011.
The evaluation draws lessons and implications on the broader socio-political changes in the region and how they influence best practices in the field of development and democracy promotion. The evaluation adopted a participatory interactive approach using both qualitative and quantitative data gathering tools. The following issues were emphasized: organizational capacity building level and service delivery. The research process was conducted through survey questionnaires, distributed among direct and indirect beneficiaries of the implemented activities and focus groups targeting relevant activists, officials and other individuals. A final report was authored explaining the major findings.
“Evaluation of PNGO III Capacity Building Interventions.” Palestinian NGO Development Center (NDC) and Welfare Association. 2011.
Through this World Bank funded assignment, AWRAD evaluated the capacity building interventions under the third Palestinian NGO project (PNGOIII). The objective of this study was to measure the effectiveness of NDC’s capacity building interventions under PNGOIII in bringing NDC supported NGOs and NGO networks to a higher level of capacity through a review and assessment of the different types of assistance provided in achieving positive outcomes of the capacity building interventions. The team collected the data through desk review, 100 interviews in addition to focus groups and case studies.
“Civic Engagement Program (CEP) Impact Assessment.” Tetra tech ARD (previously ARD). 2011.
The assessment aimed at determining whether the impact of CEP’s interventions differed depending on project type, location, and/or grantee type. It also examined the implications of CEP’s program design on programmatic procedure and impact, what effect existing constraints have on programmatic impact, evaluated the CEP mechanism’s capacity to cope with contextual challenges (across project types) and the comparative advantage CEP has in particular project areas and project types. Finally, it examined the relevancy of the CEP mechanism to its social and political context. These goals were accomplished through a mixed-methods research process, defined by survey questionnaires and in-depth interviews with program beneficiaries and other relevant stakeholders.
“Community Leadership Empowerment Program: Baseline.” Creative Associates International. 2010.
AWRAD carried out an evaluation of the Community Leadership Empowerment Program (CLEP) implemented by Creative Associates. The team conducted 12 focus groups with selected beneficiary organizations to gauge the impact on two primary objectives: supporting community level leadership and building community agency by increasing community participation through improvements to community spaces.
“Final Evaluation of the EU Partnership for Peace (PfP) Programme.” European Commission, Gruppo Soges SpA. 2009.
AWRAD was contracted by the Gruppo Soges SpA to conduct the final evaluation of the EC-funded EU Partnership for Peace (PfP) Programme on the basis of an independent assessment of the relevance, efficiency, effectiveness, sustainability and impact of the program. The evaluation was carried out on a sample of relevant projects implemented by Palestinian and Israeli civil society organizations in order to document lessons learned, particularly in relation to relevance and legitimacy, and to provide practical recommendations for the better design and implementation of future calls for proposals.
“Final and Midterm Evaluation of the Global Temporary International Mechanism (TIM)” European Commission (EC), Gruppo SOGES SpA. 2007 - 2008.
AWRAD, in partnership with the Belgian company Gruppo Soges SpA. and with support from the EC and TIM, conducted a midterm and a final evaluation of the €644 million Temporary International Mechanism (TIM) and its three windows (Emergency Services Support Program, Interim Emergency Relief Contribution and Social Allowances) according to the criteria of relevance, efficiency, effectiveness and impact. In conjunction with the evaluation, carried out by Mr. Francesco Badioli (Gruppo Soges SpA) and Dr. Nader Said (AWRAD), a survey of the TIM beneficiaries and a number of focus groups in the West Bank and Gaza where conducted to assess the impact of the TIM on their living conditions. The final evaluation was entrusted to the same team based on their positive performance in carrying out the midterm evaluation during 2007.
“Evaluation of the American Scholarship Fund.” AMIDEAST. 2007.
This project was an assessment of the AMIDEAST - USAID project (American Scholarship Fund Project – ASFP). The evaluation touched on the relevance, effectiveness and impact of the project, with a specific focus on its efficiency - procedures, staffing, indicators, criteria and transparency. AWRAD utilized a multi-approach data collection and analysis methods, with a focus on existing databases and qualitative in depth interviews and case studies. AWRAD interviewed families, school directors and other staff in the various WBG regions. The analyses included a database file of 10,000 cases collected by AMIDEAST.