About the job

Bixal will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. If you require any accommodation as part of our recruitment process, please contact us at [email protected]. You can expect a response from a team member within 24 hours during the regular work week and on the next operating day during the weekend or holidays.

Background 

The USAID Learning for Development Activity is a 5-year program led by Bixal Solutions, Inc. that provides USAID/Nepal with technical and advisory services in planning, designing, conducting, and learning from the monitoring and evaluation of the Mission's strategies, projects, and activities in an efficient manner. USAID Learning for Development supports USAID/Nepal by providing services including a) learning and knowledge management; b) evaluations, assessments, and other studies; c) performance monitoring technical support; d) capacity building; and e) development outreach and communications support.

What will you do?

USAID Learning for Development seeks a consultant with expertise in student assessment and educational governance to support the baseline study of the USAID Equity and Inclusion in Education Activity. The USAID Equity and Inclusion Activity aims to improve equitable education outcomes for marginalized youth in grades 6-10. The Activity supports local governments in bringing out-of-school children into school, increasing retention of learners through grade 10, and ensuring equitable and quality learning opportunities for marginalized youth. The Activity is being implemented in Madhesh and Karnali Provinces and will support community schools that have grade 6-10 classes. The Activity has three objectives:

•  Reduce barriers to access and retention in grades 6-10
•  Improve the quality of education for marginalized students in grades 6-10
•  Ensure quality implementation of disbursement-linked indicators related to equity and inclusion activities under the Ministry of Education, Science, and Technology's School Education Sector Plan

The baseline evaluation will adopt multi-methods, encompassing secondary data analysis, primary data collection to establish baseline learning outcomes (including the design or adaptation of suitable assessment instruments), and qualitative methods to dig out barriers to education for marginalized groups, as necessary.

A feasibility study to explore designs for the assignment was completed in the last week of May. Based on the workshop with stakeholders and the nature of the intervention, an impact evaluation is anticipated, considering the government's interest and the potential for new program interventions with future expansion and policy implications. Drawing from past experiences in education research in Nepal, the modality will employ a Quasi-Experimental design with the Difference-in-Differences (DiD) approach, along with assessments of the Knowledge, Attitudes, and Practices (KAP) of students, teachers, headteachers, and School Management Committee (SMC) members. Additionally, qualitative study designs are planned as part of the study.

Objectives of the assignment

The team is led by two assessment co-leads: an international and a national team leader. The team has already mapped indicators for the baseline study and submitted a feasibility study report outlining potential options for the Activity's baseline study.

This Scope of Work details the anticipated involvement of the additional team member in designing and implementing the baseline study, encompassing activities related to the baseline assessment. Responsibilities include reviewing the design report, assisting in the IRB process, assisting in the developing, translating, and validating of qualitative and quantitative tools, creating student assessment tools for grade 8 in mathematics and language, creating enumerator training manuals, facilitating enumerator training sessions, coordinating data collection efforts, and subsequently reviewing data analysis and report writing. All work is to be done in close cooperation with the evaluation team and the Government of Nepal.

Roles and Responsibilities:

The Evaluation team member will provide technical support across all study phases, encompassing design, execution, and reporting. This role involves close collaboration with the USAID Learning for Development evaluation team, focusing on the design and implementation of the baseline study. The person will coordinate with co-team leads for overall technical guidance and reports to the Sr. Evaluation and Research Lead, USAID Learning for Development.

The team member will review the baseline assessment design report in the initial phase. They will also lead the development of some tools and methodologies essential for the study. An important aspect of the role involves liaising with government counterparts, including the Ministry of Education, Science, and Technology, and the Education Review Office, to ensure alignment and compliance with national standards and requirements. The team member will also lead the coordination efforts with the relevant education government agencies at the provincial and local levels.

During the execution phase, the team member will take the lead in training enumerators, overseeing the data collection process, and ensuring the accuracy and reliability of the data gathered. Their responsibilities extend to co-developing the final report, co-presenting findings, and conducting stakeholder consultations to communicate results effectively and gather feedback.

The performance timeline for the baseline study is scheduled to commence on 8th July, 2024, and extend through the end of October 2024, spanning approximately three and a half months. Throughout this period, the team member's engagement will necessitate a total level of effort (LoE) of up to forty (40) days. This structured involvement ensures a focused and effective contribution to the study's successful completion.

Responsibilities and Deliverables: 

The member will support the entire process of the baseline study, which specifically includes the following:

• Provide support and review for the design report. 
• Collaborate with the Education Review Office (ERO) to develop, pilot, and validate the student assessment tool and guidelines and develop the overall framework, including reviewing the existing frameworks, developing new test item banks, equating pilot tests, and piloting the quantitative learning assessment. 
• Working with the Team Leads and ERO to review Knowledge, Attitudes, and Practices (KAP) tools and other quantitative tools related to schools and stakeholders. 
• Assist in developing, reviewing, translating, and contextualizing qualitative tools. 
• Lead the student assessment data collection process (review of frameworks, create items, pilot tests, and equate items) in close collaboration with the ERO and Team Leads. 
• Prepare the student assessment report and support the development of other reports. 
• Provide additional necessary support as required to accomplish the baseline study for the USAID Equity and Inclusion in Education Activity. 

Deliverables:

Throughout the baseline study period, the Evaluation team member will engage in various key activities:

•  Weekly/bi-weekly, as needed, check-in meetings with the Learning for Development team to ensure alignment and progress tracking. 
•  Facilitate the development and approval process for the student assessment tool by the Education Review Office (ERO) subject committee. 
•  Develop training materials/manuals and guidelines and facilitate training for the data collection team in collaboration with the in-country co-team lead. 
•  Working with team leads, finalize Knowledge, Attitudes, and Practices (KAP) tools to be used in data collection. 
•  Write the student assessment report and support the development of other reports. 
•  Conduct presentations and workshops with USAID and the Learning for Development team to share and discuss initial findings, fostering collaboration and feedback. 
•  Assist in compiling the final Evaluation report, incorporating feedback and additional analysis as needed, and preparing a presentation slide deck for the final presentation. 

Knowledge and Qualification: 

Qualifications for the position of Student Assessment and Education Management Study Expert include:

• Master's degree in education, focusing on education governance or related fields. 
• Over seven years of experience collaborating with government entities at central, provincial, and local levels in education governance. 
• Proven track record in student assessment, including item development, piloting, equating, and finalizing instruments. 
• Demonstrating expertise in assessment methodologies. 
• Strong government liaison skills and understanding of education governance procedures. 
• Experience conducting workshops, particularly in large-scale assessment enumerator training and data quality assurance. 
• Fluent in Nepali and English

Timeline and Level of Effort (LoE)

The assignment will be for up to 40 days of LOE. The work performance duration will be from 8th July to end of October 2024. Please note that these are only estimates. So long as the Consultant adheres to the overall LOE ceiling, the days can be used as needed.

All roles at Bixal will:

• Participate in client events and forums to positively represent the organization and develop and maintain relationships with the industry. 
• As appropriate, play an active role in new client acquisition by supporting business development initiatives to enhance and grow Bixal's business in each of the areas that it works. 

Please note that candidates selected may undergo a background investigation and, if applicable, meet eligibility requirements for suitability.

Bixal is an equal opportunity and affirmative action employer. It ensures equal employment opportunity without discrimination or harassment based on race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, age, disability, national origin, marital or domestic/civil partnership status, genetic information, citizenship status, veteran status, or any other characteristic protected by law. We are dedicated to promoting diversity, equity, and inclusion within our organization and beyond.