Download Study

General

Study Overview

Title:

MSE Festival Follow-Up Study (USAID LENS)

Study is 3ie funded:

No

Study ID:

RIDIE-STUDY-ID-5b4f009e5776a

Initial Registration Date:

07/18/2018

Last Update Date:

07/18/2018

Study Status:

In Development

Location(s):

Jordan

Abstract:

The USAID Jordan Local Enterprise Support Project (USAID LENS) is a five-year project to encourage the long-term economic growth and development potential of underserved Jordanian communities. One of main activity areas at LENS falls under building a better business environment through targeted support to Local Development Units (LDUs) and municipalities for Local Economic Development. LENS organized 7 MSE Festivals in partner municipalities to increase the engagement of the LDUs with MSEs and local partners in their community (see intervention section for details). The present study aims to interview MSE participants of the festivals (owners and employees) through telephone calls to: (1) Capture the change MSE participants’ satisfaction of their LDUs (whether satisfaction endured after the festivals); (2) Compare the level of LDU satisfaction for MSEs who attended the festivals against those who did not attend. (3) Assess whether participation in festivals resulted to higher engagement with BSPs compared to MSEs who did not participate.

Registration Citation:

Hellwig, R.P. and Rakkad, H., 2018. MSE Festival Follow-Up Study (USAID LENS). Registry for International Development for Impact Evaluations (RIDIE). Available at: 10.23846/ridie149

Categories:

Private Sector Development

Additional Keywords:

MSE, SME, microenterprise, LENS, USAID, FHI 360, LDU, Festival, NPS, Net Promoter Score

Secondary ID Number(s):

Principal Investigator(s)

Name of First PI:

Rafael Pilliard Hellwig

Affiliation:

FHI 360 / USAID Local Enterprise Support Project (LENS)

Name of Second PI:

Hiba Rakkad

Affiliation:

FHI 360 / USAID Local Enterprise Support Project (LENS)

Study Sponsor

Name:

USAID Jordan

Study Sponsor Location:

Jordan

Research Partner

Name of Partner Institution:

Type of Organization:

Location:

Intervention

Intervention Overview

Intervention:

USAID LENS organized seven MSE Festivals in partner municipalities to increase the engagement of the Local Development Units (LDUs) with micro- and small enterprises (MSEs) and community partners. The festivals were designed as one-day events that featured business training, ‘diagnose your business’ coaching sessions, and interaction of local NGOs, BSPs and CBOs who promoted their services to MSEs in an public fair. The festivals further promoted several USAID LENS tools and publications designed to help businesses, including the MSE Toolkit, the Start-Up Guide, and the Legal Awareness Kit. Taken together, the objective of the support was to position LDUs as a resource base and economic development agent for MSEs in partner communities.

Theory of Change:

IF Local Development Units (LDUs) host MSE Festivals within their municipalities to deliver training content to enterprises; THEN LDUs will have a stronger network of MSEs familiar with their services; THEN LDUs will have gained experience and competence in delivering trainings, resources, and networking opportunities to MSEs; THEN LDUs will enhance their community services thereby acting as better resource to MSEs, leading to enhanced outreach and linkages; THEN the MSE participant satisfaction with LDUs will increase with time; THEN MSEs engagement with LDUs will increase, and LDUs will be recognized as a resource for business startup and growth.

Multiple Treatment Arms Evaluated?

No

Implementing Agency

Name of Organization:

FHI 360 / USAID Local Enterprise Support Project (LENS)

Type of Organization:

NGO (International)

Program Funder

Name of Organization:

USAID Jordan

Type of Organization:

Foreign or Multilateral Aid Agency

Intervention Timing

Intervention or Program Started at time of Registration?

No

Start Date:

07/02/2018

End Date:

07/08/2018

Evaluation Method

Evaluation Method Overview

Primary (or First) Evaluation Method:

Other (specify)

Other (not Listed) Method:

Simple Difference Estimator

Additional Evaluation Method (If Any):

Regression with controls

Other (not Listed) Method:

Method Details

Details of Evaluation Approach:

For hypothesis #1, the design follows a one-group pre/post design that will be analyzed with a simple difference estimator (t-test). If possible, the procedure will use a paired analysis, though substantial non-response from phone interviews may dictate an independent samples approach and/or censored regression. For hypotheses #2 and #3, the design follow a quasi-experimental approach that compares the impact between beneficiaries and non-beneficiaries. The comparison group is taken from the USAID LENS survey of micro- and small-enterprises, a complex sample drawn from the same target governorates as the intervention. The survey instrument includes questions that are phrased in the same way as the telephone survey and capture similar constructs. Since the survey is strongly rooted in design-based inference, the comparison sample is representative of the wider population of MSEs and is design-unbiased.

Outcomes (Endpoints):

The primary questions/variables being assessed are: 1. On a scale of 1 to 10, how likely are you to recommend your Local Development Unit (LDU) to a friend or colleague? 2. Have you received any services from the Business Service Providers that participated the festival? 3. Were you able to apply any of the skills or topics addressed at the MSE Festival? ??4. Have you engaged with your Local Development Unit (LDU) after the festival? See survey instrument (attached) for details.

Unit of Analysis:

Micro/Small Enterprise

Hypotheses:

Primary Hypotheses: 1. Using y1 and y2 to denote the NPS score measured at timepoints (1) and (2), the H0 and H1 can be expressed as: Null hypothesis (H0): y2 - y1 = 0 (no difference) vs. Two-sided alternative hypothesis (H1): y2 - y1 != 0 (difference). 2. Using y1 and y2 to denote the NPS score measured at the MSE festivals and MSE survey respectively, the H0 and H1 can be expressed as: Null hypothesis (H0): y2 - y1 = 0 (no difference) vs. Two-sided alternative hypothesis (H1): y2 - y1 != 0 (difference). Secondary Hypotheses: The hypotheses H0: p1 - p2 = 0 vs. H1: p1 - p2 != 0 will be used to test the for differences against external benchmark values for similar constructs measured in the wider population of Jordanian MSEs (as per USAID LENS’ MSE survey): 3. The proportion p1 of MSE participants who have received services from Business Services Providers (BSPs), vs. the benchmark p2 of MSEs who received such services (Q311 from the MSE survey). We set alpha at .05 for all statistical procedures. A Holm adjustment will be made to the p values to control the false discovery rate from repeated testing.

Unit of Intervention or Assignment:

N/A (No randomization of treatment)

Number of Clusters in Sample:

7 Festivals

Number of Individuals in Sample:

225 Micro- and Small-Enterprises

Size of Treatment, Control, or Comparison Subsamples:

Intervention Group: 225; Comparison Group (MSE Survey): 1691

Supplementary Files

Analysis Plan:

Other Documents:

Data

Outcomes Data

Description:

MSE Follow-up Study: The principal dataset will be assembled from telephone interviews conducted in July 2018 (see attached questionnaire). The dataset will include answers to each of the 5 questions in the questionnaire, as well as demographic information about participants collected during the festivals.

Data Already Collected?

No

Data Previously Used?

Data Access:

Data Obtained by the Study Researchers?

Data Approval Process:

Approval Status:

Treatment Assignment Data

Participation or Assignment Information:

No

Description:

Other datasets used for hypotheses #2 and #3 (already existing): 1. MSE Festival Exit Survey: A survey conducted at each festival as participants left the venue. The questionnaire includes Net Promoter Score. 2. MSE Survey: The USAID LENS survey of micro- and small-enterprises (MSEs) captures representative data for the wider population of MSEs in the same governorates as the festivals. For more details on the questionnaire and methodology, see https://osf.io/6dprb/

Data Obtained by the Study Researchers?

Yes

Data Previously Used?

No

Data Access:

Restricted -- Access requires a formal approval process

Data Obtained by the Study Researchers?

Data Approval Process:

The MSE survey is open data and can be accessed at http://jordanlens.org/research. The 2018 wave of data is not yet available, but will be released shortly. The MSE festival exit survey is currently an internal dataset. Please email Rafael Pilliard Hellwig (rphellwig@jordanlens.org) to initiate a request for its use.

Approval Status:

Yes-obtained approval and have received the data

Data Analysis

Data Analysis Status:

Study Materials

Upload Study Materials:

Survey Instrument: MSE Festival Follow-Up Questionnaire (V1.1).pdf

Registration Category

Registration Category:

Prospective, Category 1: Data for measuring impacts have not been collected

Completion

Completion Overview

Intervention Completion Date:

Data Collection Completion Date:

Unit of Analysis:

Clusters in Final Sample:

Total Observations in Final Sample:

Size of Treatment, Control, or Comparison Subsamples:

Findings

Preliminary Report:

Preliminary Report URL:

Summary of Findings:

Paper:

Paper Summary:

Paper Citation:

Data Availability

Data Availability (Primary Data):

Date of Data Availability:

Data URL or Contact:

Access procedure:

Other Materials

Survey:

Survey Instrument Links or Contact:

Program Files:

Program Files Links or Contact:

External Link:

External Link Description:

Description of Changes:

Study Stopped

Date:

Reason: