“M&E is not a desk job”: 5 Myths About Remotely Managing Monitoring and Evaluation
“M&E is not a desk job”: 5 Myths About Remotely Managing Monitoring and Evaluation
By Anvesha Punjani, Good Return Program Impact and Effectiveness Manager
In this era of remote work, Monitoring and Evaluation (M&E) teams often find themselves managing projects from a distance - constrained by limited budgets, travel restrictions, and the sheer scale of operations. We heavily rely on our local teams to act as our eyes, ears, and documenters. However, what's readily apparent to the local team might not be as obvious to the remote manager, potentially impacting program effectiveness. Here are some key myths for effectively managing M&E from a distance:
1. “Country staff can do the field work/monitoring ….I don't need to go myself.”
M&E is not a desk job. While a strong local team is invaluable, firsthand observation is crucial. Direct engagement with the program and beneficiaries provides invaluable insights that cannot be fully captured through reports. I cherish my early career as a field researcher, traveling extensively across India and Cambodia. These experiences instilled in me the importance of direct observation. When I first visited Indonesia and met with chili farmers, I gained a deeper understanding of the challenges they faced. Observations and firsthand experiences shape your understanding and inform your analysis in ways that simply reading reports cannot. Whenever possible, dear peeps if and when possible do your monitoring visits or join the evaluation teams not all tasks can be done in the online mode.
2. “Qualitative data collection can be done by anyone.”
Like me, you must have also felt the mammoth task of dealing with the qualitative data at times. It is more complex than it might seem. Without proper training and experience, data collection can be biased and unreliable. If your qualified M&E team cannot conduct the data collection, ensure you identify and train the most suitable personnel.
Furthermore, emphasize the need for detailed transcripts, not just notes. This includes observations and notes from the moderator and note-taker (if applicable).
3. “How hard can questionnaire training be?”
Enumerator training is critical for data quality. We invest significant time in designing, testing, and analyzing questionnaires. However, the success of data collection hinges on well-trained enumerators. Here are bonus four cents.
Assume nothing: Ensure the questionnaire is culturally appropriate, translated accurately, and back-translated for verification (as needed).
Prioritize training: Actively participate in the selection and training of enumerators. Address potential challenges proactively, such as enumerators filling out questionnaires under different trees (to circumvent GPS tracking) or simply providing "right" answers instead of capturing genuine respondent feedback.
Invest in training: Develop comprehensive training manuals and provide adequate support to the training team. Conduct field training sessions and gather feedback from trainees.
Language proficiency: Ensure the master trainer is fluent in both the language of the questionnaire and the language spoken by the respondents.
4. “I don't use jargon!”
We often fall prey to jargon and let me also add acronyms in this list. We want to do everything ASAP*. MRW* I see them is "grrr, one more thing to look up!"
To ensure clarity and accessibility, strive for concise and jargon-free communication. Have colleagues review your work, including those outside the M&E field, to ensure your language is easy to understand.Like this post will be reviewed by someone from my team to get a fresh look and feedback.
5. “I can do the data interpretation on my own”.
Data interpretation can be subjective and prone to bias. Individual perspectives can inadvertently overlook crucial details. I recommend utilizing a collaborative approach, such as "Data Parties" (as described in the USAID Learning Lab article: "Data Parties: Making Data Reviews Fun, Effective, and Impactful").
Facilitate team reviews, conduct workshops when possible, and encourage peer-to-peer validation of findings. Online platforms can be effectively used to facilitate these collaborative reviews.
By addressing these common misconceptions and implementing these best practices, you can effectively manage M&E remotely and ensure the success of your programs.
*ASAP - As soon as possible
* MRW- my reaction when