Saturday, January 14, 2012

Assignment 1-Program Evaluation


Assignment 1-Program Evaluation

I had heard of a program called One Laptop Per Child (OLPC) through a pilot project I am part of with our school division.  I know that this program is meant for students who live in countries where technology is not easily attainable.  I do think that the goals of my program are similar in that we are trying to engage students, and improve their education.  I found a program evaluation done on the OLPC in Peru that was published in 2010.
Nicholas Negroponte was the founder of OLPC whose goal was to create affordable laptops to put into the hands of students in least developing countries.  He wanted to give them the opportunity to use technology to improve their education.
            Inter-American Development Bank (IDB) published a report in 2010, evaluating a program adopted by the Peruvian Government called One Laptop Per Child (OLPC).  IDB is the largest source of development financing for Latin America and the Caribbean, with a strong commitment to achieve measurable results” (http://www.iadb.org/en/about-us/about-the-inter-american-development-bank,5995.html
            I believe Scriven’s model was used in this program evaluation.  My only reservation around this is that it is not clear whether or not the authors knew beforehand the goals of the Peruvian government in relation to this project.  An assessment was developed in agreement between IDB and the Peruvian Ministry of Education (MINEDU).
            The program evaluation had both formative and summative evaluation as it had developed surveys to see how the program had impacted various groups of people including, teachers, students, parents and administrators.  It also investigated how to improve the program in Peru. 
            As in Scriven’s model, formative assessment was used through qualitative and quantitative data analysis. 
            The qualitative study provided information three months into the program from both schools that had and had not received laptops.  The information obtained provided the ability “to explore the impact on the attitudes, practices, and perceptions of the principals, teachers, students, parents, as well as to document the implementation process and explore the experiences, reactions and results of the distribution of computers.”(p.4)
            The quantitative study compiled data gathered from students, parents, teachers and principals.  The information was obtained through student testing and interviews, family, teacher and school principal questionnaires, as well as classroom observations. 
            In 2009 surveys were used to evaluate the program in selected schools that had been designated for the OLPC program.  As this was done in November, the majority of the schools that were being used in the evaluation process had only received their computers three months prior.  Therefore, the authors used the survey to gather data for short-term results to be used for future visits scheduled in October and November of 2010. 
            Through summative evaluation, strengths and weaknesses of the program were defined.  They found students and families were scared to take the laptops home in case they were to cause damage. Teaches initially felt inadequately trained and through the evaluation additional training could be provided.
            I found the evaluation to be very thorough.  By having its own objectives, the authors were able to create a document that will be useful for the program in Peru as well as other programs like this one, in South America.  The evaluators created a logical way to measure what affect the program had on those schools chosen and how those objectives were or were not being met.  Not only did the evaluation allow for an analysis into whether or not objectives were being achieved, but also how to initiate improvements to the program for future school involvement and improving the experience of those currently participating in the program.
            As far as weaknesses, I was not able to identify very many in the evaluation.  One concern I would have would be the possible premature analysis and evaluation. Is three months enough time to properly work with computers?  Another would be around the technology piece.  I felt that there should have been a stronger emphasis placed on technical support.

References

Inter-american Development Bank: http://idbdocs.iadb.org/wsdocs/getdocument.aspx?docnum=35422036
Click here for evaluation

1 comment:

  1. Good choice for your evaluation Kelly. The evaluation is very thorough and involves most of the important stakeholders in the program. It clearly lays out the goals of the program and collects data related to these goals. I agree that is it very formative in its approach. I think that future evaluations of the program will provide more useful data. Early on people are still excited and outcomes are viewed through a more positive lense. One weakness I would point out is that they do not make any recommendations. The authors provide data but they do not suggest any actions to be taken by those administering the program

    ReplyDelete