Crowdsourcing malaria parasite quantification: an online game for analyzing images of infected thick blood smears

Background: There are 600,000 new malaria cases daily worldwide. The gold standard for estimating the parasite burden and the corresponding severity of the disease consists in manually counting the number of parasites in blood smears through a microscope, a process that can take more than 20 minutes of an expert microscopist’s time. Objective: This research tests the feasibility of a crowdsourced approach to malaria image analysis. In particular, we investigated whether anonymous volunteers with no prior experience would be able to count malaria parasites in digitized images of thick blood smears by playing a Web-based game. Methods: The experimental system consisted of a Web-based game where online volunteers were tasked with detecting parasites in digitized blood sample images coupled with a decision algorithm that combined the analyses from several players to produce an improved collective detection outcome. Data were collected through the MalariaSpot website. Random images of thick blood films containing Plasmodium falciparum at medium to low parasitemias, acquired by conventional optical microscopy, were presented to players. In the game, players had to find and tag as many parasites as possible in 1 minute. In the event that players found all the parasites present in the image, they were presented with a new image. In order to combine the choices of different players into a single crowd decision, we implemented an image processing pipeline and a quorum algorithm that judged a parasite tagged when a group of players agreed on its position. Results: Over 1 month, anonymous players from 95 countries played more than 12,000 games and generated a database of more than 270,000 clicks on the test images. Results revealed that combining 22 games from nonexpert players achieved a parasite counting accuracy higher than 99%. This performance could be obtained also by combining 13 games from players trained for 1 minute. Exhaustive computations measured the parasite counting accuracy for all players as a function of the number of games considered and the experience of the players. In addition, we propose a mathematical equation that accurately models the collective parasite counting performance. Conclusions: This research validates the online gaming approach for crowdsourced counting of malaria parasites in images of thick blood films. The findings support the conclusion that nonexperts are able to rapidly learn how to identify the typical features of malaria parasites in digitized thick blood samples and that combining the analyses of several users provides similar parasite counting accuracy rates as those of expert microscopists. This experiment illustrates the potential of the crowdsourced gaming approach for performing routine malaria parasite quantification, and more generally for solving biomedical image analysis problems, with future potential for telediagnosis related to global health challenges.

The road to e-services: online and mobile games as enablers

Institute for Prospective Technological Studies Mission: - to provide customer-driven support to the EU policymaking process - by developing science based responses to policy challenges - having both socio-economic and scientific /technological dimension.

Innovación educativa en las redes sociales online: un estudio en la educación superior

Las redes sociales son tan antiguas como las relaciones entre los humanos, ya que las labores de cooperación siempre fueron imprescindibles en los procesos de asociación, tanto los formados por simples células hasta los constituidos por seres vivos. La sociedad está formada por una gran cantidad de situaciones que fomentan dicha colaboración. Desde la creación del Espacio Europeo de Educación Superior se ha promovido la utilización de entornos virtuales de aprendizaje que favorezcan una evaluación más transparente y objetiva. Las redes sociales online son las interfaces digitales más utilizadas por los estudiantes universitarios, por lo que son muchos los expertos que recomiendan analizar la utilidad educativa de este tipo de aplicaciones. Siguiendo estas recomendaciones se implementó una red social online, llamada Formatio, que se utilizó para apoyar el proceso de enseñanza y aprendizaje en la educación superior. El objetivo general de esta tesis doctoral fue valorar el nivel de aceptación de este entorno virtual de aprendizaje para los estudiantes universitarios que participaron en este estudio. Para evaluar el uso de la plataforma se analizaron las actividades generadas por los 172 estudiantes, seleccionados aleatoriamente, matriculados en la asignatura de Estadística y TIC en el curso 2010/2011, del Grado en Ciencias de la Actividad Física y el Deporte. Con el objetivo de estimar la utilidad educativa de las redes sociales online se diseñó y validó el instrumento de Valoración de Recursos Educativos Online (VREO), que fue aplicado a otra muestra aleatoria de 452 estudiantes de la misma facultad durante el curso 2011/2012. Los resultados confirman el éxito de este tipo de espacios virtuales gracias a la alta frecuencia de uso conseguida y a las buenas puntuaciones obtenidas por los alumnos, quienes tienen una buena opinión sobre las ventajas de usar las redes sociales online en la educación superior. De todos los recursos analizados la red social online Formatio ha sido la opción mejor valorada, seguida de Moodle y Facebook en segundo y tercer lugar, y de Twitter y YouTube, en cuarta y en quinta posición. Este estudio establece un punto de partida para futuras investigaciones encaminadas a obtener ciertos indicadores cualitativos y cuantitativos que faciliten una evaluación más justa de los actores integrantes de los sistemas educativos, que ayude a abrir las puertas de nuestra sociedad a la responsabilidad, la eficiencia, la transparencia y la objetividad. ABSTRACT Social networks are as old as human relations, since cooperative work has always been indispensable in all processes of association, from those composed of simple cells to those formed by living beings. Society is shaped by a large amount of situations that stimulate this cooperation. Since the creation of the European Higher Education Area, the use of virtual learning environments that favor more transparent and objective evaluation has been promoted. On-line social networks are the digital interfaces most widely used by university students, which is the reason why many experts recommend an analysis of the educational utility of this type of applications. Following these recommendations, an on-line social network called Formatio was created, which was used in order to support the teaching and learning process in higher education. The general objective of this doctoral dissertation was to evaluate the level of acceptance of this virtual learning environment by the university students who participated in this study. In order to evaluate the use of the platform, the activity created by 172 students chosen at random was analyzed; they were registered in the course on Statistics and Information and Communication Technology of the degree program in Sciences of Physical Activity and Sport during the academic year 2010/2011. With the goal of appraising the educational utility of on-line social networks, a tool for Evaluation of On-line Educational Resources (EOER) was designed, validated, and applied to another random sample of 452 students from the same department during the academic year 2011/2012. The results confirm the success of this type of virtual spaces, thanks to the high frequency of use achieved and the good grades obtained by the students who had a favorable opinion of the advantages of using on-line social networks in higher education. Out of all the resources analyzed, the Formatio on-line social network was the option that received the best evaluation, followed by Moodle and Facebook, which were second and third, and Twitter and YouTube, in fourth and fifth place respectively. This study establishes a starting point for future research that aims to obtain certain qualitative and quantitative indicators that will make it easier to engage in a fairer evaluation of the parties involved in education systems, which will help open the doors of our society to responsibility, efficiency, transparency, and objectivity.

OnToology: An online tool for ontology documentation and evaluation

In this thesis, we designed and implemented an online tool (named "OnToology") to automatically generate documentation and perform evaluation for ontologies. It is also integrated with GitHub version control system to support collaborative environments.