Webazma crowdsourcing platform

Crowdsourcing refers to a way of dividing a complex task into a number of tiny and identical sub-tasks and distributing sub-tasks between crowds of unknown people with different skills and experiences. In recent years, with the advent of the internet, this method of accomplishing complex tasks attains lots of attraction. Webazma, is a laboratory resides within the Iran Telecommunications Research Center (ITRC), whose aim is to evaluate Persian web-based services. Considering the fact that the primary reference for evaluating a web-based service is its customers, Webazma concentrates on human-based evaluations, and thus, setup a crowdsourcing framework for executing such evaluations using unknown crowds. Thus far, many different evaluations have been carried out within this framework. Furthermore, the framework has been designed in such a way that it can run variety of tasks, other than required by the laboratory. These are dataset generation, especially for deep learning purposes, confirming datasets, creating audio books, executing online surveys, and digitizing old documents to mention a few. This paper aims at introducing this framework and its capabilities with the goal of encouraging researches, companies, and other organizations to exploit it for accomplishing their complex tasks; those which require human workforces.