3 a variant of outsourcing moderation you should know
If you have done almost fesbuk, and thousands of users started to share pictures, posts and comments, then over time you will find in the tape of the little girl Sweet photo long strong male reproductive organ. And understand that our rules are fine, but to monitor their implementation still will have.
In this article we will talk about what solutions for the moderation of the content exist today. During our market research we found a considerable number of companies offering their services. We tried to classify them, to describe their advantages and disadvantages.
The entire market can be divided into 3 groups:
the
Let's look a little more all 3 groups.
A large part of the market makes these companies. Some of them spetsializiruyutsya only on the moderation of content, but most often it is and call-center services, and technical support, and much more.
Here are some of them:
the
We believe that the number of such companies is determined by the availability of cheap labor in the same Thailand, the Philippines, India and so on. Hence the low skill level of employees, and the high price of moderation of content in languages other than English.
And to use the services of such companies, You'll need several things:
the
The second category of companies has gone further in studying the problems of moderation of content and provides its own technical solutions, including:
the
Perhaps the most outstanding representative of this class is Crisp Thinking (http://crispthinking.com).
This category seems much more attractive: the staff is already trained and is familiar with the common problem of moderation; they work with their own software, and therefore well acquainted with him; API and SDK documented and it is assumed that the client should handle the integration.
However, all is not well. Initial integration involves the creation of rules of moderation. And here the problems begin.
Of course, after all the difficulties and finish the integration of the project completely forgets about moderation — content automatically goes into the moderation system, the results come automatically and processed by a client app... will only every month to top up the balance sum...
During the market research we have found companies that fully automatiseret process of content moderation, i.e. without participation of the people. One of the typical representatives is Keepcon (http://keepcon.com/).
Automatic moderation of course cheaper manual, but has many problems. Moderation without manual control without checks real people is inefficient.
First, it is difficult algorithmically to calculate the text that do not contain curse words, but has an unacceptable character. For example, “a Charming fairy will meet good gentleman in their apartment at metro Schukinskaya” or hundreds of sophisticated phrases about selling drugs, such as “Hedgehog. Raccoon. Speed. Salt. SMS 8 901 *** ***** ”, for which you can fairly quickly get acquainted with the representatives of law and order. Now add to this the support of at least five languages. But ten!?..
The situation with images worse: the algorithms for facial recognition and recognition of photos of an erotic nature today is imperfect. Even in “laboratory” conditions, they give unstable results, and in the “field” conditions have too high percentage of errors.
Second, in most cases, we need to consider the business logic of a specific project: for example, there must be only personal photos of a particular user, with a clearly distinguishable face. Automatic moderation mode suffers here fiasco — take into account the subjective factor of the machine is not learned, this can only real people.
Our experience and the experience of other projects suggests that automatic approval is only good as a pre-filter that can weed out the clearly poor quality of the content.
Technical description of existing solutions we have done. Now let's get to the fun part: compare the prices!
We wanted to provide You not just dry numbers, but to show the prices for example a specific project. As a result, we have contacted most of the leading companies on the market, and all asked one and the same task: you need to check per month 200,000 pieces of content (photos, statuses, names) for 4 languages.
Let's see what happened:
the
the Source Fit
the
the MicroSourcing
the
the Moravia
the
the Crisp Thinking
the
However, all the companies quite a clear approach to add another language: “pay for each separately.” Thus, if instead of 4 languages have 8, then the price tag for the month will increase in 2 times. In the end, 32 language ICUC will cost per month to 0.9 million dollars. Awesome!
In the study we attempted not only to classify existing firms. We tried to proceed from the role of the project model, generating UGC, social mobile app. And our challenge was finding easy, inexpensive method of moderation of content that will not require much time to integrate with existing code.
So, You have a growing audience of project, You want a turnkey solution, which can be connected within a few days, and forget about the problem with the test content, personnel, development, admin? From all the above fits You, apparently, only Crisp Thinking, but cook the$ 25,000 a month.
Of course, this article is written not just so, and to draw attention to the problem of moderation and our service of content moderation 2Hive.org.
Once we have our own need in the moderation of content and 2Hive.org originated as a way to solve it. First and foremost we wanted to make the service very easy to use, and secondly a budget. And both requirements we have fulfilled. And how, read our future columns.
Article based on information from habrahabr.ru
In this article we will talk about what solutions for the moderation of the content exist today. During our market research we found a considerable number of companies offering their services. We tried to classify them, to describe their advantages and disadvantages.
The entire market can be divided into 3 groups:
the
-
the
- the Provision of personnel; the
- Integrate in your project SaaS the
- Moderation with algorithms (robots)
Let's look a little more all 3 groups.
type 1: All staff
A large part of the market makes these companies. Some of them spetsializiruyutsya only on the moderation of content, but most often it is and call-center services, and technical support, and much more.
Here are some of them:
the
-
the
- ICUC (http://www.icucmoderation.com) the
- MicroSourcing (http://microsourcing.com) the
- Moravia (http://moravia.com)
We believe that the number of such companies is determined by the availability of cheap labor in the same Thailand, the Philippines, India and so on. Hence the low skill level of employees, and the high price of moderation of content in languages other than English.
And to use the services of such companies, You'll need several things:
the
-
the
- the Presence of its own. To ensure that You hire staff directly involved in moderation, You will need to write environment/software application/web interface, which, apparently, is a list of unverified content, and the moderators will push some buttons. the
- Training of staff. Yes, that's right: the companies say that before starting work You should hold a seminar and give professional instructions. And all of this at Your expense! the
- Most companies of this kind require that You have a timetable for the work of the moderators, especially given time zones and relevant languages.
If to speak a simple language, such companies it's a big hangar on the outskirts of the Indian city full of old computers and poor Hindus, the managers of which are willing to place staff anywhere, if only it paid money. About the quality can not speak.
TYPE2: Integrated into your SaaS project
The second category of companies has gone further in studying the problems of moderation of content and provides its own technical solutions, including:
the
-
the
- API and SDK for integration the
- Own panel moderation, which employs their own staff the
- automatic validation of the content the
- private office for clients, where you can see reports, graphs, Analytics, etc.
Perhaps the most outstanding representative of this class is Crisp Thinking (http://crispthinking.com).
This category seems much more attractive: the staff is already trained and is familiar with the common problem of moderation; they work with their own software, and therefore well acquainted with him; API and SDK documented and it is assumed that the client should handle the integration.
However, all is not well. Initial integration involves the creation of rules of moderation. And here the problems begin.
most companies the process of integration API is so complicated that it may take a few weeks!
Of course, after all the difficulties and finish the integration of the project completely forgets about moderation — content automatically goes into the moderation system, the results come automatically and processed by a client app... will only every month to top up the balance sum...
Type3: Robots
During the market research we have found companies that fully automatiseret process of content moderation, i.e. without participation of the people. One of the typical representatives is Keepcon (http://keepcon.com/).
Automatic moderation of course cheaper manual, but has many problems. Moderation without manual control without checks real people is inefficient.
First, it is difficult algorithmically to calculate the text that do not contain curse words, but has an unacceptable character. For example, “a Charming fairy will meet good gentleman in their apartment at metro Schukinskaya” or hundreds of sophisticated phrases about selling drugs, such as “Hedgehog. Raccoon. Speed. Salt. SMS 8 901 *** ***** ”, for which you can fairly quickly get acquainted with the representatives of law and order. Now add to this the support of at least five languages. But ten!?..
The situation with images worse: the algorithms for facial recognition and recognition of photos of an erotic nature today is imperfect. Even in “laboratory” conditions, they give unstable results, and in the “field” conditions have too high percentage of errors.
Second, in most cases, we need to consider the business logic of a specific project: for example, there must be only personal photos of a particular user, with a clearly distinguishable face. Automatic moderation mode suffers here fiasco — take into account the subjective factor of the machine is not learned, this can only real people.
Our experience and the experience of other projects suggests that automatic approval is only good as a pre-filter that can weed out the clearly poor quality of the content.
Price
Technical description of existing solutions we have done. Now let's get to the fun part: compare the prices!
Prices shocked. A mob of Hindus who have to train at their own expense, requested to 111 600$ a month!
We wanted to provide You not just dry numbers, but to show the prices for example a specific project. As a result, we have contacted most of the leading companies on the market, and all asked one and the same task: you need to check per month 200,000 pieces of content (photos, statuses, names) for 4 languages.
Let's see what happened:
the
-
the
- HTC
the-
the
- Price: 10 000$ in a month
the - ICUC
the-
the
- Price: 111$ 600 per month
One of Setup fee: 7 500$
the
the
-
the
- 9600$ ~ 15$ 600 per month depending on the skill of the moderators
the
-
the
- 15 000$ ~ 20 000$ in a month depending on the skill of the moderators
the
-
the
- Price: 54 000$ in a month
the
-
the
- Price: 25 000$ in a month
One of Setup fee: 10 000$
However, all the companies quite a clear approach to add another language: “pay for each separately.” Thus, if instead of 4 languages have 8, then the price tag for the month will increase in 2 times. In the end, 32 language ICUC will cost per month to 0.9 million dollars. Awesome!
Opinion
In the study we attempted not only to classify existing firms. We tried to proceed from the role of the project model, generating UGC, social mobile app. And our challenge was finding easy, inexpensive method of moderation of content that will not require much time to integrate with existing code.
So, You have a growing audience of project, You want a turnkey solution, which can be connected within a few days, and forget about the problem with the test content, personnel, development, admin? From all the above fits You, apparently, only Crisp Thinking, but cook the$ 25,000 a month.
Of course, this article is written not just so, and to draw attention to the problem of moderation and our service of content moderation 2Hive.org.
2Hive.org to cope with the mentioned problem.
for$ 4000 a month in 32 languages.
Once we have our own need in the moderation of content and 2Hive.org originated as a way to solve it. First and foremost we wanted to make the service very easy to use, and secondly a budget. And both requirements we have fulfilled. And how, read our future columns.
