As many of you may have heard, Amazon is not approving international Mturk
accounts anymore. In 2012 Amazon put a hold on accepting new
worker accounts for a couple of months. When they started accepting new workers
again, it was only for workers in the United States.
There are three reasons for this:
Fraud - Amazon was having a difficult time verifying these accounts
and a lot of fraud was occurring from outside the United States. Multiple
accounts, sweatshops, money transfers and other Amazon TOS violations were
occurring on these international accounts. Amazon would close the worker
account and then they would simply open a new one. If you want to see some of this fraud, take a look at this forum- Romanian Mturk Forum. Over 300 pages long and 6000 posts. Almost every page of this forum has discussions on how to break Amazon's TOS. It is no longer active forum because of the halts on new international accounts.
Complaints - Requester complaints about the quality of work is the second
reason. I personally know quite a few workers outside of the US that are
excellent turkers and speak and write English better than many Americans.
Because of the constant stream of complaints to Amazon about the poor quality
of work from international IP addresses, something had to be done. Since fraudulent workers outside of the US
were not required to verify their accounts, they could just make a new account
and get back to work under a different user ID.
Blocks - Blocks are a way Amazon to monitor worker accounts, although
Amazon does not tell requesters this. When a worker account starts accumulating
blocks from requesters, the workers account is suspended and reviewed by someone
at Mturk. A requester could block a US worker and over time if that worker is
not preforming well, they are removed completely from the worker pool and
cannot make a new account. With the international accounts, a worker would
simply change IP address and make a new account and set up a click script to automatically
cheat HITs until blocked .
Since Americans are verified using Social Security numbers, bank accounts, credit cards and addresses, American workers would protect and guard their accounts to ensure they are not suspended. This is NOT to say that international workers do not have a professional work ethic or are all out to cheat the system, it is just an additional restriction on American workers have to ensure that they can never make multiple accounts.
Requesters are starting to take notice of this. The worker pool of cheap labor is getting smaller every day. Some requesters feel it is ethical to pay a worker $1-$2 for an hours worth of work. American workers, for the most part, will not work for this pay. New workers, international workers and naive turkers were the ones completing these tasks. Now, this substandard work is not being completed in a timely fashion anymore.
For instance, CastingWords is now making their own interface because they need these international workers.
So please, people in India, Pakistan and other foreign countries, please stop sending me emails asking me how to get your accounts verified. It is not going to happen. And to all the workers out there, protect your accounts no matter what country you are from.
I got clarification from Sharon Chiarella, the Amazon VP who is in charge of Mechanical Turk. Her email is below. She implies that the speculation that MTurk is excluding international workers is not correct, and it is an inference that people are making because of it's new policy on confirming workers before allowing them to work.
ReplyDeleteChris,
We made a change to our registration process a few months ago. We moved to an invitation-only registration. In the new process, we review a Worker's registration information prior to inviting them to work on Mturk. We're not providing details of this review process and some Workers (or would-be Workers) are trying to determine what our process is and this has started the speculation that we're excluding international Workers.
That said, if you do notice a change in your ability to find the Workers you need on Mturk, please don't hesitate to reach out and let me know.
Thanks,
Sharon
-----Original Message---
From: Chris Callison-Burch
Sent: Sunday, February 10, 2013 6:25 AM
To: Chiarella, Sharon
Subject: does mturk have a new policy excluding international workers?
Dear Sharon,
I have read several internet rumors saying that Mechanical Turk will no longer be accepting international workers, (Here is one such report: http://turkrequesters.blogspot.com/2013/01/the-reasons-why-amazon-mechanical-turk.html). Is this true?
If it is true, it would be a shame. I have been doing research into crowdsourced translations and have been spending ~$100k per year to collect translations and other annotations for computational linguistics research. My research relies on having a diverse international speaker population to have a good representation of the world's languages. Typically, I have found the quality of the international workers who I hired to be very high.
Best Regards,
Chris Callison-Burch
Center for Language and Speech Processing
Johns Hopkins University
Chris,
DeleteI really wish I could believe that to be true. I understand that a business should be able to keep some information private, but with Amazon Mechanical Turk, there are just too many secrets.
How are "master" turkers chosen?
Where does the money go from suspended Amazon Payments accounts?
Why are some requesters given special privileges to work around Amazon's terms of service?
I have not met a single new turker from outside the USA in the past 6 months on any of the international forums that I am a member of. I have actually seen the opposite with many of the international forums closing because new workers are not being accepted.
For your HIT's, international workers are essential and you are one of the few requesters who pays a living wage to these workers. I guess time will tell if this is an honest letter from Sharon or not. Of course I will revise if I see anything that shows otherwise.
I'm Italian, and three days ago I registered to become a MTurk Worker.
ReplyDeleteThis morning I received an email stating that "We regret to inform you that you will not be permitted to
work on Mechanical Turk.".
I sent an email asking for clarification, and if there was some kind of international block at the moment.
The answer was that "New Worker accounts are accepted based on our marketplace needs. [...] All new account registrations will undergo the same review process regardless of the country of residence.".
And in this moment I can see that there are two HITs requesting english to italian translation that are expiring. So the marketplace may need somebody like me!
I don't think that their answers are sincere, and moreover the fact that you can't re-apply for the service drives me crazy!
They say that if the criteria changes I may be contacted in the future... I'm quite confident that my record will be lost between thousands of rejected Workers, even if in the future something changes.
You are saying exactly what I have heard from hundreds of international workers. Amazon may tell requesters that they are still accepting international accounts, but they are not.
DeleteIs any possibility for accepting new International accounts in near FUTURE?
ReplyDeleteAmazon "SAYS" they are accepting international workers by invitation only.
ReplyDeleteI do not believe this. Who are they inviting? As Chris Callison-Burch indicates in his comment, he needs international workers for his hits, yet there is still not a way for Amazon to verify international accounts. If a worker is not completing work properly or uses false information to make an account, then what is to stop them from making more accounts?
Try using microworkers or clickworker or one of the other platforms available.