Allow multiple locales as a qualification test in Mechanical Turk

一曲冷凌霜 提交于 2020-01-14 10:34:09

问题


I would like to have a HIT that requires users to be in the U.S. or Canada. I am using the command line tools, but it seems that any qualifications are treated as being all required -- I want a Boolean or. Is this possible?

For example, in the .properties file, I have:

# Worker_NumberHITsApproved > 100
qualification.1:00000000000000000040
qualification.comparator.1:GreaterThan
qualification.value.1:100

# Worker_PercentAssignmentsApproved > 95%
qualification.2:000000000000000000L0
qualification.comparator.2:GreaterThan
qualification.value.2:95

# Worker_Locale
qualification.3:00000000000000000071
qualification.comparator.3:EqualTo
qualification.locale.3:US

All three of these qualifications are required. Suppose I want to require the first two and then a locale of either US or CA. Is there syntax for this?


回答1:


Update: this lack may have been addressed, see dmcc's answer for more information.


I think you're out of luck. From the API docs (emphasis added):

The Locale Qualification

...snip...

Note
A Worker must meet all of a HIT's Qualification requirements to qualify for the HIT. This means you cannot specify more than one locale Qualification requirement, because a given Worker will only be able to match one of the requirements. There is no way to allow Workers of varying locales to qualify for a single HIT.




回答2:


Mechanical Turk now supports new In and NotIn comparators which allow for multiple locales. Here's an example SOAP request from that link which requires workers from the US, Canada, or the UK:

<QualificationRequirement>
   <QualificationTypeId>00000000000000000071</QualificationTypeId>
   <Comparator>In</Comparator>
   <LocaleValue>US</LocaleValue>
   <LocaleValue>CA</LocaleValue>
   <LocaleValue>UK</LocaleValue>
</QualificationRequirement>

See also AWS MTurk documentation.




回答3:


TurkPrime.com offers this and many more features using a web interface. You can exclude and include workers, email them, restart survey and more.

I and my colleagues have used it for a while and just love it.




回答4:


This question and its answers are fairly old at this point, but I was not able to find a solution specifically for the command line tools. I was fortunately able to figure it out after playing around for some time. In your .properties file:

# user must be located in the US or Canada
qualification.1:00000000000000000071
qualification.comparator.1:In
qualification.locale.1.1:US
qualification.locale.1.2:CA

A fairly modest solution but one that is not well-documented in my opinion :)



来源:https://stackoverflow.com/questions/10603494/allow-multiple-locales-as-a-qualification-test-in-mechanical-turk

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!