mechanicalturk

How to get results from a HIT on sandbox via Mturk API

烂漫一生 提交于 2021-01-27 06:51:37
问题 I have created an XML file to publish a question to MTurk and the HIT is visible in the worker sandbox. A couple of my friends even submitted responses to the HIT, but I'm unable to view the results of this HIT. Here's the code I used to publish the HIT: import boto3 MTURK_SANDBOX = 'https://mturk-requester-sandbox.us-east-1.amazonaws.com' MTURK_PROD = 'https://mturk-requester.us-east-1.amazonaws.com' mturk = boto3.client('mturk', aws_access_key_id = "blah", aws_secret_access_key = "blah",

How to get results from a HIT on sandbox via Mturk API

…衆ロ難τιáo~ 提交于 2021-01-27 06:45:50
问题 I have created an XML file to publish a question to MTurk and the HIT is visible in the worker sandbox. A couple of my friends even submitted responses to the HIT, but I'm unable to view the results of this HIT. Here's the code I used to publish the HIT: import boto3 MTURK_SANDBOX = 'https://mturk-requester-sandbox.us-east-1.amazonaws.com' MTURK_PROD = 'https://mturk-requester.us-east-1.amazonaws.com' mturk = boto3.client('mturk', aws_access_key_id = "blah", aws_secret_access_key = "blah",

How to get results from a HIT on sandbox via Mturk API

杀马特。学长 韩版系。学妹 提交于 2021-01-27 06:44:31
问题 I have created an XML file to publish a question to MTurk and the HIT is visible in the worker sandbox. A couple of my friends even submitted responses to the HIT, but I'm unable to view the results of this HIT. Here's the code I used to publish the HIT: import boto3 MTURK_SANDBOX = 'https://mturk-requester-sandbox.us-east-1.amazonaws.com' MTURK_PROD = 'https://mturk-requester.us-east-1.amazonaws.com' mturk = boto3.client('mturk', aws_access_key_id = "blah", aws_secret_access_key = "blah",

how can i access to the JSON objects in crowd-checkbox of mturk with cloud templates?

て烟熏妆下的殇ゞ 提交于 2020-02-02 13:11:31
问题 I want to check if the right answer is checked among many checkboxes on Mturk Survey (to validate the participant reads the instruction). I looked at the reference, but I am struggling to find how to access the boolean value of "checked" https://docs.aws.amazon.com/ja_jp/sagemaker/latest/dg/sms-ui-template-crowd-checkbox.html <div><crowd-checkbox name="Stop"> Red </div> Let's say I want to access "Stop" value. How should I call the value in the function? 来源: https://stackoverflow.com

Reshape in R without aggregation (for example MTurk response strings)

前提是你 提交于 2020-01-21 12:51:56
问题 Ordinarily, I'd use a pretty basic long-to-wide reshape for this, but it seems to be dropping my aggregation variables. The setup is I had a job on mechanical Turk that I performed in triplicate---I want MTurk1, Mturk2, MTurk3's answers to be their own variables in the data frame but uniquely id'd by a field I input with the job, so that I can compare them against each other with a function later. Current Format: > head(mturk) AssignmentStatus Input.id Input.State Answer.Q1thing 1 Approved

Reshape in R without aggregation (for example MTurk response strings)

无人久伴 提交于 2020-01-21 12:50:23
问题 Ordinarily, I'd use a pretty basic long-to-wide reshape for this, but it seems to be dropping my aggregation variables. The setup is I had a job on mechanical Turk that I performed in triplicate---I want MTurk1, Mturk2, MTurk3's answers to be their own variables in the data frame but uniquely id'd by a field I input with the job, so that I can compare them against each other with a function later. Current Format: > head(mturk) AssignmentStatus Input.id Input.State Answer.Q1thing 1 Approved

How to delete still available HITs using boto3 client

£可爱£侵袭症+ 提交于 2020-01-16 17:32:18
问题 I have some published HITs available to workers. Now I want to delete them although they haven't been finished by the workers. According to this documentation, it is not possible: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/mturk.html#MTurk.Client.delete_hit Only HITs in reviewable state can be deleted. But using the command line interface it seems to be possible: https://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkCLT/CLTReference_DeleteHITsCommand.html My

How to delete still available HITs using boto3 client

僤鯓⒐⒋嵵緔 提交于 2020-01-16 17:30:28
问题 I have some published HITs available to workers. Now I want to delete them although they haven't been finished by the workers. According to this documentation, it is not possible: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/mturk.html#MTurk.Client.delete_hit Only HITs in reviewable state can be deleted. But using the command line interface it seems to be possible: https://docs.aws.amazon.com/AWSMechTurk/latest/AWSMturkCLT/CLTReference_DeleteHITsCommand.html My

Allow multiple locales as a qualification test in Mechanical Turk

一曲冷凌霜 提交于 2020-01-14 10:34:09
问题 I would like to have a HIT that requires users to be in the U.S. or Canada. I am using the command line tools, but it seems that any qualifications are treated as being all required -- I want a Boolean or . Is this possible? For example, in the .properties file, I have: # Worker_NumberHITsApproved > 100 qualification.1:00000000000000000040 qualification.comparator.1:GreaterThan qualification.value.1:100 # Worker_PercentAssignmentsApproved > 95% qualification.2:000000000000000000L0

Mechanical Turk / Cmd line tools / Qualification / #set and #foreach in xml

亡梦爱人 提交于 2020-01-06 01:45:50
问题 In the Amazon Mechanical Turk command line tools (I am using version: aws-mturk-clt-1.3.0), in one of the samples (site_filter_qual: "Website Filtering Qualification", file site_filter_qual.question), there is code that looks something like this: #set( $urls = [ "http://news.bbc.co.uk/", http://..., ...]) #foreach ( $url in $urls ) ... I am wondering : a) What is the language used here (it's not Perl and not PHP, right?); b) Where (on Amazon site or elsewhere) I could read about these