参考文献
[1]Howe J.The Rise of Crowdsourcing[J].Wired Maga-zine,2006,14(6):1-4.
[2]Difallah D E,Demartini G,Cudré-Mauroux P.Mechani-cal Cheat:Spamming Schemes and Adversarial Techni-ques on Crowdsourcing Platforms[C]//Proceedings of the 1st International Workshop on Crowdsourcing Web Search.Lyon,France:
[s.n.],2012:26-30.
[3]Raykar V C,Yu Shipeng.Eliminating Spammers and Ranking Annotators for Crowdsourced Labeling Tasks[J].Journal of Machine Learning Research,2012,13(1):491-518.
[4]Ross J,Irani L,Silberman M,et al.Who Are the Crowdlabelers?:Shifting Demographics in Mechanical Turk[C]//Proceedings of the 28th International Conference on Human Factors in Computing Systems.New York,USA:ACM Press,2010:2863-2872.
[5]Eickhoff C,Vries A P.Increasing Cheat Robustness of Crowdsourcing Tasks[J].Information Retrieval,2013,16(2):121-137.
[6]Kazai G,Kamps J,Koolen M,et al.Crowdsourcing for Book Search Evaluation:Impact of Hit Design on Comparative System Ranking[C]//Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information
Retrieval.New York,USA:ACM Press,2011:205-214.
[7]Difallah D E,Demartini G,Cudré-Mauroux P.Pick-a-crowd:Tell Me What You Like,and I’ll Tell You What to Do[C]//Proceedings of the 22nd International Con-ference on World Wide Web.New York,USA:ACM Press,2013:367-374.
(下转第152页)
(上接第145页)
[8]Sheng V S,Provost F,Ipeirotis P G.Get Another Label? Improving Data Quality and Data Mining Using Multiple,Noisy Labelers[C]//Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New
York,USA:ACM Press,2008:614-622.
[9]Mason W,Watts D J.Financial Incentives and the Performance of Crowds[J].ACM SIGKDD Explora-tions Newsletter,2010,11(2):100-108.
[10]Harris C.You’re Hired! An Examination of Crowd-sourcing Incentive Models in Human Resource Tasks[C]//Proceedings of the 4th ACM International Conference on Web Search and Data Mining.New York,USA:ACM Press,2011:15-18.
[11]Sorokin A,Forsyth D.Utility Data Annotation with Amazon Mechanical Turk[C]//Proceedings of the 1st IEEE Workshop on Internet Vision at CVPR’08.Washington D.C.,USA:IEEE Press,2008:1-8.
[12]张志强,逄居升,谢晓芹,等.众包质量控制策略及评估算法研究[J].计算机学报,2013,36(8):1635-1649.
[13]岳德君,于戈,申德荣,等.基于投票一致性的众包质量评估策略[J].东北大学学报:自然科学版,2014,35(8):1097-1101.
[14]Kittur A,Chi E H,Suh B.Crowdsourcing User Studies with Mechanical Turk[C]//Proceedings of SIGCHI Conference on Human Factors in Computing Systems.New York,USA:ACM Press,2008:453-456.
[15]Snow R,Connor B O,Jurafsky D,et al.Cheap and Fast——But Is It Good? Evaluating Non-expert Annotations for Natural Language Tasks[C]//Pro-ceedings of Conference on Empirical Methods in Natural Language Processing.New York,USA:ACM
Press,2008:254-263.
编辑刘冰 |