Aniket Kittur
Bryant Lee
Robert E. Kraut
ABSTRACT
The success of Wikipedia has demonstrated the power of peer production in knowledge building. However, unlike many other examples of collective intelligence, tasks in Wikipedia can be deeply interdependent and may incur high coordination costs among editors. Increasing the number of editors increases the resources available to the system, but it also raises the costs of coordination. This suggests that the dependencies of tasks in Wikipedia may determine whether they benefit from increasing the number of editors involved. Specifically, we hypothesize that adding editors may benefit low-coordination tasks but have negative consequences for tasks requiring a high degree of coordination. Furthermore, concentrating the work to reduce coordination dependencies should enable more efficient work by many editors. Analyses of both article ratings and article review comments provide support for both hypotheses. These results suggest ways to better harness the efforts of many editors in social collaborative systems involving high coordination tasks.
- Aiken, L.&West, S. Multiple regression: Testing and interpreting interactions. Sage, CA (1991).Google Scholar
- Argote, L. Input uncertainty and organizational coordination in hospital emergency rooms. Administrative Science Quarterly 27 (1982), 420--434.Google ScholarCross Ref
- Atkinson, A.B. On the measurement of inequality. Journal of Economic Theory 2 (1970), 244--263.Google ScholarCross Ref
- Baecker, R.M., Nastos, D., Posner, I.R.&Mawby, K.L. The user-centered iterative design of collaborative writing software. Proc. CHI, ACM Press (1993). 399--405. Google ScholarDigital Library
- Benkler, Y. Coase's penguin, or Linux and the nature of the firm. Yale Law Journal 112 (2002), 367--445.Google ScholarCross Ref
- Brooks, F.P. The mythical man month. Addison-Wesley Longman Publishing Co., Inc. Boston, MA (1975). Google ScholarDigital Library
- Cataldo, M., Wagstrom, P., Herbsleb, J.D.,&Carley, K. Identification of coordination requirements: Implications for the design of collaboration and awareness tools. ACM Press, New York, 2006.Google ScholarDigital Library
- Cohen, J., Cohen, P., West, S.G.,&Aiken, L.S. Applied multiple regression/correlation analysis for the behavioral sciences. Lawrence Erlbaum Associates, Mahwah, New Jersey (2003).Google Scholar
- Cosley, D., Frankowski, D., Terveen, L., Riedl, J. SuggestBot: Using intelligent task routing to help people find work in Wikipedia. Proc. IUI, ACM Press (2007), 32--41. Google ScholarDigital Library
- Galton, F. Vox populi. Nature 75 (1907), 7.Google ScholarCross Ref
- Giles, G. Internet encyclopaedias go head to head. Nature 438 (2005), 900--901.Google ScholarCross Ref
- Gittell, J.H. Coordinating mechanisms in care provider groups: Relational coordination as a mediator and input uncertainty as a moderator of performance effects. Management Science 48 (2002), 1408--1426. Google ScholarDigital Library
- Hill, G.W. Group versus individual performance. Are N = 1 heads better than one? Psychological Bulletin 91, 3 (1982), 517--539.Google ScholarCross Ref
- Wikipedia Database Download. http://en.wikipedia.org/wiki/Wikipedia:Database_downloadGoogle Scholar
- Wikipedia Featured Article Criteria. http://en.wikipedia.org/wiki/Wikipedia:Featured_article_criteriaGoogle Scholar
- Wikipedia Featured Article Statistics. http://en.wikipedia.org/wiki/Wikipedia:Featured_article_statisticsGoogle Scholar
- Kittur, A., Suh, B., Chi, E.,&Pendleton, B. A. He says, she says: Conflict and coordination in Wikipedia. Proc. CHI 2007, ACM Press (2007), 453--462. Google ScholarDigital Library
- Kittur, A., Chi, E.,&Suh, B. Crowdsourcing user studies with Mechanical Turk. Proc. CHI 2008, ACM Press (2008), 453--456. Google ScholarDigital Library
- Kittur, A., Chi, E., Pendleton, B. A., Suh, B.,&Mytkowicz, T. Power of the few vs. wisdom of the crowd: Wikipedia and the rise of the bourgeoisie. Alt.CHI, 2007, San Jose, CA (2007).Google Scholar
- Kittur, A.,&Kraut, R. E. (2008). Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. CSCW 2008, San Diego, CA (2008). Google ScholarDigital Library
- Kozlow, M.,&Bellamy, P. Experimental study on the impact of the 6+1 trait writing model on student achievement in writing. Association for Supervision and Curriculum Development Conference 2005, Orlando, FL (2005).Google Scholar
- Malone, T.W.,&Crowston, K. The interdisciplinary study of coordination. ACM Computing Surveys (CSUR) 26, 1 (1994), 87--119. Google ScholarDigital Library
- Mockus, A., Fielding, R. T.,&Herbsleb, J. D. Two case studies of open source software development: Apache and mozilla. ACM Transactions on Software Engineering and Methodology 11, 3 (2002), 309--346. Google ScholarDigital Library
- Northwest Regional Educational Laboratory. 6+1 Trait Writing: Scoring Continuum. (2001). Available online http://www.nwrel.org/assessment/pdfRubrics/6plus1traits.PDFGoogle Scholar
- O'Reilly, T. (2005, Sep 30). What is Web 2.0? Design patterns and business models for the next generation of software. Retrieved Aug 15, 2008, from http://www.oreillynet.com/pub/a/oreilly/tim/news/2005/09/30/whatis-web-20.htmlGoogle Scholar
- Priedhorsky, R., Chen, J., Lam, S., Panciera, K., Terveen, L.,&Riedl, J. Creating, destroying, and restoring value in Wikipedia. Proc. GROUP 2007, ACM Press (2007), 259--268. Google ScholarDigital Library
- Raymond, E. The cathedral and the bazaar. Knowledge, Technology, and Policy 12 (1999), 23 -- 49. Google ScholarDigital Library
- Rouse, W.B., Cannon-Bowers, J. A.,&Salas, E. The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics 22 (1992) 1296--1308.Google ScholarCross Ref
- Steiner, I. D. Group process and productivity. New York: Academic Press (1972).Google Scholar
- Stewart, G. L. A meta-analytic review of relationships between team design features and team performance. Journal of Management 32, 1 (2006), 29.Google ScholarCross Ref
- Stvilia, B., Twidale, M. B., Smith, L. C.,&Gasser, L. Assessing information quality of a community-based encyclopedia. Proc. ICIQ 2005, MIT Press (2005), 442--454.Google Scholar
- Surowiecki, J. The wisdom of crowds. New York: Doubleday (2005). Google ScholarDigital Library
- Tushman, M. Work characteristics and subunit communication structure: A contingency analysis. Administrative Science Quarterly 24 (1979), 82--98.Google ScholarCross Ref
- Van de Ven, A., Delbecq, A.,&Koenig, R. Determinants of coordination modes within organizations. American Sociological Review 41 (1976), 322--338.Google ScholarCross Ref
- Wilkinson, D.M.,&Huberman, B.A. Assessing the value of cooperation in Wikipedia. First Monday 12, 4 (2007).Google ScholarCross Ref
Index Terms
- Coordination in collective intelligence: the role of team structure and task interdependence
Recommendations
Harnessing the wisdom of crowds in wikipedia: quality through coordination
CSCW '08: Proceedings of the 2008 ACM conference on Computer supported cooperative workWikipedia's success is often attributed to the large numbers of contributors who improve the accuracy, completeness and clarity of articles while reducing bias. However, because of the coordination needed to write an article collaboratively, adding ...
Beyond Wikipedia: coordination and conflict in online production groups
CSCW '10: Proceedings of the 2010 ACM conference on Computer supported cooperative workOnline production groups have the potential to transform the way that knowledge is produced and disseminated. One of the most widely used forms of online production is the wiki, which has been used in domains ranging from science to education to ...
Stigmergic Coordination in Wikipedia
OpenSym '18: Proceedings of the 14th International Symposium on Open CollaborationWe look for evidence of stigmergic coordination (i.e., coordination mediated by changes to a shared work product) in the context of Wikipedia. Using a novel approach to identifying edits to the same part of a Wikipedia article, we show that a majority ...
Comments