The evaluation of human collaboration and its supporting technologies
- Publication Type:
- Issue Date:
The various research on collaboration extends to text-based chat, audio-conferencing, video-conferencing, forums, code inspections, 3D virtual worlds, tangible interfaces, the automation of link establishment and disestablishment, group decision support systems, and brainstorming. Moreover, this list is by no means exhaustive! The eight essential ingredients are formulated to draw together these disparate contexts, approaches, and implementations by describing the constants and commonalities of collaboration. The ingredients, then, which are common to all collaboration sessions regardless of the underlying technology are: people; a shared space; time; a common objective; focus on the objective; common language; knowledge in the area of the objective; and interaction. There may be other aspects which affect collaboration, but these ultimately will be expressed in either one, or a combination of these ingredients. Additionally, there is little consensus on the evaluation of collaboration and its supporting technologies. It seems that many researchers focus on their application without much thought on its accompanying evaluation method or how their evaluation fits with other approaches. The various approaches to evaluation fit into a layered understanding of collaboration, through the comparison of one layer’s affects on another and/or through the examination of effectiveness, efficiency, and satisfaction of a particular layer. Furthermore, the analysis of various approaches are placed in a matrix, which can lead to the identification of ‘gaps’ in the evaluation research field and help to identify where an evaluation approach fits in. In addition, a new method of evaluation is introduced on the basis of the eight essential ingredients, thus rendering it applicable to any collaboration session. Its technological independence and numerical results provide it with strong potential for improving collaboration and its supporting technologies. To demonstrate the operation of the measure, a pilot study was conducted. The measure was found to be useful, but potentially quite expensive to implement. The expense, however, can be reduced through the automation of some of the aspects of the measure.
Please use this identifier to cite or link to this item: