Design, Implementation, and Evaluation of a highly expressive Direct Combination PrototypeCandidates are not required to know anything about Direct Combination (DC). However, some optional background is provided for candidates who might wish to know about the project���s aim and scope.
Direct Combination is variously a principle, a family of user interaction techniques, and a user interaction framework (Holland and Oppenheim, 1999; Holland et al., 2002a). Together, these can give users greatly enhanced flexibility interacting with digital systems and can reduce search when dealing with complex or unfamiliar interfaces (Holland et al., 2005).
Direct Combination also has potential to simplify multi-device interaction (Holland et al., 2002), enhance bimanual interaction (Webb, 2017), facilitate interactions spanning virtual and physical boundaries; encourage serendipitous interaction (Holland et al., 2002b), and to enable the incremental development of novel interactions by end-user programming (Holland, 2003). While the potential of Direct Combination has been widely noted (e.g. Beaudouin-Lafon and Mackay, 2000, Rekimoto, 2004, Bartoleo et al, 2006 , Webb, 2017, Agarwal et al, 2019) existing implementations have been constrained by the limitations of available mechanisms for the modelling of separation of concerns in multi-dimensional domain models.
However, new mechanisms that facilitate separation of concerns, in particular the revised version of Stateful Traits (Tesone et al., 2020) have created new opportunities for building highly expressive Direct Combination engines. Reenaskaug���s Data-Context-Interaction Paradigm (Reenskaug, 2006; James Coplien and Trygve Reenskaug, 2012) has also contributed relevant insights.
As well as prototyping the new DC engine, the project will prototype support tools. To this end, the project will also involve analysing and creating informal domain models for one or two end-user domains, anticipated to be an AR/VR game in Unity (linked via a simple OSC bridge) and possibly an interface to allow end users and music scholars to query, analyse and visualise large quantities of linked music data on the web (via SPARQL).
The choice of Smalltalk as preferred development environment reflects the fact that three previous implementations of Direct Combination at the Open University, and the reference implementations of both Stateful Traits and DCI, were all developed in Smalltalk (variously in Squeak, VisualWorks and Pharo). At the same time, the pervasively live-object nature of Smalltalk and its sophisticated IDE, along with the powerful metaprogramming facilities, offer substantial advantages in facilitating rapid prototyping and exploration.
References Agarwal, Mallika, Arjun Srinivasan, and John Stasko. (2019) "VisWall: Visual Data Exploration Using Direct Combination on Large Touch Displays." 2019 IEEE Visualization Conference (VIS). IEEE, 2019
Bartolomeo, G., BlefariMelazzi, N., Cortese, G., Friday, A., Prezerakos, G., Walker, R. and Salsano, S., 2006, February. Sms: Simplifying mobile services-for users and service providers. In Advanced Int'l Conference on Telecommunications and Int'l Conference on Internet and Web Applications and Services (AICT-ICIW'06) (pp. 209-209). IEEE.
Beaudouin-Lafon, M. and Mackay, W.E., 2000, May. Reification, polymorphism and reuse: three principles for designing visual interfaces. In Proceedings of the working conference on Advanced visual interfaces (pp. 102-109).
James Coplien and Trygve Reenskaug (2012) The data, context and interaction paradigm. In SPLASH '12: Proceedings of the 3rd annual conference on Systems, programming, and applications: software for humanity.
Gedenryd, H. (2002). Beyond Inheritance, Aspects and Roles: a Unified Scheme for Object and Program Composition. TR2002/09, Department of Computing, The Open University, Milton Keynes, MK76AA, UK.
Holland, S. and Oppenheim, D. (1999) Direct Combination. Proceedings of CHI 1999 pp. 262-269.
Holland, S., Morse, D.R., Gedenryd, H. (2002a) Direct Combination: a New User Interaction Principle for Mobile and Ubiquitous HCI. In Paterno, F., (Ed.) (2002) Human Computer Interaction with Mobile Devices. Mobile HCI 2002.
Holland, Simon; Gedenryd, Henrik and Morse, David (2002b). Applying Direct Combination to afford spontaneity in Pervasive Computing. In: Workshop on Supporting Spontaneous Interaction in Ubiquitous Computing Settings, 29 Sep - 1 Oct 2002, Gothenburg, Sweden.
Reenskaug, T. (2006) DCI Documentation
http://heim.ifi.uio.no/~trygver/themes/babyide/baby-documents.html (Accessed 19 Dec 2020)
Holland, Simon (2005). A first empirical study of direct combination in a ubiquitous environment. In: Fincher, Sally; Markpoulos, Panos; Moore, David and Ruddle, Roy eds. People and computers XVIII - Design for life: proceedings of HCI 2004. London, UK: Springer, pp. 229���247.
Holland, Simon (2003). Ambient Combination: Applying Direct Combination to Afford Spontaneity in Pervasive Computing .
http://mcl.open.ac.uk/DC/uploads/Ambient%20Combination%20Long.pdf (accessed 10 Jan 2021)
Rekimoto, J. (2004). SyncTap: synchronous user operation for spontaneous network connection. Personal and Ubiquitous Computing, 8(2), 126-134.
Pablo Tesone, St��phane Ducasse, Guillermo Polito, Luc Fabresse, Noury Bouraqadi (2020) A new modular implementation for stateful traits, Science of Computer Programming, Volume 195, 102470, ISSN 0167-6423,
https://doi.org/10.1016/j.scico.2020.102470.
Webb, A.M., 2017. Phrasing Bimanual Interaction for Visual Design (Doctoral dissertation).