crowdsourcing; cross-device interaction; mobile and ubiquitous computing; mobile authoring
(2016), Bluewave: Enabling Opportunistic Context Sharing via Bluetooth Device Names, in ACM EICS 2016
(2016), End-User Development of Cross-Device User Interfaces, in ACM EICS 2016
(2016), Snap-To-It: A User-Inspired Platform for Opportunistic Device Interactions, in ACM CHI 2016
, San Jose, CA.
(2016), The Making of Cross-Device Experiences: A Hands-on Workshop, in ACM DIS 2016
(2016), WearWrite: Crowd-Assisted Writing from Smartwatches, in ACM CHI 2016
, San Jose, CA.
(2016), XDBrowser: User-Defined Cross-Device Web Page Designs, in ACM CHI 2016
, San Jose, CA.
(2015), Kinect Analysis: A System for Recording, Analysing and Sharing Multimodal Interaction Elicitation Studies, in ACM EICS 2015
(2015), MUBox: Multi-User Aware Personal Cloud Storage, in ACM CHI 2015
(2015), Systems and Tools for Cross-Device User Interfaces, in ACM EICS 2015
(2015), WearWrite: Orchestrating the Crowd to Complete Complex Tasks from Wearables, in ACM UIST 2015 Adjunct
, Charlotte, NC.
(2015), XDSession: integrated development and testing of cross-device applications, in ACM EICS 2015
Mobile devices are generally mostly used for relatively simple tasks rather than productivity tasks such as word processing and creating presentations and spreadsheets common to desktop environments. Despite increasingly more powerful hand-held and wearable devices, but due to small screen real estate and limitations of touch interaction, tasks that require more complex information interaction are usually not carried out on mobile devices. This also includes the design and development of mobile user interfaces themselves even though they are intended for mobile devices. The overarching goal of the proposed project is to enable more complex applications and tasks on, around and between mobile devices. Taking mobile authoring as an example, this research will use a three-pronged approach to investigate how next-generation mobile applications could be enabled based on 1) new cross-device interaction concepts and techniques, 2) advanced input sensing and richer forms of user feedback, as well as 3) automated support for crowdsourcing based on a combination of design-by-example and programming-by-demonstration techniques. The project will systematically explore appropriate methods and tools required to support increasingly complex applications, and identify the kinds of productivity and design tasks that would become feasible on small-form devices, as well as how they could be facilitated. The different research streams explored in this project will come together in two demonstrator applications that will be deployed and tested in real-world settings. This research has the potential to have strong impact on mobile and ubiquitous computing and make significant contributions to the human-computer interaction (HCI) research discipline concerning both user interface engineering methods and interaction techniques. Particularly in the HCI field, the trend has been to try to directly improve device capabilities as well as user input on devices, rather than considering alternative ways of extending the interaction possibilities based on the ideas of harnessing multiple devices and crowds. When it comes to crowdsourcing, there are still major challenges such as how to facilitate more complex and creative tasks that we address with our research. More practically, the results will generally benefit people in mobile settings, especially those in developing regions who have to rely on their phone as the primary computing device so far constrained to rather simple tasks.