本文翻译了由Microsoft Research, University College London Interaction Centre, Aarhus University 和 Lancaster University合作,发表在CHI2019的研究综述 <<Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices>> 本文比较系统化的介绍了2018年前与多设备交互研究相关的510个工作,并对它们进行了统一化的术语和标签分类. 译者水平有限,意在描述大体思路,多数句子意译.处理不当之处欢迎指出.
本文将几个关键的术语以英文形式列出,为了不因翻译问题造成困扰
Cross-device; Cross-surface; Cross-display Multi-device; Multi-surface; Multi-display; Multi-monitor/screen; Multi-slate/tablet; Multi-mobile Distributed; Trans-surface; Dual-display/monitor
此外,对于mapping一词的理解不深,不敢轻易翻译 第六章开始为机翻,有时间再修正,
Cross-Device Taxonomy: Survey, Opportunities and Challenges of Interactions Spanning Across Multiple Devices
突破单一设备平面局限的界面或应用可以让人们以新的方式接触数字内容 (Digital content, 指以数字形式存在的文本、图象、声音等内容). Cross-device交互的研究也是HCI (Human-Computer Interaction, 人机交互)持续关注的焦点. 为了揭示这一领域未来的研究进程,我们对cross-device computing 领域中510篇论文进行了分析和分类.我们为这一领域的研究人员贡献了:一篇概述,包括关于主要和未充分开发的应用领域的探讨,使能技术的mapping,贯穿多设备交互的关键技术综述以及常见评估策略的回顾.
Human-centered computing → HCI theory, concepts and models; Ubiquitous and mobile computing systems and tools; Interaction paradigms; Ubiquitous and mobile computing design and evaluation methods.
Cross-device Interaction; cross-device computing; survey; multi-device; taxonomy; cross-surface; distributed user interface
我们与计算机交互的方式在过去的30年里发生了根本性的变化.我们从来没有像现在这样接触这大量的计算设备,它们有着不同形态的特点,功能和技术能力.自从Weiser在Ubiquitous computing上发表了开创性文章后,针对于这些设备形态特点的海量研究出现了,它们构想出了超越单个设备和单个用户的新的交互模式.从最初的smart-space到multi-display,distributed surface以及multi-device,到cross-display,trans-surface以及跨设备交互方式:涉及人们与各种设备的交互认知的研究是现代人机交互的前沿研究.
然而,这些研究爆炸式的发展使得术语,技术和系统开始脱节,从而形成了一个支离破碎的研究领域.在这篇论文里,我们多设备计算下的这些研究碎片修补到一起.为了便于将来的研究，我们分析了510篇跨设备交互领域的论文，以综合该领域的研究现状。基于我们对术语、应用、系统、技术和评估方法的分析，我们给出了一个统一的分类法和最新技术的概述。我们讨论了跨设备领域的开放性问题和挑战，并概述了跨设备交互领域未来研究方向。
这种分类法的提出是为更广泛的HCI领域提供一个通用的工作和讨论基础。我们为多设备研究领域的新人提供起点同时也为该领域目前研究人员提供共同的讨论平台,也为多设备社区提供了思考时间。这项工作直接合并和扩展了早期的跨设备研究分类法。我们的分类学横跨整个研究领域,包括distributed用户界面区域[76，86]，第二屏幕和跨设备研究[229]，移动跨设备生态系统[111]。我们建立在其他相关分类法的基础上(各有自己的侧重点)：例如,multi-display系统的规模[330]，multi-display的切换[275]，自发设备关联的交互技术[62]，或设备的所有权,访问性和间距[2]。我们的目标是统一跨设备领域中的术语和策略，扩展了早期分类法的范围。我们特别关注在"Multi-device"这一次关键词中围绕"Interaction"的主题。我们涵盖相关技术方面（例如跟踪系统和跨设备交互的评估策略),但其他工程方面不属于这个分类法的范围，例如跨设备架构或开发框架（概述见[149]）。
总结一下,我们的主要贡献:(1)一个针对于跨设备的分类法;(2)当前设计领域(涵盖应用领域,跟踪系统,交互技术以及评估策略)的mapping和反思性讨论;以及(3)为跨设备未来发展提供信息.我们的数据和完整的标签工具已经开源,我们也欢迎研究社区的人贡献收集的研究来拓展我们的分类.
为了创建用于分析的论文集,我们于2018年4月在ACM Digital Library进行了系统化的搜索.我们的搜索字段包含了cross-,multi-与device,surface,monitor和display的任意组合,以及分布式用户界面和缩略词.通过语料库的引用和我们在跨设备搜索领域的专业知识,我们找出了检索结果缺失的48篇文献(这是一种常见的用于调查统计和分类论文的策略[111.184]).经过合并重复项,我们评选出了738篇论文
文章需要与交互任务或技术,面向用户和/或设备的跟踪技术或者涉及多设备的技术相关.我们剔除了没有贡献或贡献很较少的文献.我们最后总共剩下了510篇标记的论文,并并入我们的分类
我们反复地为我们的分类制定了标记策略.最后的标记策略包括:贡献,应用领域,交互技术细节,部署,评估技术定义,技术方面以及几个更深的领域.我们用一个定制的基于web的文献标记系统对510篇论文进行标记.
我们主要分析了3个f数据集（1)包含所有数据段的标记后的数据库,(2)所有的pdf文档集合以及(3)从PDF剔除引用提取出文本。分析通过所有作者反复进行单独,成对和小组讨论来完成。我们使用开放编码来分析我们的标签数据集，以及轴向编码来识别更高层次的主题。此外，我们使用Tableau、R和Excel来可视化随时间而变化的关键主题，并从而揭示趋势和模式。我们用这些可视化的东西作为我们应该深入研究数据集和论文本身的指南。频繁的全文搜索补充了这些探索。新出现的模式，发现和论文的关键类别与所有合著者讨论，并随着时间的推移不断完善。
我们分类的目标是对cross-device研究领域进行全面的分析,同时我们仔细地筛选了引用文献以避免读者读到过长的引用列表和综述表格.我们优先考虑具有开创性的文献,更早期的工作和首次贡献,但也包括其他相关工作.我们承认我们的参考文件并不是跨设备研究领域中所有论文的详尽列表,而是一个具有代表性和精心策划的与该分类法最相关的子集.
我们的完整数据集和标记系统已经开源发布.我们邀请其他研究者来贡献数据语料库,推荐新的标签和分类,参与跨设备计算的讨论
在这一章中,我们综合相关工作来创建一个对于跨设备计算领域的统一理解.我们的目标是将相关但不同的研究线索(通常用不同的术语描述)编写到一个分类中,从而为这个领域当前和未来的研究人员提供信息和指导.
首先我们将这一领域最早的工作进行了简要的回顾,并着重指出随时间推移的主要趋势变化.我们将这些工作归纳为跨设备工作的三个关键领域:(1)早期的multi-monitor工作站,(2)multi-display/surface的出现,以及(3)日益增长的移动,点对点跨设备的使用.
Memex[35]是对于个人工作站最早的工作之一,它的特点是由多个显示器组成,其中两个用于显示,一个用于笔输入.我们调查的早期工作包含multi-screen系统[201,202],它们研究了在一个工作站上安装四个显示器的效果.Wellner[356]提出了DigitalDesk,进一步阐述了这一概念.类似的,尽管是之后的工作,包括Grudin[112]关于多显示器使用中外围感知(peripheral awareness,可以感知不在主视线内的动作或物体的能力)以及在连接但不同的屏幕上传输信息的优势的工作.先前的工作已经广泛地研究了multi-screen[82,153,225,276,290].
Weiser写的<<The Computer for the 21st Century>>[355] 激发了面向超越单台计算机和单个用户的研究.值得注意的是,在Fitzmaurice[90]引入掌上设备空间感知概念几年后,Rekimoto[278,281]在90年代后期的研究中探索了跨设备设备边界的交互技术.大约在同一时间,针对于大型互动空间的研究和开创性工作,比如i-LAND[324],开始出现.各种显示环境的出现,使得交互能够跨越各种设备:数字壁式显示器,桌面和平板电脑(例如[18,39,91,110,138,205,227, 305,352,357]).
不同于固定的空间和生态系统,跨设备工作的第三个领域侧重于移动和灵活的点对点跨设备配置.由于之恩那个手机和平板电脑的普遍可用性,这些研究致力于在便捷式设备上个人或协作应用,提供数字信息空间来支持日常工作[11,31,52-54,109,111,128,129,204,206,270,272,280,362].正如我们稍后将更深入地解释那样,点对点便携式设备给技术,跟踪和实地研究带来了新的挑战.
在对研究领域进行抽样调查时,很明显有比要统一用于描述正在研究的术语.对于一个大的研究领域,有些时候有不同的术语指向相同的研究领域.其他时候,情况恰恰相反,相同的术语实际上指的是不同研究领域.我们梳理了跨设备工作的不同术语,并将这些属于映射到图1的单个本体(ontology)中.这一综合的主要目标是为我们领域内的研究范围和规范化提供更好的指导.这个统一的本体由两部分关键术语组成,用于描述跨设备文献.
图一的顶部对跨设备子学科的关键术语进行了分类.这个嵌套的分类从底部的dual-display和multi-monitor工作(1a)开始,进一步扩展到multiple mobile devices,tablets or slates(1c) 和cross/multi/trans-surfaces(1d),最后到覆盖范围最广的cross/multi-device和distributed.图中的嵌套结构表示与每个术语相关的焦点关注区域以及通常包含的设备外形因素.需要注意的是,这些术语中很大一部分是可以互换使用的.图一的底部包含了一系列的术语,表明了研究的重点领域(1f):交互和协作;结构;应用程序或系统;平台或中间件;环境或生态以及计算.我们用每个术语相关论文中最常见的研究焦点对这些属于进行了注释. 如何使用本体(ontology):对于任何进入该领域的人来说,它理清了该领域所使用的术语,同时强调了一些术语是可以互换使用的.对于当前的研究者来说,这有助于确定描述工作的最佳术语.在跨设备社区中,本体可以引起对术语适当使用的反思.在本章中,我们将深入探讨跨设备设计空间的关键特征的分类法.图2的分类是对研究领域中不同但是相互交织的线程的细粒度合成.我们解释了六个关键维度,并讨论了从这种分类法的视角来看待现有研究或为新研究提供信息.
跨设备工作可以分为两类:同步(synchronous:交互同时发生)和异步(asynchronous:设备间交互有顺序).我们调查的大部分工作属于前一类.
该维度对跨设备系统的实际配置及其输入输出模式的使用及逆行了分类.同步中主要类型包括镜像(mirrored)和分布式用户界面(distributed user interface).最活跃的研究在分布式UI中进行,包括界面的空间(spatial)分布和逻辑(logical)分布.异步工作分为两类:允许跨设备迁移的界面以及跨平台运行应用的研究.与这个维度相关的分类法,有Elmqvist针对分布式UI的分类[86]以及Rashid针对**multi-device""注意力切换的分类[276].
这个维度针对于不同的人与设备的关系.虽然单人对单设备(1…1)交互通常不是跨设备工作的一部分,单人对两个或更多设备(1…m)的交互涵盖了跨设备工作站的工作.协作配置主要分为两类:没人主要使用一个设备(1…1*1…1)的团队活动,以及n个人对m个设备(n,m)的协作.最后两个类型的例子与CSCW(computer-supported cooperative works:计算机支持协同工作)社区的研究密切相关.
交互可以在不同的尺度上有所不同:从附近的,到私人的,社交的,公共房间或建筑物.Edward Hall的人际距离学(proxemics)是一种常用的人类学视角,用于研究交互作用的尺度[115],后来被用于跨设备工作,即人际距离交互[12,107,205].尺度维度与Terrenghgi对于显示生态分类法[330]和Weiser的Tab/Pad/Yard计算进展[355]密切相关.
动态特性可能因配置而异,而点对点/移动设备,半固定和固定空间与我们之前介绍的跨设备研究密切相关.固定空间通常包括较大规模的壁式显示器和桌面,而半固定空间允许一定程序的重新配置,而点对点/移动折别则专注于便携式设备,允许动态更改和重新配置.
最后一个维度区分了临近交互和远程交互(对应于Johnson的CSCW矩阵[162]).大多数跨设备工作都涉及到同一位置的场景,但是很少有例子能够解决跨远程分布式位置的跨设备交互[13,174].
注:研究项目不一定非得归为一类.相反,项目在这个项目空间中属于不同领域是很常见的.此外,项目可能遵循横向转变,即研究的范围随着时间的推移在维度上发生变化.
如何使用这个分类法:这个分类法有不同的功能,帮助研究人员:(1)它精炼了庞大的研究工作,并综合了开创性的工作,以便于进入一个陌生的研究领域,(2)具体的维度(和子类别)可以帮助正在进行的和新的研究进行框架和范围的框定,以及(3)它允许在六个维度内对主要相关研究范畴进行讨论.这种分类法与跨应用程序分析(从下一章开始),技术,交互技术和评估操作综合考虑更为有效.
我们的调查揭示了跨设备计算的一系列不同的应用领域.尽管510篇论文中只有63篇被标记出了"应用",但是361篇论文包含了某种形式的应用用例来辅助说明主要贡献,例如新的系统设计,交互技术,跟踪技术或交互概念.我们确定了九种高级应用级分类:(i)知识工作, (ii)家庭计算, (iii)数据检索, (iv)移动计算, (v)游戏/设置, (vi)协作, (vii)教育, (viii)健康 以及(ix)软件开发(表1). 最大的应用类别在知识工作上,共有62篇论文.典型的知识工作是跨显示器和设备的信息管理[90,201,283],跨设备共享信息和资源[164,252],multi-device活动和任务管理[13,140,265,353],或建设性和创造性任务[148,205,246,356,379].其他领域包括警察分析员工作站[4],工业设施[180],航空驾驶舱[88]以及航空科学家和工程师之间的合作[148]. 从2000年开始,我们看到跨设备交互应用于数据挖掘的工作增多.利用移动设备(包括平板电脑和智能手机)实现信息可视化需要新的交互词汇[18,138,171,322].特别是Horak等人[138]描述了使用真实城市犯罪数据集的范围分析场景中,智能手表显示配置的交互概念.其他类型的数据集也被检索了,包括地理[210,249],物理[18,315,357],生命科学[66,92,102,108,296],城市规划[46,340],能源[43,306]和金融[204]. 教育[37,179,365]和健康[3,87,217,363]也是流行的应用领域.在这些领域中,人们一直强调协作和分布式工作,教育应用主要集中在课堂捕捉[344],课堂演示[37,117],教育游戏[29,71,195]和课堂活动模拟[163,232,262,345,365].Kreimayer等人[179]展示了为数不多的实际研究,他们观察了课堂上的i协作活动,这种活动是使用共享平板电脑和大屏幕来进行财务管理活动的设计.在健康领域,已经有一些研究应用于实际场景,包括探索手术前场景[3],患者登记[363],以及在外科实践中设计分布式用户界面系统[87,217].其他健康应用程序是为个人使用而设计的,即记忆游戏[72],认知训练[73]和体力活动检测[172].
跨设备交互的基础是设备之间交互数据的机制.这通常需要一个跟踪系统,能够可靠的跟踪单个设备,以及(最近)操作这些设备的个人.各种跟踪系统具有不同的特性,例如,空间分辨(空间中的3D位置与设备之间的距离),所需设备的程度或尺度(例如,跟踪设备是在桌子上还是在房间中). 在数据集中的510篇论文中,55篇论文的核心贡献设计开发或定制跟踪系统;所有其他论文要么利用指定固定设备位置的现有的跟踪系统(例如,设备静止的所设备系统),要么使用非空间跟踪系统(例如,在同一网络上). 我们在表2中组织了所有以跟踪系统为重点的论文,我们通过自下而上的跟踪特性(距离与相对位置,2D与3D)和模式(电容,惯性,声学,磁性,光学,无线电)进行了分析.跟踪系统通常分为两类:(1)有外到内,使用环境中的(静态)传感器进行跟踪;或(2)由内到外,仅使用设备内置的传感器,偶尔在环境中使用信号发射器.由内而外跟踪对于移动跨设备应用场景尤为实用,表2显示了使用设备摄像机声学,无线电和最近的光信号的主要用途.这种类型的跟踪通常剔红设备的二维位置或相对邻接配置.使用非空间传感器可靠的跟踪设备的三维位置仍然是一个重大挑战[160,267].在由外到内系统(深度)相机是主导技术.尽管具有3D功能,但大多数此类系统都是用摄像机来跟踪设备的二维位置和方向(见表2).该表还表明,最近更大规模的电容面积传感器正在取代以前的大表面光学传感(例如，在以前的桌面和墙壁屏幕中使用). 对于这两个主要的类型,没有一个由内到外的论文将跟踪用户作为感知的一部分.然而大多数由外到内的系统都集成了这一功能,以检测在设备上和周围的用户交互. 我们在跟踪系统中发现了一个趋势，那就是几乎“开箱即用”的野心。我们认识到未来跨设备跟踪系统在提供高保真、可靠和准确的跟踪信息的同时，将设备发现、校准和配对的用户输入保持在最低限度，尤其是对于移动系统。我们预见未来的由内而外的系统将提供更多当前系统的功能，包括用户和身份跟踪。我们还预计，由外到内系统会越来越多地感知用户的内容，比如他们的空间配置和活动。
如何使用跟踪分类：选择合适的跨设备跟踪技术是一项具有挑战性的任务，即使是对该领域的专家也是如此。这一选择遵循了几个考虑因素，权衡了倾向于高保真信息，而不是轻量级但保真度较低的由内向外跟踪技术。这种分类显示了跨设备跟踪技术的最新研究的广度，包括那些现成的技术。引用表可能是最适合使用的技术参考。
人们使用跨设备计算的基本方法是通过交互技术.在我们的样本中,130篇论文明确提到“交互技术”是本文的主要贡献。进一步的 深入分析表明，另有221篇论文介绍了交互技术作为新的跟踪方法,应用或系统的一部分，总共351篇论文描述并使用了跨设备交互 技术。
我们划分了跨设备交互技术的三个阶段(见表3中的完整概述,该表并不是所有交互技术的详尽或完整列表，而是来自我们数据集的代表性样本，可作为我们分析中确定的三个阶段和六种模式的典范)：(第一阶段)配置阶段,(第二阶段)内容参与阶段和(第三阶段)脱离接触阶段.我们的分析表明，用户进行交互的输入方式可以分为五类：（i）屏幕交互；（ii）围绕设备交互和手势；（iii）设备运动；（iv）改变设备形状；（v）使用肢体手势。
第一阶段集中于设置设备的跨设备配置，包括配对、组合、连接或耦合多个设备。此配置阶段的目的是在支持跨设备活动的设备之间建立有意义的语义关系。跨设备交互技术的例子可以在所有6种模式中找到。例如，使用屏幕交互，诸如缝合[129]或融合[192，238，243]多个显示器，或执行同步触摸[280]等技术已被用于将设备配对到一个配置中。配对技术还利用设备指向[259,349]或不同的手指姿势和识别[144]来隐式创建跨设备配置。对于围绕设备的交互例子,包括敲打配对[103]，甚至拍照识别其他设备[299]。手势配对技术包括Rekimoto的开创性敲击[280]，以及roll- and pointing[61]或保持和翻转[54]等组合设备的技术. 配置阶段的大多数技术都是以2D或3D设备运动作为主要输入模式来设计的。如表3所示，使用运动配对技术的示例包括碰撞[127]、堆叠[61]或震动设备[131211]。通过改变形状、改变夹持装置的形状，可以相互联系。 使用眼睛、凝视或头部方向，使用透视感知界面[226]、透视感知光标[227]或显示改变可视化[81]等技术来选择正确的设备或屏幕。最后，诸如渐进参与[203]和前体交互[107]等技术利用整个身体的位置、位置和方向来创建设备之间的语义关系。由于将各种设备组合成跨设备配置或生态系统是任何应用程序或技术跨设备工作的中心前提条件，因此许多技术明确地集中在这个配对或配置阶段就不足为奇了。
第二阶段发生在为跨设备使用配置设备之后，包括与分布在多个设备上的内容、数据、可视化、应用程序或接口的直接或间接交互。内容参与封装了跨各种不断变化的设备配置对内容的实际消耗。许多经典的跨设备交互技术(源于开创性工作的Hyperdrag[281]和Pick and drop[223278])使用直接触摸或鼠标与显示器交互，将内容从一个设备移动到另一个设备。例如,在多个屏幕的边框上拖放[312],朝另一个设备的方向滑动[159,348],以及平移[270]，轻敲[310]和笔势[277]。通过拖放代理图标门户[64、123、206]、基于压力的按下和轻按技术[223],多屏幕环境下的拖拽缩放技术[206]或多屏幕环境下的拖放和拖放技术支持跨设备直接交互[15].设备周围的交互主要基于交互界面(如PhoneTouch[294]或ActivitySpace[143]),或将交互空间扩展到设备旁边的视觉代理[311],扩展投影显示[57],设备周围支持触摸的表面[362]，甚至是增强的鼠标、触摸，和键盘输入[23]. 空中手势也被考虑用于跨设备交互。其中一些是挥舞的变体：例如在设备之间挥舞[50]或在设备上方挥舞[141]。其他空中例子是在触摸或三维运动交互之后进行的，例如点和抓[198]、升降[8]或抓握和微移动[375]。 大多数用于内容参与的交互技术使用2D或3D设备运动模式。第一类技术集中在平面上的二维运动。技术包括旋转设备与内容交互[143,270,288]，移动设备来探索空间感知地图[90，270]，或探索信息可视化[367]。第二类侧重于先进的三维运动与设备的内容互动。例如倾倒[159]或将内容扔到显示器上[69]，以及倾斜操作来平移地图[69]。其他技术包括旋转[188]、投掷和夹击[122]、射击和复制[27]和倾斜[191]技术，以便在设备之间进行交互（见表3中的完整列表). 只有少数全身手势，例如通过F-formations传播的内容传输[206]，或选择设备或屏幕的凝视和头部手势[183,303]，以及选择内容[333]的研究。其中许多技术利用设备的物理性和可供性，使具有表现力的3D设备运动能够接收、使用或向其他设备发送数据，这些设备非常容易和直观地执行。
最后一个阶段涉及一个人在设备、基础设施或应用程序级别停止跨设备内容参与的交互技术。虽然第一个配置阶段在早期的工作中受到了很大的关注，但脱离接触阶段的研究仍然较少。设备上和设备周围的一些示例包括跨设备会话管理[116]或覆盖智能手表以重置跨设备配置[32]。使用三维运动，有一些技术可以通过移动设备[127，298]，从跟踪区域[143，190，270]拾取设备，垂直倾斜设备以停止共享[190]，摇晃以断开连接[243]，或通过断开物理接触来隐式断开设备连接[371]。最后，proxemic交互通过离开操作空间[206]或远离显示器[369]来支持隐式分离。 需要注意的是，交互技术可以同时出现在不同阶段的多个功能中，或者组合在一起。例如，PhoneTouch[294]、WatchConnect[141]、渐进参与[206]或Gluey[303]中讨论的技术在一种交互技术中结合了第1阶段配置和第2阶段内容参与功能。然而，应用这种分类法可以作为一种有用的分析视角来理解大多数跨设备交互技术的广度和重点。
与交互技术相关，我们确定了四大类可视化和反馈，它们被用来帮助用户理解特定的跨设备交互技术或应用程序是如何工作的(表4). 首先，许多技术为用户提供了跨设备和跨空间的跨设备交互的概述。示例包括布局或窗口管理器的使用[24，357]和使用概述或小地图[2，16，24，97，358]。第二，为了提高对信息和应用程序在设备中的位置的了解和了解，开发了许多内容可视化和分发方法。该类别包括设备间的实时协调视图[91、92、120、263、322]、设备之间的刷涂和链接[7、63]、按需或其他设备上的概述和详细信息[16、31、136、287、322]、魔术镜头视图[16、28]或动态校正的透视图[226]。第三，为了提高跨设备系统的可理解性，开发了反馈和前馈机制。例如对象预览和手势阴影[22，188，206，301]，透视光标[227，349]或多显示指针[163，286]帮助用户理解信息是如何在设备之间传输的。最后一个策略是明确地可视化设备之间的链接.物理和数字彩色边框都是用于指示连通性[116、206、271、351、358]。设备上或设备周围的可视代理或门户用于可视化哪个设备拥有哪些信息[24、64、89、97、123、143、203、357、358]，跨设备门户帮助用户识别设备之间的边界[143、206]。
在本节中，我们报告了我们对跨设备工作的评估策略的分析。虽然技术研究可能会对开发人员进行性能评估或初步专家评估，但其他工作则通过实验室研究或与用户的实际部署进行评估
总之，在我们的语料库中，317/510篇论文报告了一项研究，我们将其归纳为我们针对跨设备工作的五种主要评估策略。由于许多跨设备研究可以被视为“建设性问题”（建设性概念或建设性经验[251]），我们扩展了Ledo等人的HCI技术工具包评估策略[184]，以便我们用“信息性”进行分类，从而得出五大类：信息型（观察和启发）、演示、使用（定性和定量）、技术和启发式评估（表5）。我们想指出Ledo等人关于后四种工具的评估策略的深入讨论[184]，这同样出现在我们的分析中。下面我们将对每一个策略做一个简短的总结，并对我们新增加的第四个策略进行详细的解释。
演示展示了跨设备系统或交互技术支持什么，以及用户如何将其用于某些任务[184]。虽然这不涉及真实世界的部署，但它显示了所提议的解决方案解决实际问题的适用性[251]。因此，演示是一个强大的评估工具，特别是对于技术系统（例如跟踪工具包或其他开发框架）。
使用评估一个跨设备系统或交互技术是否可以被某个用户或用户组使用（可用性），它如何支持某些任务（有用性），它是如何被适当使用的，或者引起其他用户的反馈[184]。大多数新的交互技术和跨设备系统都是通过定性的实验室研究或控制实验来评估的，这些研究很好地揭示了可用性问题，但往往缺乏生态有效性。野生研究弥补了这一局限性，因为它们提供了对特定系统使用环境的洞察[285]。然而，现实世界的部署很难进行，因为许多支持跨设备交互的技术在实验室外很难控制（前面在跟踪系统部分中提到）。然而，有20篇论文报道了在学校[179]和大学教室[37，53]中的实际部署。
启发式评估使用一组标准（如Nielsen[239]）来评估可用性，而不需要人工参与。很少有论文（5）报告启发式作为一种评估方法。我们推测这可能是因为跨设备研究缺乏专门的启发式指标。启发式度量是发现可用性问题的有用工具，特别是在设计过程的早期阶段。然而，“简单的度量可以产生不一定有意义的简单化的进展”[247]，因为它们不能提供对用户经常意外使用系统的洞察。
旨在深入了解用户需求和未解决问题的研究被归类为信息性研究。它们通常先于实现或开发工作，并让用户参与设计过程，从而使研究人员获得更广泛的可能解决方案，并在感知到的用户需求中确定系统设计选择。然而，并不是所有的项目都涉及一个专门的信息步骤，而是从现有的文献或其他以前的工作中得出他们的设计选择。在开发完成后，通过明确的评估步骤，工程工作通常会进一步以研究为基础。
观察性研究：在我们的语料库中，有几篇论文报道了现场观察或实验室研究的结果，以建立对跨设备使用的理解，以指导进一步的研究方向或促进设计选择。例如，对办公环境中多显示器使用的早期观察[112]引发了关于如何通过使用多个显示器和多个设备来降低认知负荷的其他研究[153]和[75252290]。类似地，其他观察研究也被用于调查当前的多设备利用率[41，42]，真正多设备使用的障碍[263]，或协同工作中显示尺寸的影响[148,377]。
手势诱导研究：跨设备交互技术通常涉及空中、周围和空中的手势来连接设备或操作内容。构建系统的研究人员设计的这种手势并不总是反映用户的首选。Wobbrock等人。[364]在设计新的互动技巧时，提议将手势诱导研究作为一种工具：参与者被呈现在动作（指涉）的效果上，并要求他们执行可能导致这些动作的符号。通过对协议得分进行加权和计算，提出的手势可以映射到用户友好性和接受度[343]。通过对启发式任务的合理设计，这些研究可以生成一个手势词汇，从而允许在类似任务中重复使用手势
“如何很好地展示的系统的评估”[184],我们的语料库中有66篇论文报告了一项技术评估，这项评估专门用于评估跟踪技术(28)或其他交叉设备工具包(38)我们再次指出Ledo等人[184]的更多细节。
如何使用评估分类：跨设备领域的评估策略分类可以帮助研究人员找到合适的评估方法。尽管可用性评估（有时）被认为是有害的[106]，但我们希望表明，有多种方法可用于评估跨设备交互、系统和接口，我们鼓励在HCI社区中讨论这些方法。
研究跨设备交互：研究跨设备交互通常包括视频记录实验室研究或野外部署，尤其是定性研究。然而，只有少数系统支持研究人员分析这些视频材料：VICPAM[222]、EXCITE[207]和EagleView[34]是使研究人员能够可视化和/或查询与多个设备的空间交互的系统。最终，关于如何最好地评估跨设备交互和系统，还需要做更多的工作。
对跨设备计算和交互的研究表明，打破孤立的计算机、设备和用户的限制可以获得巨大的好处。通过对跨设备文献的调查，我们发现了在标注我们的论文语料库时存在的挑战和问题，以及我们对这些发现的反思。我们明确地将以下67篇论文中提到的挑战综合成9个主题。我们将它们与先前工作中确定的挑战相结合（例如[111，142]）.
为了支持跨设备生态中的人类活动或有意义地比较跨设备交互技术和方法，我们需要通过将应用程序和场景作为中心焦点来开发可测试的设计模式[203]。虽然有些工作试图比较技术[223,271]，但根本的问题是没有参照系来比较和评估跨设备技术和系统。虽然许多技术贡献重新设想并推动了互动可能性的边界，但它们往往与实证研究的发现脱节。需要更多的工作来将经验和技术交叉设备的工作统一到一个研究流中。
虽然近几年来，跨设备功能开始出现在商业产品中，但有几项研究对设备利用率提出了有时有争议的发现。例如，一项关于苹果持续性的研究表明，用户在理解其功能、意识到其存在和影响以及在共享设备时减轻重大隐私问题等方面存在挑战[273]。而Rädle等人。他们认为，空间感知的跨设备交互，必须精心设计，以减少用户的认知负荷和心理需求[271]。潜在的挑战是在系统和应用程序中交流跨设备交互的可能性和好处。更具体地说，我们需要新的概念、反馈和前馈机制，以及专门为跨设备计算而设计的用户界面模式[31]。
传统偏见的现象，即用户即使在更有效和新颖的技术可用的情况下也会求助于众所周知的交互风格，这一现象在跨设备感官制作[263]、笔记记录[157]和策展任务[32]的研究中都有记载。尽管工作场所和用户体验研究一直报告说，许多人已经在为多设备碎片化而挣扎[42,75,290]，但用户将在多大程度上采用新的多设备系统仍是一个悬而未决的问题。需要对单个设备的心理模型和更大的生态系统进行更多的研究，以便为新的跨设备技术研究提供经验基础。
设计新的跨设备系统包括应对社会关系和规范[77]、隐私[33、337]、身份验证等挑战，以及为跨设备交互的参与和脱离阶段所需的配置工作[143]提供支持。我们的分析发现，系统缺乏从跨设备交互中分离的交互技术（表3）。用户需要配置（或重新配置）跨设备功能的能力[273]，Greenberg等人。主张明确支持交互系统的加入和退出[104]。虽然在这个领域已经进行了一些初步的工作，但围绕整个跨设备交互模型的基本问题仍然存在.
虽然Weiser的观点[355]是跨设备计算研究的基础，但它也引起了批判性的反思。例如，罗杰斯提出了一个“从主动计算到主动的人的转变”[284]，在这种转变中，有目的地建立的经验让人们参与进来，同时让他们控制自己与世界的互动[284]。类似地，Oulasvirta总结说，是用户在“做ubicomp”[250]，Dourish认为，用户，而不是设计师，使用适当的技术，从而为他们的交互创造意义[83]。因此，与其将设备混合在一起，并试图隐藏它们之间的界限，设计者应该拥抱并利用设备和它们的“席”（45, 250）的异质性和灵活性——最终创造一种设备的生态学，从而建立跨设备计算的概念基础。当前向移动、即席和可重新配置的设备配置的转移反映了这种转变，但需要以一种更强有力的方式考虑使用环境、用户操作以及特定的应用程序和场景. 。
许多跨设备交互的实现技术（表3）是典型的、难以设置的、昂贵的，或者需要很大的空间。这类系统需要更可靠[181]，以提高正常使用和运动时的速度和精度[47，145，258，267，299]，并将跨设备能力带到研究空间之外的未经修改的设备[243]。在技术层面上，跨设备研究需要更实际的测试[160]和针 对实验室外情况的改进[187]，以支持更广泛的应用和野外部署。外-内跟踪通常需要在被跟踪对象上附加标记，或者很容易与不确定条件（光、噪声）混淆。过去，由于其健壮性、移动性和对特殊情况的支持，由内向外跟踪一直用于野外部署，但它缺乏由外到内的逼真度和细节（例如跟踪用户）。另一方面，设备本身可以知道它们的使用环境。学术界和工业界的研究人员已经开始指出并解决这一基础设施问题[143250]，但只有很少的努力集中在最小化用户的设置和配置时间，以实现开箱即用的交互（例如[159,378]）。
跨设备计算的商业尝试仅限于单个用户在特定制造商的生态系统中管理他们的个人设备生态，几乎不支持真正的协作活动。然而，成功地突破商业应用和生态系统障碍的技术创新大多建立在开放标准之上，特别是万维网、电子邮件和开放文件格式。支持跨设备计算的标准并不多，现代web浏览器中对蓝牙等技术的集成为开发商业或研究领域之外的跨设备交互开辟了方向。然而，有意义的标准的设计必须通过严格的使用研究来进行，而不仅仅局限于实验室[142,250]。这就带来了一个鸡和蛋的问题，因为跨设备交互技术和应用程序的构建、部署和测试都是众所周知的困难和昂贵的。
随着移动设备、可穿戴设备和有形设备的新交互技术的出现，跨设备的研究正在进一步分化，各种输入和输出模式。虽然跨设备计算本质上侧重于“设备”，但它本身也是“设备不可知论者”。随着新的设备外形因素、材料、混合现实技术、物联网设备和形状变化的界面，重新思考复杂生态系统中设备的边界、用途和范围将面临新的挑战和机遇。
过去三十年，与计算机的交互从单屏主机计算，到双屏台式PC，到具有手势交互的先进多显示设备，到如今移动和可穿戴设备的扩散。多设备和跨设备计算已经成为人机交互研究的基础部分。尽管研究议程和重点有很大的不同，但我们社区的共同点是理解、创造和提供超越个人装置的经验。在一篇论文中调查30多年的交叉装置研究，对许多积极创造、开发、贡献和塑造这一领域的研究人员来说，并不公平。我们承认，本次调查有许多不同的广告，我们希望我们的解释是在HCI社区内进行更广泛讨论的进一步步骤。通过反思我们正在使用的术语，并通过确定和解决根本挑战，社区可以共同塑造跨设备计算的未来。我们期待着继续讨论我们的目标，并邀请跨设备研究人员和实践者——新的和已建立的——为我们的开放数据集作出贡献:https://github.com/ frederikbrudy/ cross-device-taxonomy.
[1] Hussein Ajam and Mu Mu. 2017. A Middleware to Enable Immersive Multi-Device Online TV Experience. In Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’17 Adjunct). ACM, New York, NY, USA, 27–32. https://doi.org/10.1145/3084289.3089919 [2] Dzmitry Aliakseyeu, Andrés Lucero, and Jean-Bernard Martens. 2008. Users’ Quest for an Optimized Representation of a Multi-device Space. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’08). ACM, New York, NY, USA, 359–362. https://doi.org/10. 1145/1385569.1385633 [3] Ole Andre Alsos and Dag Svanæs. 2006. Interaction Techniques for Using Handhelds and PCs Together in a Clinical Setting. In Proceedings of the 4th Nordic Conference on Human-computer Interaction: Changing Roles (NordiCHI ’06). ACM, New York, NY, USA, 125–134. https://doi.org/10.1145/1182475.1182489 [4] Craig Anslow, Chris Rooney, Neesha Kodagoda, and William Wong. 2015. Police Analyst Workstation: Towards a Multi-Surface User Interface. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS ’15). ACM, New York, NY, USA, 307–311. https://doi.org/10.1145/2817721.2823498 [5] Nathalie Aquino, Jean Vanderdonckt, Nelly Condori-Fernández, Óscar Dieste, and Óscar Pastor. 2010. Usability Evaluation of Multidevice/Platform User Interfaces Generated by Model-driven Engineering. In Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM ’10). ACM, New York, NY, USA, Article 30, 10 pages. https://doi.org/10.1145/ 1852786.1852826 [6] Md Tanvir Islam Aumi, Sidhant Gupta, Mayank Goel, Eric Larson, and Shwetak Patel. 2013. DopLink: Using the Doppler Effect for Multi-device Interaction. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’13). ACM, New York, NY, USA, 583–586. https://doi.org/10.1145/ 2493432.2493515 [7] Sriram Karthik Badam and Niklas Elmqvist. 2014. PolyChrome: A Cross-Device Framework for Collaborative Web Visualization. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 109–118. https://doi.org/10.1145/2669485.2669518 [8] Thomas Bader, Astrid Heck, and Jürgen Beyerer. 2010. Lift-anddrop: Crossing Boundaries in a Multi-display Environment by Airlift. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI ’10). ACM, New York, NY, USA, 139–146. https://doi. org/10.1145/1842993.1843019 [9] Caroline Baillard, Matthieu Fradet, Vincent Alleaume, Pierrick Jouet, and Anthony Laurent. 2017. Multi-device Mixed Reality TV: A Collaborative Experience with Joint Use of a Tablet and a Headset. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (VRST ’17). ACM, New York, NY, USA, Article 67, 2 pages. https://doi.org/10.1145/3139131.3141196 [10] Rafael Ballagas, Meredith Ringel, Maureen Stone, and Jan Borchers. 2003. iStuff: A Physical User Interface Toolkit for Ubiquitous Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03). ACM, New York, NY, USA, 537–544. https://doi.org/10.1145/642611.642705 [11] Rafael Ballagas, Michael Rohs, Jennifer G Sheridan, and Jan Borchers. 2004. Byod: Bring your own device. In Proceedings of the Workshop on Ubiquitous Display Environments, Ubicomp, Vol. 2004. [12] Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-aware Environment. In ACM International Conference on Interactive Tabletops & Surfaces (ITS ’10). ACM, New York, NY, USA, 121–130. https: //doi.org/10.1145/1936652.1936676 [13] Jakob Bardram, Sofiane Gueddana, Steven Houben, and Søren Nielsen. 2012. ReticularSpaces: Activity-based Computing Support for Physically Distributed and Collaborative Smart Spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA, 2845–2854. https://doi.org/10.1145/ 2207676.2208689 [14] Marco Barsotti, Fabio Paternò, and Francesca Pulina. 2017. A Web Framework for Cross-device Gestures Between Personal Devices and Public Displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM ’17). ACM, New York, NY, USA, 69–78. https://doi.org/10.1145/3152832.3152858 [15] Patrick Baudisch, Edward Cutrell, Dan Robbins, Mary Czerwinski, Peter Tandler, Benjamin Bederson, Alex Zierlinger, et al. 2003. Dragand-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. In Proceedings of INTERACT, Vol. 3. 57–64. [16] Dominikus Baur, Sebastian Boring, and Steven Feiner. 2012. Virtual Projection: Exploring Optical Projection As a Metaphor for Multidevice Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA, 1693–1702. https://doi.org/10.1145/2207676.2208297 [17] Michel Beaudouin-Lafon. 2000. Instrumental Interaction: An Interaction Model for Designing post-WIMP User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’00). ACM, New York, NY, USA, 446–453. https: //doi.org/10.1145/332040.332473 [18] Michel Beaudouin-Lafon, Stephane Huot, Mathieu Nancel, Wendy Mackay, Emmanuel Pietriga, Romain Primet, Julie Wagner, Olivier Chapuis, Clement Pillias, James Eagan, Tony Gjerlufsen, and Clemens Klokmose. 2012. Multisurface Interaction in the WILD Room. Computer 45, 4 (apr 2012), 48–56. https://doi.org/10.1109/MC.2012.110 [19] Federico Bellucci, Giuseppe Ghiani, Fabio Paternò, and Carmen Santoro. 2011. Engineering JavaScript State Persistence of Web Applications Migrating Across Multiple Devices. In Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’11). ACM, New York, NY, USA, 105–110. https: //doi.org/10.1145/1996461.1996502 [20] Silvia Berti and Fabio Paternò. 2005. Migratory MultiModal Interfaces in MultiDevice Environments. In Proceedings of the 7th International Conference on Multimodal Interfaces (ICMI ’05). ACM, New York, NY, USA, 92–99. https://doi.org/10.1145/1088463.1088481 [21] Enrico Bertini and Giuseppe Santucci. 2004. Modelling Internet Based Applications for Designing Multi-device Adaptive Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’04). ACM, New York, NY, USA, 252–256. https://doi.org/10.1145/ 989863.989906 [22] Guillaume Besacier, Julie Tournet, Nippun Goyal, Frank Cento, and Stacey D. Scott. 2014. Object and ARM Shadows: Visual Feedback for Cross Device Transfer. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’14). ACM, New York, NY, USA, 463–466. https://doi.org/10.1145/2559206.2574832 [23] Xiaojun Bi, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2011. Magic Desk: Bringing Multi-touch Surfaces into Desktop Work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). ACM, New York, NY, USA, 2511–2520. https://doi.org/10.1145/1978942.1979309 [24] Jacob T. Biehl and Brian P. Bailey. 2006. Improving Interfaces for Managing Applications in Multiple-device Environments. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’06). ACM, New York, NY, USA, 35–42. https://doi.org/10.1145/1133265.1133273 [25] Gaddi Blumrosen, Bracha Hod, Tal Anker, Danny Dolev, and Boris Rubinsky. 2010. Continuous Close-Proximity RSSI-Based Tracking in Wireless Sensor Networks. In Proceedings of the 2010 International Conference on Body Sensor Networks (BSN ’10). IEEE Computer Society, Washington, DC, USA, 234–239. https://doi.org/10.1109/BSN.2010.36 [26] Susanne Bødker and Clemens Nylandsted Klokmose. 2012. Dynamics in Artifact Ecologies. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI ’12). ACM, New York, NY, USA, 448–457. https: //doi.org/10.1145/2399016.2399085 [27] Sebastian Boring, Manuela Altendorfer, Gregor Broll, Otmar Hilliges, and Andreas Butz. 2007. Shoot & Copy: Phonecam-based Information Transfer from Public Displays Onto Mobile Phones. In Proceedings of the 4th International Conference on Mobile Technology, Applications, and Systems and the 1st International Symposium on Computer Human Interaction in Mobile Technology (Mobility ’07). ACM, New York, NY, USA, 24–31. https://doi.org/10.1145/1378063.1378068 [28] Sebastian Boring, Dominikus Baur, Andreas Butz, Sean Gustafson, and Patrick Baudisch. 2010. Touch Projector: Mobile Interaction Through Video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’10). ACM, New York, NY, USA, 2287–2296. https://doi.org/10.1145/1753326.1753671 [29] Amira Bouabid, Sophie Lepreux, Christophe Kolski, and Clémentine Havrez. 2014. Context-sensitive and Collaborative Application for Distributed User Interfaces on Tabletops. In Proceedings of the 2014 Workshop on Distributed User Interfaces and Multimodal Interaction (DUI ’14). ACM, New York, NY, USA, 23–26. https://doi.org/10.1145/ 2677356.2677661 [30] Andrew Bragdon, Rob DeLine, Ken Hinckley, and Meredith Ringel Morris. 2011. Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings. In Proceedings of the ACM International Conference on Interactive Tabletops & Surfaces (ITS ’11). ACM, New York, NY, USA, 212–221. https://doi.org/10.1145/2076354. 2076393 [31] Frederik Brudy, Joshua Kevin Budiman, Steven Houben, and Nicolai Marquardt. 2018. Investigating the Role of an Overview Device in Multi-Device Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 300, 13 pages. https://doi.org/10.1145/3173574. 3173874 [32] Frederik Brudy, Steven Houben, Nicolai Marquardt, and Yvonne Rogers. 2016. CurationSpace: Cross-Device Content Curation Using Instrumental Interaction. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 159–168. https://doi.org/10.1145/2992154.2992175 [33] Frederik Brudy, David Ledo, Saul Greenberg, and Andreas Butz. 2014. Is Anyone Looking? Mitigating Shoulder Surfing on Public Displays Through Awareness and Protection. In Proceedings of The International Symposium on Pervasive Displays (PerDis ’14). ACM, New York, NY, USA, Article 1, 6 pages. https://doi.org/10.1145/2611009.2611028 [34] Frederik Brudy, Suppachai Suwanwatcharachat, Wenyu Zhang, Steven Houben, and Nicolai Marquardt. 2018. EagleView: A Video Analysis Tool for Visualising and Querying Spatial Interactions of People and Devices. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS ’18). ACM, New York, NY, USA, 61–72. https://doi.org/10.1145/3279778.3279795 [35] Vannevar Bush. 1945. As we may think. Atlantic Monthly 176 (1945), 101–108. [36] Roberto Calderon, Michael Blackstock, Rodger Lea, Sidney Fels, Andre de Oliveira Bueno, and Junia Anacleto. 2014. RED: A Framework for Prototyping Multi-display Applications Using Web Technologies. In Proceedings of The International Symposium on Pervasive Displays (PerDis ’14). ACM, New York, NY, USA, Article 148, 6 pages. https://doi.org/10.1145/2611009.2611037 [37] Bingyi Cao, Margarita Esponda, and Raúl Rojas. 2016. The Use of a Multi-Display System in University Classroom Lectures. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 427–432. https://doi.org/10.1145/2992154. 2996793 [38] Jessica R. Cauchard. 2011. Mobile Multi-display Environments. In Proceedings of the 24th Annual ACM Symposium Adjunct on User Interface Software and Technology (UIST ’11 Adjunct). ACM, New York, NY, USA, 39–42. https://doi.org/10.1145/2046396.2046414 [39] Jessica R. Cauchard, Markus Löchtefeld, Pourang Irani, Johannes Schoening, Antonio Krüger, Mike Fraser, and Sriram Subramanian. 2011. Visual Separation in Mobile Multi-display Environments. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST ’11). ACM, New York, NY, USA, 451– 460. https://doi.org/10.1145/2047196.2047256 [40] Marta E. Cecchinato, Anna L. Cox, and Jon Bird. 2015. Working 9-5?: Professional Differences in Email and Boundary Management Practices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 3989–3998. https://doi.org/10.1145/2702123.2702537 [41] Marta E. Cecchinato, Anna L. Cox, and Jon Bird. 2017. Always On(Line)?: User Experience of Smartwatches and Their Role Within Multi-Device Ecologies. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 3557–3568. https://doi.org/10.1145/3025453.3025538 [42] Marta E. Cecchinato, Abigail Sellen, Milad Shokouhi, and Gavin Smyth. 2016. Finding Email in a Multi-Account, Multi-Device World. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 1200–1210. https://doi.org/10.1145/2858036.2858473 [43] Augusto Celentano and Emmanuel Dubois. 2015. A Design Space for Exploring Rich and Complex Information Environments. In Proceedings of the 11th Biannual Conference on Italian SIGCHI Chapter (CHItaly 2015). ACM, New York, NY, USA, 34–41. https://doi.org/10. 1145/2808435.2808444 [44] Augusto Celentano and Emmanuel Dubois. 2017. Interaction-in-thelarge vs Interaction-in-the-small in Multi-device Systems. In Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter (CHItaly ’17). ACM, New York, NY, USA, Article 19, 10 pages. https://doi.org/10.1145/3125571.3125577 [45] Matthew Chalmers and Areti Galani. 2004. Seamful Interweaving: Heterogeneity in the Theory and Design of Interactive Systems. In Proceedings of the 5th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS ’04). ACM, New York, NY, USA, 243–252. https://doi.org/10.1145/1013115.1013149 [46] Li-Wei Chan, Hsiang-Tao Wu, Hui-Shan Kao, Ju-Chun Ko, HomeRu Lin, Mike Y. Chen, Jane Hsu, and Yi-Ping Hung. 2010. Enabling Beyond-surface Interactions for Interactive Surface with an Invisible Projection. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’10). ACM, New York, NY, USA, 263–272. https://doi.org/10.1145/1866029.1866072 [47] Tsung-Hsiang Chang and Yang Li. 2011. Deep Shot: A Framework for Migrating Tasks Across Devices Using Mobile Phone Cameras. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). ACM, New York, NY, USA, 2163–2172. https: //doi.org/10.1145/1978942.1979257 [48] Sven Charleer, Joris Klerkx, Erik Duval, Tinne De Laet, and Katrien Verbert. 2016. Faceted Search on Coordinated Tablets and Tabletop: A Comparison. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’16). ACM, New York, NY, USA, 165–170. https://doi.org/10.1145/2933242.2935867 [49] Debaleena Chattopadhyay, Kenton O’Hara, Sean Rintel, and Roman Rädle. 2016. Office Social: Presentation Interactivity for Nearby Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 2487–2491. https://doi.org/10.1145/2858036.2858337 [50] Ke-Yu Chen, Daniel Ashbrook, Mayank Goel, Sung-Hyuck Lee, and Shwetak Patel. 2014. AirLink: Sharing Files Between Multiple Devices Using In-air Gestures. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’14). ACM, New York, NY, USA, 565–569. https://doi.org/10.1145/ 2632048.2632090 [51] Min-Yu Chen, Chi-Wei Liu, and Min-Shiang Hwang. 2013. SecureDropbox: A File Encryption System Suitable for Cloud Storage Services. In Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference (CAC ’13). ACM, New York, NY, USA, Article 21, 2 pages. https://doi.org/10.1145/2494621.2494642 [52] Nicholas Chen, Francois Guimbretiere, and Abigail Sellen. 2012. Designing a Multi-slate Reading Environment to Support Active Reading Activities. ACM Trans. Comput.-Hum. Interact. 19, 3, Article 18 (oct 2012), 35 pages. https://doi.org/10.1145/2362364.2362366 [53] Nicholas Chen, François Guimbretière, and Abigail Sellen. 2013. Graduate Student Use of a Multi-slate Reading System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13). ACM, New York, NY, USA, 1799–1808. https://doi.org/10.1145/ 2470654.2466237 [54] Xiang ’Anthony’ Chen, Tovi Grossman, Daniel J. Wigdor, and George Fitzmaurice. 2014. Duet: Exploring Joint Interactions on a Smart Phone and a Smart Watch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 159–168. https://doi.org/10.1145/2556288.2556955 [55] Xiang ‘Anthony’ Chen and Yang Li. 2017. Improv: An Input Framework for Improvising Cross-Device Interaction by Demonstration. ACM Trans. Comput.-Hum. Interact. 24, 2, Article 15 (apr 2017), 21 pages. https://doi.org/10.1145/3057862 [56] Bin Cheng. 2012. Virtual Browser for Enabling Multi-device Web Applications. In Proceedings of the Workshop on Multi-device App Middleware (Multi-Device ’12). ACM, New York, NY, USA, Article 3, 6 pages. https://doi.org/10.1145/2405172.2405175 [57] Jorge H. dos S. Chernicharo, Kazuki Takashima, and Yoshifumi Kitamura. 2013. Seamless Interaction Using a Portable Projector in Perspective Corrected Multi Display Environments. In Proceedings of the 1st Symposium on Spatial User Interaction (SUI ’13). ACM, New York, NY, USA, 25–32. https://doi.org/10.1145/2491367.2491375 [58] Pei-Yu (Peggy) Chi and Yang Li. 2015. Weave: Scripting Cross-Device Wearable Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 3923–3932. https://doi.org/10.1145/2702123.2702451 [59] Apoorve Chokshi, Teddy Seyed, Francisco Marinho Rodrigues, and Frank Maurer. 2014. ePlan Multi-Surface: A Multi-Surface Environment for Emergency Response Planning Exercises. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 219–228. https: //doi.org/10.1145/2669485.2669520 [60] Ming Ki Chong and Hans Gellersen. 2011. How Users Associate Wireless Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). ACM, New York, NY, USA, 1909–1918. https://doi.org/10.1145/1978942.1979219 [61] Ming Ki Chong and Hans W. Gellersen. 2013. How Groups of Users Associate Wireless Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13). ACM, New York, NY, USA, 1559–1568. https://doi.org/10.1145/2470654.2466207 [62] Ming Ki Chong, Rene Mayrhofer, and Hans Gellersen. 2014. A Survey of User Interaction for Spontaneous Device Association. ACM Comput. Surv. 47, 1, Article 8 (July 2014), 40 pages. https: //doi.org/10.1145/2597768 [63] Haeyong Chung and Chris North. 2018. SAViL: Cross-display Visual Links for Sensemaking in Display Ecologies. Personal Ubiquitous Comput. 22, 2 (apr 2018), 409–431. https://doi.org/10.1007/ s00779-017-1091-4 [64] Haeyong Chung, Chris North, Jessica Zeitz Self, Sharon Chu, and Francis Quek. 2014. VisPorter: Facilitating Information Sharing for Collaborative Sensemaking on Multiple Displays. Personal Ubiquitous Comput. 18, 5 (jun 2014), 1169–1186. https://doi.org/10.1007/ s00779-013-0727-2 [65] Christopher Clarke, Alessio Bellino, Augusto Esteves, Eduardo Velloso, and Hans Gellersen. 2016. TraceMatch: A Computer Vision Technique for User Input by Tracing of Animated Controls. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’16). ACM, New York, NY, USA, 298–303. https://doi.org/10.1145/2971648.2971714 [66] Dane Coffey, Nicholas Malbraaten, Trung Le, Iman Borazjani, Fotis Sotiropoulos, and Daniel F. Keefe. 2011. Slice WIM: A Multi-surface, Multi-touch Interface for Overview+Detail Exploration of Volume Datasets in Virtual Reality. In Symposium on Interactive 3D Graphics and Games (I3D ’11). ACM, New York, NY, USA, 191–198. https: //doi.org/10.1145/1944745.1944777 [67] Valentina Conotter, Guido Grassel, and Francesco De Natale. 2014. Multi-device Interaction for Content Sharing. In Proceedings of the 1st International Workshop on Emerging Multimedia Applications and Services for Smart Cities (EMASC ’14). ACM, New York, NY, USA, 29–34. https://doi.org/10.1145/2661704.2661705 [68] Christian Corsten, Ignacio Avellino, Max Möllers, and Jan Borchers. 2013. Instant User Interfaces: Repurposing Everyday Objects As Input Devices. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’13). ACM, New York, NY, USA, 71–80. https://doi.org/10.1145/2512349.2512799 [69] Raimund Dachselt and Robert Buchholz. 2009. Natural Throw and Tilt Interaction Between Mobile Phones and Distant Displays. In CHI ’09 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’09). ACM, New York, NY, USA, 3253–3258. https://doi.org/10. 1145/1520340.1520467 [70] Chi Tai Dang and Elisabeth André. 2014. A Framework for the Development of Multi-display Environment Applications Supporting Interactive Real-time Portals. In Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’14). ACM, New York, NY, USA, 45–54. https://doi.org/10.1145/2607023. 2607038 [71] Elena de la Guía, María Lozano, and Victor R. Penichet. 2013. TrainAb: A Solution Based on Tangible and Distributed User Interfaces to Improve Cognitive Disabilities. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). ACM, New York, NY, USA, 3039–3042. https://doi.org/10.1145/2468356.2479605 [72] Elena de la Guía, María Dolores Lozano, and Víctor M. R. Penichet. 2014. Increasing Engagement in Elderly People Through Tangible and Distributed User Interfaces. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth ’14). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 390–393. https://doi.org/10.4108/icst.pervasivehealth.2014. 255361 [73] Elena de la Guía, María D. Lozano, and Victor M. R. Penichet. 2014. Interacting with Tangible Objects in Distributed Settings. In Proceedings of the 2014 Workshop on Distributed User Interfaces and Multimodal Interaction (DUI ’14). ACM, New York, NY, USA, 15–18. https://doi.org/10.1145/2677356.2677659 [74] David Dearman, Richard Guy, and Khai Truong. 2012. Determining the Orientation of Proximate Mobile Devices Using Their Back Facing Camera. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA, 2231–2234. https://doi.org/10.1145/2207676.2208377 [75] David Dearman and Jeffery S. Pierce. 2008. It’s on My Other Computer!: Computing with Multiple Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08). ACM, New York, NY, USA, 767–776. https://doi.org/10.1145/ 1357054.1357177 [76] Alexandre Demeure, Gaëlle Calvary, Jean-Sebastien Sottet, and Jean Vanderdonkt. 2005. A Reference Model for Distributed User Interfaces. In Proceedings of the 4th International Workshop on Task Models and Diagrams (TAMODIA ’05). ACM, New York, NY, USA, 79–86. https: //doi.org/10.1145/1122935.1122952 [77] Anind K. Dey, Peter Ljungstrand, and Albrecht Schmidt. 2001. Distributed and Disappearing User Interfaces in Ubiquitous Computing. In CHI ’01 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’01). ACM, New York, NY, USA, 487–488. https: //doi.org/10.1145/634067.634346 [78] Linda Di Geronimo, Marica Bertarini, Julia Badertscher, Maria Husmann, and Moira C. Norrie. 2017. MyoShare: Sharing Data Among Devices via Mid-air Gestures. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’17). ACM, New York, NY, USA, Article 48, 3 pages. https://doi.org/10.1145/3098279.3125436 [79] Linda Di Geronimo, Maria Husmann, and Moira C. Norrie. 2016. Surveying Personal Device Ecosystems with Cross-device Applications in Mind. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis ’16). ACM, New York, NY, USA, 220–227. https://doi.org/10.1145/2914920.2915028 [80] Linda Di Geronimo and Moira C. Norrie. 2016. Rapid Development of Web Applications That Use Tilting Interactions in Single and MultiDevice Scenarios. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI ’16). ACM, New York, NY, USA, 354–355. https://doi.org/10.1145/2909132.2926088 [81] Jakub Dostal. 2013. Designing Context-aware Display Ecosystems. In Proceedings of the Companion Publication of the 2013 International Conference on Intelligent User Interfaces Companion (IUI ’13 Companion). ACM, New York, NY, USA, 1–4. https://doi.org/10.1145/2451176. 2451178 [82] Jakub Dostal, Per Ola Kristensson, and Aaron Quigley. 2013. Subtle Gaze-dependent Techniques for Visualising Display Changes in Multi-display Environments. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (IUI ’13). ACM, New York, NY, USA, 137–148. https://doi.org/10.1145/2449396.2449416 [83] Paul Dourish. 2004. Where the Action Is (new ed edition ed.). MIT Press, Cambridge, Mass. [84] John Dowell and Edward Anstead. 2017. Interaction with a TV Companion App As Synopsis and Supplement. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 2264–2268. https://doi.org/10.1145/ 3025453.3025459 [85] John Dowell, Sylvain Malacria, Hana Kim, and Edward Anstead. 2015. Companion Apps for Information-rich Television Programmes: Representation and Interaction. Personal Ubiquitous Comput. 19, 7 (oct 2015), 1215–1228. https://doi.org/10.1007/s00779-015-0867-7 [86] Niklas Elmqvist. 2011. Distributed User Interfaces: State of the Art. Springer London, London, 1–12. https://doi.org/10.1007/ 978-1-4471-2271-5_1 [87] Habib M. Fardoun, Abdullah AL-Malaise AL-Ghamdi, and Antonio Paules Cipres. 2014. Improving Surgery Operations by Means of Cloud Systems and Distributed User Interfaces. In Proceedings of the 2014 Workshop on Distributed User Interfaces and Multimodal Interaction (DUI ’14). ACM, New York, NY, USA, 31–36. https: //doi.org/10.1145/2677356.2677663 [88] Camille Fayollas, Célia Martinie, David Navarre, Philippe Palanque, and Racim Fahssi. 2014. Fault-Tolerant User Interfaces for Critical Systems: Duplication, Redundancy and Diversity As New Dimensions of Distributed User Interfaces. In Proceedings of the 2014 Workshop on Distributed User Interfaces and Multimodal Interaction (DUI ’14). ACM, New York, NY, USA, 27–30. https://doi.org/10.1145/2677356.2677662 [89] Shenfeng Fei, Andrew M. Webb, Andruid Kerne, Yin Qu, and Ajit Jain. 2013. Peripheral Array of Tangible NFC Tags: Positioning Portals for Embodied Trans-surface Interaction. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’13). ACM, New York, NY, USA, 33–36. https://doi.org/10.1145/2512349. 2512820 [90] George W. Fitzmaurice. 1993. Situated Information Spaces and Spatially Aware Palmtop Computers. Commun. ACM 36, 7 (jul 1993), 39–49. https://doi.org/10.1145/159544.159566 [91] Clifton Forlines, Alan Esenther, Chia Shen, Daniel Wigdor, and Kathy Ryall. 2006. Multi-user, Multi-display Interaction with a Single-user, Single-display Geospatial Application. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (UIST ’06). ACM, New York, NY, USA, 273–276. https: //doi.org/10.1145/1166253.1166296 [92] Clifton Forlines and Ryan Lilien. 2008. Adapting a Single-user, Singledisplay Molecular Visualization Application for Use in a Multi-user, Multi-display Environment. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’08). ACM, New York, NY, USA, 367–371. https://doi.org/10.1145/1385569.1385635 [93] Luca Frosini and Fabio Paternò. 2014. User Interface Distribution in Multi-device and Multi-user Environments with Dynamically Migrating Engines. In Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’14). ACM, New York, NY, USA, 55–64. https://doi.org/10.1145/2607023.2607032 [94] Johannes Fuchs, Roman Rädle, Dominik Sacha, Fabian Fischer, and Andreas Stoffel. 2013. Collaborative data analysis with smart tangible devices. In Proc. SPIE, Vol. 9017. 15. https://doi.org/10.1117/12.2040011 [95] Andrea Gallidabino and Cesare Pautasso. 2016. The Liquid.Js Framework for Migrating and Cloning Stateful Web Components Across Multiple Devices. In Proceedings of the 25th International Conference Companion on World Wide Web (WWW ’16 Companion). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 183–186. https://doi.org/10. 1145/2872518.2890538 [96] Andrea Gallidabino and Cesare Pautasso. 2018. The Liquid User Experience API. In Companion Proceedings of the The Web Conference 2018 (WWW ’18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 767–774. https://doi.org/10.1145/3184558.3188738 [97] Hans Gellersen, Carl Fischer, Dominique Guinard, Roswitha Gostner, Gerd Kortuem, Christian Kray, Enrico Rukzio, and Sara Streng. 2009. Supporting Device Discovery and Spontaneous Interaction with Spatial References. Personal Ubiquitous Comput. 13, 4 (may 2009), 255–264. https://doi.org/10.1007/s00779-008-0206-3 [98] Florian Geyer, Hans-Christian Jetter, Ulrike Pfeil, and Harald Reiterer. 2010. Collaborative Sketching with Distributed Displays and Multimodal Interfaces. In ACM International Conference on Interactive Tabletops & Surfaces (ITS ’10). ACM, New York, NY, USA, 259–260. https://doi.org/10.1145/1936652.1936705 [99] Giuseppe Ghiani, Marco Manca, and Fabio Paternò. 2015. Authoring Context-dependent Cross-device User Interfaces Based on Trigger/Action Rules. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia (MUM ’15). ACM, New York, NY, USA, 313–322. https://doi.org/10.1145/2836041.2836073 [100] Giuseppe Ghiani, Fabio Paternò, and Lorenzo Isoni. 2012. Security in Migratory Interactive Web Applications. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM ’12). ACM, New York, NY, USA, Article 15, 10 pages. https://doi.org/ 10.1145/2406367.2406386 [101] Giuseppe Ghiani, Fabio Paternò, and Carmen Santoro. 2010. Ondemand Cross-device Interface Components Migration. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’10). ACM, New York, NY, USA, 299–308. https://doi.org/10.1145/1851600.1851653 [102] Tony Gjerlufsen, Clemens Nylandsted Klokmose, James Eagan, Clément Pillias, and Michel Beaudouin-Lafon. 2011. Shared Substance: Developing Flexible Multi-surface Applications. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). ACM, New York, NY, USA, 3383–3392. https://doi.org/10.1145/ 1978942.1979446 [103] Mayank Goel, Brendan Lee, Md. Tanvir Islam Aumi, Shwetak Patel, Gaetano Borriello, Stacie Hibino, and Bo Begole. 2014. SurfaceLink: Using Inertial and Acoustic Sensing to Enable Multi-device Interaction on a Surface. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 1387–1396. https://doi.org/10.1145/2556288.2557120 [104] Saul Greenberg, Sebastian Boring, Jo Vermeulen, and Jakub Dostal. 2014. Dark Patterns in Proxemic Interactions: A Critical Perspective. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS ’14). ACM, New York, NY, USA, 523–532. https://doi.org/10. 1145/2598510.2598541 [105] Saul Greenberg, Michael Boyle, and Jason LaBerge. 1999. PDAs and shared public displays: Making personal information public, and public information personal. Personal Technologies 3, 1-2 (1999), 54– 64. [106] Saul Greenberg and Bill Buxton. 2008. Usability Evaluation Considered Harmful (Some of the Time). In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08). ACM, New York, NY, USA, 111–120. https://doi.org/10.1145/1357054.1357074 [107] Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? interactions 18, 1 (Jan. 2011), 42–50. https://doi.org/10.1145/1897239. 1897250 [108] Casey Grote, Evan Segreto, Johanna Okerlund, Robert Kincaid, and Orit Shaer. 2015. Eugenie: Multi-Touch and Tangible Interaction for Bio-Design. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’15). ACM, New York, NY, USA, 217–224. https://doi.org/10.1145/2677199.2680605 [109] Jens Grubert, Matthias Heinisch, Aaron Quigley, and Dieter Schmalstieg. 2015. MultiFi: Multi Fidelity Interaction with Displays On and Around the Body. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 3933–3942. https://doi.org/10.1145/2702123.2702331 [110] Jens Grubert and Matthias Kranz. 2017. HeadPhones: Ad Hoc Mobile Multi-Display Environments Through Head Tracking. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 3966–3971. https://doi.org/10. 1145/3025453.3025533 [111] Jens Grubert, Matthias Kranz, and Aaron Quigley. 2016. Challenges in mobile multi-device ecosystems. mUX: The Journal of Mobile User Experience 5, 1 (26 Aug 2016), 5. https://doi.org/10.1186/ s13678-016-0007-y [112] Jonathan Grudin. 2001. Partitioning Digital Worlds: Focal and Peripheral Awareness in Multiple Monitor Use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’01). ACM, New York, NY, USA, 458–465. https://doi.org/10.1145/365024.365312 [113] John Grundy and Weiguo Jin. 2002. Experiences Developing a Thinclient, Multi-device Travel Planning Application. In Proceedings of the SIGCHI-NZ Symposium on Computer-Human Interaction (CHINZ ’02). ACM, New York, NY, USA, 85–90. https://doi.org/10.1145/2181216. 2181231 [114] Jonathan Haber, Miguel A. Nacenta, and Sheelagh Carpendale. 2014. Paper vs. Tablets: The Effect of Document Media in Co-located Collaborative Work. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI ’14). ACM, New York, NY, USA, 89–96. https://doi.org/10.1145/2598153.2598170 [115] Edward Twitchell Hall. 1966. The Hidden Dimension (1st ed. ed.). Doubleday, Garden City, N.Y. [116] Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: Enabling and Understanding Cross-device Interaction. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 2773–2782. https://doi.org/10. 1145/2556288.2557170 [117] Richard Han, Veronique Perret, and Mahmoud Naghshineh. 2000. WebSplitter: A Unified XML Framework for Multi-device Collaborative Web Browsing. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW ’00). ACM, New York, NY, USA, 221–230. https://doi.org/10.1145/358916.358993 [118] David Hannah, Martin Halvey, Graham Wilson, and Stephen A. Brewster. 2011. Using Multimodal Interactions for 3D Television and Multimedia Browsing. In Proceedings of the 9th European Conference on Interactive TV and Video (EuroITV ’11). ACM, New York, NY, USA, 181–184. https://doi.org/10.1145/2000119.2000156 [119] Robert Hardy and Enrico Rukzio. 2008. Touch & Interact: Touchbased Interaction of Mobile Phones with Displays. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’08). ACM, New York, NY, USA, 245–254. https://doi.org/10.1145/1409240.1409267 [120] Björn Hartmann, Michel Beaudouin-Lafon, and Wendy E. Mackay. 2013. HydraScope: Creating Multi-surface Meta-applications Through View Synchronization and Input Multiplexing. In Proceedings of the 2nd ACM International Symposium on Pervasive Displays (PerDis ’13). ACM, New York, NY, USA, 43–48. https://doi.org/10. 1145/2491568.2491578 [121] Khalad Hasan, David Ahlström, and Pourang Irani. 2015. SAMMI: A Spatially-Aware Multi-Mobile Interface for Analytic Map Navigation Tasks. In Proceedings of the 17th International Conference on HumanComputer Interaction with Mobile Devices and Services (MobileHCI ’15). ACM, New York, NY, USA, 36–45. https://doi.org/10.1145/2785830. 2785850 [122] Nabeel Hassan, Md Mahfuzur Rahman, Pourang Irani, and Peter Graham. 2009. Chucking: A one-handed document sharing technique. In IFIP Conference on Human-Computer Interaction. Springer, 264–278. [123] Mike Hazas, Christian Kray, Hans Gellersen, Henoc Agbota, Gerd Kortuem, and Albert Krohn. 2005. A Relative Positioning System for Co-located Mobile Devices. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (MobiSys ’05). ACM, New York, NY, USA, 177–190. https://doi.org/10.1145/1067170. 1067190 [124] Tommi Heikkinen, Jorge Goncalves, Vassilis Kostakos, Ivan Elhart, and Timo Ojala. 2014. Tandem Browsing Toolkit: Distributed MultiDisplay Interfaces with Web Technologies. In Proceedings of The International Symposium on Pervasive Displays (PerDis ’14). ACM, New York, NY, USA, Article 142, 6 pages. https://doi.org/10.1145/ 2611009.2611026 [125] Rorik Henrikson, Bruno Araujo, Fanny Chevalier, Karan Singh, and Ravin Balakrishnan. 2016. Multi-Device Storyboards for Cinematic Narratives in VR. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). ACM, New York, NY, USA, 787–796. https://doi.org/10.1145/2984511.2984539 [126] J. Hightower and G. Borriello. 2001. Location systems for ubiquitous computing. Computer 34, 8 (Aug. 2001), 57–66. https://doi.org/10. 1109/2.940014 [127] Ken Hinckley. 2003. Synchronous Gestures for Multiple Persons and Computers. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST ’03). ACM, New York, NY, USA, 149–158. https://doi.org/10.1145/964696.964713 [128] Ken Hinckley, Morgan Dixon, Raman Sarin, Francois Guimbretiere, and Ravin Balakrishnan. 2009. Codex: A Dual Screen Tablet Computer. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’09). ACM, New York, NY, USA, 1933–1942. https://doi.org/10.1145/1518701.1518996 [129] Ken Hinckley, Gonzalo Ramos, Francois Guimbretiere, Patrick Baudisch, and Marc Smith. 2004. Stitching: Pen Gestures That Span Multiple Displays. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’04). ACM, New York, NY, USA, 23–31. https://doi.org/10.1145/989863.989866 [130] Daniel Hintze, Rainhard D. Findling, Muhammad Muaaz, Eckhard Koch, and René Mayrhofer. 2015. Cormorant: Towards Continuous Risk-aware Multi-modal Cross-device Authentication. In Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers (UbiComp/ISWC’15 Adjunct). ACM, New York, NY, USA, 169–172. https://doi.org/10. 1145/2800835.2800906 [131] Lars Erik Holmquist, Friedemann Mattern, Bernt Schiele, Petteri Alahuhta, Michael Beigl, and Hans-Werner Gellersen. 2001. Smart-Its Friends: A Technique for Users to Easily Establish Connections Between Smart Artefacts. In Proceedings of the 3rd International Conference on Ubiquitous Computing (UbiComp ’01). Springer-Verlag, London, UK, UK, 116–122. http://dl.acm.org/citation.cfm?id=647987. 741340 [132] Christian Holz, Frank Bentley, Karen Church, and Mitesh Patel. 2015. “I’m Just on My Phone and They’re Watching TV”: Quantifying Mobile Device Use While Watching Television. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’15). ACM, New York, NY, USA, 93–102. https://doi.org/10.1145/2745197.2745210 [133] Christian Holz and Frank R. Bentley. 2016. On-Demand Biometrics: Fast Cross-Device Authentication. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 3761–3766. https://doi.org/10.1145/2858036. 2858139 [134] Christian Holz and Marius Knaust. 2015. Biometric Touch Sensing: Seamlessly Augmenting Each Touch with Continuous Authentication. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, 303–312. https://doi.org/10.1145/2807442.2807458 [135] Leila Homaeian, Nippun Goyal, James R. Wallace, and Stacey D. Scott. 2017. Investigating Communication Grounding in Cross-Surface Interaction. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS ’17). ACM, New York, NY, USA, 348–353. https://doi.org/10.1145/3132272.3132282 [136] Leila Homaeian, Nippun Goyal, James R. Wallace, and Stacey D. Scott. 2018. Group vs Individual: Impact of TOUCH and TILT Cross-Device Interactions on Mixed-Focus Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 73, 13 pages. https://doi.org/10. 1145/3173574.3173647 [137] Tsz-Kin Hon, Lin Wang, Joshua D. Reiss, and Andrea Cavallaro. 2015. Audio Fingerprinting for Multi-device Self-localization. IEEE/ACM Trans. Audio, Speech and Lang. Proc. 23, 10 (oct 2015), 1623–1636. https://doi.org/10.1109/TASLP.2015.2442417 [138] Tom Horak, Sriram Karthik Badam, Niklas Elmqvist, and Raimund Dachselt. 2018. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 19, 13 pages. https://doi.org/10.1145/3173574.3173593 [139] Tom Horak, Ulrike Kister, and Raimund Dachselt. 2016. Presenting Business Data: Challenges During Board Meetings in Multi-Display Environments. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 319–324. https: //doi.org/10.1145/2992154.2996774 [140] Steven Houben and Jakob E. Bardram. 2013. ActivityDesk: Multidevice Configuration Work Using an Interactive Desk. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). ACM, New York, NY, USA, 721–726. https://doi.org/10.1145/ 2468356.2468484 [141] Steven Houben and Nicolai Marquardt. 2015. WatchConnect: A Toolkit for Prototyping Smartwatch-Centric Cross-Device Applications. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 1247–1256. https://doi.org/10.1145/2702123.2702215 [142] Steven Houben, Nicolai Marquardt, Jo Vermeulen, Clemens Klokmose, Johannes Schöning, Harald Reiterer, and Christian Holz. 2017. Opportunities and Challenges for Cross-device Interactions in the Wild. interactions 24, 5 (Aug 2017), 58–63. https://doi.org/10.1145/3121348 [143] Steven Houben, Paolo Tell, and Jakob E. Bardram. 2014. ActivitySpace: Managing Device Ecologies in an Activity-Centric Configuration Space. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 119–128. https://doi.org/10.1145/2669485.2669493 [144] Steven Houben, Jo Vermeulen, Clemens Klokmose, Nicolai Marquardt, Johannes Schöning, and Harald Reiterer. 2015. Cross-Surface: Workshop on Interacting with Multi-Device Ecologies in the Wild. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS ’15). ACM, New York, NY, USA, 485–489. https://doi.org/10.1145/2817721.2835067 [145] Gang Hu, Derek Reilly, Mohammed Alnusayri, Ben Swinden, and Qigang Gao. 2014. DT-DT: Top-down Human Activity Analysis for Interactive Surface Applications. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 167–176. https://doi.org/10.1145/2669485. 2669501 [146] Zhigang Hua, Yutaka Kidawara, Hanqing Lu, and Katsumi Tanaka. 2005. A Collaborative Environment for Enhanced Information Access on Small-form-factor Devices. In Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices &Amp; Services (MobileHCI ’05). ACM, New York, NY, USA, 325–326. https: //doi.org/10.1145/1085777.1085848 [147] Da-Yuan Huang, Chien-Pang Lin, Yi-Ping Hung, Tzu-Wen Chang, Neng-Hao Yu, Min-Lun Tsai, and Mike Y. Chen. 2012. MagMobile: Enhancing Social Interactions with Rapid View-stitching Games of Mobile Devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM ’12). ACM, New York, NY, USA, Article 61, 4 pages. https://doi.org/10.1145/2406367.2406440 [148] Elaine M. Huang, Elizabeth D. Mynatt, and Jay P. Trimble. 2007. When Design Just Isn’t Enough: The Unanticipated Challenges of the Real World for Large Collaborative Displays. Personal Ubiquitous Comput. 11, 7 (Oct 2007), 537–547. https://doi.org/10.1007/s00779-006-0114-3 [149] Maria Husmann. 2017. Investigating Tool Support for Cross-Device Development. Ph.D. Dissertation. ETH Zurich. [150] Maria Husmann, Nina Heyder, and Moira C. Norrie. 2016. Is a Framework Enough?: Cross-device Testing and Debugging. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’16). ACM, New York, NY, USA, 251–262. https://doi.org/10.1145/2933242.2933249 [151] Maria Husmann, Nicola Marcacci Rossi, and Moira C. Norrie. 2016. Usage Analysis of Cross-device Web Applications. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis ’16). ACM, New York, NY, USA, 212–219. https://doi.org/10.1145/ 2914920.2915017 [152] Maria Husmann, Michael Spiegel, Alfonso Murolo, and Moira C. Norrie. 2016. UI Testing Cross-Device Applications. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 179–188. https://doi.org/10.1145/2992154.2992177 [153] Dugald Ralph Hutchings, Greg Smith, Brian Meyers, Mary Czerwinski, and George Robertson. 2004. Display Space Usage and Window Management Operation Comparisons Between Single Monitor and Multiple Monitor Users. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’04). ACM, New York, NY, USA, 32–39. https://doi.org/10.1145/989863.989867 [154] Heather M. Hutchings and Jeffrey S. Pierce. 2006. Understanding the Whethers, Hows, and Whys of Divisible Interfaces. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’06). ACM, New York, NY, USA, 274–277. https://doi.org/10.1145/1133265. 1133320 [155] Peter Hutterer, Benjamin S. Close, and Bruce H. Thomas. 2006. TIDL: Mixed Presence Groupware Support for Legacy and Custom Applications. In Proceedings of the 7th Australasian User Interface Conference - Volume 50 (AUIC ’06). Australian Computer Society, Inc., Darlinghurst, Australia, Australia, 117–124. http://dl.acm.org/citation. cfm?id=1151758.1151775 [156] Heidi Pi Jensen, Marius Pallisgaard Olsen, and Mikael B. Skov. 2016. PinchPan: Investigating Children’s Collaboration in Cross-Device Interaction. In Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology (ACE2016). ACM, New York, NY, USA, Article 9, 6 pages. https://doi.org/10.1145/ 3001773.3001789 [157] Mads Møller Jensen, Roman Rädle, Clemens N. Klokmose, and Susanne Bodker. 2018. Remediating a Design Tool: Implications of Digitizing Sticky Notes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 224, 12 pages. https://doi.org/10.1145/3173574.3173798 [158] Hans-Christian Jetter, Michael Zöllner, Jens Gerken, and Harald Reiterer. 2012. Design and implementation of post-WIMP distributed user interfaces with ZOIL. International Journal of Human-Computer Interaction 28, 11 (2012), 737–747. [159] Haojian Jin, Christian Holz, and Kasper Hornbæk. 2015. Tracko: Adhoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, 147–156. https://doi.org/10.1145/2807442. 2807475 [160] Haojian Jin, Cheng Xu, and Kent Lyons. 2015. Corona: Positioning Adjacent Device with Asymmetric Bluetooth Low Energy RSSI Distributions. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, 175–179. https://doi.org/10.1145/2807442.2807485 [161] Yucheng Jin, Chi Tai Dang, Christian Prehofer, and Elisabeth André. 2014. A Multi-Display System for Deploying and Controlling Home Automation. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 399–402. https://doi.org/10.1145/2669485.2669553 [162] Robert Johansen. 1988. GroupWare: Computer Support for Business Teams. The Free Press, New York, NY, USA. [163] Brad Johanson, Greg Hutchins, Terry Winograd, and Maureen Stone. 2002. PointRight: Experience with Flexible Input Redirection in Interactive Workspaces. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST ’02). ACM, New York, NY, USA, 227–234. https://doi.org/10.1145/571985.572019 [164] Brad Johanson, Shankar Ponnekanti, Caesar Sengupta, and Armando Fox. 2001. Multibrowsing: Moving Web Content Across Multiple Displays. In Proceedings of the 3rd International Conference on Ubiquitous Computing (UbiComp ’01). Springer-Verlag, London, UK, UK, 346–353. http://dl.acm.org/citation.cfm?id=647987.741346 [165] Tero Jokela, Jarno Ojala, Guido Grassel, Petri Piippo, and Thomas Olsson. 2015. A Comparison of Methods to Move Visual Objects Between Personal Mobile Devices in Different Contexts of Use. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’15). ACM, New York, NY, USA, 172–181. https://doi.org/10.1145/2785830.2785841 [166] Tero Jokela, Parisa Pour Rezaei, and Kaisa Väänänen. 2016. Natural Group Binding and Cross-display Object Movement Methods for Wearable Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’16). ACM, New York, NY, USA, 206–216. https://doi.org/ 10.1145/2935334.2935346 [167] Rachel Jones, Sarah Clinch, Jason Alexander, Nigel Davies, and Mateusz Mikusz. 2015. ENGAGE: Early Insights in Measuring MultiDevice Engagements. In Proceedings of the 4th International Symposium on Pervasive Displays (PerDis ’15). ACM, New York, NY, USA, 31–37. https://doi.org/10.1145/2757710.2757720 [168] Heekyoung Jung, Erik Stolterman, Will Ryan, Tonya Thompson, and Marty Siegel. 2008. Toward a Framework for Ecologies of Artifacts: How Are Digital Artifacts Interconnected Within a Personal Life?. In Proceedings of the 5th Nordic Conference on Human-computer Interaction: Building Bridges (NordiCHI ’08). ACM, New York, NY, USA, 201–210. https://doi.org/10.1145/1463160.1463182 [169] Seungki Kim, Donghyeon Ko, and Woohun Lee. 2017. Utilizing Smartphones As a Multi-Device Single Display Groupware to Design Collaborative Games. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17). ACM, New York, NY, USA, 1341–1352. https://doi.org/10.1145/3064663.3064716 [170] Seongwoon Kim, Inseong Lee, Kiho Lee, Seungki Jung, Joonah Park, Yeun Bae Kim, Sang Ryong Kim, and Jinwoo Kim. 2010. Mobile Web 2.0 with Multi-display Buttons. Commun. ACM 53, 1 (jan 2010), 136–141. https://doi.org/10.1145/1629175.1629208 [171] U. Kister, K. Klamka, C. Tominski, and R. Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Computer Graphics Forum 36, 3 (June 2017), 503–514. https://doi.org/10.1111/cgf.13206 [172] Randy Klaassen, Rieks op den Akker, and Harm op den Akker. 2013. Feedback Presentation for Mobile Personalised Digital Physical Activity Coaching Platforms. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments (PETRA ’13). ACM, New York, NY, USA, Article 64, 8 pages. https://doi.org/10.1145/2504335.2504404 [173] Clemens Nylandsted Klokmose and Michel Beaudouin-Lafon. 2009. VIGO: Instrumental Interaction in Multi-surface Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’09). ACM, New York, NY, USA, 869–878. https://doi. org/10.1145/1518701.1518833 [174] Clemens N. Klokmose, James R. Eagan, Siemen Baader, Wendy Mackay, and Michel Beaudouin-Lafon. 2015. Webstrates: Shareable Dynamic Media. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, 280–290. https://doi.org/10.1145/2807442.2807446 [175] Clemens Nylandsted Klokmose, Matthias Korn, and Henrik Blunck. 2014. WiFi Proximity Detection in Mobile Web Applications. In Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’14). ACM, New York, NY, USA, 123–128. https://doi.org/10.1145/2607023.2610281 [176] Stefanie Klum, Petra Isenberg, Ricardo Langner, Jean-Daniel Fekete, and Raimund Dachselt. 2012. Stackables: Combining Tangibles for Faceted Browsing. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI ’12). ACM, New York, NY, USA, 241–248. https://doi.org/10.1145/2254556.2254600 [177] Oskari Koskimies, Johan Wikman, Tapani Mikola, and Antero Taivalsaari. 2015. EDB: A Multi-master Database for Liquid Multi-device Software. In Proceedings of the Second ACM International Conference on Mobile Software Engineering and Systems (MOBILESoft ’15). IEEE Press, Piscataway, NJ, USA, 125–128. http://dl.acm.org/citation.cfm? id=2825041.2825064 [178] Anna Kötteritzsch, Julian Fietkau, Katrin Paldan, and Michael Koch. 2016. Connecting Interaction with Smart Urban Objects for Individual Support in Neighborhood Participation. In Proceedings of the 6th International Conference on the Internet of Things (IoT’16). ACM, New York, NY, USA, 165–166. https://doi.org/10.1145/2991561.2998475 [179] Stefan Kreitmayer, Yvonne Rogers, Robin Laney, and Stephen Peake. 2013. UniPad: Orchestrating Collaborative Activities Through Shared Tablets and an Integrated Wall Display. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’13). ACM, New York, NY, USA, 801–810. https://doi.org/ 10.1145/2493432.2493506 [180] Thomas Kubitza. 2016. Apps for Environments: Demonstrating Pluggable Apps for Multi-Device IoT-Setups. In Proceedings of the 6th International Conference on the Internet of Things (IoT’16). ACM, New York, NY, USA, 185–186. https://doi.org/10.1145/2991561.2998473 [181] Yuki Kubo, Ryosuke Takada, Buntarou Shizuki, and Shin Takahashi. 2017. Exploring Context-Aware User Interfaces for SmartphoneSmartwatch Cross-Device Interaction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 69 (Sep 2017), 21 pages. https://doi.org/10.1145/3130934 [182] Romina Kühn, Mandy Korzetz, Lukas Büschel, Christina Korger, Philip Manja, and Thomas Schlegel. 2016. Natural Voting Interactions for Collaborative Work with Mobile Devices. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’16). ACM, New York, NY, USA, 2570–2575. https://doi.org/10.1145/2851581.2892300 [183] Christian Lander, Sven Gehring, Antonio Krüger, Sebastian Boring, and Andreas Bulling. 2015. GazeProjector: Accurate Gaze Estimation and Seamless Gaze Interaction Across Multiple Displays. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST ’15). ACM, New York, NY, USA, 395–404. https://doi.org/10.1145/2807442.2807479 [184] David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, 36:1–36:17. https://doi.org/10.1145/3173574.3173610 [185] Hyunglae Lee, Heeseok Jeong, JoongHo Lee, Ki-Won Yeom, Hyun-Jin Shin, and Ji-Hyung Park. 2008. Select-and-point: A Novel Interface for Multi-device Connection and Control Based on Simple Hand Gestures. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’08). ACM, New York, NY, USA, 3357–3362. https://doi.org/ 10.1145/1358628.1358857 [186] Sang-won Leigh, Philipp Schoessler, Felix Heibeck, Pattie Maes, and Hiroshi Ishii. 2015. THAW: Tangible Interaction with See-Through Augmentation for Smartphones on Computer Screens. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’15). ACM, New York, NY, USA, 89–96. https://doi.org/10.1145/2677199.2680584 [187] Ming Li and Leif Kobbelt. 2012. Dynamic Tiling Display: Building an Interactive Display Surface Using Multiple Mobile Devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM ’12). ACM, New York, NY, USA, Article 24, 4 pages. https://doi.org/10.1145/2406367.2406397 [188] Hai-Ning Liang, Cary Williams, Myron Semegen, Wolfgang Stuerzlinger, and Pourang Irani. 2012. User-defined Surface+Motion Gestures for 3D Manipulation of Objects at a Distance Through a Mobile Device. In Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction (APCHI ’12). ACM, New York, NY, USA, 299–308. https://doi.org/10.1145/2350046.2350098 [189] Hyunchul Lim, YoonKyong Cho, Wonjong Rhee, and Bongwon Suh. 2015. Vi-Bros: Tactile Feedback for Indoor Navigation with a Smartphone and a Smartwatch. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’15). ACM, New York, NY, USA, 2115–2120. https://doi.org/10.1145/2702613.2732811 [190] Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-themaround: Collaborative Use of Mobile Phones for Photo Sharing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). ACM, New York, NY, USA, 1787–1796. https: //doi.org/10.1145/1978942.1979201 [191] Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2012. MobiComics: Collaborative Use of Mobile Phones and Large Displays for Public Expression. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI ’12). ACM, New York, NY, USA, 383–392. https: //doi.org/10.1145/2371574.2371634 [192] Andrés Lucero, Jaakko Keränen, and Hannu Korhonen. 2010. Collaborative Use of Mobile Phones for Brainstorming. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’10). ACM, New York, NY, USA, 337–340. https://doi.org/10.1145/1851600.1851659 [193] Kris Luyten, Kristof Verpoorten, and Karin Coninx. 2007. Ad-hoc Co-located Collaborative Work with Mobile Devices. In Proceedings of the 9th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’07). ACM, New York, NY, USA, 507–514. https://doi.org/10.1145/1377999.1378061 [194] Leilah Lyons. 2007. Scaffolding Cooperative Multi-device Activities in an Informal Learning Environment. In Proceedings of the 6th International Conference on Interaction Design and Children (IDC ’07). ACM, New York, NY, USA, 189–192. https://doi.org/10.1145/1297277. 1297326 [195] Leilah Lyons, Joseph Lee, Christopher Quintana, and Elliot Soloway. 2006. MUSHI: A Multi-device Framework for Collaborative Inquiry Learning. In Proceedings of the 7th International Conference on Learning Sciences (ICLS ’06). International Society of the Learning Sciences, 453–459. http://dl.acm.org/citation.cfm?id=1150034.1150100 [196] Carsten Magerkurth and Thorsten Prante. 2001. Towards a Unifying Approach to Mobile Computing. SIGGROUP Bull. 22, 1 (April 2001), 16–21. https://doi.org/10.1145/500721.500725 [197] Narges Mahyar, Kelly J. Burke, Jialiang (Ernest) Xiang, Siyi (Cathy) Meng, Kellogg S. Booth, Cynthia L. Girling, and Ronald W. Kellett. 2016. UD Co-Spaces: A Table-Centred Multi-Display Environment for Public Engagement in Urban Design Charrettes. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 109–118. https://doi.org/10.1145/2992154.2992163 [198] Ville Mäkelä, Mohamed Khamis, Lukas Mecke, Jobin James, Markku Turunen, and Florian Alt. 2018. Pocket Transfers: Interaction Techniques for Transferring Content from Situated Displays to Mobile Devices. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 135, 13 pages. https://doi.org/10.1145/3173574.3173709 [199] Niko Mäkitalo. 2014. Building and Programming Ubiquitous Social Devices. In Proceedings of the 12th ACM International Symposium on Mobility Management and Wireless Access (MobiWac ’14). ACM, New York, NY, USA, 99–108. https://doi.org/10.1145/2642668.2642678 [200] Marco Manca and Fabio Paternò. 2016. Customizable Dynamic User Interface Distribution. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’16). ACM, New York, NY, USA, 27–37. https://doi.org/10.1145/2933242.2933259 [201] Yoshihisa Mano, Kazuhito Omaki, and Koji Torii. 1981. An Intelligent Multi-display Terminal System Towards: A Better Programming Environment. SIGSOFT Softw. Eng. Notes 6, 2 (apr 1981), 8–14. https://doi.org/10.1145/1010865.1010866 [202] Yoshihisa Mano, Kazuhito Omaki, and Koji Torii. 1982. Early Experiences with a Multi-display Programming Environment. In Proceedings of the 6th International Conference on Software Engineering (ICSE ’82). IEEE Computer Society Press, Los Alamitos, CA, USA, 422–423. http://dl.acm.org/citation.cfm?id=800254.807788 [203] Nicolai Marquardt, Till Ballendat, Sebastian Boring, Saul Greenberg, and Ken Hinckley. 2012. Gradual Engagement: Facilitating Information Exchange Between Digital Devices As a Function of Proximity. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’12). ACM, New York, NY, USA, 31–40. https://doi.org/10.1145/2396636.2396642 [204] Nicolai Marquardt, Frederik Brudy, Can Liu, Ben Bengler, and Christian Holz. 2018. SurfaceConstellations: A Modular Hardware Platform for Ad-Hoc Reconfigurable Cross-Device Workspaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 354, 14 pages. https://doi.org/10.1145/3173574.3173928 [205] Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST ’11). ACM, New York, NY, USA, 315–326. https: //doi.org/10.1145/2047196.2047238 [206] Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Crossdevice Interaction via Micro-mobility and F-formations. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST ’12). ACM, New York, NY, USA, 13–22. https://doi.org/10.1145/2380116.2380121 [207] Nicolai Marquardt, Frederico Schardong, and Anthony Tang. 2015. EXCITE: Exploring collaborative interaction in tracked environments. In Human-Computer Interaction. Springer, 89–97. [208] Reed Martin and Henry Holtzman. 2010. Newstream: A Multi-device, Cross-medium, and Socially Aware Approach to News Content. In Proceedings of the 8th European Conference on Interactive TV and Video (EuroITV ’10). ACM, New York, NY, USA, 83–90. https://doi.org/10. 1145/1809777.1809797 [209] Roberto Martinez-Maldonado, Peter Goodyear, Judy Kay, Kate Thompson, and Lucila Carvalho. 2016. An Actionable Approach to Understand Group Experience in Complex, Multi-surface Spaces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 2062–2074. https://doi.org/10.1145/2858036.2858213 [210] Masood Masoodian, Saturnino Luz, and David Kavenga. 2016. Nuview: A Visualization System for Collaborative Co-located Analysis of Geospatial Disease Data. In Proceedings of the Australasian Computer Science Week Multiconference (ACSW ’16). ACM, New York, NY, USA, Article 48, 10 pages. https://doi.org/10.1145/2843043.2843374 [211] Rene Mayrhofer. 2007. Towards an open source toolkit for ubiquitous device authentication. In Pervasive Computing and Communications Workshops, 2007. PerCom Workshops ’07. Fifth Annual IEEE International Conference on. IEEE, 247–254. [212] Christopher McAdam and Stephen Brewster. 2011. Using Mobile Phones to Interact with Tabletop Computers. In Proceedings of the ACM International Conference on Interactive Tabletops & Surfaces (ITS ’11). ACM, New York, NY, USA, 232–241. https://doi.org/10.1145/ 2076354.2076395 [213] Mark McGill, John Williamson, and Stephen A. Brewster. 2014. Mirror, Mirror, on the Wall: Collaborative Screen-mirroring for Small Groups. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’14). ACM, New York, NY, USA, 87–94. https://doi.org/10.1145/2602299.2602319 [214] Mark McGill, John Williamson, and Stephen A. Brewster. 2015. Who’s the Fairest of Them All: Device Mirroring for the Connected Home. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’15). ACM, New York, NY, USA, 83–92. https://doi.org/10.1145/2745197.2745200 [215] Jérémie Melchior, Donatien Grolaux, Jean Vanderdonckt, and Peter Van Roy. 2009. A Toolkit for Peer-to-peer Distributed User Interfaces: Concepts, Implementation, and Applications. In Proceedings of the 1st ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’09). ACM, New York, NY, USA, 69–78. https://doi. org/10.1145/1570433.1570449 [216] Jérémie Melchior, Jean Vanderdonckt, and Peter Van Roy. 2011. A Model-based Approach for Distributed User Interfaces. In Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’11). ACM, New York, NY, USA, 11–20. https://doi.org/10.1145/1996461.1996488 [217] Helena M. Mentis. 2017. Collocated Use of Imaging Systems in Coordinated Surgical Practice. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 78 (dec 2017), 17 pages. https://doi.org/10.1145/3134713 [218] David Merrill, Jeevan Kalanithi, and Pattie Maes. 2007. Siftables: Towards Sensor Network User Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI ’07). ACM, New York, NY, USA, 75–78. https://doi.org/10.1145/1226969. 1226984 [219] Jan Meskens, Kris Luyten, and Karin Coninx. 2009. Plug-and-design: Embracing Mobile Devices As Part of the Design Environment. In Proceedings of the 1st ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’09). ACM, New York, NY, USA, 149–154. https://doi.org/10.1145/1570433.1570461 [220] Jan Meskens, Kris Luyten, and Karin Coninx. 2010. D-Macs: Building Multi-device User Interfaces by Demonstrating, Sharing and Replaying Design Actions. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST ’10). ACM, New York, NY, USA, 129–138. https://doi.org/10.1145/1866029.1866051 [221] Jan Meskens, Kris Luyten, and Karin Coninx. 2010. Jelly: A Multidevice Design Environment for Managing Consistency Across Devices. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI ’10). ACM, New York, NY, USA, 289–296. https://doi.org/10.1145/1842993.1843044 [222] Roshanak Zilouchian Moghaddam and Brian Bailey. 2011. VICPAM: A Visualization Tool for Examining Interaction Data in Multiple Display Environments. In Human Interface and the Management of Information. Interacting with Information, Michael J. Smith and Gavriel Salvendy (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 278– 287. [223] Miguel A. Nacenta, Dzmitry Aliakseyeu, Sriram Subramanian, and Carl Gutwin. 2005. A Comparison of Techniques for Multi-display Reaching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’05). ACM, New York, NY, USA, 371–380. https://doi.org/10.1145/1054972.1055024 [224] Miguel A. Nacenta, Mikkel R. Jakobsen, Remy Dautriche, Uta Hinrichs, Marian Dörk, Jonathan Haber, and Sheelagh Carpendale. 2012. The LunchTable: A Multi-user, Multi-display System for Information Sharing in Casual Group Interactions. In Proceedings of the 2012 International Symposium on Pervasive Displays (PerDis ’12). ACM, New York, NY, USA, Article 18, 6 pages. https://doi.org/10.1145/2307798.2307816 [225] Miguel A. Nacenta, Regan L. Mandryk, and Carl Gutwin. 2008. Targeting Across Displayless Space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’08). ACM, New York, NY, USA, 777–786. https://doi.org/10.1145/1357054.1357178 [226] Miguel A. Nacenta, Satoshi Sakurai, Tokuo Yamaguchi, Yohei Miki, Yuichi Itoh, Yoshifumi Kitamura, Sriram Subramanian, and Carl Gutwin. 2007. E-conic: A Perspective-aware Interface for Multidisplay Environments. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST ’07). ACM, New York, NY, USA, 279–288. https://doi.org/10.1145/1294211.1294260 [227] Miguel A. Nacenta, Samer Sallam, Bernard Champoux, Sriram Subramanian, and Carl Gutwin. 2006. Perspective Cursor: Perspectivebased Interaction for Multi-display Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’06). ACM, New York, NY, USA, 289–298. https://doi.org/10.1145/ 1124772.1124817 [228] Timothy Neate, Matt Jones, and Michael Evans. 2015. Designing Attention for Multi-screen TV Experiences. In Proceedings of the 2015 British HCI Conference (British HCI ’15). ACM, New York, NY, USA, 285–286. https://doi.org/10.1145/2783446.2783613 [229] Timothy Neate, Matt Jones, and Michael Evans. 2017. Cross-device Media: A Review of Second Screening and Multi-device Television. Personal Ubiquitous Comput. 21, 2 (Apr 2017), 391–405. https://doi. org/10.1007/s00779-017-1016-2 [230] Michael Nebeling. 2017. XDBrowser 2.0: Semi-Automatic Generation of Cross-Device Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 4574–4584. https://doi.org/10.1145/3025453.3025547 [231] Michael Nebeling and Anind K. Dey. 2016. XDBrowser: User-Defined Cross-Device Web Page Designs. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 5494–5505. https://doi.org/10.1145/2858036.2858048 [232] Michael Nebeling, Maria Husmann, Christoph Zimmerli, Giulio Valente, and Moira C. Norrie. 2015. XDSession: Integrated Development and Testing of Cross-device Applications. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’15). ACM, New York, NY, USA, 22–27. https: //doi.org/10.1145/2774225.2775075 [233] Michael Nebeling, Theano Mintsi, Maria Husmann, and Moira Norrie. 2014. Interactive Development of Cross-device User Interfaces. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 2793–2802. https://doi.org/10.1145/2556288.2556980 [234] Michael Nebeling, Janet Nebeling, Ao Yu, and Rob Rumble. 2018. ProtoAR: Rapid Physical-Digital Prototyping of Mobile Augmented Reality Applications. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 353, 12 pages. https://doi.org/10.1145/3173574.3173927 [235] Michael Nebeling and Moira Norrie. 2012. jQMultiTouch: Lightweight Toolkit and Development Framework for Multi-touch/Multi-device Web Interfaces. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’12). ACM, New York, NY, USA, 61–70. https://doi.org/10.1145/2305484.2305497 [236] Michael Nebeling, Elena Teunissen, Maria Husmann, and Moira C. Norrie. 2014. XDKinect: Development Framework for Cross-device Interaction Using Kinect. In Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’14). ACM, New York, NY, USA, 65–74. https://doi.org/10.1145/2607023. 2607024 [237] Heidi Selmer Nielsen, Marius Pallisgaard Olsen, Mikael B. Skov, and Jesper Kjeldskov. 2014. JuxtaPinch: An Application for Collocated Multi-device Photo Sharing. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI ’14). ACM, New York, NY, USA, 417–420. https: //doi.org/10.1145/2628363.2633569 [238] Heidi Selmer Nielsen, Marius Pallisgaard Olsen, Mikael B. Skov, and Jesper Kjeldskov. 2014. JuxtaPinch: Exploring Multi-device Interaction in Collocated Photo Sharing. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services (MobileHCI ’14). ACM, New York, NY, USA, 183– 192. https://doi.org/10.1145/2628363.2628369 [239] Jakob Nielsen. 1994. Usability engineering. Elsevier. [240] Sangeun Oh, Hyuck Yoo, Dae R. Jeong, Duc Hoang Bui, and Insik Shin. 2017. Mobile Plus: Multi-device Mobile Platform for Cross-device Functionality Sharing. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys ’17). ACM, New York, NY, USA, 332–344. https://doi.org/10.1145/3081333. 3081348 [241] Takashi Ohta. 2008. Dynamically Reconfigurable Multi-display Environment for CG Contents. In Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology (ACE ’08). ACM, New York, NY, USA, 416–416. https://doi.org/10.1145/ 1501750.1501866 [242] Takashi Ohta and Jun Tanaka. 2010. Automatic Configuration of Display Ordering for Multi-display Environments. In Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology (ACE ’10). ACM, New York, NY, USA, 24–27. https://doi.org/10.1145/1971630.1971638 [243] Takashi Ohta and Jun Tanaka. 2012. Pinch: An Interface That Relates Applications on Multiple Touch-Screen by ‘Pinching’ Gesture. Springer Berlin Heidelberg, Berlin, Heidelberg, 320–335. https://doi.org/10. 1007/978-3-642-34292-9_23 [244] Takashi Ohta and Jun Tanaka. 2015. MovieTile: Interactively Adjustable Free Shape Multi-display of Mobile Devices. In SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications (SA ’15). ACM, New York, NY, USA, Article 18, 7 pages. https://doi.org/10.1145/ 2818427.2818436 [245] Katie O’Leary, Tao Dong, Julia Katherine Haines, Michael Gilbert, Elizabeth F. Churchill, and Jeffrey Nichols. 2017. The Moving Context Kit: Designing for Context Shifts in Multi-Device Experiences. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17). ACM, New York, NY, USA, 309–320. https://doi.org/10. 1145/3064663.3064768 [246] Gerard Oleksik, Hans-Christian Jetter, Jens Gerken, Natasa MilicFrayling, and Rachel Jones. 2013. Towards an Information Architecture for Flexible Reuse of Digital Media. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM ’13). ACM, New York, NY, USA, Article 12, 10 pages. https://doi.org/10.1145/2541831.2541866 [247] Dan R. Olsen, Jr. 2007. Evaluating User Interface Systems Research. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST ’07). ACM, New York, NY, USA, 251– 258. https://doi.org/10.1145/1294211.1294256 [248] Dan R. Olsen, Jr., Sean Jefferies, Travis Nielsen, William Moyes, and Paul Fredrickson. 2000. Cross-modal Interaction Using XWeb. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST ’00). ACM, New York, NY, USA, 191– 200. https://doi.org/10.1145/354401.354764 [249] Matthew Oskamp, Christophe Bortolaso, Robin Harrap, and T.C. Nicholas Graham. 2015. TerraGuide: Design and Evaluation of a Multi-Surface Environment for Terrain Visibility Analysis. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 3553–3562. https://doi.org/10.1145/2702123.2702480 [250] Antti Oulasvirta. 2008. FEATURE: When Users “Do” the Ubicomp. interactions 15, 2 (March 2008), 6–9. https://doi.org/10.1145/1340961. 1340963 [251] Antti Oulasvirta and Kasper Hornbæk. 2016. HCI Research As Problem-Solving. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 4956–4967. https://doi.org/10.1145/2858036.2858283 [252] Antti Oulasvirta and Lauri Sumari. 2007. Mobile Kits and Laptop Trays: Managing Multiple Devices in Mobile Information Work. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’07). ACM, New York, NY, USA, 1127–1136. https: //doi.org/10.1145/1240624.1240795 [253] Jeni Paay, Dimitrios Raptis, Jesper Kjeldskov, Mikael B. Skov, Eric V. Ruder, and Bjarke M. Lauridsen. 2017. Investigating Cross-Device Interaction Between a Handheld Device and a Large Display. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 6608–6619. https://doi.org/10.1145/3025453.3025724 [254] Tim Paek, Maneesh Agrawala, Sumit Basu, Steve Drucker, Trausti Kristjansson, Ron Logan, Kentaro Toyama, and Andy Wilson. 2004. Toward Universal Mobile Interaction for Shared Displays. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW ’04). ACM, New York, NY, USA, 266–269. https://doi.org/10.1145/1031607.1031649 [255] Seonwook Park, Christoph Gebhardt, Roman Rädle, Anna Maria Feit, Hana Vrzakova, Niraj Ramesh Dayama, Hui-Shyong Yeo, Clemens N. Klokmose, Aaron Quigley, Antti Oulasvirta, and Otmar Hilliges. 2018. AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 184, 14 pages. https://doi.org/10.1145/3173574.3173758 [256] Fabio Paternò and Carmen Santoro. 2012. A Logical Framework for Multi-device User Interfaces. In Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS ’12). ACM, New York, NY, USA, 45–50. https://doi.org/10.1145/2305484. 2305494 [257] Fabio Paternò, Carmen Santoro, and Antonio Scorcia. 2008. Automatically Adapting Web Sites for Mobile Access Through Logical Descriptions and Dynamic Analysis of Interaction Resources. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’08). ACM, New York, NY, USA, 260–267. https://doi.org/10.1145/ 1385569.1385611 [258] Chunyi Peng, Guobin Shen, Yongguang Zhang, Yanlin Li, and Kun Tan. 2007. BeepBeep: A High Accuracy Acoustic Ranging System Using COTS Mobile Devices. In Proceedings of the 5th International Conference on Embedded Networked Sensor Systems (SenSys ’07). ACM, New York, NY, USA, 1–14. https://doi.org/10.1145/1322263.1322265 [259] Julian Petford, Miguel A. Nacenta, and Carl Gutwin. 2018. Pointing All Around You: Selection Performance of Mouse and Ray-Cast Pointing in Full-Coverage Displays. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 533, 14 pages. https://doi.org/10.1145/3173574.3174107 [260] Tommaso Piazza, Shengdong Zhao, Gonzalo Ramos, Asim Evren Yantaç, and Morten Fjeld. 2013. Dynamic Duo: Phone-tablet Interaction on Tabletops. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). ACM, New York, NY, USA, 2803–2804. https://doi.org/10.1145/2468356.2479520 [261] Jeffrey S. Pierce and Jeffrey Nichols. 2008. An Infrastructure for Extending Applications’ User Experiences Across Multiple Personal Devices. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST ’08). ACM, New York, NY, USA, 101–110. https://doi.org/10.1145/1449715.1449733 [262] Krzysztof Pietroszek and Edward Lank. 2012. Clicking Blindly: Using Spatial Correspondence to Select Targets in Multi-device Environments. In Proceedings of the 14th International Conference on Humancomputer Interaction with Mobile Devices and Services (MobileHCI ’12). ACM, New York, NY, USA, 331–334. https://doi.org/10.1145/2371574. 2371625 [263] Thomas Plank, Hans-Christian Jetter, Roman Rädle, Clemens N. Klokmose, Thomas Luger, and Harald Reiterer. 2017. Is Two Enough?: ! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 4548–4560. https://doi.org/10.1145/3025453.3025537 [264] Christopher Plaue and John Stasko. 2009. Presence & Placement: Exploring the Benefits of Multiple Shared Displays on an Intellective Sensemaking Task. In Proceedings of the ACM 2009 International Conference on Supporting Group Work (GROUP ’09). ACM, New York, NY, USA, 179–188. https://doi.org/10.1145/1531674.1531701 [265] Thorsten Prante, Richard Stenzel, Carsten Röcker, Norbert Streitz, and Carsten Magerkurth. 2004. Ambient Agoras: InfoRiver, SIAM, Hello.Wall. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’04). ACM, New York, NY, USA, 763–764. https://doi.org/10.1145/985921.985924 [266] Sydney Pratte, Teddy Seyed, and Frank Maurer. 2014. Exploring Multi-Surface Interactions in Retail Environments. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 393–398. https: //doi.org/10.1145/2669485.2669552 [267] Jian Qiu, David Chu, Xiangying Meng, and Thomas Moscibroda. 2011. On the Feasibility of Real-time Phone-to-phone 3D Localization. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems (SenSys ’11). ACM, New York, NY, USA, 190–203. https://doi.org/10.1145/2070942.2070962 [268] Roman Rädle. 2013. Design and Evaluation of Proxemics-aware Environments to Support Navigation in Large Information Spaces. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13). ACM, New York, NY, USA, 1957–1960. https://doi.org/ 10.1145/2468356.2468710 [269] Roman Rädle, Hans-Christian Jetter, Jonathan Fischer, Inti Gabriel, Clemens N. Klokmose, Harald Reiterer, and Christian Holz. 2018. PolarTrack: Optical Outside-In Device Tracking That Exploits Display Polarization. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 497, 9 pages. https://doi.org/10.1145/3173574.3174071 [270] Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 45–54. https://doi.org/10.1145/2669485.2669500 [271] Roman Rädle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. 2015. Spatially-aware or Spatiallyagnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 3913–3922. https://doi.org/10.1145/2702123.2702287 [272] Gonzalo Ramos, Kenneth Hinckley, Andy Wilson, and Raman Sarin. 2009. Synchronous Gestures in Multi-Display Environments. HumanComputer Interaction 24, 1-2 (2009), 117–169. https://doi.org/10.1080/ 07370020902739288 [273] Dimitrios Raptis, Jesper Kjeldskov, and Mikael B. Skov. 2016. Continuity in Multi-Device Interaction: An Online Study. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI ’16). ACM, New York, NY, USA, Article 29, 10 pages. https://doi.org/10.1145/2971485.2971533 [274] Umar Rashid, Jarmo Kauko, Jonna Häkkilä, and Aaron Quigley. 2011. Proximal and Distal Selection of Widgets: Designing Distributed UI for Mobile Interaction with Large Display. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’11). ACM, New York, NY, USA, 495–498. https://doi.org/10.1145/2037373.2037446 [275] Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. 2012. The Cost of Display Switching: A Comparison of Mobile, Large Display and Hybrid UI Configurations. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI ’12). ACM, New York, NY, USA, 99–106. https://doi.org/10.1145/2254556.2254577 [276] Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. 2012. Factors Influencing Visual Attention Switch in Multi-display User Interfaces: A Survey. In Proceedings of the 2012 International Symposium on Pervasive Displays (PerDis ’12). ACM, New York, NY, USA, Article 1, 6 pages. https://doi.org/10.1145/2307798.2307799 [277] Adrian Reetz, Carl Gutwin, Tadeusz Stach, Miguel Nacenta, and Sriram Subramanian. 2006. Superflick: A Natural and Efficient Technique for Long-distance Object Placement on Digital Tables. In Proceedings of Graphics Interface 2006 (GI ’06). Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 163–170. http://dl.acm.org/citation.cfm?id=1143079.1143106 [278] Jun Rekimoto. 1997. Pick-and-drop: A Direct Manipulation Technique for Multiple Computer Environments. In Proceedings of the 10th Annual ACM Symposium on User Interface Software and Technology (UIST ’97). ACM, New York, NY, USA, 31–39. https://doi.org/10. 1145/263407.263505 [279] Jun Rekimoto. 1998. A Multiple Device Approach for Supporting Whiteboard-based Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’98). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 344–351. https://doi.org/10.1145/274644.274692 [280] Jun Rekimoto. 2004. SyncTap: Synchronous User Operation for Spontaneous Network Connection. Personal Ubiquitous Comput. 8, 2 (may 2004), 126–134. https://doi.org/10.1007/s00779-004-0262-2 [281] Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’99). ACM, New York, NY, USA, 378–385. https://doi.org/10.1145/302979.303113 [282] João Ribeiro, João Barreto, and Paulo Ferreira. 2011. MultiRep: Asynchronous Multi-device Consistency. In Proceedings of the Third International Workshop on Middleware for Pervasive Mobile and Embedded Computing (M-MPAC ’11). ACM, New York, NY, USA, Article 7, 6 pages. https://doi.org/10.1145/2090316.2090323 [283] Scott Robertson, Cathleen Wharton, Catherine Ashworth, and Marita Franzke. 1996. Dual Device User Interface Design: PDAs and Interactive Television. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’96). ACM, New York, NY, USA, 79–86. https://doi.org/10.1145/238386.238408 [284] Yvonne Rogers. 2006. Moving on from Weiser’s Vision of Calm Computing: Engaging UbiComp Experiences. In UbiComp 2006: Ubiquitous Computing, Paul Dourish and Adrian Friday (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 404–421. [285] Yvonne Rogers, Kay Connelly, Lenore Tedesco, William Hazlewood, Andrew Kurtz, Robert E. Hall, Josh Hursey, and Tammy Toscos. 2007. Why It’s Worth the Hassle: The Value of In-Situ Studies When Designing Ubicomp. In UbiComp 2007: Ubiquitous Computing (Lecture Notes in Computer Science), John Krumm, Gregory D. Abowd, Aruna Seneviratne, and Thomas Strang (Eds.). Springer Berlin Heidelberg, 336–353. http://dl.acm.org/citation.cfm?id=647987.741340 [286] Manuel Román, Christopher Hess, Renato Cerqueira, Anand Ranganathan, Roy H. Campbell, and Klara Nahrstedt. 2002. Gaia: A Middleware Platform for Active Spaces. SIGMOBILE Mob. Comput. Commun. Rev. 6, 4 (Oct. 2002), 65–67. https://doi.org/10.1145/643550. 643558 [287] Houssem Saidi, Marcos Serrano, and Emmanuel Dubois. 2016. Investigating the Effects of Splitting Detailed Views in Overview+Detail Interfaces. In Proceedings of the 18th International Conference on HumanComputer Interaction with Mobile Devices and Services (MobileHCI ’16). ACM, New York, NY, USA, 180–184. https://doi.org/10.1145/2935334. 2935341 [288] Houssem Saidi, Marcos Serrano, Pourang Irani, and Emmanuel Dubois. 2017. TDome: A Touch-Enabled 6DOF Interactive Device for Multi-Display Environments. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 5892–5904. https://doi.org/10.1145/3025453.3025661 [289] Satoshi Sakurai, Tokuo Yamaguchi, Yoshifumi Kitamura, Yuichi Itoh, Ryo Fukazawa, Fumio Kishino, Miguel A. Nacenta, and Sriram Subramanian. 2008. M3: Multi-modal Interface in Multi-display Environment for Multi-users. In ACM SIGGRAPH ASIA 2008 Artgallery: Emerging Technologies (SIGGRAPH Asia ’08). ACM, New York, NY, USA, 45–45. https://doi.org/10.1145/1504229.1504259 [290] Stephanie Santosa and Daniel Wigdor. 2013. A Field Study of Multidevice Workflows in Distributed Workspaces. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’13). ACM, New York, NY, USA, 63–72. https: //doi.org/10.1145/2493432.2493476 [291] Anthony Savidis and Constantine Stephanidis. 2005. Distributed Interface Bits: Dynamic Dialogue Composition from Ambient Computing Resources. Personal Ubiquitous Comput. 9, 3 (may 2005), 142–168. https://doi.org/10.1007/s00779-004-0327-2 [292] Florian Scharf, Christian Wolters, Michael Herczeg, and Jörg Cassens. 2013. Cross-Device Interaction Definition, Taxonomy and Applications. In AMBIENT 2013: The Third International Conference on Ambient Computing, Applications, Services and Technologies. IARIA, 35–40. [293] Dominik Schmidt, Fadi Chehimi, Enrico Rukzio, and Hans Gellersen. 2010. PhoneTouch: A Technique for Direct Phone Interaction on Surfaces. In Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology (UIST ’10). ACM, New York, NY, USA, 13–16. https://doi.org/10.1145/1866029.1866034 [294] Dominik Schmidt, Julian Seifert, Enrico Rukzio, and Hans Gellersen. 2012. A Cross-device Interaction Style for Mobiles and Surfaces. In Proceedings of the Designing Interactive Systems Conference (DIS ’12). ACM, New York, NY, USA, 318–327. https://doi.org/10.1145/2317956. 2318005 [295] Stefan Schneegass and Florian Alt. 2014. SenScreen: A Toolkit for Supporting Sensor-enabled Multi-Display Networks. In Proceedings of The International Symposium on Pervasive Displays (PerDis ’14). ACM, New York, NY, USA, Article 92, 6 pages. https://doi.org/10. 1145/2611009.2611017 [296] Bertrand Schneider, Matthew Tobiasz, Charles Willis, and Chia Shen. 2012. WALDEN: Multi-surface Multi-touch Simulation of Climate Change and Species Loss in Thoreau’s Woods. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’12). ACM, New York, NY, USA, 387–390. https://doi.org/10. 1145/2396636.2396707 [297] Dennis Schneider, Julian Seifert, and Enrico Rukzio. 2012. MobIES: Extending Mobile Interfaces Using External Screens. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM ’12). ACM, New York, NY, USA, Article 59, 2 pages. https: //doi.org/10.1145/2406367.2406438 [298] Mario Schreiner, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. Connichiwa: A Framework for Cross-Device Web Applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’15). ACM, New York, NY, USA, 2163–2168. https://doi.org/10.1145/ 2702613.2732909 [299] Julia Schwarz, David Klionsky, Chris Harrison, Paul Dietz, and Andrew Wilson. 2012. Phone As a Pixel: Enabling Ad-hoc, Large-scale Displays Using Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12). ACM, New York, NY, USA, 2235–2238. https://doi.org/10.1145/2207676.2208378 [300] Stacey Scott, Phillip McClelland, and Guillaume Besacier. 2012. Bridging Private and Shared Interaction Surfaces in Co-located Group Settings. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’12). ACM, New York, NY, USA, 403–406. https://doi.org/10.1145/2396636.2396711 [301] Stacey D. Scott, Guillaume Besacier, Julie Tournet, Nippun Goyal, and Michael Haller. 2014. Surface Ghosts: Promoting Awareness of Transferred Objects During Pick-and-Drop Transfer in Multi-Surface Environments. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 99–108. https://doi.org/10.1145/2669485.2669508 [302] Julian Seifert, Adalberto Simeone, Dominik Schmidt, Paul Holleis, Christian Reinartz, Matthias Wagner, Hans Gellersen, and Enrico Rukzio. 2012. MobiSurf: Improving Co-located Collaboration Through Integrating Mobile Devices and Interactive Surfaces. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’12). ACM, New York, NY, USA, 51–60. https://doi.org/10.1145/2396636.2396644 [303] Marcos Serrano, Barrett Ens, Xing-Dong Yang, and Pourang Irani. 2015. Gluey: Developing a Head-Worn Display Interface to Unify the Interaction Experience in Distributed Display Environments. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI ’15). ACM, New York, NY, USA, 161–171. https://doi.org/10.1145/2785830.2785838 [304] Teddy Seyed, Alaa Azazi, Edwin Chan, Yuxi Wang, and Frank Maurer. 2015. SoD-Toolkit: A Toolkit for Interactively Prototyping and Developing Multi-Sensor, Multi-Device Environments. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS ’15). ACM, New York, NY, USA, 171–180. https: //doi.org/10.1145/2817721.2817750 [305] Teddy Seyed, Chris Burns, Mario Costa Sousa, Frank Maurer, and Anthony Tang. 2012. Eliciting Usable Gestures for Multi-display Environments. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’12). ACM, New York, NY, USA, 41–50. https://doi.org/10.1145/2396636.2396643 [306] Teddy Seyed, Mario Costa Sousa, Frank Maurer, and Anthony Tang. 2013. SkyHunter: A Multi-surface Environment for Supporting Oil and Gas Exploration. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’13). ACM, New York, NY, USA, 15–22. https://doi.org/10.1145/2512349.2512798 [307] Teddy Seyed, Xing-Dong Yang, and Daniel Vogel. 2016. Doppio: A Reconfigurable Dual-Face Smartwatch for Tangible Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 4675–4686. https: //doi.org/10.1145/2858036.2858256 [308] Teddy Seyed, Xing-Dong Yang, and Daniel Vogel. 2017. A Modular Smartphone for Lending. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST ’17). ACM, New York, NY, USA, 205–215. https://doi.org/10.1145/3126594. 3126633 [309] Zahra Shakeri Hossein Abad, Craig Anslow, and Frank Maurer. 2014. Multi Surface Interactions with Geospatial Data: A Systematic Review. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 69–78. https://doi.org/10.1145/2669485.2669505 [310] Hirohito Shibata, Junko Ichino, Tomonori Hashiyama, and Shun’ichi Tano. 2016. A Rhythmical Tap Approach for Sending Data Across Devices. In Proceedings of the 18th International Conference on HumanComputer Interaction with Mobile Devices and Services Adjunct (MobileHCI ’16). ACM, New York, NY, USA, 815–822. https://doi.org/10. 1145/2957265.2961851 [311] Léo Sicard, Aurélien Tabard, Juan David Hincapié-Ramos, and Jakob E Bardram. 2013. Tide: Lightweight device composition for enhancing tabletop environments with smartphone applications. In IFIP Conference on Human-Computer Interaction. Springer, 177–194. [312] Adalberto L. Simeone, Julian Seifert, Dominik Schmidt, Paul Holleis, Enrico Rukzio, and Hans Gellersen. 2013. A Cross-device Drag-anddrop Technique. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM ’13). ACM, New York, NY, USA, Article 10, 4 pages. https://doi.org/10.1145/2541831.2541848 [313] Anoop K. Sinha and James A. Landay. 2001. Visually Prototyping Perceptual User Interfaces Through Multimodal Storyboarding. In Proceedings of the 2001 Workshop on Perceptive User Interfaces (PUI ’01). ACM, New York, NY, USA, 1–4. https://doi.org/10.1145/971478.971501 [314] Mikael B. Skov, Jesper Kjeldskov, Jeni Paay, Heidi P. Jensen, and Marius P. Olsen. 2015. Investigating Cross-Device Interaction Techniques: A Case of Card Playing on Handhelds and Tablets. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI ’15). ACM, New York, NY, USA, 446–454. https://doi.org/10.1145/2838739.2838763 [315] Hendrik Sollich, Ulrich von Zadow, Tobias Pietzsch, Pavel Tomancak, and Raimund Dachselt. 2016. Exploring Time-dependent Scientific Data Using Spatially Aware Mobiles and Large Displays. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 349–354. https://doi.org/10.1145/2992154. 2996779 [316] Henrik Sørensen and Jesper Kjeldskov. 2012. Distributed Interaction: A Multi-device, Multi-user Music Experience. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI ’12). ACM, New York, NY, USA, 336–339. https://doi.org/10.1145/ 2254556.2254621 [317] Henrik Sørensen and Jesper Kjeldskov. 2012. The Interaction Space of a Multi-device, Multi-user Music Experience. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI ’12). ACM, New York, NY, USA, 504–513. https://doi.org/10.1145/2399016.2399094 [318] Henrik Sørensen, Dimitrios Raptis, Jesper Kjeldskov, and Mikael B. Skov. 2014. The 4C Framework: Principles of Interaction in Digital Ecosystems. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’14). ACM, New York, NY, USA, 87–97. https://doi.org/10.1145/2632048.2636089 [319] Martin Spindler, Wolfgang Büschel, and Raimund Dachselt. 2012. Use Your Head: Tangible Windows for 3D Information Spaces in a Tabletop Environment. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’12). ACM, New York, NY, USA, 245–254. https://doi.org/10.1145/2396636.2396674 [320] Martin Spindler, Wolfgang Büschel, Charlotte Winkler, and Raimund Dachselt. 2014. Tangible Displays for the Masses: Spatial Interaction with Handheld Displays by Using Consumer Depth Cameras. Personal Ubiquitous Comput. 18, 5 (Jun 2014), 1213–1225. https://doi.org/10. 1007/s00779-013-0730-7 [321] Martin Spindler, Sophie Stellmach, and Raimund Dachselt. 2009. PaperLens: Advanced Magic Lens Interaction Above the Tabletop. In Proceedings of the ACM International Conference on Interactive Tabletops & Surfaces (ITS ’09). ACM, New York, NY, USA, 69–76. https://doi.org/10.1145/1731903.1731920 [322] Martin Spindler, Christian Tominski, Heidrun Schumann, and Raimund Dachselt. 2010. Tangible Views for Information Visualization. In ACM International Conference on Interactive Tabletops & Surfaces (ITS ’10). ACM, New York, NY, USA, 157–166. https: //doi.org/10.1145/1936652.1936684 [323] Richard Stoakley, Matthew J. Conway, and Randy Pausch. 1995. Virtual Reality on a WIM: Interactive Worlds in Miniature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’95). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 265–272. https://doi.org/10.1145/223904.223938 [324] Norbert A. Streitz, Jörg Geißler, Torsten Holmer, Shin’ichi Konomi, Christian Müller-Tomfelde, Wolfgang Reischl, Petra Rexroth, Peter Seitz, and Ralf Steinmetz. 1999. i-LAND: An Interactive Landscape for Creativity and Innovation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’99). ACM, New York, NY, USA, 120–127. https://doi.org/10.1145/302979.303010 [325] Paul Strohmeier. 2015. DisplayPointers: Seamless Cross-device Interactions. In Proceedings of the 12th International Conference on Advances in Computer Entertainment Technology (ACE ’15). ACM, New York, NY, USA, Article 4, 8 pages. https://doi.org/10.1145/2832932.2832958 [326] Alexandros Stylianidis, Jo Vermeulen, Steven Houben, Lindsay MacDonald, and Russell Beale. 2017. SenseBelt: A Belt-Worn Sensor to Support Cross-Device Interaction. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’17). ACM, New York, NY, USA, 2123–2131. https://doi.org/10.1145/3027063.3053135 [327] Zheng Sun, Aveek Purohit, Kaifei Chen, Shijia Pan, Trevor Pering, and Pei Zhang. 2011. PANDAA: Physical Arrangement Detection of Networked Devices Through Ambient-sound Awareness. In Proceedings of the 13th International Conference on Ubiquitous Computing (UbiComp ’11). ACM, New York, NY, USA, 425–434. https://doi.org/10.1145/2030112.2030169 [328] Desney S. Tan, Brian Meyers, and Mary Czerwinski. 2004. WinCuts: Manipulating Arbitrary Window Regions for More Effective Use of Screen Space. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’04). ACM, New York, NY, USA, 1525– 1528. https://doi.org/10.1145/985921.986106 [329] Peter Tandler, Thorsten Prante, Christian Müller-Tomfelde, Norbert Streitz, and Ralf Steinmetz. 2001. Connectables: Dynamic Coupling of Displays for the Flexible Creation of Shared Workspaces. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST ’01). ACM, New York, NY, USA, 11–20. https://doi.org/10.1145/502348.502351 [330] Lucia Terrenghi, Aaron Quigley, and Alan Dix. 2009. A Taxonomy for and Analysis of Multi-person-display Ecosystems. Personal Ubiquitous Comput. 13, 8 (Nov. 2009), 583–598. https://doi.org/10.1007/ s00779-009-0244-5 [331] Ricardo Tesoriero, María Lozano, Jean Vanderdonckt, José A. Gallud, and Victor M.R. Penichet. 2012. Distributed User Interfaces: Collaboration and Usability. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’12). ACM, New York, NY, USA, 2719–2722. https://doi.org/10.1145/2212776.2212704 [332] Paul Tolstoi and Andreas Dippon. 2015. Towering Defense: An Augmented Reality Multi-Device Game. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA ’15). ACM, New York, NY, USA, 89–92. https://doi.org/10.1145/2702613.2728659 [333] Jayson Turner, Andreas Bulling, Jason Alexander, and Hans Gellersen. 2014. Cross-device Gaze-supported Point-to-point Content Transfer. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA ’14). ACM, New York, NY, USA, 19–26. https: //doi.org/10.1145/2578153.2578155 [334] Markku Turunen, Juho Hella, Toni Miettinen, Pellervo Valkama, Jaakko Hakulinen, and Roope Raisamo. 2011. Multimodal Multidevice Program Guide for Smart Conferences. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI ’11). ACM, New York, NY, USA, 679–682. https://doi.org/10.1145/2037373.2037483 [335] Markku Turunen, Roope Raisamo, Thomas Olsson, Juho Hella, Toni Miettinen, Tomi Heimonen, Jaakko Hakulinen, and Ismo Rakkolainen. 2013. Enhancing the Conference Experience with a MultiDevice, Multimodal, Multi-User Program Guide. In Proceedings of International Conference on Making Sense of Converging Media (AcademicMindTrek ’13). ACM, New York, NY, USA, Article 5, 4 pages. https://doi.org/10.1145/2523429.2523446 [336] Eric Umuhoza, Hamza Ed-douibi, Marco Brambilla, Jordi Cabot, and Aldo Bongio. 2015. Automatic Code Generation for Cross-platform, Multi-device Mobile Apps: Some Reflections from an Industrial Experience. In Proceedings of the 3rd International Workshop on Mobile Development Lifecycle (MobileDeLi 2015). ACM, New York, NY, USA, 37–44. https://doi.org/10.1145/2846661.2846666 [337] Ersin Uzun, Nitesh Saxena, and Arun Kumar. 2011. Pairing Devices for Social Interactions: A Comparative Usability Evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). ACM, New York, NY, USA, 2315–2324. https://doi.org/10.1145/1978942.1979282 [338] Consuelo Valdes, Diana Eastman, Casey Grote, Shantanu Thatte, Orit Shaer, Ali Mazalek, Brygg Ullmer, and Miriam K. Konkel. 2014. Exploring the Design Space of Gestural Interaction with Active Tokens Through User-defined Gestures. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 4107–4116. https://doi.org/10.1145/ 2556288.2557373 [339] Florian van de Camp and Rainer Stiefelhagen. 2013. GlueTK: A Framework for Multi-modal, Multi-display Human-machine-interaction. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (IUI ’13). ACM, New York, NY, USA, 329–338. https: //doi.org/10.1145/2449396.2449440 [340] Michael van der Laan, Ron Kellet, Cynthia Girling, Maged Senbel, and Tao Su. 2013. A Collaborative Multi-touch, Multi-display, Urban Futures Tool. In Proceedings of the Symposium on Simulation for Architecture & Urban Design (SimAUD ’13). Society for Computer Simulation International, San Diego, CA, USA, Article 10, 4 pages. http://dl.acm.org/citation.cfm?id=2500004.2500014 [341] Alexander Van’t Hof, Hani Jamjoom, Jason Nieh, and Dan Williams. 2015. Flux: Multi-surface Computing in Android. In Proceedings of the Tenth European Conference on Computer Systems (EuroSys ’15). ACM, New York, NY, USA, Article 24, 17 pages. https://doi.org/10. 1145/2741948.2741955 [342] Radu-Daniel Vatavu and Matei Mancas. 2014. Visual Attention Measures for Multi-screen TV. In Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video (TVX ’14). ACM, New York, NY, USA, 111–118. https://doi.org/10.1145/ 2602299.2602305 [343] Radu-Daniel Vatavu and Jacob O. Wobbrock. 2015. Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). ACM, New York, NY, USA, 1325–1334. https://doi.org/10.1145/2702123.2702223 [344] Caio Cesar Viel, Erick Lazaro Melo, Maria da Graça Pimentel, and Cesar A.C. Teixeira. 2013. Multimedia Multi-device Educational Presentations Preserved As Interactive Multi-video Objects. In Proceedings of the 19th Brazilian Symposium on Multimedia and the Web (WebMedia ’13). ACM, New York, NY, USA, 51–58. https: //doi.org/10.1145/2526188.2526211 [345] Pedro G. Villanueva, Ricardo Tesoriero, and Jose A. Gallud. 2014. Performance Evaluation of Proxywork. In Proceedings of the 2014 Workshop on Distributed User Interfaces and Multimodal Interaction (DUI ’14). ACM, New York, NY, USA, 42–45. https://doi.org/10.1145/ 2677356.2677665 [346] Nicolas Villar, Daniel Cletheroe, Greg Saul, Christian Holz, Tim Regan, Oscar Salandin, Misha Sra, Hui-Shyong Yeo, William Field, and Haiyan Zhang. 2018. Project Zanzibar: A Portable and Flexible Tangible Interaction Platform. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Article 515, 13 pages. https://doi.org/10.1145/3173574.3174089 [347] Ulrich von Zadow, Wolfgang Büschel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touchsensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops & Surfaces (ITS ’14). ACM, New York, NY, USA, 129–138. https://doi.org/10.1145/2669485.2669507 [348] Aniruddha Waje, Khalid Tearo, Raghav V. Sampangi, and Derek Reilly. 2016. Grab This, Swipe That: Combining Tangible and Gestural Interaction in Multiple Display Collaborative Gameplay. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 433–438. https://doi.org/10.1145/2992154.2996794 [349] Manuela Waldner, Christian Pirchheim, Ernst Kruijff, and Dieter Schmalstieg. 2010. Automatic Configuration of Spatially Consistent Mouse Pointer Navigation in Multi-display Environments. In Proceedings of the 15th International Conference on Intelligent User Interfaces (IUI ’10). ACM, New York, NY, USA, 397–400. https: //doi.org/10.1145/1719970.1720040 [350] Manuela Waldner and Dieter Schmalstieg. 2010. Experiences with Mouse Control in Multi-display Environments. In Proceedings of the International Conference on Advanced Visual Interfaces (AVI ’10). ACM, New York, NY, USA, 411–411. https://doi.org/10.1145/1842993. 1843089 [351] Jim Wallace, Vicki Ha, Ryder Ziola, and Kori Inkpen. 2006. Swordfish: User Tailored Workspaces in Multi-display Environments. In CHI ’06 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’06). ACM, New York, NY, USA, 1487–1492. https://doi.org/10.1145/ 1125451.1125724 [352] James R. Wallace, Regan L. Mandryk, and Kori M. Inkpen. 2008. Comparing Content and Input Redirection in MDEs. In Proceedings of the 2008 ACM Conference on Computer Supported Cooperative Work (CSCW ’08). ACM, New York, NY, USA, 157–166. https: //doi.org/10.1145/1460563.1460588 [353] James R. Wallace, Stacey D. Scott, Taryn Stutz, Tricia Enns, and Kori Inkpen. 2009. Investigating Teamwork and Taskwork in Single- and Multi-display Groupware Systems. Personal Ubiquitous Comput. 13, 8 (nov 2009), 569–581. https://doi.org/10.1007/s00779-009-0241-8 [354] Yan Wang, Sunghyun Cho, Jue Wang, and Shih-Fu Chang. 2016. PanoSwarm: Collaborative and Synchronized Multi-Device Panoramic Photography. In Proceedings of the 21st International Conference on Intelligent User Interfaces (IUI ’16). ACM, New York, NY, USA, 261–270. https://doi.org/10.1145/2856767.2856778 [355] Mark Weiser. 1991. The Computer for the 21st Century. Scientific American 265, 3 (Sept. 1991), 94–104. https://www.scientificamerican. com/article/the-computer-for-the-21st-century/ [356] Pierre Wellner. 1993. Interacting with Paper on the DigitalDesk. Commun. ACM 36, 7 (Jul 1993), 87–96. https://doi.org/10.1145/159544. 159630 [357] Daniel Wigdor, Hao Jiang, Clifton Forlines, Michelle Borkin, and Chia Shen. 2009. WeSpace: The Design Development and Deployment of a Walk-up and Share Multi-surface Visual Collaboration System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’09). ACM, New York, NY, USA, 1237–1246. https: //doi.org/10.1145/1518701.1518886 [358] Daniel Wigdor, Chia Shen, Clifton Forlines, and Ravin Balakrishnan. 2006. Table-centric Interactive Spaces for Real-time Collaboration. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI ’06). ACM, New York, NY, USA, 103–107. https://doi.org/10. 1145/1133265.1133286 [359] Andrew D. Wilson and Hrvoje Benko. 2014. CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI ’14). ACM, New York, NY, USA, 216–223. https://doi.org/10.1145/2663204.2663270 [360] Andrew D Wilson and Raman Sarin. 2007. BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In Proceedings of Graphics interface 2007. ACM, 119– 125. [361] Jeff Wilson, Judith M. Brown, and Robert Biddle. 2014. ACH Walkthrough: A Distributed Multi-Device Tool for Collaborative Security Analysis. In Proceedings of the 2014 ACM Workshop on Security Information Workers (SIW ’14). ACM, New York, NY, USA, 9–16. https://doi.org/10.1145/2663887.2663902 [362] Christian Winkler, Markus Löchtefeld, David Dobbelstein, Antonio Krüger, and Enrico Rukzio. 2014. SurfacePhone: A Mobile Projection Device for Single- and Multiuser Everywhere Tabletop Interaction. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 3513–3522. https://doi.org/10.1145/2556288.2557075 [363] Christian Winkler, Julian Seifert, Christian Reinartz, Pascal Krahmer, and Enrico Rukzio. 2013. Penbook: Bringing Pen+Paper Interaction to a Tablet Device to Facilitate Paper-based Workflows in the Hospital Domain. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops & Surfaces (ITS ’13). ACM, New York, NY, USA, 283–286. https://doi.org/10.1145/2512349.2512797 [364] Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’09). ACM, New York, NY, USA, 1083–1092. https://doi.org/10.1145/ 1518701.1518866 [365] Marisol Wong-Villacres, Margarita Ortiz, Vanessa Echeverría, and Katherine Chiluiza. 2015. A Tabletop System to Promote Argumentation in Computer Science Students. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS ’15). ACM, New York, NY, USA, 325–330. https://doi.org/10.1145/2817721. 2823501 [366] Paweł W. Woźniak, Nitesh Goyal, Przemysław Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 2447–2460. https://doi.org/10.1145/2858036.2858491 [367] Paweł W. Woźniak, Lars Lischke, Benjamin Schmidt, Shengdong Zhao, and Morten Fjeld. 2014. Thaddeus: A Dual Device Interaction Space for Exploring Information Visualisation. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI ’14). ACM, New York, NY, USA, 41–50. https://doi.org/10.1145/2639189.2639237 [368] Andy Wu, Sam Mendenhall, Jayraj Jog, Loring Scotty Hoag, and Ali Mazalek. 2012. A Nested APi Structure to Simplify Cross-device Communication. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI ’12). ACM, New York, NY, USA, 225–232. https://doi.org/10.1145/2148131.2148180 [369] Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 3929–3942. https://doi.org/10.1145/3025453.3025562 [370] Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13). ACM, New York, NY, USA, 879–888. https://doi.org/10.1145/2470654.2466113 [371] Robert Xiao, Scott Hudson, and Chris Harrison. 2016. CapCam: Enabling Rapid, Ad-Hoc, Position-Tracked Interactions Between Devices. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS ’16). ACM, New York, NY, USA, 169–178. https: //doi.org/10.1145/2992154.2992182 [372] Robert Xiao, Gierad Laput, Yang Zhang, and Chris Harrison. 2017. Deus EM Machina: On-Touch Contextual Functionality for Smart IoT Appliances. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 4000–4008. https://doi.org/10.1145/3025453.3025828 [373] Jishuo Yang and Daniel Wigdor. 2014. Panelrama: Enabling Easy Specification of Cross-device Web Applications. In Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems (CHI ’14). ACM, New York, NY, USA, 2783–2792. https: //doi.org/10.1145/2556288.2557199 [374] Masasuke Yasumoto and Takehiro Teraoka. 2015. VISTouch: Dynamic Three-dimensional Connection Between Multiple Mobile Devices. In Proceedings of the 6th Augmented Human International Conference (AH ’15). ACM, New York, NY, USA, 89–92. https://doi.org/10.1145/ 2735711.2735823 [375] Dongwook Yoon, Ken Hinckley, Hrvoje Benko, François Guimbretière, Pourang Irani, Michel Pahud, and Marcel Gavriliu. 2015. Sensing Tablet Grasp + Micro-mobility for Active Reading. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST ’15). ACM, New York, NY, USA, 477–487. https: //doi.org/10.1145/2807442.2807510 [376] Johannes Zagermann, Ulrike Pfeil, Carmela Acevedo, and Harald Reiterer. 2017. Studying the Benefits and Challenges of Spatial Distribution and Physical Affordances in a Multi-device Workspace. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM ’17). ACM, New York, NY, USA, 249–259. https://doi.org/10.1145/3152832.3152855 [377] Johannes Zagermann, Ulrike Pfeil, Roman Rädle, Hans-Christian Jetter, Clemens Klokmose, and Harald Reiterer. 2016. When Tablets Meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI ’16). ACM, New York, NY, USA, 5470–5481. https://doi.org/10.1145/2858036. 2858224 [378] Zengbin Zhang, David Chu, Xiaomeng Chen, and Thomas Moscibroda. 2012. SwordFight: Enabling a New Class of Phone-to-phone Action Games on Commodity Phones. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (MobiSys ’12). ACM, New York, NY, USA, 1–14. https://doi.org/10. 1145/2307636.2307638 [379] Frank Zhao and Qiong Liu. 2004. A Web Based Multi-display Presentation System. In Proceedings of the 12th Annual ACM International Conference on Multimedia (MULTIMEDIA ’04). ACM, New York, NY, USA, 176–177. https://doi.org/10.1145/1027527.1027565
