Projet ANR InterPlay

Overview

Novel display technologies such as wall-sized displays, very large tabletops, and headsets for Virtual Reality or Augmented Reality make it possible to redesign workspaces for more flexibility and efficiency. The goal of the project is to study rich display environments from a human computer interaction perspective in order to inform the design of innovative workspaces for crisis management and data analysis. To reach this goal we will: (i) study the output capacities of these displays for distributing information across displays efficiently; (ii) use physical artefacts for facilitating navigation and interaction across displays; and (iii) use embodied gestures for portable and expert interactions across displays. Our studies will be informed by a real crisis management environment, and the results of the project will help redesign this environment.

Period: January 1st 2022 - January 1st 2026

ID: ANR-21-CE33-0022 - INTERPLAY

Jobs

We have funding for internships, Ph.D. students, post-docs and engineers. Mail us if you are interested by InterPlay: interplay@irit.fr

Publications and Software

Emmanuel Courtoux, Caroline Appert & Olivier Chapuis. SurfAirs: Surface + Mid-air Input for Large Vertical Displays. In CHI '23: Proceedings of the international conference on Human factors in computing systems, 15 pages, ACM, April 2023.

@inproceedings{Courtoux:2023:SAS,
  author = {Emmanuel Courtoux and Caroline Appert and Olivier Chapuis},
  title = {Surf{A}irs: Surface + Mid-air Input for Large Vertical Displays},
  series = {CHI '23},
  booktitle = {Proceedings of the international conference on Human factors in computing systems},
  numpages = {15},
  publisher = {ACM},
  month = {April},
  year = {2023},
  location = {Hamburg, Germany},
  doi = {10.1145/3544548.3580877},
  url = {https://doi.org/10.1145/3544548.3580877},
  url-hal = {https://hal.archives-ouvertes.fr/hal-04009207/en},
  video = {https://surfairs.lisn.upsaclay.fr/videos/surfairs.mp4},
}

Raphaël James, Anastasia Bezerianos & Olivier Chapuis. Evaluating the Extension of Wall Displays with AR for Collaborative Work. In CHI '23: Proceedings of the international conference on Human factors in computing systems, 17 pages, ACM, April 2023.

@inproceedings{James:2023:EEW,
  author = {Raphaël James and Anastasia Bezerianos and Olivier Chapuis},
  title = {Evaluating the Extension of Wall Displays with {AR} for Collaborative Work},
  series = {CHI '23},
  booktitle = {Proceedings of the international conference on Human factors in computing systems},
  numpages = {17},
  publisher = {ACM},
  month = {April},
  year = {2023},
  location = {Hamburg, Germany},
  doi = {10.1145/3544548.3580752},
  url = {https://doi.org/10.1145/3544548.3580752},
  url-hal = {https://hal.archives-ouvertes.fr/hal-04010673/en},
  video = {https://ilda.gitlabpages.inria.fr/arviz/images/chi23video.mp4},
}

Aziz Niyazov, Barrett Ens, Kadek Ananta Satriadi, Nicolas Mellado, Loïc Barthe, Tim Dwyer & Marcos Serrano. User-Driven Constraints for Layout Optimisation in Augmented Reality. In CHI '23: Proceedings of the international conference on Human factors in computing systems, 16 pages, ACM, April 2023.

@inproceedings{niyazov:hal-04042351,
  author = {Niyazov, Aziz and Ens, Barrett and Satriadi, Kadek Ananta and Mellado, Nicolas and Barthe, Loïc and Dwyer, Tim and Serrano, Marcos},
  title = {User-Driven Constraints for Layout Optimisation in Augmented Reality},
  series = {CHI '23},
  booktitle = {Proceedings of the international conference on Human factors in computing systems},
  numpages = {16},
  publisher = {ACM},
  month = {April},
  year = {2023},
  location = {Hamburg, Germany},
  doi = {10.1145/3544548.3580873},
  url = {https://doi.org/10.1145/3544548.3580873},
  url-hal = {https://hal.science/hal-04042351},
}

Gaëlle Clavelin, Mickael Bouhier, Wen-Jie Tseng & Jan Gugenheimer. Exploring the Perception of Pain in Virtual Reality through Perceptual Manipulations. In CHI EA '23: Extended Abstracts of the international conference on Human factors in computing systems, ACM, April 2023.

@inproceedings{clavelin:hal-04057864,
  author = {Clavelin, Gaëlle and Bouhier, Mickael and Tseng, Wen-Jie and Gugenheimer, Jan},
  title = {Exploring the Perception of Pain in Virtual Reality through Perceptual Manipulations},
  series = {CHI EA '23},
  booktitle = {Extended Abstracts of the international conference on Human factors in computing systems},
  publisher = {ACM},
  month = {April},
  year = {2023},
  doi = {10.1145/3544549.3585674},
  url = {https://doi.org/10.1145/3544549.3585674},
  url-hal = {https://hal.science/hal-04057864},
}

Aziz Niyazov, Barrett Ens, Kadek Ananta Satriadi, Nicolas Mellado, Loic Barthe, Tim Dwyer & Marcos Serrano. Bringing Interactivity into Spatial Content Layout Optimisation. In Workshop @ Conference on Human Factors in Computing Systems, April 2023.

@inproceedings{niyazov:hal-04042388,
  author = {Niyazov, Aziz and Ens, Barrett and Satriadi, Kadek Ananta and Mellado, Nicolas and Barthe, Loic and Dwyer, Tim and Serrano, Marcos},
  title = {Bringing Interactivity into Spatial Content Layout Optimisation},
  booktitle = {Workshop @ Conference on Human Factors in Computing Systems},
  month = {April},
  year = {2023},
  location = {Hamburg, Germany},
  url = {https://hal.science/hal-04042388},
}

Emmanuel Dubois, Ilyes Reguig, Gary Perelman, Philippe Limousin & Bergé Louis-Pierre. Vue Radar: DéPorter Le Gestionnaire de FenêTres Sur Une Tablette: RadarView: Unloading the Desktop Window Manager onto a Tablet. In IHM '23: Proceedings of the 34th Conference on l'Interaction Humain-Machine, 11 pages, ACM, 2023.

@inproceedings{Dubois:2023:VRD,
  author = {Dubois, Emmanuel and Reguig, Ilyes and Perelman, Gary and Limousin, Philippe and Louis-Pierre, Bergé},
  title = {Vue Radar: DéPorter Le Gestionnaire de FenêTres Sur Une Tablette: RadarView: Unloading the Desktop Window Manager onto a Tablet},
  series = {IHM '23},
  booktitle = {Proceedings of the 34th Conference on l'Interaction Humain-Machine},
  numpages = {11},
  publisher = {ACM},
  year = {2023},
  location = {TROYES, France},
  doi = {10.1145/3583961.3583962},
  isbn = {9781450398244},
  url = {https://doi.org/10.1145/3583961.3583962},
  url-hal = {https://hal.archives-ouvertes.fr/hal-04006865/en},
}

Alice Probst, Gary Perelman, Emmanuel Dubois & Marcos Serrano. Acquisition visuelle en réalité mixte, depuis et vers une table interactive : Analyse de la transition entre un écran virtuel et un écran physique. In IHM '22: 33ème Conférence internationale francophone sur l'Interaction Humain-Machine, 17 pages, ACM, Nov. 2022.

@inproceedings{probst:hal-03845381,
  author = {Probst, Alice and Perelman, Gary and Dubois, Emmanuel and Serrano, Marcos},
  title = {Acquisition visuelle en réalité mixte, depuis et vers une table interactive : Analyse de la transition entre un écran virtuel et un écran physique},
  series = {IHM '22},
  booktitle = {33ème Conférence internationale francophone sur l'Interaction Humain-Machine},
  numpages = {17},
  publisher = {ACM},
  month = {Nov.},
  year = {2022},
  location = {Namur, Belgium},
  url = {https://doi.org/10.1145/3500866.3516377},
  url-hal = {https://hal.science/hal-03845381},
}

Eugénie Brasier, Emmanuel Pietriga, Anastasia Bezerianos, Olivier Chapuis & Caroline Appert. De-augmenting Visually-Augmented Reality. Technical Report n. RR-9494, INRIA, 29, 2022.

@techreport{brasier:hal-03914418,
  author = {Brasier, Eugénie and Pietriga, Emmanuel and Bezerianos, Anastasia and Chapuis, Olivier and Appert, Caroline},
  title = {De-augmenting Visually-Augmented Reality},
  number = {RR-9494},
  institution = {INRIA},
  pages = {29},
  year = {2022},
  url-hal = {https://hal.inria.fr/hal-03914418},
  video = {https://hal.inria.fr/hal-03914418/file/DeaugmentingAR_RR.mp4},
}

Gary Perelman, Emmanuel Dubois, Alice Probst & Marcos Serrano. Visual Transitions around Tabletops in Mixed Reality: Study on a Visual Acquisition Task between Vertical Virtual Displays and Horizontal Tabletops. Proc. ACM Hum.-Comput. Interact., 6 (ISS), Article No. 585, 20 pages, nov 2022.

@article{perelman:hal-03856210,
  author = {Perelman, Gary and Dubois, Emmanuel and Probst, Alice and Serrano, Marcos},
  title = {Visual Transitions around Tabletops in Mixed Reality: Study on a Visual Acquisition Task between Vertical Virtual Displays and Horizontal Tabletops},
  journal = {Proc. ACM Hum.-Comput. Interact.},
  volume = {6},
  number = {ISS},
  articleno = {585},
  numpages = {20},
  publisher = {ACM},
  month = {nov},
  year = {2022},
  doi = {10.1145/3567738},
  url = {https://doi.org/10.1145/3567738},
  url-hal = {https://ut3-toulouseinp.hal.science/hal-03856210},
}

Relevant Prior Work of the Consortium

Louis-Pierre Bergé, Emmanuel Dubois, L. Boudet, et Michel Rodriguez. 2019. Menu linéaire, contextuel et circulaire: cas d’application pour la création de situation tactique (SITAC), Proceedings of the 31ème conférence francophone sur l’Interaction Homme-Machine, IHM '19, pp. 4:1-8, AFIHM HAL

Eugenie Brasier, Olivier Chapuis, Nicolas Ferey, Jeanne Vezien & Caroline Appert. 2021. ARPads: Mid-air Indirect Input for Augmented Reality. International Symposium on Mixed and Augmented Reality, ISMAR '21, pp. 453 - 464, IEEE. DOI HAL

Florent Cabric, Emmanuel Dubois & Marcos Serrano. 2021. A Predictive Performance Model for Immersive Interactions in Mixed Reality, International Symposium on Mixed and Augmented Reality, ISMAR '21, pp. 202-210, IEEE. DOI HAL

Florent Cabric, Emmanuel Dubois, Pourang Irani, Marcos Serrano. 2019. TouchGlass: Raycasting from a Glass Surface to Point at Physical Objects in Public Exhibits, 17th IFIP Conference on Human-Computer Interaction, INTERACT '19, pp. 249-269, Springer. DOI

Emmanuel Courtoux, Caroline Appert & Olivier Chapuis. 2021. WallTokens: Surface Tangibles for Vertical Displays. Proceedings of the international conference on Human factors in computing systems, CHI '21, 13 pages, ACM. DOI HAL

Bruno Fruchard, Eric Lecolinet & Olivier Chapuis. 2018. Impact of Semantic Aids on Command Memorization for On-Body Interaction and Directional Gestures. Proceedings of the International Working Conference on Advanced Visual Interfaces, AVI '18, 14:1-14:9, ACM. DOI HAL

Jan Gugenheimer, Christian Mai, Mark McGill, Julie Williamson, Frank Steinicke, and Ken Perlin. 2019. Challenges Using Head-Mounted Displays in Shared and Social Spaces. Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems,CHI EA '19, W19:1– W19:8, ACM. DOI

Jan Gugenheimer, Evgeny Stemasov, Harpreet Sareen, and Enrico Rukzio. 2018. FaceDisplay: Towards Asymmetric Multi-User Interaction for Nomadic Virtual Reality. Proceedings of the Conference on Human Factors in Computing Systems, pp. 54:1–54:13, ACM. DOI

Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2017. ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users. Proceedings of the Conference on Human Factors in Computing Systems, CHI '17, pp. 4021–4033, ACM. DOI

Jan Gugenheimer, David Dobbelstein, Christian Winkler, Gabriel Haas, and Enrico Rukzio. 2016. FaceTouch: Enabling Touch Interaction in Display Fixed UIs for Mobile Virtual Reality. Proceedings of the 29th Annual Symposium on User Interface Software and Technology , UIST '16, 49–60, ACM. DOI

Raphaël James, Anastasia Bezerianos, Olivier Chapuis, Tim Dwyer, Maxime Cordeil & Arnaud Prouzeau. 2020. Personal+Context Navigation: Combining AR and Shared Displays in Network Path-following. Proceedings of Graphics Interface, GI '20, 13 pages, CHCCS/SCDHM. DOI HAL

Hans-Christian Jetter, Jan-Henrik Schröder, Jan Gugenheimer, Mark Billinghurst, Christoph Anthes, Mohamed Khamis & Tiare Feuchtner. 2021. Transitional Interfaces in Mixed and Cross-Reality: A new frontier? Interactive Surfaces and Spaces, ISS '21, pp. 46–49, ACM. DOI

Philippe Limousin, Radhouene Azzabi, Louis-Pierre. Bergé, Hubert Dubois, L. L. Gall, and S. Truptil. 2019. How to build dashboards for collecting and sharing relevant information to the strategic level of crisis management. International Conference on Information and Communication Technologies for Disaster Management, ICT-DM ’19, pp. 1-8, IEEE. DOI

Arnaud Prouzeau, Anastasia Bezerianos & Olivier Chapuis. Awareness Techniques to Aid Transitions between Personal and Shared Workspaces in Multi-Display Environments. Proceedings of the 2018 International Conference on Interactive Surfaces and Spaces, ISS '18, 291-304, ACM. DOI HAL

Houssem Eddine Saidi, Emmanuel Dubois, Marcos Serrano. 2021. HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View Interaction, Proceedings of the international conference on Human factors in computing systems, CHI '21, 17 pages, ACM. DOI

Houssem Eddine Saïdi, Marcos Serrano, Pourang Irani, Christophe Hurter, Emmanuel Dubois. 2019. On-Body Tangible Interaction: Using the Body to Support Tangible Manipulations for Immersive Environments, 17th IFIP Conference on Human-Computer Interaction, INTERACT '19, pp. 471-492, Springer. DOI

Adalberto L. Simeone, Mohamed Khamis, Augusto Esteves, Florian Daiber, Matjaž Kljun, Klen Čopič Pucihar, Poika Isokoski, and Jan Gugenheimer. 2020. International Workshop on Cross-Reality (XR) Interaction. Companion Proceedings of the 2020 Conference on Interactive Surfaces and Spaces, ISS '20, 111–114, ACM. DOI

Sébastien Truptil, Philippe Limousin, Louis-Pierre Bergé, Radhouene Azzabi, Huber Dubois. 2020. Towards a unified approach of interoperability to facilitate the transfer from research to industry: application to crisis management, Interoperability for Enterprise Systems and Applications, Interoperability for Crisis Management: Increasing Organizational Resilience, I-ESA Workshops '20, 5 pages, CEUR. PDF

Wen-Jie Tseng, Samuel Huron, Eric Lecolinet, and Jan Gugenheimer. 2021. FingerMapper: Enabling Arm Interaction in Confined Spaces for Virtual Reality through Finger Mappings. Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, W194:1–W194:4, ACM. DOI

...

	Laboratoire Interdisciplinaire des Sciences du Numérique (LISN), Université Paris-Saclay, CNRS & Inria. Olivier Chapuis (Scientific Coordinator), Caroline Appert and Arthur Fages (Post-doc ANR) with the ILDA Inria team ... More info Olivier Chapuis (Scientific Coordinator), Caroline Appert and Arthur Fages (Post-doc ANR) with the ILDA Inria research team, part of the Humain Centred Interaction department of the LISN. Expertise in wall-displays, tangible interaction, distributed input and rendering, collaborative interaction, evaluation of interactive system, etc. Less info
	CEA Tech en Occitanie, Commissariat à l'Energie Atomique et aux Energies Alternatives. Philippe Limousin (Coordinator), Louis-Pierre Bergé and Hubert Dubois at CEA Tech en Occitanie... More info Philippe Limousin (Coordinator), Louis-Pierre Bergé and Hubert Dubois at CEA Tech en Occitanie, one of the six site of CEA Tech, a structure of the CEA with the goal to transfer research results to industry. Expertise in crisis management, large tabletop, interactive rooms, etc. Less Info
	Institut de Recherche en Informatique de Toulouse (IRIT), CNRS & Université de Toulouse. Emmanuel Dubois (Coordinator), Marcos Serrano and Reda Benkhelifa (Ph.D. Student ANR) with the ELIPSE research group... More info Emmanuel Dubois (Coordinator), Marcos Serrano and Reda Benkhelifa (Ph.D. Student ANR) with the ELIPSE research group, part of the “Interaction and Collective Intelligence” department of the IRIT. Expertise in spatial and tangible interaction, multi-display environments, interaction techniques, eyes-free interaction, pervasive and ubiquitous computing, etc. Less info
	Laboratoire Traitement et Communication de l'Information, Télécom Paris & Institut Polytechnique de Paris. Eric Lecolinet (Coordinator), Jan Gugenheimer and Gaëlle Clavelin (Ph.D. Student ANR) with the DIVA group... More info Eric Lecolinet (Coordinator), Jan Gugenheimer and Gaëlle Clavelin (Ph.D. Student ANR) with the DIVA group, part of the Informatique et Réseaux department of the LTCI. Expertise in gestures in all their aspects such as learning and memorization, mixed Reality, spatial interaction, nomadic VR, novel output modalities, etc. Less info

ANR Project InterPlay

Overview

Consortium

Jobs

Publications and Software

Relevant Prior Work of the Consortium