Journal papers

1. [TVCG]
   Investigating Whether the Mass of a Tool Replica Influences Virtual Training Learning Outcomes Cauquis, Julien, Peillard, Etienne, Dominjon, Lionel, Duval, Thierry, and Moreau, Guillaume IEEE Transactions on Visualization and Computer Graphics 2024 [Abs] [pdf]

   Virtual Reality (VR) has emerged as a promising solution to address the pressing concern of transferring know-how in the manufacturing industry. Making an immersive training experience often involves designing an instrumented replica of a tool whose use is to be learned through virtual training. The process of making a replica can alter its mass, making it different from that of the original tool. As far as we know, the influence of this difference on learning outcomes has never been evaluated. To investigate this subject, an immersive training experience was designed with pre and post-training phases under real conditions, dedicated to learning the use of a rotary tool. 80 participants took part in this study, split into three groups: a control group performing the virtual training using a replica with the same mass as the original tool (m = 100%), a second group that used a replica with a lighter mass than the original tool (m = 50%), and a third group using a replica heavier than the original tool (m = 150%). Despite variations in the mass of the replica used for training, this study revealed that the learning outcomes remained comparable across all groups, while also demonstrating significant enhancements in certain performance measures, including task completion time. Overall, these findings provide useful insights regarding the design of tool replicas for immersive training.

2. The Sense of Embodiment in Virtual Reality and its Assessment Methods Guy, Martin, Normand, Jean-Marie, Jeunet-Kelway, Camille, and Moreau, Guillaume Frontiers in Virtual Reality 2023 [Abs] [doi] [pdf]

   The sense of embodiment refers to the sensations with being inside, having and controlling a body. In virtual reality, it is possible to substitute a person’s body with a virtual one, referred to as an avatar. Modulations of the sense of embodiment through modifications of this avatar have perceptual and behavioural consequences on users that can influence the way users interact with the virtual environment. Therefore, it is essential to define metrics that enable a reliable assessment of the sense of embodiment in virtual reality to better understand its dimensions, the way they interact, and the influence that they have on the quality of interaction in the virtual environment. In this review, we first introduce the current knowledge on the sense of embodiment, its dimensions (senses of agency, body ownership, and self-location), and how they relate the ones with the others. Then, we dive into the different methods currently used to assess the sense of embodiment, ranging from questionnaires to neurophysiological measures. We provide a critical analysis of the existing metrics, discussing their advantages and drawbacks in the context of virtual reality. Notably, we argue that real-time measures of embodiment, that are also specific and do not require double-tasking are the most relevant in the context of virtual reality. Electroencephalography seems a good candidate for the future if its drawbacks (such as its sensitivity to movement and practicality) are improved. While the perfect metric has yet to be identified if it exists, this work provides clues on which metric to choose depending on the context, which should hopefully contribute to better assessing and understanding the sense of embodiment in virtual reality.

3. [TVCG]
   Handwriting for efficient text entry in industrial VR applications: influence of board orientation and sensory feedback on performance Fourrier, Nicolas, Moreau, Guillaume, Benaouicha, Mustapha, and Normand, Jean-Marie IEEE Transactions on Visualization and Computer Graphics 2023 [Abs] [doi] [pdf]

   Text entry in Virtual Reality (VR) is becoming an increasingly important task as the availability of hardware increases and the range of VR applications widens. This is especially true for VR industrial applications where users need to input data frequently. Large-scale industrial adoption of VR is still hampered by the productivity gap between entering data via a physical keyboard and VR data entry methods. Data entry needs to be efficient, easy-to-use and to learn and not frustrating. In this paper, we present a new data entry method based on handwriting recognition (HWR). Users can input text by simply writing on a virtual surface. We conduct a user study to determine the best writing conditions when it comes to surface orientation and sensory feedback. This feedback consists of visual, haptic, and auditory cues. We find that using a slanted board with sensory feedback is best to maximize writing speeds and minimize physical demand. We also evaluate the performance of our method in terms of text entry speed, error rate, usability and workload. The results show that handwriting in VR has high entry speed, usability with little training compared to other controller-based virtual text entry techniques. The system could be further improved by reducing high error rates through the use of more efficient handwriting recognition tools. In fact, the total error rate is 9.28% in the best condition. After 40 phrases of training, participants reach an average of 14.5 WPM, while a group with high VR familiarity reach 16.16 WPM after the same training. The highest observed textual data entry speed is 21.11 WPM.

4. Deep weathering effects Verhulst, Adrien, Normand, Jean-Marie, Moreau, Guillaume, and Patow, Gustavo Computers & Graphics 2023 [Abs] [doi] [pdf]

   Weathering phenomena are ubiquitous in urban environments, where it is easy to observe severely degraded old buildings as a result of water penetration. Despite being an important part of any realistic city, this kind of phenomenon has received little attention from the Computer Graphics community compared to stains resulting from biological or flow effects on the building exteriors. In this paper, we present physically-inspired deep weathering effects, where the penetration of humidity (i.e., water particles) and its interaction with a building’s internal structural elements result in large, visible degradation effects. Our implementation is based on a particle-based propagation model for humidity propagation, coupled with a spring-based interaction simulation that allows chemical interactions, like the formation of rust, to deform and destroy a building’s inner structure. To illustrate our methodology, we show a collection of deep degradation effects applied to urban models involving the creation of rust or of ice within walls.

5. Apport de la réalité augmentée comme aide technologique pour le maintien de l’autonomie de personnes présentant une maladie neurologique : revue narrative de la littérature Perrier, Manon, Pillette, Léa, Normand, Jean-Marie, Lécuyer, Anatole, Moreau, Guillaume, and Mélanie, Cogné Ergothérapies 2022 [Abs] [doi] [pdf]

   Introduction. Cognitive disorders can limit participation of people with neurological diseases in daily life activities, and more specifically when navigating in their outdoor environment. Augmented Reality (AR) tools seem promising for compensating these difficulties. Aim. Our main objective was to detail and discuss the existing application fields of AR devices for people with neurological disorders. Methods. We conducted our literature review between August and September 2021 using 2 databases: Medline and Scopus, with the following keywords: “augmented reality” AND: “neurological” (and synonyms: “neurology”, “neurologic”), “disorientation”, “mild cognitive”, “aid”, “cognition”. Results. We selected and analysed 13 studies. The selected articles show a good acceptance of AR devices by the participants. Research focused on navigation tasks showed that most of the participants were able to complete the navigation task without any other assistance. The notion of cognitive load which influences the user’s safety during the navigation task when using augmented reality, was often taken into account. Conclusion. We defined a framework for the use of AR that can be applied in rehabilitation and to consider its future use in the person’s environment as a technological aid for spatial navigation. Further studies on the cognitive load in people with neurological pathology are necessary to compare the results obtained to ones on healthy participants.

6. Towards a sensitive urban wind representation in virtual reality Giraldo, Gabriel, Servières, Myriam, and Moreau, Guillaume ISPRS International Journal of Geo-Information 2022 [Abs] [doi] [pdf]

   Wind can influence people’s behavior and their way of inhabiting an architectural or urban space. Furthermore, virtual reality (VR) enables the simulation of different physical and sensitive phenomena such as the wind. We aim to analyze the effects of different wind representations in terms of perception of its properties and sense of presence in VR. We carry out two within-subject studies aiming at evaluating different wind representation suggestions (including audiovisual and tactile stimuli) to identify their effects on wind properties’ perception and sense of presence in the VR scene. Our analysis showed significant effects of tactile restitution over the visual effects used in the study, both for understanding wind properties and for increasing the sense of presence in the VR scene. The tactile condition (T) reduced the estimation error of wind direction by 27% compared to the visual condition (V). The wind force error was reduced by 9.8% using (T) with (V). (T) increased the sense of presence by 12.2% compared to (V). Our second experiment showed an overestimation of the wind force perceived compared to the reference value of the Beaufort scale. For the maximum force value evaluated, the average result was 91% higher than the reference value, while for the lower, the average answer was 77% higher than the reference value. Previous studies have evaluated wind rendering in virtual reality, and others have studied the visualization of wind simulation results. To our knowledge, our study is the first to compare the perception of these two types of representations as well as the effects of wind on elements of the context. We also compared the wind perception to a reference-based method, the Beaufort scale.

7. [TVCG]
   A Systematic Review of Navigation Assistance Systems for People with Dementia Pillette, Léa, Moreau, Guillaume, Normand, Jean-Marie, Perrier, Manon, Lécuyer, Anatole, and Cogné, Melanie IEEE Transactions on Visualization and Computer Graphics 2022 [Abs] [doi] [pdf]

   Technological developments provide solutions to alleviate the tremendous impact on the health and autonomy due to the impact of dementia on navigation abilities. We systematically reviewed the literature on devices tested to provide assistance to people with dementia during indoor, outdoor and virtual navigation (PROSPERO ID number: 215585). Medline and Scopus databases were searched from inception. Our aim was to summarize the results from the literature to guide future developments. Twenty-three articles were included in our study. Three types of information were extracted from these studies. First, the types of navigation advice the devices provided were assessed through: (i) the sensorial modality of presentation, e.g., visual and tactile stimuli, (ii) the navigation content, e.g., landmarks, and (iii) the timing of presentation, e.g., systematically at intersections. Second, we analyzed the technology that the devices were based on, e.g., smartphone. Third, the experimental methodology used to assess the devices and the navigation outcome was evaluated. We report and discuss the results from the literature based on these three main characteristics. Finally, based on these considerations, recommendations are drawn, challenges are identified and potential solutions are suggested. Augmented reality-based devices, intelligent tutoring systems and social support should particularly further be explored.

8. Direct and Indirect vSLAM Fusion for Augmented Reality Outahar, Mohamed, Moreau, Guillaume, and Normand, Jean-Marie Journal of Imaging 2021 [Abs] [doi] [pdf]

   Augmented reality (AR) is an emerging technology that is applied in many fields. One of the limitations that still prevents AR to be even more widely used relates to the accessibility of devices. Indeed, the devices currently used are usually high end, expensive glasses or mobile devices. vSLAM (visual simultaneous localization and mapping) algorithms circumvent this problem by requiring relatively cheap cameras for AR. vSLAM algorithms can be classified as direct or indirect methods based on the type of data used. Each class of algorithms works optimally on a type of scene (e.g., textured or untextured) but unfortunately with little overlap. In this work, a method is proposed to fuse a direct and an indirect methods in order to have a higher robustness and to offer the possibility for AR to move seamlessly between different types of scenes. Our method is tested on three datasets against state-of-the-art direct (LSD-SLAM), semi-direct (LCSD) and indirect (ORBSLAM2) algorithms in two different scenarios: a trajectory planning and an AR scenario where a virtual object is displayed on top of the video feed; furthermore, a similar method (LCSD SLAM) is also compared to our proposal. Results show that our fusion algorithm is generally as efficient as the best algorithm both in terms of trajectory (mean errors with respect to ground truth trajectory measurements) as well as in terms of quality of the augmentation (robustness and stability). In short, we can propose a fusion algorithm that, in our tests, takes the best of both the direct and indirect methods.

9. Detection of Removed Objects in 3D Meshes Using Up-to-Date Images for Mixed-Reality Applications Roupin, Olivier, Fradet, Matthieu, Baillard, Caroline, and Moreau, Guillaume Electronics 2021 [Abs] [doi] [pdf]

   Precise knowledge of the real environment is a prerequisite for the integration of the real and virtual worlds in mixed-reality applications. However, real-time updating of a real environment model is a costly and difficult process; therefore, hybrid approaches have been developed: An updated world model can be inferred from an offline acquisition of the 3D world, which is then updated online using live image sequences under the condition of developing fast and robust change detection algorithms. Current algorithms are biased toward object insertion and often fail in object removal detection; in an environment where there is uniformity in the background—in color and intensity—the disappearances of foreground objects between the 3D scan of a scene and the capture of several new pictures of said scene are difficult to detect. The novelty of our approach is that we circumvent this issue by focusing on areas of least change in parts of the scene that should be occluded by the foreground. Through experimentation on realistic datasets, we show that this approach results in better detection and localization of removed objects. This technique can be paired with an insertion detection algorithm to provide a complete change detection framework.

10. Camera pose estimation using collaborative databases and single building image Semaan, Bernard, Servières, Myriam, Moreau, Guillaume, and Chebaro, Bilal Journal of Geographic Information System 2020 [doi] [pdf]
11. Exploring Multiple And Coordinated Views For Multilayered Geospatial Data In Virtual Reality Spur, Maxim, Tourre, Vincent, David, Erwan, Moreau, Guillaume, and Le Callet, Patrick Information 2020 [doi] [pdf]
12. Effects of Physical, Non-Immersive Virtual, and Immersive Virtual Store Environments on Consumers’ Perceptions and Purchase Behavior Lombart, Cindy, Millan, Elena, Normand, Jean-Marie, Verhulst, Adrien, Labbé-Pinlon, Blandine, and Moreau, Guillaume Computers in Human Behavior 2020 [Abs] [doi] [pdf]

    The application of virtual reality in human activities has been rapidly growing during the last decade. Shopping for food is an important part of people’s daily lives. As overnight delivery services of fresh produce, such as Amazon Fresh, are in their development stage, more studies on virtual stores for perishable products are needed because the quality of FaVs cannot be easily assessed by consumers when virtual stores are used. This research examines the impact of a physical store, a non-immersive virtual store, and an immersive virtual store environment on consumers’ perceptions and purchase behavior toward fruits and vegetables (FaVs). Experimental between-subjects design (i.e., three groups), combined with a questionnaire survey (after-only design), is used to address the study objectives. The research found that consumers’ perceptions of FaVs in both non-immersive and immersive virtual stores (VS) are similar to those in a physical store. By contrast, consumers buy more FaVs in both non-immersive and immersive VS compared to a physical store. The findings also indicate that consumers tend to rely more on extrinsic cues (i.e., FaVs’ prices) in the immersive VS when evaluating the FaVs on offer and less on intrinsic cues (e.g., FaVs’ appearance) they use in the physical store. The results have important implications for practitioners and researchers with regard to the usefulness of virtual reality for better understanding of consumer behavior.

13. Influence of virtual objects’ shadows and lighting coherence on distance perception in optical see-through augmented reality Gao, Yuan, Peillard, Etienne, Normand, Jean-Marie, Moreau, Guillaume, Liu, Yue, and Wang, Yongtian Journal of the Society of Information Display 2020 [doi] [pdf]
14. Consumer perceptions and purchase behavior toward imperfect fruits and vegetables in an immersive virtual reality grocery store Lombart, Cindy, Millan, Elena, Normand, Jean-Marie, Verhulst, Adrien, Labbé-Pinlon, Blandine, and Moreau, Guillaume Journal of Retailing and Consumer Services 2019 [doi] [pdf]
15. A Study on Differences in Human Perception between a Real and an AR Scene viewed in an OST-HMD Gao, Yuan, Liu, Yue, Normand, Jean-Marie, Moreau, Guillaume, Gao, Xue, and Wang, Yongtian Journal of the Society for Information Display 2019 [doi] [pdf]
16. Comment les consommateurs réagissent-ils, en situation d’achat, face à des fruits et légumes difformes ? Premiers résultats d’une étude menée en magasin laboratoire virtuel immersif Lombart, Cindy, Labbé-Pinlon, Blandine, Normand, Jean-Marie, Verhulst, Adrien, and Moreau, Guillaume Revue de l’organisation Responsable 2019 [doi] [pdf]
17. Influence of Being Embodied in an Obese Virtual Body on Shopping Behavior and Product Perception in VR Verhulst, Adrien, Normand, Jean-Marie, Lombart, Cindy, Sugimoto, Maki, and Moreau, Guillaume Frontiers in Robotics and AI: Virtual Environments 2018 [doi] [pdf]
18. Voir l’invisible : de la vision par ordinateur aux réalités augmentée et virtuelle Moreau, Guillaume, and Normand, Jean-Marie Revue française d’Histotechnologie 2018 [pdf]
19. [TVCG]
    Local Geometric Consensus: a general purpose point pattern-based tracking algorithm Yang, Liming, Normand, Jean-Marie, and Moreau, Guillaume IEEE Transactions on Visualization & Computer Graphics 2015 [Abs] [doi] [pdf]

    We present a method which can quickly and robustly match 2D and 3D point patterns based on their sole spatial distribution, but it can also handle other cues if available. This method can be easily adapted to many transformations such as similarity transformations in 2D/3D, and affine and perspective transformations in 2D. It is based on local geometric consensus among several local matchings and a refinement scheme. We provide two implementations of this general scheme, one for the 2D homography case (which can be used for marker or image tracking) and one for the 3D similarity case. We demonstrate the robustness and speed performance of our proposal on both synthetic and real images and show that our method can be used to augment any (textured/textureless) planar objects but also 3D objects.

20. Gérer les informations temporelles dans et par les modèles informatiques Bertrand, Frédéric, Faucher, Cyril, Lafaye, Jean-Yves, Moreau, Guillaume, Servières, Myriam, and Zaki, Chamseddine Revue Internationale de Géomatique, numéro spécial "modéliser les dynamiques spatiales" 2015 [doi] [pdf]
21. Real Time Detection and Tracking of Printed Maps Based on Road Structure Callier, Sébastien, Saito, Hideo, and Moreau, Guillaume ITE Transactions on Media Technology and Applications 2015 [doi]
22. Footprint-Based Generalization of 3D Building Groups at Medium Level of Detail for Multi-Scale Urban Visualization He, Shuang, Moreau, Guillaume, and Martin, Jean-Yves International Journal on Advances in Software 2012
23. Real-time adaptive blur for reducing eye strain in stereoscopic displays Leroy, Laure, Fuchs, Philippe, and Moreau, Guillaume ACM Transactions on Applied Perception 2012 [doi]
24. Enrichissement d’un réseau routier à partir de trajectoires : application dans un contexte d’urgence Soussi, Mohamed, Follin, Jean-Michel, Moreau, Guillaume, Bouju, Alain, and Polidori, Laurent Ingénierie des Systèmes d’Information 2012 [doi]
25. Caractérisation des tissus urbains à partir de l’analyse structurelle des réseaux viaires Hamaina, Rachid, Leduc, Thomas, and Moreau, Guillaume Cybergéo : European Journal of Geography 2012 [doi]
26. Visual fatigue reduction for immersive stereoscopic displays by disparity, content and focus-point adapted blur Leroy, Laure, Fuchs, Philippe, and Moreau, Guillaume IEEE Transactions in Industrial Electronics 2011 [doi]
27. Utilisation des tests de concordance de scripts pour l’évaluation en informatique Magnin, Morgan, and Moreau, Guillaume Sciences et Technologies de l’Information et de la Communication pour l’Éducation et la Formation 2011
28. Generic modeling of application and spatiotemporal data: application to the study of pedestrian behavior Zaki, Chamseddine, Zekri, Elyes, Servières, Myriam, Moreau, Guillaume, and Hégron, Gérard Intelligent Decision Technology 2011 [Abs] [doi]

    In this paper we propose a methodology describing a global process used to model both urban spatiotempporal data and applications. During the design phase, we use a tool based on the Entity-Relation formalism that is dedicated to spatiotemporal data design (MADS). The resulting conceptual schemas are adapted to the particularities of the urban data by distingusihing between physical concepts (continuants) and events (occurents). This distinction enables a better readability of conceptual schemas and a more powerful interoperability. The resulting schemas are then implemented in an object oriented environment. In the end, we use a GIS to query and graphically represent urban data. In order to test the capacity of our proposed modeling methodology in a real case, we apply it on a case study whose objective is to analyze pedestrian walkways in urban areas

29. Camera tracking by on-line learning of keypoint arrangement with LLAH for augmented reality applications Uchiyama, Hideaki, Saito, Hideo, Servières, Myriam, and Moreau, Guillaume Virtual Reality 2011 [doi] [pdf]
30. AR geovisualization framework based on on-line geographic data matching between a map with intersections and its intersection database on GIS Uchiyama, Hideaki, Saito, Hideo, Servières, Myriam, and Moreau, Guillaume Journal of the Institute of Image Information and Television Engineers 2010
31. Virtual Reality as a landscape decision-making tool: The wind turbines’ case Jallouli, Jihen, and Moreau, Guillaume International Journal of Design Sciences and Technology 2010
32. Géolocalisation en milieu urbain par appariement entre une collection d’images et un SIG 2D Bioret, Nicolas, Moreau, Guillaume, and Servières, Myriam Ingénierie des Systèmes d’Information, numéro spécial "Systèmes d’information et géo-localisation" 2009 [doi] [pdf]
33. An immersive path-based study of wind turbines landscape: a French case in Plouguin Jallouli, Jihen, and Moreau, Guillaume Renewable Energy 2009 [doi]
34. Integration of Immersive Walking to Analyze Urban Daylighting Ambiences Tahrani, Souha, and Moreau, Guillaume Journal of Urban Design 2008 [Abs] [doi]

    The urban environment is deÞned as the interaction between the cityÕs morphological characteristics and its physical behaviour based on human interpretation. Contemporary psychology emphasizes the relation between perception and action and conÞrms that perception can be enhanced by the receptorÕs motion. Basing this study on these principles, it is assumed that virtual reality techniques bring both immersion and interaction to static computer generated images and they can be used to study sunlight effects as well as daylight ambience. This paper shows the methodology of Ôsunlight effectsÕ analysis of both real and virtual worlds and builds a framework for a comparison.

35. Dense Stereo Correspondence using quarters of wavelet transform Régis, Sébastien, Doncescu, Andrei, Moreau, Guillaume, and Fuchs, Philippe International Journal of Pattern Recognition and Artificial Intelligence 2005 [doi]
36. Applications of Virtual Reality in the manufacturing industry: from design review to ergonomic studies Moreau, Guillaume, Fuchs, Philippe, and Stergiopoulos, Panagiotis Mécanique et Industries 2004
37. Dossier Réalité Virtuelle Chauvineau, Eric, Moreau, Guillaume, and Aubel, Amaury A3IEMag (journal des anciens de l’ENSIIE) 2002