Human Perception-Optimized Planning for Comfortable VR-Based Telepresence
This paper introduces an emerging motion planning problem by considering a human that is immersed into the viewing perspective of a remote robot. The challenge is to make the experience both effective (such as delivering a sense of presence) and comfortable (such as avoiding adverse sickness symptoms, including nausea). We refer this challenging new area as human perception-optimized planning and propose a general multiobjective optimization framework that can be instantiated in many envisioned scenarios. We then consider a specific VR telepresence task as a case of human perception-optimized planning, in which we simulate a robot that sends 360 video to a remote user to be viewed through a head-mounted display. In this particular task, we plan trajectories that minimize VR sickness (and thereby maximize comfort). An A* type method is used to create a Pareto-optimal collection of piecewise linear trajectories while taking into account criteria that improve comfort. We conducted a study with human subjects touring a virtual museum, in which paths computed by our algorithm are compared against a reference RRT-based trajectory. Generally, users suffered less from VR sickness and preferred the paths created by the presented algorithm.
In the last few years, the arrival of consumer Virtual Reality (VR) products has enhanced the level of immersion that most people can experience through a robotic platform. This is an unprecedented opportunity to make people feel present in a remote or artificial environment along with the actuation provided by robotic platforms (see Fig. 1). This allows people to interact with each other over distances as more than a face on a screen, in so-called mobile robotic telepresence, which has been shown to be a superior means of communication over simple videoconferencing [18, 25]; possible use cases include attending conferences or business meetings, and elderly care. This highly immersive mode of human-robot interaction brings challenging new motion planning aspects.
We first present a mathematical framework for human perception-optimized planning, in which unprecedented level of human factors must be considered in the motion planning problem. In this framework one of the most challenging problems is to guarantee user comfort as several of the user’s senses are stimulated with artificial or remote experiences, while also taking into account classic motion planning criteria and other people in the presence of the robot. We propose a general and formal definition of such framework, formulated as a Multi-Objective Optimization (MOO) problem, which can be instantiated in a variety of tasks.
We then present a concrete VR telepresence task as an instance of human perception-optimized planning, in which we simulate a robot that streams 360 video to a user’s head-mounted display (HMD). Although the use of an HMD may bring on adverse side effects, it has been shown superior in some contexts such as search-and-rescue operations requiring detailed object identification and depth perception , collaborative assembly tasks , and increased stability while teleoperating a wheelchair . This makes HMD-based teleoperation an appealing research direction. Even though there are known methods for reducing VR sickness, their downside is that they often reduce the feeling of presence , which is the feeling of actually being at the location seen on the screen . Increasing the feeling of presence has the potential to resolve some issues of telepresence, such as perceived difficulty of communication . Because the susceptibility to VR sickness varies greatly within a population , applying the sickness reduction techniques to all users should not be considered. Thus, in this work we consider finding the Pareto front of the MOO problem, which means the set of all solutions for which there are none better in terms of all criteria.
This paper has two main parts. The first one is to define the general framework for human perception-optimized planning as a MOO problem with a Pareto front, which allows multiple future research directions and usage with any motion planning method. This is done by defining four classes of criteria to help researchers make sure they have taken all of the required parts of a problem into account. The second part is to use the framework to define a VR telepresence task as a concrete instance of human perception-optimized planning. For this particular instance, we propose computing piecewise-linear trajectories, which are motivated by falling in line with the sensory conflict theory  of motion sickness.
Finally, in preliminary experiments, we show with trials on human subjects that the Pareto trajectories designed by the presented algorithm are preferred over trajectories created by a typical motion planning algorithm, the RRT  (even when selecting an optimized trajectory). In such trials, the remote video streaming performed by the robot is simulated, allowing us to have control over the experimentation. The actual tests with a physical robot are left for future work, where issues such as communication delays, feedback control, and robot localization must be considered. Nonetheless, the simulation study in this paper is an important step toward validation of the planning methods.
MOO issues arise often in robotics because of common tradeoffs between safety and task efficiency. However, this is typically solved by simply choosing the weights, or priorities, beforehand. In contrast, Pareto optimization finds all possible solutions, often called the Pareto front, in which one criterion cannot be improved without degrading another one. Many Pareto-optimization works appear in robotics [14, 37, 38]. Pareto optimization is a natural choice for human perception-optimized planning because the prioritizing or weighting of the criteria can vary heavily due to the high variance of susceptibility to cybersickness in population.
In this paper, we consider a VR telepresence task as a particular instance of human perception-optimized planning. In the area of robotics, the human telepresence task has been addressed in works such as [24, 17], with the goal to achieve the remote presence of a human in a physical space. Whereas most works in telepresence consider only a 2-D screen, there are few works who consider using an HMD as well. Oh et al.  considered using a telepresence robot streaming video from 360 camera to an HMD on a facility tour. Heshmat et al.  compared telepresence between a 2-D screen and an HMD, and found that people prefer the ability to look around with the HMD. Zhang et al.  researched the use of redirected walking when using an HMD for teleoperation, and Stotko et al.  built a model from the environment to be observed by the user while the robot moved. However, in [39, 33] the issue of VR sickness was avoided by using less scalable user interfaces, and in [23, 8] it was not considered at all.
The term VR sickness, often also called cybersickness, is used to refer to Visually Induced Motion Sickness (VIMS) in the context of Virtual Reality [5, 22]. To be more specific, VIMS is a particular type of Motion sickness (MS) that may occur without the person physically moving but while they are observing motion. VIMS can appear under visual stimulation present in movie theatres , virtual simulators  and video games. It can result in symptoms such as cold sweat, dizziness, headaches, nausea, and even vomiting. Since MS and VIMS share many common characteristics, classical MS theories that incorporate visual components can be used to try to explain and address VIMS, and therefore, VR sickness. One theory is that the origin of MS is a negative reinforcement system to avoid postural instability . Other works as  explain MS as a function of the vestibular detection of stimuli that would be disruptive to digestion. Some theories even suggest that MS serves as a mechanism to avoid poisoning . Nevertheless, the most accepted and cited MS theory is the sensory conflict theory [4, 26]. This theory attributes MS to the mismatch between optical flow perceived by the eyes, the vestibular system, and/or the somatosensory senses (non-vestibular proprioceptive senses of skin, muscles, and joints). This last theory is the one we adopt in the presented work.
Consider then our scenario, in which a stationary human user is wearing an HMD, and a remote robot is used to stream 360 video to the user through the HMD. The main potential discomfort in such a system comes from the symptoms of VR sickness. More precisely, assume that the user is seated wearing the HMD; when the robot moves and transmits views from changing viewpoints, the vestibular system reports that the user is motionless, but the user’s vision system reports to his brain that they are moving, which might yield vection. Vection is the illusion of self motion when no movement is taking place, and is believed to be an important cause for VR sickness, as vection involves an intrinsic sensorial conflict that might result in symptoms such as dizziness, nausea, and even vomiting. Several factors affect vection sensitivity . Some examples include the distance from the center view, spatial frequency of the displayed images, prior knowledge (knowing beforehand what kind of motion should be perceived), and exposure time to the optical flow.
Ii human perception-optimized planning
We define as human perception-optimized planning the generation of a collision-free trajectory for a sensing-system that generates a perceptual stimulus to an interfaced user, while ensuring user’s comfort. If the sensing system is attached to a mobile robot platform, both the sensor and the platform may have separate Degree of Freedoms; consider, for example, a camera attached to a pan-tilt-unit, or even a robot arm, on top of a wheeled platform. This decoupling allows assigning different requirements for each set of DoFs; it has been shown that decoupling the viewing angle and motion of the vehicle improves teleoperation .
Human perception-optimized planning can be considered as an upper layer to a motion planning task; the perceptual stimuli is planned to optimize a set of criteria. Inherited by the motion planning aspect of the task, the path itself can be required to optimize certain aspects of the movement, for example, the travelled distance. However, these criteria may be contradicting and depend on personal preferences, and thus care must be taken on how to prioritize the criteria, naturally leading to the formulation of Pareto optimization.
To formalize the human perception-optimized planning problem, we proceed to introduce some notation and basic concepts. The physical system consists of a mobile robot base and a (possibly actuated) sensor attached to the base, with both moving in the Euclidean workspace . Let be the obstacle region, the configuration space of and the configuration space of , thus making the configuration space of the whole system . Finally, is the set of configurations in which the interior of the system geometric model, placed at configuration , intersects .
Let denote the state space, which is formed as the Cartesian product of and a compact space that covers time derivatives of configuration. Let , and . Furthermore, let be a continuous, collision-free trajectory, with , in which is the initial state , and is the goal state . Let denote the set all such trajectories (assuming and are fixed). In some cases, may be further constrained to include only trajectories that satisfy a control model of the form , with input u drawn from a compact set .
A trajectory that solves the human perception-optimized planning will be required to optimize certain criteria. For a better classification of the problem, we define four classes, , , and , which group the criteria belonging to different aspects of the problem. This classification can be used to, for example, make sure that no aspect of the problem is ignored or overemphasized. Each individual criterion is defined as a cost functional . First, the class includes criteria defining the performance, which depends on the application and refers to keeping the intended functionality of the system. For example, if the robot is equipped with a manipulator, this could correspond to keeping the orientation such that the manipulator can be used safely (e.g., not have it face a wall). In a telepresence scenario, this could correspond to the user retaining spatial orientation and the sense of presence. measures the comfort of the interfaced user while exposed to the stimulus obtained from the system, while moving via ; in the case of an HMD, this would correspond to criteria mitigating VR sickness. is a function that considers the robot motion; this includes mainly traditional motion planning criteria, such as path length, distance to objects, power consumption, etc. Lastly, considers others, for instance, other humans or moving bodies in the vicinity. These criteria can be related to the human-aware motion planning , in which behaviors such as not walking between two conversing people are considered. Thus, the task is to compute some that simultaneously minimizes the multiple criteria given by the vector of costs:
in which cover all individual criteria from and . The classes can be thought of as a manner to organize the costs, hence, the classes are vectors themselves. We note that this classification of criteria is meant to clarify the definition of a problem, and make sure that researchers and engineers who design human-based motions consider all aspects of the problem: criteria such as the distance to objects can be considered both as safety () or performance (); with a 360 camera, the performance deteriorates heavily if the camera is too close to an object.
Usually in a MOO problem a single solution is found by weighting the criteria according to their importance. However, when individual human physiology can have a strong impact on a desired weighting, scalarization of the problem too early should be avoided. This is especially important for the telepresence application because it has been shown that VR sickness and presence have a negative correlation , and thus degrading the presence for people who do not suffer from VR sickness severely deteriorates their situational awareness and communication ability. A natural solution is to find the Pareto front , in other words, solutions that cannot be improved in any of the objectives without degrading at least one of the other objectives. Mathematically, this is defined through the concept of (Pareto) dominance: a trajectory dominates trajectory , denoted as , if , and such that . Finally, based on the previous concepts, the general problem formulation is given next.
Human perception-optimized planning: Given the general motion planning formulation above, and a cost functional , find a set of all trajectories (up to cost-vector equivalence):
Note that this formulation does not consider a single trajectory to be a solution. This could be accomplished by simply formulating and optimizing a scalar, linear combination of all of the objectives; however, we want to present the set of Pareto-optimal solutions so that the system, together with users, could select particular trajectories dynamically during execution. It is important to offer this because to the high variability of human subject sensitivities and environmental conditions that arise during execution.
The next sections apply this formulation to an illustrative VR telepresence task.
Iii Case study: VR telepresence
The concept of telepresence is attributed to Marvin Minsky, pioneer of artificial intelligence . In the present work, we refer to VR telepresence as the set of technologies that allow human users interfaced with VR equipment to feel as they were present in a remote location, and even allow them to interact in that location through the use of teleoperated robots. Particularly, we will consider that there is a robot in a remote location equipped with a 360 camera, and that it is streaming video to an HMD worn by a human user at a different location (see Fig. 1). It is assumed that the human user has control over the robot’s goal (essentially, any location in ), but that a motion planner computes the trajectories to reach the goal; therefore, solving a human perception-optimized planning problem.
In the next subsections we present the specifics of the criteria used in this case study for human perception-optimized planning, and the actual planner that will be used to compute the required trajectories.
Iii-a System model
The considered system consists of a robotic base moving on a plane with a 360 camera mounted on top of it, streaming video to an HMD worn by a user. The robotic base is a differential drive robot (DDR). The camera will be fixed on top of the DDR, hence, the configuration space of the whole system will be the one of the robotic base, namely, . Considering extra degrees of freedom () for an actuated or filtered omnidirectional camera is left for future work.
The state of the system is given by the tuple . Let and be the coordinates of the reference point located between the DDR wheels, and the robot’s heading. Variables and denote the velocities of the contact point of the right and left wheels with the floor, respectively. The system is controlled through the right and left wheels’ translational accelerations, and , with , . Considering as the distance between the robot’s reference point and the wheels, we obtain the next state transition equation that models our VR telepresence system:
Iii-B Modeling of user comfort cost functional
A critical aspect on the VR telepresence task is the user’s comfort, which is mainly affected by the experienced VIMS. Nonetheless, other performance issues need to be addressed; with a 360 camera, the performance deteriorates heavily if the camera is too close to an object. In the present work, to compute solution trajectories for the human-perception-planning problem in the context of VR telepresence, we will mainly focus on the performance and user’s comfort aspects of the problem; therefore, the cost functional will be of the form . This allows a controlled experiment that concentrates on the sickness and preference; new criteria must be thoroughly controlled and researched, before they are accepted as a part of a complete human perception-optimized planning.
Regarding the performance costs , due to the 360 camera requirements, it is desirable to keep a ball of radius around the 360 camera unobstructed. Consequently, we define a function that measures the obstructed percentage of such a ball centered at the camera position p. Eq. (3) defines , in which for a measurable set , is the volume of , is a ball centered at p with radius , and is the obstacle region in :
Using function , we define the function as in Eq. (4), which is an average over all trajectory of the percentage of obstructed volume of a ball of radius around the 360 camera:
This functional is aimed at preferring trajectories in which the ball around the 360 camera is not cluttered, allowing proper functioning of the camera. Concerning user’s comfort , from a sensory conflict theory perspective, the experienced VIMS comes from the conflict between the user’s vision and vestibular system. The vestibular system is composed of two main organs, the otoliths and the semicircular canals. The otoliths sense linear acceleration and the semicircular canals angular acceleration. Under that premise, presenting the visual stimuli corresponding to following a curved path would evoke potential sensory conflict with the otoliths, due to the presence of linear accelerations (for instance, the components of centripetal acceleration). Moreover, visual stimuli resulting from rotational movement can also evoke sensory conflict with the semicircular canals. Under that rationale, in the present work, we propose to move along piecewise linear paths, in addition to reducing the number of line segments comprising them. The DDR will be required to apply straight line motions with its heading pointing tangentially to the line segments, and apply rotations in place at line segment transitions to redirect its heading with regard to the next segment. Note that following line segments, the total time of conflict with the otoliths can be reduced; as shown in , performing a fixed amount of rotation with greater speed can be beneficial in preventing VR sickness, as it reduces the total time of conflict. Additionally, reducing the number of segments reduces the number of poses at which conflict with the semicircular canals takes place. Indeed, the number of transitions between line segments, , is set to be part of our cost functional associated to user comfort. Even more, there is evidence that rotational motion is the most evocative of VR sickness .
Additionally, it is also desirable to minimize the length of the path (see Eq. (5)) because there is a direct relation between the path length and the time of exposure to potential sensory conflict due to motion. Thus, the user’s comfort class is set as , and
The resulting cost vector is defined as
Iii-C Motion planner
We present a planner that addresses the human perception-optimized planning problem formulated in Section II. Although that covers general trajectories, there are several advantages for the telepresence setup in restricting the search space to piecewise linear paths: reduction of VR sickness, planning simplicity, and potential for improved retaining of spatial orientation. The piecewise-linear path requirement makes it suitable to consider a regular grid representation of the configuration space . Considering a grid will naturally result in paths composed of linear segments.
The regular grid is modeled as a directed graph, , in which each node, , is labeled with a position on the plane, and a given orientation . The positions p are equally spaced throughout the and coordinates of the plane using a step , and the orientations lie in the set , to preserve eight-neighbor connectivity in the plane (see Fig. 2). Transition between elements in the grid are defined through the following edge definition. First, let denote an edge from node toward –the arguments of will be dropped when convenient. Such edge will exist if and (refer to them as Type-A edges); or if and is a neighbor of under an 8-connectivity in the plane (refer to them as Type-B edges). See Fig. 2 for examples of Type-A and Type-B edges.
Each edge, , will have associated to it a non-negative cost vector, . Its first element, , is associated to the cost that evaluates the obstructions around the 360 camera, and it is simply set as . The cost is associated to , the number of turns performed by the DDR. It is set as for Type-A edges, and as for Type-B edges. The last element, , is associated to , the traveled distance. For Type-A edges . For Type-B edges, if , and if . See Fig. 2 for cost vector examples.
To compute the actual Pareto optimal trajectories, , we use the multiobjective variant of the A* algorithm presented in . That variant is an extension of A* to the MOO case, preserving path selection and expansion as the basic operations, as opposed to MOA*  that preserves node selection and expansion instead. The path selection results into substantial savings in memory over MOA*. For a given directed graph and set of edges’ costs, the algorithm from  computes the set of all non-dominated solutions whenever this set is finite and nonempty. Fig. 3 shows some sample trajectories that we were able to compute with the aforementioned algorithm for our problem modeling. Lastly, based on the findings from  to reduce VR sicknes, the DDR is required to follow the path with constant speed; hence, accelerations only take place at the beginning and at the end of the straight line motions and rotations in place.
Iv-a Experimental setup
We performed a user study in a laboratory using a completely virtual museum environment built with Unity 3D (see Fig. 4). We first ran the planner from Section III-C on a 2D projection of the museum environment. From the set of Pareto-optimal trajectories, we hand-picked two: one that minimizes the number of rotations, and another that reduces the distance traveled. The RRT trajectory was selected from 1000 solutions produced by RRT reruns, preferring the one with the least number of curvature sign changes. The three chosen trajectories are shown in Fig. 4. A 360 video recording of a mobile robot traversing each of these trajectories in the environment was created in Unity, so that the subjects could rotate their heads and look around in the environment (as they would in a real setting), but could not control the robot’s trajectory. To compare how subjects felt about the trajectories, we performed a within-subject user study with 36 participants. The study took place in a research lab at the University of Oulu (Fig. 1, left picture). The subjects were equally balanced by gender with 18 females and 18 males. Their ages ranged from 20 to 44 with a mean age of 28.25 years. The presentation of each of the three videos was fully counterbalanced to counteract any potential ordering effects; therefore, three females and three males each saw one of the six combinations of video presentation orders.
Subjects were first asked to sign a consent form and fill in the baseline Simulator Sickness Questionnaire (SSQ) , after which instructions were given and the first video was played. Subjects were instructed not to pay attention to the pieces of art they saw on the path (as there were two different homotopy classes, as shown on Fig. 4). After each of the three videos, the subjects were asked to fill in an SSQ and another questionnaire with 6-point Likert scale questions regarding their comfort, retention of sense of orientation, and perception of closeness to walls and objects. Finally, after the last video, subjects were asked to select which of the three videos they preferred and which was the most comfortable. Each video lasted between 1min and 1min 30s.
The visual features in the Pareto least turns path were different in the second half of the video from the features shown in the second half of the Pareto shortest path and the RRT (see Fig. 4 top-view mini-map). The Pareto least turns path passed through a hallway with blank walls, while the other paths passed through a room filled with sculptures. Despite this difference, the three paths were constructed to take the user from the same initial state to the same goal state .
All tests were run with a confidence interval and two-tailed significance levels set to 0.05. Shapiro-Wilk tests found a departure from normality for the response distributions, so non-parametric tests were used. Significance values were adjusted with Bonferroni correction for multiple tests.
A Wilcoxon Signed-Ranks test indicated that the Pareto least turns path did not result in a statistically significant increase in SSQ scores from the baseline (Mdn = 5.61) to the post-test (Mdn = 9.35), Z = -0.501, p = .616. The Pareto shortest path resulted in a nearly statistically significant increase in SSQ scores from the baseline to the post-test (Mdn = 14.96), Z = -1.931, p = .054. However, the RRT path resulted in a statistically highly significant increase in SSQ scores from the baseline to the post-test (Mdn = 20.57), Z = -3.328, p = .001.
A Kruskal-Wallis H test was performed to compare the post-treatment mean SSQ scores for each of the paths. A statistically significant difference was found, , p = .011. Post-hoc pairwise comparisons revealed a statistically significant difference between the Pareto least turns path and the RRT (p = .008). The Pareto least turns and Pareto shortest path were not significantly different, (p = .566), and the Pareto shortest path was not significantly different from the RRT (p = .277).
Figs. 5 and 6 show the distribution of responses regarding users’ comfort and preference based on answers obtained from the questionnaire asking them to select one of the three paths. Fig. 7 presents the total weighted SSQ scores recorded after watching the video of each of the paths. Only the Pareto least turns and the RRT paths had a statistically significant difference.
The results of this study show that the most comfortable path is the Pareto least turns path. Viewing the video of this path resulted in only a small increase in the SSQ total weighted symptom scores from the baseline pre-test to the post-test, which was not a statistically significant difference. The Pareto least turns path was also significantly more comfortable than the RRT path. This supports our hypothesis that the number of turns plays an important role in the users’ comfort when viewing these paths in a virtual reality headset. This finding is consistent with the results from a previous study , where it was found that rotational movement is the most evocative of VR sickness.
Concerning the Pareto shortest path, our results found that this path was more comfortable than the RRT path but less comfortable than the Pareto least turns path. The median SSQ total weighted score at the baseline pre-test was 5.61 and the median scores after watching each video (see Fig. 7) were 9.35 for the Pareto least turns, 14.96 for the Pareto shortest path and 20.57 for the RRT. From the Wilcoxon test results, we can see that viewing the Pareto shortest path did not result in a statistically significant increase in SSQ total weighted scores from the baseline to the post-test, though the increase was nearly significant. The RRT, however, did result in a statistically highly significant increase in SSQ scores from the baseline to the post-test. As larger scores indicate that more sickness symptoms were experienced, these tests confirm that the Pareto shortest path was the second most comfortable and the RRT was the least comfortable. The comfort comparison questionnaire (Fig. 5) also supports that trend. The Pareto least turns path was selected by the most number of subjects as the most comfortable, followed by the Pareto shortest path, and finally the RRT path.
Surprisingly, the preference answers (Fig. 6) provide a different ranking. The Pareto shortest path was the most preferable, followed by the Pareto least turns, and the RRT path last. This is an interesting finding worthy of further investigation: that users may not always prefer the most comfortable trajectories. This might be related to the same issue pointed out above; the final part of the Pareto least turns path passes through a hallway, which could be perceived by the users as less interesting compared to the other paths that traversed through a gallery with sculptures. Because this occurred despite the fact that subjects were explicitly told not to pay attention to the pieces of art, additional criteria may need to be added in the cost functional to evaluate the user’s preference for certain visual features or depending upon the task or environment.
In the present work, the formal definition of the framework of the human perception-optimized planning was provided, based on a multi objective optimization formulation. That framework is general in the sense that it allows modelling of motion planning problems where the human user is a key element within a robotic system, guaranteeing important aspects such as the userâs comfort. The framework was further illustrated by making use of the task of VR telepresence. That task is modelled to guarantee usersâ comfort and performance of key components of the system, for example, the 360 camera performance. Solution trajectories were computed with a Pareto variant of the A* algorithm. Those Pareto solutions were compared against a trajectory obtained with a standard motion planning technique, which does not focus on guaranteeing any user oriented aspect.
Through experimentation on human subjects, it was validated that a solution designed to address the human perception-optimized planning problem can result in trajectories that are more comfortable for the users, or trajectories that they might prefer for other reasons. Even though the human subjects experiments were carried out in a simulated VR telepresence system, we believe that our findings justify human perception-optimized planning and apply to VR telepresence. Experimentation in VR-based telepresence systems with physical robots and 360 cameras is left for future work.
Besides user studies with a real robot, there are many other research directions to explore. First, the user’s method of choosing the destination (such as a minimap, or choosing a point in the field of view), must be researched. Then, there are multiple potential criteria that should be studied. Consider user’s wayfinding capabilities: for example, should other rotation angles besides multiples of 45 degrees be allowed through another planner, or can we show through experiments the intuition that the current planner helps users retain their sense of direction? Additionally, users often look for certain objects in an environment, for example pieces of art in the museum, faces in a cocktail party, or exit signs at an airport. If there is a criterion that would allow users to see more of this sort of important objects, it would be a valuable finding. Additionally, can we predict the weighting and prioritizing of criteria from prior information of users, such as age, event type or gaming experience? This could be done using machine learning techniques on data obtained through human subjects experimentation; the users could then be allowed the final adjustment of weights themselves, or they could be learned even further through the users’ gaze direction. Finally, we are interested in finding additional means to reduce the experienced VR sickness, such as compensating for the 360 camera motion by adding degrees of freedom to it and thus \sayunwinding the rotations (the user would not experience rotation even when the robot’s base is rotating), or even use time scaling on the trajectory to transform the visual stimuli to a comfortable one.
- (2007) A qualitative study of in-home robotic telepresence for home care of community-living elderly subjects. Journal of telemedicine and telecare 13 (2), pp. 79–84. Cited by: §I.
- (2010) Motion sickness: a negative reinforcement model. Brain research bulletin 81 (1), pp. 7–11. Cited by: §I.
- (2008) Pareto optimality, game theory and equilibria. Springer. Cited by: §II.
- (1931) The psychology of seasickness. Psyche 11, pp. 86–90. Cited by: §I.
- (1999) Virtual reality-induced symptoms and effects (vrise). Presence: Teleoperators & Virtual Environments 8 (2), pp. 169–186. Cited by: §I.
- (1995) Virtual reality: scientific and technological challenges. National Academies Press. Cited by: §I.
- (2018) Telewheelchair: the remote controllable electric wheelchair system combined human and machine intelligence. In Proceedings of the 9th Augmented Human International Conference, pp. 7. Cited by: §I.
- (2018) Geocaching with a beam: shared outdoor activities through a telepresence robot with 360 degree viewing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–13. Cited by: §I.
- (2003) Camera control and decoupled motion for teleoperation. In SMC’03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme-System Security and Assurance (Cat. No. 03CH37483), Vol. 2, pp. 1339–1344. Cited by: §II.
- (2017) New VR navigation techniques to reduce cybersickness. Electronic Imaging 2017 (3), pp. 48–53. Cited by: §III-B, §IV-C.
- (1993) Simulator sickness questionnaire: an enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3 (3), pp. 203–220. Cited by: §IV-A.
- (2016) Immersed remotely: evaluating the use of head mounted devices for remote collaboration in robotic telepresence. In 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 638–645. Cited by: §I.
- (2013) Human-aware robot navigation: a survey. Robotics and Autonomous Systems 61 (12), pp. 1726–1743. Cited by: §II.
- (1998-12) Optimal motion planning for multiple robots having independent goals. IEEE Trans. on Robotics and Automation 14 (6), pp. 912–925. Cited by: §I.
- (2001) Randomized kinodynamic planning. The international journal of robotics research 20 (5), pp. 378–400. Cited by: §I.
- (2020) Virtual reality. Cambridge University Press. Cited by: §I.
- (2011) An inexpensive robot platform for teleoperation and experimentation. In 2011 IEEE International Conference on Robotics and Automation, pp. 1211–1216. Cited by: §I.
- (2011) Now, i have a body: uses and social norms for mobile remote presence in the workplace. In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 33–42. Cited by: §I.
- (2005) A new approach to multiobjective A* search. In IJCAI, Vol. 8. Cited by: §III-C.
- (2009) Immersive 3-D teleoperation of a search and rescue robot using a head-mounted display. In 2009 IEEE Conference on Emerging Technologies & Factory Automation, pp. 1–8. Cited by: §I.
- (1980) Telepresence. Omni Magazine 38 (4), pp. 217230Murray. Cited by: §III.
- (2002) Health and safety implications of virtual reality: a review of empirical evidence. Applied ergonomics 33 (3), pp. 251–271. Cited by: §I.
- (2018) 360 VR based robot teleoperation interface for virtual tour. In Proceedings of the 1st International Workshop on Virtual, Augmented, and Mixed Reality for HRI (VAM-HRI), Cited by: §I.
- (2001) Social tele-embodiment: understanding presence. Autonomous Robots 11 (1), pp. 87–95. Cited by: §I.
- (2014) Bodies in motion: mobility, presence, and task awareness in telepresence. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems, pp. 2153–2162. Cited by: §I.
- (1975) Motion sickness.. Academic press. Cited by: §I, §I.
- (2014) Individual variation in susceptibility to cybersickness. In Proceedings of the 27th annual ACM symposium on User interface software and technology, pp. 309–317. Cited by: §I.
- (1992) Synthetic experience: a proposed taxonomy. Presence: Teleoperators & Virtual Environments 1 (2), pp. 229–247. Cited by: §I.
- (2010) Motion sickness etiology: an alternative to treismanâs evolutionary theory. In Spatial Orientation Symposium in Honor of Fred Guedry, Institute of Human and Machine Cognition, Pensacola, FL., Cited by: §I.
- (2005) From presence to consciousness through virtual reality. Nature Reviews Neuroscience 6 (4), pp. 332–339. Cited by: §I.
- (1991) Multiobjective A*. Journal of the ACM (JACM) 38 (4), pp. 775–814. Cited by: §III-C.
- (2018) Wait, can you move the robot? examining telepresence robot use in collaborative teams. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, pp. 14–22. Cited by: §I.
- (2019) A VR system for immersive teleoperation and live exploration with a mobile robot. arXiv preprint arXiv:1908.02949. Cited by: §I.
- (1977) Motion sickness: an evolutionary hypothesis. Science 197 (4302), pp. 493–495. Cited by: §I.
- (2019) Presence and cybersickness in virtual reality are negatively related: a review. Frontiers in psychology 10, pp. 158. Cited by: §I, §II.
- (2019) Assessing postural instability and cybersickness through linear and angular displacement. Human factors. External Links: Cited by: §III-B, §III-C.
- (2015) MORRF*: sampling-based multi-objective motion planning. In Twenty-Fourth International Joint Conference on Artificial Intelligence, Cited by: §I.
- (2013) Structure and intractability of optimal multi-robot path planning on graphs. In Twenty-Seventh AAAI Conference on Artificial Intelligence, Cited by: §I.
- (2018) Detection thresholds for rotation and translation gains in 360 video-based telepresence systems. IEEE transactions on visualization and computer graphics 24 (4), pp. 1671–1680. Cited by: §I.