FR3068803A1 - METHOD AND DEVICE FOR PROCESSING DATA OF A VIRTUAL REALITY ENVIRONMENT - Google Patents

Abstract

The invention relates to a method for processing data of a virtual reality environment in which at least one virtual object is projected into a projection space by a holographic projection device. The method includes detecting a hand of a user of the holographic projection device, determining whether the detected hand is a right hand or a left hand, and generating, based on the determination whether the detected hand is a right hand or a hand left, a data display command of the virtual reality environment.

Description

Method and device for processing data from a virtual reality environment.

The invention relates to the processing of augmented reality or mixed virtual reality data, intended to be displayed for example by a holographic display.

There are headsets or virtual reality glasses for displaying a mixed virtual reality environment in the form of holograms integrating into the user's field of vision. For example, the Microsoft® Hololens helmet, illustrated in Figure 1, offers such a display. Such a helmet is in particular equipped with sensors, for example cameras, allowing the user to interact in a gestural manner on the virtual objects of the virtual reality environment projected by the helmet.

To interact with virtual objects projected by such a helmet, a user uses one of his hands which he places in front of a virtual object projected in the field of vision of the helmet.

In order to activate the selection of a virtual object for manipulation (moving the object for example), the helmet must detect that the user's hand goes from an open state (illustrated in FIG. 2A) in a closed state (illustrated in FIG. 2B) when it is placed on the object to be selected. The open state of the hand is detected by the opening of the space between the thumb and the index finger and the closed state of the hand is detected by the closing of the space between the thumb and the index finger.

The disadvantage of such a system is that the use of one hand for user interaction is not intuitive for the user of the helmet, in particular for actions of manipulation of virtual objects for which the user tends to want to use both hands as they would with real objects.

In addition, the use of one hand for the manipulation of virtual objects limits the number of possible actions accessible only from gestures made with one hand. In order to increase the number of possible actions, it is sometimes necessary to add menus to the helmet projection field allowing the user to access additional actions. However, the addition of such menus reduces the user's impression of immersion in the projected virtual reality environment.

In addition, the object selection mechanism by opening / closing a hand is sensitive to errors. Indeed, the user's hand may be badly positioned or badly oriented relative to the helmet sensors, or badly positioned relative to the object to be selected, or the user does not open or close the space between thumb and index finger, etc. When the open / closed state of the hand is not correctly detected, the user cannot then manipulate the virtual object as he would like. In this case, the user has no way of knowing why the manipulation of the virtual object is not possible.

The Microsoft® Hololens headset allows the user to display visual feedback in the form of a colored dot or circle indicating whether the virtual object overflown by the hand is suitable for manipulation or not. However, no information is provided to the user indicating the detection status of his hand.

There is therefore a need to improve the manipulation of virtual objects of a virtual reality scene displayed by holography.

To this end, a method for processing data from a virtual reality environment is proposed. The proposed method comprises: projecting by holographic projection at least one virtual object into a projection space of a holographic projection device, detecting a hand of a user of the holographic projection device, determining whether the detected hand is a right hand or a left hand, and generating, based on the determination whether the detected hand is a right hand or a left hand, a command to display data of the virtual reality environment, the command comprising: when it is determined that the detected hand is a right hand, order the display in the projection space of a first visual signal placed to the right of an object pointer displayed in the projection space, and when it is determined that the detected hand is a left hand, order the display in the projection space of the first visual signal placed to the left of the object pointer displayed in the projection space.

The display control according to the proposed method can be configured to control that the visual signal representative of the detection of a hand is reproduced by display in the projection space near an object pointer in the projection space. projection. Such an object pointer corresponds to a visual signal allowing the user to point an object or an area in the projection space, and plays for example the role of a mouse, or of a cursor displayed on a screen. personal computer or tablet.

Visual information (pointer, detection status of one hand or of each of the two hands of the user) is thus restored to the user in a limited area, near the pointer. In addition, the rest of the projection space is advantageously not polluted by the display of the various information to be restored, thus allowing the user to maintain the impression of immersion in the virtual reality environment.

Advantageously, the detected hand is identified as a left hand or a right hand so that the signal representative of the detection of the hand can be restored on the corresponding side (left or right) of the pointer. Thus, the user intuitively knows which hand corresponds to the status signal of a displayed hand.

In one or more embodiments, the proposed method further comprises determining a state of opening of the detected hand, from among a set of predetermined states. This set of predetermined states can typically include two states, a "closed" state and an "open" state. The proposed method is not however limited to these two states, and it can for example be determined that the detected hand is in an “open”, “closed” state, or in one or more intermediate states between these two states ( for example a “semi-open”, or “semi-closed” state), according to the embodiment chosen and in particular of the desired detection finesse for the postures and actions of the user's hand.

In these embodiments, the opening command may take account of the determined opening state, and the first signal be representative of the detection and of the determined opening state for the detected hand.

The manipulation of virtual objects in a virtual reality environment is thus facilitated, to varying degrees depending on the number of parameters (state of the detected hand "right" or "left", state of opening of the hand detected) taken into account for the display command, by implementing the proposed method.

The display of a signal representative of an opening state of a hand detected in the projection space advantageously makes it possible to inform the user of the detection state of this hand. The user thus knows whether his hand has been correctly detected, and if so in what state (for example "open" or "closed"). He thus knows according to the determined state of opening of the hand if the manipulation of objects is possible using his hand.

Advantageously, the same visual signal is used to represent both which hand (left or right) has been detected and which is the state (open / closed) of the detected hand.

According to one or more embodiments, the method further comprises: detecting another hand of the user of the holographic projection device, determining an opening state of the other detected hand, in which the display command is in additionally generated on the basis of the opening state of the other detected hand, and further comprises: in the case where the other detected hand is a right hand, control the display in the projection space of a second visual signal placed to the right of the object pointer displayed in the projection space, and in the case where the other detected hand is a left hand, control the display in the projection space of the second visual signal placed to the left of the object pointer displayed in the projection space, and in which the second signal is representative of the detection and of the opening state determined for the other detected hand.

According to this embodiment, a second hand is detected in the projection space. Advantageously, the addition of a second hand for the manipulation of virtual objects allows the user a more intuitive gesture for the manipulation of objects. In addition, each signal representative of the detected / open / closed state with one hand is restored on the corresponding side (left / right) near the object pointer. Thus, the user can determine the state of each of his hands independently.

In one or more embodiments, the display command can further comprise a command to display the object pointer in the form of a closed line, possibly curved, for example of oval or circular shape, and comprises in in addition to modifying a pointer display color so that in the case where the pointer is displayed relative to an object which can be manipulated by the user, the pointer is displayed in a first color, and in the case where the pointer is displayed relative to an object that cannot be manipulated by the user, the pointer is displayed in a second color.

According to this embodiment, thanks to the use of distinct colors, the user can easily identify the virtual objects that can be manipulated and their state.

In one or more embodiments, the display command may further comprise a modification of the display color of the pointer so that in the case where the pointer is displayed relative to an object being manipulated by the user , the pointer is displayed in a third color.

In one or more embodiments, the display command may comprise a command to display the first signal and / or the second signal in the form of an open line, possibly curved, for example a half-oval or a semicircle, partially surrounding the displayed pointer, the open line being positioned along a vertical axis in the projection space, to the left or to the right of the pointer depending on whether the corresponding hand is a left or right hand.

In these embodiments, the display command may further comprise a command to modify a display color of the open line so that, in the case where the corresponding hand is not detected, the open line is displayed in a fourth color, when the corresponding hand is detected open, the open line is displayed in a fifth color, and in the case where the corresponding hand is detected closed, the open line is displayed in a sixth color.

According to this embodiment, thanks to the use of several distinct colors corresponding respectively to different detection states of each hand, the user can easily identify the detection state of his hands.

In one or more embodiments, the proposed method can further comprise: in the case where the pointer is displayed relative to a virtual object capable of being manipulated and in the case where both hands are detected in a closed state, detect a movement of rotation of the two hands relative to an axis of rotation, a movement of translation of the two hands in the same direction, or a movement of translation and rotation of the two hands. The display command then further comprises, depending on the case: in the case of a detection of a rotational movement of the two hands relative to an axis of rotation, a command to modify the display of the virtual object so as to rotate along a vertical axis the virtual object projected in the direction of rotation of the hands, in the case of detection of a translational movement of the two hands in the same direction, a modification command display of the virtual object so as to move the projected virtual object in the direction of translation of the hands, and in the case of detection of a movement of translation and rotation of the two hands, a command to modification of the display of the virtual object so as to simultaneously rotate and move the projected virtual object according to the direction of rotation and according to the direction of translation of the hands.

The addition of a second hand thus improves the handling of objects by using a gesture adapted to the desired action.

In particular, in one or more embodiments of the proposed method, the display in the projection space can be controlled so that a combination of a movement of translation and rotation of the two hands causes a modification of the display. of the virtual object so as to simultaneously rotate and move the projected virtual object according to the direction of translation and rotation of the hands.

Such a combined movement of translation-rotation makes it possible to make the manipulation of virtual objects more natural and intuitive for the user. The user can thus manipulate a virtual object as he would with a real object.

User interaction is facilitated because the user can interact more quickly. It is not necessary to click on buttons to change the transformation. In addition, the gesture of interaction being more natural, the learning time to interact with virtual objects is reduced.

In one or more embodiments, the proposed method further comprises a detection of a distance or a rapprochement of one another with the two hands of the user. In this case, the display command may include, in the case of a detection of a distance of the two hands from each other, a command to modify the display of the virtual object so as to increase the size of the virtual object displayed in the projection space, or in the case of a detection of bringing two hands together, a command to modify the display of the object virtual so as to decrease the size of the virtual object displayed in the projection space.

The addition of a second hand thus improves the handling of objects by using a gesture adapted to the desired action.

In one or more embodiments, the proposed method further comprises, in the case where the pointer is displayed relative to a virtual object capable of being manipulated and in the case where both hands are detected in a closed state, a detection of 'A distance or a reconciliation of one another with the two hands of the user. In this case, the display command may include, in the case of a detection of a distance of the two hands from each other, a command to modify the display of the virtual object so as to open the virtual object displayed in the projection space, or in the case of a detection of bringing two hands together, a command to modify the display of the virtual object of so as to close the virtual object displayed in the projection space.

Thus, the manipulation of objects is facilitated by the association of manipulation actions with natural gestures for the realization of these actions.

According to another aspect, a data processing device for a virtual reality environment is proposed. This device comprises a processing unit comprising a processor and a memory operatively coupled to the processing unit, the processing unit and the memory being configured for the implementation of a data processing method as proposed. herein. In one or more embodiments, the processing device includes a holographic projection system.

Alternatively, the holographic projection system can be provided separate from the processing device. The processing device is then configured to control the projection of data from the virtual reality environment, and in particular the first, and if necessary the second, signal by the holographic projection system.

In one or more embodiments, such a device is included in a terminal.

Such a terminal corresponds for example to a virtual reality headset, of the Hololens type, or else a smartphone (for a smart phone), or even a personal computer.

Another aspect relates to a computer program comprising instructions for the implementation of the data processing method according to any one of the particular embodiments described above, when said program is executed by a processor. Such a program can use any programming language. It can be downloaded from a communication network and / or saved on a computer-readable medium. This program can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.

In yet another aspect, a computer readable recording medium or information medium is provided which includes instructions for a computer program as mentioned above. The recording media mentioned above can be any entity or device capable of storing the program. For example, the medium may include a storage means, such as a memory of the Read-Only Memory (ROM) type, for example a CD-ROM or a microelectronic circuit ROM, a flash memory mounted on a removable storage medium. , such as a USB key, or a magnetic mass memory of the Hard-Disk Drive (HDD) or Solid-State Drive (SSD) type, or a combination of memories operating according to one or more data recording technologies. On the other hand, the recording media can correspond to a transmissible medium such as an electrical or optical signal, which can be routed via an electrical or optical cable, by radio or by other means. In particular, the proposed computer program can be downloaded from a network such as the Internet.

Alternatively, the recording media can correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the process in question.

The data processing method according to the invention can therefore be implemented in various ways, in particular in hardware form or in software form, or be implemented in the form of a combination of hardware and software elements.

Other characteristics and advantages of the invention will appear more clearly on reading the following description of an embodiment, given by way of simple illustrative and nonlimiting example, and of the appended drawings, among which:

FIG. 1 illustrates a virtual reality headset using a holographic projection,

- Figures 2A and 2B illustrate the position of the thumb and forefinger of a hand to detect an open state and a closed state of the hand respectively for user interaction with the helmet illustrated in Figure 1 for example, and the figures 2C and 2D illustrate a rotational movement of the two hands,

FIG. 3 illustrates steps of the method for processing data of a virtual reality environment according to one embodiment,

FIG. 4 illustrates an example of a visual signal representative of the detection and of the detected open or closed state with two hands of a user of a holographic projection device,

FIG. 5 schematically illustrates the structure of a data processing device of a virtual reality environment according to one embodiment,

- Figure 6 illustrates an example of a holographic projection space of a virtual object.

The proposed method relates in one or more embodiments to the processing of data from a virtual reality environment projected by a holographic projection technique. This process aims to improve the handling by a user of virtual objects projected into the environment.

Advantageously, according to one or more embodiments of the proposed method, the hand (s) used by the user to manipulate objects is (are) identified as a left hand or a right hand so as to be able to restore to the user information indicating the open or closed detection state of the hand (s) detected intuitively, by displaying the state information with one hand on the corresponding side of an object pointer.

Thus, the user quickly becomes aware of the detection state of each of his hands.

FIG. 3 illustrates a proposed method for processing data from a virtual reality environment according to one embodiment.

With reference to FIG. 3, a virtual reality environment is projected (E30) by a holographic projection device in a projection space. Such a holographic projection is for example produced by a projection helmet as illustrated in figure

1.

More particularly, a virtual object is projected into the projection space. FIG. 6 illustrates an example of a holographic projection space 63 of a virtual object 64 by a helmet with holographic projection 60. In the example illustrated, the helmet with holographic projection 60 comprises two screens for holographic projection 61 and 62 placed respectively in front of the right eye and the left eye of a user of the helmet and the projectors (not shown) to project the virtual object. The projection space 63 is here defined as the space in which the user has the impression that the virtual objects and the virtual reality environment are displayed. In the embodiment described here, the projection space 63 is defined by the field of vision of the holographic projection helmet 60.

According to the embodiment illustrated in FIG. 3, a hand of a user of the holographic projection device is detected (E31), for example by sensors of the projection device.

When a user's hand is detected, an opening state of the detected hand, among a set of predetermined states, for example among two possible states, an “open” state and a “closed” state, is determined. (E32). For example, in one or more embodiments, the hand may be determined to be in an open state, ie not closed, when the thumb and index finger of the hand form an angle substantially equal to 90 °, as illustrated in Figure 2A. With reference to FIG. 2A, the angle “a” measured for the purpose of determining the open or closed state of the hand may be the angle between the thumb and the index finger measured counterclockwise for the right hand illustrated. According to another embodiment, the hand can be determined to be in an open state when a measurement of the angle between the thumb and the index finger of the hand is greater than a first predefined threshold, for example 60 °. This measure of the angle between the thumb and forefinger can also be used in embodiments in which one or more detected opening states of the hand other than the "open" state and the "closed" state are used. For example, in one or more embodiments, the hand can be determined to be in a semi-open state when a measure of the angle between the thumb and the index finger of the hand is greater than a second predefined threshold, for example 30 °, and lower than the first predefined threshold.

Likewise, in one or more embodiments, the hand can be determined to be in a closed state when the thumb and forefinger of the hand form an angle whose measurement is substantially equal to 0 °, as illustrated in Figure 2B. According to another embodiment, the hand can be determined to be in a closed state when a measurement of the angle between the thumb and the index finger of the hand is less than or equal to a predefined threshold, as a function of the number d 'opening states used. When only two states are used (open / closed), the hand can be determined to be in a closed state when a measurement of the angle between the thumb and the index finger of the hand is less than or equal to the first predefined threshold ( in the example given above less than or equal to 60 °). When only three states are used (open / closed / semi-open), the hand can be determined to be in a closed state when a measure of the angle between the thumb and index finger of the hand is less than or equal to second predefined threshold (in the example given above less than or equal to 30 °). In general, the hand can be determined to be in a closed state when a measurement of the angle between the thumb and the index finger of the hand is less than or equal to a predefined threshold not corresponding to a closed state and being closest to the corresponding measurement value by configuration in the closed state of the hand (measurement value equal in the example above to 0 °).

For example, the angle between the thumb and the index finger is measured from a half-line passing through the junction between the thumb and the index finger and the end of the thumb and a half-line passing through the junction between the thumb and index finger and the tip of the index finger.

With reference to FIG. 3, it is determined (E33) whether the detected hand is a right hand or a left hand. In one or more embodiments, consider for example the area of the projection space in which the hand has been detected. As illustrated in FIG. 6, the projection space is divided into two zones by a separation axis 65 perpendicular to the helmet 60 and passing between the two holographic screens 61 and 62.

In one embodiment, if the hand has for example been detected in the right half of the projection space (on the side of the screen 61 in FIG. 6), it is determined that the hand is a right hand, and if the hand was detected in the left half of the projection space (on the side of the screen 62 in FIG. 6), it is determined that the hand is a left hand.

As a variant, it can be determined in other embodiments whether the hand and a right hand or a left hand by taking into account the direction of the fingers of the detected hand, for example according to whether the angle between the thumb and the index is measured positive or negative counterclockwise. For example, using a measure of the angle counterclockwise, if the angle between the thumb and index finger of the hand is determined to be positive, the hand can be determined to be a left hand, or if the The angle between the thumb and the index finger of the hand is negative, the hand can be determined to be a right hand.

It is considered here of course that the user uses his hand by placing the top of his hand facing him.

It is considered in the embodiment described here that the hand of the user previously detected is determined to be a right hand.

Following the detection (E31) of the hand and the determination (E32) of the opening state of the detected hand (in this nonlimiting example, "open" or "closed" state), a display command data from the virtual reality environment is generated (E36). This command includes a command to display a visual signal representative of the detection and of the opening state previously determined for the detected hand.

The display command is transmitted (E38) to a projection device, for example in association with an instruction for updating the display of the data of the virtual reality environment by using a first visual signal. In one or more embodiments, the display of the data of the virtual reality environment is consequently controlled to display the first signal to the right of an object pointer in the projection space, the hand of the previously detected user having been determined to be a right hand.

Depending on the embodiment, the display command can be generated on the basis of the determination whether the detected hand is a right hand (case of the example illustrated in FIG. 3) or a left hand, or on the basis of this determination and of the opening state determined for the detected hand, as illustrated in FIG. 3.

Different embodiments can be chosen for the implementation of the display control, depending in particular on the architecture (software and / or hardware) of the devices for the implementation of the proposed method. In particular, the display command may take the form of one or more messages, transmitted for example to a projection device in a format suitable for the device used, each message carrying one or more display control commands from data in the projected space. The format of the display command, and where appropriate of the messages composing it, will be chosen corresponding to the projection device used, and according to the architecture at the interface, for example software, such as an API interface (from English "Application Programming Interface") between the data processing device configured to implement the proposed method and the projection device used to display the virtual reality environment data.

When the detected hand is determined to be a left hand, the display of the data of the virtual reality environment can be controlled, in one or more embodiments, so as to display (E36) the first visual signal to the left of the pointer.

In the embodiment illustrated in FIG. 3, a second hand of a user of the holographic projection device is detected (E34), for example by the sensors of the projection device.

A detected second hand opening state, among a set of predetermined states, for example among two possible states, an "open" state and a "closed" state, is determined (E35), similar to the determination opening status performed (E32) for the first hand detected. Here, since the first hand has already been identified, for example as a right hand, the second hand is identified as the other hand, a left hand in the example described here.

A second display command is generated (E37) on the basis of the detected opening state of the other hand, which comprises a command to display a second visual signal representative of the detection and of the state opening determined for the second hand detected. Depending on the embodiment, the second display command may be configured in a form integrated, in whole or in part, with the (first) display command generated for the first hand detected, or else in the form of a command distinct from this first display command (for example in the form of one or more messages distinct from the messages relating to the first display command).

The second display command, possibly being one with the first display command, is transmitted (E38) to the projection device, for example in association with an instruction for updating the display of the data of the virtual reality environment based on information carried by the second visual signal. The display of data from the virtual reality environment is thus controlled to display the second signal generated for the second hand detected near the object pointer in the projection space, on the other side of the object pointer compared to the visual signal of the state of the first hand. For example, if the first visual signal (representative of the state of the first hand) is displayed on the right of the pointer, the second visual signal (representative of the state of the second hand) is displayed on the left of the pointer, and vice versa .

FIG. 4 illustrates an example of a visual signal which can be used in one or more embodiments. The object pointer is represented in this nonlimiting example by a circle 41. The proposed method is however applicable with any form of object pointer, and in particular any form comprising a closed line, such as for example a square, a rectangle, or a curved line, such as an oval, a test pattern, or a circle as illustrated in FIG. 4. Depending on the embodiment, the display of circle 41 can be controlled to vary the color of this circle 41 as a function of the object relatively to which the pointer is displayed (for example as a function of the object overflown by the pointer, or more generally as a function of the object facing which the pointer is positioned). In one or more embodiments, the display of the pointer 41 can also be configured or controlled so that the pointer 41 moves in the projection space following the movements of the detected hand which are picked up by the sensors of the helmet. with holographic projection.

In one or more embodiments, the display of the pointer 41 can also be configured or controlled so that when the pointer is displayed relative to an object (for example the pointer hovers over this object) which cannot be manipulated by the user , the pointer (in the example of FIG. 4 the circle 41) is displayed according to a first color, for example white. When the pointer is displayed relative to an object (for example the pointer rolls over this object) that can be manipulated by the user, the color of the pointer (in the example in FIG. 4, circle 41) is controlled and the pointer is displayed in a second color, for example light blue.

Advantageously, in one or more embodiments, when the pointer is displayed relative to an object (for example the pointer rolls over this object) during manipulation by the user, the color of the pointer (circle 41 in the example of the figure

4) is controlled and the pointer is displayed in a third color, for example dark blue. In one or more embodiments, the visual signal representative of the detection and of the opening state determined for a hand (left or right) is displayed in the form of an open line, possibly curved, such as for example a semi-oval or semicircle (42, 43 in FIG. 4), which extends around the pointer 41 (having a circular shape in the nonlimiting example of FIG. 4), without completely surrounding the pointer 41 as illustrated in Figure 4, along the vertical axis to the left or right of the pointer depending on whether the hand corresponding to the open line is a left or right hand.

In one or more embodiments, the display of the pointer is controlled as a function additionally of the opening state determined for the hand. In the example in Figure 4, the pointer display can be controlled so that the color of each semi-circle depends on the detection state and the open / closed state determined for each hand.

In one or more embodiments, the display of the pointer 41 illustrated in FIG. 4 can also be configured so that, when the corresponding hand is not detected, the semicircle is displayed in a first color, for example White. When the corresponding hand is detected open, i.e. not closed, the color of the corresponding semicircle can also be modified and the semicircle displayed in a second color, for example light orange. When the corresponding hand is detected closed, the color of the corresponding semicircle can also be modified and the semicircle displayed in a third color, for example dark orange.

Again with reference to FIG. 3, manipulation of a virtual object can be detected (E39), for example on the basis of data captured by the holographic projection device, in one or more embodiments. To do this, it can be verified in one or more embodiments that the object pointer is displayed relative to a virtual object capable of being manipulated and that both hands are detected and in a closed state.

In one or more embodiments, a distance between the two hands can also be detected as a variant, for example from data captured by the holographic projection device. For example, when it is detected that a distance between the two hands in the projection space increases, the display of the virtual object indicated by the object pointer is controlled (E38) so as to increase the size the projected virtual object. The size of the virtual object can for example, in one or more embodiments, be increased as a function of the increase in the distance measurement between the two hands.

In one or more embodiments, a bringing together of the two hands in the projection space can also be detected, ie the device for implementing the proposed method is configured to detect, for example from data captured by the device holographic projection, that a distance between the two hands in the projection space decreases. The display of the virtual object indicated by the object pointer can then be controlled (E38) so as to decrease the size of the projected virtual object, as a function of the decrease in the distance measurement between the two hands.

In one or more embodiments, a rotational movement in the projection space of both hands with respect to an axis of rotation can be detected, for example from data captured by the projection device. The display of the virtual object can then be controlled (E38) so as to rotate along a vertical axis the virtual object projected in the same direction of rotation as the two hands in the projection space. Such a rotational movement of the two hands is illustrated in FIGS. 2C and 2D, FIG. 2C illustrating the hands before rotation and FIG. 2D illustrating the hands after rotation relative to an axis of rotation.

In one or more embodiments, a translational movement of the two hands in the projection space in the same direction can be detected, for example from data captured by the projection device. The display of the virtual object can then be controlled (E38) so as to move the virtual object projected in the same direction of translation of the hands in the projection space.

In one or more embodiments, a rotational and translational movement of the two hands can also be detected, for example from data captured by the projection device. The display of the virtual object can then be controlled (E38) so as to rotate and move the projected virtual object in a similar manner to the movement detected with both hands.

Such a combined movement of translation-rotation makes it possible to make the manipulation of virtual objects more natural and intuitive for the user. The user can thus manipulate a virtual object as he would with a real object.

User interaction is facilitated because the user can interact more quickly. It is not necessary to click on buttons to change the transformation. In addition, the gesture of interaction being more natural, the learning time to interact with virtual objects is reduced.

According to another particular embodiment of the invention, a distance between the two hands is detected, for example from data captured by the holographic projection device. When the distance between the two hands in the projection space increases, the display of the virtual object, relatively to which the object pointer is displayed, is modified (E38): in one embodiment the projected virtual object is open, and / or the graphic data representing the interior of the virtual object are projected into the projection space.

According to this other particular embodiment of the invention, when a bringing together of the two hands in the projection space is detected, ie the device for implementing the proposed method is configured to detect, for example from captured data by the holographic projection device, as the distance between the two hands in the projection space decreases, the display of the virtual object, relatively to which the object pointer is displayed, is modified (E38) so as to close the projected virtual object.

Such a particular embodiment allows manipulation of objects with natural gestures for the user.

FIG. 5 illustrates the simplified structure of a device of a DISP device for processing data of a virtual reality environment according to one or more embodiments. Such a device is configured to implement the method for processing virtual reality data according to any one of the embodiments described herein.

In the nonlimiting example illustrated in FIG. 5, the device DISP comprises a memory MEM, a processing unit UT, equipped for example with a processor PROC, and controlled by the computer program PG stored in memory MEM. The computer program PG includes instructions for implementing the steps of the data processing method as described above, when the program is executed by the processor PROC.

On initialization, the code instructions of the computer program PG are for example loaded into a RAM memory before being executed by the processor PROC. The processor PROC of the processing unit UT implements in particular the data processing method according to any one of the embodiments described in relation to FIG. 3 according to the instructions of the computer program PG.

For this, the DISP device includes CAPT sensors configured to detect the presence of at least one hand of a user in the projection space, and movements of the hand of the user.

The DISP device also includes a holographic projection system PROJ making it possible to project virtual reality data onto holographic screens, so that the user can view them in the projection space.

According to a particular embodiment of the invention, the DISP device described above is included in a terminal, for example a virtual reality headset.

The architecture of the DISP device illustrated in FIG. 5 is not, however, limiting. The DISP device can for example be operatively coupled to the holographic projection system PROJ, and be implemented in the form of a device distinct from the holographic projection system PROJ. In addition, the DISP device can be implemented on different types of platform, such as a computer (for example of the PC or laptop type) or a network of computers, a smartphone, a tablet, or another device comprising a processor operatively coupled to a memory, as well as, depending on the embodiment chosen, other associated hardware elements such as a network interface and a media reader for reading and writing to a removable storage medium (not shown in the figure).

Depending on the embodiment chosen, certain acts, actions, events or functions of each of the methods described in this document may be performed or occur in a different order from that in which they have been described, or may be added, merged or not be performed or not occur, as the case may be. In addition, in certain embodiments, certain acts, actions or events are performed or occur concurrently and not successively.

Although described through a certain number of detailed exemplary embodiments, the proposed method and the equipment for implementing the method include different variants, modifications and improvements which will be obvious to those skilled in the art, it being understood that these different variants, modifications and improvements form part of the scope of the invention, as defined by the claims which follow. In addition, different aspects and characteristics described above can be implemented together, or separately, or else substituted for one another, and all of the different combinations and sub-combinations of the aspects and characteristics are part of the scope of the 'invention. In addition, some systems and equipment described above may not incorporate all of the modules and functions described for the preferred embodiments.

Claims (13)

claims 1. Method for processing data from a virtual reality environment, comprising: - project by holographic projection at least one virtual object into a projection space of a holographic projection device, - detect a hand of a user of the holographic projection device, - determine whether the detected hand is a right hand or a left hand, and - generate, on the basis of the determination whether the detected hand is a right hand or a left hand, a command for displaying data from the virtual reality environment, the command comprising: - when it is determined that the detected hand is a right hand, order the display in the projection space of a first visual signal placed to the right of an object pointer displayed in the projection space, and - when it is determined that the detected hand is a left hand, order the display in the projection space of the first visual signal placed to the left of the object pointer displayed in the projection space. The method of claim 1, further comprising: determining an open state of the detected hand, from a set of predetermined states, and wherein the display command is further generated based on the state opening, and the first signal is representative of the detection and the opening state determined for the detected hand. 3. Method according to any one of the preceding claims, further comprising: - detect another hand of the user of the holographic projection device, - determining an opening state of the other detected hand, in which the display command is furthermore generated on the basis of the opening state of the other detected hand, and further comprises: - in the case where the other detected hand is a right hand, order the display in the projection space of a second visual signal placed to the right of the object pointer displayed in the projection space, and - in the case where the other hand detected is a left hand, order the display in the projection space of the second visual signal placed to the left of the object pointer displayed in the projection space, and in which the second signal is representative of the detection and the opening state determined for the other detected hand. 4. Method according to any one of the preceding claims, in which the display command comprises a command for displaying the object pointer in the form of a closed line, possibly curved, for example of oval or circular shape, and further comprises modifying a display color of the pointer so that in the case where the pointer is displayed relative to an object which can be manipulated by the user, the pointer is displayed in a first color, and in the When the pointer is displayed relative to an object that cannot be manipulated by the user, the pointer is displayed in a second color. 5. Method according to any one of the preceding claims, in which the display command further comprises a modification of the display color of the pointer so that in the case where the pointer is displayed relative to an object being manipulation by the user, the pointer is displayed in a third color. 6. Method according to any one of the preceding claims for the first signal, and according to any one of claims 3, or 4 and 5 in that they depend on claim 3 for the second signal, in which the command d display includes a command to display the first signal and / or the second signal in the form of an open line, possibly curved, for example a semi-oval or a semi-circle, partially surrounding the pointer displayed, the open line being positioned along a vertical axis in the projection space, to the left or to the right of the pointer depending on whether the corresponding hand is a left or right hand. 7. The method of claim 6, wherein the display command comprises a command to modify a display color of the open line so that, in the case where the corresponding hand is not detected, the line open is displayed in a fourth color, when the corresponding hand is detected open, the open line is displayed in a fifth color, and in the case where the corresponding hand is detected closed, the open line is displayed in a sixth color. 8. Method according to claim 3, or any one of claims 4 to 7 in that they depend on claim 3, further comprising: - in the case where the pointer is displayed relative to a virtual object capable of being manipulated and in the case where both hands are detected in a closed state, detecting a rotational movement of the two hands relative to an axis of rotation, a translational movement of both hands in one direction, or translational and rotational movement of both hands; and in which the display command further comprises: - in the case of a detection of a rotation movement of both hands relative to an axis of rotation, a command to modify the display of the virtual object so as to rotate the virtual object along a vertical axis projected in the direction of rotation of the hands, - in the case of detection of a translational movement of both hands in the same direction, a command to modify the display of the virtual object so as to move the virtual object projected in the direction of translation of the hands, and - in the case of detection of a movement of translation and rotation of the two hands, a command to modify the display of the virtual object so as to simultaneously rotate and move the projected virtual object according to the direction of rotation and in the direction of translation of the hands. 9. The method of claim 3, or any one of claims 4 to 8 in that they depend on claim 3, further comprising: detecting a distance or a coming together from one of the two hands of the user, and in which the display command further comprises: - in the case of a detection of a distance of the two hands from each other, a command to modify the display of the virtual object so as to increase the size of the virtual object displayed in the projection space, or - in the case of a detection of a bringing together of the two hands from one another, a command to modify the display of the virtual object so as to reduce the size of the virtual object displayed in the projection space. 10. Method according to claim 3, or any one of claims 4 to 9 in that they depend on claim 3, further comprising: - in the case where the pointer is displayed relative to a virtual object capable of being manipulated and in the case where the two hands are detected in a closed state, detecting a distance or a bringing together of the two hands of the user, and in which the display command further comprises: - in the case of detection of a distance between the two hands from each other, a command to modify the display of the virtual object so as to open the virtual object displayed in the space of projection, or - in the event of detection of a bringing together of the two hands from each other, a command to modify the display of the virtual object so as to close the virtual object displayed in space projection. 11. Device for processing data from a virtual reality environment comprising a processing unit comprising a processor and a memory coupled in a manner 10 operational at the processing unit, the processing unit and the memory being configured for the implementation of a data processing method according to any one of claims 1 to 10. 12. Terminal comprising a device according to claim 11. 15. A computer program comprising instructions for the implementation of the data processing method according to any one of claims 1 to 10, when said program is executed by a processor.