FR3090941A1 - Method of user interaction with a virtual reality environment - Google Patents

Abstract

Method of interaction of a user with a virtual reality environment, characterized in that it comprises the following, at the level of a terminal: - command (COM) to a server at least one image of a space in three dimensions from the virtual reality environment, - receive (REC), from said server, data from a view representative of said space in three dimensions, - extract (EXTR) from said data said at least one image, - convert (CONV) said at least one image into said view, - order (REST) the reproduction on the terminal of said view. Figure for the abstract: Figure 1

Description

Description

Title of the invention: Method of user interaction with a virtual reality environment

The invention relates to the processing of virtual reality data, and in particular in the field of collaborative services using a virtual reality, mixed or augmented reality environment.

In the professional world, interlocutors working in cooperation on common projects are often located on different geographic sites. Through telephone calls or even telephone "bridges", communications between these different interlocutors are widely spread. Other tools also exist to collaborate remotely (audio / videoconference, sharing of computer screens, etc.), but the interactions achievable through these tools, and the commitment of the various interlocutors when using these solutions, may be limited. Likewise in the personal markets, the purchase of products and services is increasingly carried out remotely. This marketing method is widely used for practical reasons (no need to go to the store). However, the customer has often lost the physical link with the seller and must be content with the information provided by the seller's website. Sometimes this information is not sufficient to decide the customer to buy the product or service offered by the seller. Even a phone call or videoconference between the customer and the seller may not be sufficient to complete the sale. In addition, even in the case of complex and / or tailor-made products, such as the purchase of houses or apartments, the physical link between the customer and the seller may prove to be insufficient to give a realistic image of the property. purchased. Indeed, in a majority of cases, the client often only has plans of the property or even, at best, a three-dimensional representation, but the client is limited in his ability to interact in real time with the seller to modify these plans or view the real estate project in detail, that is to say with the integration of objects and furniture in future housing. It is therefore clear that the current solutions and practices in order to present a project touching on a given field and to discuss with the client on this project have drawbacks as soon as a "co-creation" is set up for this project, particularly during exchanges around the design of a tailor-made product or, in another register, for an artistic achievement (architectural models, vehicles, etc.). It is therefore often necessary for interlocutors working on a project to meet, in particular to manipulate the object being designed, to imagine it more easily in its future "reality" and in its future interactions with it.

The capabilities and performance of current communication networks are such that, combined with the computing performance of personal computers with powerful graphics cards, it is now possible to offer virtual reality services to bring together in one place virtual interlocutors in distant geographical positions. These interlocutors are each represented in this virtual place by a fictional character often called an avatar. This or these virtual places in which the avatars can interact constitute virtual reality environments. To get closer to the real environment, new solutions try to reproduce the richness of the exchanges between collaborators or partners by reproducing collaborative environments having interaction conditions, for example infra verbal communications between avatars (facial expressions, direction of gaze, etc.), interactions with an object being designed, etc. Thus, solutions are developed which facilitate collaboration through a virtual co-creation space where the participants are represented in virtual places.

To be able to interact in these virtual reality environments, the user, represented by his avatar, must be able to visualize and hear in an environment that is as close as possible to what he might feel in reality. We often speak of first-person immersion because it gives the impression that the user puts himself in the place of his avatar and therefore shares the same field of vision and the same sound environment. The user, through his avatar, must also be able to communicate with other avatars, grab and use objects, or even create objects. This is made possible by the use of virtual reality headsets, also called virtual reality headsets. There is now a rich offer of virtual reality headsets on the consumer market with two types of products:

- On the one hand, virtual reality head-mounted displays, in addition to an optical system allowing the final rendering of a three-dimensional space to a user, a video screen integrated into the headset making it possible to broadcast images and videos adapted to the optical system for three-dimensional rendering, and various internal and / or external sensors for detecting user movements. Products such as the Oculus Rift®, HTC Vive® or Sony® Playstation VR® are among these types of headsets. To operate in virtual reality environments, they rely on the computing power of an external computer with a powerful hardware configuration and in particular in terms of graphics processing processor (also called "graphics card"). These products are therefore still limited to a small segment of the population because the material investment is substantial for the purchase of a PC (initials of "Personal Computer" in English) with a powerful graphics card (which often represents a non negligible of the cost of the PC and is only justified for this type of virtual reality application or for certain video games), as well as for the purchase of the head-mounted display,

- on the other hand, head-mounted displays called "mobile virtual reality headsets" (or also "cardboard" in English) which, for most of them, only integrate the optical system allowing the final rendering a three-dimensional space for the user. It is therefore necessary to interface a terminal such as, for example, a smartphone (smart phone in French) to have the video screen functionalities and the inertial, gyroscopic and magnetometric sensors of these terminals. In this range of products, we find, for example, Gear VR® from Samsung®, VR One plus® from Zeiss® or Daydream View® from Google® or even Google Cardboard® made of cardboard and at a very low purchase cost. . These cardboards associated with smartphones have the advantage of being autonomous in the calculation and rendering of a virtual reality environment because they use the computing power of the smartphone as well as its sensors. In addition, virtual reality headsets are less expensive than headsets integrating the screen and the sensors because they only integrate the optical system. Since the rate of smartphone equipment in the world is high, the potential of users equipped with a smartphone and able to buy a cardboard is much greater than the potential of people equipping themselves with solutions with a Powerful PC and integrated headphones. This type of equipment could therefore make it possible to democratize virtual reality services for the purposes of co-design or co-creation as described above. However, the limited computing capacity of the graphics processors of current smartphones does not yet allow to simulate and control the display of a complex virtual reality environment. However, the graphic modeling part is essential so that the user has the best possible perception of the virtual reality environment. In this invention, we are referring to three-dimensional graphic modeling allowing rendering close to reality. Three-dimensional graphic modeling requires a powerful PC in terms of configuration of the graphics card, RAM, latest generation motherboard, etc. The technical problem raised by the invention is therefore that the domestic computing devices that are mobile phones of the smartphone type do not have the computing capacities to model the graphical environments in three dimensions, which reduces the potential of the users of these services. to those with very expensive PCs.

The invention therefore proposes to overcome the drawbacks of the prior art by proposing a method of offset from the visual scene of a three-dimensional space of a virtual reality environment comprising a terminal and a headset of the type cardboard, so that this scene is displayed without the terminal having to perform the calculations inherent in the creation of virtual reality environments. This process therefore allows a user, by delegation to a powerful server of graphical modeling calculations, to use a cardboard type head-mounted display with, for example, a smartphone and an application installed on the smartphone in order to access various three-dimensional virtual reality that would not otherwise be available to it due to lack of computing power.

One of the aims of the invention is to remedy the drawbacks of the aforementioned state of the art.

To this end, an object of the present invention relates to a method of interaction of a user with a virtual reality environment, characterized in that it comprises the following, at the level of a terminal:

- ordering a server at least one image of a three-dimensional space from the virtual reality environment,

- receive, from said server, data from a representative view of said space in three dimensions,

- extracting said data from said at least one image,

- converting said at least one image into said view,

- order the restitution on the terminal of said view.

By three-dimensional space is meant a set of data describing the dimensions in a three-dimensional Euclidean space, the colors and the textures of a real or imagined place, possibly of fictitious objects and characters or avatars of said place. . This place is characterized by several geometric shapes (a cube, a rectangle, a tetrahedron etc.), possibly specific objects contained in it (an armchair, a television, a sink etc.) and avatars.

By image is meant a digital graphic document interpretable by the terminal.

By virtual reality environment is meant a set of three-dimensional spaces, in which avatars can move, communicate with other avatars or with objects, use these objects, modify the space by creating new ones. objects or by modifying them etc. A virtual reality environment therefore has precise rules for managing three-dimensional spaces, such as their arrangement and the management of objects and avatars in terms of interaction and compatibility. Indeed, the virtual reality environment defines the possible actions (lifting, moving, transforming, communicating etc.) of the avatars on the objects and vice versa if necessary, even of the objects between them. In addition, the virtual reality environment also governs the physical laws between different objects and between objects and avatars.

Thanks to the invention, it is possible to broadcast on a screen of a terminal with limited computing capacities (example of a smartphone or a head-mounted display with integrated digital processing and computing capacities) a view represented by an image of a three-dimensional space, which, when viewed by the user of the terminal, gives the impression of a three-dimensional view. This view is close in terms of visual rendering of a representation of this space which would be produced by a more powerful machine, such as a server or a PC equipped with a latest generation graphics card. For this, the terminal is advantageously satisfied with receiving from a server a data file which has been generated by the server and which contains, inter alia, the image or images representing the view generated by the virtual reality application of the server. The image (s) are simply converted and displayed by the terminal. The stages of extraction and conversion into an image carried out by the terminal of the three-dimensional space data provided by the server do not require complex vector calculations (it is only a question of plating this image on a sphere encompassing the from the point of view of the user) as is the case for the restitution mechanisms of conventional virtual reality environments. Indeed, it was the server, upstream of the transmission to the terminal, which carried out all the calculations for converting the space in three dimensions into a data file comprising at least one image and metadata. Extracting at least one image and metadata from a data file is a simple step for the terminal. The step of converting an image from the terminal to a representative view of three-dimensional space also does not require complex calculations. Where a graphics engine will be necessary for a complete VR environment (sorting and placement of objects, management of light, shadows, rendering effects), the projection onto an image sphere remains very optimal (simple spherical deformation) . After conversion according to three-dimensional rendering techniques well known to those skilled in the art, the representative view of the three-dimensional space is displayed on the terminal screen and transmitted via an optical system to be viewed by the user. user who feels like being immersed in a three-dimensional environment.

According to a particular embodiment, the command to the server takes place as follows:

- point to a map representing the virtual reality environment,

- Transmit to the server the coordinates of the score on said map.

Thanks to the invention, the user can transmit location coordinates, following the pointing, in order, for example, to move his avatar or to transport an object from a three-dimensional space to another place in the world. virtual reality environment. It then suffices for him to edit the map representing the virtual reality environment and to point to the place on the map with which the user wishes to interact, for example the place where the user wishes to transport his avatar or an object. . The pointer can be moved in different ways: via the terminal and in particular its motion sensors or via an external device such as a joystick, mouse, movement sensor pad, Kynect type camera ® or any other external equipment capable of detecting commands to move a pointer by the user. The terminal therefore sends back to the server the contact details necessary for updating the virtual reality environment. The server or the PC, in charge of running the virtual reality application and in particular to restore the three-dimensional spaces of the virtual reality environment, upon request from the terminal, updates the location coordinates of the avatar (s) and / or of object (s) contained in its virtual reality environment and, on the basis of the new coordinates, calculates the new view and converts it into a data file integrating an image interpretable by the terminal for broadcasting the new view to the user as well as the contextual information related to the action to be performed by the server such as, for example, moving the avatar or moving an object.

In addition, thanks to the invention, following steps P2 to P5, said view representative of the three-dimensional space viewed by the user via the terminal and of a "cardboard" type helmet. is a point of view located at a specific location in three-dimensional space where, for example, the avatar is located. This characteristic allows the user to locate himself in three-dimensional space in order to envisage, for example, a new movement or a new action of his avatar and / or an object.

According to a particular embodiment, said command to the server takes place as follows:

- point to a place in a view,

- convert said view integrating the location pointed to a data file interpretable by said server,

- transmit to said server said data file.

Thanks to the invention, at the request of the user, the user can point to a place in the view of space in three dimensions. He can then order a certain number of actions such as those, for example, to command the server to move his avatar and / or an object to this pointed location. The user therefore only has to designate, via a pointer displayed on the terminal screen, the place where he wishes, for example, to move his avatar and / or an object. The displacement of the pointer is implemented in the ways already described for the previous embodiment. Based on the image transmitted by the terminal integrating the pointer, the server or the PC, in charge of executing the virtual reality application and in particular to restore the three-dimensional spaces of the virtual reality environment. update the location coordinates of the location pointed to in the virtual reality environment and, on the basis of the new coordinates, perform the action ordered by the user such as, for example, calculating a new view and broadcasting a data file integrating an image interpretable by the terminal to broadcast the new view to the user. The user can therefore move his avatar from one point in space to another point. It is also possible to restore a fluid displacement of the avatar and / or an object in its virtual reality environment by the successive transmission of changes of coordinates of the avatar and / or of the object in space in three dimensions and respective changes of 360-degree views at a sufficient frequency, so as to simulate an impression of movement.

In addition, as described in the previous particular embodiment, and following steps P2 to P5, said view representative of the three-dimensional space viewed by the user via the terminal and a headset "cardboard" type is a point of view located at a specific place in three-dimensional space where is located, for example, the avatar. This characteristic allows the user to locate himself in three-dimensional space in order to envisage, for example, a new movement or a new action of his avatar and / or an object.

According to another particular embodiment, from the data of the three-dimensional space, extract descriptive information from at least one object and / or from at least one avatar of the three-dimensional space,

Thanks to the invention, the user can directly view information and interact on certain objects or other avatars that are in his field of vision. Indeed, without this additional descriptive information of the image, the terminal does not have the possibility of characterizing the objects arranged in space nor identifying the avatars. Indeed, the image is only seen, by the terminal, as a set of pixels with a certain level of colors and light intensity and not as a set of vector objects having their own characteristics as is the case in a classic virtual reality environment. Based on the information retrieved by the terminal, the latter is therefore able to determine areas on the image which represent an object and / or an avatar. The user can therefore point to these areas in order to have additional information on the object and / or the avatar and / or to order actions of any kind related to these.

According to another particular embodiment, said view is a function of the orientation of an object or an avatar in said three-dimensional space.

Thanks to the invention, it is therefore possible for the user to modify the representative point of view of the space in three dimensions around a fixed point and in all possible orientations without having to order a new image. to the server. The image has all the information necessary for the terminal to display all these points of view. In the case where the fixed point of space happens to be the face of the avatar, the user, by rotating his avatar on himself, has different points of view allowing him to visually apprehend the space in three dimensions in its entirety in place of its avatar. The user can then decide what actions to take in the field of vision corresponding to the rotation performed by the avatar. Such an embodiment thus optimizes the feeling of immersion of the user in the virtual reality environment.

The various embodiments or features mentioned above can be added independently or in combination with each other, to the interaction process defined above.

The invention also relates to a user interaction terminal with a virtual reality environment, the terminal being characterized in that it comprises a processor which is configured to implement the following:

- order a server at least one image of a three-dimensional space from the virtual reality environment,

- receive, from said server, data from a representative view of said space in three dimensions,

- extracting said data from said at least one image,

- converting said at least one image into said view,

- order the restitution on the terminal of said view.

Such a terminal is in particular capable of implementing the aforementioned method of interaction of a user with a virtual reality environment, according to any one of the aforementioned embodiments.

The invention also relates to a computer program comprising instructions for implementing the method of interaction of a user with a virtual reality environment, according to any one of the particular embodiments described above, when said program is executed by a processor.

This program can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in n ' any other desirable form.

The invention also relates to a recording medium or information medium readable by a computer, and comprising instructions of a computer program as mentioned above.

The recording medium can be any entity or device capable of storing the program. For example, the support may include a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or else a magnetic recording means, for example a USB key or a hard disk.

On the other hand, the recording medium can be a transmissible medium such as an electrical or optical signal, which can be routed via an electrical or optical cable, by radio or by other means. The program according to the invention can in particular be downloaded from a network of the Internet type.

Alternatively, the recording medium can be an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the above-mentioned interaction method.

Other characteristics and advantages of the invention will appear more clearly on reading the following description of particular embodiments, given by way of simple illustrative and nonlimiting examples, and of the appended drawings, among which:

[Fig.l]

- Figure 1 shows the main actions performed by the user interaction process with a virtual reality environment,

[Fig.2]

FIG. 2 details an exemplary embodiment describing the main exchanges of information flows between the terminals during the implementation of the method of interaction of a user with a virtual reality environment,

[Fig.3]

FIG. 3 represents an example of a two-dimensional image used in the interaction method of FIG. 1,

[Fig.4]

- Figure 4 shows an example of a three-dimensional view,

[Fig.5]

FIG. 5 represents in more detail one of the actions executed by the method of FIG. 1,

[Fig.6]

FIG. 6 represents in more detail one of the actions executed by the method of FIG. 1,

[Fig.7a]

FIG. 7a represents in more detail one of the actions executed by the method of FIG. 1, according to a first variant,

[Fig.7b]

FIG. 7b represents in more detail one of the actions executed by the method of FIG. 1, according to a second variant,

[Fig.7c]

FIG. 7c represents in more detail one of the actions executed by the method of FIG. 1,

[Fig.8]

FIG. 8 represents an example of a user interaction terminal with a virtual reality environment implementing the method of interaction of a user with a virtual reality environment of FIG. 1.

Description of an embodiment of the invention

General principle of the invention

The objective of the invention is to allow a user of a terminal with low-power computing capacities to interconnect in a three-dimensional virtual reality environment. This environment usually requires terminals with a large computation capacity and in particular graphical computation.

The invention mainly proposes a method and a terminal for managing graphic and contextual data transmitted by a server in order to display a view of a space in three dimensions and to be able to interact with this space by exchanging information with the server.

There are a large number of possible configurations in terms of service architectures for creating a virtual reality environment, but there are two major functions: on the one hand, the management of the virtual reality environment and, d on the other hand, its modeling and its graphic rendering. The management of the environment concerns all the management of the rules of interactions between the objects and / or between the virtual characters or avatars, their modifications, transport, even in certain environments the follow-up of a script of events (example of the games video). Environmental management can be delegated to a single server-type terminal in charge of this management for all users. This function can also be virtualized by several servers processing calculations in parallel. The servers can be terminals controlled by users of the service for creating a virtual reality environment and / or terminals managed by the service provider or a combination of the two. Modeling and graphic rendering concern vector representation, texture management, light effects, etc. of a three-dimensional space. They are performed by a computer and can be delegated to a remote computer. The modeling requires dedicated graphics card type equipment in order to relieve the main processor of the computer of this type of calculation.

The invention is implemented in such a way that said terminal has software enabling it to communicate the information necessary to the computer (which can be a server, a PC or any other machine having the capabilities of sufficient calculation), in charge of managing the virtual reality environment and modeling, so that this computer performs the modeling and graphic rendering of a three-dimensional space. This information has for example appeal to the state of the avatar in the virtual reality environment such as: its location, its orientation, its communication with other avatars, its interaction with objects in the environment. The computer, in charge of this modeling and graphic rendering, interprets this information to modify the space in three dimensions according to this new information. This graphic modeling and rendering represents a new view of the three-dimensional space where the user's avatar is located. This view is converted by the computer so that it can be easily used by the terminal. The terminal therefore delegates the graphic modeling functions and part of the environmental management functions to the computer. The terminal then takes care of converting the new data received from the computer into a three-dimensional image.

Specific embodiments of the invention.

It is described below, with reference to Figures 1 to 8, a method and a terminal for user interaction with a virtual reality environment.

Such a process takes place in the following manner.

In an exemplary embodiment of the invention, the user is a potential buyer of a property, for example a house, and wishes to take stock with his promoter to discuss the design of this house. The promoter was teleworking that day, so he suggested that the user launch a session of a new collaboration service in virtual reality. This service is offered by the promoter's company, and is materialized by an application installed on a specific server hosted in the premises of this company. This application can be accessed remotely by subscribing to a user account linked to the service. The server has all the information necessary to present the real estate project (description of the property, plans of the property, objects, actions available on the objects etc.). It manages and stores all the information on the company's real estate projects. The service is also deployed, via another, simpler application, on the promoter's PC-type computer. This application communicates with the server application. The PC type computer incorporates a powerful graphics card allowing the promoter to perform the necessary graphic modeling calculations related to his own use but also on behalf of the user. The user has a terminal (a smartphone for example) and a cardboard compatible with the terminal. In addition, to allow the user to use the service with the terminal, an application is available on the website of the promoter's company and also, for example, on the various “app stores” (application stores in smartphone operating system providers. The user installs the mobile app from the app store on their terminal, launches the application and connects the terminal to the cardboard. He then connects to the company's virtual reality service, the promoter's employer. The promoter also connects to the virtual reality service through the application already installed on his PC and installs a head-mounted display adapted to his PC.

In Figure 1, in PI, there is a command to a server of at least one image of a three-dimensional space from the virtual reality environment.

For this purpose, as shown in Figure 2, by way of example, it is the user, via a terminal, who requests a server SERV of the company to notify him, by the sending data I, that he wishes a new image of space in three dimensions in order to start the session of virtual reality with the promoter and to be able to view the real estate project. The SERV server then communicates a set of information A, B and C to a promoter's PCI computer so that it can calculate a new image representative of the space in three dimensions and transmit it to the TERM terminal. Information A are parameters of the space in three dimensions (grid, texture or not, ceiling or not .....). Information B is data describing the three-dimensional space, such as for example data on the objects (furniture and buildings) and / or data on the avatar (s) contained in the three-dimensional space. The information C is location and position information of the body of the avatar of the user in three-dimensional space, such as for example location and position data of the head of the avatar, displacement of the arms, hands of the avatar, etc.

In FIG. 1, in P2, REC is received from said server, data from a view representative of said space in three dimensions.

To this end, as shown in FIG. 2, the PCI computer communicates to the TERM terminal of data B and E. In the example described, it is the promoter's PCI computer which communicates this data to the TERM terminal of the user because the session involves only the user and the promoter. In other particular embodiments, involving a larger number of computers, the SERV server can be responsible for centralizing the calculations and communicating the data B and E to the TERM terminal. The data E includes at least one image interpretable by the TERM terminal. The data B includes descriptive information of said space in three dimensions. In the example shown, the TERM terminal receives a data file transmitted by the PCI computer which contains this data E and B.

In FIG. 1, in P3, there is a process, by the TERM terminal, of an EXTR extraction of said data, said at least one image E.

As described in FIG. 3, the image E is a two-dimensional image which includes two views (left eye, right eye) distortedly representing the same scene in three dimensions.

In FIG. 1, in P4, the TERM terminal carries out a CONV conversion of said at least one image E into a view representative of the space in three dimensions.

As illustrated in FIG. 4, such a view V is the result of the conversion of the two views of the image E illustrated in FIG. 3.

In Figure 1, in P5, it is carried out, by the TERM terminal, a command of the REST rendering of said view.

According to a particular embodiment, shown in Figure 8, the actions performed by steps PI to P5 are implemented by a terminal. The terminal is for example a smartphone. For this, the terminal has the conventional architecture of a computer and notably comprises a memory MEM_T, a processing unit UT_T, equipped for example with a processor PROC_T, and controlled by the computer program PG_T stored in memory MEM_T. The computer program PG_T includes instructions for implementing the actions of steps PI to P5 as described above, when the program is executed by the processor PROC_T. On initialization, the code instructions of the computer program PG_T are for example loaded into a RAM memory (not shown) before being executed by the processor PROC_T. The processor PROC_T of the processing unit UT_T implements in particular the actions of the steps PI to P5 described above, according to the instructions of the computer program PG_T.

During steps PI and P2, the TERM terminal communicates with the SERV server, via a communication module or network device P_RES_T, via its communication module or network device P_RES_SERV. These communication modules P_RES_T and P_RES_SERV are suitable for exchanging data between them, via a RES network. Such a RES network is for example a MAN type network (English acronym for "Metropolitan Area Network") or WAN type (English acronym for "Wide Area Network").

Those skilled in the art can realize that there are many different types of data communication networks, for example radio networks, cellular or non-cellular, and that depending on the embodiment, the P_RES_T and P_RES_SERV communication modules can integrate one or more communication modules, for example radiofrequency communication and be configured for the transmission and reception of radiofrequency signals, according to one or more technologies, such as TDMA, FDMA, OFDMA, CDMA, or one or more radiocommunication standards, such as GSM, EDGE, CDMA, UMTS, HSPA, LTE, LTE-A, WiFi (IEEE 802.11) and WiMAX (IEEE 802.16), or their variants or developments, currently known or developed later.

In FIG. 1, in a particular embodiment of the action PI, it is carried out in Pl'_l with an action of pointing POINT_C on a map representing the virtual reality environment, in Pl'_2 with a TRANSI transmission to the SERV server of the coordinates of the score on said card as carried out in P '1_1.

In an example illustrated in Figure 5, the action requested by the customer is the rapid transport of his avatar from point Pj located in the garden to point Pc located in the kitchen of the house. For this, the user orders the edition of a CAR card thanks to the TERM terminal via the use of CAP_C sensors of the CARD cardboard or CAP_T sensors of the terminal. In the example shown, the user wants to move his avatar from the garden to the home kitchen to discuss with the promoter the layout of this room.

To this end, as shown in FIG. 8, the user, by means of the Cardboard CARD and the TERM terminal, visualizes the map of the virtual reality environment, in this case the house in the example described. The card is viewed by the user via the ECR screen of the TERM terminal, which is optically coupled with a three-dimensional vision system SYST_OPT of the Cardboard CARD. The user actuates the CAP_C or CAP_T sensors to move the pointer on the map of the virtual reality environment.

To this end, as shown in FIG. 2, the TERM terminal communicates to the server SERV the information C for changing the location of the avatar. In the example described, it is the SERV server which manages the part of the service linked to the management of the virtual reality environment. After receiving this information, the SERV server communicates the C information for this change to the promoter's PCI computer, so that this computer can perform graphics tasks.

In FIG. 1, in Pl ”_l, Pl” _2 and Pl ”_3, in another alternative embodiment to PI, there is an action Pl” _l of pointing POINT_E on a place of a view , an action Pl ”_2 of conversion CONV_V of said view integrating the location pointed to a data file interpretable by said server and an action Pl” _3 of transmission TRANS2 of said data file to said server. According to this alternative embodiment, the user orders the transport of his avatar in the same three-dimensional space.

To this end, as shown in FIG. 2, the TERM terminal communicates to the SERV server information C1 on the new location of its avatar in the form of a data file integrating at least one image and descriptive data of the space in three dimensions. Said at least one image is similar, in terms of format, to image E illustrated in FIG. 3 and is the result of a CONV_V conversion of a representative view of space in three dimensions as illustrated in FIG. 4. Said at least one image incorporates a graphic marking of the location pointed so that the server can refer to this marking in order to calculate a location coordinate of destination. This location coordinate will be used to transport the avatar. The server then transmits the destination coordinates through the C data stream to the PCI computer. In an alternative embodiment, the server can delegate the CON ”_2 conversion Pl” _2 action to the PCI computer. In another alternative embodiment, the terminal can also transmit the data C1 directly to the PCI computer (not shown in FIG. 2) so that this computer performs the conversion action P1 "_2.

As illustrated in Figure 6, in accordance with an exemplary embodiment of the invention, the user requests to transport his avatar AV, initially located at a point Pci, from a kitchen table OBJ_TAB next to a refrigerator OBJ_FR, at a destination point Pcd. This is so that the user can have a different view of the room. To do this, he commands the movement of a Point_C pointer to the Pcd destination point where he wishes to move his avatar. The point of view displayed on the ECR screen of the terminal incorporating the cursor of the pointer Point_C is converted CONV_V into an image interpretable by the SERV server. This server can then calculate, on the basis of this image, the new location coordinates of the destination point Pcd of the avatar.

To this end, as shown in Figure 8, the user, through the cardboard CARD and the terminal, has a view of space in three dimensions. The point of view is visualized by the user through the optical system SYST_OPT of three-dimensional vision of the cardboard CARD which is itself coupled by an optical link to the screen ECR of the terminal. The user activates the CAP_C or CAP_T sensors to move the pointer on the representative point of view of the space in three dimensions to the destination point Pcd where he wishes to move. The point of view integrating this point Pcd is then converted by the PG_T software, into a data file interpretable by the SERV server, said file containing at least one image of a view representative of space in three dimensions integrating the place point. This data file is then transmitted to the SERV server by means of a communication, via the RES network, between the communication modules P_RES_T and P_RES_SERV.

In FIG. 1, in a particular embodiment of the extraction action P3, the TERM terminal proceeds in P'3, from the data of said view, to the extraction INF of the descriptive information of at least one object and / or at least one avatar of three-dimensional space. The user by pointing to an object (s) and / or an avatar (s) from his point of view of three-dimensional space thus has descriptive information about said object or avatar. This information is extracted from the data file transmitted by the server or the computer. The descriptive information contained in the data file is of type: name, description of the object (s) and / or of the avatar (s), possible actions on the object (s) and / or on the / the avatar (s), such as for example: communicate, speak, take, pose, launch, delete etc.

In Figure 1, in an additional embodiment of P4, said view converted to P4 ’is a function of the orientation ORT of the body of the avatar in said space in three dimensions.

For this purpose, as shown in FIG. 2, it is the promoter's PCI computer which models and produces the graphic rendering of the view on the basis of the information C supplied by the server SERV on the position and the orientation of the avatar in three-dimensional space. In an alternative embodiment (not described in FIG. 2), it is the SERV server which performs the modeling and the graphic rendering of said view. This information C is transmitted by the TERM terminal and integrates, in addition to the location data, data on the orientation of the body of the avatar, for example the orientation of its head. This last information then makes it possible to calculate a point of view of space in three dimensions as a person positioned in the place of the avatar could see it.

As illustrated in FIG. 7a and in accordance with the example which has just been described, an image IM_2D_CUIS, after conversion P'4 by the terminal, represents a sphere ESP_3D_CUIS modeling a three-dimensional space, in which the AV avatar can rotate in all directions around a fixed point (for example the head), in order to have a plurality of views depending on the position of the avatar in this sphere. Figure 7b illustrates the example of Figure 7a, with a single degree of freedom for the avatar. In this particular case, the avatar AV rotates only around an axis OZ perpendicular to the plane containing the lines OX and OY. By turning, the avatar describes an angle a between a line perpendicular to the line passing through his eyes and the OY axis for example. If for example the angle a = 30 °, to obtain the point of view of the user, the terminal analyzes the information of the image IM_2D_CUIS centered on the angle a = 30 ° and performs the function of converting the image IM_2D_CUIS in a point of view of the avatar having a specific orientation (angle a = 30 °) in this kitchen.

As described in FIG. 7c, and in order to illustrate the example of FIG. 7b differently, an avatar AV located at point Pc, having oriented its body by an angle a = 30 °, finds itself facing a another AV avatar. The AV avatar's unique point of view for the value a = 30 ° calculated by the terminal on the basis of the IM_2D_CUIS image is the Vue_AV_30 ° three-dimensional image rendered using the TERM terminal and the CARD cardboard. This principle can therefore be generalized with two degrees of freedom and therefore two angles a and β to describe the whole of space in three dimensions. In this case, each point of view of the avatar in the ESP_3D_CUIS space (Figure 7a) corresponds to a point in the IM_2D_CUIS image transmitted by the server or the computer and vice versa. We can therefore say that there are therefore as many possible points of view as there are pixels defining the image IM_2D_CUIS.

To this end, as shown in FIG. 8, the user controls the orientation of the body of the avatar by means of the CAP_C sensors of the CARD cardboard or the CAP_T sensors of the TERM terminal. The orientation information of the avatar is stored in memory MEM_T and processed by the software PG_T. The processing unit UT_T of the SMART smartphone recalculates a new view according to the information transmitted by the PG_T software. This representative information of the space in three dimensions integrates all the data necessary for a panoramic view (360 degrees on two degrees of freedom).

It goes without saying that the embodiments which have been described above have been given purely by way of indication and in no way limitative, and that numerous modifications can be easily made by those skilled in the art without thereby depart from the scope of the invention.

Claims (1)

Claims [Claim 1] Method for the interaction of a user with a virtual reality environment, characterized in that it comprises the following, at the level of a terminal (TERM): order (COM) a server (SERV) at least one image of a three-dimensional space from the virtual reality environment, receive (REC), from said server (SERV), data from a view representative of said space in three dimensions, extract (EXTR) from said data said at least one image, convert (CONV) said at least one image into said view, order (REST) the rendering on the terminal (TERM) of said view. [Claim 2] Method according to claim 1, in which the order to the server takes place as follows: point (POINT_C) on a map (CAR) representing the virtual reality environment, transmit (TRANSI) to the server the coordinates of the score on said card (CAR). [Claim 3] Method according to claim 1, in which the order to the server takes place as follows: point (POINT_E) to a place in a view, convert (CONV_V) said view integrating the location pointed to a data file interpretable by said server (SERV), transmit (TRANS2) to said server (SERV) said data file. [Claim 4] Method according to claim 1, in which, from the data of said view, extract (INF) descriptive information from at least one object and / or from at least one avatar of three-dimensional space. [Claim 5] The method of claim 1, wherein said view is a function of the orientation (ORT) of an object or an avatar in said three-dimensional space. [Claim 6] Terminal adapted for the interaction of a user with a virtual reality environment, said terminal being characterized in that it comprises a processor (PROC_T) which is configured to implement the following: command a server at least one image of a three-dimensional space originating from the virtual reality environment, receiving, from said server, data from a representative view of said three-dimensional space, extracting said data from said at least one image, converting said at least one image into said view, ordering the rendering of said view on the terminal. [Claim 7] Computer program comprising program code instructions for carrying out the steps of the method according to any one of claims 1 to 5, when executed on a computer. [Claim 8] Information medium readable by a computer and comprising instructions of a computer program according to claim 7. 1/5