FR3104743A1 - Portable 3D content display device, system and method thereof. - Google Patents

Abstract

The invention relates to a first portable optical display device (12) of stereoscopic 3D content, intended to be worn by a user's head (11). The first portable display device is configured to display a first 3D representation of first data, and to calibrate a 3D coordinate system representative of the actual environment in which the user is located, said 3D coordinate system being used to display said first 3D representation of said first data, by storing a position in the 3D coordinate system of at least one second display device (13) also configured to display on a display surface a second 3D representation of second data using said 3D coordinate system. The invention also relates to a 3D rendering system and corresponding 3D display methods. Figure for the abstract: Fig. 2

Description

Portable 3D content display device, system and method thereof.

1. Field of the invention

The invention relates to devices for restoring virtual reality data, and in particular to augmented reality headsets and 3D screens.

2. Prior art

There are devices allowing the restitution of virtual reality data. Such devices include, for example, stereoscopic screens which display to a user a series of images intended alternately for the right eye and the left eye of the user, thus creating an impression of 3D relief of the content displayed. Such screens require the user to wear “3D” glasses (called active or passive depending on the technology of the associated screen) which allow each eye of the user to receive only the images intended for it.

There are also auto-stereoscopic screens which make it possible to render relief content to a user without the need for glasses worn by the user.

Such display devices provide the user with a 3D impression of the displayed content. However, these devices are limited by the occlusion problems that appear when rendering 3D content. Indeed, the 3D rendering perceived by the user when displaying the content by these devices is limited by the real environment in which the user finds himself, in particular by objects placed between the user and the screen or the projection surface. For example, if an object is placed between the user and a stereoscopic screen, the user will not be able to perceive a 3D effect in front of the object, the real object creating an occlusion in the virtual reality data displayed.

Other devices, such as augmented reality headsets, also make it possible to restore virtual reality data and provide the user wearing such a headset with a 3D impression of the restored data. However, it should be noted that such headsets also have drawbacks when real objects from the user's environment are located in the display space of the headset. In particular, virtual reality content can only be displayed in front of a real object placed in the display space of the headset. Virtual reality content displayed by the headset may then include 3D rendering inconsistencies when the headset's consideration of a real object is erroneous or absent, typically when the real object is placed between the headset and an object virtual reality content. Indeed, the detection of real objects in an environment is not very precise and inefficient in the case of a real moving object.

The impression of immersion in a virtual environment felt by the user can then be reduced when the user wishes to interact with content projected by the helmet with a certain impression of distance for the user and when this user comes up against a real object of its environment which is at a closer distance than that returned by the helmet.

Finally, it should be noted that augmented reality headsets have a very limited projection visual field compared to the human visual field.

There is therefore a need to improve the state of the art.

3. Disclosure of Invention

The invention improves the state of the art. To this end, it relates to a first 3D display device. The first 3D display device is portable in that it is intended to be worn by a user's head. According to the invention, such a first display device comprises in particular a display module configured to display a first 3D representation of first data and a calibrator of a 3D coordinate system representative of the real environment in which the user is located, said 3D coordinate system being used by the display module to display said first 3D representation of said first data, by storing a position in the 3D coordinate system of at least a second display device configured to display on a display surface a second 3D representation of second data using said 3D coordinate system.

The invention thus proposes a first display device, for example a portable optical display device such as an augmented reality headset, making it possible to improve the 3D rendering perceived by a user. Advantageously, such a first display device is used together with at least one second display device, for example a stereoscopic screen, to restore 3D data. Such a restitution is carried out using a common 3D coordinate system so that the 3D rendering of the 3D representations restored by each of the two devices is consistent for the user.

In addition, each device in the system renders data in its own projection space. Such projection spaces are complementary in the environment in which the user finds himself. Indeed, the first display device displays data in a projection space located facing the gaze of the user, and close to him and whose limits are defined by the projection field angles of the projection system of the first device display.

Using a second 3D display device on a surface increases the 3D field of view provided to the user by the first display device. Indeed, thanks to the second display device, the user has a 3D rendering in a restitution space going beyond the limits of the projection field of the first display device.

In case of real objects placed in the environment between the user and the second display device, the phenomenon of occlusion is limited. Indeed, data can be displayed in 3D in front of and behind this object with respect to the user, thanks respectively to the first portable display device and to the second display device.

According to a particular embodiment of the invention, the first portable display device further comprises a detector configured to detect at least one user interaction on at least one element of the 3D representation displayed by the second display device.

According to another particular embodiment of the invention, the first portable display device comprises a communication module further configured to transmit to the second display device at least one interaction datum.

Such interaction data corresponds for example to the position of the head or of a hand of the user. According to this variant embodiment of the invention, the second display device thus has the same position data of the head and the hands of the user as the first display device. It can thus adapt the display of 3D data according to these positions.

According to another variant, or in addition to the previous variant, the interaction datum corresponds to information representative of a user interaction detected by the first display device.

According to another particular embodiment of the invention, the detector is configured to detect said at least one user interaction on at least one element of the second 3D representation displayed by the second display device when a hand of the user with which it interacts is detected at a position located outside a projection field of said first portable display device.

According to this particular embodiment of the invention, the first portable display device advantageously uses the field differences between its display field according to which it displays the 3D representation and its field of vision according to which it is capable of detecting the position of the hands of the user, to determine whether the user interacts on the representation displayed by the first portable display device or on the representation displayed by the second display device.

According to another particular embodiment of the invention, the first portable display device has a memory in which is stored a location of at least one element of the second 3D representation displayed by the second display device in the 3D coordinates. According to this particular embodiment of the invention, the first portable display device is aware of the locations in the 3D coordinate system of the elements of the second 3D representation displayed by the second display device and can thus determine when detecting a user interaction in the environment in which 3D representation the user has interacted.

The invention also relates to a second 3D display device comprising:

• a display module configured to display a second 3D representation of second data on a display surface, and
• a 3D coordinate system calibrator operable to display said second 3D representation of said second data on the display surface by storing at least one position in the 3D coordinate system of a first wearable display device by a head of a user and configured to display a first 3D representation of first data using said 3D coordinate system.

The display surface may be included in the second 3D display device or else be connected to this second 3D display device.

According to a particular embodiment of the invention, the second 3D display device further comprises a module for modifying the display of the second 3D representation displayed by the second display device as a function of at least one datum interaction received from the first display device.

According to this particular embodiment of the invention, the user can interact on the second data displayed by the second display device without the latter requiring a mechanism for detecting user interactions on the second 3D representation displayed by the second display device. Indeed, the user interactions are here detected by the first portable display device and transmitted to the second display device when they do not concern the first data displayed by the first portable display device. Thus, it is possible to use a second simple display device, such as a stereoscopic or auto-stereoscopic screen, requiring no additional means.

According to a particular embodiment of the invention, the interaction datum corresponds to at least one of the following data:

• a position of the user's head or hand,
• information representative of a user interaction on at least one element of the second 3D representation displayed by the second display device.

According to another particular embodiment of the invention, the second 3D display device further comprises a communication module for transmitting to the first portable display device at least a subset of elements displayed in the second 3D representation displayed by the second display device.

The invention also relates to a 3D data restitution system comprising a first display device according to any one of the particular modes mentioned above, and at least one second display device according to any one of the particular modes mentioned above.

The invention also relates to a first 3D display method, implemented by a first display device intended to be worn by a head of a user. Such a first display method comprises:

• a display, by the first display device, of a first 3D representation of first data, and
• a calibration of a 3D coordinate system representative of the real environment in which the user finds himself, said 3D coordinate system being used to display said first 3D representation of said first data, the calibration comprising at least the memorization of a position in the 3D coordinate system of at least a second display device configured to display on a display surface a second 3D representation of second data using said 3D coordinate system.

According to a particular embodiment of the invention, the first 3D display method further comprises the transmission by the first display device to the second display device of at least one position of the head or of a user's hand.

According to a particular embodiment of the invention, the first method for displaying 3D data further comprises the detection of at least one user interaction on at least one element of the second 3D representation displayed by the second display device and transmitting to the second display device information representative of said detected user interaction.

According to another particular embodiment of the invention, the first 3D display method further comprises obtaining a subset of elements displayed in the second 3D representation displayed by the second display device, and modifying the first 3D representation displayed by the first display device to display the elements of said subset. According to this particular embodiment of the invention, the user can manipulate elements of a set displayed by the second display device via the first portable display device.

According to another particular embodiment of the invention, the first 3D display method further comprises the detection of a user interaction on said subset of elements displayed by the first portable display device modifying said sub- together, and transmitting said modified subset to the second display device.

The invention also relates to a second 3D display method, implemented by a second display device, the second display method comprising:

• a display of a second 3D representation of second data on a display surface,
• a calibration of a 3D coordinate system used to display on the display surface said second 3D representation of said second data, the calibration comprising at least the storage of a position in the 3D coordinate system of a first device of a display intended to be worn by a user's head and configured to display a first 3D representation of at least first data using said 3D coordinate system.

According to a particular embodiment of the invention, the second 3D display method further comprises:

• a reception by the second display device, coming from the first display device, of at least one interaction datum,
• a modification of the display of the second 3D representation displayed by the second display device as a function of said at least one interaction datum received.

According to another particular embodiment of the invention, the second 3D display method further comprises the transmission to the first display device of at least one subset of elements displayed in the second 3D representation displayed by the second display device.

The invention also relates to a computer program comprising instructions for implementing the first or second 3D display method according to any one of the particular embodiments described above, when said program is executed by a processor. Such a program can use any programming language. It can be downloaded from a communication network and/or recorded on a computer-readable medium. This program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in partially compiled form, or in any other desirable form.

According to yet another aspect, a computer-readable recording medium or information carrier is provided which comprises instructions of a computer program as mentioned above. The recording media mentioned above can be any entity or device capable of storing the program. For example, the medium may comprise a storage means, such as a Read-Only Memory (ROM) type memory, for example a CD-ROM or a microelectronic circuit ROM, a flash memory mounted on a removable storage medium , such as a USB key, or else a magnetic mass memory of the Hard-Disk Drive (HDD) or Solid-State Drive (SSD) type, or a combination of memories operating according to one or more data recording technologies. On the other hand, the recording media may correspond to a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means. In particular, the proposed computer program can be downloaded from an Internet type network.

Alternatively, the recording media may correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.

The first and second 3D data display methods according to the invention can therefore be implemented in various ways, in particular in hardware form or in software form, or be implemented in the form of a combination of hardware elements and software.

4. List of Figures

Other characteristics and advantages of the invention will appear more clearly on reading the following description of a particular embodiment, given by way of a simple illustrative and non-limiting example, and the appended drawings, among which:

- Figure 1 illustrates an example of an environment for implementing the invention according to a particular embodiment of the invention,

- figure 2 illustrates the example of figure 1 during the restitution of 3D data to the user,

- Figure 3 schematically illustrates the projection field and the detection field of a first display device according to a particular embodiment of the invention,

- Figure 4 schematically illustrates the organization of the real and virtual rendering spaces experienced by a user according to the particular embodiment of the invention illustrated by Figure 2,

- Figure 5 schematically illustrates the structure of a first 3D data display device according to one embodiment,

- Figure 6 schematically illustrates the structure of a second 3D data display device according to one embodiment,

- Figure 7A illustrates steps of the first and second 3D data display methods implemented respectively by a first display device and by a second display device according to one embodiment,

- Figure 7B illustrates steps of the first and second 3D data display methods implemented respectively by a first display device and by a second display device according to another embodiment,

FIG. 8 illustrates an example of an environment for implementing the methods described in relation to FIG. 7B.

5. Description of an embodiment of the invention

Figure 1 illustrates an example of an environment (10) for implementing the invention according to a particular embodiment. The environment 10 comprises a user (11) equipped with a first device (12) for displaying data in stereoscopic 3D. For example, such a first display device is a portable optical device (12) such as an augmented reality headset suitable for displaying so-called virtual reality data to the user, such as a holographic projection headset (Microsoft Hololens®). According to the invention, the augmented reality helmet is a helmet allowing the user to see virtual reality data displayed in 3D by the helmet on the optics of the glasses of the helmet, as well as the real environment in which the user is located. The portable optical display device (12) constitutes a first 3D data display device of the restitution system illustrated in FIG. 1.

The environment (10) also includes at least one second display device (13) for 3D data. Such a second display device (13) can be a stereoscopic or auto-stereoscopic screen, or even any type of 3D screen making it possible to display data in 3D to a user. For example, these may be screens installed in an immersive room. When the second display device (13) is a stereoscopic screen, the user is also provided with a corresponding pair of glasses allowing him to see in relief the data displayed by the screen (13).

These glasses can be placed just in front of the glasses of the augmented reality helmet or just behind with respect to the direction of the user's gaze.

The devices (12) and (13) of the environment (10) form a 3D rendering system according to the invention. Such a system allows the user to visualize data displayed in 3D according to several levels or layers of restitution in the environment.

In order to have consistency in the 3D rendering of the data provided by each device, the devices of the restitution system use the same 3D coordinate system to display the 3D representation of the data to the user. In other words, a point of a 3D representation displayed by the first portable display device (12) corresponds to a point of the same 3D coordinates in the 3D coordinate system used by the second display device (13) to display a 3D representation, and vice versa.

For this, during an initialization phase, the devices (12) and (13) carry out a calibration according to which they respectively record their position in the 3D coordinate system that they use for the display, as well as the position from the other device.

For example, the origin point of the 3D coordinate system corresponds to the initial position of the user (11) carrying the first portable display device (12) in the real environment.

The position of the first portable display device can change over time depending on the movements of the user. The position of the user is then transmitted by the first portable display device (12) to the second display device (13) regularly or upon detection of a change in position, so that the second display device ( 13) adapts the rendering of 3D data. In the embodiment described here, the second display device (13) is fixed, its position therefore remains fixed.

The recording of the position of the second display device (13) by the first portable display device (12) can be done manually during the installation of the second display device (13) in the environment or else detected by the first portable display device (12). To display 3D data, the first portable display device (12) establishes a 3D representation of the data to be rendered according to a 3D coordinate system representative of the real environment in which the first portable display device (12) is place. The 3D coordinate system stored by the first portable display device (12) comprises a virtual representation of the second display device (13) located according to the position of the second display device (13) in the real environment .

According to the embodiments of the invention implemented, the data displayed by the display devices may be identical or different. Thereafter, we will call “global content” the set of data displayed by all the devices of the restitution system.

According to a particular embodiment of the invention, the first portable display device (12) and the second display device (13) restore the same 3D content, each device restoring a distinct part of the data of such content. For example, the second display device (13) displays second data of the content to be rendered furthest from the user and the first handheld display device (12) renders first data of the content to be rendered closer of the user.

According to this particular embodiment of the invention, the data returned by each device are different but belong to the same content.

According to another particular embodiment of the invention, the first portable display device (12) and the second display device (13) respectively restore first data and second distinct data. For example, when the global content rendered is a virtual reality environment, the second display device (13) displays second data of the virtual reality environment which is visible to all. The first portable display device (12) for its part restores first data corresponding to virtual elements for enriching the second data. These virtual elements (first data) are displayed superimposed on the second data of the virtual reality environment displayed. Such virtual elements are for example virtual objects inserted into the virtual reality environment specifically for the user. These virtual elements are not visible to other users who would be present in the user's real environment. The first data are thus personalized for the user carrying the first display device.

Thus, this particular embodiment of the invention makes it possible to display personalized or enriched global content.

According to another particular embodiment of the invention, the first portable display device (12) and the second display device (13) restore complementary data. For example, when the global content rendered is a virtual reality environment, the second display device (13) displays second data representative of the virtual reality environment. Certain elements of the virtual reality environment may not be visible to the user, for example because these elements are occluded by real objects placed in the real environment in which the user finds himself. The first portable display device (12) detects the presence of real objects in the field of vision of the user, and then restores the second data of the virtual reality environment which is not visible to the user when they are displayed by the second display device (13). Thus, according to this particular embodiment of the invention, the first display device and the second display device displays the same content (the virtual reality environment), part of the first data displayed by the first device the display being identical to at least a part of the second data displayed by the second display device.

Figure 1 illustrates an environment (10) comprising a single second display device (13). In other particular embodiments, the restitution system according to the invention may comprise several second display devices (13) associated and configured to display second data in 3D on a display surface and/or one or more third display devices configured to display third 3D data between the at least one display surface and the user (eg, 3D holographic projectors). In this case, each second or even third display device (13) records its position and the position of all the other second or even third display devices (13) and of the first portable display device (12). Likewise, the first portable display device (12) records the position of all the second or even third display devices (13) of the environment.

The devices of the 3D rendering system are configured to communicate with each other in a wired or wireless manner.

FIG. 2 schematically illustrates the 3D restitution of data to a user in the environment (10) by the restitution system described above. In Figure 2, there is a first space 22 corresponding to a restitution space of the first portable display device (12) in which it displays the 3D representation of the first data to be returned to the user. In other words, the first space 22 corresponds to a space of the real environment in which the user has the impression that the first data is restored by the first portable display device (12).

Figure 2 also includes a second space 20 corresponding to a 3D restitution space of the second display device (13). In other words, the second space 20 corresponds to a space of the real environment in which the user has the impression that the second data is restored by the second display device (13).

In the example illustrated in FIG. 2, a real object 21 (represented schematically by a vertical block) is placed in the environment (10) between the user (11) and the second display device (13). According to the invention, the occlusion phenomenon caused by the presence of the real object 21 in the second restitution space (20) of the second display device (13) is limited. Indeed, according to the particular embodiment described here, the first portable display device (12) comprises a detector for the presence of real objects placed in the environment in which the user is located and more particularly in his field. of vision. The first portable display device (12) comprises a module for determining the second space of the environment in which the second display device (13) displays the second 3D representation of the second data. Such a determination module uses the position, in the environment 10, of the second display device (13).

The first portable display device (12) comprises an occlusion detector which, from the position of the user's head (11), deduces therefrom at least one zone of the second 3D representation displayed by the second device display (13) which is not visible to the user (11).

The first portable display device (12) comprises a receiver then obtaining first complementary data corresponding to the non-visible zone detected and displays a first 3D representation of these first complementary data in its first restitution space (22). Since the first portable display device (12) and the second display device (13) use the same 3D coordinate system, the two 3D representations, the first and the second 3D representations, are consistent, and the user has the impression of viewing a single 3D representation corresponding to a fusion of the first 3D representation with the second 3D representation.

The first corresponding data of the second 3D representation displayed by the second display device (13) which are not visible to the user are obtained by the first portable display device (12):
- either from the memory of the first portable display device (12) because the two devices, the first and the second display devices, restore a single and same content consisting of data which is divided into first data and second data (the first data and the second data corresponding to data distinct from the content) to be restored respectively by the first and the second display device. Thus the data of the content corresponding to the second data of the non-visible zone detected are inserted into the first data restored by the first portable display device.
- Either on request from the second display device (13).

Advantageously, according to a particular embodiment of the invention, the first portable display device (12) comprises a user interaction peripheral allowing the user to interact on part of the elements of the second representation 3D displayed by the second display device (13), when this second display device (13) does not have a user interaction detector on the second 3D representation (for example a camera coupled to the screen).

Indeed, as shown in Figure 2, and described in more detail in relation to Figure 3, the first portable display device (12) is equipped with a user interaction detector. This interaction detector defines an interaction space in the real environment in which the user can interact. Such interactions can for example be carried out by an opening/closing of the hand, or particular gestures triggering actions on the elements represented in the 3D representations.

FIG. 3 schematically illustrates a projection field and an interaction detection field of a first portable display device according to a particular embodiment of the invention. In Figure 3, a user (11) is shown schematically wearing a holographic projection headset (12). In the example illustrated, the holographic projection helmet (12) comprises a projection device (not shown) defining a restitution space (22) and an interaction detector (not shown) defining an interaction detection space ( 24).

For example, the projection device comprises two screens for holographic projection placed respectively in front of the right eye and the left eye of the user (11) of the headset, as well as projectors for projecting data, for example reality data Virtual.

Such a projection device thus defines a restitution space (22), illustrated by dotted lines in FIG. 3. Such a restitution space (22) corresponds to the restitution space described in relation with FIG. 2. C is a space in which the user (11) has the impression that the first virtual reality data, for example virtual objects, are displayed. In the embodiment described here, the restitution space (22) is limited by the field of vision of the holographic projection helmet (12).

The interaction detector comprises for example a 2D camera and depth sensors, or else a 2D+depth camera, placed on the helmet (12). The interaction detector defines an interaction detection space (24, defined as a solid line in FIG. 3) which is larger than the restitution space (22).

According to the embodiment illustrated in FIG. 3, when a part of the body of the user of the holographic projection helmet (12), for example a hand (30), is in the interaction detection space (24 ), this part of the body is detected by the interaction detector and can manipulate projected virtual objects. Similarly, if real objects are placed in the interaction detection space, the interaction detector can also detect them and take them into account when projecting first data.

The interaction detector and the projection device are coupled to a headset processing unit (12) (not shown) which is configured to process the first virtual reality data, i.e. the 2D or 3D data of the scene to be projected by the projection device, and the data captured by the interaction detector, for example a part of the user's body to be detected and/or elements of the user's real environment.

As illustrated in figure 3, the restitution space (22) and the interaction detection space (24) can be different. For example, with reference to Figure 3, the interaction detection space (24) is larger than the restitution space (22).

It thus appears that a part of the user's body (11) can be detected in the interaction detection space (24) but that it is not in the restitution space (22). Such a zone (25) of the interaction detection space (24) in which a part of the body of the user (11) is not in the restitution space (22), is illustrated hatched on the figure 3.

According to the prior art, even if the interaction detection space is larger than the restitution space, the space in which the user can actually interact is limited by the restitution space (22). Indeed, no element of the 3D representation projected by the headset is rendered in zone 25, the user cannot then interact on an element of this zone.

Advantageously, according to the invention, the use of a second display device (13) together with the first portable display device (12) as described in relation to FIGS. 1 or 2 makes it possible to enlarge the space in which the user can actually interact. Indeed, the second display device (13) can thus display elements of its second 3D representation in the zone 25, so that the user can thus interact on elements of the second 3D representation located in this zone.

FIG. 4 schematically illustrates the organization of the real and virtual rendering spaces experienced by a user according to the particular embodiment of the invention. For example, an environment (10') includes second display devices (13') such as immersive walls placed on 3 sides of the environment (10'). The second devices (13') define a second immersive restitution space (20'). The environment (10') comprises a succession of real/virtual layers ordered as follows (in FIG. 4, the virtual layers are illustrated in hatched lines): the user (11'), the first portable display device ( 12') carried by the user, the first restitution space (22') of the portable device, a real object (21') placed in the environment, the second immersive restitution space (20').

FIG. 5 illustrates the simplified structure of a first portable optical data display device D_PROJ according to a particular embodiment of the invention. Such a device D_PROJ is configured to implement the first 3D data display method according to any one of the embodiments described. For example, the first portable optical display device D_PROJ is a first portable display device (12) as described in relation to Figures 1-3.

In the non-limiting example illustrated in FIG. 5, the first device D_PROJ comprises a memory MEM, a processing unit UT, equipped for example with a processor PROC, and controlled by the computer program PG stored in memory MEM. The computer program PG includes instructions for implementing the steps of the first 3D data display method, when the program is executed by the processor PROC.

On initialization, the code instructions of the computer program PG are for example loaded into a memory before being executed by the processor PROC. The processor PROC of the processing unit UT notably implements the first 3D data display method according to any one of the embodiments described above in relation to FIGS. 1-3, or below in relationship with Figures 7A or 7B according to the instructions of the computer program PG.

For this, the first device D_PROJ comprises a position detector CAPT configured to detect the position of the head and hands of a user wearing the first portable display device D_PROJ.

The first device D_PROJ also comprises a projection device PROJ making it possible to visually restore a first 3D representation of the first data to the user, for example via a holographic projection technique.

The first device D_PROJ also comprises a transmitter/receiver or communication module COM enabling the first device D_PROJ to communicate with at least one second display device. In particular, the processing unit UT is configured to communicate with the communication module COM to transmit to the second display device the position of the head and the hands of the user, and/or information representative of a user interaction , and/or to receive from the second display device first data to be restored (in particular second non-visible data to be integrated into the first data).

According to a particular embodiment of the invention, the first device D_PROJ described above is included in a terminal, for example an augmented reality headset.

FIG. 6 illustrates the simplified structure of a second data display device D_AFF according to a particular embodiment of the invention. Such a second device D_AFF is configured to implement the second 3D data display method according to any one of the embodiments described. For example, the second display device D_AFF is the second display device (13) as described in relation to figures 1-2.

In the non-limiting example illustrated in FIG. 6, the second device D_AFF comprises a memory MEM', a processing unit UT', equipped for example with a processor PROC', and controlled by the computer program PG' stored in memory MEM'. The computer program PG' includes instructions for implementing the steps of the second 3D data display method, when the program is executed by the processor PROC'.

On initialization, the code instructions of the computer program PG' are for example loaded into a memory before being executed by the processor PROC'. The processor PROC' of the processing unit UT' notably implements the second 3D data display method according to any one of the embodiments described above in relation to FIGS. 1-3, or below. below in relation to FIGS. 7A or 7B according to the instructions of the computer program PG'.

For this, the second device D_AFF comprises a display surface ECR, for example a screen suitable for displaying to a user a series of images intended alternately for the right eye and the left eye of the user, thus creating a 3D relief impression of the displayed data.

According to a particular embodiment of the invention, the second device D_AFF is coupled to a pair of active or passive 3D glasses intended to be worn by the user to perceive the 3D effect of the second data displayed. Such 3D glasses are active or passive depending on the technology used by the second device D_AFF to restore the second data in 3D.

The second device D_AFF also comprises a transmitter/receiver or communication module COM' allowing the device D_AFF to communicate with a first display device (in particular optical) intended to be worn by a user. In particular, the processing unit UT' is configured to communicate with the communication module COM' to receive from the first optical display device the position of the user's head and hands, and/or representative information of a user interaction, and/or to transmit to the first display device first data to be restored (in particular second non-visible data to be integrated with the first data).

According to a particular embodiment of the invention, the second device D_AFF described above is included in a screen.

Figure 7A illustrates steps of the first and second methods of 3D data display according to one embodiment. The first 3D display method is for example implemented by a first portable display device (12) as described in relation to FIGS. 1-3 and the second 3D display method is for example implemented by the second display device (13) as described in relation to Figures 1-2.

During a step E70, the first portable optical display device (12) initializes a 3D coordinate system representative of the real environment in which the user finds himself.

During a step E71, the first portable optical display device (12) transmits to the second display device (13) the position of the first portable optical display device (12).

During a step E72, the second display device (13) displays a 3D representation of the data to be rendered, for example a virtual reality environment, or else an interface comprising interaction elements.

During a step E73, the first portable optical display device (12) also displays a 3D representation of the data to be restored. As described above, it may be the same data, or additional data.

Step E71 is implemented regularly or upon detection of a change in the position of the user's head (for example movement of the head or movement of the user in the real environment). Upon receipt of a new position of the user's head from the first portable optical display device (12) during step E71, the second display device (13) modifies the 3D representation of the data displayed to take this change into account.

During a step E74, the first portable optical display device (12) detects a user interaction.

During a step E75, the first portable optical display device (12) determines whether the user interaction has been implemented on an element of the 3D representation displayed by the second display device (13) or relocated by the first portable optical display device (12).

If the user interaction has been implemented on an element of the 3D representation rendered by the first portable optical display device (12), the first portable optical display device (12) modifies the rendered data accordingly.

If the user interaction has been implemented on an element of the 3D representation displayed by the second display device (13), during a step E76, the first portable optical display device (12) transmits to the second display device (13) information representative of the user interaction.

During a step E77, the second display device (13) modifies the display of the 3D representation according to the user interaction received.

Steps E71 to E77 are iterated as long as data is to be returned to the user.

FIG. 7B illustrates, in relation to FIG. 8, steps of the first and second methods of 3D display of data according to another embodiment.

In this particular embodiment of the invention, the second display device (13) is configured to display a large volume of data (800 in FIG. 8) to the user and the first portable optical display device ( 12) is used by the user to interact with a subset (810 in FIG. 8) of the data displayed by the second display device (13). The steps of the first and second display methods are similar to those described in connection with Figure 7A and further include the steps described below. It is assumed here that during step E73, the first portable optical display device (12) does not yet project data to the user.

During a step E74′, the first portable optical display device (12) detects a user interaction on the 3D representation of the data displayed by the second display device (13). Such a user interaction corresponds to a selection by the user of a sub-group of elements from among a group of elements of the 3D representation displayed by the second display device (13).

During a step E76′, the first portable optical display device (12) transmits to the second display device (13) information representative of the user interaction. During a step E77', possibly, the second display device (13) modifies the display of the 3D representation, for example by visually modifying the representation of the selected elements, or else by deleting the selected elements from the 3D representation displayed.

During a step E78, the second display device (13) transmits to the first portable optical display device (12) the selected elements of the subset. The first portable optical display device (12) receives them and stores them in memory.

During a step E79, the first portable optical display device (12) restores a 3D representation of the elements received.

During a step E80, the first portable optical display device (12) detects a user interaction on the subset of elements restored by the first portable optical display device aimed at modifying one or more elements of the subset. together. During step E80, the first portable optical display device (12) modifies the element(s) of the subset and saves the modification in memory. Step E80 can be iterated as long as the user wishes to interact on the elements of the subset.

During a step E81, the first portable optical display device (12) detects a user interaction aimed at transmitting the subset of modified elements to the second display device (13). During step E81, the first portable optical display device (12) therefore transmits to the second display device (13) the subset of modified elements. The second display device (13) saves the modified sub-assembly in memory and during a step E82, the second display device (13) modifies the display of the 3D representation to display in the elements of the sub- set received.

Different particular embodiments of the invention have been described above. These different particular embodiments of the invention can be implemented alone or in combination with each other.

Claims (15)

First 3D display device, intended to be worn by a user's head, the first display device comprising:
- a display module configured to display a first 3D representation of first data, and
- a calibrator of a 3D coordinate system representative of the real environment in which the user finds himself, said 3D coordinate system being used by the display module to display said first 3D representation of said first data, by storing a position in the 3D coordinate system of at least a second display device configured to display on a display surface a second 3D representation of second data using said 3D coordinate system. The first 3D display device according to claim 1, further comprising a detector of at least one user interaction on at least one element of the second 3D representation displayed by the second display device. The first 3D display device according to claim 2, wherein the detector is configured to detect said at least one user interaction on at least one element of the second 3D representation displayed by the second display device when a hand of the user with whom he interacts is detected at a position located outside a projection field of said first portable display device. The first 3D display device according to claim 3, further comprising a memory in which is stored a location of at least one element of the second 3D representation displayed by the second display device in the 3D coordinate system. A second 3D display device, the second display device comprising:
- a display module configured to display a second 3D representation of second data on a display surface, and
- a calibrator of a 3D coordinate system used to display on the display surface said second 3D representation of said second data, by storing at least one position in the 3D coordinate system of a first display device intended to be carried by a head of a user and configured to display a first 3D representation of first data using said 3D coordinate system. Second 3D display device according to claim 5, further comprising a module for modifying the display of the second 3D representation displayed by the second display device as a function of at least one interaction datum received from the first device display. Second 3D display device according to claim 6, wherein said at least one interaction datum comprises at least one of the following data:
- a position of the user's head or hand,
- information representative of a user interaction on at least one element of the second 3D representation displayed by the second display device. 3D data restitution system including:
- a first display device according to any one of claims 1 to 4,
- at least one second display device according to any one of claims 5 to 7. First 3D display method, implemented by a first display device intended to be worn by a head of a user, the first display method comprising:
- a display, by the first display device, of a first 3D representation of first data, and
- a calibration of a 3D coordinate system representative of the real environment in which the user finds himself, said 3D coordinate system being used to display said first 3D representation of said first data, the calibration comprising at least the memorization of a position in the 3D coordinate system of at least a second display device configured to display on a display surface a second 3D representation of second data using said 3D coordinate system. A first 3D display method according to claim 9, further comprising:
- detection of at least one user interaction on at least one element of the second 3D representation displayed by the second display device and,
- A transmission to the second display device of information representative of said detected user interaction. A first 3D data display method according to any of claims 9 or 10, further comprising:
- obtaining a subset of elements displayed in the second 3D representation displayed by the second display device,
- a modification of the first 3D representation displayed by the first display device to display the elements of said subset. A first 3D data display method according to claim 11, further comprising:
- detection of a user interaction on said subset of elements displayed by the first display device modifying said subset,
- A transmission to the second display device of said modified subset. A second 3D display method, implemented by a second display device, the second 3D display method comprising:
- a display of a second 3D representation of second data on a display surface,
- a calibration of a 3D coordinate system used to display on the display surface said second 3D representation of said second data, the calibration comprising at least the storage of a position in the 3D coordinate system of a first device of a display intended to be worn by a user's head and configured to display a first 3D representation of at least first data using said 3D coordinate system. A second 3D display method according to claim 13, further comprising:
- reception by the second display device from the first display device of at least one interaction datum,
- a modification of the display of the second 3D representation displayed by the second display device as a function of said at least one interaction datum received. Computer program comprising instructions for implementing the first 3D display method according to any one of Claims 9 to 12 or the second 3D display method according to any one of Claims 13 or 14, when the program is executed by a processor.