FR3076641A1 - IMMERSIVE MULTIMEDIA, MULTI-USER AND MULTI SENSORY VOLUME - Google Patents

Abstract

An immersive viewing system comprises at least one main body defining a closed interior chamber, having side walls, upper and lower forming image projection surfaces for forming a virtual three-dimensional representation, and means for multichannel sound diffusion (23 to 27), the system further comprising means of geolocation viewers present in said inner chamber and acquisition of the spatial orientation of their field of view. Said system comprises a computer controlling the means (3 to 8) for projecting said images as well as said sound diffusion means (23 to 27) according to said geolocation and acquisition means of the spatial orientation of the visual field of each spectator (31 to 33).

Description

MULTIMEDIA, MULTI-USER AND MULTI-SENSORY IMMERSIVE VOLUME.

Field of the invention

The present invention relates to the field of immersive virtual environments (virtual reality, virtual creations, virtual art, augmented reality, virtual games, ...), in a space where the projectors are directed between three and six of the walls of a cube the size of a room.

This technique is known by the acronym Cave (from the English “Cave Automatic Virtual Environment”), also called 3D immersive cube. It combines high resolution stereoscopic projection and 3D computer graphics to create a complete immersive experience of a given virtual environment. The term "3D" includes images calculated in 3D in real time or pre-calculated, viewed with or without glasses.

The immersive cube allows several users to immerse themselves completely in the same virtual environment and at the same time on one or more faces. Most immersive cubes have four faces (three side faces and one face on the ground) and the most advanced have six. The projection is carried out in monoscopy or in stereoscopy (passive or active).

The sound is broadcast by multichannel equipment, type 2.1, 5.1, 7.1 ... and generally in a.b.

The immersive cube allows users to:

Feel the 3D model floating in space, while seeing his hands and other people

Analyze the data of a given space

Navigate in life-size environments

Focus on data with a complete display, software, IT and support solution

It usually includes the following means: Rear projection on all faces of the immersive cube Rear projection on the ground face

Motion sensors on different sides

A video

In order to be able to visualize a 3D model in an immersive cube, the user needs 3D glasses which make it possible to display an image in 3 dimensions using a stereoscopic process. The 3D effect is rendered by the display of two images - one for each eye - allowing the brain to visualize the depth of objects. The tracking system allows you to record and follow the movements of the person inside the immersive cube, and to display the images according to the point of view of the user. It can be provided by different means of communication: glove, tablet, voice recognition, position, ...

State of the art

We know in the prior art American patents US 8624924 and US 8615383 describing a collaborative visualization system which integrates motion capture and virtual reality, as well as kinematics and computer-aided design (CAD), for example for virtual learning of a task. A portable motion capture system tracks the movements of one or more trainers and records whole body motion capture data for one or more trainers performing one or more tasks. A virtual reality simulator receives the recorded motion capture data and animates scaled avatars in a three-dimensional virtual reality simulation in response to recorded motion capture data. An immersive observation system displays the virtual reality simulation, including animated avatars, in the form of a three-dimensional image which surrounds one or more trainees using one or more head-mounted displays so that the trainee (s) can analyze the task (s) performed.

Also known is American patent US 9298008 which relates to a method of preparing images for projection on an immersive cube, consisting in extracting an image from a point located in a scene and presenting it on a plurality of displays covering entirely the view of a user, the image covering the entire areas of the plurality of displays. This method provides: a first step of receiving a signal indicating a request to capture the image of the scene - a second step of extracting the image from the point of the image of the scene - a third step of dividing the image in a number of zones equal to the number of displays in which each zone is defined by the projection of the delimitation lines of one of the displays on the image from the point of view of the user - a fourth step consisting in presenting each zone of the image on a corresponding display in which the zone of the image is reformed to adapt within the limits of the corresponding display.

European patent EP2633500 describes another example of making three-dimensional virtual tours from two-dimensional images.

The images projected on a set of screens forming an IMMERSIVE CUBE are generated from ordinary two-dimensional (2D) still images such as photographs. Two or more 2D images are combined to form a 3D scene, which defines a relationship between 2D images in 3D space. 3D tubes connect 2D images to each other according to defined spatial relationships and to guide the movement of the virtual camera from one image to the next. A user can then take a 3D virtual tour by crossing the images inside the 3D scene, for example, by moving from one image to another, either in response to a request from the user or automatically . In various embodiments, some or all of the 2D images can be selectively distorted to enhance the 3D effect, thereby enhancing the impression that the user is moving inside a 3D space. Transitions from one image to the next can occur automatically without requiring explicit user interaction.

Also known from US Pat. 'location of a given participant the following steps: - capture video images of the participant using a pair of video cameras; detecting, monitoring and determining parameters relating to the size and position of the participant in the video images; - generate a single elementary video stream relating to the participant, based on the captured video images; associate a room identifier with the elementary video stream, the room identifier being associated only with the given participant; - send the elementary video stream, the parameters relating to size and position and the room identifier to a centralized entity; repeat the above steps for each participant in a different location; the method further comprising at the level of the centralized entity the following steps: - creating a virtual room by combining the elementary video streams for all the participants; - stage the elementary video streams of all the participants in said virtual room and calculate a scene specification associated with the room identifier of each participant on the basis of the parameters relating to the size and the position of all the participants; and - generate, for each participant, a unique composite video stream of the virtual room which displays the 2D video of the other participants sized and positioned as if the participants were in the same virtual room on the basis of the scene specification and a combination of basic video streams from other participants.

Finally, American patent US8955258 describes an example of a transportable room comprising a main body defining a closed interior chamber. The roof, the long sides and the ends can be defined by a plurality of inflated tubes, and the long sides of the primary body can have a substantially vertical orientation with respect to a surface on which the theater can be supported by at least the major part. the height of the respective long sides. The theater also includes a support section, a display screen positioned inside the primary theater body and visible to an observer seated in the support section, and a projection system inside the body. primary theater and in communication with the screen.

Disadvantages of the prior art

The solutions of the prior art have the drawback of offering a unique and common virtual representation to all the spectators present in the immersive cube. They do not allow to personalize, in the same immersive volume, the sensory atmospheres perceived by different spectators.

Solution provided by the invention

In order to remedy this drawback, the invention relates, in its most general sense, to an immersive viewing system constituted by at least one main body defining a closed interior chamber, having side, top and bottom walls forming projection surfaces of images to form a virtual three-dimensional representation, as well as multichannel sound broadcasting means, the system further comprising means of geolocation of the spectators present in said interior chamber as well as acquisition of the spatial orientation of their visual field, characterized in what it includes a computer controlling the means for projecting said images as well as said multichannel sound diffusion means as a function of said means of geolocation and acquisition of the spatial orientation of the visual field of each spectator.

By “image projection surface” is meant any surface allowing an image to be viewed by any projection means as well as an image viewing surface formed by a screen such as an LED screen, an image wall consisting of an assembly of several screens or any other equivalent means for viewing images as well as stereoscopic images.

The spectator's perceptions include atmospheric pressure, sensory means of resistance, etc.

Projections are made for one point of view or for several points of view.

The broadcasting is carried out on demand (“content on demand”, “Video on demand” broadcasting) or live streaming.

According to a variant, the system according to the invention comprises a plurality of interconnected immersive bodies as well as means of communication between the computers controlling the means of projection and sound diffusion of each of said interconnected immersive bodies which communicate with each other.

According to a variant, the system further comprises means for varying temperature, humidity, generating vibrations, movement of the immersive body and / or diffusion of odor controlled by said computer.

According to another variant, the system comprises means for mixing the audio and video elements broadcast: • Multilingual broadcasting in relation to the geographic areas of the cube • Broadcasting of several contents in relation to the visual areas • Diffusion of several contents in addition with or without transparent layers (like alpha channels) and with or without overlay by mixing calculated image and real time.

Detailed description of a nonlimiting example of the invention

The present invention will be better understood on reading the detailed description of a nonlimiting example of the invention which follows, referring to the accompanying drawings in which: - Figure 1 shows a schematic view of an immersive volume according to the invention - Figure 2 shows a schematic view of the components fitted to such an immersive room.

Immersive volume structure

The immersive volume according to the invention consists of a hemispherical chamber in the example described defining a closed and opaque volume to mask the external environment. The shape of this chamber is not limited to a hemispherical configuration, it can have a polygonal or circular section, and more generally delimit any volume having walls allowing the viewing of images and the movement of people inside the volume.

In the example described, the structure has a door (2) for user access. The chamber can be produced by a canvas stretched over a rigid superstructure or by a fixed installation.

Equipment for immersive volume The invention provides a plurality of equipment for communicating multimedia resources to users: • Projectors (3 to 6) oriented in 4 complementary directions, towards the projection walls (13 to 16) of the room

(D • Sound diffusers (23 to 27) for multichannel broadcasting of n.m type sounds • Projectors (7, 8) oriented in vertical directions for projecting images on the floor and ceiling of the room.

The users (31 to 33) move freely inside the room. The room is equipped with a geolocation sensor for users (31 to 33) to control the various equipment according to the position and movements of the users.

Claims (3)

claims 1 - Immersive visualization system constituted by at least one main body (1) defining a closed interior chamber, having lateral, upper and lower walls forming surfaces for projecting images to form a virtual three-dimensional representation, as well as means for multichannel sound broadcasting (23 to 27), the system further comprising means for geolocation of the spectators present in said interior chamber (1) as well as for acquisition of the spatial orientation of their visual field, characterized in that it comprises a computer controlling the means (3 to 8) of projecting said images as well as said sound broadcasting means (23 to 27) as a function of said geolocation means and of acquiring the spatial orientation of the visual field of each spectator (31 to 33). 2 - Immersive display system according to claim 1 characterized in that it comprises a plurality of interconnected immersive bodies as well as means of communication between the computers controlling the means of projection and sound diffusion of each of said interconnected immersive bodies which communicate between them. 3 - Immersive display system according to claim 1 characterized in that it further comprises means for temperature variation, humidity, generation of vibrations, movement of the immersive body and / or diffusion of controlled odor (s) by said computer.