WO2016207557A1

WO2016207557A1 - Augmented reality device for live performances

Info

Publication number: WO2016207557A1
Application number: PCT/FR2016/051544
Authority: WO
Inventors: Christophe FOURNIER; Steve Peguet
Original assignee: Atos Se
Priority date: 2015-06-25
Filing date: 2016-06-23
Publication date: 2016-12-29
Also published as: FR3038073A1; FR3038073B1; EP3262843A1

Abstract

The invention relates to an augmented reality device (L) including a screen (E) able to display information so that the user of said device can both read said information and see, through said device, a performance taking place a distance away, said device furthermore including a telecommunication module (M) allowing synchronisation signals (idx) to be received, and means (A1) for displaying on said screen an extract from a text and corresponding to said synchronisation signal.

Description

INCREASED VISION DEVICE

FOR THE LIVE SHOW

FIELD OF THE INVENTION

The invention relates to an augmented reality vision device, particularly in the form of a pair of glasses, for displaying a predetermined text in association with a live show. This predetermined text may in particular be a translation into another language of the text said during the live performance.

BACKGROUND OF THE INVENTION

Augmented vision is a new technological field to offer a user additional information to the "natural" vision of his environment. A possible device for augmented vision may be a pair of glasses having a screen for displaying information. This information can be seen by the user at the same time as the reality through the device, so that reality and information are superimposed, the latter "enriching" the reality.

An example of a product using these mechanisms is the Google Glass product from Google.

However, the existing devices are not adapted to the constraints of live performance, and do not allow the display in real time of predetermined texts in connection with the show.

In particular, there is no solution based on augmented vision, allowing to display in real time a translation of a text said (or sung) on stage in the language of a particular viewer. SUMMARY OF THE INVENTION

The object of the present invention is to provide a device and a method at least partially overcoming the aforementioned drawbacks.

More particularly, the invention aims to provide a device for providing a text, including a translation, synchronized in real time with the text said on stage, under the particular conditions of a live performance. To this end, the present invention provides an augmented vision device, comprising a screen adapted to the display of information so that the user of said device can both read said information and see a distant show through said device, and further comprising a telecommunication module for receiving synchronization signals and means for displaying on said screen an extract of a text corresponding to said synchronization signal.

According to preferred embodiments, the invention comprises one or more of the following features which can be used separately or in partial combination with one another or in total combination with one another:

The augmented vision device has the shape of a pair of glasses;

said synchronization signals comprise an index identifying an extract within said text;

said text is available in several versions and said device further comprises means for selecting a version of said text. Another aspect of the invention relates to a system comprising a set of augmented vision devices as previously described and a control terminal adapted to the transmission of synchronization signals to said augmented vision devices through a communication network.

According to preferred embodiments, the system according to the invention comprises one or more of the following characteristics which can be used separately or in partial combination with one another or in total combination with one another:

said synchronization signals are triggered by an action of a user of said control terminal;

said control terminal has means for indicating display parameters of said extracts via said synchronization signals;

said augmented vision device has means for determining local parameters;

Another aspect of the invention relates to a live performance management method, the method comprising steps consisting in:

triggering a synchronization signal by a control terminal to a set of augmented vision devices; displaying on a screen of said devices an extract of a text, corresponding to said synchronization signal, the display being performed by said device so that the user can both read said extract and see said live show through said device,

According to preferred embodiments, the method according to the invention comprises a step according to which a user of said control terminal triggers said synchronization signal by an action via the human-machine interface of said terminal. Other features and advantages of the invention will appear on reading the following description of a preferred embodiment of the invention, given by way of example and with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 schematically represents an example of a system according to one embodiment of the invention.

FIG. 2 schematically represents an example of an augmented vision device according to one embodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

The invention is particularly adapted to the field of live performance, although it can also be used in other contexts. Live shows include theater, opera, operetta, musical comedy and other artistic forms in which actors perform in front of an audience. The invention applies in particular to forms of live shows with text said or sung. It may relate to dance or dance-theater performances in so far as these may include textual parts.

A live show has the essential characteristic of being subject to the game of artists, the vagaries of the context of the show, etc. Also, even if the show is based on a predetermined text and a precise staging, different incidents can occur:

- the rhythm of the artists' play varies from one performance to another;

- an actor can forget a replica or interchange two - there can be interruptions of show due to external elements, etc. The invention makes it possible to take into account these specificities of the live performance by means of an augmented vision device. This device may preferentially be in the form of a pair of glasses that the viewer can put in order to have access to additional information about the show.

This additional information may in particular be a translation of the text said or sung on stage. It can be provided several languages of translation and the viewer can then choose his language of preference.

Thus, the invention allows facilitated access to foreign shows offered on a given linguistic territory. In addition, it also facilitates access to a work in a given language broadcast worldwide, such as opera works for example. FIG. 1 illustrates a system according to one embodiment of the invention, comprising a set of augmented vision devices Ll, L2 ... Ln, a control terminal T, and a communication network N.

The number of augmented vision devices can vary from n = 1 to several hundred, especially depending on the size of the theater.

As schematically illustrated in FIG. 2, the augmented vision devices L are equipped with a telecommunication module M, adapted to receive idx synchronization signals. These telecommunication modules can typically be radio interfaces compliant with a WIFI standard, but other technologies can be envisaged as well.

In this way, the augmented vision devices L1, L2... Ln are connected to a control terminal T and can receive the idx synchronization signals from it.

The augmented vision devices further include a screen E adapted to display information so that the user of the device can both read this information and see a distant show through the device. In the implementation of Figure 2, the device has the shape of a pair of glasses. A screen is arranged at one of the two eyes. This screen is typically transparent or quasi-transparent, and operating according to LED technology. The focus on the screen E can be made so that the viewer accommodating his eye to see the distant show will also see the text displayed on the screen E.

The augmented vision devices also comprise means for processing the synchronization signals received and control the display on the screen E according to these signals and a previously provided text.

To do this, they may comprise processing means and an Al software application operating on these processing means. Typically, this application Al can be an application running on an Android® platform deployed on these processing means.

The text may be provided by downloading from a remote platform or from the control terminal T. It may also be provided by temporarily connecting the augmented vision device to the control terminal T or to another device, for example by means of a USB connection.

According to one embodiment, the text can be provided in several versions. These versions can for example correspond to different languages.

This text (in its possibly several versions) can be stored in a memory contained in the augmented vision device. In one embodiment of the invention, the text is cut into extracts, each extract being intended to be displayed on the screen E, and therefore has an appropriate size. Typically, an excerpt can be a tirade of a play, an opera, a musical, etc. Each extract can be associated with an index, which can be a simple serial number.

The following table gives a simple example of storage in the memory of an augmented vision device according to one embodiment of the invention: 1 Tirade 1

2 Tirade 2

3 Tirade 3

The application Al is intended to display on the screen an extract corresponding to the synchronization signal. According to one embodiment, the synchronization signal comprises an index identifying an extract of the text. This index can thus correspond to an entry in the table below. Thus, if the index received is the number i, the number i tirade will be displayed on the screen E.

The augmented vision devices may have configuration means accessible to viewers. Thus, a viewer can adjust various local parameters (ie, specific to his augmented vision device), such as the size of the characters displayed on the screen E, the color, the light intensity, and so on.

In the case where the same text is available in several versions, for example in several languages, it may include means for selecting a version of this text. Thus, the viewer can choose himself the language in which he wants to see the translation of the show. It can possibly change language during the show.

Since only a very short synchronization signal is transmitted to the augmented vision devices, the latter can immediately react with a minimum of computer processing to display the text extract pointed by the synchronization signal (for example, the index in a text structured in a table as illustrated above). It is thus possible to have a display following as closely as possible the progress of the show. In addition, this synchronized display system is independent of the text version (and thus, for example, of the language). Thus, each spectator is treated fairly regardless of the language chosen.

In addition, as a minimum of information is transmitted between the control terminal T and the various augmented vision devices, even if the number of equipped viewers is important, the communication network N is not congested by the exchanges of information that is minimal. Another advantage of the invention is that the display is adaptable to each viewer, and can thus take into account the specificity of his vision, allowing him to choose the size, color, brightness, etc. of the display, as well as the language in which the text is to be displayed. This is a considerable advantage over surtitling techniques usually used in a theater.

In addition, regardless of the distance of the viewer from the scene over which the surtitling screens are usually placed, the invention allows the same quality of access to the text. The control terminal T may be unique to manage a show and manipulated by a stage manager during the show. It can be a laptop, a computer, a tablet. This terminal T may comprise an application A2, for example operating on an Android® system, and means of communication with the augmented vision devices Ll, L2 ... Ln., Through the network N. It may for example s' act as a radio interface compliant with a WIFI standard.

It can be provided that the different synchronization signals corresponding to all the extracts of the text are automatically transmitted to the augmented vision devices. However, preferably, the synchronization signals are triggered by an action of the controller, via the human-machine interface of the control terminal. For example, this control terminal T may present on a screen part of the extracts corresponding to a time window around a current time. Each snippet can be associated with an index, which may or may not be displayed.

The controller can select a particular extract, and the application A2 is provided to detect this selection and transmit to all the augmented vision devices, a synchronization signal corresponding to the selected extract, i.e., for example, containing the index of the selected extract.

Thus, the stage manager can follow the progress of the show and choose at any moment the excerpt corresponding to what is said, sings or is done on the stage. It can thus adapt to the conditions of live performance.

Thus, dynamically and real-time, each viewer receives the relevant text extract, in the version he has chosen.

According to one embodiment of the invention, the control terminal T furthermore has means for indicating display parameters of the extracts on the screen E of the augmented vision devices Ll, L2, Ln. These indications can be made via the synchronization signals.

They can relate to the color of the extracts to display for example.

Indeed, the stage manager has information on the lighting of the stage, the backgrounds etc. and is best able to decide on a color for a suitable display. The color may include the color of the characters.

The color can also be defined by the controller according to the character assigned to the extract: thus, each role, for example, can be assigned a color for its replicas, in order to improve the intelligibility of the text, especially when replicas are used. 'chained quickly. However, it can be expected that each spectator can force or impose his own choice of color to that indicated by the director. This may be interesting for example if the viewer has visual deficiencies (color blindness ...)

Other display parameters are of course configurable by the controller via the control terminal T.

It can also be expected to indicate a duration for a text extract. The flow of this duration can trigger the deletion of the extract on the devices Ll, L2 ... Ln. According to one embodiment of the invention, the extracts can be linked automatically according to this duration.

The controller may also require the display of a black screen on all devices. This display allows you to remove the subtitle on periods of silence, music, etc., more generally on periods when no replica is pronounced (or on periods of improvisation in the game of actors for which no sub -title is not planned).

Of course, the present invention is not limited to the examples and to the embodiment described and shown, but it is capable of numerous variants accessible to those skilled in the art.

Claims

An augmented vision device (L), comprising a screen (E) adapted to display information so that the user of said device can both read said information and see a remote show through said device, and further comprising a telecommunication module (M) for receiving synchronization signals (idx) and means (A1) for displaying on said screen an extract corresponding to said synchronization signal, a text stored in a memory (M) contained in said device.

2. Augmented vision device according to the preceding claim, having the shape of a pair of glasses.

3. Augmented vision device according to one of the preceding claims, wherein said synchronization signals comprise an index identifying an extract within said text.

4. Augmented vision device according to one of the preceding claims, wherein said text is available in several versions and said device further comprises means for selecting a version of said text.

5. System comprising a set of augmented vision devices (Ll, L2 ..., Ln) according to one of the preceding claims, and a control terminal (T) adapted to the transmission of synchronization signals to said devices of increased vision through a communication network (N).

6. System according to the preceding claim, wherein said synchronization signals are triggered by an action of a user of said control terminal.

7. System according to one of claims 5 and 6, wherein said control terminal has means for indicating display parameters of said extracts via said synchronization signals.

8. System according to one of claims 5 to 7, wherein said augmented vision device has means for determining local parameters.

9. A method of managing a live performance, the method comprising steps consisting in:

triggering a synchronization signal by a control terminal to a set of augmented vision devices; displaying on a screen of said devices an extract corresponding to said synchronization signal of a text stored in a memory (M) contained in said device, the display being performed by said device so that the user can at once reading said extract and seeing said live show through said device,

10. Control method according to the preceding claim, wherein a user of said control terminal triggers said synchronization signal by an action via the human-machine interface of said terminal.