DE102012000745A1 - Playback device for sound and picture - Google Patents

Abstract

The invention relates to a reproducing device for sound and images. This reproduction device comprises an image reproduction device for the simultaneous reproduction of a plurality of at least two different images, which are each visible from at least one of different laterally offset viewing zones (23), as well as a sound reproduction device with a plurality of at least two loudspeakers for directed sound generation and a control unit ( 28) for controlling the image reproduction device as a function of image information (30) of the various images and for controlling the sound reproduction device as a function of at least two different audio channels. The control unit (28) is set up to enter input commands that independently define an individual image content from various possible image content and an individual audio channel from the various audio channels for at least two different viewers (25, 26, 27), and to control the image reproduction device and the sound reproduction device in response to these input commands.

Description

The present invention relates to a sound and image reproducing apparatus comprising an image reproducing apparatus for simultaneously reproducing a plurality of at least two different images, each of which is visible from at least one of different laterally offset viewing zones, and a control unit for driving the image reproducing apparatus in response to image information of the various ones Images includes.

Such playback devices are known as autostereoscopic screens per se. In a conventional manner, such screens are operated by reproducing one of a plurality of pairwise complementary stereoscopic fields in such a way that each of these fields is visible from one of the viewing zones. Although the reproduced images can also be seen by several viewers at the same time, neither in the selection of displayed image content nor in the type of playback on individual wishes of the various observers can be considered.

The invention is therefore based on the object to propose a corresponding playback device, with the different viewers images can be displayed simultaneously, the viewer the content played - defined z. B. by different television programs or video channels - in an appropriate manner individually entpsrechend each own wishes to be able to select.

This object is achieved by a method having the features of the main claim. Advantageous embodiments and further developments of the invention will become apparent with the features of the dependent claims.

• – zum Eingeben von Eingabebefehlen, die für mindestens zwei verschiedene Betrachter unabhängig jeweils einen individuellen Bildinhalt von verschiedenen möglichen Bildinhalten und einen individuellen Tonkanal aus den verschiedenen Tonkanälen definieren,
• – und zum Ansteuern der Bildwiedergabevorrichtung und der Tonwiedergabevorrichtung in Abhängigkeit von diesen Eingabebefehlen derart,

dass jeder der ausgewählten Bildinhalte aus mindestens einer der Betrachtungszonen sichtbar ist, die dem Betrachter zugeordnet ist, für den dieser Bildinhalt ausgewählt ist, und aus mindestens einer weiteren Betrachtungszone, die dem oder den jeweils anderen Betrachtern zugeordnet ist, nicht sichtbar ist,
und dass jeder der ausgewählten Tonkanäle durch jeweils mindestens einen Lautsprecher wiedergegeben wird, der dem Betrachter zugeordnet ist, für den dieser Tonkanal ausgewählt ist, wobei dieser Lautsprecher keinen Tonkanal wiedergibt, der nicht für diesen Betrachter ausgewählt ist,
wobei die Lautsprecher so angeordnet sind, dass jeder der Lautsprecher auf einen Bereich gerichtet ist, der die Betrachtungszone oder mindestens eine der Betrachtungszonen umfasst, die dem Betrachter zugeordnet sind, dem dieser Lautsprecher zugeordnet ist.So proposed is a playback device for sound and image, comprising
an image display device for simultaneously displaying a plurality of at least two different images, each of which is visible from at least one of different laterally offset viewing zones,
and a sound reproducing apparatus having a plurality of at least two loudspeakers for directional sound generation and
a control unit for driving the image reproduction apparatus in response to image information of the various images and for driving the sound reproduction apparatus in response to at least two different sound channels;
wherein the control unit is set up

• For inputting input commands which independently define at least two different viewers each an individual picture content of different possible picture contents and an individual sound channel from the different sound channels,
• And for driving the image reproduction device and the sound reproduction device in response to these input commands in such a way,

each of the selected image contents is visible from at least one of the viewing zones associated with the viewer for whom that image content is selected and is not visible from at least one other viewing zone associated with the other viewer (s);
and that each of the selected audio channels is played by at least one loudspeaker associated with the viewer for whom that audio channel is selected, said loudspeaker not reproducing a sound channel not selected for that viewer,
wherein the loudspeakers are arranged such that each of the loudspeakers is directed to an area comprising the viewing zone or at least one of the viewing zones associated with the viewer to whom this loudspeaker is associated.

This advantageously makes it possible for the various viewers to be able to select not only individual picture contents but also matching individual tones. It is because of the directional speakers not necessary that the viewer wearing headphones to avoid interference with other audio channels that may be selected for other viewers. This brings high comfort for the viewer as a user of the playback device with it.

It is advantageous if the playback device further comprises a tracking device for detecting one head position or two eye positions of the at least two viewers of the image display device, wherein the control unit is then configured to drive the image display device and the sound reproduction device such that the viewing zones associated with each viewer the eye positions contain this viewer. Then, the display device can be adapted to a current placement of the viewer, with a movement of the viewer can be compensated or tracked in an advantageous manner. In this case, it is of course advantageous if a main emission of the speaker is adjustable, z. B. by pivoting the speaker.

The speakers can be given in particular by ultrasonic speakers, the are arranged to radiate serving as a carrier ultrasound with thereon modulated audio signals representing the respective audio channel. Such ultrasonic speakers are z. B. in the dissertation of Dirk Olszewski "Strongly Directed Audio Sonication with Parametric Ultrasonic Loudspeaker", University of Paderborn, EIM-E / 237, the contents of which are incorporated herein by reference. in particular Figure 3.10 from the mentioned dissertation. With the z. B. from the local description known per se ultrasound speakers is a sufficiently well-directed generation of sound is possible to realize the sound described here of the different observers with spatially local, the viewing zones superimposed and following them individual audio channels.

In the image display device, it may, for. B. act on an autostereoscopic screen. A typical structure is that the screen has a matrix screen with a plurality of pixels arranged in columns and rows, as well as a grid arranged in front of the matrix screen with a structure oriented parallel to the columns in order to diffuse light emanating from the pixels of the matrix screen into the different ones To steer viewing zones.

In a particularly advantageous embodiment, the control unit is also arranged for inputting input commands, which in each case independently define at least two different viewers each one of different possible picture contents and one of various selectable display modes, the selectable display modes comprising a mono picture mode and an individual stereo picture mode. In addition, the control unit is arranged to drive the screen in response to these input commands and eye positions detected by the tracking device by defining various disjoint portions of columns of the matrix screen and displaying at least one of different images on each of the separations, in such a manner in that each of the detected eye positions of each observer is associated with one of the excerpts comprising at least all of the columns of the matrix screen visible from said eye position through the grid. In this case, the control unit is set up to control the pixels of this extract such that the at least one image reproduced on this extract shows the image content defined for that viewer, with the same eye detail assigned to the two eye positions of each viewer for whom the mono image mode is selected as the reproduction mode and the image reproduced thereon is a monaural image, while the two eye positions of each observer for which the individual stereo image mode is selected as the reproduction mode are assigned two different separations and two complementary stereoscopic fields are reproduced on these excerpts.

As a result, two things are achieved in an advantageous manner. First, different viewers, the different image content -. B. different TV channels or video channels or video games defined image content - want to show - at the same time use the same screen and especially in the same room, so are not dependent on using different devices. Secondly, the individually selectable for each viewer playback mode can be avoided that while one of the viewer is forced to deal with a less rich presentation -. B. mono instead of stereo - or a more unpleasant for him presentation - z. B. stereo instead of mono - satisfied. In particular, individual viewing habits can be taken into account. In this case, the individual wishes can be realized in an advantageously simple manner by means of corresponding input commands.

It can be provided that the control unit for inputting the input commands comprises one or more operating devices separate from a central processing unit of the control unit, which can be connected to the central processing unit via cable connections or by means of wireless data transmission. In the case of several operating devices, each of the observers can thus advantageously input the input commands relating to them to an operating device assigned to them alone.

The pixels of the matrix screen will typically be subpixels of three different primary colors that complement one another. In this case, various arrangements are conceivable, wherein the primary colors of course alternately in each column from top to bottom and typically also in each row alternate from left to right in cyclic order.

Typically, the various separations are formed by different adjacent columns of the matrix screen, which accordingly can be addressed simultaneously. However, the possibility of a screen in which the extracts are driven in a time-sequential manner and each formed by the same pixels at different times while the raster is temporally variable should not be explicitly excluded. An excerpt is then defined not only by the pixels contained therein, but also by the position or the state of the grid. Such a screen is z. B. in the document WO 2009/001161 A1 shown. Also, the matrix screen used can be a color sequential Provide representation in which image components of different primary colors are generated one after the other and made visible on the same pixel positions. These can z. B. micromechanical elements with a color sequential backlight - that is a color changing illumination - combined.

In an advantageous embodiment, the selectable playback modes further comprise a multiview stereo image mode, wherein the control unit is then configured to control the screen so that the two eye positions of each viewer for which the multiview stereo image mode is selected as the playback mode by a corresponding input command An extract is assigned to and on different subsets of columns of this excerpt each a stereoscopic field from a family of complementary stereoscopic fields is reproduced. Of course, if multiple viewers choose the same image content and this multiview stereo image mode, the separation may also be chosen to be large enough to include all columns visible from at least one of the eye positions of any one of those viewers. For these viewers, the screen then works as a conventional multiview display.

In this case, the control unit may include a renderer configured to calculate drive data for the matrix screen required to display the set of stereoscopic fields from image information to the image content defined by the input commands to the viewer for which the multiview stereo image mode is Playback mode is selected. This can be provided in particular if the image content is defined by a video game.

In order for the observers to be able to move within the widest possible limits without having to accept losses in the image quality or to completely lose sight of the respective image, the tracking device is preferably set up to detect a movement of the eye positions while the control unit is then set up is to redefine the excerpts depending on the detected movement. For this purpose, the tracking device can be realized in particular by a stereo camera with a corresponding image analysis.

It is particularly useful if the control unit is set up to accept the input commands for the at least two viewers successively as registrations of the viewer. In addition, the control unit may have an output unit in order to be able to display information about the available image contents and / or about the reproduction modes that can be selected for the respective image content and / or whether a last input command can be executed. This output unit can, for. B. be given by a display. In this case, the control unit can be set up by appropriate programming in particular to determine depending on already entered input commands and the detected eye positions and display on the output unit whether another viewer can be registered and / or if or how a placement already registered viewer is to be changed so that another viewer can be registered or a last input command can be executed.

In a further development, it is also conceivable that the playback device -. B. by an image analysis with the tracking device recorded images - the viewer can recognize and automatically recognizes a setting (eg, a playback mode), which is preset for this viewer when recognizing a viewer. Also, the control unit may be configured to correct an image depth displayed to a viewer in accordance with a specification of this viewer.

Finally, parts of the matrix screen not occupied by the abovementioned excerpts can be filled with suitable image content in order to also enable bystanders to be able to follow at least one or the other image content.

The various separations will each form a flock of stripes comprising one or more columns on the matrix screen, with the stripes belonging to the various separations typically alternating in cyclic order. Again, if an extract is divided into different subsets or subgroups of columns to realize the multiview stereo mode in the manner previously described, then the subsets or subsets typically consist of one column in each of the strips associated with that statement.

In order to reduce the crosstalk of the various audio channels, which may not be excluded from the outset despite the use of speakers described type as far as possible, the following measure can additionally be taken. For at least one of the observers, the reproducing apparatus may include a sound receiver for detecting crosstalk between the sound channel selected for that viewer and at least one other of the sound channels. The control unit can then be set up to control the loudspeaker associated with this viewer as a function of an output signal of the sound receiver so that these loudspeakers additionally suppress the crosstalk that is at least partially extinguished Create sound component. To this end, this sound component can be defined and generated in such a way that it destructively interferes with the unwanted portion of the sound arriving at said viewer, which is due to one or more other sound channels.

An embodiment of the invention will be described below with reference to the 1 to 5 explained. It shows

1 a schematic view of a playback device for sound and image, with the same image information for three different viewers are shown,

2 a block diagram showing the operation of a control unit of the playback device 1 illustrates

3 a flow diagram illustrating a function of an interactive control unit of the control unit of the playback device,

4 a flowchart with a process sequence for suppressing crosstalk between different audio channels and

5 schematically the operation of a speaker used in the playback device.

In 1 Thus, there is shown an image display apparatus which is implemented as a sound and image reproducing apparatus and realized by using an autostereoscopic screen. This screen has a matrix screen 21 with a plurality of pixels arranged in rows and columns and one in front of the matrix screen 21 arranged grid 22 which is suitable from the pixels of the matrix screen 21 outgoing light respectively into different ones of a plurality of laterally offset viewing zones 23 to steer. These viewing zones 23 are numbered here and correspond to twenty image channels 1 to 20 Of the screen. The grid 22 can also be referred to as a beam splitter grid or barrier grid. Of course, with a finer subdivision of the matrix screen, a much larger number of possible image channels can also be provided.

At the matrix screen 21 it is a liquid crystal screen. At the pixels of this matrix screen 21 These are subpixels of three different primary colors, with red, green and blue subpixels alternating in cyclical order in each row and in each column. Instead, z. As an OLED display can be used. Everyone on the matrix screen 21 reproduced pixel is formed by a pixel group or a cluster of multiple subpixels and extends over three lines, so that regardless of a width of the pixel or the pixel group or the cluster, any desired color can be reproduced color-fast. In a modified embodiment, the matrix screen 21 instead be given by a color sequentially working screen. Then, each pixel does not have to span more than one line at a time. Rather, the pixels can then be realized in each case by a single pixel, which reproduces different primary colors in cyclical order.

The grid 22 can z. B. be designed as a slot grid or as a cylindrical lens grid, wherein slots or cylindrical lenses of the grid 22 - Assuming a corresponding arrangement of the columns - can be oriented vertically or inclined by about 20 degrees from a vertical out. In any case, a structure of the grid 22 oriented parallel to the columns. The columns of the matrix screen 21 In the present context, therefore, not necessarily understood as extending perpendicular to the horizontal lines columns of subpixels, but as parallel to the above structure - ie z. B. parallel to the slots or the cylindrical lenses of the grid 22 - running juxtapositions of subpixels, even if they include an angle other than 90 ° with the lines.

In addition to the actual autostereoscopic screen with the matrix screen 21 and the grid 22 the image display device has a tracking device 24 for detecting two eye positions of a first observer in the present case 25 , a second viewer 26 and a third viewer 27 Of the screen. This tracking device 24 is realized by a stereo camera with two lenses, which is set up for an automatic image analysis. It is irrelevant whether the image analysis allows the eye positions to be recognized directly or whether initially only head positions are detected and the eye positions are determined as a function of the head positions on the basis of a typical eye distance of about 65 mm.

Finally, the image display device has a control unit 28 on top of a data processing system 29 includes and programmatically for driving the matrix screen 21 is set up. This can be done by the control unit 28 the pixels of the matrix screen 21 depending on image information 30 control various images, in particular depending on image information of different stereoscopic fields. The picture information 30 can be read from a data store be B. from a DVD or other media. Audio data for the different audio channels can then also be stored in this data memory. Alternatively, the picture information 30 and the audio information is also output from a TV receiver or a game console for video games.

In an operating mode that is not the focus of interest in the present case, the screen may be operated as a conventional multi-view screen by clicking on the pixels of the matrix screen 21 reproduced in cyclic order image information from twenty mutually complementary stereoscopic fields, so that from each of the laterally offset viewing zones 23 one of these stereoscopic fields is visible. In a plane 31 , which is a nominal viewing distance d from the matrix screen 21 is removed and in the viewing zones 23 have a maximum width (typically a width of about an average eye relief of 65 mm or slightly less), then several people can simultaneously autostereoscopic stereo images of the same scene perceive.

Here, another method for reproducing images with the image display apparatus will be described. For its implementation, the control unit 28 except the data processing system 29 also an operating device 32 to input input commands to the viewer 25 . 26 and 27 as well as under certain circumstances independently of one another for each viewer, one of different image contents and one of various possible reproduction modes and - typically to match the respective image content - define one of different audio channels. Of course, in addition to the control unit 32 corresponding further operating devices 32 ' be provided so that each of the viewer 25 . 26 . 27 the input commands affecting him on his own operating device 32 or 32 ' can enter. The following only for the control unit 32 The information given then applies accordingly also for the other operating devices 32 ' ,

Among these selectable playback modes, in particular, is a mono picture mode, an individual stereo picture mode, and a multiview stereo picture mode. The viewers can use the input commands 25 . 26 and 27 also choose an individually adjustable depth of a representation of their respective associated images. The operating device 32 can be via a wired connection or through a wireless data exchange with the data processing system 29 the control unit 28 be connected. The image content can each z. B. be defined by a TV channel, a video channel or a video game.

It is assumed that in a situation illustrated, the first viewer 25 the multiview stereo image mode, the second viewer 26 the individual stereo image mode and the third viewer 27 has selected the mono image mode and corresponding input commands to the HMI device 32 entered. In multiview stereo image mode, the matrix screen will display 21 depending on its construction, either a central perspective multiview display, a parallel perspective integral imaging representation, a modification derived therefrom, or a divergent rendering with intersection of corresponding image rays behind the matrix screen 21 played. These types of representation are for example in US 7671889 B2 described.

The control unit 28 is now programmatically set up, the matrix screen 21 not only depending on the image information 30 but also in response to these input commands and by the tracking device 24 to control detected eye positions in the manner described below.

First, different disjoint slices of columns of the matrix screen 21 defines such that each of the detected eye positions of each of the observers 25 . 26 and 27 one of the separations is associated, at least all of this eye position through the grid 22 visible columns of the matrix screen 21 includes. In this case, for each viewer for which the mono image mode is selected as the rendering mode, a single digest is defined that includes all columns that are visible from both eye positions of that viewer. In the present case this is for the third observer 27 the case. An image reproduced on this excerpt is from an area 33 Visible, in which both eye positions of the viewer 27 are located.

The two eye positions of each viewer for which the individual stereo image mode is selected as the playback mode, however, are assigned to two different extracts, ie an extract of a left eye position and an extract of a right eye position. This is true for the second viewer 26 to. An image rendered on the slide, the viewer's left eye position 26 is assigned, is from an area 34 visible while an image rendered on the other excerpt from an area 35 visible, which is opposite the area 34 laterally offset.

The two eye positions of each viewer for which the multiview stereo image mode is selected as the playback mode are again assigned a common separation. This applies here for the first viewer 25 , Like the other excerpts, this excerpt consists of a flock of strips, each of which has several columns, and which aligns with the strips of the other extracts from left to right across the matrix screen 21 alternate in cyclic order. The abstract, the eye positions of the viewer 25 is also divided into a plurality of five sub-groups in the present case, these sub-groups each containing exactly one column from each of the said strips of this extract. An image rendered on one of these subgroups will be exactly one of the five in 1 hatched drawn viewing zones 23 to see.

Each of the excerpts now reproduces at least one of different images, the pixels of each separation being controlled in such a way that the at least one image reproduced on this extract shows the image content which is for the viewer 25 . 26 , or 27 through the into the operating device 32 entered input commands is defined. Of course, the pictures will typically be moving pictures.

It is on the abstract, the eye positions of the third observer 27 is assigned exactly one image, namely a mono image, by the viewer 27 can be seen. The same applies to other observers, if this by an appropriate input to the control unit 32 select the mono picture mode.

On the two excerpts, the second viewer 26 are assigned, two mutually complementary stereoscopic fields are reproduced, so that from the field 34 a left and out of the area 35 a right field is visible and the viewer 26 see a stereo image to which these fields complement each other. The same applies to other observers, if this by an appropriate input to the control unit 32 select the individual stereo image mode.

On the abstract, the first viewer 25 or any other viewer who has selected the multiview stereo image mode, and for whom an appropriate input to the operator device 32 In the present case, a whole family of five fields complementary to one another is reproduced on each of the subgroups mentioned, so that the viewer 25 see a stereo image from a perspective that depends on where its eye positions are.

If the picture information 30 not all control data for the matrix screen 21 include for playing the stereoscopic fields for the viewer 25 can be required, this drive data also by rendering with the data processing system 29 calculated from a smaller amount of image data available for the corresponding image content.

The tracking device 24 Of course, it is also possible to detect a movement of the eye positions while the control unit is set up to redefine the excerpts in dependence on the detected movement.

In addition, the player now also has a control unit 28 controlled sound reproduction device 40 with in this case six speakers 41 . 42 . 43 . 44 . 45 and 46 on. With each of these speakers 41 to 46 it is a highly directional emitting ultrasonic speaker. Speakers of this kind are in the already mentioned dissertation of Dirk Olszewski "Strongly directed audio sound with parametric ultrasonic loudspeaker", University of Paderborn, EIM-E / 237 shown, s. there in particular Figure 3.10 , The speaker 41 to 46 are in particular adapted to aufzumodulieren a respective sound channel corresponding sound signal on serving as a carrier ultrasonic waves. Demodulation takes place with increasing distance from the speakers 41 to 46 as a result of a damping of the sound signal significantly increased attenuation of serving as a carrier ultrasonic waves. A propagation of the remaining due to constructive interference sound signal occurs only along a main emission of the respective speaker, whereby a strong directivity is achieved. This is exemplary for the speaker 41 schematically in 5 shown. The speaker 41 sends in with a sound signal 51 modulated ultrasonic signal 52 out. At a distance 53 from the speaker 41 is the ultrasonic signal 52 so strongly subdued that only the audible sound signal 51 remains. The distance 53 is, for example, a few meters. The demodulation thus takes place automatically in the air, in each case in an environment of the ears of the viewer 25 . 26 . 27 , but only if they are located in the main emission direction of the respective loudspeaker, because only there a constructive interference reconstructing the sound signal comes about.

Each of the viewer 25 . 26 and 27 are two of the speakers 41 to 46 assigned, namely the speakers 41 and 44 the first viewer 25 , the speaker 42 and 45 the second viewer 26 and the speakers 43 and 46 the third viewer 27 , The sound reproduction device 40 will now be dependent on the one for the viewer 25 . 26 and 27 selected audio channels, in such a way that the speakers 41 and 44 reproduce two stereo audio signals corresponding to the audio channel indicated by the input commands for the audio channel first viewer 25 is selected while the speakers 42 and 45 two stereo sound signals corresponding to that for the second viewer 26 selected sound channel and the speakers 43 and 46 two stereo sound signals corresponding to that for the third viewer 27 play selected sound channel.

The speaker 41 to 46 are so directed that each of the viewer 25 . 26 and 27 at least as well as exclusively the sound signals from the speakers assigned to it 41 and 44 respectively. 42 and 45 respectively. 43 and 46 can hear. The other audio channels are at least several orders of magnitude weaker audible, so they do not disturb.

The speaker 41 to 46 are - also controlled by the control unit 28 - be pivoted in response to the detected head or eye positions and are each set so that they are directed to the viewer to whom they are assigned.

The operating device 32 has except controls such as buttons in particular also an output unit 36 in the form of a display on which information about the available image content and about the playback modes that can be selected for the respective image content can be displayed. Besides, on the output unit 36 whether a last entered input command is executable. The input commands are typically successively for the different viewers 25 . 26 and 27 and possibly for other viewers as registrations of these viewers entered. The control unit 28 is also set up, depending on already made registrations and on the detected eye positions of the corresponding viewer 25 . 26 or 27 to determine and on the output unit 36 indicate if another viewer can be logged in (this could be ruled out if on the matrix screen 21 there is no space left for further excerpts) and, if so, whether and if so, how a placement of already registered viewers 25 . 26 or 27 or the viewer who still wants to log in, must be changed so that a further logon is possible or for a last input command can be executed.

This in 1 also shown for each of the viewer 25 . 26 and 26 one or more microphones each 61 . 62 respectively. 63 on, in the immediate vicinity of the respective viewer 25 . 26 respectively. 27 are arranged and serve as a sound receiver to detect the incoming sound there. Output signals of the microphones 61 . 62 . 63 be in a device 60 compared with the sound channels, thereby providing for each of the viewer 25 . 26 . 27 a crosstalk between that for this viewer 25 . 26 . 27 selected audio channel and at least one other of the audio channels is detected.

The data processing system 29 the control unit 28 is now configured to suit each of the viewer 25 . 26 . 27 the this viewer 25 . 26 . 27 assigned speakers 41 and 44 respectively. 42 and 45 respectively. 43 and 46 in response to output signals of the device 60 so drives that at least some of these speakers 41 . 42 . 43 . 44 . 45 . 46 additionally each generate a crosstalk at least partially extinguishing sound component. These sound components compensate for the crosstalk by dealing with the respective unwanted portion of the respective viewer 25 . 26 . 27 incoming sound due to the other audio channels will interfere destructively. The sound components mentioned can therefore be referred to as anti-sound. In a modification of the embodiment shown here, additional speakers for generating this anti-noise can be used. Finally, the viewer can 25 . 26 . 27 also get the opportunity to adapt the anti-sound frequency range depending on the perceived overall impression. This can be done by appropriate entries in the operator panels 32 . 32 ' happen.

In 2 is a possible architecture of the image display device and in particular the control unit 28 illustrated. Recurring features are again provided with the same reference numerals.

The 3 in turn describes what steps through the control unit 28 - depending on any previous registrations - be performed when one of the observers 25 . 26 . 27 by entering input commands into the control unit 32 sign up. In particular, the function of the in 2 described placement optimizer, which checks whether one or more of the viewer 25 . 26 or 27 need to be relocated for the current login to be performed. The selected playback mode is referred to here as a display mode. The term "mainlobe" refers to the area in which the two compartments overlap with rays that appear in 1 are drawn in and there emanate from two completely external pixels. This area can be moved to the right or left by repurposing image channels, resulting in even greater flexibility. Outside this area, zones emerge from which the same images are visible again in the viewing zones 23 and the areas 33 . 34 and 35 , The subpixel positions to be recorded with the different channels become dependent on the detected or selected viewer positions determined. It will also fit from the various speakers 41 to 46 the tone generators are selected, through which the corresponding audio channels are reproduced.

4 3 illustrates, with reference to a flow chart, a process sequence for generating destructive sound waves, which may additionally be provided in order to at least partially suppress crosstalk between the audio channels in the previously described manner. This process is done by the control unit 28 interacting with the device 60 executed. The sound channels referred to here as selective sound events accordingly become dependent on the selected programs and the determined observer positions on the sound sources - that is to say, for example. B. the speakers 41 to 46 out 1 - assigned. Depending on the sound signals received by the sound receivers at the viewer positions, additional sound waves are generated which destructively interfere with the portions of the sound arriving at the respective viewer positions to be suppressed. These portions will be primarily due to the audio channels assigned to the other viewer positions. The generation of destructive sound waves can also be controlled by inputs that allow users to manually tune into the operator panel 32 or 32 ' can be made dependent on room characteristics and / or on a calibration.

It is therefore proposed an audio-visual reproducing apparatus comprising a screen for simultaneously displaying a plurality of more than and / or at least two different images, which are visible from at least one of different laterally offset viewing zones, and a plurality of more than two separately controllable directed sound generating systems, wherein the direction of the sound radiation of these systems are dynamically influenced by the position of the viewing area occupied by each observer and the distance of the audible sound level from the distance to be detected by the observer.

For this purpose, the audio-visual image display device preferably has a tracking device for detecting two eye positions of at least two viewers of the screen and at least one control unit for driving the screen and the sound generation systems, which is configured to input input commands to at least two different viewers independently define one of various possible audio-visual contents and / or one of various selectable image display modes and / or one of various selectable sound reproduction modes.

Also proposed is a method of playing audio-visual content that allows different viewers to simultaneously present individual audio and video content according to individually selectable playback modes without disturbing one viewer with another video content selected by another viewer.

To enable depth perception with today's displays, a variety of 3D technologies are available. The most comfortable solution relies on autostereoscopic, electronically individually tracked (tracked) methods with free content and playback format assignment. 3D displays or 3D televisions today are not yet designed to individually change the displayed depth according to the wishes of one or more viewers. Latest solutions already point in the direction of multiview with several simultaneously presented individual contents. If this technology is to be used in the area of 3D TV sets or 3D home cinema, then in addition to individual viewing, the corresponding acoustic information would have to be offered to every user. Especially in scenes that have a corresponding sound background, the audio events generated for other users can lead to significant noise. If you resort to headphone solutions, the experience is reduced.

Autostereoscopic multi-person displays with individual image content assignment are still in the research stage. For stereoscopic displays (eyeglass solutions), the same question led to the investigation of time-sequential approaches with active shutter glasses for up to four different image contents. The much too low luminous efficacy due to the time sharing and the lack of transparency of shutter glasses as well as the display brightness necessary for their compensation, by which observers are blinded without shutter glasses, make this form of 3D display technology seem nonsensical. Therefore, this problem did not occur in 3D displays with TV sets or home theaters.

It is known that persons directed sound is tracked to inform them selectively. The body silhouette, in the alternative also skin colors or markers are detected. In cases where the sound of the background of visual representations is used, only an area in front of the display is sonicated, without tracking the position. In this case, sonicated people have no way to influence the type (stereo / mono), language choice or volume of the sound system.

In the autostereoscopic 3D display technology, the head and / or the eye position of the observer are detected, the corresponding 3D sector is specifically recorded with image information and if the position changes, the observer is tracked if necessary. Since the space requirement of a person including comfortable arm posture corresponds approximately to eight to ten times the eye relief, an observer occupies approximately the area in which a current eight-channel multiview display distributes the eight different views. With 24 to 30 views, three to four people can be placed in the "viewing zone". By utilizing the side lobes present on many autostereoscopic screens, much looser seating arrangements can be achieved, thereby assigning even more viewing positions to more people. This can be achieved by adjusting the emission direction of the images or image columns. The reference variable is determined by eye detection.

The sounding associated with the viewing position can also be tracked using this reference variable. Using an ultrasonic speaker for acoustic information transmission, the sound can be adjusted according to the location of the viewer's head. Recent results even show the availability of trackable loudspeaker systems for moving and even multiple targets (see the dissertation by Dirk Olszewski mentioned above).

The multitude of possible emission directions leads to a high number of necessary public address systems, between which must be switched during tracking. Autostereoscopic screens can be equipped with corresponding loudspeaker units, where sound radiation can be bundled, changed in the direction as well as controlled in the distance of the sound propagation. This minimal equipment is sufficient for sound radiation in wide, open spaces. In closed rooms, additional passive and / or active elements to prevent or at least reduce the unwanted propagation of audio sound by reflection, absorption or extinction are useful to reduce unwanted sound propagation. In this case, a particularly high-quality sound experience is made possible by selectively usable directional loudspeakers, which can be selected and activated by the determined head position and can be placed either in or on the ceiling and / or in the seating. This allows individual sound, voice and surround (mono / stereo / surround) to be selected as they become available. This results in combination options such as mono image with monotone or stereo image with stereo sound, but also such as multiview with stereo sound or stereo image with monotone or mono image with surround sound. These combinations can be caused by the sound signal as well as by individual inputs or presets.

The arrangement of the directed loudspeaker systems, which can be mechanically, acoustically or electronically pivotable, depends on the deflection angle of the loudspeakers, their overlapping area and the maximum number of users. The possibilities to track the spatial position of the visual main and side lobes are limited by the number of people who can be supplied by sound technology, if zones z. B. in multi-view mode on the sidelobes are used multiple times.

The controller must therefore be programmatically designed so that the resources of the audio and video presentation are used optimally. The loudspeakers are preferably arranged such that a sufficient overlapping region of the addressable emission directions exists and is controlled in such a way that the sound bundles do not overlap.

The proposed device and method have a number of advantages over known devices or methods. This allows multiple viewers to have their audio-visual content customized and presented according to their interests, viewing and listening habits. Losses with regard to the viewing quality or regarding the visual and hearing comfort can be individually minimized by the observers.

Furthermore, a spatial separation of the viewer with different viewing and listening habits and special interests (Internet, teletext, games) is not necessary. The communication between the users is not affected by body-worn aids such as glasses or headphones. All viewers can be offered their viewing and listening habits and prerequisites appropriate playback properties.

A further advantage is that the overall comfort of 3D reproduction devices, in particular for 3D TV and 3D home theater, is expanded by 3D-specific, individually adaptable properties. In addition, multiple people can simultaneously select any content and customize playback properties individually.

In addition to the features already described, the playback system may also include headphones and / or chair sound systems for the individual viewer 25 to 27 provide that optional instead of the speakers 41 to 46 or in addition to the speakers 41 to 46 can be controlled and each only or largely only for the respective viewer 25 . 26 or 27 generate audible sound. That can be helpful to the individual viewer 25 to 27 less of ambient sound - especially conversations between the other observers 25 . 26 or 27 - be disturbed. This can z. B. a switchability of the speakers 41 to 46 be provided on the headphones or chair PA systems. It is conceivable, the switching to a headphone when needed automatically using the tracking device 24 to induce if this determines that one of the observers 25 to 27 has put on the headphones assigned to him. This can be done by the tracking device 24 be supplemented by an identification system that z. B. LEDs on the headphones and thus allows to locate the headphones and switch to these if necessary.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• WO 2009/001161 A1 [0014]
• US 7671889 B2 [0037]

Cited non-patent literature

• Dirk Olszewski "Strongly Directed Audio Sonication with Parametric Ultrasonic Loudspeaker", University of Paderborn, EIM-E / 237, the contents of which are incorporated herein by reference. in particular Figure 3.10 [0008]
• Dirk Olszewski "Strongly directed audio sound with parametric ultrasonic loudspeaker", University of Paderborn, EIM-E / 237 shown, s. there in particular Figure 3.10 [0048]

Claims (14)

A sound and image reproducing apparatus comprising an image reproducing apparatus for simultaneously reproducing a plurality of at least two different images each from at least one of different laterally offset viewing zones (Figs. 23 ) and a sound reproducing apparatus having a plurality of at least two loudspeakers ( 41 . 42 . 43 . 44 . 45 . 46 ) for directional sound generation and a control unit ( 28 ) for driving the image display device depending on image information ( 30 ) of the various images and for driving the sound reproducing apparatus in dependence on at least two different sound channels, wherein the control unit ( 28 ) - for inputting input commands that are for at least two different viewers ( 25 . 26 . 27 ) independently for each defining an individual picture content of various possible picture contents and an individual sound channel from the different sound channels, and for driving the picture reproducing apparatus and the sound reproducing apparatus in response to these input commands such that each of the selected picture contents is visible from at least one of the viewing zones is assigned to the viewer for whom this image content is selected, and is not visible from at least one further viewing zone, which is assigned to the or each other viewers, and that each of the selected audio channels by at least one speaker ( 41 . 42 . 43 . 44 . 45 . 46 ) assigned to the viewer for whom this sound channel is selected, this speaker ( 41 . 42 . 43 . 44 . 45 . 46 ) does not play a sound channel that is not selected for this viewer, with the speakers ( 41 . 42 . 43 . 44 . 45 . 46 ) are arranged so that each of the speakers ( 41 . 42 . 43 . 44 . 45 . 46 ) is directed to an area comprising the viewing zone or at least one of the viewing zones associated with the viewer to which this speaker ( 41 . 42 . 43 . 44 . 45 . 46 ) assigned. Playback device according to claim 1, characterized in that it further comprises a tracking device ( 24 ) for detecting one head position or two eye positions of at least two observers ( 25 . 26 . 27 ) of the image display device, wherein the control unit ( 28 ) is arranged to drive the image display device and the sound reproduction device such that the each viewer ( 25 . 26 . 27 ) associated viewing zones ( 23 ) the eye positions of this viewer ( 25 . 26 . 27 ) contain. Playback device according to claim 2, characterized in that a main emission direction of the loudspeakers ( 41 . 42 . 43 . 44 . 45 . 46 ) is adjustable. Playback device according to one of claims 1 to 3, characterized in that the loudspeakers ( 41 . 42 . 43 . 44 . 45 . 46 ) are provided by ultrasonic loudspeakers arranged to emit ultrasound-carrying ultrasound with audio signals modulated thereon representing the respective audio channel. Playback device according to one of claims 1 to 4, characterized in that the image display device is an autostereoscopic screen. A playback device according to claim 5, characterized in that the screen is a matrix screen ( 21 ) with a plurality of pixels arranged in columns and rows and one in front of the matrix screen ( 21 ) grid ( 22 ) with a structure oriented parallel to the columns in order to distinguish from the pixels of the matrix screen ( 21 ) outgoing light into the different viewing zones ( 23 ) to steer. A player according to claim 6, when appended to claim 2, characterized in that the control unit ( 28 ) is further set up - for inputting input commands which are for the at least two different viewers ( 25 . 26 . 27 ) independently define one of a plurality of selectable play modes, the selectable play modes comprising a mono picture mode and an individual stereo picture mode, - and for driving the screen in response to these input commands and to the tracking device ( 24 ) are defined by defining different disjunctive separations of columns of the matrix screen and displaying on each of the extracts at least one of different images such that each of the detected eye positions of each observer ( 25 . 26 . 27 ) is associated with one of the extracts, which at least all of this eye position through the grid ( 22 ) visible columns of the matrix screen ( 21 ), wherein the pixels of this extract are controlled in such a way that the at least one image reproduced on this extract corresponds to the image intended for this viewer ( 25 . 26 . 27 ) defined image content, wherein a) the two eye positions of each observer ( 27 ), for which the mono image mode is selected as the reproduction mode, the same separation is assigned and the image reproduced thereon is a mono image, while b) the two eye positions of each viewer ( 26 ) for which the individual stereo image mode is selected as the playback mode, two different separations be assigned and reproduced on these extracts two mutually complementary stereoscopic fields. A player according to claim 7, characterized in that the selectable playback modes further comprise a multiview stereo image mode, the control unit ( 28 ) is arranged to control the screen so that the two eye positions of each viewer ( 25 ) for which the multiview stereo image mode is selected as the playback mode, the same digest is assigned, and on each of a plurality of columns of that excerpt, one of a set of complementary stereoscopic fields is reproduced. Playback device according to claim 8, characterized in that the control unit ( 28 ) comprises a renderer which is arranged to calculate control data for the matrix screen required for displaying the group of stereoscopic fields ( 21 ) from image information ( 30 ) to the image content generated by the input commands to the viewer ( 25 ) for which the multiview stereo image mode is selected as the playback mode. Playback device according to one of claims 7 to 9, characterized in that the tracking device ( 24 ) is adapted to detect a movement of the eye positions, while the control unit ( 28 ) is arranged to redefine the extracts in dependence on the detected movement. Playback device according to one of claims 1 to 10, characterized in that the control unit ( 28 ), the input commands for the at least two viewers ( 25 . 26 . 27 ) successively as applications of the viewer ( 25 . 26 . 27 ) to accept. Playback device according to one of claims 1 to 11, characterized in that the control unit ( 28 ) an output unit ( 36 ) for displaying information about the available image contents and / or the reproduction modes selectable for the respective image content and / or whether a last input command is executable. Playback device according to claim 12, as far as it relates to claim 11, characterized in that the control unit ( 28 ) is arranged to be determined in dependence on already input input commands and the detected eye positions and on the output unit ( 36 ) indicate whether another viewer ( 25 . 26 . 27 ) and / or whether or how a placement of already registered viewers ( 25 . 26 . 27 ) is to change so that another viewer ( 25 . 26 . 27 ) or a last entered input command can be executed. Playback device according to one of claims 1 to 13, characterized in that it is at least for one of the observers ( 25 . 26 . 27 ) has a sound receiver for detecting a crosstalk between the one for this viewer ( 25 . 26 . 27 ) and at least one other of the audio channels, the control unit ( 28 ), the loudspeakers associated with this viewer ( 41 . 42 . 43 . 44 . 45 . 46 ) in response to an output signal of the sound receiver so that these speakers ( 41 . 42 . 43 . 44 . 45 . 46 ) additionally generate a crosstalk at least partially extinguishing sound component.

Images