DE102020108985A1 - Means of locomotion, device and method for reproducing media content - Google Patents

Abstract

A means of locomotion (10), a device and a method for reproducing media content (1) using a means of locomotion (10) are proposed. The method comprises the following steps: IT analysis of the media content (1), automatic assignment of a first sequence (2) of the media content (1) to an actuator (5) of the means of transport (10) and control of the actuator (5) synchronously with the playback of the first Sequence (2) of the media content (1).

Description

The present invention relates to a means of locomotion, a device and a method for reproducing media content for the use of a means of locomotion. In particular, the present invention relates to an immersive reproduction of media content in a means of transport, in particular a car.

In the prior art, infotainment systems for means of transport are basically known. In order to make the reproduction of audio / video content as impressive as possible, considerable efforts are made in the prior art with regard to software and hardware which is used for the reproduction of the media content. For example, shakers are activated as vibration exciters in addition to the loudspeakers, through which the structure of the passenger cell / seat receptacle is excited to vibrate which corresponds to the audio signal of the media content. In particular, the low-frequency audio signals are used to control the vibration exciter synchronously with strong bass signals.

DE 10 2018 132 711 A1 discloses a method for controlling vehicle modules based on media content. Vehicle actuators are used to support media playback. These are non-audiovisual vehicle system modules, each of which is configured for a primary purpose other than presenting audiovisual and visual information to a user.

Based on the aforementioned prior art, it is an object of the present invention to be able to reproduce media content in a more impressive manner in a means of transport.

The aforementioned object is achieved according to the invention by a method for reproducing media content using a means of locomotion. Any audio and / or visual data record that can be reproduced via an infotainment system of the means of locomotion is seen as media content within the scope of the present invention. In particular, digital files and / or streaming information are used for the reproduction according to the invention. It is irrelevant here whether the content was generated outside or inside the means of transport. In particular, films and series to be consumed passively, as well as computer games designed by the user in real time, can be reproduced in a manner according to the invention. The means of locomotion can be, for example, a car, van, truck, aircraft and / or watercraft. In particular, the means of locomotion can be a road-legal vehicle (land vehicle). In a first step, media content is analyzed using information technology. In particular, the video portion of the media content can be analyzed and results of the analysis can be assigned to the media content automatically, in particular in a synchronized manner. In other words, the results of the analysis can be stored in such a way that the results are assigned to the media content over time. In other words, a further track can be generated which can be used during the media playback to control an actuator according to the invention. The same applies to an audio component of the media content. The media content can include, for example, audio / video playback and / or a computer game. But photos can also be presented and reproduced individually or as a so-called “slideshow” in a manner according to the invention. A first sequence of the media content is then automatically assigned to an actuator of the means of locomotion. In other words, the media content is proportionally assigned to an actuator of the means of transport, i.e. with respect to the first sequence, the actuator being set up to convert the results of the analysis (previous step) into signals that the occupant of the means of transport can experience. In particular, these can be sensory, preferably haptic, perceptible signals. The actuator is then activated synchronously with the playback of the first sequence of the media content in order to achieve the aforementioned effect. With the method according to the invention, the media content is processed in such a way that the actuator is activated as part of the entertainment system of the means of transport during the subsequent playback of the first sequence of the media content. Start, stop, operating parameters, intensity, etc., of the actuator depend on the content of the media content or the result of the analysis according to the invention, which makes the media experience more impressive and easier to understand for the user.

The subclaims show preferred developments of the invention.

The media content can include a movie, for example. Here, the first sequence can correspond to a first time range of the film, which is arranged after a second time range and is arranged ahead of a third time range of the film material. Here a sequence can be understood as a frame or a scene or a shot or a chapter. In other words, several sequences of the film can be analyzed in blocks or in packets. The same applies to audio material, which is part of the media content. In the case of a video game as media content, for example, different levels, stages or time ranges of the course of the game / the game structure can be understood as sequences in the sense of the above explanations. This enables a suitable balance between the analysis effort (especially in the event that the playback is interrupted / aborted) and ensuring that analysis results are available in good time.

The actuator can comprise a fan and / or a heating device of the means of locomotion. In other words, the heating / air conditioning system of the means of transport is used to present / reproduce the analysis results, in particular of the video content. Alternatively or additionally, a window lifter of the means of transport can be provided and controlled as an actuator in order to display suitable video sequences (e.g. parachute jump or action scene on a fast moving means of transport) in a more impressive manner. Alternatively or additionally, an ambient light, in particular in a door of the means of locomotion, can be controlled as an actuator within the meaning of the present invention. The ambient lighting can be controlled in particular by analyzing individual components of the video signal, depending on their color and / or position and / or their intensity and / or their contrast with regard to the other image components, in order to supplement the video signal and present it as impressively as possible. Alternatively or additionally, a room scenting device of the means of transport can be understood as an actuator which, depending on the analysis result, propagates a scent note into the interior of the means of transport which supports the sensory impression of the media content. Alternatively or additionally, an active chassis component, in particular chassis suspension and / or chassis damping, can be activated in order to move the means of locomotion as an actuator for reproducing the media content. The means of locomotion can be stimulated to sway, wobble, hop, tilt, shake or vibrate in order to support a corresponding media presentation. In particular, a traction machine, which is preferably designed as an electric traction machine, can be used as an actuator, by means of which the means of locomotion is moved, for example, forwards and / or backwards and / or iteratively forwards and backwards in order to present the media content in a particularly impressive manner. In combination with the traction machine, electrically steerable axles of the means of locomotion can also be automatically turned in order to undertake / simulate lateral movements or cornering. In particular, distances to the objects and persons / living beings surrounding the vehicle can be determined, checked and taken into account, which have been determined in advance and at the same time as the reproduction by sensors / automatically. In the context of the present invention, an actuator is understood to mean, in particular, non-audiovisual vehicle systems which are set up to carry out primary functions lying outside the present invention. In this way, the reproduction of media content within the scope of the present invention can be made possible in an essentially hardware-neutral manner.

The analysis of the media content can include a detection of a situation represented in the media content. The situation can in particular be interpreted to the effect of which sensory impressions a person present / present in the depicted situation or a person observing the situation from the viewer's point of view would experience. Corresponding sensory impressions can then be automatically interpreted in relation to the effect of actuators present in the means of locomotion and assigned to them. For this purpose, the hardware present in the means of locomotion can already be examined by means of information technology before the analysis of the media content / sequence to determine which sensory impressions can be generated at all by means of the present actuators. An examination / analysis of the media content for such sensory impressions which cannot be reproduced / supported by the currently available hardware in any case is therefore unnecessary. As a result, the analysis will be more efficient and the amount of data generated during the analysis will be reduced.

The analysis of the media content can include a comparison with a database located outside the means of locomotion. Signals using actuators that are often present in means of locomotion can be stored in the database, for example. For example, a vehicle manufacturer could analyze the media content centrally and in particular for several vehicles in its fleet at the same time, to what extent actuators present in its vehicle fleet could be used to support the sensory impressions in the reproduction of the media content viewed. In other words, before or after the download of the analysis results, a vehicle-specific configuration file is taken into account (also referred to as a “registry”), which of the analysis results are relevant / usable for the downloading means of transport. Using the registry before the download prevents useless data from being loaded into the means of transport, thereby reducing the required bandwidth, reducing the memory to be used in the means of transport and reducing the load on the server. In addition, the transmission of the information required to control the actuator can be accelerated or accomplished within a shorter time. Alternatively or in addition, machine-based learning algorithms can be used to analyze the media content. For example Object recognition with regard to the video content and / or with regard to the audio content can be carried out to determine which stimuli (e.g. sensation of cold / warmth, vibrations, smell, etc.) would be experienced by the performer experiencing the situation or the viewer of the content. For a fleet-based evaluation of the media content, it can be provided in particular that the user of the method according to the invention is given the opportunity (or is prompted to do so) to evaluate the reproduction of the first sequence of the media content and thus a quality or a need for improvement with regard to the analysis of the To send media content. This enables the analysis to be improved, in particular in the event that several corresponding feedbacks from users are agglomerated / verified.

In a corresponding manner, the method according to the invention can include the automatic determination of a second sequence of media content with image and audio content different from the first sequence and, depending on the content of the second sequence, not controlling the same actuator synchronously with the playback of the media content. In other words, the second sequence does not contain any audio / video information, the presentation of which can be improved in the manner according to the invention by means of the considered actuator. The first and the second sequence can in particular be present in the media content one after the other in time. In other words, the actuator is sometimes used more, sometimes less and sometimes or predominantly not at all in order to support the reproduction of the media content in the manner according to the invention.

For example, the first sequence, but not the second sequence, can represent a situation with a strong draft and / or high heat and / or an intense olfactory impression and / or fluctuating image content, etc. Such sequences can be delimited from one another, for example, by changing a camera setting and / or a scene / scenery in the media content. Alternatively or additionally, fixed time segments, e.g. 10 seconds, 30 seconds, 60 seconds, 2 minutes, 5 minutes, or the like, can represent a first sequence, which is seamlessly followed by the second sequence. In this way it can be avoided that a film lasting several hours does not have to be completely analyzed if the user only intends to consume part of it. In this way, the analysis effort can only be undertaken shortly or immediately before the actual consumption, thus potentially reducing computing power and storage capacity.

In order not to overwhelm / disturb the user with undesired signals, a user preference for controlling the actuator can first be queried, in response to which the control of the actuator or the analysis of the media content is enabled. This can be provided as a configuration menu item in a 4D experience menu of the means of transport / its entertainment system. In particular, the user can also set an intensity of the activation of the actuator or limit the dynamics (corresponding to a night mode) of the actuator signals.

The method according to the invention can include determining a predefined vehicle situation (for example a geographical position and / or an infrastructure surrounding the means of locomotion), in particular for safety reasons. For example, it can be determined that the means of transport is in public space, in particular on a street / a parking lot. If necessary, there may be a restriction here in that certain actuators can be used to reproduce the media content. Accordingly, it can be determined that the means of transport is located on private property. There may be other restrictions or no restrictions on what type of actuators can be used and how they can be operated to reproduce the media content. In particular, it can be determined that the means of transport is not on a ferry / car ferry, not on a car of a car train (railroad) or not at a gas station. Such locations for the means of locomotion can be particularly unsuitable for the use of certain actuators for reproducing the media content. The geographical position can be determined based on satellites, for example. The environment / infrastructure in which the means of transport is located can be determined using digital map material, for example. In particular, environmental sensors that work optically and / or acoustically and / or radar-based can also be used to examine the surroundings and their suitability for using the actuators in the sense of the invention. Alternatively or additionally, a distance to an environmental object and / or a living being can be determined by means of a sensor of the means of transport and the actuator can be deactivated in response to this or depending on the determined distance / surrounding object / living being present. This can, for example, also take place during the playback of the media content and "adapt / trump" preferences defined in advance by the user. It can thus be ensured that the use of the actuator does not impair / endanger the environment, which the Increased user acceptance when using the method according to the invention.

According to a second aspect of the present invention, a device for reproducing media content in a means of locomotion is proposed. The device comprises a data input, an evaluation unit, for example a programmable processor, an electronic control device, or the like, and a data output. The device is set up to use the data input to analyze the media content using information technology. This can be done using the data input and the evaluation unit. In other words, the data input can read in the file that represents the media content. This can be done, for example, from an optical and / or semiconductor-based data carrier. In particular, data can also be received via an antenna and in particular from outside the means of transport (e.g. via the Internet). Then, depending on a result of the analysis, a first sequence of the media content is automatically assigned to the actuator of the means of locomotion. The sequence can be understood as a time segment of the media content and is characterized, for example, by the use of the actuator for the reproduction of the media content compared to other (in particular directly adjacent) sequences. In other words, the first sequence can be distinguished from other sequences of the media content, for example, in that, in contrast to the other sequences, it provides for the use of the actuator of the means of locomotion. By means of the data output, the evaluation unit is also set up to control the actuator synchronously with the reproduction of the first sequence as a function of the result of the analysis. In other words, the data output outputs control commands to the actuator which are based on the analysis result and in particular change the operating mode of the actuator for this purpose, without the user having given a manual prompt / user input for this. In this way, the features, feature combinations and the advantages resulting therefrom are embodied in such a way that they are evident in accordance with the above aspect of the invention, so that reference is made to the above statements in order to avoid repetition.

According to a third aspect of the present invention, a means of locomotion is proposed which has a multimedia playback device, an actuator and a device according to the second-mentioned aspect of the invention. The actuator is used by the device according to the invention to reproduce media content which is reproduced by means of the multimedia reproduction device. Also with regard to the means of transport, which can be designed as a car, van, truck, aircraft and / or watercraft, the features, combinations of features and advantages result according to the above explanations.

• 1 eine perspektivische Darstellung eines Fahrerarbeitsplatzes eines Fortbewegungsmittels mit einer Multimediawiedergabeeinrichtung gemäß einem Ausführungsbeispiel einer erfindungsgemäßen Vorrichtung;
• 2 eine schematische Darstellung von Bestandteilen einer ersten Sequenz eines Mediainhaltes über der Zeit;
• 3 eine schematische Darstellung von Bestandteilen einer zweiten Sequenz eines Mediainhaltes über der Zeit; und
• 4 ein Flussdiagramm veranschaulichend Schritte eines Ausführungsbeispiels eines erfindungsgemäßen Verfahrens zur Wiedergabe eines Mediainhaltes unter Verwendung eines Fortbewegungsmittels.

Further details, features and advantages of the invention emerge from the following description and the figures. Show it:

• 1 a perspective view of a driver's workstation of a means of locomotion with a multimedia playback device according to an embodiment of a device according to the invention;
• 2 a schematic representation of components of a first sequence of media content over time;
• 3 a schematic representation of components of a second sequence of media content over time; and
• 4th a flowchart illustrating steps of an exemplary embodiment of a method according to the invention for reproducing media content using a means of locomotion.

1 shows a driver's workstation of a car designed according to the invention 10 as a means of transportation. There is a screen in the dashboard of the car 4th (CID) arranged on which a first sequence 2 of a movie 1 is played back as media content. The film 1 will have an exit 9 an electronic control unit 7th played. More precisely, the video signals are sent via the data output 9 to the screen 4th sent. To play the movie 1 becomes one via the antenna in a manner according to the invention 13th received multimedia file initially via a data input 8th from the electronic control unit 7th received as an evaluation unit and then analyzed to what extent a fan is working 5a , a heater 5b , a window regulator 5c to lower a window 12th , an ambient lighting 5d , an active suspension damper 5f as well as an electric traction machine 5g which has a driver 11 is controlled as actuators according to the invention to support the playback of the film 1 suitable. If one of the aforementioned actuators is suitable 5a until 5g determined is in a data store 14th an “actuator track” (not shown) is created in which the actuators for controlling the respective actuator 5a until 5g suitable signals, at least temporarily, in synchronism with the respective sequence 2 of the film 1 are filed. In the on the screen 4th sequence shown 2 a wintry scenery is shown. This is in advance by the electronic control unit 7th or even outside the car 10 been analyzed. In particular, the video signal is identified by a machine-based comparison algorithm as " wintry ”and“ fast ”or“ rapid ”have been categorized. Therefore, a cold airstream would appear as a sensory impression, which is generated by means of the fan 5a or by means of the lowered side window 12th can be readjusted in a suitable manner, result for the depicted skiers. Structural means of the active damper could also be used 5f or the traction machine 5g Generated vibrations that simulate oscillations that sometimes occur during alpine skiing, so that those from the fans 6th in the dashboard or through the open side window 12th Inflowing cold air and the vibrations allow the user / viewer (not shown) to “immerse” in the scenery shown. The result is an immersive multimedia experience.

2 shows a timing diagram in which a first sequence prepared according to the invention 2 of the in 1 presented media content 1 is shown. The first sequence 2 consists of a video signal V2 , which is symbolized over time t by a downhill skier. An audio track A2 shows audio material, which can represent noises and / or background music during the run. An actuator track 52 has been created in accordance with the invention by the video signal V2 has been analyzed automatically. In the example is the actuator track 52 assigned to a cold air fan, which produces an initially increasing air throughput (rising flank) over time t and has a decreasing dynamic after the skier has passed it. This forms the actuator track 52 on the one hand the winter environment of the video signal V2 on, on the other hand, the dynamic content of the approaching or darting of the depicted skier by means of the air throughput. Consuming the first sequence 2 is through the actuator track 52 more impressive or immersive for the viewer.

3 shows a second sequence 3 , which according to the invention by creating an actuator track 53 has been processed in the manner according to the invention. In the video signal V3 shows a beach scene with a zoom process into the sun. An audio signal A3 reflects the noises and / or background music corresponding to the scenery. The actuator track 53 is assigned, for example, to a radiant heater device of a means of locomotion or a seat heater and / or a fan of the means of locomotion. Corresponding to the zoom process, which is up to the last displayed image of the video signal V3 continues, an increasing dynamics / intensity of the used, heat-producing actuator is provided. The approach to the sun experienced according to the image signal is impressively reproduced or made immersive for the viewer by the increasing intensity of the actuator signal.

4th FIG. 3 shows a flowchart illustrating steps of an exemplary embodiment of a method according to the invention for reproducing media content using a means of locomotion. In step 100 a user preference for controlling an actuator of the means of locomotion is determined in a configuration menu. Here, the user can determine the intensity or the dynamics of the actuator or a plurality of actuators of the means of locomotion or completely exclude individual actuators from being used in the context of the present method. This step could also be understood as “approval” or “user approval” for using the method according to the invention. In step 200 media content that the user would like to consume using the means of transport is automatically analyzed using information technology. This does not rule out that the media content, in particular only the video component, should be reproduced on a screen that is not mechanically assigned to the means of transport. Such a screen can be assigned to a portable user terminal, for example. In step 300 a first sequence of the media content is automatically assigned to an actuator of the means of transport. In other words, a logical link is made between the actuator and its mode of operation during the playback of a sequence of the media content. In this way, an actuator track is created, which can take place in particular several seconds, preferably several minutes, in advance of the playback in order to prepare the actuator for use in the context of the playback and the boundary conditions (e.g. graphic position and / or ambient conditions and - distances to surrounding objects and people / living beings in the vicinity) in good time. In step 400 a predefined vehicle situation is also determined during the playback using environmental sensors of the means of locomotion. Since the geographical position, the infrastructure surrounding the vehicle and the distances to surrounding objects and living beings do not require any restriction of the method according to the invention, step 500 then the actuator is controlled synchronously with the playback of the first sequence of the media content. The user experiences an immersive or 4D media experience, which particularly promotes his identification with the means of transport. In step 600 a second sequence of media content with image and audio content that is different from the first sequence is automatically determined and analyzed. It is determined here that the actuator which was used to reproduce the first sequence is not suitable for use in the second sequence. Correspondingly, in step 700 the second sequence of media content is reproduced without the use of the actuator. Thus, media content depending on the actuators of the means of transport used to create the best possible media playback experience.

For example, a represented trip or trip in a computer game over a hilltop or a jump with the vehicle can be displayed more impressively in the manner according to the invention by quickly raising and then lowering the active chassis as an actuator. Shaking in a situation or a curve position can be reproduced favorably by inclination (one-sided control of the air suspension) or the automatic turning of a steering as actuators. Decelerating and accelerating in the media content can be represented by tilting or erecting the means of locomotion using active chassis dampers / springs as actuators. Smallest forward / backward movements including braking intervention by means of the chassis / the (electric) traction machine of the means of locomotion can be used to reproduce abrupt maneuvers. Such traction interventions can be carried out while stationary or while driving autonomously in order to achieve the desired effect in connection with the media content.

List of reference symbols

1

Media content

2

first sequence

3

second sequence

4th

Screen (CID)

5a

Fan

5b

Heating device

5c

Window regulator

5d

Ambient light

5f

active suspension damper

5g

electric traction machine

6th

Fan

7th

electronic control unit

8th

Data input

9

Data output

10

Car

11

driver

12th

Side window

13th

antenna

14th

Data storage

52, 53

Actuator track

100 to 700

Procedural steps

A2, A3

Audio track

V2, V3

Video track

QUOTES INCLUDED IN THE DESCRIPTION

This list of the documents listed by the applicant was generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Patent literature cited

• DE 102018132711 A1 [0003]

Claims (12)

Method for reproducing media content (1) using a means of locomotion (10) comprising the steps: • Information technology analysis (200) of the media content (1), • Automatic assignment (300) of a first sequence (2) of the media content (1) to an actuator (5) of the means of locomotion (10) and • Activation (500) of the actuator (5) synchronously with the playback of the first sequence (2) of the media content (1). Procedure according to Claim 1 , wherein the media content (1) comprises - a film and / or - audio material and / or - a video game. Procedure according to Claim 1 or 2 , wherein the actuator (5) - a fan (5a) and / or - a heating device (5b) and / or - a window lifter (5c) and / or - an ambient lighting (5d), in particular in a door, of the means of locomotion (10 ) and / or - a room scenting device (5e) and / or - an active chassis suspension and / or - an, in particular electric, traction machine (5g). Method according to one of the preceding claims, wherein the analysis of the media content (1) comprises a recognition of a situation represented in the media content (1), in particular by interpreting an audio and / or image content. Procedure according to Claim 4 In the course of analyzing the media content (1) - a comparison with a database takes place, on the basis of which the first sequence (2) is assigned to a predefined class of situations, and / or - algorithms of machine-based learning are used. A method according to any preceding claim further comprising - Automatic determination (600) of a second sequence (3), different from the first sequence (2), of the media content (1) with image and audio content and - Not driving (700) the actuator (5) to play the second sequence (3) of the media content (1). Method according to one of the preceding claims, wherein the first sequence (2), but not the second sequence (3), a situation with - strong drafts and / or - high heat and / or - intense olfactory impression and / or - represents fluctuating image content. A method according to any preceding claim further comprising - Determination (100) of a user preference for controlling the actuator (5) as a precondition for controlling the actuator (5). Method according to one of the preceding claims, wherein the analysis takes place several seconds, in particular several minutes, before the playback of the first sequence (2) and in particular takes place chapter by chapter. A method according to any preceding claim further comprising - Determination (400) of a predefined vehicle situation, in particular - a geographical position and / or - An infrastructure surrounding the means of transport (10) and / or - A distance to an environmental object or living being by means of a sensor of the means of locomotion (10) and in response thereto - Deactivating the actuator (5). Device for reproducing media content in a means of locomotion (10) comprising: - a data input (8), - An evaluation unit (7) and - A data output (9), wherein the device is set up, - analyze the media content (1) with information technology using the data input (8), - automatically assign a first sequence (2) of the media content (1) to an actuator (5) of the means of locomotion (10) and - To control the actuator (5) synchronously with the playback of the first sequence (2) of the media content (1) by means of the data output (9). Means of locomotion (10) comprising - a multimedia playback device, - an actuator (5) and - a device according to Claim 11 .

Images