DE102019102941A1 - Method, device and computer program for operating an audio system in a vehicle - Google Patents

Abstract

A method (200) for operating an audio system in a vehicle (100) is described. The method (200) comprises the determination (201), in particular the prediction, of an influencing factor currently or in the future acting on a perception system of an occupant of the vehicle (100). The method (200) further comprises adapting (202) a parameter of an audio system operated in the vehicle (100) as a function of the influencing factor on the occupant's perception system.

Description

The invention relates to the reproduction of audio signals in a vehicle. In particular, the invention relates to a method, a device and a computer program for operating an audio system in a vehicle.

A vehicle typically includes an audio system for playing audio signals, e.g. to play a radio broadcast or to play music or to play sounds. The present document deals with the technical task of increasing the subjective quality of audio signals perceived by a vehicle occupant.

The task is solved by each of the independent claims. Advantageous embodiments include described in the dependent claims. It is pointed out that additional features of a claim dependent on an independent claim without the features of the independent claim or only in combination with a subset of the features of the independent claim can form a separate invention and independent of the combination of all features of the independent claim can be made the subject of an independent claim, a divisional application or a late application. This applies in the same way to the technical teachings described in the description, which can form an invention which is independent of the features of the independent claims.

According to one aspect, a method for operating an audio system in a vehicle (in particular in a motor vehicle) is described. The audio system can be designed to output an audio signal (e.g. a voice signal and / or a music signal and / or one or more tones). The output can take place via one or more sound transducers (e.g. loudspeakers and / or structure-borne sound transducers). The method can be carried out by a control unit or by a device of a vehicle.

The audio signal is preferably a useful signal, for example an audio signal required or desired by an occupant of the vehicle. In particular, the audio signal can be an audio signal to be output and / or an audio signal already intended for output (e.g. a music signal or a radio signal). The audio signal can be based on signal data already present in the vehicle. Alternatively or additionally, the audio signal can be an auditory message, e.g. a voice message (possibly in the process) generated by voice generation.

The method comprises determining, in particular predicting, an influencing factor currently or in the future (in particular in the near future) influencing a perception system of an occupant (in particular the driver) of the vehicle. In particular, this may be an occupant's auditory perception system. The influencing factor can be frequency-invariant and / or time-invariant. In particular, the influencing factor can indicate a frequency-dependent influence on the occupant's perception system for a large number of different frequency ranges. The frequency-dependent influence can change over time.

The influencing factor can be determined on the basis of sensor data from one or more sensors of the vehicle. An exemplary sensor is a (structure-borne noise) microphone that is set up to record sensor data in relation to sound waves on and / or in the vehicle. Another exemplary sensor is an occupant or driver sensor (e.g. a camera), which is set up to record sensor data with respect to the occupant (e.g. with respect to the direction of view of the occupant). Another exemplary sensor is an environment sensor (e.g. a camera) which is set up to record sensor data in relation to an environment or an environment of the vehicle. Alternatively or in addition, the influencing factor can be determined on the basis of data received from a vehicle-external unit (e.g. from a backend server and / or from one or more other vehicles).

Furthermore, the method comprises adapting a parameter of an audio system operated in the vehicle as a function of the influencing factor on the occupant's perception system. In particular, an output parameter of an audio signal output by the audio system can be adapted as a function of the influencing factor. Exemplary output parameters are: an amplitude of the audio signal, a frequency parameter of the audio signal, a content-related parameter relating to a content (e.g. a voice message) of the audio signal, a playback speed of the audio signal and / or a spectral composition of the audio signal. Alternatively or additionally, a time interval for outputting at least a section of an audio signal to be output by the audio system can be adapted as a function of the influencing factor.

By taking into account a current or future influencing factor on the (auditory) perception system of an occupant The subjective quality of audio reproduction in a vehicle can be increased.

The parameter of the audio system, in particular the audio parameter of the reproduced audio signal, can be dynamically adapted in dependence on a time-changing influencing factor such that a perception of an audio signal output by the audio system changed by the time-changing influencing factor is at least partially avoided, balanced and / or is compensated. Subjectively constant quality of the actual perception of an occupant can thus be brought about even with changing influencing variables on the perception system. In this way, the subjective quality of audio reproduction in a vehicle can be increased.

The method can include determining, in particular predicting, a frequency parameter with respect to an oscillation frequency of a part, in particular a passenger compartment, of the vehicle. The frequency parameter can include a spectral and / or temporal frequency pattern, e.g. describes the spectral composition and / or the time profile of one or more vibrations of a part of the vehicle.

Alternatively or in addition, the method can include determining, in particular predicting, an acceleration parameter with respect to an acceleration of a part, in particular a passenger compartment, of the vehicle. The acceleration parameter can include a temporal acceleration pattern, e.g. describes the time course of an acceleration of a part of the vehicle.

The influencing factor on the occupant's perception system can then be determined and / or predicted in a precise manner on the basis of the frequency parameter and / or on the basis of the acceleration parameter. In this way, the subjective quality of the audio playback can be further increased.

The frequency parameter and / or the acceleration parameter can be determined in a precise manner on the basis of: a noise in a drive train of the vehicle; a noise of a chassis actuator of the vehicle; a wind noise; vibration in the vehicle; an action induced by an environment of the vehicle; and / or a current or predicted resonance in the vehicle.

The method can include determining, in particular predicting, a degree of (possibly temporal) agreement of an audio signal to be output with a frequency pattern and / or an acceleration pattern. The parameter of the audio system, in particular the output parameter of the audio signal, can then be adjusted in a precise manner as a function of the determined degree of agreement. In this way, the subjective quality of audio reproduction in a vehicle can be further increased.

The method may include determining an impact function that indicates an impact of a vibration in a frequency range that is inaudible to a human being on an audible frequency range of the occupant's (auditory) perception system. The impact function can e.g. determined in advance and stored on a memory unit of the vehicle. In particular, the impact function can be determined in advance in relation to one or more time intervals in the future and / or for one or more (vehicle) positions. This is particularly advantageous in relation to the adaptation of an (output parameter of) an audio signal in the form of a speech message to be generated with a speech generation, since the speech generation can be accelerated through the use of a predefined impact function.

Vibration information can then be determined in relation to an inaudible vibration currently or in the future acting on the occupant's perception system (e.g. by means of a structure-borne sound microphone). The influencing factor can then be determined on the basis of the vibration information and on the basis of the impact function. By considering the effects of vibrations at inaudible frequencies, the subjective quality of audio reproduction in a vehicle can be further increased.

The output parameter of an output signal can be adapted by means of a non-linear characteristic in relation to different frequencies and / or in relation to different times (depending on the influencing factor). In other words, the spectral composition of an audio signal and / or the temporal course of an audio signal can be adjusted nonlinearly. In this way, the subjective quality of the audio playback can be further increased.

The method can include the determination, in particular the prediction, of a road section that the vehicle is currently traveling on or will travel on in the future (in the near future). In particular, lane data can be determined in relation to the condition of the lane of a lane currently or in the future. The lane data with regard to the lane section (in particular with regard to the condition of the lane) can be obtained from an external vehicle unit (e.g. from a backend server or from one or more other vehicles) (e.g. via a wireless communication link). The influencing factor on the perception system can then be determined, in particular predicted, in a precise manner on the basis of the roadway data. By taking roadway data into account, the subjective quality of the audio playback can be further increased.

The method can include determining a state and / or a change in state of the occupant's perception system. In particular, a change in state depending on the influencing variable can be determined. The states and / or state changes can be made in a precise and robust manner by means of a state machine, e.g. be described or modeled using a so-called state machine of the perception system. The state machine can be determined in advance and stored on a storage unit of the vehicle.

The parameter of the audio system, in particular the output parameter of the audio signal, can then be adapted as a function of the state and / or the change in state of the occupant's perception system. In this way, the subjective quality of the audio playback can be further increased.

A change in the influencing factor over time can be determined as part of the method. In particular, it can be determined that the occupant's perception system is more or less impaired over time (e.g. by ambient noise). The scope of the dynamics of an audio signal to be output by the audio system can then be automatically adjusted depending on the change in the influencing factor over time. In this way, the comfort and quality of audio reproduction in a vehicle can be increased.

The method may include determining information related to visual content that affects the occupant of the vehicle. In particular, the information can indicate a degree of visual content acting on the occupant. The information related to visual content can e.g. can be determined on the basis of sensor data from an occupant sensor (e.g. a camera) which is directed at the occupant. As an alternative or in addition, the information relating to visual content can be determined on the basis of sensor data from an environment sensor (e.g. a camera) which is set up to record sensor data in relation to an environment of the vehicle. The information relating to visual content can in particular indicate how strongly the occupant is burdened by visual impressions and / or how strongly the occupant is concentrated on visual content.

The influencing factor on the (auditory) perception system can then be determined on the basis of the information in relation to visual content. In particular, on the basis of the information relating to visual content, it can be determined how the output of an audio signal has to be adjusted so that the audio signal is reliably perceived by the occupant (despite visual stress) (for example by adjusting the volume, the dynamics and / or the spectral composition of the audio signal).

In one aspect, a device for a vehicle is described. The device is set up to determine, in particular to predict, an influencing factor currently or in the future acting on an (auditory) perception system of an occupant of the vehicle. Furthermore, the device is set up to adapt a parameter of an audio system operated in the vehicle as a function of the influencing factor on the occupant's perception system.

According to a further aspect, a (road) motor vehicle (in particular a passenger car or a truck or a bus or a motorcycle) is described, which comprises the device described in this document.

According to a further aspect, a computer program, in particular a computer program product comprising a computer program, is described, the computer program being designed to execute the method described in this document when it is executed on at least one computing unit.

The computer program product can be designed as an update of a previous computer program, which includes the parts of the computer program or the corresponding program code, for example as part of a functional expansion, for example as part of a so-called “remote software update”. The computer program product in particular comprises a medium that can be read by the data processing device and on which the program code is stored, or at least an encrypted file. According to a further aspect, a program product is described which comprises an authorized right of access to stored data of the computer program product.

It should be noted that the methods, devices and systems described in this document both alone and in combination with others described in this document Methods, devices and systems can be used. Furthermore, any aspect of the methods, devices and systems described in this document can be combined with one another in a variety of ways. In particular, the features of the claims can be combined with one another in a variety of ways.

• 1 beispielhafte Komponenten eines Fahrzeugs; und
• 2 ein Ablaufdiagramm eines beispielhaften Verfahrens zur Wiedergabe eines Audiosignals in einem Fahrzeug.

The invention is described in more detail below on the basis of exemplary embodiments. Show

• 1 exemplary components of a vehicle; and
• 2nd a flowchart of an exemplary method for playing an audio signal in a vehicle.

As stated at the beginning, the present document is concerned with increasing the quality of an audio signal perceived by an occupant of a vehicle. In particular, the present document is concerned with providing an audio playback system which can be adapted to the current and / or expected state (and the associated properties) of human perception and information utilization, in particular in order to increase the subjectively perceivable audio quality and / or to increase the efficiency of the communication with to raise a voice assistant.

In this context shows 1 exemplary components of a vehicle 100 . The vehicle 100 includes a control unit 101 (or a device) that is set up via one or more electroacoustic (sound) transducers 102 (e.g. a loudspeaker and / or a structure-borne sound transducer) an audio signal 112 in an interior of the vehicle 100 or spend in a hard hat of a motorcycle user. The perception of the user of the vehicle 100 can depend on the condition of the vehicle 100 depend (e.g. on the acceleration of the vehicle 100 and / or vibrations in the vehicle 100 ).

• • ein Umfeldsensor 105 (z.B. ein Radarsensor, ein Bildsensor, eine Kamera, ein Lidar-Sensor oder ein Ultraschallsensor) des Fahrzeugs 100, der eingerichtet ist, Sensordaten in Bezug auf ein Umfeld des Fahrzeugs 100 zu erfassen;
• • ein Fahrzeugsensor 103, der eingerichtet ist, Sensordaten in Bezug auf einen Zustand des Fahrzeugs 100 zu erfassen (wie z.B. die Geschwindigkeit, die Beschleunigung, die Gierrate, etc. des Fahrzeugs 100); und/oder
• • ein Insassensensor 104, der eingerichtet ist, Sensordaten in Bezug auf einen Zustand eines Nutzers bzw. Insassen des Fahrzeugs 100 zu erfassen (wie z.B. die Blickrichtung).

The control unit 101 can be set up information relating to the state of the perception system of a user of the vehicle 100 to determine and / or predict. In particular, one or more influencing factors can influence the perception system of a user of the vehicle 100 are determined and / or predicted. For this purpose, the control unit 101 on the sensor data from one or more sensors 103 , 104 , 105 of the vehicle 100 To fall back on. Exemplary sensors 103 , 104 , 105 are:

• • an environment sensor 105 (e.g. a radar sensor, an image sensor, a camera, a lidar sensor or an ultrasound sensor) of the vehicle 100 , which is set up, sensor data relating to an environment of the vehicle 100 capture;
• • a vehicle sensor 103 , which is set up, sensor data relating to a state of the vehicle 100 to be recorded (such as the speed, acceleration, yaw rate, etc. of the vehicle 100 ); and or
• • an occupant sensor 104 , which is set up, sensor data relating to a state of a user or occupant of the vehicle 100 to be recorded (such as the direction of view).

As an alternative or in addition, the control unit can 101 be set up, data via a communication unit 106 of the vehicle 100 from a vehicle external unit 110 (e.g. from a backend server). The data can be accessed via a (wireless) communication link 111 (such as WLAN, Bluetooth, 3G, 4G, 5G etc.) can be received. The data can, for example, display information about a road section ahead (for example, about the condition of the road).

The control unit 101 can be set up, on the basis of the sensor data and / or on the basis of the received data, at least one influencing factor on the (acoustic) perception system of a user of the vehicle 100 to determine or predict. Furthermore, the control unit 101 be set up to play an audio signal 112 in the vehicle 100 depending on the influencing factor to adapt to the subjectively perceived quality of the audio signal by the user 112 to increase.

2nd shows a flow diagram of an exemplary method 200 for operating an audio system in a vehicle 100 . The procedure 200 includes identifying 201 , in particular the prediction, of an influencing factor on the perception system of an occupant of the vehicle 100 . In doing so, an influencing factor is determined which affects the occupant at a current time and / or which will affect the occupant in the near future. The procedure also includes 200 the customization 202 of a parameter one in the vehicle 100 operated audio system, depending on the determined influencing factor on the perception system of the occupant.

That in the vehicle 100 powered audio system of the vehicle 100 can be an audio system of the vehicle 100 be. Furthermore, the audio system can be a system for outputting audio signals 112 and / or a system for evaluating sound waves and / or a communication system and / or comprise a speech computer, for example a speech assistant. For example, the audio system can include a hands-free device and / or a voice control.

The audio system can be one (to the vehicle 100 belonging and / or in the vehicle 100 operable) device 101 include. This device 101 may also include a user device (e.g. a smartphone, smart clothing, smart watch, etc.) that is in the vehicle 100 , for example in an active connection with the vehicle 100 , is operated (or can be operated).

Furthermore, the audio system can comprise a device that is portable or at least partially located in the body of the at least one occupant and implanted in the body. For example, the audio system can include or can be a (also medical) hearing aid and / or headphones.

For example, the audio system may include: a surround sound system of the vehicle 100 (comprising a (digital signal processor) DSP, an amplifier, a speaker system, etc.); a vehicle voice control system 100 ; and / or a system for generating an information output as audible speech, for example through speech synthesis.

The influencing factor on the perception system can include one or more physical influences (various types). For example, the influencing factor can be or include a physical influence on the occupant, which is due to the operation of the vehicle 100 acts. The influencing factor can depend on an operating size of the vehicle 100 and / or due to an influence on the vehicle 100 be determined from the outside. The influencing factor can preferably be a quantitative measure, in particular a mathematical function, which is characteristic of a quantitative measure of the influence on the perception system. For example, the influencing factor on an occupant's perception system can depend on (current and / or predicted) physical influences on the passenger compartment of the vehicle 100 be determined.

In particular, the influencing factor can be characterized or described by a frequency parameter or by a frequency-dependent parameter and / or by an acceleration parameter or by an acceleration-dependent parameter. The frequency parameter or the acceleration parameter can e.g. certain frequencies, certain frequency ranges, certain superposition of frequencies, a temporal course, e.g. include an increase and / or a decrease in frequencies or accelerations and / or patterns of such parameters.

The frequency parameter can preferably at least partially comprise an infrasound frequency range (in particular frequencies up to 16 or 20 Hz). The acceleration parameter can preferably characterize an acceleration which changes with regard to the amplitude, direction and / or frequency, in particular with a relatively high frequency of changing the acceleration parameter (for example once in 5 seconds or less, once in 2 seconds or less, once in 1 second or less, or once in 0.5 seconds or less).

The influencing factor can include or characterize certain frequency patterns and / or acceleration patterns.

The occupant's perception system can include the following occupant perception systems (individually or in any combination): the hearing system, the vestibular system and / or the short-term memory.

As part of the process 200 the at least one parameter of the audio system can be dynamically adjusted in such a way that an alternating influence on the perception of the sound waves of the audio signal 112 by the occupant of the vehicle 100 , in particular if the changing influence is different influences on different frequency ranges, is at least partially avoided, compensated for and / or compensated for by the dynamic adaptation of the at least one parameter of the audio system.

In other words, through a converter 102 output audio signal 112 can be (intentionally) distorted in such a way that the corresponding subjective perception of the corresponding sound waves by the occupant is as if there was no significant influence on the occupant's perception system.

As part of the adaptation of the audio signal 112 can non-linear changes in the audio signal 112 are effected, and / or non-linearities are compensated. In particular, the audio system of the vehicle 100 are controlled such that a (certain) non-linearity, for example a non-linear mapping between the data for outputting the audio signal to be output 112 and the corresponding sound waves to be generated by the audio system. A corresponding mapping function can be varied dynamically (eg several times per minute or second).

The non-linearity can affect the mapping of the amplitudes of the audio signal 112 at different frequencies, in particular on the mapping of the signal amplitude (for example with an infinitesimal gain factor), depending on the amplitude range, and / or on a playback speed of the audio signal 112 Respectively.

The changed mapping function (or the corresponding non-linearity) can be determined in this way and on the corresponding sections of the audio signal to be output 112 applied that the subjective perception of the audio signal 112 corresponding sound waves, corresponds to a (possibly, essentially) true to the original (eg linear) signal.

As part of the procedure described 200 can not only control the volume, but also the frequency range and possibly the phase of an audio signal to be output 112 and / or the one with the audio system 112 sound waves to be processed are controlled depending on a frequency pattern and / or an acceleration pattern.

In a simplified form, a frequency parameter, for example a ratio of at least two frequencies of an audio signal to be output by the audio system 112 and / or an audio signal 112 be described, dynamically determined or adapted on the basis of recorded sound waves.

In a simplified form, a lane profile of a lane section to be traveled in the near future can be determined (for example on the basis of received lane data). The determination, in particular the prediction, of a frequency profile or a frequency pattern and / or an acceleration profile or an acceleration pattern can depend on the determined roadway profile, in particular taking into account an operating parameter (for example the driving speed) of the vehicle 100 , respectively. For example, a time course of the effects on the passenger compartment of the vehicle 100 can be determined in advance on the basis of the information about the road section to be traveled on soon. This information can take into account, for example, the properties of the chassis of the vehicle 100 determined, in particular predicted.

In a simplified form (as an adjustment of a parameter of the audio system), a delay or repetition of sections of an audio signal can 112 respectively. For example, individual sections of a generated audio signal (depending on the frequency pattern and / or acceleration pattern) 112 (for example an audio signal to be output and / or an auditory message which is based in particular on voice generation) are repeated or for example output in a changed form.

Furthermore, depending on the frequency pattern and / or vibration pattern determined, part of a recognition or processing of a voice input and / or a communication can be varied (adapted) or repeated.

For example, an influence of the determined, in particular the predicted, frequency pattern and / or acceleration pattern on the subjective perception by the occupant, in particular on the understanding of a section of a linguistic message by the occupant, can be determined as an influencing factor.

The influencing factor on the perception system can be a time function and / or a function of the driving distance of the vehicle 100 determined, in particular predicted. For example, a (in particular dynamic) “perception curve”, a (in particular dynamic) “disturbance curve”, a (in particular dynamic) “deflection curve”, and / or a (in particular dynamic) “curve of influencing the short-term memory”, which is a performance, disorder , and / or the occupancy of the short-term memory of an occupant is identified, determined, in particular predicted, and taken into account.

For example, such information (for example an influencing factor on the perception system) can be provided by means of the vehicle 100 generated and for example by means of an (adequately authorizable) interface for operating one in the vehicle 100 operable device 101 to provide.

In particular, a parameter (for example at least a simplified characteristic or an audiogram) of the perception system of a specific occupant can be determined (for example set, read into the vehicle, etc.) and taken into account. A concrete impact on the perception system, for example imminent in a few seconds, can be predicated depending on the determined properties of the perception system and / or identifying the expected impact on the perception system from the information. The audio system can in particular be controlled with foresight. A potential undesirable influence on the perception system of the occupant can be counteracted and / or a temporary improvement in the properties of the perception system can be used (for an audio signal 112 output).

• • hinsichtlich ihres Ausgabezeitpunkts vorverlegt, verschoben oder aufgeteilt werden;
• • hinsichtlich ihres Frequenzspektrums, Stimme, und/oder Intonation verändert werden; und/oder
• • in einer verkürzten oder ausführlicheren Form, z.B. in Bezug auf die Wortwahl und/oder in Bezug auf den Ausführlichkeitsgrad, erzeugt werden.

For example, if it is determined that an increased disturbance in the short-term memory of the occupant, in particular at certain time intervals, is or is to be expected, a measure can be taken with regard to the reproduction of an audio signal 112 to be hit. For example, a voice message (ie an audio signal 112 )

• • brought forward, postponed or divided in terms of their issue date;
• • are changed with regard to their frequency spectrum, voice, and / or intonation; and or
• • are generated in a shortened or more detailed form, for example in relation to the choice of words and / or in relation to the level of detail.

The audio system can be controlled not only based on current influences, but also based on a prediction of the influencing variable. In particular, a determined and / or predicted change in a frequency pattern and / or an acceleration pattern acting on an occupant can be determined and taken into account. In particular, the frequency pattern and / or the acceleration pattern can comprise or be a change parameter, e.g. a gradient (related to a quantity representing time and / or a quantity representing a space).

In another example, output of certain (short) sections of an audio signal 112 and / or processing sound waves in the vehicle 100 , for example for speech recognition in a time interval, between two relatively strong effects that exceed a certain limit value, depending on the frequency patterns and / or acceleration patterns. In other words, a “gap filling” can be carried out, for example between two particularly strong effects.

As part of the process 200 the influencing factor can be determined as a function of a frequency parameter and / or an acceleration parameter which relates to a vibration or an acceleration of at least one vehicle part, in particular a part of the passenger compartment of the vehicle 100 , and / or the occupant in the operation of the vehicle 100 relates.

In particular, the predicted influencing factor e.g. are determined and taken into account as a course or as a time function of the influencing factor. This course or this time function can be determined or predicted from the predicted physical influence on the passenger compartment.

A frequency pattern can preferably be taken into account as the frequency parameter. An acceleration pattern can preferably be taken into account as the acceleration parameter.

As part of the process 200 can the influence of the frequencies not per se inaudible by humans and / or a relatively frequently changing acceleration on the perception system of the at least one occupant of the vehicle 100 , in particular on the perception of the audible frequencies of a specific audio signal to be output 112 (Useful signal), determined and taken into account.

The human vestibular system (relevant for the sense of balance) is biologically related to the hearing system. The influence of vibrations of inaudible frequencies of <15 Hz (which are also perceived directly by the body) can influence the audibility of other audible frequencies, in particular the perception of music.

For example, it can influence an (especially subjective) perception of the sound waves of the audio signal 112 are at least partially avoided and / or compensated for by the occupant in a first audible frequency range, in particular the signal pattern (of interest to humans), by an influencing factor which relates to a second frequency, in particular in a frequency range which is not directly audible.

In the process 200 can take into account these influences of a subjectively perceived distortion or disturbance of the audio content in the vehicle 100 be counteracted. Furthermore, a deviation and / or a (above-average, below-average, and / or a certain) load on the so-called short-term memory of the occupant (driver or passenger) can be determined, for example predicted for a time interval in the next few seconds. The audio system can then be controlled in such a way that an audio signal 112 (e.g. a voice message that contains several pieces of information to be observed by the occupant), in particular with foresight. For example, if an increased disturbance of the human short-term memory due to the predicted effects (frequency pattern and / or vibration pattern) is to be expected in a certain time interval (information), information can be output to the occupant in a changed form. For example, a voice message can be formulated differently, or can be generated in a shortened or more detailed form. For example, a voice message can be output in this way that it contains as little information to be understood as possible, e.g. numbers.

As part of the process 200 can be an output parameter for an audio signal to be output 112 dynamically changed, in particular provided with a variable non-linear characteristic. For example, the output parameter can be changed dynamically with regard to the reproduction (or the image), the amplitude values, the frequency values, and / or the reproduction speed values (for example in the case of generated voice messages).

The output parameter can be changed in comparison to an output without influencing the perception system of the occupant and / or in comparison to an influencing of the perception system assumed to be average or average.

• • Sprachmitteilungen, insbesondere durch eine Sprachgenerierung,
• • Sprachinhalten, insbesondere von aufgezeichneten Sprachinhalten,
• • Telekommunikationsinhalten, und/oder
• • Musik, insbesondere je nach Stil,

erfolgt und/oder beabsichtigt wird, jeweils eine unterschiedliche Veränderung des Audiosignals 112 ausgeführt werden. Insbesondere können je nach Art des auszugebenden Audiosignals 112 unterschiedliche Funktionen zur Steuerung des Audiosystems abhängig von dem Einflussfaktor auf das Wahrnehmungssystem des Insassen verwendet werden.It may be differentiated between different types of audio signals to be output. For example, if the output of

• Voice messages, in particular through voice generation,
• • Voice content, especially recorded voice content,
• • Telecommunications content, and / or
• • music, especially depending on style,

takes place and / or is intended, a different change in the audio signal 112 be carried out. In particular, depending on the type of audio signal to be output 112 Different functions for controlling the audio system are used depending on the influencing factor on the occupant's perception system.

A frequency parameter can be a frequency pattern and / or an acceleration parameter can be an acceleration pattern. The respective pattern can be characterized, for example, by a form of the energy density spectrum and / or by a time profile, or one or more criteria can be recognized from these. As part of the process 200 a parameter of the audio system can be controlled as a function of a detection of the frequency pattern and / or the acceleration pattern. This is particularly advantageous because the perception system or the influencing factor on a person's perception system depend on the above-mentioned patterns of frequency and / or acceleration.

As part of the process 200 the frequency parameter and / or the acceleration parameter can be determined depending on the current or predicted noises of the drive train, depending on the noises of the chassis actuators (vertical dynamics, steering, braking, etc.) and / or depending on wind noises.

In particular, frequencies that can be heard immediately and frequencies that are not immediately audible, vibrations and corresponding patterns recognized on the basis of this data can be taken into account. The determination, in particular the prediction, of a frequency pattern and / or an acceleration pattern can, in particular, depend on a previously determined chassis condition in the near future and / or depending on the current and / or predicted exterior noise (e.g. the vehicle's own wind noise) 100 , other noise source, etc.) can be determined.

• • eine erkannte bzw. voraussichtliche manuelle oder z.B. geplante bzw. voraussichtliche automatische Gangschaltung bzw. Übersetzungsveränderung des (manuellen, halbautomatischen oder automatischen) Getriebes, und/oder
• • eine Veränderung der Antriebsart des Fahrzeugs 100, z.B. von zumindest teilweise Verbrennungsantrieb auf zumindest teilweise elektrischen Antrieb (oder umgekehrt), und/oder
• • eine, insbesondere prädizierte, Veränderung der Windgeräusche, z.B. bei einer Brücke, einem Tunnel, einem Fahrtrichtungswechsel, etc.

A change in an operating mode of the drive system of the vehicle that has taken place, is currently taking place or is likely to take place 100 be determined and taken into account. For example, the following can be determined and taken into account:

• • A recognized or expected manual or, for example, planned or expected automatic gear shift or change in gear ratio of the (manual, semi-automatic or automatic) transmission, and / or
• • a change in the drive type of the vehicle 100 , for example from at least partially combustion drive to at least partially electric drive (or vice versa), and / or
• • a, in particular predicted, change in wind noise, for example in the case of a bridge, a tunnel, a change of direction, etc.

As part of the process 200 can a temporal correspondence between the determined, in particular expected, frequency pattern and / or acceleration pattern, and an audio signal to be output 112 determined, in particular predicted, and taken into account. The parameter of the audio system can then be set or adjusted depending on a degree of temporal correspondence.

As part of the process 200 can be a parameter of the audio signal 112 and / or a time interval for outputting a section of the audio signal 112 depending on the frequency pattern and / or depending on the acceleration pattern and / or depending on a temporal correspondence between the determined, in particular expected, frequency pattern and / or acceleration pattern and an audio content to be output 112 be determined or adjusted. The content of a section that has not yet been output of the audio signal 112 , for example in the form of digital data that has already been read in or is available in a memory (intended for output).

• • im Fahrzeug entstehenden Vibrationen,
• • Einwirkungen, die von der Umgebung des Fahrzeug 100 induziert werden oder wurden, und/oder
• • einer aktuellen, insbesondere einer prädizierten, Resonanz im Fahrzeug 100.

A frequency parameter and / or an acceleration parameter can be determined depending on

• • vibrations occurring in the vehicle,
• • Effects from the surroundings of the vehicle 100 be or have been induced, and / or
• • a current, especially a predicted, resonance in the vehicle 100 .

For example, the influencing factor on an occupant's perception system may depend on one (at one or more points in the vehicle) 100 ) measured structure-borne noise. In other words, the sound output by an audio system (through the at least one parameter of the audio signal to be output 112 ) controlled, in particular regulated, depending on the structure-borne noise.

For example, a frequency pattern and / or an acceleration pattern with at least one microphone of the vehicle 100 and / or with a device for recording structure-borne noise, for example a structure-borne sound microphone (for example on the body of the vehicle 100 ), determined or recorded.

For example, echo effects (measured, predicted and / or derived from the history), e.g. when driving through a tunnel and / or when driving past a certain type of road user (e.g. a truck) and / or a certain lane boundary.

In a further example, which can be combined with all further features of the invention, the influencing factor on the perception system of an occupant can be determined depending on a visual content, the visual content being one of the occupant, in particular the driver, of the vehicle 100 identifiable or at least probably perceived visual content. It can, for example with a camera system 105 , an environment of the vehicle 100 detected and based on this a certain influencing factor (value of the influencing factor) on the visual perception system of the occupant, in particular the driver. In this case, a corresponding adjustment of a parameter of an audio system operated in the vehicle can be controlled, in particular regulated, depending on the value determined for a visual content which has an effect on the occupant or which has acted on the occupant in the near past.

For example, it can be determined that the visual perception system of the at least one occupant, in particular the driver, of the vehicle 100 is exposed to a relatively high, for example exceeding a certain limit, visual load and / or was exposed in a past time interval. An increased influencing factor on the (auditory) perception system of the occupant can then be concluded. For example, if it is determined that the occupant, in particular the driver, is exposed to relatively high light values, light fluctuations, glare, an increased influence of various visual information, for example certain lighting contrasts, spatial frequencies, light contrasts, number of traffic signs to be read or the like and / or in one exposed to the past time interval, this can be regarded as a (possibly also above-threshold) influencing factor on the occupant's perception system. In other words, depending on a determined, in particular estimated, influencing factor on the occupant's visual system, a conclusion can be drawn about a certain influencing factor (ascertainable according to a predetermined mathematical function), a state or a change in state of the hearing system, the vestibular system and / or the Short-term memory of the occupant can be made.

Detecting 201 An influencing factor can depend on the data of a backend system 110 and / or depending on data of one or more vehicles that have already traveled on the same or a similar section of the road. In particular, frequency patterns and / or acceleration patterns or information determined on the basis of the frequency pattern and / or acceleration pattern can be assigned to a specific location information and / or time information or read in depending on this information. Information (for example a control signal) for controlling the audio system, in particular for compensating for an influence of a frequency pattern and / or acceleration pattern within a route, can be assigned to a digital map. In other words, the lane data relating to frequency patterns and / or acceleration patterns for a lane section can be provided in connection with a digital map and in a vehicle 100 be used.

As part of the process 200 A state and / or a change in state of the perception system of the at least one occupant can be determined and taken into account. In particular, a parameter of the audio system in Depending on the state and / or the state change can be adjusted.

In other words, the (at least probable or determined with a certain approximation) state and / or the change in state of an occupant's perception system can be imaged, simulated and / or simulated using technical means. There is preferably no need for an immediate measurement or disturbance of the occupant.

For example, a (current, predicted, or applicable for a certain time interval in the near future or for the near past) state and / or state change of the perception system of the at least one occupant can be determined using a mathematical function, a state machine and / or one or more differential equations . Certain parameters (e.g. related to the occupant) can be determined for one or more states and / or changes in state. For example, the state and / or the change in state can be determined by means of a mathematical function, preferably a mathematical simulation, which is operated or calculated on the basis of the (continuously) determined influencing factor.

The condition can e.g. depict different types and / or degrees of influence. The transition between the states can take place on the basis of the determined influencing factor. Different occupants, e.g. different parameters are selected for certain people and / or for people from different age groups and / or different states or changes in the respective perception systems are determined.

For example, a degree of utilization of the hearing system, a degree of utilization of the sense of balance, a degree of utilization of the short-term memory and / or a transition to a more stressed and / or less stressed state can be determined.

The state of the perception system can depend on a relatively long period of time, e.g. longer than 1 minute, longer than 2 minutes, or longer than 5 minutes. This can e.g. depending on an integrated (over time) effect of the influencing factor.

A change in the state of the perception system can depend on a relatively short-term change in the influencing factor, e.g. less than 1 second, less than 2 seconds, or less than 5 seconds. This can e.g. depending on an integrated (over time) effect of the influencing factor.

As part of the process 200 a frequency parameter and / or a content parameter of the audio signal to be output can be dynamically determined or adapted depending on the determined frequency parameter and / or the determined acceleration parameter.

In particular, depending on the frequency response of the noise, which is derived in particular from the one or more acceleration values, a dynamic change in the frequency response of the audio signal to be output with the audio system 112 being controlled. The ratio and / or the equilibrium of the frequencies actually perceivable by the occupant can be adapted, in particular at least partially adjusted to a perception of the useful signal without the frequency pattern and / or acceleration pattern acting on it.

A change in the dynamic range of the audio signal to be output 112 can be determined or adjusted depending on the change in the influencing factor. The dynamic range of the audio signal to be output can 112 can be determined or adapted for different frequencies depending on the frequency pattern and / or acceleration pattern determined.

For example, with relatively little background noise, with a relatively low acceleration and / or with a relatively low vibration, a relatively large audible amplitude bandwidth can be set for audio reproduction. E.g. the dynamic range of the audio signal can be set higher in purely electric driving than in the case of broadband noise. This can be achieved by changing dynamic compression. In this way, the quality of the audio reproduction can be increased.

The influencing factor can be determined, in particular predicted, as a function of a parameter of the road condition of the relevant, in particular ahead, road section. A certain arrangement or frequency of bumps, thresholds, ruts, potholes, etc. can significantly influence human perception. A relatively bad road, an off-road area or a cobblestone street affects people's acoustic perception. An automatic adjustment of the audio system increases the comfort for an occupant of the vehicle 100 Increased, since, for example, the volume of the playback does not have to be adjusted manually (but is set automatically) if there is an uneven road.

The influencing factor or the state and / or the change in state of the occupant's perception system and consequently also a parameter of an audio signal to be output 112 can thus be determined essentially on the basis of digital map data. In this case, a correlation between map information and one with means of the vehicle can be preferred 100 determined frequency patterns or acceleration patterns are determined and taken into account. In particular, rapid changes that are predicted according to the digital map can be taken into account, depending on whether and to what extent these are measured in the vehicle 100 to match. If the correspondence is relatively high, values of the influencing factor which can be changed relatively quickly and which result from a digital map can also be taken into account.

A parameter of the audio system can be set as a function of the measured and / or pre-determined influences of the specific route (at the appropriate time). The change in a parameter of the audio system can be adapted, if necessary in hardly noticeable steps, in particular depending on an interpolated function and / or a curve envelope.

In another example, the audio signal 112 comprise at least two audio signals of different types (e.g. a music signal and a voice message) for a (certain) occupant, and / or at least two audio signals which are at least predominantly intended for at least two different occupants, e.g. for the driver and for a passenger.

In another example, the audio signal 112 comprise an audio signal to be output, for example a signal which is based on data which has already been read in or is intended for output, for example an entertainment or music program. Alternatively or additionally, the audio signal 112 include an auditory message, in particular a voice message, which is or is to be generated or output on the basis of data that is not yet available and may still have to be generated.

If two different types of audio signals (e.g. a first audio signal and an auditory message) are to be output within a comparatively short time interval, then a parameter of a section of the first audio signal to be output and a parameter of the at least one auditory message can be almost simultaneously or in a specific one Dependency on each other. The adaptation can be carried out taking into account the state or changes in the state of the occupant's perception system.

In one example, one or more time parameters can be used to output at least a section of the (first) audio signal and / or the at least one auditory message, in particular characterizing a time interval or an event, depending on which the output of at least a section of the audio signal 112 and / or at least one auditory report is to be made, determined or adjusted. In other words, the outputs of one or more sections of the (first) audio signal and / or the auditory message can be adjusted on or along a time axis.

In a further example, a distribution of the output of the (first) audio signal or a distribution of the output of individual channels of the (first) audio signal or a distribution of the output of the at least one auditory message to different spatial areas of the interior of the vehicle 100 respectively. For example, if the auditory message is predominantly for the driver of the vehicle 100 is determined, a parameter of a section of an (additional) audio signal to be output in the same time interval 112 be reduced in the immediate vicinity of the driver (eg the driver's seat and / or the driver's head). Thus, the driver can be caused so that the driver does not miss an auditory message while other occupants of the vehicle 100 have almost no disadvantage with regard to the perception of the (first) audio signal.

The sound waves generated on the basis of the (first) audio signal and / or the at least one auditory message, in particular one or more specific (to be generated) sound wave patterns, can, in particular in one or more specific spatial areas, assign at least one current or specific section of the (first) audio signal or the auditory message for one or more specific, e.g. virtual sound sources, in particular synthesized sound sources. By assigning a (first) audio signal or an auditory message to a sound source, the quality of perception for an occupant can be increased.

In another example, a surround parameter of the audio signal 112 be determined or adjusted. By determining or adapting the at least one surround sound parameter, specific, expedient surround sound effects can be induced, which have an effect on the output of certain sections of the (first) audio signal to be output and / or the at least one auditory message. For example, a surround sound parameter indicates from which direction and / or in which direction the sound waves generated on the basis of the (first) audio signal or on the basis of the at least one auditory message are to be output or made perceptible. The surround sound parameter can also be characteristic of the parameters of at least one sound source, in particular a sound source generated by means of the wave field synthesis. For example, the surround sound parameter can be characteristic of a perceptible distance and / or a direction from which this, in particular from a certain spatial area of the interior of the vehicle 100 , should be made perceptible. For example, depending on the spatial sound parameter determined, a wave field synthesis is carried out.

In a further example, an envelope of the amplitude and / or the frequency density spectrum or a corresponding parameter of the sound waves can be changed on the basis of the at least one auditory message or the (first) audio signal to be output. In particular, the parameter can determine a control of the amplitude dynamics or dynamic compression of the at least one auditory message or the (first) audio signal. When using dynamic or bandwidth compression, a section of an auditory message e.g. are highlighted from a frequency spectrum range that is temporarily less noticeable for the occupant. In a further example, the tones, tone sequences, melodies or noises can be selected or adapted for the at least one auditory message.

As part of the process 200 For example, a determination or adaptation of one or more parameters of the (first) audio signal to be output and / or of one or more parameters of the at least one auditory message can be carried out, in particular continuously or cyclically. In particular, this can be carried out in such a way that a certain first (possibly adjustable) limit parameter for minimum perceptibility, in particular for one or more specific occupants, for example for the driver, is not undershot and / or a certain second (possibly adjustable) Limit parameters for a maximum parameter value, in particular for one or more specific occupants, for example for the driver, are not exceeded. In particular, a parameter of the in the vehicle 100 operated audio system are adapted such that the sound waves of the two types of audio signals mentioned here as examples 112 (a (first) audio signal to be output and / or an auditory message), in particular overall, lie within the bandwidth between the first limit parameter and the second limit parameter. Depending on the determined influencing factor on the perception system of an occupant of the vehicle 100 a “compromise” or a “balance” between the perceptibility of the section of an audio signal to be output and / or an auditory message, in particular a voice message.

Furthermore, a device is described in this document, possibly comprising at least one mobile user device, which is set up to carry out the described method. A corresponding computer product, in particular an app, is also described. The device described can comprise a mobile user device with an expediently configured interface for the active connection with a vehicle 100 to at least part of the process 200 to execute.

The measures described in this document can improve the subjective perception of an occupant of a vehicle 100 be improved. In particular, the audibility and the subjectively perceived audio quality, in particular for music, can be optimized. Furthermore, the volume required to perceive or process audio signals can be reduced (at least on average, statistically). The physical through a speaker 102 Sound pressure generated can thus be reduced (at least on average). The load on an occupant's hearing system can thus be reduced. Furthermore, the reduced speaker power can reduce energy consumption. Overloading the short-term memory of an occupant can also be counteracted. Important voice messages in a vehicle 100 do not always have to be played back, but only if necessary, relatively loudly. Furthermore, the measures described can reduce the costs of an audio system.

The present invention is not restricted to the exemplary embodiments shown. In particular, it should be noted that the description and the figures are only intended to illustrate the principle of the proposed methods, devices and systems. These can be freely combined with all other features identified in this document.

Claims (16)

Method (200) for operating an audio system in a vehicle (100); wherein the method (200) comprises - determining (201), in particular predicting, an influencing factor currently or in the future influencing a perception system of an occupant of the vehicle (100); and - adjusting (202) a parameter of an audio system operated in the vehicle (100) in Dependence on the influencing factor on the occupant's perception system. Method (200) according to Claim 1 The parameter of the audio system is adapted dynamically in dependence on a time-changing influencing factor such that a perception of an audio signal (112) output by the audio system (112) changed by the time-changing influencing factor is at least partially avoided, compensated for and / or compensated for. The method (200) according to any one of the preceding claims, wherein - the influencing factor is frequency invariant; and or - The influencing factor indicates a frequency-dependent influence on the occupant's perception system for a large number of different frequency ranges. The method (200) according to any one of the preceding claims, wherein the method (200) comprises determining, in particular predicting, a frequency parameter with respect to an oscillation frequency of a part, in particular a passenger compartment, of the vehicle (100) and / or determining, in particular predicting, an acceleration parameter with respect to an acceleration of a part, in particular a passenger compartment, of the vehicle (100); and - The influencing factor is determined as a function of the frequency parameter and / or as a function of the acceleration parameter; - The frequency parameter comprises in particular a spectral and / or temporal frequency pattern; and - The acceleration parameter in particular comprises a temporal acceleration pattern. Method (200) according to Claim 4 , wherein the frequency parameter and / or the acceleration parameter are determined on the basis of - a noise in a drive train of the vehicle (100); - A noise of a chassis actuator of the vehicle (100); - wind noise; - A vibration occurring in the vehicle (100); - an action induced by an environment of the vehicle (100); and / or - a current or predicted resonance in the vehicle (100). Method (200) according to one of the Claims 4 to 5 , wherein - the method (200) comprises determining, in particular predicting, a degree of correspondence of an audio signal (112) to be output with a frequency pattern and / or an acceleration pattern; and - the parameter of the audio system is adapted as a function of the determined degree of agreement. The method (200) according to any one of the preceding claims, wherein adjusting a parameter of the audio system comprises - adjusting an output parameter of an audio signal (112) to be output by the audio system; and or - Adjusting a time interval for outputting at least a portion of an audio signal (112) to be output by the audio system. The method (200) according to any one of the preceding claims, wherein - The method (200) comprises determining an impact function that indicates an impact of a vibration in a frequency range inaudible to a human being on an audible frequency range of an auditory perception system of the occupant; - The method (200) comprises determining, in particular predicting, vibration information relating to an inaudible vibration currently or in the future acting on the occupant's perception system; and - The influencing factor is determined on the basis of the vibration information and on the basis of the impact function. The method (200) according to any one of the preceding claims, wherein - The method (200) comprises adjusting an output parameter of an audio signal (112) output by the audio system as a function of the influencing factor; - The output parameter, in particular an amplitude of the audio signal (112), a frequency parameter of the audio signal (112), a content-related parameter relating to a content of the audio signal (112), a playback speed of the audio signal (112) and / or a spectral composition of the audio signal (112 ) includes; and - The output parameter is adapted in particular by means of a non-linear characteristic with respect to different frequencies and / or with respect to different times. Method (200) according to one of the preceding claims, wherein the method (200) comprises - determining, in particular predicting, a section of roadway that the vehicle is currently traveling on or will be driven on in the future; - determining roadway data relating to the roadway section from a vehicle-external unit (110); and - determining, in particular predicting, the influencing factor based on the roadway data. The method (200) according to any one of the preceding claims, the method (200) comprising - Determination of roadway data in relation to the road surface condition of a roadway currently or in the future; and - Determine, in particular predict, the influencing factor based on the roadway data. The method (200) according to any one of the preceding claims, the method (200) comprising - Determining a state and / or a change in state of the occupant's perception system, in particular as a function of the influencing variable; and - Adjusting the parameter of the audio system depending on the state and / or the change in state of the occupant's perception system. The method (200) according to any one of the preceding claims, the method (200) comprising - Determining a change in the influencing factor over time; and - Adjusting a range of dynamics of an audio signal (112) to be output by the audio system as a function of the change in the influencing factor over time. The method (200) according to any one of the preceding claims, the method (200) comprising - determining information relating to visual content that affects the occupant of the vehicle (100), in particular regarding an extent of visual content acting on the occupant; and - Determine the influencing factor based on the information relating to visual content. Device (101) for a vehicle (100); the device (101) being set up, - to determine, in particular to predict, an influencing factor currently or in the future influencing a perception system of an occupant of the vehicle (100); and - Adapt a parameter of an audio system operated in the vehicle (100) as a function of the influencing factor on the perception system of the occupant. Computer program, in particular a computer program product, comprising a computer program, the computer program being designed, when executed on at least one computing unit, one or more steps of the method (200) according to at least one of the Claims 1 to 14 to execute.

Images