WO2018228404A1

WO2018228404A1 - System and method for automatically adjusting sound effect modes of onboard audio

Info

Publication number: WO2018228404A1
Application number: PCT/CN2018/090965
Authority: WO
Inventors: 史晓磊; 张蕊; 于尔根; 俞斌
Original assignee: 蔚来汽车有限公司
Priority date: 2017-06-14
Filing date: 2018-06-13
Publication date: 2018-12-20
Also published as: TW201906416A; CN107392094A

Abstract

The present invention relates to the technical field of automobile audio, in particular to a system and method for automatically adjusting sound effect modes of onboard audio in an automobile. In order to solve the problem of a user only being able to manually adjust different sound effect modes in a traditional sound system, the system for automatically adjusting the sound effect modes of an onboard audio system provided by the present invention comprises: a passenger distribution identification unit, used for identifying position distribution information of passengers in a vehicle; and an audio processing unit, capable of adjusting sound effect modes of onboard audio according to the position distribution information of passengers in the vehicle, wherein the audio processing unit establishes in advance a corresponding relationship between the sound effect modes of the onboard audio and the position distribution information of passengers in the vehicle. By means of the technical solution of the present invention, the sound effect modes of onboard audio are adjusted according to the position distribution information of passengers in the vehicle, so that the passengers in the vehicle may hear the best sound effect without requiring manual adjustment by a user, thereby greatly improving the user experience.

Description

System and method for automatically adjusting car audio sound mode

Technical field

The invention belongs to the technical field of car audio, and particularly relates to a system and a method for automatically adjusting a car audio sound mode of a car.

Background technique

As more and more cars enter ordinary homes, the use of cars becomes more frequent, and cars become more intelligent and user-friendly. Car audio as a must-have entertainment device for cars, its sound effects directly affect the driving experience, for different positions of the passengers, often need to set different sound modes to get the best results. At present, passengers with different seats have been specially optimized for sound effects (such as frequency response, phase, delay, etc.) to form different sound modes, such as driver mode, front mode, rear mode, and full car. Mode and more. Each sound mode will optimize the sound that the corresponding passenger hears, and may reduce the sound at other locations.

However, for the traditional car audio, the user can only manually adjust different sound modes, such as the desired sound mode after the operation of the multi-level menu, especially in the process of driving the vehicle, if the operation of the multi-level menu still exists A certain security risk.

Accordingly, the present invention requires a new system and method to solve the above problems.

Summary of the invention

In order to solve the above problems in the prior art, the present invention provides a system for automatically adjusting a car audio sound mode, the system comprising: a passenger distribution identification unit for identifying position distribution information of a passenger in the vehicle; an audio processing unit And adjusting the vehicle audio sound mode according to the position distribution information of the passenger in the vehicle; wherein the audio processing unit pre-establishes a correspondence relationship between the vehicle audio sound mode and the distribution information of the passenger position in the vehicle.

In a preferred embodiment of the above system for automatically adjusting a car audio sound mode, the passenger distribution identifying unit includes: an image capturing device configured to acquire image data of each seat; an image recognition module, the image The identification module is configured to identify a face position in the image data, and determine location distribution information of the passenger in the vehicle based on the face position.

In a preferred embodiment of the system for automatically adjusting a car audio sound mode, the image recognition module is pre-established with a first model and a second model, wherein: the first model is a face position recognition model, and the first model Capturing the face position by the image data; the second model is a model of a correspondence between a face position and a seat in the vehicle, and the second model is capable of obtaining position distribution information of the passenger in the vehicle through the face position .

In a preferred embodiment of the above system for automatically adjusting a car audio sound mode, the audio processing unit includes an in-vehicle multimedia player, an external power amplifier and a speaker, and the in-vehicle multimedia player is used to distribute the position of the passenger in the vehicle. The information adjusts the car audio sound mode, and sends an instruction to the external power amplifier; the external power amplifier extracts a tuning parameter corresponding to the car audio sound mode according to the received command, and passes the speaker based on the tuning parameter Play sounds into the car.

In a preferred embodiment of the system for automatically adjusting the car audio sound mode described above, the passenger position within the vehicle includes: a driver's seat, a passenger's seat, and a rear row.

The present invention also provides a method for automatically adjusting a car audio sound mode, the method comprising the steps of: acquiring position distribution information of a passenger in the vehicle; and adjusting a car audio sound mode according to the position distribution information of the passenger in the vehicle; wherein A corresponding relationship is established in advance between the in-vehicle audio sound mode and the position distribution information of the in-vehicle passenger.

In a preferred embodiment of the method for automatically adjusting the in-vehicle audio sound mode, the step of "acquiring position distribution information of the in-vehicle passengers" specifically includes: acquiring image data of each seat; identifying a face position in the image data; The location of the face obtains location distribution information of the passengers in the vehicle; wherein the relationship between the face position and the seat in the vehicle is pre-established.

In a preferred embodiment of the method for automatically adjusting a car audio sound mode, the step of "recognizing a face position in the image data" specifically includes: recognizing a face in the image data by using a face detection algorithm; The established face position recognition model calculates the face position.

In a preferred embodiment of the method for automatically adjusting the in-vehicle audio sound mode, the step of "adjusting the in-vehicle audio effect mode according to the position distribution information of the in-vehicle passenger" further includes: extracting a tuning corresponding to the in-vehicle audio sound mode a parameter; playing a sound into the car through the speaker based on the tuning parameter.

In a preferred embodiment of the above method of automatically adjusting a car audio sound mode, the passenger position in the vehicle includes a driver's seat, a passenger's seat, and a rear row.

Through the technical solution of the present invention, the car audio sound mode is adjusted according to the position distribution information of the passengers in the vehicle, and the passengers in the car can hear the best sound effect without the manual adjustment by the user, thereby greatly improving the user experience. Moreover, the image data of each seat in the vehicle is collected by the camera image acquisition device, and then the image data is processed to learn the position distribution information of the passengers in the vehicle, and the position distribution information of the passengers in the vehicle can be accurately and real-time determined. Through the correspondence between the pre-established car audio sound mode and the distribution information of the passenger position in the car, it is ensured that the adjusted sound mode enables the driver and the passenger to hear the best sound effect.

DRAWINGS

1 is a schematic structural view of a system for automatically adjusting a car audio sound mode of the present invention;

2 is a schematic view showing the position of the system for automatically adjusting the car audio sound mode in the vehicle according to the present invention;

3 is a schematic flow chart of a method for automatically adjusting a car audio sound mode according to the present invention;

4 is a schematic flow chart showing the position distribution information of the passengers in the vehicle in the method of automatically adjusting the in-vehicle audio sound mode of the present invention.

detailed description

Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the scope of the present invention.

The traditional way of adjusting the car audio sound mode needs to rely on manual. In order to make the vehicle more intelligent and user-friendly, the present invention provides a system for automatically adjusting the car audio sound mode. As shown in FIG. 1, the system includes a passenger distribution identification unit and an audio processing unit. The passenger distribution identification unit is mainly used to identify position distribution information of passengers in the vehicle, and the vehicle audio sound mode and the passenger position in the vehicle are pre-established based on the audio processing unit. The correspondence relationship of the distribution information, the audio processing unit can adjust the car audio sound mode according to the position distribution information of the passengers in the car. Specifically, firstly, the acoustic characteristics (such as frequency response, phase, etc.) of each seat are collected, and then subjective tuning is performed separately for each selected position, for example, a professional tuner separately adjusts different selected positions. Tones, so that every selected position can get the best audio. The selected position (ie, the position distribution of the passengers in the vehicle) may be the position of each individual seat (such as the driver's seat, the front passenger seat, the rear seat, etc.), or any two or three of the seat combinations. In the rear position, all seats in the whole car can also be selected as one position. Then, the tuning parameters obtained by subjective tuning for each selected position are saved as a sound mode, so that each selected position corresponds to one sound mode. That is to say, different sound modes are set for the different distribution of passengers in the car, so that the passengers can obtain the best audio effect regardless of the position in the car.

Since the correspondence between the position distribution of the in-vehicle passengers and the in-vehicle audio sound mode is established in advance, when the audio processing unit receives the position distribution information of the in-vehicle passengers, it can be directly adjusted to correspond to the position distribution of the in-vehicle passengers. In the sound mode, the corresponding tuning parameters are then adjusted according to the adjusted sound mode, and then the sound is played to the passengers in the car to optimize the sound heard by the passengers in the car.

It can be understood by those skilled in the art that the passenger distribution identification unit can acquire the passenger distribution information in the vehicle in various ways. For example, by setting a pressure sensor under each seat, the distribution of the passengers in the vehicle can be determined according to the signal of the pressure sensor. This mode will not be described in detail here. A specific implementation of obtaining passenger distribution information in a car is described below.

With continued reference to FIG. 1, the passenger distribution identification unit includes an image capture device and an image recognition module. In this embodiment, the image capturing device may be a camera. As a preferred embodiment, the camera may be disposed at a central position in front of the vehicle to facilitate acquiring image data of each seat, that is, acquiring an image in the vehicle; The face position in the in-vehicle image is identified, and based on the face position, the position distribution information of the in-vehicle passenger is determined. Specifically, firstly, the internal parameters of the camera, such as the focal length of the camera, the field of view, etc., need to be calibrated, and then the image recognition module establishes the first model and the second model on the basis of the camera internal calibration. The first model is a face position recognition model. After the camera acquires the image in the car, the face detection algorithm is used to calculate the position of the face in the image in the car. The second model is a model of the correspondence between the position of the face and the seat in the vehicle. After calculating the position of the face in the image of the vehicle, the position distribution of the passenger in the vehicle is obtained according to the correspondence between the position of the face and the seat in the vehicle.

Those skilled in the art can understand that in the process of processing the image in the vehicle, first establish a coordinate system, then map each seat in the vehicle into the coordinate system, and establish the position of the seat and the face of the vehicle. Corresponding relationship, for example, makes each seat correspond to a delineated area. When the face position is located in the area, it indicates that there is a passenger on the corresponding seat in the area; when the face position is not located in the area ( That is, no face is detected in the area, indicating that there are no passengers in the corresponding seat in the area. Thereby the position distribution of the passengers in the car is obtained. More specifically, reference may be made to known image processing techniques, and details of how the images are processed will not be described here.

Further, after the passenger distribution identification unit acquires the position distribution information of the passenger in the vehicle, it transmits it to the audio processing unit. With continued reference to Figure 1, the audio processing unit includes a car multimedia player, an external power amplifier, and a speaker. Wherein, after receiving the position distribution information of the passengers in the vehicle, the vehicle-mounted multimedia player obtains a car audio sound mode corresponding to the position distribution of the received passengers according to the corresponding relationship between the position distribution information of the passengers in the vehicle and the car audio sound mode. And sending an instruction to the external power amplifier; the external power amplifier extracts the tuning parameter corresponding to the car audio sound mode according to the received command, and plays the sound through the speaker to the car based on the tuning parameter, so that the passenger in the car hears The best sound effects. The “command” can be understood as a control command for controlling the external power amplifier to adjust the corresponding tuning parameter after the car multimedia player adjusts the sound mode, and the external power amplifier executes the control command sent by the vehicle multimedia player, that is, The tuning parameters corresponding to the adjusted tuning parameters are retrieved.

In a possible implementation manner, referring to FIG. 2, FIG. 2 is a schematic diagram showing the position of the system for automatically adjusting the car audio sound mode of the present invention in the vehicle. As shown in FIG. 2, the camera 1 is installed directly in front of the vehicle; the image recognition module 2 can be embedded in the main control unit in the vehicle, and can receive the image of the car collected by the camera 1; the car multimedia player can be placed in front of the vehicle. On the control panel, the car multimedia player is omitted in FIG. 2; the external power amplifier can be placed at the rear end of the vehicle for receiving the command sent by the car multimedia player, and the corresponding tuning parameter is obtained according to the instruction; the speaker 4 It can be set to four and evenly distributed inside the car to play sound into the car.

According to the technical solution of the present invention, the position distribution information of the passengers in the vehicle can be accurately and real-time determined, and the car audio sound mode can be adjusted according to the position distribution information of the passengers in the vehicle, and the driver can be driven in the vehicle without manually adjusting the sound mode. The passengers hear the best sound effects and greatly enhance the user experience.

In another aspect, the present invention also provides a method of automatically adjusting a car audio sound mode. As shown in FIG. 3, the method includes the following steps: S110: acquiring position distribution information of passengers in the vehicle; S120, adjusting a car audio sound mode according to position distribution information of the passengers in the vehicle.

Wherein, in step S110, the location distribution information of the passengers in the vehicle is acquired, and the manner of setting the pressure sensor in each seat may be performed in various manners. The method provides a specific implementation for obtaining location distribution information of passengers in the vehicle. Referring to FIG. 4, FIG. 4 is a schematic flow chart of obtaining position distribution information of passengers in a vehicle. As shown in FIG. 4, the method includes the following steps: S210: acquiring image data of each seat; S220, identifying a face in the image data by using a face detection algorithm; S230, calculating a face according to a pre-established face position recognition model Position; S240, based on the position of the face, obtaining position distribution information of the passengers in the vehicle. Among them, there is a corresponding relationship between the face position and the seat in the car.

In the above steps S210-S240, the position distribution information of the passengers in the vehicle can be obtained by the camera and the image recognition module. For details, refer to the above description, and details are not described herein again. In this embodiment, the passenger position in the vehicle includes: a driving position, a passenger seat position, and a rear row.

The method of the invention can accurately and real-timely determine the position distribution information of the passengers in the vehicle, and adjust the car audio sound mode according to the position distribution information of the passengers in the vehicle, so that the passengers can be best heard without the user manually adjusting the sound mode. The sound effect greatly enhances the user experience.

Heretofore, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the drawings, but it is obvious to those skilled in the art that the scope of the present invention is obviously not limited to the specific embodiments. Those skilled in the art can make equivalent changes or substitutions to the related technical features without departing from the principles of the present invention, and the technical solutions after the modifications or replacements fall within the scope of the present invention.

Claims

A system for automatically adjusting a car audio sound mode, wherein the system comprises:

a passenger distribution identification unit for identifying location distribution information of passengers in the vehicle;

An audio processing unit capable of adjusting a car audio sound mode according to position distribution information of the passenger in the vehicle;

The audio processing unit pre-establishes a correspondence relationship between the car audio sound mode and the distribution information of the in-vehicle passenger position.
The system for automatically adjusting a car audio sound mode according to claim 1, wherein the passenger distribution identification unit comprises:

An image capture device configured to be capable of acquiring image data of each seat;

And an image recognition module, configured to identify a face position in the image data, and determine location distribution information of the passenger in the vehicle based on the face position.
The system for automatically adjusting a car audio sound mode according to claim 2, wherein the image recognition module is pre-established with a first model and a second model, wherein:

The first model is a face location recognition model, and the first model is capable of acquiring a face position by using the image data;

The second model is a model of a correspondence between a face position and a seat in the vehicle, and the second model is capable of obtaining position distribution information of the passenger in the vehicle through the face position.
The system for automatically adjusting a car audio sound mode according to claim 1, wherein the audio processing unit comprises an in-vehicle multimedia player, an external power amplifier and a speaker.

The in-vehicle multimedia player is configured to adjust an in-vehicle audio sound mode according to position distribution information of the in-vehicle passenger, and send an instruction to the external power amplifier;

The external power amplifier extracts a tuning parameter corresponding to the car audio sound mode according to the received command, and plays a sound into the car through the speaker based on the tuning parameter.
The system for automatically adjusting a car audio sound mode according to any one of claims 1 to 4, characterized in that the passenger position in the vehicle includes: a driver's seat, a passenger's seat and a rear row.
A method for automatically adjusting a car audio sound mode, characterized in that the method comprises the following steps:

Obtaining location distribution information of passengers in the vehicle;

Adjusting the car audio sound mode according to the position distribution information of the passenger in the car;

Wherein, a corresponding relationship is established between the in-vehicle audio sound mode and the position distribution information of the in-vehicle passenger.
The method of automatically adjusting a car audio sound mode according to claim 6, wherein the step of "acquiring position distribution information of the passengers in the car" comprises:

Obtaining image data of each seat;

Identifying a face position in the image data;

Obtaining location distribution information of the passengers in the vehicle based on the face position;

Among them, there is a corresponding relationship between the face position and the seat in the car.
The method of automatically adjusting a car audio sound mode according to claim 7, wherein the step of "identifying a face position in the image data" comprises:

Identifying a face in the image data by using a face detection algorithm;

The face position is calculated based on the pre-established face position recognition model.
The method of automatically adjusting a car audio sound mode according to claim 6, wherein the step of: adjusting the car audio sound mode according to the position distribution information of the passenger in the vehicle further comprises:

Extracting a tuning parameter corresponding to the car audio sound mode;

Sound is played into the car through the speaker based on the tuning parameters.
The method of automatically adjusting a car audio sound mode according to any one of claims 6 to 9, wherein the passenger position in the vehicle includes a driving position, a passenger seat position, and a rear row.