CN113291247A - Method and device for controlling vehicle rearview mirror, vehicle and storage medium - Google Patents

Method and device for controlling vehicle rearview mirror, vehicle and storage medium Download PDF

Info

Publication number
CN113291247A
CN113291247A CN202110560019.1A CN202110560019A CN113291247A CN 113291247 A CN113291247 A CN 113291247A CN 202110560019 A CN202110560019 A CN 202110560019A CN 113291247 A CN113291247 A CN 113291247A
Authority
CN
China
Prior art keywords
vehicle
target object
target
sound source
rearview mirror
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110560019.1A
Other languages
Chinese (zh)
Inventor
张家文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Xiaopeng Motors Technology Co Ltd
Original Assignee
Guangzhou Xiaopeng Motors Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Xiaopeng Motors Technology Co Ltd filed Critical Guangzhou Xiaopeng Motors Technology Co Ltd
Priority to CN202110560019.1A priority Critical patent/CN113291247A/en
Publication of CN113291247A publication Critical patent/CN113291247A/en
Priority to PCT/CN2022/093007 priority patent/WO2022242589A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The application discloses a control method and device for a vehicle rearview mirror, a vehicle and a storage medium, wherein the method comprises the following steps: acquiring a sound source position of a target object, wherein the sound source position is used for representing the spatial position of a sounding organ of a sound emitted by the target object; determining binocular positions of the target object according to the sound source position; and adjusting the vehicle rearview mirror to a target position according to the binocular positions, so that the vehicle rearview mirror is adjusted by utilizing sound source positioning, and great convenience is brought to a user for driving a vehicle.

Description

Method and device for controlling vehicle rearview mirror, vehicle and storage medium
Technical Field
The present disclosure relates to the field of vehicle control technologies, and in particular, to a method and an apparatus for controlling a vehicle rearview mirror, a vehicle, and a storage medium.
Background
The rearview mirrors are tools for a driver sitting on a cab seat to directly acquire external information such as the rear, side and lower parts of the automobile. In order to facilitate the operation of a driver, prevent the occurrence of driving safety accidents and guarantee the personal safety, all countries stipulate that the rearview mirrors must be installed on the vehicle, and all the rearview mirrors must be capable of adjusting the direction.
Since the position of the rearview mirror is directly related to whether the driver can observe the road condition behind the vehicle, the driver is difficult to adjust the position of the rearview mirror. Therefore, the rearview mirrors of the existing vehicles are basically electrically adjusted, and a driver operates the rearview mirrors through an electric control system, but the electrically adjusted rearview mirrors require the driver to repeatedly adjust buttons, so that the driver spends more time and is very inconvenient.
Disclosure of Invention
The embodiment of the application provides a control method and device for a vehicle rearview mirror, a vehicle and a storage medium.
In a first aspect, some embodiments of the present application provide a method for controlling a vehicle rearview mirror, the method including: the method comprises the steps of obtaining a sound source position of a target object, wherein the sound source position is used for representing the spatial position of a sounding organ which makes sound by the target object, determining the binocular position of the target object according to the sound source position, and adjusting a vehicle rearview mirror to the target position according to the binocular position.
In a second aspect, some embodiments of the present application further provide a control apparatus for a vehicle rearview mirror, the apparatus including: the acquisition module is used for acquiring the sound source position of the target object, and the sound source position is used for representing the spatial position of a sounding organ which emits sound by the target object; the determining module is used for determining the binocular positions of the target objects according to the sound source positions; and the adjusting module is used for adjusting the vehicle rearview mirror to the target position according to the binocular position.
In a third aspect, some embodiments of the present application further provide a vehicle, including a microphone array, a processor, and a memory, where the memory stores computer program instructions, and the computer program instructions, when called by the processor, execute the control method of the vehicle rearview mirror.
In a fourth aspect, the present application also provides a computer-readable storage medium, which stores program codes, wherein the program codes, when executed by a processor, implement the control method of the vehicle rearview mirror.
The application provides a control method and device of a vehicle rearview mirror, a vehicle and a storage medium, wherein the sound source position of a target object is obtained, the sound source position is used for representing the spatial position of a sounding organ of the target object, the binocular position of the target object is determined according to the sound source position, and further the vehicle rearview mirror is adjusted to the target position according to the binocular position. Therefore, the sound source positioning is combined with the adjustment of the rearview mirror of the vehicle, so that the vehicle can automatically adjust the rearview mirror to the optimal position according to the binocular position of the driver, the adjustment efficiency of the rearview mirror is effectively improved, and convenience is brought to driving of the driver.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 shows a schematic application scenario of a control method for a vehicle rearview mirror according to an embodiment of the present application.
Fig. 2 shows a schematic distribution diagram of a vehicle microphone array provided by an embodiment of the present application.
Fig. 3 shows a block diagram of connection between a microphone array and vehicle hardware provided by an embodiment of the present application.
Fig. 4 shows a flow chart of a control method of a vehicle rearview mirror provided by an embodiment of the application.
Fig. 5 is a schematic application scenario diagram illustrating a control method for a vehicle rearview mirror according to an embodiment of the present application.
Fig. 6 shows a flow chart of a control method of a vehicle rearview mirror provided in an embodiment of the present application.
Fig. 7 shows a flowchart of step S210 in the control method of the vehicle mirror of fig. 6.
Fig. 8 is a schematic two-dimensional plane diagram of a sound source localization algorithm provided by an embodiment of the present application.
Fig. 9 shows a flowchart of step S240 in the control method of the vehicle mirror of fig. 6.
Fig. 10 is a schematic view illustrating an application scenario of a control method for a vehicle rearview mirror according to an embodiment of the present application.
Fig. 11 shows a flowchart of step S250 in the control method of the vehicle mirror of fig. 6.
Fig. 12 is a flowchart illustrating a control method for a vehicle rearview mirror according to an embodiment of the present application.
Fig. 13 is a flowchart illustrating a control method for a vehicle rearview mirror according to an embodiment of the present application.
Fig. 14 shows a block diagram of a control device of a vehicle rearview mirror according to an embodiment of the present application.
FIG. 15 is a block diagram of a vehicle according to an embodiment of the present disclosure.
Fig. 16 is a block diagram of a computer-readable storage medium according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.
In order to make the technical solutions of the present application better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The rearview mirror is used as an essential accessory of a vehicle and plays an important role in driving safety of a driver. In order to clearly observe the road condition behind the vehicle, the driver can adjust the actual position of the driver seat according to the actual position of the driver seat, for example, the driver manually adjusts the rearview mirror to the visual field position meeting the driving requirement of the driver by using a rearview mirror adjusting key. The visual field position is usually determined by the specific positions of the two eyes of the driver during driving.
Since the same vehicle or the same type of vehicle can be driven by several people with different body proportions, for example, different family members drive the same vehicle, different taxi drivers drive the same type of vehicle, and the drivers with different body proportions must adjust the position of the rearview mirror according to their own needs. Furthermore, the driving posture of the driver may be constantly changed while the vehicle is running, which also makes adjustment of the rear view mirror troublesome.
In order to solve the above problems, the inventors have made extensive studies to provide a method for controlling a vehicle mirror according to an embodiment of the present application, which includes obtaining a sound source position of a target object, the sound source position being used to represent a spatial position of a sound organ from which the target object emits sound, determining a binocular position of the target object according to the sound source position, and further adjusting the vehicle mirror to the target position according to the binocular position. Thus, the sound source localization is combined with the adjustment of the vehicle's rearview mirrors so that the vehicle can dynamically adjust the rearview mirrors to the optimal positions automatically according to the binocular positions of the driver. The following first describes an application scenario of the control method for the vehicle rearview mirror according to the present application.
As shown in fig. 1, in some embodiments, the control method of the vehicle rearview mirror provided in the embodiments of the present application may be applied to a control system 400 of the vehicle rearview mirror, where the control system 400 of the vehicle rearview mirror includes a microphone array and a vehicle rearview mirror 420. Wherein the microphone array may include a plurality of microphones 410, and the vehicle rear view mirror may include an exterior rear view mirror or/and an interior center rear view mirror.
Alternatively, a plurality of microphones 410 may be installed at different positions in the vehicle compartment, respectively, for picking up the voice uttered by the driver. As shown in fig. 2, a microphone array formed by a plurality of microphones 410 is installed at different positions on the roof of the vehicle cabin, and it should be noted that the distribution positions and the number of the plurality of microphones 410 may be arranged according to the specific vehicle type.
For example, a two-row seated vehicle model may employ an arrangement of 4 microphones, front left, front right, back left, back right, respectively. A three-row seated vehicle model may employ an arrangement of 6 microphones, front left 401, front right 402, middle left 403, middle right 404, back left 405, and back right 406. For a main driver, the specific position of the sounding part of the driver can be located only by the front left 401, front right 402 and middle left 403 microphones, and the microphones at the positions of the front left 401, the front right 402 and the middle left 403 can be installed at the positions which are not shielded by the driver as far as possible, so that sound reflection is prevented, and the accuracy of sound collection is influenced.
As an embodiment, during driving of the vehicle, the plurality of microphones 410 may collect the sound emitted by the driver, and determine the position of the emitted sound, i.e., the nose/mouth of the driver, according to the sound, and further, obtain the positions of the eyes of the driver according to the nose/mouth, so as to adjust the vehicle rearview mirror to a position suitable for the driver to view the road condition behind the vehicle according to the positions of the eyes.
For example, as shown in fig. 3, for a vehicle with three rows of seats, an arrangement of 6 microphones may be adopted, during the running process of the vehicle, the 6 microphones are responsible for collecting sound and transmitting the collected sound to an amplifier, the amplifier amplifies an Analog Signal of the collected sound, and simultaneously an Analog-to-Digital Converter (ADC) transmits the collected sound to a Digital Signal Processor (DSP) for Processing, further, since the DSP and a System on Chip (SoC) may communicate with each other through an Integrated Circuit bus (IIC)/Serial Peripheral Interface (SPI), the DSP transmits the processed Signal to the SoC and performs voice recognition on the sound Signal by the SoC, the SoC communicates with the microcontroller, and the microcontroller communicates with a Controller Area Network (Controller Area Network) through the SoC, and sending the CAN information to be executed to the vehicle CAN gateway module, and further controlling and adjusting the rearview mirror through the CAN gateway module. Embodiments in the present application will be described in detail below with reference to the accompanying drawings.
Referring to fig. 4, fig. 4 illustrates a control method of a vehicle rearview mirror according to an embodiment of the present application, where the control method of the vehicle rearview mirror may include the following steps S110 to S130.
Step S110: and acquiring the sound source position of the target object, wherein the sound source position is used for representing the spatial position of a sounding organ of the target object for sounding.
In order to facilitate a target object to accurately acquire road condition information behind a vehicle from a rearview mirror in the driving process, the position of the vehicle rearview mirror can be adjusted to an optimal position according to the position of the eyes of the target object, and the positions of the eyes can be calculated according to the position of the nose/mouth of the target object, so that the vehicle can acquire the sound emitted by the nose/mouth of the target object through a microphone array, and determine the specific position of the nose/mouth of the target object according to a sound source positioning technology to further determine the positions of the eyes of the target object, wherein the target object can be a driver or other passengers of the vehicle, the target object is defaulted as the driver under the normal condition, the vehicle can identify other passengers as the target object according to sound source positioning, for example, when the passengers in a passenger seat of a passenger seat send control commands to a central rearview mirror, at this time, the vehicle may regard the occupant as a target object.
Wherein, the sound source position refers to a specific spatial position of the nose/mouth where the target object emits sound in the vehicle cabin, and it is noted that, in the embodiment of the present application, for convenience of calculation, the spatial positions of the nose/mouth and the eyes may belong to the same spatial coordinate system.
As an embodiment, the vehicle may collect multiple paths of sound information emitted by the target object through the microphone array, and calculate the spatial position of the nose/mouth of the sound emitted by the target object by using a sound source localization algorithm according to the multiple paths of sound information, and further use the spatial position of the nose/mouth as the sound source position.
Specifically, as shown in fig. 5, when the microphones 101 and 102 collect the sound information 105 emitted from the mouth 104 of the target object 103, a spatial cartesian coordinate system is formed by using a microphone array formed by the microphones 101 and 102, and the position of the sound source in the space is determined according to different linear arrays, or a plane array and a spatial array are constructed according to different installation positions of the microphones to perform the calculation of sound source positioning.
Step S120: and determining the binocular position of the target object according to the sound source position.
Wherein, the binocular position refers to the spatial position of the two eyes of the target object in the vehicle compartment, and can be determined after determining the position of the nose/mouth of the target object because the distribution of the human five sense organs on the face has small differences. As an embodiment, when the sound source position of the target object is acquired, the binocular position of the target object may be calculated based on the sound source position, for example, the binocular position may be located at 8cm directly above the sound source position, and the horizontal distribution area may be about 4cm long.
Step S130: and adjusting the vehicle rearview mirror to the target position according to the binocular positions.
The target position refers to a position where a vehicle rearview mirror which is most suitable for a target object to view road conditions behind a vehicle is located, and the target position can be a pre-stored position which is obtained by adjusting the target object in advance according to the body proportion and driving habits of the target object, or can be default set by a vehicle manufacturer according to human factors engineering and related technologies of vehicle manufacturing neighborhood in the vehicle production process.
As an embodiment, when the vehicle determines the binocular positions of the target objects, the corresponding target positions may be determined according to the binocular positions, and then the vehicle rearview mirrors may be adjusted to the target positions. Specifically, after determining the binocular position, the vehicle may query a target position corresponding to the current binocular position from factory settings of the vehicle, for example, when the binocular position is within a spatial position range a to B, the target position of the corresponding vehicle rearview mirror is M.
Illustratively, as shown in fig. 5, during the driving of the vehicle, the microphone array formed by the microphones 101 and 102 may collect the sound signal 105 emitted by the target object 103 in real time, and use a sound localization algorithm to obtain the spatial position of the mouth 104 as the sound source position, and further calculate a binocular position 106 based on the sound source position, after obtaining the binocular position, the vehicle determines the target position of the vehicle rearview mirror 107, and further, adjusts the vehicle rearview mirror 107 to the target position.
In the embodiment of the application, the sound source position of the target object is obtained, the sound source position is used for representing the spatial position of a sounding organ which makes sound by the target object, the binocular position of the target object is determined according to the sound source position, and further, the vehicle rearview mirror is adjusted to the target position according to the binocular position. Therefore, the sound source positioning is combined with the adjustment of the rearview mirror of the vehicle, so that the vehicle can automatically adjust the rearview mirror to the optimal position according to the binocular position of the driver, and the adjustment efficiency of the rearview mirror is effectively improved.
As shown in fig. 6, fig. 6 schematically illustrates another control method of a vehicle rearview mirror provided in an embodiment of the present application, and the control method of the vehicle rearview mirror may include the following steps S210 to S250.
Step S210: and acquiring sound information emitted by the target object through the microphone array.
The posture of the target object for driving the vehicle is usually changed continuously during driving, and therefore, the position of the target object adjusted to the vehicle rearview mirror before driving may not meet the optimal position corresponding to the current posture in real time. Therefore, the vehicle can collect the sound information of the driver to carry out sound source positioning, so that the vehicle rearview mirror can be adjusted in real time. Wherein the sound information refers to the sound emitted by the nose/mouth of the target object, it is noted that the sound information may include a control password emitted by the target object for controlling the adjustment of the vehicle rearview mirror.
In some embodiments, the vehicle may collect the sound information emitted by the target object in real time by using the microphone array, and in particular, referring to fig. 7, step S220 may include: step S211 and step S212.
Step S211: and determining a target microphone in the microphone array according to the position in the vehicle where the target object is positioned.
In order to improve the accuracy of the microphone array for acquiring the sound information emitted by the target object, a target microphone may be designated according to the position of the target object to acquire the sound information, wherein the target microphone refers to a microphone in the microphone array that is specifically used for acquiring the sound information of the target object.
As an embodiment, a microphone close to the target object may be selected as the target microphone according to different vehicle models, as shown in fig. 2, and specifically, a microphone in the microphone array located at the front left, front right, and middle left positions of the vehicle compartment may be used as the target microphone.
Step S212: and acquiring sound information emitted by the target object through the target microphone.
As an embodiment, when the vehicle determines the target microphone, whether the target object emits sound may be monitored in real time according to the target microphone, and if it is detected that the target object emits sound, sound information emitted by the target object may be acquired, and optionally, after acquiring the sound information, the target microphone may perform preprocessing on the sound information to remove noise and improve accuracy of the sound information.
Step S220: and determining the sound source position according to the sound information.
In one embodiment, after the vehicle acquires the sound information, the vehicle may analyze the sound information to determine the sound source position. Specifically, the sound source position can be calculated by using a sound source positioning algorithm, that is, a spatial geometric relationship is constructed by using the sound source positioning algorithm, and the position of the sound source is estimated for the multi-path sound information based on the established sound source model so as to achieve the sound source positioning capability of a centimeter level, thereby improving the accuracy of sound source positioning.
For example, the vehicle can determine the sound source position by using a voice position recognition method of time delay estimation and space positioning, and for the time delay estimation of the voice signal, the time delay can be estimated by selecting the highest peak of two sections of sound information cross-correlation curves. In the embodiment of the present application, a sound source localization algorithm may be described by a two-dimensional plane parameter distance, specifically, as shown in fig. 8, a known microphone: the first microphone 201, the second microphone 202 and the third microphone 203 have the coordinates of (0, 0), (-d, 0), (d, 0) and t1Is the time difference, t, of the information traveling from the second microphone 202 to the first microphone 2012Is the time difference in the propagation of the information from the first microphone 201 to the third microphone 203, wherein,d,t1,t2the sound information propagation velocity v is a known parameter, and the time delay estimation calculation equation can be used to solve the coordinates l (x, y) of the sound source position, and the calculation equation is as follows:
Figure BDA0003078680670000071
Figure BDA0003078680670000072
the coordinates l (x, y) of the position of the sound source can be solved from the above equation (1) and equation (2) in combination. It should be noted that, in the above example, the sound source localization algorithm is described by using a two-dimensional plane parameter distance, in an actual application scenario, a plurality of microphones may be arranged at positions convenient for acquiring sound information of a target object at different heights, so that a three-dimensional space coordinate system may be constructed for multi-channel sound source localization calculation, which is not limited herein.
Step S230: and determining the binocular position of the target object according to the sound source position.
In one embodiment, after the vehicle calculates the coordinates of the sound source position through the sound information, the coordinates of the sound source position may be subjected to a displacement operation to obtain the binocular positions of the target object. For example, the coordinates of the sound source position may be translated upward by 8cm as the coordinates of the binocular position.
Step S240: and determining the target positions corresponding to the binocular positions according to the binocular positions.
The existing computer vision related technologies such as face recognition can also play a role in recognizing/positioning the positions of human eyes, but such schemes are easily affected by the external environment, for example, the illumination intensity can affect the recognition precision, and in addition, a camera device for recognition needs to be additionally arranged, so that the binocular positions are determined by sound source positioning in the embodiment provided by the application, the accuracy of obtaining the binocular positions can be improved, and meanwhile, the vehicle production cost is prevented from being improved due to the addition of additional equipment.
In addition, due to physiological factors such as the height ratio of the human body and the like and the difference of the positions of the driver seats, the optimal angle of each driver for watching the rearview mirror is different, and generally, the rearview mirror has an optimal position, namely a target position, corresponding to the spatial position, for watching the rear road condition at each spatial position where each pair of eyes are located. In some embodiments, the vehicle may determine the target position corresponding to the binocular position according to the binocular position, and specifically, referring to fig. 9, step S240 may include: step S241 and step S242.
In some embodiments, the vehicle may store the target object adjusting the position of the vehicle mirror as the target position so that the target position may be directly obtained and the vehicle mirror adjusted quickly the next time the target object needs to adjust the vehicle mirror.
Step S241: the user identity of the target object is determined.
As an embodiment, when the vehicle acquires the voice information of the target user, voice recognition/voiceprint recognition may be performed on the voice information, and the user identity of the target object may be determined. For example, after the target microphone collects the voice information emitted by the target object, the vehicle analyzes the voice information by using a voiceprint recognition algorithm to determine the user identity of the target object.
Step S242: and determining a target position corresponding to the binocular position of the target object according to the user identity.
As an embodiment, when the vehicle determines the user identity of the target object according to the collected sound information, a historical adjustment position corresponding to a binocular position of the target object may be obtained by the user identity, where the historical adjustment position refers to a position where a rearview mirror of the vehicle is adjusted in a historical record, further, a default adjustment position corresponding to the binocular position may be obtained according to the binocular position of the target object, where the default adjustment position refers to a default position of rearview mirror adjustment obtained by a vehicle manufacturer through a test experiment according to vehicle characteristics (e.g., a vehicle body length, a car height) and the binocular position, further, whether the historical adjustment position matches the default adjustment position may be judged, and if the historical adjustment position matches the default adjustment position, the historical adjustment position is determined as the target position.
Alternatively, the vehicle may query the record of the target object for adjusting the vehicle mirror from the data table recorded with the vehicle mirror adjustment record, so as to obtain the corresponding historical adjustment position, as shown in table 1, where table 1 is the data table of the vehicle mirror adjustment record, and includes an Identity (ID) of the user and the historical adjustment position corresponding to the ID.
Figure BDA0003078680670000081
Alternatively, as shown in table 2, table 2 includes binocular position ranges and default adjustment positions corresponding to the binocular position ranges. When the binocular position of the target object falls within the range Ai~BiThen, the default adjustment position corresponding to the binocular position can be determined as Di
Figure BDA0003078680670000091
Optionally, after determining whether the historical adjustment position matches the default adjustment position, if the historical adjustment position does not match the default adjustment position, the historical adjustment position may be modified. For example, the value of the historical adjustment position corresponding to the user identity is replaced with the value of the default adjustment position corresponding to the current binocular position.
In other embodiments, when the vehicle determines the binocular positions of the target object according to the sound source position, default adjustment positions corresponding to the binocular positions may be acquired, and the corresponding default adjustment positions may be directly determined as the target positions.
Step S250: and adjusting the vehicle rearview mirror to a target position.
In some embodiments, after the vehicle determines the target position through the binocular position, the vehicle rearview mirror may be adjusted according to the target position, as shown in fig. 10, and may enclose a driving side rearview mirror 204, a secondary driving side rearview mirror 205, and an interior center rearview mirror 206 outside the vehicle. Specifically, referring to fig. 11, step S250 may include:
step S251: the current position of the vehicle rearview mirror is acquired.
As an embodiment, when the vehicle determines the target position, the current position α of the vehicle's rearview mirror may be acquired. For example, the current position α of the driving side mirror 204 is acquired1Current position α of the copilot side mirror 2052And the current position alpha of the center rearview mirror 206 in the vehicle3
Step S252: and judging whether the current position is at the target position.
In order to reduce the adjustment steps of the vehicle rearview mirror and avoid repeated adjustment, when the current position of the vehicle rearview mirror is at the target position, no adjustment is needed. As an embodiment, the vehicle may compare the acquired current position α of the vehicle rearview mirror with a target position β, and determine whether the current position is at the target position, where the target position may be a position range, for example, the target position β ∈ (p, q). Specifically, the vehicle may determine whether the acquired current position α of the vehicle mirror falls within the target position β to determine whether the current position is at the target position.
Step S253: and if the current position is not at the target position, adjusting the position of the vehicle rearview mirror to the target position.
As an embodiment, when it is determined that the current position α of the vehicle mirror is not equal to the target position β, the current position α of the vehicle mirror may be adjusted to the target position β. In particular, different vehicle mirrors may be adjusted.
In the embodiment of the application, sound information emitted by a target object is acquired through a microphone array, the position of a sound source is determined according to the sound information, the binocular position of the target object is determined according to the position of the sound source, further, the target position corresponding to the binocular position is determined according to the binocular position, and therefore the vehicle rearview mirror is adjusted to the target position. Therefore, the vehicle can dynamically adjust the vehicle rearview mirror to the optimal view according to the positions of the two eyes in the driving process of the target object, and the driving safety is improved.
As shown in fig. 12, fig. 12 schematically illustrates another control method of a vehicle rearview mirror provided in an embodiment of the present application, and the control method of the vehicle rearview mirror may include the following steps S310 to S340.
Step S310: and when the target object is detected to be in the driver seat, judging whether to acquire a control command.
In order to reduce the operation steps of adjusting the vehicle rearview mirror, the vehicle can store the target position corresponding to the target object, so that when the vehicle rearview mirror needs to be adjusted next time, the adjusted target position for the target user can be found directly from the history record of adjusting the vehicle rearview mirror by the target object, and the vehicle rearview mirror is directly adjusted to the target position adjusted last time, so that the adjustment steps are simplified, and the adjustment efficiency of the vehicle rearview mirror is improved.
The control command refers to a command for instructing the vehicle to adjust the vehicle mirror, which can be generated by the voice of the target object, for example, if the target object sends a voice command "adjust the mirror", the vehicle can recognize the voice command by using a voice recognition algorithm, for example, machine learning/deep learning (Wav2letter + +), and when the target object is determined to send the voice command for controlling the vehicle mirror, the vehicle generates the control command.
As one embodiment, the vehicle may determine whether to acquire the control instruction when it is detected that the target object is seated in the driver's seat. Specifically, whether a driver enters a vehicle compartment or not may be determined by providing a pressure sensor in a driver seat of the vehicle, and when the pressure sensor on the driver seat detects pressure, it may be determined that the target object is in the driver seat, and then, it is determined whether a control instruction is acquired or not.
Step S320: and if the control instruction is acquired, acquiring the sound source position of the target object according to the control instruction.
As an implementation, when the vehicle detects the control instruction, a voice password for generating the control instruction may be acquired, and sound source location may be acquired by performing sound source location on the voice password, and a specific method of sound source location may refer to the description in the above embodiment. In addition, although the target object usually wakes up the vehicle by a voice password to adjust the rearview mirror after getting on the vehicle, the target object may forget to issue the voice password.
As another embodiment, if the control instruction is not acquired, it may be monitored in real time whether the target object sends a voice command or a sound, and then the position of the rearview mirror is adjusted after the binocular position of the target object is located by using the sound information acquired at any time.
In some embodiments, the vehicle may determine the location of the sound source based on the control commands, and thus the location of the eyes to control the rear view mirror. The specific steps may include step S330 and step S340.
Step S330: and determining the binocular position of the target object according to the sound source position.
Step S340: and adjusting the vehicle rearview mirror to the target position according to the binocular positions.
In this embodiment, the specific implementation of step S330 and step S340 may refer to the description of step S120 and step S130 provided in the above embodiments, and are not described herein again.
In other embodiments, the vehicle may determine a user identity of the target object based on the control instruction and directly control the rearview mirror based on the user identity. Specifically, after the vehicle acquires the control command, the target user may be subjected to identity recognition according to the sound information of the control password corresponding to the control command, for example, the user identity of the target object is determined by using a voice recognition algorithm.
Further, when the vehicle determines the user identity of the target object, the history of the adjustment of the vehicle rearview mirror by the target object can be obtained according to the user identity, the adjusted target position for the target user can be found from the history, and the vehicle rearview mirror can be directly adjusted to the adjusted target position last time.
For example, as shown in fig. 13, fig. 13 shows an adjusting method of a vehicle rearview mirror provided in an embodiment of the present application, which adjusts the vehicle rearview mirror according to whether a control instruction is acquired. Specifically, the vehicle may determine whether the acquired control instruction is acquired when it is detected that the target object is in the driver's seat.
Further, if it is determined that the control instruction is acquired, the sound source position of the target object is acquired according to the control instruction, specifically, a control command of the target object may be acquired, sound source positioning is performed according to the control command to acquire the sound source position, then the binocular position of the target object may be determined according to the sound source position, and the vehicle rearview mirror is adjusted to the target position according to the binocular position.
Optionally, if it is determined that the control instruction is not acquired, the vehicle may monitor, in real time, whether the sound information of the target object is acquired through the microphone array, and when the sound information of the target object is acquired, the sound source may be positioned according to the sound information to acquire the sound source position, and then the binocular position of the target object may be determined according to the sound source position, and the vehicle rearview mirror may be adjusted to the target position according to the binocular position. In addition, the control command can be judged to be acquired by performing voice analysis on the sound information, and if the control command is acquired, the vehicle rearview mirror is directly adjusted according to the control command.
In the embodiment of the application, whether a control instruction is acquired or not is judged when the target object is detected to be in a driver seat, if the control instruction is acquired, a sound source position of the target object is acquired according to the control instruction, a binocular position of the target object is determined according to the sound source position, and further, the vehicle rearview mirror is adjusted to the target position according to the binocular position. Therefore, the vehicle can directly adjust the position of the vehicle rearview mirror after acquiring the control command sent by the target object, and can also position the sound source and adjust the vehicle rearview mirror according to the sound information acquired by real-time monitoring. Thus, the number of operation steps for adjusting the vehicle mirror is reduced.
Referring to fig. 14, a block diagram of a control device 500 for a vehicle rearview mirror according to an embodiment of the present application is shown. The control device 500 for the vehicle mirror includes: an obtaining module 510, configured to obtain a sound source position of the target object, where the sound source position is used to represent a spatial position of a sounding organ from which the target object makes sound; a determining module 520, configured to determine binocular positions of the target object according to the sound source position; and an adjusting module 530 for adjusting the vehicle rearview mirror to a target position according to the binocular positions.
In some embodiments, the control device 500 of the vehicle rearview mirror further includes: the judging module is used for judging whether to acquire a control instruction or not when the target object is detected to be in the driver seat;
the obtaining module 510 may further include: and if the control instruction is acquired, acquiring the sound source position of the target object according to the control instruction.
In some embodiments, the obtaining module 510 may include: the acquisition unit is used for acquiring sound information emitted by the target object through the microphone array; and a sound source determining unit for determining a sound source position based on the sound information.
In some embodiments, the obtaining unit may include: the determining subunit is used for determining a target microphone in the microphone array according to the position of the target object in the vehicle; and the acquisition subunit is used for acquiring the sound information emitted by the target object through the target microphone.
In some embodiments, the adjustment module 530 includes: the position determining unit is used for determining a target position corresponding to the binocular position according to the binocular position; and the adjusting unit is used for adjusting the vehicle rearview mirror to the target position.
In some embodiments, the location determination unit may be specifically configured to: determining a user identity of a target object; and determining a target position corresponding to the binocular position of the target object according to the user identity.
In some embodiments, the adjusting unit may be specifically configured to: acquiring the current position of a vehicle rearview mirror; judging whether the current position is at a target position; and if the current position is not at the target position, adjusting the position of the vehicle rearview mirror to the target position.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, the coupling between the modules may be electrical, mechanical or other type of coupling.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
According to the scheme, the sound source position of the target object is obtained, the sound source position is used for representing the spatial position of a sounding organ which makes sound by the target object, the binocular position of the target object is determined according to the sound source position, and further the vehicle rearview mirror is adjusted to the target position according to the binocular position. Therefore, the sound source positioning is combined with the adjustment of the rearview mirror of the vehicle, so that the vehicle can automatically adjust the rearview mirror to the optimal position according to the binocular position of the driver, and the adjustment efficiency of the rearview mirror is effectively improved.
As shown in fig. 15, the present embodiment also provides a vehicle 600, the vehicle 600 includes a processor 610, a memory 620, and a microphone array 630, where the memory 620 stores computer program instructions, the computer program instructions are invoked by the processor 610 to execute the control method of the vehicle rearview mirror, and the microphone array 630 may include at least two microphones, and the microphones may be used to collect sound.
The processor 610 may include one or more processing cores. The processor 610 interfaces with various components throughout the battery management system using various interfaces and lines to perform various functions of the battery management system and to process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 620 and invoking data stored in the memory 620. Alternatively, the processor 610 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 610 may integrate one or more of a Central Processing Unit (CPU) 610, a Graphics Processing Unit (GPU) 610, a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 610, but may be implemented by a communication chip.
The Memory 620 may include a Random Access Memory (RAM) 620, and may also include a Read-Only Memory (Read-Only Memory) 620. The memory 620 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 620 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area can also store data (such as a phone book, audio and video data, chatting record data) created by the electronic device map in use and the like.
As shown in fig. 16, an embodiment of the present application further provides a computer-readable storage medium 700, where the computer-readable storage medium 700 has stored therein computer program instructions 710, and the computer program instructions 710 can be called by a processor to execute the method described in the above embodiment.
The computer-readable storage medium may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium includes a non-volatile computer-readable storage medium. The computer readable storage medium 700 has storage space for program code for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code may be compressed, for example, in a suitable form.
Although the present application has been described with reference to the preferred embodiments, it is to be understood that the present application is not limited to the disclosed embodiments, but rather, the present application is intended to cover various modifications, equivalents and alternatives falling within the spirit and scope of the present application.

Claims (10)

1. A control method of a vehicle rearview mirror, characterized by comprising:
acquiring a sound source position of a target object, wherein the sound source position is used for representing the spatial position of a sounding organ of a sound emitted by the target object;
determining binocular positions of the target object according to the sound source position; and
and adjusting the vehicle rearview mirror to a target position according to the binocular positions.
2. The method of claim 1, wherein prior to said obtaining a sound source location of a target object, the method further comprises:
when the target object is detected to be in the driver seat, judging whether a control instruction is acquired; and
the acquiring of the sound source position of the target object includes:
and if the control instruction is acquired, acquiring the sound source position of the target object according to the control instruction.
3. The method according to claim 1, wherein the obtaining the sound source position of the target object comprises:
acquiring sound information emitted by the target object through a microphone array; and
and determining the sound source position according to the sound information.
4. The method of claim 3, wherein the obtaining of the sound information emitted by the target object through a microphone array comprises:
determining a target microphone in the microphone array according to the position of the target object in the vehicle; and
and acquiring sound information emitted by the target object through the target microphone.
5. The method of claim 1, wherein adjusting the vehicle mirrors to a target position based on the binocular positions comprises:
determining a target position corresponding to the binocular position according to the binocular position; and
and adjusting the vehicle rearview mirror to a target position.
6. The method according to claim 5, wherein the determining the target positions corresponding to the binocular positions according to the binocular positions comprises:
determining a user identity of the target object;
acquiring a historical adjustment position corresponding to the binocular position of the target object according to the user identity;
acquiring a default adjusting position corresponding to the binocular position according to the binocular position;
judging whether the historical adjustment position is matched with the default adjustment position;
if the historical adjustment position is matched with the default adjustment position, determining the historical adjustment position as the target position; and
and if the historical adjustment position is not matched with the default adjustment position, correcting the historical adjustment position.
7. The method of claim 5, wherein the adjusting the vehicle mirror to a target position comprises:
acquiring the current position of the vehicle rearview mirror;
judging whether the current position is at the target position; and
and if the current position is not at the target position, adjusting the position of the vehicle rearview mirror to the target position.
8. A control device for a vehicle rearview mirror, characterized by comprising:
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring the sound source position of a target object, and the sound source position is used for representing the spatial position of a sounding organ of a sound emitted by the target object;
the determining module is used for determining the binocular positions of the target objects according to the sound source positions; and
and the adjusting module is used for adjusting the vehicle rearview mirror to the target position according to the binocular position.
9. A vehicle, characterized by comprising:
a microphone array;
a memory;
one or more processors coupled with the memory;
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, the one or more applications configured to perform the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that a program code is stored in the computer-readable storage medium, which program code can be called by a processor to perform the method according to any of claims 1-7.
CN202110560019.1A 2021-05-21 2021-05-21 Method and device for controlling vehicle rearview mirror, vehicle and storage medium Pending CN113291247A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110560019.1A CN113291247A (en) 2021-05-21 2021-05-21 Method and device for controlling vehicle rearview mirror, vehicle and storage medium
PCT/CN2022/093007 WO2022242589A1 (en) 2021-05-21 2022-05-16 Method and apparatus for controlling rear-view mirror of vehicle, and vehicle and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110560019.1A CN113291247A (en) 2021-05-21 2021-05-21 Method and device for controlling vehicle rearview mirror, vehicle and storage medium

Publications (1)

Publication Number Publication Date
CN113291247A true CN113291247A (en) 2021-08-24

Family

ID=77323810

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110560019.1A Pending CN113291247A (en) 2021-05-21 2021-05-21 Method and device for controlling vehicle rearview mirror, vehicle and storage medium

Country Status (2)

Country Link
CN (1) CN113291247A (en)
WO (1) WO2022242589A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022242589A1 (en) * 2021-05-21 2022-11-24 广州小鹏汽车科技有限公司 Method and apparatus for controlling rear-view mirror of vehicle, and vehicle and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0687094U (en) * 1993-06-07 1994-12-20 株式会社村上開明堂 Emergency sound detector
JP2007045217A (en) * 2005-08-08 2007-02-22 Denso Corp Control system of electric mirror for vehicle
JP2007290554A (en) * 2006-04-25 2007-11-08 Toyota Motor Corp In-vehicle sound input device
CN201240321Y (en) * 2008-07-23 2009-05-20 天津三星电子有限公司 Sound control automobile rearview mirror
CN107364412A (en) * 2017-07-11 2017-11-21 北京汽车研究总院有限公司 A kind of adjusting method of automobile rearview mirror, device and automobile
CN107444316A (en) * 2017-06-23 2017-12-08 福建省汽车工业集团云度新能源汽车股份有限公司 A kind of seat and rearview mirror automatic adjusting method and device
CN108454517A (en) * 2018-02-27 2018-08-28 北京汽车研究总院有限公司 A kind of vehicle mirrors regulating system and the vehicle with it
KR20200095990A (en) * 2019-02-01 2020-08-11 (주)탑중앙연구소 Method for controlling smart device
CN111532205A (en) * 2020-05-13 2020-08-14 北京百度网讯科技有限公司 Adjusting method, device and equipment of rearview mirror and storage medium
CN111634235A (en) * 2020-05-13 2020-09-08 一汽奔腾轿车有限公司 System and method for adjusting automobile exterior rearview mirror through facial recognition
EP3730350A1 (en) * 2019-04-26 2020-10-28 Renault S.A.S. Method and device for adjusting the position of at least one element of a motor vehicle

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2723278Y (en) * 2004-06-22 2005-09-07 上海中油企业集团有限公司 Sound control regulator for sedan reflector
CN104554017B (en) * 2013-12-20 2017-03-08 浙江吉利控股集团有限公司 A kind of vehicle centre rear-view mirror intelligent regulating system and its control method
DE102017208342A1 (en) * 2017-05-17 2018-11-22 Bayerische Motoren Werke Aktiengesellschaft Mirror adjustment device
CN108177611A (en) * 2017-12-14 2018-06-19 蔚来汽车有限公司 Monitoring system, method and the vehicle of objective body in vehicle
CN113291247A (en) * 2021-05-21 2021-08-24 广州小鹏汽车科技有限公司 Method and device for controlling vehicle rearview mirror, vehicle and storage medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0687094U (en) * 1993-06-07 1994-12-20 株式会社村上開明堂 Emergency sound detector
JP2007045217A (en) * 2005-08-08 2007-02-22 Denso Corp Control system of electric mirror for vehicle
JP2007290554A (en) * 2006-04-25 2007-11-08 Toyota Motor Corp In-vehicle sound input device
CN201240321Y (en) * 2008-07-23 2009-05-20 天津三星电子有限公司 Sound control automobile rearview mirror
CN107444316A (en) * 2017-06-23 2017-12-08 福建省汽车工业集团云度新能源汽车股份有限公司 A kind of seat and rearview mirror automatic adjusting method and device
CN107364412A (en) * 2017-07-11 2017-11-21 北京汽车研究总院有限公司 A kind of adjusting method of automobile rearview mirror, device and automobile
CN108454517A (en) * 2018-02-27 2018-08-28 北京汽车研究总院有限公司 A kind of vehicle mirrors regulating system and the vehicle with it
KR20200095990A (en) * 2019-02-01 2020-08-11 (주)탑중앙연구소 Method for controlling smart device
EP3730350A1 (en) * 2019-04-26 2020-10-28 Renault S.A.S. Method and device for adjusting the position of at least one element of a motor vehicle
CN111532205A (en) * 2020-05-13 2020-08-14 北京百度网讯科技有限公司 Adjusting method, device and equipment of rearview mirror and storage medium
CN111634235A (en) * 2020-05-13 2020-09-08 一汽奔腾轿车有限公司 System and method for adjusting automobile exterior rearview mirror through facial recognition

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022242589A1 (en) * 2021-05-21 2022-11-24 广州小鹏汽车科技有限公司 Method and apparatus for controlling rear-view mirror of vehicle, and vehicle and storage medium

Also Published As

Publication number Publication date
WO2022242589A1 (en) 2022-11-24

Similar Documents

Publication Publication Date Title
JP6216096B2 (en) System and method of microphone placement for noise attenuation
US9953641B2 (en) Speech collector in car cabin
US20160358604A1 (en) Method for recognizing a voice context for a voice control function, method for ascertaining a voice control signal for a voice control function, and apparatus for executing the method
US11062125B2 (en) Facial feature detecting apparatus and facial feature detecting method
CN105835804A (en) Method and apparatus for monitoring a rear passenger seating area of a vehicle
CN113335146A (en) Adjusting method, device and system for automatically adjusting vehicle-mounted equipment related to driver
CN110633615A (en) Passenger number monitoring system
JP2020047273A (en) 3d feature point information generator
WO2022126419A1 (en) Rear-view mirror control method and related device
CN113291247A (en) Method and device for controlling vehicle rearview mirror, vehicle and storage medium
JP7183782B2 (en) Emotion estimation device, environment providing system, vehicle, emotion estimation method, and information processing program
CN113055810A (en) Sound effect control method, device, system, vehicle and storage medium
JP2018060466A (en) Image processing apparatus, detection apparatus, learning apparatus, image processing method, and image processing program
CN115195637A (en) Intelligent cabin system based on multimode interaction and virtual reality technology
CN108116320A (en) Rearview mirror Automatic adjustment method and system based on car key
CN115831141B (en) Noise reduction method and device for vehicle-mounted voice, vehicle and storage medium
JP5288251B2 (en) Emergency vehicle recognition support device
JP2019217830A (en) Occupant recognition device
CN115782794A (en) Self-adaptive adjusting method and device for vehicle
JP7456490B2 (en) Sound data processing device and sound data processing method
CN107933434A (en) Intelligent back vision mirror quiets down method of adjustment, equipment and the storage medium of pattern
CN110647304A (en) Method and system for adjusting sound effect of vehicle-mounted sound
US20230027663A1 (en) Audio method and system for a seat headrest
US20230302992A1 (en) Occupant state monitoring apparatus
WO2023174268A1 (en) Vehicle interior system, method for adjusting interior component, device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210824