KR20220078537A - Delay estimation method and apparatus for smart rearview mirror, and electronic device - Google Patents

Abstract

The present application provides a delay estimation method, apparatus, and electronic device used in a smart rearview mirror, and relates to an artificial intelligence technology field such as a vehicle Internet field and an autonomous driving field. Specific implementation means include: when the smart rearview mirror connects with an external device for screen projection, acquiring identification information of the external device; determining a target delay estimation upper limit value corresponding to the external device according to the identification information; performing delay estimation according to a target delay estimation upper limit value when the smart rearview mirror transmits a voice signal to an external device; and performing delay processing on the speech signal according to the delay estimation result. includes The present application obtains identification information of an external device, obtains a target delay estimation upper limit matching the external device, so that the delay estimation algorithm calculates the delay more accurately and quickly, delays the voice signal, and optimizes the final signal processing effect do.

Description

DELAY ESTIMATION METHOD AND APPARATUS FOR SMART REARVIEW MIRROR, AND ELECTRONIC DEVICE

This application relates to the field of artificial intelligence technology, and more particularly, to the field of vehicle internet and autonomous driving, and in particular, to a delay estimation method, apparatus, and electronic device used in a smart rearview mirror.

The smart rearview mirror can transmit sound to an external device through screen projection technology and reproduce it. Due to the large amount of transmitted data, there is always a certain delay in audio reproduction. Due to the limitation of the hardware noise reduction chip, the current signal processing technology cannot perform in the situation of non-normal (>40 ms) delay, which has a relatively large negative effect on the processing of the voice signal.

To this end, the smart rearview mirror introduces a delay estimation algorithm and calculates the delay to solve the problem of audio playback delay. In order not to affect the overall experience, the delay estimation algorithm usually limits the upper limit of the calculation result to a relatively small range (eg 1000 ms). This is because the smaller the upper limit value, the shorter the convergence time of the algorithm, and when the actual delay value is within this range, the final signal processing effect may be better. Accordingly, the size of the upper limit of the delay estimation for limiting the calculation result of the delay estimation algorithm directly affects the calculation result of the delay estimation algorithm and the final signal processing effect.

The present application provides a delay estimation method, apparatus, apparatus and storage medium used in a smart rearview mirror.

According to a first aspect of the present application, there is provided a delay estimation method used in a smart rearview mirror, the method comprising:

acquiring identification information of the external device when the smart rearview mirror and the external device are connected for screen projection;

determining a target delay estimation upper limit value corresponding to the external device according to the identification information;

when the smart rearview mirror transmits a voice signal to the external device, performing delay estimation according to the target delay estimation upper limit value; and

performing delay processing on the speech signal according to a delay estimation result; includes

According to a second aspect of the present application, there is provided a delay estimation apparatus used in a smart rearview mirror, the apparatus comprising:

a first acquisition module configured to acquire identification information of the external device when the smart rearview mirror is connected to an external device for screen projection;

a determining module configured to determine an upper limit value of estimation of a target delay corresponding to the external device according to the identification information;

an estimation module configured to perform delay estimation according to the target delay estimation upper limit value when the smart rearview mirror transmits a voice signal to the external device; and

a processing module configured to perform delay processing on the speech signal according to a delay estimation result; includes

According to a third aspect of the present application, there is provided an electronic device, the electronic device comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; including,

An instruction executable by the at least one processor is stored in the memory, and when the instruction is executed by the at least one processor, the at least one processor performs the delay estimation method of the first aspect.

According to a fourth aspect of the present application, there is further provided a non-transitory computer readable storage medium having a computer instruction stored thereon, the computer instruction causing the computer to perform the delay estimation method of the first aspect.

According to a fifth aspect of the present application, there is provided a computer program stored in a non-transitory computer-readable storage medium, and when the computer program is executed by a processor, the delay estimation method of the first aspect is performed.

According to the technical means of the present application, according to the identification information of the external device connected to the smart rearview mirror, one default value is not used uniformly, but the upper limit of the delay estimation algorithm can be flexibly set, and the prior art is fixed After solving the problem that the delay estimation upper limit of the delay estimation algorithm does not match the performance of the external device and setting the upper limit uniformly, the convergence of the delay estimation algorithm is too slow for an external device with excellent performance, the effect of noise reduction To prevent this late case, and to prevent the deterioration of the voice interaction experience after online, for an external device with poor performance, the delay estimation range is too small, and the delay estimation algorithm fails to obtain a suitable delay value in the range. , it is possible to prevent repeated jumps between multiple delay values, severely affecting the calculation of the noise reduction algorithm, and interfering with the voice interaction process. The technical means provided in this application matches a target delay upper limit suitable for different external devices, performs delay estimation based on the target upper delay upper limit value matched with the external device, and the delay estimation result obtained by the delay estimation algorithm is more It is accurate and optimizes the audio reproduction effect of an external device. It should be understood that the content described in this section is not intended to identify key or important features of embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application can be easily understood through the following specification.

The present application obtains identification information of an external device, obtains a target delay estimation upper limit matching the external device, so that the delay estimation algorithm calculates the delay more accurately and quickly, delays the voice signal, and optimizes the final signal processing effect do.

The drawings are used to better understand the technical means, and are not intended to limit the present application.
1 is a flowchart of a delay estimation method used in a smart rearview mirror according to an embodiment of the present application.
2 is a flowchart of determining a target delay estimation upper limit value corresponding to an external device according to an embodiment of the present application.
3 is a flowchart of determining a target delay estimation upper limit value corresponding to an external device according to another embodiment of the present application.
4 is a flowchart of a delay estimation method used in a smart rearview mirror according to another embodiment of the present application.
5 is a structural block diagram of a delay estimation apparatus used in a smart rearview mirror according to an embodiment of the present application.
6 is a structural block diagram of a delay estimation apparatus used in a smart rearview mirror according to another embodiment of the present application.
7 is a structural block diagram of a delay estimation apparatus used in a smart rearview mirror according to another embodiment of the present application.
8 is a block diagram of an electronic device implementing a delay estimation method used in a smart rearview mirror according to an embodiment of the present application.

Hereinafter, exemplary embodiments of the present application will be described in conjunction with the drawings. Several details of the embodiments of the present application are included herein to aid understanding, and the embodiments are to be regarded as illustrative only. Therefore, those skilled in the art to which the present invention pertains should recognize that various changes and modifications can be made to the embodiments without departing from the scope and spirit of the present application. At the same time, descriptions of well-known functions and structures are omitted in the following description for accuracy and conciseness.

In the related art, mainly through a fixed delay estimation algorithm, the problem of audio delay occurring in the process of the smart rearview mirror transmitting audio to an external device is solved. The upper limit of the calculation result of the fixed delay estimation algorithm is limited to a relatively small range, a delay value is calculated within the range, and delay processing is performed on the speech signal.

However, since the performance of each external device supporting the screen projection function does not match, the actual transmission delay fluctuation is relatively large, and when setting the upper limit uniformly, it cannot be set in real time according to the performance of the external device. When the upper limit is uniformly and large, in an external device with excellent performance, the delay estimation range is too large, the algorithm convergence is too slow, and furthermore, the effect of noise reduction is slow, and the voice interaction experience after online is deteriorated. When the upper limit is uniformly adjusted to a small value, in an external device with poor performance, the delay estimation range is too small, the algorithm does not obtain a suitable delay value in the range, jumps repeatedly between several delay values, and noise It severely affects the computation of the reduction algorithm and interferes with the voice interaction process.

Accordingly, the present application provides a delay estimation method, apparatus, and electronic device used in a smart rearview mirror that can be configured in real time according to an external device. Specifically, a delay estimation method, apparatus, and electronic device used in the smart rearview mirror according to an embodiment of the present application will be described with reference to the drawings below.

First of all, the external device of the embodiment of the present application may be a physical device capable of receiving the screen projection contents of the smart rearview mirror. For example, the external device may be a mobile terminal, that is, a smartphone, a tablet PC, a device having an augmented reality (AR) function, or a device having a virtual reality (VR) function. Also for example, the external device may be a vehicle computer system of a vehicle. The vehicle computer system is an abbreviation for information and entertainment products for vehicles mounted on the vehicle, and the vehicle computer system can implement information communication between a person and a vehicle and a vehicle and the outside world (vehicle and vehicle) in terms of function. The smart rearview mirror of the embodiment of the present application may be connected to an external device for screen projection. The embodiments of the present application do not limit the specific technology and specific form used by the external device.

1 is a flowchart of a delay estimation method used in a smart rearview mirror provided according to an embodiment of the present application. It should be explained that the delay estimating method used in the smart rearview mirror of the embodiment of the present application may be applied to the delay estimating apparatus used in the smart rearview mirror of the embodiment of the present application, and the delay estimating apparatus may be configured in an electronic device. As an example, the electronic device may be a smart rearview mirror mounted on a vehicle.

As shown in Fig. 1, the delay estimation method used in the smart rearview mirror includes steps 101 to 104.

In step 101, when the smart rearview mirror is connected to an external device for screen projection, identification information of the external device is acquired.

It should be explained that the identification information in the embodiment of the present application may be a channel number of an external device or other identifier that can uniquely identify the device, and the present application is not specifically limited thereto.

It should be further described, in an embodiment of the present application, the external device may be a vehicle computer system.

For example, when the smart rearview mirror is connected to an external device for screen projection, it may request the external device to obtain the channel number of the external device, and the channel number may uniquely identify the external device.

In step 102, a target delay estimation upper limit value corresponding to the external device is determined according to the identification information.

It should be noted that, in some embodiments, the target delay estimation upper limit corresponding to the external device may be determined by searching the upper limit configuration file according to the identification information.

Optionally, after acquiring the identification information of the external device, the smart rearview mirror searches for the upper limit configuration file according to the identification information, and determines whether there is an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file. can when the upper limit of the delay estimation corresponding to the identification information of the external device exists in the upper limit configuration file, determining the upper limit of the delay estimation corresponding to the identification information as the upper limit of the estimation of the target delay; When the upper limit of the delay estimation corresponding to the identification information of the external device does not exist in the upper limit configuration file, the preset upper limit of the delay estimation is determined as the upper limit of the estimation of the target delay corresponding to the external device.

In step 103, when the smart rearview mirror transmits a voice signal to an external device, delay estimation is performed according to a target delay estimation upper limit value.

Optionally, when the smart rearview mirror is connected to an external device for screen projection and transmits the audio data of the smart rearview mirror to the external device, the smart rearview mirror performs delay processing on the transmitted voice data to affect the audio playback effect of the external device should give To solve the problem of audio playback delay, the smart rearview mirror introduces a delay estimation algorithm, and when monitoring the transmission of a voice signal to an external device, the target delay estimation upper limit value adapted to the external device is determined according to the identification information. The delay estimation calculation is performed so that the obtained delay estimation result is more adapted to the performance of the external device.

In step 104, delay processing is performed on the speech signal according to the delay estimation result.

Optionally, delay estimation is performed according to the target delay upper limit to obtain a delay estimation result, and then delay processing is performed on the voice signal transmitted to the external device by the smart rearview mirror according to the delay estimation result. According to the delay estimation method used in the smart rearview mirror of the embodiment of the present application, it is possible to make the delay-processed voice signal more accurate and faster.

In the delay estimation method used in the smart rearview mirror of the present application embodiment, when the smart rearview mirror connects to an external device for screen projection, identification information of the external device is obtained, and the target delay estimation upper limit value corresponding to the external device according to the identification information is obtained. is determined, and when the smart rearview mirror transmits a voice signal to an external device, delay estimation is performed according to the target delay estimation upper limit value, and the voice signal transmitted to the external device by the smart rearview mirror is processed according to the delay estimation result. Match the target delay upper limit suitable for different external devices, perform delay estimation based on the target delay upper limit matched with the external device, and the delay estimation result obtained by the delay estimation algorithm is more accurate, and the audio reproduction of the external device Optimize the effect.

It should be explained, in some embodiments of the present application, shown in FIG. 2, in order to quickly and accurately determine a target delay estimation upper limit value corresponding to the external device according to the identification information of the external device, so that the delay estimation result is more accurate. As described above, the specific implementation process of determining the upper limit of the target delay estimation corresponding to the external device according to the identification information includes the following steps 201 to 204.

In step 201, according to the identification information, the upper limit configuration file is searched.

In an embodiment of the present application, the upper limit configuration file includes a plurality of pieces of identification information and a corresponding relationship between a plurality of delay estimation upper limits.

In step 202, it is determined whether an upper limit of delay estimation corresponding to identification information of an external device exists in the upper limit configuration file. If there is an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file, step 203 is performed; If there is no upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file, step 204 is performed.

In step 203, a delay estimation upper limit value corresponding to identification information of an external device is determined as a target delay estimation upper limit value.

In the present embodiment, if the upper limit configuration file has an upper limit of delay estimation corresponding to the identification information of the external device, it is explained that the upper limit of the delay estimation of the external device is present in the upper limit configuration file, and the upper limit of the delay estimation is determined by the external device. Applied to the device, the delay estimation result is more accurate, and there is no need to use a preset upper limit for delay estimation.

In step 204, a preset upper limit for estimating delay is determined as a target upper limit for estimating delay corresponding to the external device.

In the present embodiment, when there is no delay estimation upper limit value corresponding to the identification information of the external device in the upper limit configuration file, it is explained that the delay estimation upper limit information of the external device does not exist in the upper limit configuration file, and the preset delay estimation The upper limit value is used as an upper limit value for estimating the target delay corresponding to the external device.

It should be described that, in some embodiments of the present application, before searching for the upper limit configuration file according to the identification information, it is necessary to obtain the upper limit configuration file, and as shown in FIG. 3 , corresponding to the external device according to the identification information A specific implementation process for determining the upper limit of the target delay estimation to be used includes steps 301 to 305 .

In step 301, an upper limit configuration file is obtained.

It should be noted that the upper limit configuration file may be obtained through various methods. In an embodiment of the present application, when the smart rearview mirror connects with an external device for screen projection, it sends a network request to the server, and receives the upper limit configuration file sent by the server according to the network request.

There can be several implementations for requesting the capping configuration file from the server. One implementation is to ask the server to download the latest cap configuration file every time the smart rearview mirror requests it. Another implementation method is that a version number is provided in the network request, and after the server receives the network request, the version number of the network request and the latest version number (or the highest version number, max. version number), determine whether the upper limit configuration file stored in the smart rearview mirror is the latest version, the version number of the network request and the latest version number (or the highest version number, the maximum version number) of the upper limit configuration file stored in the server itself ) do not match, it is determined that the one stored in the smart rearview mirror is not the latest version, and in this case, the latest version must be obtained from the server, otherwise, the maximum configuration file stored in the smart rearview mirror is directly used without downloading from the server Do it.

In addition to the above embodiment, the upper limit configuration file may be implemented through other embodiments. In another embodiment of the present application, the upper limit configuration file is obtained from the local storage module of the smart rearview mirror, and the upper limit configuration file is the upper limit configuration file that the smart rearview mirror requested to the server last time. The last requested upper limit configuration file is a request to send the upper limit configuration file to the server when the smart rearview mirror and an external device are connected for screen projection last time, or the last requested upper limit configuration file is the smart rearview mirror regularly This may be the configuration file returned by the server when requesting the server to send the upper bound configuration file.

In step 302, according to the identification information, the upper limit configuration file is retrieved.

In the embodiments of the present application, step 302 may be implemented using any method of each embodiment of the present application, and the embodiments of the present application are not limited thereto, and will not be described further.

In step 303, it is determined whether there is an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file. If there is an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file, step 304 is performed; If there is no upper limit for delay estimation corresponding to the identification information of the external device in the upper limit configuration file, step 305 is performed.

In step 304, the upper limit of the delay estimation corresponding to the identification information of the external device is determined as the upper limit of the estimation of the target delay.

In the embodiments of the present application, step 304 may be implemented using any method of each embodiment of the present application, and the embodiments of the present application are not limited thereto and will not be described further.

In step 305, a preset upper limit for estimating delay is determined as a target upper limit for estimating delay corresponding to the external device.

In the embodiments of the present application, step 305 may be implemented using any method of each embodiment of the present application, and the embodiments of the present application are not limited thereto and will not be described further.

In order to improve the user's experience of using screen projection, it should be explained that in some external devices with poor performance, when the delay estimation method used in the smart rearview mirror of the present application is used, the voice blocking function may be turned off, During TTS (Text To Speech) broadcast, the smart rearview mirror reproduces a complex scene of screen-projected audio on an external device, and the delay value exceeds the algorithm upper limit (eg 2500ms) or the jitter is too severe to converge prevent cases from happening. Optionally, in some embodiments of the present application, as shown in FIG. 4 , the delay estimation method used in the smart rearview mirror may include steps 401 to 410 .

In step 401, when the smart rearview mirror and the external device are connected for screen projection, identification information of the external device is acquired.

In the embodiments of the present application, step 401 may be implemented using any method of each embodiment of the present application, and the embodiments of the present application are not limited thereto and will not be described further.

In step 402, an upper limit configuration file is obtained.

In the embodiments of the present application, step 402 may be implemented using any method of each embodiment of the present application, and the embodiments of the present application are not limited thereto, and will not be described further.

In step 403, according to the identification information, the upper limit configuration file is searched.

In an embodiment of the present application, the upper limit configuration file includes a plurality of pieces of identification information and a corresponding relationship between a plurality of delay estimation upper limits.

In step 404, it is determined whether there is an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file. If there is an upper limit value of delay estimation corresponding to the identification information of the external device in the upper limit configuration file, step 405 is performed; If there is no upper limit for delay estimation corresponding to the identification information of the external device in the upper limit configuration file, step 406 is performed.

In step 405, a delay estimation upper limit value corresponding to the identification information of the external device is determined as a target delay estimation upper limit value.

In the present embodiment, if the upper limit configuration file has an upper limit of delay estimation corresponding to the identification information of the external device, it is explained that the upper limit of the delay estimation of the external device is present in the upper limit configuration file, and the upper limit of the delay estimation is determined by the external device. Applied to the device, the delay estimation result is more accurate, and there is no need to use a preset upper limit for delay estimation.

In step 406, a preset upper limit for estimating delay is determined as a target upper limit for estimating delay corresponding to the external device.

In the present embodiment, when there is no delay estimation upper limit value corresponding to the identification information of the external device in the upper limit configuration file, it is explained that the delay estimation upper limit information of the external device does not exist in the upper limit configuration file, and the preset delay estimation The upper limit value is used as an upper limit value for estimating the target delay corresponding to the external device.

In step 407, a blocking configuration file is obtained; The blocking configuration file includes a corresponding relationship between the plurality of pieces of identification information and the voice blocking function configuration information.

It should be noted that the blocking configuration file can be obtained through various methods. In an embodiment of the present application, when the smart rearview mirror and the external device connect for screen projection, a network request is sent to the server, and the blocking configuration file sent by the server is received according to the network request.

There may be several implementations for requesting a blocking configuration file from the server. In one implementation, the smart rearview mirror asks the server to download the latest blocking configuration file on every request. Another implementation method is that a version number is provided in the network request, and after the server receives the network request, the version number of the network request and the latest version number of the blocking configuration file stored in the server itself (or the highest version number, the maximum version number), determine whether the blocking configuration file stored in the smart rearview mirror is the latest version, the version number of the network request and the latest version number (or the highest version number, the maximum version number) of the blocking configuration file stored in the server itself ) do not match, it is determined that the one stored in the smart rearview mirror is not the latest version, and in this case, the latest version must be obtained from the server, otherwise, the maximum configuration file stored in the smart rearview mirror is directly used without downloading from the server Do it.

In addition to the above embodiment, the blocking configuration file may be implemented through other embodiments. In another embodiment of the present application, the blocking configuration file is obtained from the local storage module of the smart rearview mirror, and the blocking configuration file is the blocking configuration file that the smart rearview mirror requested to the server last time. The blocking configuration file requested last time is a request to send a blocking configuration file to the server when the smart rearview mirror and an external device connect for screen projection last time, or the blocking configuration file requested last time is the blocking configuration file requested by the smart rearview mirror regularly This may be the configuration file returned by the server when requesting the server to send the blocking configuration file.

In step 408, it is determined whether the voice blocking function of the external device should be turned off according to the identification information and the blocking configuration file. If it is set in the blocking configuration file that the external device corresponding to the identification information should turn off the voice blocking function, step 409 is performed; If it is set in the blocking configuration file that the external device corresponding to the identification information does not need to turn off the voice blocking function, step 410 is performed.

In step 409, control information is transmitted to an external device; The control information is used to instruct the external device to turn off the voice blocking function.

In this embodiment, when it is set in the blocking configuration file that the external device corresponding to the identification information should turn off the voice blocking function, it is explained that the voice blocking function affects the smart rearview mirror to calculate the delay estimation, and the delay value If the upper limit of the algorithm (eg, 2500ms) is exceeded or the jitter is too severe, the delay estimation algorithm fails to converge, resulting in failure to calculate an appropriate delay value. Therefore, it is necessary to transmit control information to the external device, and turn off the voice blocking function of the external device, so that the delay estimation result of the delay estimation algorithm is more accurate and the final audio reproduction effect of the external device is optimized.

In step 410, when the smart rearview mirror transmits a voice signal to an external device, delay estimation is performed according to a target delay estimation upper limit value.

In the embodiment of the present application, when the external device that needs to turn off the voice blocking function has already turned off the voice blocking function and then the smart rearview mirror transmits a voice signal to the external device, delay estimation can be performed according to the upper limit of the target delay estimation, , without affecting the final delay estimation result; If the external device does not require the voice blocking function, it is explained that the voice blocking function does not affect the final delay estimation result. Delay estimation can be performed.

In step 411, delay processing is performed on the speech signal according to the delay estimation result.

Optionally, delay estimation is performed according to the target delay upper limit to obtain a delay estimation result, and then the voice signal transmitted to the external device by the smart rearview mirror is delayed according to the delay estimation result. According to the delay estimation method used in the smart rearview mirror of the embodiment of the present application, it is possible to make the delay-processed voice signal more accurate and faster.

It should be noted that the configuration information of the upper limit configuration file and the blocking configuration file in the embodiment of the present application can be acquired according to experience. For example, after more and more devices are accessed and more and more rich experiences are obtained, it is possible to obtain a more reasonable upper limit of target delay estimation corresponding to different external devices through experience. That is, by flexibly configuring the target delay estimation upper limit corresponding to the performance of different external devices, the performance of the external device is not affected and the effect of processing a voice signal can be guaranteed.

In the delay estimation method used in the smart rearview mirror of the present application embodiment, when the smart rearview mirror connects to an external device for screen projection, identification information of the external device is obtained, and the target delay estimation upper limit value corresponding to the external device according to the identification information is obtained. determine, obtain an upper limit configuration file, search for an upper limit configuration file according to the identification information, and when the upper limit configuration file has a delay estimation upper limit value corresponding to the identification information of the external device, the delay corresponding to the identification information of the external device determine an upper estimate limit as a target delay estimate upper bound; When the upper limit of the delay estimation corresponding to the identification information of the external device does not exist in the upper limit configuration file, a preset upper limit of delay estimation is determined as the target delay estimation upper limit, and a blocking configuration file is obtained, and the identification information is stored in the blocking configuration file. When it is displayed that the external device corresponding to ' should turn off the voice blocking function, the external device's voice blocking function is turned off, and when the smart rearview mirror transmits a voice signal to the external device, delay estimation is performed according to the target delay estimation upper limit value. and processing the voice signal transmitted to the external device by the smart rearview mirror according to the delay estimation result; When it is displayed in the blocking configuration file that the external device corresponding to the identification information does not need to turn off the voice blocking function, when the smart rearview mirror transmits a voice signal to the external device, delay estimation is performed according to the target delay estimation upper limit; , process the audio signal transmitted to the external device by the smart rearview mirror according to the delay estimation result. The delay estimation method used in the smart rearview mirror of the embodiment of the present application matches the upper limit of delay estimation suitable for different external devices, and determines whether the different external devices should turn off the voice blocking function, so that external devices with poor performance Thus, during TTS broadcasting, the smart rearview mirror plays a complex scene of screen-projected audio to an external device, and the delay value exceeds the algorithm upper limit (eg, 2500 ms) or the jitter is too severe to prevent convergence.

5 is a structural block diagram of a delay estimation apparatus used in a smart rearview mirror provided according to an embodiment of the present application. As shown in FIG. 5 , the apparatus for estimating delay used in the smart rearview mirror includes a first acquiring module 501 , a determining module 502 , an estimation module 503 , and a processing module 504 .

Specifically, the first acquisition module 501 is used to acquire identification information of the external device when the smart rearview mirror and the external device are connected for screen projection.

It should be explained that the identification information in the embodiment of the present application may be a channel number of an external device, or may be another identifier that can uniquely identify the device.

It should be further explained that, in the embodiment of the present application, the external device is a vehicle computer system.

The determining module 502 is used to determine a target delay estimation upper limit value corresponding to the external device according to the identification information.

In some embodiments of the present application, the determining module 502 specifically searches for an upper bound configuration file according to the identification information, wherein the upper limit configuration file includes a correspondence relationship between a plurality of identification information and a plurality of delay estimation upper bound values and determining whether an upper limit of delay estimation corresponding to the identification information of the external device exists in the upper limit configuration file, and if there is an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file, the A delay estimation upper limit value corresponding to the identification information is determined as the target delay estimation upper limit value, and when the delay estimation upper limit value corresponding to the identification information of the external device does not exist in the upper limit configuration file, the preset delay estimation upper limit value corresponds to the external device It is determined by the upper limit of the target delay estimation.

The estimation module 503 is used to perform delay estimation according to the target delay estimation upper limit value when the smart rearview mirror transmits a voice signal to the external device.

The processing module 504 is used to perform delay processing on the speech signal according to the delay estimation result.

Optionally, in some embodiments of the present application, as shown in FIG. 6 , the apparatus for estimating the delay used in the smart rearview mirror further includes a second acquiring module 605 . The second acquiring module 605 is specifically, when the smart rearview mirror connects with an external device for screen projection, sends a network request to the server, and receives the blocking configuration file sent by the server according to the network request or, it is used to obtain the blocking configuration file from the local storage module of the smart rearview mirror. 601 to 604 in FIG. 6 and 501 to 504 in FIG. 5 have the same function and structure.

Optionally, in some embodiments of the present application, as shown in FIG. 7 , the delay estimating device used in the smart rearview mirror includes a third obtaining module 706 , a determining module 707 and a transmitting module 708 . include more The third obtaining module 706 is specifically used to obtain a blocking configuration file, wherein the blocking configuration file includes a corresponding relationship between a plurality of identification information and the voice blocking function configuration information.

The determination module 707 is specifically used to determine whether to turn off the voice blocking function of the external device according to the identification information and the blocking configuration file.

The sending module 708 specifically sends control information to the external device in response to turning off the voice blocking function of the external device, and the control information is used to instruct the external device to turn off the voice blocking function . 701 to 705 in FIG. 7 and 601 to 605 in FIG. 6 have the same function and structure.

With respect to the apparatus of the above embodiment, the specific manner in which each module performs an operation has already been described in detail in the embodiment related to the method, and will not be described in detail herein.

The apparatus for estimating the delay used in the smart rearview mirror according to the embodiment of the present application includes: when the first acquisition module connects the smart rearview mirror and the external device for screen projection, acquiring identification information of the external device; the determining module determines an upper limit value for estimating a target delay corresponding to the external device according to the identification information; the estimation module performs delay estimation according to the target delay estimation upper limit value when the smart rearview mirror transmits a voice signal to the external device; The processing module performs delay processing on the speech signal according to the delay estimation result. The embodiment of the present application matches a target delay upper limit suitable for different external devices, performs delay estimation based on a target delay upper limit value matched with an external device, and the delay estimation result obtained by the delay estimation algorithm is more accurate and optimize the audio playback effect of the external device.

According to an embodiment of the present application, the present application further provides an electronic device, a readable storage medium, and a computer program.

As shown in FIG. 8, FIG. 8 is a block diagram of an electronic device used to implement a delay estimation method used in a smart rearview mirror according to an embodiment of the present application. Electronic devices represent various types of digital computers. For example, it may be a laptop computer, desktop computer, workstation, personal digital assistant (PAD), server, blade server, mainframe, and other suitable computer. Electronic devices represent various types of mobile devices. For example, it may be a personal digital assistant (PAD), a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components disclosed in this application, their connections and relationships, and functions are illustrative only and are not intended to limit the implementation of the present application as described and/or required in this application.

As shown in FIG. 8 , the electronic device includes one or a plurality of processors 801 , a memory 802 , and an interface including a high-speed interface and a low-speed interface for connecting each component. Each component is connected to each other using a different bus, and may be mounted on a common motherboard or in other ways depending on demand. The processor processes instructions executable within the electronic device, including instructions for displaying graphical information in the GUI on a memory or stored thereon and on an external input/output device (eg, a display device coupled to an interface). can do. In other implementations, multiple processors and/or multiple buses may be used with multiple memories as needed. Likewise, a plurality of electronic devices may be connected, each electronic device providing some necessary operation (eg, a server array, a group of blade servers, or a multi-processor system). In Fig. 8, one processor 801 is taken as an example.

The memory 802 is a non-transitory computer-readable storage medium provided by the present application. The memory stores instructions executable by at least one processor, and enables the at least one processor to perform the delay estimation method used in the smart rearview mirror provided in the present application. Computer instructions are stored in the non-transitory computer-readable storage medium of the present application, and the computer instructions cause the computer to perform the delay estimation method used in the smart rearview mirror provided in the present application.

The memory 802 is a non-transitory computer-readable storage medium used to store non-transitory software programs, non-transitory computer-executable programs, and modules. For example, program instructions/modules corresponding to the delay estimation method used in the smart rearview mirror in the embodiments of the present application (eg, the first acquiring module 701, the determining module 702, the estimation shown in Fig. 7) module 703 , processing module 704 , second acquiring module 705 , third acquiring module 706 , determining module 707 , and sending module 708 ). The processor 801 operates non-transitory software programs, instructions and modules stored in the memory 802 to perform various functional applications and data processing of the server. That is, the delay estimation method used in the smart rearview mirror of the above method embodiment is implemented.

The memory 802 may include a program storage area and a data storage area, the program storage area may store an operating system and an application program necessary for at least one function, and the data storage area may include a delay estimation method used in a smart rearview mirror. Data generated by the use of the electronic device may be stored. In addition, memory 802 may include high-speed random access memory, and may further include non-transitory memory, eg, at least one magnetic disk memory, flash memory, or other non-transitory solid state memory. In some embodiments, memory 802 optionally includes memory installed remotely to processor 801 , which remote memory may be coupled via a network to the electronic device of the delay estimation method used in the smart rearview mirror. Examples of the network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The electronic device of the delay estimation method used in the smart rearview mirror may further include an input device 803 and an output device 804 . The processor 801 , the memory 802 , the input device 803 , and the output device 804 may be connected via a bus or other method, and in FIG. 8 , the connection via a bus is an example.

The input device 803 may receive input number or character information, and may generate a key signal input related to user setting and function control of an electronic device of a delay estimation method used in a smart rearview mirror, for example, , a touch screen, a keypad, a mouse, a trackpad, a touchpad, a pointing stick, one or more mouse buttons, a trackball, a joystick, etc. input devices. The output device 804 may include a display device, an auxiliary lighting device (eg, an LED), and a tactile feedback device (eg, a vibration motor). The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display, and a plasma display. In some embodiments, the display device may be a touch screen.

Various embodiments of the systems and techniques described herein may be implemented in digital electronic circuit systems, integrated circuit systems, application specific integrated circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may comprise being implemented in one or a plurality of computer programs, ie, the present application further provides a computer program. When the computer program is executed by the processor, the delay estimation method used in the smart rearview mirror described in the above embodiment is performed. The one or more computer programs are executed and/or interpreted in a programmable system comprising at least one programmable processor, which may be a dedicated or generic programmable processor, a storage system, at least one input The device and the at least one output device may receive data and commands, and send the data and commands to the storage system, the at least one input device, and the at least one output device.

Such computing programs (ie, programs, software, software applications, or code) may include machine instructions of a programmable processor and execute such computing programs using high-level procedural and/or object-oriented programming languages and/or assembly/machine languages. can be carried out. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or apparatus (eg, a magnetic disk) that provides machine instructions and/or data to a programmable processor. , optical disks, memories, programmable logic devices (PLDs)), and machine readable media for receiving machine instructions that are machine readable signals. The term “machine readable signal” refers to any signal that provides machine instructions and/or data to a programmable processor.

In order to provide for interaction with a user, the systems and techniques described herein may be implemented on a computer, which computer may include a display device (eg, a cathode ray tube (CRT) or liquid crystal display (LCD) monitor) that displays information to the user. ); and a keyboard and a pointing device (eg, a mouse or a trackball), wherein the user can provide input to the computer through the keyboard and the pointing device. Other types of devices may also be used for interaction with the user, for example, the feedback provided to the user may be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback), It is possible to receive an input from the user in the form of (audio input, voice input, or tactile input).

The systems and techniques described herein can be combined with a computing system that includes a background component (eg, a data server), or a computing system that includes a middleware component (eg, an application server), or a computing system that includes a front end component (eg, For example, it may be implemented on a user computer having a graphical user interface or network browser, through which a user may interact with embodiments of the systems and technologies described herein), or such a background. It may be implemented in a computing system including any combination of components, middleware components, or front end components. The components of the system may be interconnected through any form or medium of digital data communication (eg, a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), the Internet, and blockchain networks.

A computer system may include a client and a server. Clients and servers are typically remote from each other and interact with each other through a communications network. A relationship between a client and a server is created by a computer program running on a corresponding computer and having a client-server relationship with each other. The server may be a cloud server, also referred to as a cloud computing server or cloud host, and is a host product of a cloud computing service system, and in a traditional physical host and VPS service (“Virtual Private Server”, or “VPS”), management is difficult, It solves the disadvantage of weak business scalability. A server can be a server in a decentralized system or a server that combines a blockchain.

It should be understood that by the above various types of flow, steps can be rearranged, added or deleted. For example, each step described in the present application may be executed in parallel or sequentially, or may be executed in a different order. As long as the technical means disclosed in the present application can implement only a desired result, the present application is not limited thereto.

The above specific implementation manner does not limit the protection scope of the present application. Those skilled in the art to which the present invention pertains should understand that various modifications, combinations, sub-combinations and substitutions may be made according to design requirements and other factors. All modifications, equivalent substitutions and improvements made within the spirit and principle of the present application shall fall within the protection scope of the present application.

Claims (15)

A delay estimation method used in a smart rearview mirror, comprising:
acquiring identification information of the external device when the smart rearview mirror is connected to an external device for screen projection;
determining a target delay estimation upper limit value corresponding to the external device according to the identification information;
when the smart rearview mirror transmits a voice signal to the external device, performing delay estimation according to the target delay estimation upper limit value; and
performing delay processing on the speech signal according to a delay estimation result; containing,
Delay estimation method used in the smart rearview mirror, characterized in that. According to claim 1,
The step of determining an upper limit value for estimation of a target delay corresponding to the external device according to the identification information includes:
retrieving, according to the identification information, an upper limit configuration file, the upper limit configuration file including a plurality of pieces of identification information and corresponding relationships between a plurality of delay estimation upper limits;
determining whether a delay estimation upper limit value corresponding to the identification information of the external device exists in the upper limit configuration file;
determining, as the target delay estimation upper limit, an upper limit of delay estimation corresponding to the identification information of the external device in response to the existence of an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file; and
determining a preset upper limit delay estimation value as a target delay estimation upper limit value corresponding to the external device in response to the absence of an upper limit delay estimation value corresponding to the identification information of the external device in the upper limit configuration file; containing,
Delay estimation method used in the smart rearview mirror, characterized in that. 3. The method of claim 2,
Before retrieving the upper limit configuration file according to the identification information, the method comprises:
when the smart rearview mirror connects with an external device for screen projection, sending a network request to a server, and receiving the upper limit configuration file sent by the server according to the network request; or,
obtaining the upper limit configuration file from the local storage module of the smart rearview mirror, wherein the upper limit configuration file is the upper limit configuration file that the smart rearview mirror requested to the server last time; further comprising,
Delay estimation method used in the smart rearview mirror, characterized in that. The method of claim 1,
obtaining a blocking configuration file, the blocking configuration file including a plurality of identification information and corresponding relationships between the voice blocking function configuration information;
determining whether to turn off the voice blocking function of the external device according to the identification information and the blocking configuration file; and
sending control information to the external device in response to turning off the voice blocking function of the external device, wherein the control information is used to instruct the external device to turn off the voice blocking function; further comprising,
Delay estimation method used in the smart rearview mirror, characterized in that. 5. The method of claim 4,
Obtaining the blocking configuration file comprises:
when the smart rearview mirror connects with an external device for screen projection, sending a network request to a server, and receiving the blocking configuration file sent by the server according to the network request; or,
obtaining the blocking configuration file from a local storage module of the smart rearview mirror; containing,
Delay estimation method used in the smart rearview mirror, characterized in that. 6. The method according to any one of claims 1 to 5,
The external device is a vehicle computer system,
Delay estimation method used in the smart rearview mirror, characterized in that. A delay estimation device used in a smart rearview mirror, comprising:
a first acquisition module configured to acquire identification information of the external device when the smart rearview mirror is connected to an external device for screen projection;
a determining module configured to determine an upper limit value of estimation of a target delay corresponding to the external device according to the identification information;
an estimation module configured to perform delay estimation according to the target delay estimation upper limit value when the smart rearview mirror transmits a voice signal to the external device; and
a processing module configured to perform delay processing on the speech signal according to a delay estimation result; containing,
Delay estimation device used in the smart rearview mirror, characterized in that. 8. The method of claim 7,
The decision module is
search, according to the identification information, an upper limit configuration file, the upper limit configuration file including a plurality of pieces of identification information and a corresponding relationship between a plurality of delay estimation upper limits;
determining whether an upper limit of delay estimation corresponding to the identification information of the external device exists in the upper limit configuration file;
determining an upper limit of delay estimation corresponding to the identification information of the external device as the target delay estimation upper limit in response to the existence of an upper limit of delay estimation corresponding to the identification information of the external device in the upper limit configuration file;
In response to a delay estimation upper limit corresponding to the identification information of the external device not present in the upper limit configuration file, a preset upper limit delay estimation value is determined as a target delay estimation upper limit value corresponding to the external device,
Delay estimation device used in the smart rearview mirror, characterized in that. 9. The method of claim 8,
a second acquiring module,
The second acquisition module,
when the smart rearview mirror connects with an external device for screen projection, it sends a network request to the server, and receives the upper limit configuration file sent by the server according to the network request; or,
obtain the blocking configuration file from the local storage module of the smart rearview mirror, wherein the upper limit configuration file is the upper limit configuration file that the smart rearview mirror requested to the server last time;
Delay estimation device used in the smart rearview mirror, characterized in that. 8. The method of claim 7,
a third acquiring module for acquiring a blocking configuration file, wherein the blocking configuration file includes a corresponding relationship between a plurality of identification information and voice blocking function configuration information;
a determination module for determining whether to turn off a voice blocking function of the external device according to the identification information and the blocking configuration file; and
a sending module configured to transmit control information to the external device in response to turning off the voice blocking function of the external device, wherein the control information is used to instruct the external device to turn off the voice blocking function; further comprising,
Delay estimation device used in the smart rearview mirror, characterized in that. 11. The method of claim 10,
The third acquisition module,
When the smart rearview mirror connects with an external device for screen projection, it sends a network request to the server, and receives the blocking configuration file sent by the server according to the network request; or,
obtaining the blocking configuration file from the local storage module of the smart rearview mirror,
Delay estimation device used in the smart rearview mirror, characterized in that. 12. The method according to claim 7 to 11,
The external device is a vehicle computer system,
Delay estimation device used in the smart rearview mirror, characterized in that. In an electronic device,
at least one processor; and
a memory communicatively coupled to the at least one processor; including,
An instruction executable by the at least one processor is stored in the memory, and when the instruction is executed by the at least one processor, the at least one processor performs the method of any one of claims 1 to 6 to do,
Electronic device, characterized in that. A non-transitory computer-readable storage medium having computer instructions stored thereon, comprising:
The computer instructions cause a computer to perform the method of any one of claims 1 to 6,
Non-transitory computer-readable storage medium, characterized in that. A computer program stored in a non-transitory computer-readable storage medium, comprising:
When the computer program is executed by a processor, the method of any one of claims 1 to 6 is performed,
A computer program characterized in that.

Images