CN115022716A

CN115022716A - Display apparatus, sound field adjusting method, storage medium, and program product

Info

Publication number: CN115022716A
Application number: CN202210498140.0A
Authority: CN
Inventors: 于彬
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-05-09
Filing date: 2022-05-09
Publication date: 2022-09-06

Abstract

The present disclosure relates to a display apparatus, a sound field adjusting method, a storage medium, and a program product, which are applied to the field of display technologies and solve a problem that user experience is affected by imbalance of sounds experienced by an existing user when viewing display content. The display device includes: a detector configured to: acquiring target voice data of a user, wherein the target voice data is a target awakening word for performing sound field calibration on display equipment; a controller configured to: when the target awakening word is a preset awakening word, determining an incident angle of the target voice data based on the direction information of the target voice data, wherein the incident angle of the target voice data is a relative angle between a user and the display equipment; the sound field of the display device is adjusted based on the incident angle of the target speech data.

Description

Display apparatus, sound field adjusting method, storage medium, and program product

Technical Field

The present disclosure relates to the field of display technologies, and in particular, to a display apparatus, a sound field adjusting method, a storage medium, and a program product.

Background

The display device can display some multimedia contents to the user for the user to browse, thereby enriching the amateur life of the user.

When a user watches the display device, the user usually selects a watching position according to personal watching requirements, however, the watching position selected by the user may not be the center position of the sound field of the display device, and especially when the watching position of the user is far away from the center position of the sound field of the display device, the unbalance of the sound emitted by the display device, which is felt by the left ear and the right ear of the user, is affected, thereby greatly reducing the user experience.

Disclosure of Invention

In order to solve the above technical problem or at least partially solve the above technical problem, the present disclosure provides a display device, a sound field adjusting method, a storage medium, and a program product, which can perform voice interaction with the display device in real time when a user views playing content of the display device, so that the display device can adjust a sound field center position of a playing source to be always consistent with the user based on the voice interaction content, thereby facilitating the user to feel balanced sound and improving user experience.

In a first aspect, the present disclosure provides a display device comprising:

a detector configured to: acquiring target voice data of a user, wherein the target voice data is a target awakening word for performing sound field calibration on the display equipment;

a controller configured to: when the target awakening word is a preset awakening word, determining an incident angle of the target voice data based on the direction information of the target voice data, wherein the incident angle of the target voice data is a relative angle between the user and the display equipment;

adjusting a sound field of the display device based on an incident angle of the target speech data.

In some embodiments of the present disclosure, the controller is specifically configured to:

determining an equalization parameter of a sound equalizer of the display device based on the incident angle of the target voice data, wherein the equalization parameter is used for controlling a gain value of each channel of the display device;

adjusting the sound field of the display device based on the equalization parameters of the sound equalizer in the display device.

In some embodiments of the present disclosure, the controller is further configured to:

acquiring a preset value corresponding to the equalization parameter, wherein the preset value is used for describing a maximum sound channel gain value corresponding to the equalization parameter;

the controller is specifically configured to:

determining a first numerical value according to a preset numerical value corresponding to the balance parameter, the incident angle of the target voice data and a preset angle value;

and determining the equalization parameters of the sound equalizer in the display equipment based on the first numerical value and the preset numerical value corresponding to the equalization parameters.

determining a second numerical value based on the first numerical value and a preset numerical value corresponding to the equalization parameter, wherein the second numerical value is used for describing an actual numerical value corresponding to the equalization parameter;

and rounding the second numerical value to obtain the equalization parameters of the sound equalizer in the display equipment.

adjusting a gain value of a first channel in the display device based on an equalization parameter of a sound equalizer in the display device;

and/or adjusting the gain value of the second channel in the display equipment based on the equalization parameter of the sound equalizer in the display equipment.

if the equalization parameter of the sound equalizer in the display equipment is in a first preset parameter range, increasing the gain value of a first sound channel and reducing the gain value of a second sound channel, wherein the first preset parameter range corresponds to the first sound channel;

or if the equalization parameter of the sound equalizer in the display device is in a second preset parameter range, increasing the gain value of the second channel and decreasing the gain value of the first channel, wherein the second preset parameter range corresponds to the second channel.

In some embodiments of the present disclosure, the detector is further configured to:

when detecting that the relative angle between the user and the display equipment changes, generating prompt information, wherein the prompt information is used for indicating the user to carry out sound field calibration on the display equipment;

the controller further configured to: and outputting the prompt information.

In a second aspect, the present disclosure provides a sound field adjusting method, including:

acquiring target voice data of a user, wherein the target voice data is a target awakening word for sound field calibration of the display equipment;

when the target awakening word is a preset awakening word, determining an incident angle of the target voice data based on the direction information of the target voice data, wherein the incident angle of the target voice data is a relative angle between the user and the display equipment;

In some embodiments of the present disclosure, the adjusting the sound field of the display device based on the incident angle of the target speech data includes:

In some embodiments of the present disclosure, further comprising:

the determining equalization parameters of a sound equalizer of the display device based on the incident angle of the target voice data comprises:

In some embodiments of the present disclosure, the determining, based on the first value and a preset value corresponding to the equalization parameter, an equalization parameter of a sound equalizer in the display device includes:

In some embodiments of the present disclosure, the adjusting the sound field of the display device based on the equalization parameter of the sound equalizer in the display device includes:

In some embodiments of the present disclosure, the adjusting the gain value of the first channel in the display device based on the equalization parameter of the sound equalizer in the display device; and/or adjusting the gain value of the second channel in the display device based on the equalization parameter of the sound equalizer in the display device, including:

In some embodiments of the present disclosure, the method further comprises:

and outputting the prompt information.

In a third aspect, the present disclosure provides a computer-readable storage medium comprising: the computer-readable storage medium stores thereon a computer program which, when executed by a processor, implements the sound field adjusting method as shown in the second aspect.

In a fourth aspect, the present disclosure provides a computer program product comprising: when the computer program product is run on a computer, the computer is caused to implement the sound field adjusting method as shown in the second aspect.

Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages: when a user interacts with a display device, target voice data of the user are collected, wherein the target voice data are target awakening words for conducting sound field calibration on the display device, when the target awakening words and preset awakening words are determined, the incident angle corresponding to the target voice data is determined based on direction information of the target voice data, so that the sound field of a sound source emitted by the display device is adjusted corresponding to the user.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the embodiments or technical solutions in the prior art description will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

Fig. 1 is a schematic diagram of an operational scenario between a display device and a control apparatus according to one or more embodiments of the present disclosure;

fig. 2 is a block diagram of a hardware configuration of the control apparatus 100 according to one or more embodiments of the present disclosure;

fig. 3 is a block diagram of a hardware configuration of a display apparatus 200 according to one or more embodiments of the present disclosure;

fig. 4 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present disclosure;

FIG. 5 is a schematic illustration of an icon control interface display of an application in a display device 200 according to one or more embodiments of the present disclosure;

fig. 6A is a system framework diagram for sound field adjustment according to one or more embodiments of the present disclosure;

FIG. 6B is an architectural diagram of sound field adjustments made in accordance with one or more embodiments of the present disclosure;

fig. 7A is a schematic flowchart of a sound field adjusting method according to an embodiment of the disclosure;

fig. 7B is a schematic structural diagram of a microphone array pickup assembly according to an embodiment of the present disclosure;

fig. 7C is a schematic diagram illustrating an operation of a microphone array pickup assembly according to an embodiment of the present disclosure;

fig. 7D is a schematic diagram of sound source localization provided by an embodiment of the present disclosure;

fig. 7E is a schematic diagram of a position relationship between a user and a display device according to an embodiment of the disclosure;

fig. 7F is a schematic diagram of a region where a user is located and a sound field range of a display device according to an embodiment of the disclosure;

fig. 7G is a schematic diagram of another area where a user is located and a sound field range of a display device according to an embodiment of the disclosure;

fig. 8A is a schematic diagram of another position relationship between a user and a display device according to an embodiment of the present disclosure;

fig. 8B is a schematic diagram of a position relationship between a user and a display device according to another embodiment of the disclosure;

fig. 8C is a schematic diagram of a position relationship between a user and a display device according to another embodiment of the disclosure;

fig. 8D is a schematic diagram illustrating adjustment of gain values of channels according to an embodiment of the disclosure;

fig. 8E is a schematic diagram illustrating adjustment of gain values of another channel according to an embodiment of the disclosure;

fig. 8F is a schematic diagram of a position of a user's best-view vision provided by an embodiment of the present disclosure.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.

Different display contents can be played on the display device, wherein different playing sound fields of the display device can be caused by different playing sound channel gain values of each piece of display content, and sound effects received by a user are different, specifically, the most basic configuration of the current display device mainly comprises 2.0 two-channel (left channel and right channel) stereo, and different gain values can be set on the left channel and the right channel, so that the user can conveniently receive the sound.

Generally speaking, if the display device is configured with left and right channel equalization, the sound field of the display device is a middle position, and the best listening effect position of the user is also the middle position of the display device, and if the user is in other positions, because the sounds of the left and right channels of the display device interfere with each other, at this time, for the user, the sound field of the display device is still in the middle position, and at this time, the listening effect of the user is deteriorated.

In the related art, a user can manually control the display device to adjust the left and right channel gain values through an adjusting button on the controller/display device, so that the playing sound of the display content of the display device adapts to the watching position of the user, and therefore, the manual adjusting mode can increase the complexity of watching the display content of the user and reduce the watching experience of the user.

In order to solve the above problem, in the embodiment of the present disclosure, when a user interacts with a display device, a detector of the display device collects target voice data spoken by the user, where the target voice data is a target wake-up word for performing sound field calibration on the display device, and when the target wake-up word and a preset wake-up word are determined, an incident angle corresponding to the target voice data is determined based on direction information of the target voice data, so as to perform adjustment corresponding to the user on a sound field of a sound source emitted by the display device.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to one or more embodiments of the present disclosure. As shown in fig. 1, a user may operate the display device 200 through an intelligent device 300 (e.g., a mobile phone) or a control apparatus 100 (e.g., a remote controller), so that the display device 200 plays corresponding multimedia content, wherein the display device 200 may collect sounds emitted by the user in real time through a microphone array, plan a current sound field of the display device in real time based on a propagation direction of the sounds, and adjust the current sound field of the display device to be consistent with a position of the user.

In some embodiments, when the user turns on the display device through the remote controller and controls the display content played on the display device, the display device may adjust the sound field of the display device in real time based on the incident angle of the sound source emitted by the user.

For example, the range of the sound field of the display apparatus may be a range area where a scene picture that can be captured by a capturing device in the display apparatus is located, and may include: the display device comprises a first area, a second area, a third area, a fourth area and a fifth area, wherein the sound field direction of the display device can correspond to the third area by default; when the sound field corresponding to the display device is determined according to the incident angle of the sound source sent by the user, the display area corresponding to the current sound field of the display device may be adjusted from the third area to the first area, or when the sound field corresponding to the display device is determined according to the incident angle of the sound source sent by the user, the display area corresponding to the current sound field of the display device may be adjusted from the third area to the second area, or when the sound field corresponding to the display device is determined according to the incident angle of the sound source sent by the user, the display area corresponding to the current sound field of the display device may be adjusted from the third area to the fourth area, or when the sound field corresponding to the display device is determined according to the incident angle of the sound source sent by the user, the display area corresponding to the current sound field of the display device may be adjusted from the third area to the fifth area, therefore, the problem in the prior art is solved, voice interaction can be carried out with the display equipment in real time when a user watches the playing content of the display equipment, the center position of the sound field of the playing source of the display equipment can be adjusted to be consistent with that of the user all the time based on the voice interaction content, the user can feel balanced sound conveniently, and user experience is improved.

It should be noted that the first area, the second area, the third area, the fourth area, and the fifth area may be display areas that are located on the same horizontal plane and do not overlap, or the first area, the second area, the third area, the fourth area, and the fifth area may be display areas that are located on different horizontal planes and do not overlap/overlap, which is not specifically limited in the disclosure.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication, a bluetooth protocol communication, a wireless communication or other wired communication to control the display device 200. The user may input a user command through keys on a remote controller, voice input, control panel input, and the like to control the display apparatus 200. In some embodiments, the display device 200 may also be controlled using mobile terminals, tablets, computers, laptops, and other smart devices.

In some embodiments, the display device 200 may not receive instructions using the smart device or the control device described above, but receive control of the user through touch or gesture, or the like.

In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain a voice command, or may be received by a voice control device provided outside the display device 200.

In some embodiments, the smart device 300 may communicate with a software application installed in the display device 200 via a network communication protocol to implement connection communication for the purpose of one-to-one control operation and data communication. The audio and video content displayed on the smart device 300 can also be transmitted to the display device 200, so as to realize the synchronous display function. The display apparatus 200 is also in data communication with the server 400 through various communication means, which may allow the display apparatus 200 to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers. The server 400 may provide various contents and interactions to the display apparatus 200. The display device 200 may be a liquid crystal display, an OLED display, or a projection display device, etc. The display apparatus 200 may additionally provide an intelligent network tv function that provides a computer support function in addition to the broadcast receiving tv function.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, serving as an interaction intermediary between the user and the display device 200. The communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module. The user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a key, or an alternative module.

Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment. The display apparatus 200 as shown in fig. 3 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface (i.e., a user input interface) 280. The controller 250 includes a central processor, a video processor, an audio processor, a graphic processor, a RAM, a ROM, first to nth interfaces for input/output. The display 260 may be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner demodulator 210 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio/video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals. The communicator 220 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of a control signal and a data signal with the external control apparatus 100 or the server 400 through the communicator 220. The detector 230 is used to collect signals of the external environment or interaction with the outside. The controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. The user interface 280 may be used to receive control signals for controlling the apparatus 100 (e.g., an infrared remote control, etc.).

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. A user may input a user command on a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operation and displayed in a graphical manner. It may be an interface element such as an icon, a window, and a control displayed in a display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, and other visual interface elements.

Fig. 4 is a schematic diagram of a software configuration in a display device 200 according to one or more embodiments of the present disclosure, and as shown in fig. 4, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (Application Framework) layer (referred to as a "Framework layer"), an Android runtime (Android runtime) and system library layer (referred to as a "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (Window) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, applications in the application layer include, but are not limited to, the above examples.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software, including at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..

Fig. 5 is a schematic diagram illustrating an icon control interface display of an application program in the display device 200 according to one or more embodiments of the present disclosure, as shown in fig. 5, an application layer includes at least one application program that can display a corresponding icon control in a display, for example: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like. The live television application program can provide live television through different signal sources. A video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. The media center application program can provide various applications for playing multimedia contents. The application program center can provide and store various application programs.

In some embodiments, the display device is a terminal device having a display function, such as a television or a flat panel television. In the display device:

in some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

An output interface (display 260, and/or audio output interface 270) configured to output user interaction information;

a communicator 220 for communicating with the server 400;

a detector 230 configured to: acquiring target voice data of a user, wherein the target voice data is a target awakening word for performing sound field calibration on the display equipment;

a controller 250 configured to: when the target awakening word is a preset awakening word, determining an incident angle of the target voice data based on the direction information of the target voice data, wherein the incident angle of the target voice data is a relative angle between the user and the display equipment;

In some embodiments, the controller 250 is specifically configured to: determining an equalization parameter of a sound equalizer of the display device based on the incident angle of the target voice data, wherein the equalization parameter is used for controlling a gain value of each channel of the display device; adjusting the sound field of the display device based on the equalization parameters of the sound equalizer in the display device.

In some embodiments, the controller 250 is further configured to: acquiring a preset value corresponding to the equalization parameter, wherein the preset value is used for describing a maximum sound channel gain value corresponding to the equalization parameter; the controller 250 is specifically configured to: determining a first numerical value according to a preset numerical value corresponding to the balance parameter, the incident angle of the target voice data and a preset angle value; and determining the equalization parameters of the sound equalizer in the display equipment based on the first numerical value and the preset numerical value corresponding to the equalization parameters.

In some embodiments, the controller 250 is specifically configured to: determining a second numerical value based on the first numerical value and a preset numerical value corresponding to the equalization parameter, wherein the second numerical value is used for describing an actual numerical value corresponding to the equalization parameter; and rounding the second numerical value to obtain the equalization parameters of the sound equalizer in the display equipment.

In some embodiments, the controller 250 is specifically configured to: adjusting a gain value of a first channel in the display device based on an equalization parameter of a sound equalizer in the display device; and/or adjusting the gain value of the second channel in the display equipment based on the equalization parameter of the sound equalizer in the display equipment.

In some embodiments, the controller 250 is specifically configured to: if the equalization parameter of the sound equalizer in the display equipment is in a first preset parameter range, increasing the gain value of a first sound channel and reducing the gain value of a second sound channel, wherein the first preset parameter range corresponds to the first sound channel; or if the equalization parameter of the sound equalizer in the display device is in a second preset parameter range, increasing the gain value of the second channel and decreasing the gain value of the first channel, wherein the second preset parameter range corresponds to the second channel.

In some embodiments, the detector 230 is further configured to: when detecting that the relative angle between the user and the display equipment changes, generating prompt information, wherein the prompt information is used for indicating the user to carry out sound field calibration on the display equipment; the controller 250, further configured to: and outputting the prompt information.

In summary, in the embodiment of the present disclosure, when a user interacts with a display device, a detector of the display device collects target speech data spoken by the user, where the target speech data is a target wake-up word for performing sound field calibration on the display device, and when the target wake-up word and a preset wake-up word are determined, an incident angle corresponding to the target speech data is determined based on direction information of the target speech data, so as to perform adjustment corresponding to the user on a sound field of a sound source emitted by the display device.

Fig. 6A is a block diagram of a system for adjusting a sound field according to one or more embodiments of the present disclosure, and as shown in fig. 6A, the system may include a voice data acquisition module 601, an incident angle determination module 602, and a sound field adjustment module 603. After the system collects target voice data of a user through a voice data collection module 601, wherein the target voice data is a target awakening word for performing sound field calibration on a display device, when the target awakening word is a preset awakening word, an incident angle determination module 602 determines an incident angle of the target voice data based on direction information of the target voice data, the incident angle of the target voice data is a relative angle between the user and the display device, and a sound field of the display device is adjusted through a sound field adjustment module 603 based on the incident angle of the target voice data, so that when the user watches playing content of the display device, voice interaction can be performed with the display device in real time, and the center position of the sound field of a playing source of the display device can be adjusted to be consistent with the user all the time based on the voice interaction content, the user can feel balanced sound conveniently, and the user experience is improved.

Fig. 6B is an architecture diagram for performing sound field adjustment according to one or more embodiments of the present disclosure, and based on the system framework, the implementation of the present disclosure in an android system is as shown in fig. 6B, where the android system mainly includes an application layer, a framework layer, a system runtime layer, and a kernel layer, and the implementation logic is mainly embodied in the application layer, where the implementation logic includes a voice data acquisition module, an incident angle determination module, and a sound field adjustment module.

The sound field adjusting method provided in the embodiment of the disclosure collects voice data of a user in a speaking period by detecting the voice behavior of the user in real time, and matches the voice data with a preset awakening word when the user is detected to speak, wherein the preset awakening word is a starting condition for adjusting the sound field of the display device, when the matching degree of the voice data spoken by the user and the preset awakening word is determined to be higher than a certain threshold value, the sound incident angle between the user and the display device is measured based on the propagation direction of the voice data sent by the user, and the corresponding area of the sound field of the display device is corrected in real time according to the sound incident angle between the user and the display device, so as to ensure that the corresponding area of the sound field of the display device is consistent with the area where the user is located, thereby facilitating the user to enjoy the consistent sound body feeling of left and right ears at different viewing positions, the sound experience degree when watching the display content is effectively improved.

For more detailed description of the present solution, the following description is made in conjunction with fig. 7A, and it is understood that the steps involved in fig. 7A may include more steps or fewer steps in actual implementation, and the order between the steps may also be different, so as to enable the sound field adjusting method provided in the embodiment of the present disclosure to be implemented, and the embodiment of the present disclosure is not limited.

As shown in fig. 7A, fig. 7A is a schematic flowchart of a sound field adjusting method according to an embodiment of the present disclosure, where the sound field adjusting method specifically includes the following steps:

s110, collecting target voice data of a user, wherein the target voice data are target awakening words for performing sound field calibration on display equipment.

The user may be a crowd watching the display device, or the user may be a crowd appearing in a scene image that can be collected by a camera of the display device.

For example, when the person a views multimedia content through the display device, the person a may be the user mentioned in the present disclosure, or when the person B, the person C, and the person D simultaneously appear in a scene image that can be captured by an image capturing device of the display device, the person B/the person C/the person D may be the user mentioned in the present disclosure.

When it is determined that there are a plurality of users corresponding to the display device, that is, there are a plurality of people appearing in the scene image that can be captured by the camera of the display device at the same time, the user referred to in the present disclosure can be determined by the sound priority of the people/whether to view the display device.

In combination with the above examples, the person B, the person C, and the person D simultaneously appear in the scene image that can be collected by the camera device of the display device, and the person B, the person C, and the person D are used as candidate users, and it is determined whether there is a person who watches the display device among the person B, the person C, and the person D, if only the person B watches the display device, the person B may be used as the user indicated in the present disclosure, or if only the person C watches the display device, the person C may be used as the user indicated in the present disclosure, or if only the person D watches the display device, the person D may be used as the user indicated in the present disclosure.

Wherein, if there are two people watching the display device at the same time, it can be determined who is the user based on the sound priority of the two people, and the sound priority can be the person who speaks.

In combination with the above examples, the person B, the person C, and the person D simultaneously appear in the scene image that can be collected by the camera device of the display device, and the person B, the person C, and the person D are taken as candidate users, if the person B and the person C simultaneously view the display device, and the person B makes a voice utterance, the person B can be considered as a user referred to in this disclosure, and the target voice data of the user is collected, and then the content of the utterance of the person B can be collected, or, if the person B and the person D simultaneously view the display device, and the person D makes a voice utterance, the person D can be considered as a user referred to in this disclosure, and the target voice data of the user is collected, and then the content of the utterance of the person D can be collected.

Wherein, if there are two at least personnel simultaneously and watch display device, and these two personnel all make sound, then can be based on the sound propagation direction of two personnel, confirm who is the user.

In combination with the above example, the person B, the person C, and the person D simultaneously appear in the scene image that can be captured by the camera of the display device, and the person B, the person C, and the person D are taken as candidate users, and if the person B, the person C, and the person D simultaneously view the display device and the person B and the person C all make a sound, but the propagation direction of the sound made by the person B is not the direction of the display device and the propagation direction of the sound made by the person C is the direction of the display device, it can be considered that the person C is the user indicated in the present disclosure, and the target speech data of the user is captured, and the content of the speech of the person C can be captured.

The target voice data may be a sentence composed of one word or a plurality of words interacted between the user and the display device, and may be a target wake-up word for sound field calibration of the user on the display device.

For example, the target wake word may be a word, such as the user may say "on" to the display device, or the user may say "correct" to the display device, and so on.

As another example, the target wake-up word may be a sentence composed of a plurality of words, such as the user may say "turn on sound field correction" to the display device, or the user may say "make sound field correction" to the display device, or the user may say "i want to correct sound field" to the display device, and so on.

It should be noted that the user may issue the target voice data at any position corresponding to the display device, that is, the display device may collect the sound as the target wake-up word when detecting that the user issues the sound.

In addition, when the display device collects the target voice data of the user, the display device is turned on, that is, in the state that the display device is turned on, the target wake-up word sent by the user is used for the purpose of correcting and controlling the sound field of the display device.

The display device can execute subsequent operation through acquiring the target awakening words of the user when the control button is turned on, and can trigger sound field correction to indicate that the display device cannot execute the subsequent operation through acquiring the target awakening words of the user when the control button is turned off.

Specifically, under the condition that the control button is turned off, after the display device collects the target wake-up word sent by the user, a prompt window can be popped up in the display interface, the user is asked whether to start sound field correction, and after the user confirms the prompt window, the subsequent operation can be executed.

Or, under the condition that the control button is turned off, after the display device collects the target wake-up word sent by the user, the sound field correction can be automatically turned on, the subsequent operation is continuously executed, and the message for turning on the sound field correction is displayed to the user on the display interface, so that the user can know the correction condition conveniently.

It should be noted that the control button set on the display device may be a virtual button or a physical button, where if the control button is a virtual button, the user may be supported to execute on/off in the display device through a remote controller or other control methods, and if the control button is a physical button, the user may execute on/off in a triggering manner such as pressing or clicking on the display device.

According to the method, before the target voice data of the user is collected, a microphone array pickup assembly can be integrated in the display device, so that the target voice data of the user can be collected through the microphone array pickup assembly when the target voice data of the user is collected, the microphone array pickup assembly can be a double-microphone far-field pickup plate or four-microphone and above far-field pickup plates, and 2-path or 4-path and above original audio can be collected.

As exemplarily shown in fig. 7B, the microphone array pickup assembly is integrated in the display device through the interface 1 to be communicatively connected with the display device, wherein the microphone array pickup assembly may further include two microphones, mic2 and mic3, and mic2 and mic3 may be respectively used for collecting one or more channels of audio data emitted by the user.

As shown in fig. 7C, the mic2 is used to collect audio data sent by a first user, and the mic3 is used to collect audio data sent by a second user, so as to obtain two paths of audio data.

And S120, when the target awakening word is a preset awakening word, determining the incident angle of the target voice data based on the direction information of the target voice data.

And determining whether the target awakening word is the preset awakening word or not according to the matching degree between the target awakening word and the preset awakening word, wherein a critical threshold value can be set for measuring the matching degree between the target awakening word and the preset awakening word.

The preset wake-up word may be "turn on/perform sound field correction".

With reference to the foregoing example, when the target wake-up word is "on", at this time, the display device is already turned on, and the user does not explicitly specify which function or application is turned on, the target wake-up word spoken by the user may be considered to be used for sound field correction for turning on the display device, and the target wake-up word may be considered to be a preset wake-up word; or when the target wake-up word is "on", at this time, the display device is already turned on, and the user does not explicitly specify which function or application is on, the target wake-up word spoken by the user can be considered to be used for sound field correction for turning on the display device, and the target wake-up word can be considered to be a preset wake-up word; or, when the target wake-up word is correct, at this time, the user does not explicitly specify that the target wake-up word is a correction target, and the target wake-up word spoken by the user may be considered to be used for correcting the sound field of the display device, and may be considered to be a preset wake-up word.

For another example, when the target wake-up word is "start sound field correction", it can be matched that the matching degree between the target wake-up word and the preset wake-up word is higher than a critical threshold, and the target wake-up word can be regarded as the preset wake-up word; or when the target awakening word is 'sound field correction', the matching degree between the target awakening word and the preset awakening word is higher than a critical threshold value in a matched mode, and the target awakening word is considered to be the preset awakening word; or when the target awakening word is "i want to correct the sound field", matching that the matching degree between the target awakening word and the preset awakening word is higher than a critical threshold value can be matched, and the target awakening word can be considered as the preset awakening word.

The direction information of the target voice data can be obtained by positioning the sound source of the target voice data, and specifically, the sound source of the target voice data (i.e., the user) can be positioned by using the phase difference between the collected multiple paths of target voice data.

As shown in fig. 7C for example, the mic2 collects the direction information of the audio data uttered by the first user, and as shown in fig. 7C for example, the mic3 collects the direction information of the audio data uttered by the second user, it can be determined that the sound source of the target speech data is at the position U as shown in fig. 7D for example, and accordingly, the incident angle of the target speech data is θ.

The incident angle of the target voice data is a relative angle between the user and the display device, that is, the incident angle of the target voice data may be an angle between the user and the display device on a horizontal plane which is a long plane of the display device.

As exemplarily shown in fig. 7E, the relative angle between the user and the display device is an angle θ exemplarily shown in fig. 7E, and the relative angle between the user and the display device ranges from [0 °,180 ° ].

In addition, when the target awakening word sent by the user is determined to be the preset awakening word, a non-receiving time period can be set for avoiding the problem that the processing efficiency of the display device is influenced by receiving voice data for multiple times in a short time period.

For example, in a first period after the target wake-up word sent by the user a is determined to be the preset wake-up word, the voice data sent by the user a or the other user B is received, and the received voice data sent by the user a or the other user B can be shielded if the first period is in a set non-receiving period.

And S130, adjusting the sound field of the display equipment based on the incident angle of the target voice data.

Wherein adjusting the sound field of the display device based on the incident angle of the target voice data may include: and adjusting the sound field of the display device to the area where the user is located based on the incident angle of the target voice data, or adjusting the sound field of the display device to be overlapped/highly overlapped with the area where the user is located based on the incident angle of the target voice data.

For example, the area where the user a is located is an area a, the area corresponding to the current sound field of the display device is an area b, the area a is not equal to the area b, or there is little/no overlapping area between the area a and the area b, the current sound field of the display device may be adjusted from the area b to the area a, or the current sound field of the display device may be adjusted from the area b to an area c with a higher overlapping degree with the area a.

Specifically, as exemplarily shown in fig. 7F, the region corresponding to the current sound field of the display device is a range region exemplarily shown as a region b in fig. 7F, the region where the user a is located is a range region exemplarily shown as a region a in fig. 7F, and the sound field of the display device can be adjusted to the range region exemplarily shown as a region b in fig. 7F by the incident angle of the target voice data.

As exemplarily shown in fig. 7G, the region corresponding to the current sound field of the display device is a range region exemplarily shown as a region b in fig. 7G, the region where the user a is located is a range region exemplarily shown as a region a in fig. 7F, and the sound field of the display device can be adjusted to be a range region exemplarily shown as a region c in fig. 7F by the incident angle of the target voice data, wherein the region c is nearly overlapped with the range region of the region a or is overlapped with most regions.

The parameter value of the sound equalizer used for adjusting the sound field range in the display device can be calculated through the incident angle of the target voice data, so that the display device automatically adjusts the gain values of the left and right channels of the display device based on the calculated parameter value of the sound equalizer used for adjusting the sound field range, and the sound field range is rapidly adjusted.

It should be noted that, the sound field may be adjusted by the present disclosure, including but not limited to, adjusting the left and right channels, and specifically, the gain values of the multiple channels may be adjusted to meet the viewing requirements of the user according to the multi-channel setting of the display device, for example, the gain values of the upper and lower channels may also be adjusted.

Based on the description of the above embodiment, when adjusting the sound field of the display device, the gain value of each channel of the sound equalizer in the display device may be determined first through the determined relative angle between the user and the display device, so that the display device can adjust the playback volume of each channel based on the gain value of each channel, so that the sound field of the display device corresponds to the area where the user is located.

Wherein, the gain value of each sound channel is used for controlling the volume of the sound emitted by the sound channel.

Specifically, when the user is in the middle position of the display device, as exemplarily shown in fig. 8A, the left and right channels of the display device may use the same gain value to ensure that the volume values heard by the left and right ears of the user are uniform.

When the user is not in the middle position of the display device, as exemplarily shown in fig. 8B, the left and right channels of the display device may adopt different gain values to avoid the problem of non-uniform volume received by the user.

When the user is not in the middle position of the display device, as exemplarily shown in fig. 8C, the left and right channels of the display device may adopt different gain values to avoid the problem of non-uniform volume received by the user.

In some embodiments, the determining of the equalization parameter of the sound equalizer in the display device may be implemented by combining a preset value, where the preset value may be used to describe a maximum channel gain value corresponding to the equalization parameter, and specifically may be set to 9.

The method comprises the steps of determining a first value according to a preset value corresponding to an equalization parameter by combining an incident angle and a preset angle value of target voice data, and obtaining the equalization parameter of a sound equalizer in the display device based on the first value and the preset value.

Specifically, a second numerical value may be determined according to the first numerical value and a preset numerical value, where the second numerical value may be used to describe an actual numerical value calculated/measured based on the equalization parameter, and the second numerical value is subjected to a nearest integer rounding operation to obtain the equalization parameter of the sound equalizer in the display device.

For example, the equalization parameters can be implemented as follows.

Wherein the content of the first and second substances,

corresponding to the first value, N corresponds to a preset value which is the maximum value of the balance parameter, 180 degrees corresponds to a preset angle value,

corresponding to the second value.

Where, when N is 9, W has a value range of [ -9,9], where W is 9 may indicate that all sounds emitted from the display device are controlled by the gain value of the left channel, the gain value of the right channel is 0, W is 9 may indicate that all sounds emitted from the display device are controlled by the gain value of the right channel, and the gain value of the left channel is 0.

In general, the default value of W for the display device is 0, which means that the gain values of the left and right channels of the display device are the same, that is, the volume values of the sound emitted by the left speaker and the right speaker are the same.

Wherein, the value range of theta is [0 DEG, 180 DEG ], and W is changed along with the change of the incident angle theta of the target voice data.

In some embodiments, when the display device has a first channel and a second channel, gain value adjustments may be made to the first channel and the second channel separately/simultaneously based on different equalization parameters.

The gain value of the first channel of the display device and the gain value of the second channel of the display device may be adjusted simultaneously according to the determined equalization parameter, or the gain value of the first channel of the display device may be adjusted according to the determined equalization parameter, or the gain value of the second channel of the display device may be adjusted.

Specifically, a specific range of values corresponding to the equalization parameters may be determined to determine the adjustment strategies for the first channel and the second channel.

Two parameter ranges can be set, namely a first preset parameter range and a second preset parameter range, wherein the first preset parameter range can be (— infinity, 0), and the second preset parameter range can be (0, + ∞).

In connection with the above example, N is 9, θ is 60 °, W is-3, and the adjustment of the gain value of the channel of the display device can be exemplarily shown in fig. 8D, and the sound field of the display device can be ensured to be in the area where the user is located by increasing the gain value of the left channel and decreasing the gain value of the right channel, wherein the display device can automatically perform the operation of increasing or decreasing the gain values of the left and right channels by writing the equalization parameter W-3 into the sound playing parameter of the display device.

In connection with the above example, N is 9, θ is 120 °, W is 3, and the gain value of the channel of the display device is adjusted, as exemplarily shown in fig. 8E, the sound field of the display device can be ensured to be in the area where the user is located by increasing the gain value of the right channel and decreasing the gain value of the left channel, wherein the display device can automatically perform the operation of increasing and decreasing the gain values of the left and right channels by writing the equalization parameter W3 into the sound playing parameter of the display device.

In particular, as shown in fig. 8F, it can be seen that the user is in the middle of the display device and in the center of the sound field, and the best hearing effect can be obtained.

In some embodiments, after it is determined that the sound field of the display device is successfully adjusted, whether the relative angle between the user and the display device changes or not can be detected in real time, when the relative angle between the user and the display device is detected to change, prompt information is generated and output to a display of the display device, a request inquiry whether the sound field adjustment needs to be performed or not is prompted to the user, and therefore the user can effectively know the visual effect of the current viewing position and perform timely processing when viewing the display device.

Whether the relative angle between the user and the display equipment is changed or not is detected, and image detection or voice detection can be achieved.

For example, whether a user makes a sound is detected, if the user makes the sound, the sound made by the user can be collected to position the current position of the user, and if the current position of the user is detected to change, the change of the relative angle between the user and the display device is determined.

Or recording an original relative angle value between the user and the display equipment when the user carries out sound field adjustment last time, positioning the current position of the user by collecting the sound emitted by the user when detecting that the user emits the sound, obtaining a new relative angle value between the current position of the user and the display equipment, and determining that the relative angle between the user and the display equipment changes when the new relative angle value is not equal to the original relative angle value or the difference between the new relative angle value and the original relative angle value is larger than a certain value.

For another example, the position of the user is located in real time by a camera device (an embedded camera or an external camera) of the display device, and if it is detected that the current position of the user changes, it is determined that the relative angle between the user and the display device changes.

Or recording an original relative angle value between the user and the display device when the user performs sound field adjustment last time, calculating a new relative angle value between the current position of the user and the display device when detecting that the position of the user changes, and determining that the relative angle between the user and the display device changes when the new relative angle value is not equal to the original relative angle value or the difference between the new relative angle value and the original relative angle value is larger than a certain value.

To sum up, according to the sound field adjusting method implemented on the display device, when a user interacts with the display device, target voice data of the user is collected, wherein the target voice data is a target wake-up word for performing sound field calibration on the display device, and when the target wake-up word and a preset wake-up word are determined, an incident angle corresponding to the target voice data is determined based on direction information of the target voice data, so as to perform adjustment corresponding to the user on a sound field of a sound source emitted by the display device.

The embodiments of the present disclosure provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process executed by the sound field adjusting method, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here.

The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

The present disclosure provides a computer program product, comprising: when the computer program product is run on a computer, the computer is caused to implement the sound field adjusting method described above.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the foregoing discussion in some embodiments is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

2. The display device of claim 1, wherein the controller is specifically configured to:

determining an equalization parameter of a sound equalizer of the display device based on the incident angle of the target voice data, wherein the equalization parameter is used for controlling a gain value of each sound channel of the display device;

3. The display device of claim 2, wherein the controller is further configured to:

the controller is specifically configured to:

4. The display device of claim 3, wherein the controller is specifically configured to:

5. The display device of claim 2, wherein the controller is specifically configured to:

6. The display device of claim 5, wherein the controller is specifically configured to:

7. The display device of claim 1, wherein the detector is further configured to:

the controller further configured to: and outputting the prompt message.

8. A sound field adjusting method, comprising:

acquiring target voice data of a user, wherein the target voice data is a target awakening word for performing sound field calibration on display equipment;

9. A computer-readable storage medium, comprising: the computer-readable storage medium stores thereon a computer program which, when executed by a processor, implements the sound field adjusting method according to claim 8.

10. A computer program product, comprising: when the computer program product is run on a computer, the computer is caused to implement the sound field adjusting method of claim 8.