CN110556096A

CN110556096A - Voice-controlled display device and method for acquiring voice signal

Info

Publication number: CN110556096A
Application number: CN201810552774.3A
Authority: CN
Inventors: 林成龙; 张燕云; 黄芝成; 张世滨
Original assignee: Giga Byte Technology Co Ltd
Current assignee: Giga Byte Technology Co Ltd
Priority date: 2018-05-31
Filing date: 2018-05-31
Publication date: 2019-12-10

Abstract

The present disclosure provides a method for obtaining a voice signal and a voice control display device, including: display panel, signal input end, radio, microprocessor and display controller. The signal input end is used for receiving a first image signal from the host. The sound receiver is provided with a sound receiving end for receiving external audio signals, the sound receiving end is arranged adjacent to the display panel, and the sound receiving end and the display panel are positioned on the same side of the sound control display device. The microprocessor is electrically connected with the radio, and executes the voice recognition program according to the external sound to obtain an instruction. The display controller is electrically connected with the signal input end, the display panel and the microprocessor, the display controller adjusts the first image signal into a second image signal according to the obtained instruction, and the display panel presents the first image signal or the second image signal.

Description

Voice-controlled display device and method for acquiring voice signal

Technical Field

The present invention relates to a display device and a method for acquiring a speech signal, and more particularly, to a display device for adjusting a frame by voice control and a method for acquiring a speech signal by two microphones.

Background

Currently, computer screens available on the market all provide users with self-adjustment of display mode settings such as brightness, contrast, color temperature, horizontal position, vertical position, scanning frequency, etc. In more detail, the user needs to manually press or touch the physical keys located below, beside or behind the screen to adjust the display mode of personal habits. However, most computer screens provide a limited number of physical keys, and therefore often have a one-key multi-purpose design. For example, the same key is pressed to jump out of the main menu, and the second key is pressed within seconds to enter the currently selected sub-menu.

However, for a general user, it is not a frequent operation to adjust the display mode, so it is not easy to adjust the display mode by physical keys, and the following situations often occur: the setting is lost due to long pressing in the process of pressing the key to perform detail adjustment, or the setting is slowly pressed once because the setting is not needed to be exceeded, or the setting value is considered to exceed the waiting time and jump back to other menus, so that the complicated key action performed before is redone once. Especially for professional players, the display mode of the screen does not affect the game operation, and if a lot of time is consumed for adjusting the screen, the user is not sure to be inconvenienced.

Disclosure of Invention

In view of the above, the present invention provides a voice-controlled display device, which solves the above-mentioned inconvenience of adjusting the display device through physical buttons by intercepting the operation command of the display screen included in the user's voice.

an embodiment of a voice-controlled display device according to the present invention includes: display panel, signal input end, first radio, second radio, microprocessor and display controller. The signal input end receives a first image signal from the host. The first radio receiver is provided with a first radio receiving end for receiving external audio signals, the first radio receiving end is arranged adjacent to the display panel, and the first radio receiving end and the display panel are positioned on the same side of the sound control display device. The second radio receiver is provided with a second radio receiving end for receiving external audio, the second radio receiver is arranged adjacent to the display panel and the first radio receiver, and the second radio receiving end and the display panel are positioned at the same side of the sound control display device. The microprocessor is electrically connected with the radio, and executes the voice recognition program according to the external audio signal to obtain an instruction. The display controller is electrically connected with the signal input end, the display panel and the microprocessor, the display controller adjusts the first image signal into a second image signal according to the obtained instruction, and the display panel presents the first image signal or the second image signal.

a method for acquiring a speech signal according to an embodiment of the present invention includes: the first radio and the second radio respectively obtain external audio signals, wherein the radio receiving end of the first radio and the radio receiving end of the second radio are both arranged adjacent to the same side of the display panel; the microprocessor calculates the characteristic waveforms of the two external audio signals; the microprocessor calculates a difference quantity according to the two characteristic waveforms; and when the difference is smaller than the preset threshold value, the microprocessor executes a voice recognition program according to the external audio signal to obtain an instruction, otherwise, the microprocessor discards the external audio signal.

Through the above structure, the voice-controlled display device disclosed by the invention enables a user to control various settings of a screen through voice, and further in an embodiment of the voice-controlled display device disclosed by the invention, the method for acquiring voice signals disclosed by the invention is matched, and a better effect of receiving the voice of the user is realized through a special design that the two microphones are arranged on the same side of the display panel. Therefore, the general user can easily adjust the display mode of the screen to achieve the best screen viewing visual experience. In addition, for professional players, the game pictures and scenes can be converted in real time through the voice, and the time for the players to manually operate the mouse to convert the pictures and the game scenes is saved. In summary, the voice-controlled display device and the method for acquiring the voice signal disclosed by the invention provide a more humanized way to control the screen, thereby improving the screen adjustment and game operation experience which are more convenient for the user.

The foregoing description of the disclosure and the following detailed description are presented to illustrate and explain the principles and concepts of the invention and to provide further explanation of the invention's scope of the claims.

drawings

Fig. 1 is a block diagram of a voice-controlled display device according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of a position of a display panel and a sound receiving end according to an embodiment of the invention.

FIG. 3 is a diagram illustrating a field diagram and a sound reception range according to an embodiment of the present invention.

FIG. 4A is a schematic diagram of a first image signal displayed on a display panel.

FIG. 4B is a schematic diagram of a second video signal displayed on the display panel.

Fig. 5 is a flowchart illustrating a method for acquiring a speech signal according to an embodiment of the invention.

Description of the symbols

1 display panel

3 signal input terminal

52 first radio

52a first sound receiving end

54 second radio

54a second sound receiving end

7 Microprocessor

9 display controller

Angle A

P intersection region

predetermined region D1-D4

L1, L2 parting line

S1-S6

Detailed Description

The detailed features and advantages of the present invention are described in detail in the embodiments below, which are sufficient for anyone skilled in the art to understand the technical contents of the present invention and to implement the present invention, and the related objects and advantages of the present invention can be easily understood by anyone skilled in the art from the disclosure of the present specification, the request items and the attached drawings. The following examples further illustrate the aspects of the present invention in detail, but are not intended to limit the scope of the present invention in any way.

Please refer to fig. 1, which is a block diagram illustrating a voice-controlled display device according to an embodiment of the present invention, including: display panel 1, signal input end 3, radio 5, microprocessor 7 and display controller 9.

The display panel 1 is a device for displaying pictures for users to watch. Practically, the display panel 1 includes, for example: a Twisted Nematic (TN) panel, an In-Plane-Switching (IPS) panel, or a Vertical Alignment (VA) panel, but the hardware structure of the display panel 1 is not limited thereto.

The signal input terminal 3 is used for receiving a first image signal from a host, such as a personal computer, a server, a smart phone, or a tablet computer with a central processing unit, but not limited thereto. In practice, the signal output end 3 may adopt a common D-sub (sub) Interface, a Digital Video Interface (DVI), a High Definition Multimedia Interface (HDMI), or a DisplayPort Interface.

The radio receiver 5 is used for receiving external audio. In practice, the radio receiver 5 is, for example, a Micro Electro Mechanical Systems (MEMS) microphone. It is emphasized that in one embodiment of the present invention, a dual microphone design is used, such as the first radio 52 and the second radio 54 shown in fig. 1. The radio receiver 5 has a radio receiving end for receiving external audio signals, the radio receiving end is preferably disposed adjacent to the display panel 1, and the radio receiving end and the display panel 1 are both located on the same side of the sound control display device. Referring to fig. 2, it is a schematic view showing that the first sound receiving end 52a of the first sound receiver 52 and the second sound receiving end 54a of the second sound receiver 52 are installed on the display panel 1, and as shown in fig. 2, the first sound receiving end 52a, the second sound receiving end 54a and the display panel 1 are all located on one side of the sound control display device facing the user.

Please refer to fig. 3, which is a schematic diagram illustrating a field diagram and a sound reception range of the directional microphone. In an embodiment of the present invention, the first radio 52 and the second radio 54 are directional microphones of the same specification, and the directivity is heart-shaped (Cardioid) direction, as shown in the field pattern (polar pattern) on the left half of fig. 3, and the heart-shaped area is the sound receiving range of a directional microphone. Further, the area formed by the included angle a in front of the microphone is the best sound pickup range of the directional microphone. In an embodiment of the present invention, the included angle a is 15-60 degrees, which can be set to 45 degrees in practice. In addition, the distance between the first sound receiving end 52a and the second sound receiving end 54a is 2 to 4 centimeters (cm). Referring to the right half of fig. 3, the optimal sound receiving range of the first sound receiver 52 and the optimal sound receiving range of the second sound receiver 54 have an intersection region P, which is represented as the optimal sound receiving ranges of the two microphones. In practice, the range of the intersection region P can be changed by adjusting the distance between the first sound receiving end 52a and the second sound receiving end 54a or the angle at which the two sound receiving ends are disposed.

Please refer to fig. 1. The microprocessor 7 is electrically connected to the first radio 52 and the second radio 54 for receiving external audio signals. In practice, after receiving the external audio from the microphone, the Analog-to-Digital Converter (ADC) built in the Micro-electromechanical directional microphone itself or the external ADC chip may be used to convert the Analog signal of the external audio into a Digital signal, and then the Digital audio signals received by the first radio 52 and the second radio 54 are transmitted to the microprocessor 7 through an I2S (Inter-IC Sound or Integrated Inter-chip Sound) interface, and the microprocessor 7 executes a speech recognition program according to the external audio to obtain an instruction, in practice, the microprocessor 7 is, for example, an Integrated Circuit (IC) or a microcontroller (Micro Control Unit), and the hardware structure of the microprocessor 7 is not particularly limited in the present invention. In addition, in another embodiment of the present invention, the microprocessor 7 further comprises a firmware update interface for downloading the speech recognition databases of different languages, so that the voice-controlled display device disclosed in the present invention can be applied to various countries.

In an embodiment of the present invention, the speech recognition procedure is mainly associated with an algorithm. In detail, after the microprocessor 7 obtains the external audio signal, the speech recognition procedure calculates the time difference between the two microphones receiving the same sound. When the time difference is smaller than or equal to a preset threshold value, the voice recognition program adopts the external audio signal to carry out voice recognition so as to obtain a voice instruction contained in the external audio signal; when the time difference exceeds a preset threshold, the voice recognition program filters the external audio signal. The value of the predetermined threshold is set in relation to the distance between the first sound receiving end 52 and the second sound receiving end 54. In another aspect, when the external audio signal is generated in an area outside the range of the intersection area P and received by the radio receiver 5, the voice recognition program can directly filter out the audio signal, so as to prevent the environmental noise on both sides of the voice-controlled display device from being misinterpreted as the voice command. Based on the above mechanism, the microprocessor 7 according to an embodiment of the present invention can perform speech recognition only on the sound signals within the intersection region P. It should be noted that, in addition to using the time difference as a comparison reference, the intensity difference or other properties that can reflect the sound transmission distance may also be used as a comparison reference, and the present invention is not particularly limited thereto.

Please refer to fig. 1. The display controller 9 is electrically connected to the signal input terminal 3, the display panel 1 and the microprocessor 7. Generally, the display controller 9 is used for displaying the image signal transmitted from the host on the display panel 1 for the user to watch. In practice, the display controller 9 is, for example, a System on Chip (SoC) for controlling a screen, and is electrically connected to the microprocessor 7 through a Universal Asynchronous Receiver/Transmitter (UART) interface to receive commands. In an embodiment of the invention, the display controller 9 is further configured to adjust the first image signal into the second image signal according to an instruction obtained by the voice recognition program, and the display panel 1 is configured to present the first image signal or the second image signal. The first image signal is an original image transmitted by the host, and the display controller 9 may set a predetermined area within a range where the first image signal is displayed on the display panel 1. One embodiment of the second image signal is: the display controller 9 superimposes another local image on the predetermined area based on the original first image signal. For example, if the voice command is "increase brightness", the display controller 9 presents the current brightness state of the display panel 1 in the preset area in the form of image or text, thereby informing the user that the voice-controlled display device has completed the adjustment action instructed by the user.

Another embodiment of the second video signal is: the display controller 9 makes the second image signal include an amplified image signal of the predetermined region. For example, a game player often needs to enlarge and view a certain portion of a game screen during game playing so as to facilitate subsequent game operations. Referring to fig. 4A and 4B together, fig. 4A is a schematic diagram showing the first video signal displayed on the display panel 1, which shows a shooting game picture from a first person perspective, wherein the shooting game picture includes four preset areas D1-D4 separated by separation lines L1 and L2. When the player sends the voice command of "enlarge the upper left corner", the command recognized by the microprocessor 7 can drive the display controller 9 to enlarge and adjust the first image signal belonging to the preset area D1 into the second image signal, and the display controller 9 displays the second image signal on the display panel 1, as shown in fig. 4B. Therefore, the game player can more quickly confirm whether the shooting target exists or aim at the shooting target more accurately, and the interest in game is improved.

In another embodiment of the present invention, the voice-controlled display device further has a light-emitting module electrically connected to the display controller 9, and the light-emitting module is used for emitting a color light of a designated color according to the instruction. In practice, the Light Emitting module is, for example, a Light Emitting Diode (LED) disposed on the sound control display device and facing away from the display panel 1, and the Light Emitting timing and the Light Emitting color of the Light Emitting module can be controlled by the voice command received by the first radio 52 and the second radio 54 on the front side of the display panel 1. Compared with the traditional display device which is only used as an image output device, the sound control display device disclosed by the invention can also be used as an input device for controlling peripheral light, so that the visual experience of a user when watching a screen is improved. In addition, compared with the conventional game host in which the light-emitting module can only write the light configuration file by itself through the operation interface provided by the manufacturer for control, the voice command control method adopted by the voice control display device disclosed by the embodiment of the invention is undoubtedly more intuitive and simple in operation method, and the burden of the user for learning various setting methods is reduced.

Please refer to fig. 5, which is a flowchart illustrating a method for acquiring a voice signal according to an embodiment of the present invention, the method is suitable for the voice-controlled display apparatus. Please refer to step S1: the first radio 52 and the second radio 54 respectively obtain external audio signals. Specifically, the external audio signal is, for example, a screen control command issued by the user or an activation command for activating the microprocessor 7 to start executing the speech recognition program. Please refer to step S2: the microprocessor 7 calculates the respective signature of the two external audio signals. In detail, this step is used to determine the portion of the external audio signals obtained by the first audio receiver 52 and the second audio receiver 54, which belong to the same audio signal. In detail, the external audio signals recorded by the first audio receiver 52 and the second audio receiver 54 may include a plurality of characteristic waveforms, for example, a first characteristic waveform is an environmental noise recorded outside the intersection region P shown in fig. 3, and a second characteristic waveform is a user voice recorded inside the intersection region P. Please refer to step S3: the microprocessor 7 calculates a difference amount according to the calculated characteristic waveform, wherein the difference amount is a time difference or an intensity difference. In the above example, the microprocessor 7 calculates the amount of difference between the first characteristic waveform recorded by the first radio receiver 52 and the first characteristic waveform recorded by the second radio receiver 54, and calculates the amount of difference between the second characteristic waveform recorded by the first radio receiver 52 and the second characteristic waveform recorded by the second radio receiver 54. Please refer to steps S4 to S5: when the difference is smaller than a predetermined threshold, the microprocessor 7 executes a speech recognition procedure according to the characteristic waveform of the external audio signal with the difference smaller than the predetermined threshold to obtain an instruction (which is the second characteristic waveform in the above example). In contrast, when the difference is greater than or equal to the predetermined threshold, please refer to steps S4 to S6, the microprocessor 7 filters the characteristic waveform (the first characteristic waveform in the above example) of the external audio signal with the difference greater than or equal to the predetermined threshold to avoid the erroneous output of the voice command not issued by the user.

In summary, the sound control display device disclosed in the present invention receives the same external audio signal by using two directional microphones installed on the same side of the display panel, compares the relative strength of the audio signal by the microprocessor, and takes the external audio signal outside the optimal reception range as the environmental noise and filters the environmental noise. The method for acquiring the voice signal disclosed by the invention does not adopt the traditional mode of deducting the environmental sound from the external audio signal by a hardware circuit, but improves the recognition rate of the voice of the user and the environmental noise by an algorithm with continuous fine tuning improvement. Therefore, the voice recognition program executed by the microprocessor can really recognize according to the voice sent by the user and output the corresponding voice command, and the display controller uses the acquired voice command to adjust the first image into the second image and display the first image or the second image through the display panel. Therefore, the general user can easily adjust the display mode of the screen to achieve the best screen viewing visual experience. In addition, for professional players, the game pictures and scenes can be converted in real time through the voice, and the time for the players to manually operate the mouse to convert the pictures and the game scenes is saved. Overall, the voice-controlled display device and the method for acquiring the voice signal disclosed by the invention provide a more humanized mode for the user to control the screen, thereby improving the screen adjustment and game operation experience which are more convenient for the user.

Although the present invention has been described with reference to the above embodiments, it is not intended to limit the invention. All changes and modifications that come within the spirit and scope of the invention are desired to be protected. With regard to the scope of protection defined by the present invention, reference should be made to the appended claims.

Claims

1. A voice activated display device, comprising:

A display panel;

A signal input end for receiving a first image signal from a host;

The first radio receiver is provided with a first radio receiving end for receiving an external audio signal, the first radio receiving end is arranged adjacent to the display panel, and the first radio receiving end and the display panel are positioned on the same side of the sound control display device;

a second radio with a second radio end for receiving the external audio signal, the second radio end is disposed adjacent to the display panel and the first radio and the second radio end and the display panel are disposed at the same side of the sound control display device;

A microprocessor electrically connected to the first radio and the second radio, the microprocessor executing a voice recognition program according to the external audio signal to obtain an instruction; and

the display controller is electrically connected with the signal input end, the display panel and the microprocessor and used for adjusting the first image signal into a second image signal according to the instruction;

The display panel is used for displaying the first image signal or the second image signal.

2. The voice-activated display device according to claim 1, wherein the distance between the first sound receiving end and the second sound receiving end is 2 to 4 cm.

3. The acoustic control display device according to claim 1, wherein the first radio and the second radio are directional microphones.

4. The sound-controlled display device according to claim 3, wherein the directional microphone has a sound reception range of 15 to 60 degrees, and the sound reception range of the first radio and the sound reception range of the second radio have an intersection region.

5. the voice-controlled display apparatus according to claim 1, wherein the first video signal includes a predetermined area, and the command is used to drive the display controller such that the second video signal includes an amplified video signal of the predetermined area.

6. the voice-controlled display device according to claim 1, further comprising a light-emitting module electrically connected to the display controller, wherein the light-emitting module is configured to emit a color light of a designated color according to the command.

7. A method of acquiring a speech signal, comprising:

Respectively obtaining an external audio signal by a first radio and a second radio, wherein the radio receiving end of the first radio and the radio receiving end of the second radio are both adjacently arranged at the same side of a display panel;

Calculating a characteristic waveform of each of the external audio signals by using a microprocessor;

calculating a difference quantity by the microprocessor according to the characteristic waveform;

When the difference is smaller than a preset threshold value, the microprocessor executes a voice recognition program according to the external audio signal to obtain an instruction, otherwise, the microprocessor discards the characteristic waveform.

8. The method of claim 7, wherein the difference is a time difference or an intensity difference.

9. The method of claim 7, wherein the distance between the sound receiving end of the first radio and the sound receiving end of the second radio is 2 to 4 cm.

10. The method as claimed in claim 7, wherein the first radio and the second radio are directional microphones.

11. The method as claimed in claim 10, wherein the directional microphone has a sound reception range of 15 to 60 degrees, and the sound reception range of the first radio and the sound reception range of the second radio have an intersection region.