TW201947389A - Voice control system and method for display device - Google Patents

Abstract

A voice control system and method for display device are provided according to an embodiment of the invention. A display device has display information based on a display type and connects to a host device. A voice server receives and analysis a voice command to transmit a keyword command associated to the display device. An internet-of-thing server is connected to the voice server and the host device, receives the keyword command, and generates a control command associated to the display device to transmit the control command to the host device. The host device reads the display information from the display device via an instruction interface to provide and notify a voice-controlled command corresponding to the display information. When the host device receives the control command associated to the voice-controlled command, the host device controls the display device to perform a operation function according to the control command.

Description

Voice control system and voice control method of display device

The invention relates to a voice control system and a voice control method for a display device, and more particularly to a voice control system and a voice control method that can provide a voice control instruction to a user according to the type of display.

More and more electronic devices are using voice control. Voice control will become the user interface commonly used by most electronic devices in the future. As a result, smart voice device systems are also booming. In addition to the ability to provide answering functions, the current smart voice device systems on the market, due to the humane and simple operation of voice control, use voice control to control other electronic devices (such as Are household appliances, 3C electronics, etc.). For example, smart home services or the Internet of Things can provide voice control.

On the other hand, with the advancement of display technology, the functions of the display have also become more diversified. Among them, through wired or wireless transmission technology, the display can display corresponding pictures for user viewing based on the image data provided by the image source device. . It can be known that if the display is to be controlled manually by the intelligent voice assistant and Internet of Things technology on the market, the display must be equipped with a wireless or wired network communication module (such as a WiFi module or a local area network (LAN)). Modules, etc.). However, the general displays sold in the market usually do not have such network communication modules, so users cannot actually control these general displays without network communication modules through the Internet of Things technology and smart voice assistants. If a network communication module is added to a general display, it will inevitably increase the display manufacturing cost and hardware design complexity.

In view of this, the present invention provides a voice control system and voice control method for a display device, which not only allows users to control a display device without a network communication module through voice, but also provides corresponding voice control according to the type of the display device. Instructions to the user.

An embodiment of the present invention provides a voice control system for a display device, which includes a display device, a host device, a voice server, and an Internet of Things server. The display device has display information based on the display type. The host device is coupled to the display device. The voice server receives the voice command, analyzes the voice command, and transmits a keyword string command to be associated with the display device. The IoT server is coupled to the host device and the voice server, receives a keyword string command, and generates a control command associated with the display device according to the keyword string command to transmit the control command to the host device. The host device reads the display information from the display device through the command interface to provide and prompt at least one voice control command corresponding to the display information. When the host device receives a control instruction related to the voice control instruction, the host device controls the display device to perform an operation function according to the control instruction.

Another embodiment of the present invention provides a voice control method for a display device, which includes: receiving a voice command by a voice server, and analyzing the voice command to transmit a keyword string command to be associated with the display device; and receiving by the Internet of Things server Keyword string command, according to the keyword string command, generates a control command related to the display device to transmit the control command to the host device; the host device reads the display information from the display device through the command interface to provide and prompt the display information At least one voice control instruction; and when the host device receives the control instruction associated with the voice control instruction, the host device controls the display device to perform an operation function according to the control instruction.

Based on the above, in the embodiment of the present invention, the display device is connected to the host device via an existing video transmission interface. When the user issues a voice command to the smart voice device, the voice server can perform voice recognition and send the recognition result to the Internet of Things server. The IoT server can send a control command corresponding to the voice recognition result to the correct host device, and thus the host device controls the display device to perform an operation function corresponding to the voice command via the command interface. Therefore, even if the display device is not equipped with any network communication module, the display device can still perform corresponding function operations through the smart voice device and according to the voice command issued by the user.

In order to make the above features and advantages of the present invention more comprehensible, embodiments are hereinafter described in detail with reference to the accompanying drawings.

FIG. 1 is a schematic diagram of a voice control system of a display device according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a display device and a host device according to an embodiment of the invention. 1 and FIG. 2, the voice control system 10 includes a smart voice device 110, a voice server 120, an Internet of Things server 130, a host device 140, and a display device 150. In other embodiments, the number of the host device 140 and the display device 150 may be more or less, which is not limited in the present invention.

The display device 150 may be various display devices independent of the host device 140. The display 150 is, for example, a Liquid Crystal Display (LCD), a Light-Emitting Diode (LED) display, a Field Emission Display (FED), or an Organic Light-Emitting Diode, OLED) or other kinds of displays, the present invention is not limited thereto. The display device 150 may include a screen S1 and a display processor 151. The display processor 151 may be a programmable general purpose or special purpose microprocessor (Microprocessor), a digital signal processor (DSP), a programmable controller, or an application specific integrated circuit. Circuits (ASIC), Programmable Logic Device (PLD) or other similar devices or a combination of these devices.

The host device 140 is, for example, a personal computer (PC), a digital set top box (STB), a tablet computer, a smart phone, a TV game instrument, a DVD player, or the like. Generally, the host device 140 can transmit the image data to the display device 100 for display. In addition, in the embodiment of the present invention, the host device 140 may be connected to the display device 150 through a wired video transmission interface I1. The wired video transmission interface I1 is, for example, a Video Graphics Array (VGA) interface, a digital video interface ( Digital Visual Interface (DVI) interface, High-Definition Multimedia Interface (HDMI) interface, DisplayPort (DP) interface or Thunderbolt interface, etc. The present invention is not limited thereto.

Referring to FIG. 2, the host device 140 may include a processor 142 and a memory element 143. The memory element 143 is, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory (Flash memory), A hard drive or other similar device or combination of these devices that is used to store data. The type of the memory element 143 is not limited herein. The memory component 143 can load various software components (for example, an operating system, a driver, various program instructions, etc.) and data for execution and use by the processor 142. In this embodiment, the software components in the memory component 143 include an application program 141.

The processor 142 may be, for example, a central processing unit (CPU), or other programmable general purpose or special purpose microprocessor (Microprocessor), digital signal processor (DSP), programmable controller, special application product Body Circuit (ASIC), Programmable Logic Device (PLD) or other similar device or a combination of these devices. The processor 142 is coupled to the memory element 143 and is used to access the application program 141 and the operating system and the like loaded into the memory element 143. In an embodiment, the processor 142 may further include a Graphic Processing Unit (GPU) to generate image data suitable for output to the display 150. For example, the processor 142 of FIG. 2 may be implemented as a central processing chip with a built-in graphics processor. Alternatively, the processor 142 may be implemented as a combination of a central processing chip and a graphics processor on a separate display card.

In an embodiment, the processor 142 may display the display with the display device 150 through, for example, a digital display channel / command interface (DDC / CI) and a monitor control command set (MCCS). The processor 151 communicates to detect the display type of the display device 150 and control the display device 150 to perform corresponding operations. For example, the type of the display device 150 may be a gaming category, a non-gaming category, a general category, or a commercial category.

Please refer to FIG. 1 again. The smart voice device 110 is used for receiving voice commands spoken by a user, and is, for example, a smart speaker or other electronic device having a radio device (such as a microphone). In one embodiment, the smart voice device 110 may further include a sound emitting device such as a speaker, which is used to send voice messages and to talk with the user.

The voice server 120 is connected to the smart voice device 110 and receives a voice command V1 in an audio format from the smart voice device 110. The voice server 120 can perform voice recognition on the voice command V1 in the audio format, and generate a keyword string command W1 that matches the user's attempt and is in the text format. For example, the voice server 120 may output a keyword string command W1 including at least one keyword after performing voice recognition. Generally speaking, the keywords may include a device name and an execution action. That is, the keyword string instruction W1 may include the device name of the display device 150 that the user intends to control and the execution action that the user expects the display device 150 to perform. For example, the keyword string instruction W1 may include keywords such as the action “on” and the device name “display No. 1”.

The IoT server 130 may be connected to the voice server 120 and the host device 140 via a network. Generally speaking, the IoT server 130 is the control center of the IoT control system. It can control various electronic devices registered under the IoT server 130 via the network. In the embodiment of the present invention, the IoT server 130 receives the keyword string command W1 from the voice server 120. For example, the IoT server 130 may communicate with the voice server 120 through a Hypertext Transfer Protocol (HTTP) to receive the keyword string command W1. After that, the IoT server 130 may generate a control command C1 associated with the display device 150 according to the keyword string command to transmit the control command C1 to the host device 140.

In detail, after registering with the Internet of things server 130, the Internet of things server 130 may register the device serial number, device name, and user account and other related information of the display device 150. Therefore, when the IoT server 130 detects that the keyword string command W1 includes the device name of the display device 150, the IoT server 130 may translate the device name and execution action in the keyword string command W1 into the control command C1 The first device identification code and the first execution code. For example, the IoT server 130 may translate the device name "display No. 1" into the first device identification code "MN0X1", and translate the execution action "On" into the first execution code "0X101", and then send the message including The control command C1 of the first device identification code "MN0X1" and the first execution code "0X101". The IoT server 130 may send the control command C1 to the host device 140 connected to the display device 150.

However, in another embodiment, the IoT server 130 may further convert the first device identification code and the first execution code into other device identification codes and execution codes that are easily recognized by the host device 140. For example, the IoT server 130 may further convert the first device identification code “MN0X1” to “D-MNX1”, and convert the first execution code “0X101” to “A-0X101”, and then send the message including “ "D-MNX1" and "A-0X101" control command C1. The IoT server 130 may send the control command C1 to the host device 140 connected to the display device 150.

In an embodiment, when the host device 140 receives the control command C1, the host device 140 may translate the first device identification code and the first execution code into the second device identification code and the second execution code, respectively. For example, in an embodiment, the host device 140 may convert the converted first device identification code “D-MNX1” and the first execution code “A-0X101” into the second device identification code “PC-D -MNX1 "and the second execution code" PC-D-MNX1 ".

In an embodiment, when the second device identification code and the second execution code meet a preset condition, the host device 140 activates the application program 141 to read the display information of the display device 150 through the application program 141 and the command interface. For example, when the host device 140 determines that the second device identification code corresponds to the display device 150 and the second execution code matches a specific code, the host device 140 starts the application program 141, causing the display processor 151 to communicate with the wired video via a command interface. The transmission interface I1 provides display information of the display device 150 to the host device 140.

In an embodiment, when the host device 140 executes the application program 141, the host device 140 reads the display information of the display device 150 through the application program 141 through a command interface (for example, DDC / CI) to know the display device 150 Supported display functions or types and models of the display device 150. Then, after the host device 140 obtains the display information of the display device 150, the host device 140 can provide and prompt at least one voice control command corresponding to the display information. Therefore, the user can issue a voice command according to the voice control command prompted by the host device 140. It is worth mentioning that, based on the foregoing judgment about the preset conditions, the user can instruct the display device 150 to prompt the corresponding voice control instruction at an appropriate timing according to a specific voice instruction.

Accordingly, after the host device 140 prompts the voice control instruction, when the host device 140 receives the control instruction associated with the voice control instruction, the host device 140 may control the display device 150 to perform a corresponding operation function according to the control instruction. The above-mentioned operation functions are, for example, switching the display mode, turning on the display, turning off the display, adjusting the brightness of the display, etc., which is not limited in the present invention. In detail, the host device 140 may convert the control command C1 associated with the voice control command into a display control command in a monitor control command set (MCCS) to control the display device 150 to execute by the display control command. Operational functions. In this way, the user can know the voice control command corresponding to the specific display type, and then issue the voice command according to the following. Thus, the user does not need to manually set on the operation interface of the display device 150, and can also accurately control the display device 150 without a network communication module through the voice assistant platform and the Internet of Things platform.

For example, FIG. 3A to FIG. 3C are exemplary schematic diagrams of a voice control instruction provided by a display device according to an embodiment of the present invention. Referring to FIG. 3A, it is assumed that the display device 150 is a high-order color display. The host device 140 can read the display information through the command interface, so as to know that the display device 150 belongs to a high-order color display. Since the display modes supported by the high-end color display may include a standard color gamut mode (REC.709 mode) and a high dynamic range mode (HDR mode), etc., the host device 140 may control the display device 150 to display a display including a voice control instruction "REC. 709 mode "and" HDR mode "tool windows Wg1. Therefore, when the user speaks "switch to HDR mode" with reference to the tool window Wg1, the host device 140 may receive the corresponding control command C1 from the IoT server 130 and further convert the control command C1 into a display control command set ( MCCS) to control the display device 150 to switch the display mode to the HDR mode.

Similarly, referring to FIG. 3B, it is assumed that the display device 150 is a gaming display. The host device 140 can read the display information through the command interface, so as to know that the display device 150 belongs to a gaming display. Since the display modes supported by the gaming monitor may include a synchronization mode (Action mode) and a competition mode (Racing mode), etc., the host device 140 may control the display device 150 to display including voice control instructions "Action mode" and "Racing mode" Tool window Wg2. In this way, users can issue voice commands according to the content provided by the tool window Wg2.

Referring to FIG. 3C, it is assumed that the display device 150 is a general display. The host device 140 can read the display information through the command interface, so as to know that the display device 150 belongs to a general display. Since the display modes supported by the gaming monitor may include a reading mode (Reading mode) and an energy saving mode (Eco mode), the host device 140 may control the display device 150 to display a tool including a voice control instruction "Reading mode" and "Eco mode" Windows Wg3. With this, users can issue voice commands according to the content provided by the tool window Wg3.

However, although FIG. 3A to FIG. 3C take the screen prompting voice control command of the display device 150 as an example, the present invention is not limited thereto. In other embodiments, the host device 140 may control other electronic devices to display voice control instructions on the screen. For example, if the host device 140 establishes a communication link with the user's smartphone, the host device 140 can also control the screen display of the smartphone to control the voice control instructions of the display device 150, thereby prompting these voice control instructions. To the user.

In addition, after the display device 150 performs an operation function desired by the user, the host device 140 may return a report message to the IoT server 130, and the IoT server 130 may transmit the report message to the voice server 120. The voice server 120 can convert the content of the report message into voice content in the audio format, and the smart voice device 110 plays the voice content. For example, the smart voice device 110 can play the voice content of “the display mode is switched”. In this way, the user can be informed that the display device 150 has completed the operation function desired by the user.

FIG. 4 is a flowchart of a voice control method of a display device according to an embodiment of the invention. Referring to FIG. 4, in step S401, a voice server receives a voice command, analyzes the voice command, and transmits a keyword string command to be associated with a display device. In step S402, a keyword string command is received by the Internet of Things server, and a control command associated with the display device is generated according to the keyword string command to transmit the control command to the host device. In step S403, the host device reads the display information from the display device through the command interface to provide and prompt at least one voice control command corresponding to the display information. In step S404, when the host device receives a control instruction related to the voice control instruction, the host device controls the display device to perform an operation function according to the control instruction.

However, the steps in FIG. 4 have been described in detail above, and will not be repeated here. It should be noted that each step in FIG. 4 can be implemented as multiple codes or circuits, which is not limited in the present invention. In addition, the method in FIG. 4 can be used in combination with the above exemplary embodiments, or can be used alone, which is not limited in the present invention.

FIG. 5 is a flowchart of a voice control method of a display device according to an embodiment of the invention. Referring to FIG. 5, in step S501, a voice server receives a voice command, analyzes the voice command, and transmits a keyword string command to be associated with a display device. In step S502, the IoT server translates the device name and execution action in the keyword string instruction into the first device identification code and the first execution code in the control instruction, respectively. In step S503, the control command is transmitted from the IoT server to the host device. In step S504, the host device translates the first device identification code and the first execution code into the second device identification code and the second execution code, respectively. In step S505, when the second device identification code and the second execution code meet the preset conditions, the host device starts an application program to read the display information of the display device and provide a voice control instruction through the application program through the command interface. In step S506, the voice server receives the voice command, analyzes the voice command, and transmits a keyword string command to be associated with the display device. In step S507, the IoT server receives the keyword string command, and generates a control command associated with the display device according to the keyword string command to transmit the control command to the host device. In step S508, when the host device receives a control instruction related to the voice control instruction, the host device controls the display device to perform an operation function according to the control instruction.

Similarly, the steps in FIG. 5 have been described in detail above, and will not be repeated here. It should be noted that each step in FIG. 5 can be implemented as multiple codes or circuits, which is not limited in the present invention. In addition, the method in FIG. 5 may be used in combination with the above exemplary embodiments, or may be used alone, which is not limited in the present invention.

In summary, in the embodiment of the present invention, the display device is connected to the host device via the wired video transmission interface, and the host device can control the display device through a specific command interface and a display control command set. Based on this, when the user speaks a voice command, the host device can serve as a bridge between the display device and the IoT server, so that the user can use the intelligent voice assistant and the IoT technology to voice control without a network communication module. Set of display devices. In addition, the host device can further read the display information of the display device through a specific command interface, thereby knowing the functions supported by the display device, and providing the user with a voice control command corresponding to the prompt flexibly. In this way, users can complete a variety of single-screen application requirements in a convenient and fast voice control manner.

Although the present invention has been disclosed as above with the examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some modifications and retouching without departing from the spirit and scope of the present invention. The protection scope of the present invention shall be determined by the scope of the attached patent application.

10‧‧‧Voice Control System

141‧‧‧Apps

110‧‧‧Smart Voice Device

151‧‧‧Display Processor

120‧‧‧Voice Server

V1‧‧‧Voice commands

130‧‧‧IoT server

W1‧‧‧Keyword String Command

140‧‧‧Host device

C1‧‧‧Control instruction

150‧‧‧ display device

I1‧‧‧Wired video transmission interface

142‧‧‧Processor

143‧‧‧Memory components

Wg1, Wg2, Wg3‧‧‧tool window

S1‧‧‧Screen

S301 ~ S304, S501 ~ S508‧‧‧step

FIG. 1 is a schematic diagram of a voice control system of a display device according to an embodiment of the present invention. FIG. 2 is a schematic diagram of a display device and a host device according to an embodiment of the invention. FIG. 3A to FIG. 3C are exemplary schematic diagrams of a voice control instruction provided by a display device according to an embodiment of the present invention. FIG. 4 is a flowchart of a voice control method of a display device according to an embodiment of the invention. FIG. 5 is a flowchart of a voice control method of a display device according to an embodiment of the invention.

Claims (10)

A voice control system for a display device includes: a display device having display information based on a display type; a host device coupled to the display device; a voice server receiving a voice command, analyzing the voice command, and transmitting the voice command A keyword string command associated with the display device; and an IoT server coupled to the host device and the voice server, receiving the keyword string command, and generating a keyword string command associated with the display device according to the keyword string command A control instruction to transmit the control instruction to the host device, wherein the host device reads the display information from the display device via an instruction interface to provide and prompt at least one voice control instruction corresponding to the display information, wherein When the host device receives the control instruction associated with the at least one voice control instruction, the host device controls the display device to perform an operation function according to the control instruction. The voice control system of a display device according to item 1 of the scope of patent application, wherein the host device and the display device are connected via a wired video transmission interface, and the command interface is a display data channel command interface (Display Data Channel Command Interface) , DDC / CI). The voice control system of the display device according to item 1 of the scope of patent application, wherein the IoT server translates a device name and an execution action in the keyword string instruction into a first device in the control instruction, respectively. An identification code and a first execution code. According to the voice control system of the display device according to item 3 of the patent application scope, wherein the host device translates the first device identification code and the first execution code into a second device identification code and a second execution code, respectively, When the second device identification code and the second execution code meet a preset condition, the host device starts an application program to read the display information of the display device through the application program through the command interface. The voice control system for a display device according to item 1 of the scope of patent application, wherein the host device converts the control instruction associated with the at least one voice control instruction into a monitor control command set (MCCS) A display control instruction to control the display device to perform the operation function by the display control instruction, The voice control system of the display device according to item 1 of the scope of patent application, wherein the host device controls an electronic device to display the at least one voice control instruction on a screen. A voice control method for a display device includes: receiving a voice command by a voice server, analyzing the voice command, and transmitting a keyword string command to be associated with a display device; receiving the keyword by an Internet of Things server A string command, according to the keyword string command, generating a control command associated with the display device to transmit the control command to a host device; the host device reads display information from the display device through a command interface to provide At least one voice control instruction corresponding to the display information is prompted; and when the host device receives the control instruction associated with the at least one voice control instruction, the host device controls the display device to perform an operation function according to the control instruction. The voice control method for a display device according to item 7 of the scope of patent application, wherein the host device and the display device are connected via a wired video transmission interface, and the command interface is a display data channel command interface (Display Data Channel Command Interface) , DDC / CI), and the host device controls an electronic device to display the at least one voice control command on a screen. The voice control method for a display device according to item 7 of the scope of patent application, wherein the keyword string command is received by the IoT server, and the control command associated with the display device is generated according to the keyword string command, so that The step of transmitting the control instruction to the host device includes: translating, by the IoT server, a device name and an execution action in the keyword string instruction into a first device identification code and a first An execution code, wherein the step of reading display information from the display device by the host device through the instruction interface to provide and prompt at least one voice control command corresponding to the display information includes: the host device sends the first device The identification code and the first execution code are respectively translated into a second device identification code and a second execution code; and when the second device identification code and the second execution code meet a preset condition, the host device starts a An application to read the display information of the display device through the application through the command interface and provide the at least one voice control Instructions. The voice control method for a display device according to item 7 of the scope of patent application, wherein the step of controlling the display device to perform an operation function by the host device according to the control instruction includes: the host device will be associated with the at least one voice control The control command of the command is converted into a display control command in a monitor control command set (MCCS), so as to control the display device to perform the operation function through the display control command.