CN110121092B - Method for controlling remote controller microphone by smart television and smart television - Google Patents

Method for controlling remote controller microphone by smart television and smart television Download PDF

Info

Publication number
CN110121092B
CN110121092B CN201910375859.3A CN201910375859A CN110121092B CN 110121092 B CN110121092 B CN 110121092B CN 201910375859 A CN201910375859 A CN 201910375859A CN 110121092 B CN110121092 B CN 110121092B
Authority
CN
China
Prior art keywords
remote controller
state
data
microphone
intelligent television
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910375859.3A
Other languages
Chinese (zh)
Other versions
CN110121092A (en
Inventor
初德进
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN201910375859.3A priority Critical patent/CN110121092B/en
Publication of CN110121092A publication Critical patent/CN110121092A/en
Application granted granted Critical
Publication of CN110121092B publication Critical patent/CN110121092B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42222Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

The embodiment of the invention discloses a method for controlling a remote controller microphone by an intelligent television and the intelligent television. In the invention, first key data sent by a remote controller is received, wherein the first key data is used for requesting the intelligent television to enter an operation state for preparing to receive voice data; the kernel layer of the smart television responds to the first key data, controls the smart television to enter the running state, and inquires the current state of the microphone of the remote controller in a state recording table, wherein the kernel layer integrates control logic for controlling the switch of the microphone of the remote controller, and the state recording table is configured to record the current state of the microphone of the remote controller, which is turned on or turned off; and responding to the current state as a closing state, and issuing an instruction for indicating the remote controller to open a microphone to the remote controller. Therefore, the response speed of the microphone of the remote controller is improved, and the completeness and the accuracy of voice recognition are further improved.

Description

Method for controlling remote controller microphone by smart television and smart television
The application is a divisional application of Chinese patent application 201610378045.1 entitled "a method and a device for controlling a remote controller microphone by an intelligent television" which is proposed in 2016, 05, month and 31.
Technical Field
The invention relates to the field of communication, in particular to a method for controlling a remote controller microphone by an intelligent television and the intelligent television.
Background
With the development of voice recognition technology, a voice search function based on the voice recognition technology becomes more and more popular on smart televisions, and the basic principle is to record the voice of a user, upload the voice to a cloud server for analysis, and return the analysis result. Wherein the quality and integrity of the recorded data determines the success rate of speech recognition.
At present, in a voice search scheme based on a remote controller and an intelligent television, the remote controller is usually provided with a Microphone (MIC, Microphone) supporting a recording function, and the Microphone in the remote controller is not always in a recording mode, so that the intelligent television is required, that is, an instruction for triggering the MIC to be turned on or turned off is issued to the remote controller by an intelligent television terminal. Therefore, whether to turn on or off the MIC in time will determine the integrity of the recorded data.
In the prior art, a bluetooth adapter (or referred to as a bluetooth chip) is connected to an intelligent television through a USB (Universal Serial Bus) interface, and is responsible for data transmission based on a standard bluetooth protocol with a bluetooth peripheral. The data types related to the Bluetooth remote controller comprise uplink data such as key data, voice data and air mouse data, and downlink data for controlling the MIC to be turned on or turned off. For the standard bluetooth protocol stack, the bluetooth remote controller belongs to an HID (Human Interface Device) type Device, and conforms to bluetooth HID profile. When the Bluetooth remote controller is paired with the smart television, the HID report descriptor of the Bluetooth remote controller is uploaded to the smart television. In fact, the HID report descriptor may be regarded as a programming language or a key, which describes the format of the subsequent data, which is equivalent to informing the smart tv how to parse the received data.
In the prior art, there are two ways to control the MIC in the remote controller to be turned on or off:
in the first mode, after a user presses a voice key of the remote controller, the remote controller directly controls to open the MIC and record, and then sends recorded voice data to the smart television at one time. The method has the disadvantage that when the intelligent television software is not ready to receive the voice data, the voice data with large data volume can cause the intelligent television software to overflow data, and further cause the software to crash.
In the second way, for an Android device, control logic for controlling the MIC to be turned on or off is placed at an upper application layer of Linux. Fig. 1 shows a schematic flow diagram of a voice search scheme in the prior art, and as shown in fig. 1, the flow specifically includes:
s1: after the Bluetooth pairing of the remote controller and the intelligent television is completed, after a user presses a voice search key on the remote controller, the remote controller is triggered to carry a key value of the key in a Bluetooth empty packet (also called as an empty packet for short) and send the key value to a Bluetooth adapter (Bluetooth dongle) at the intelligent television end.
S2: and the Bluetooth dongle is transferred to a Bluetooth device driver positioned in a Kernel layer (Kernel layer). And then the Bluetooth device driver reports the data to a Bluetooth protocol stack positioned in a USER layer (USER layer).
S3: the type of the data is analyzed by a Bluetooth protocol stack, and when the data is data belonging to the HID type, the data is written into a UHID device driver of a kernel layer, wherein the UHID (USB Human Interface device) device driver is a Bluetooth HID device proprietary driver.
S4: the UHID device driver reports the key data to the user layer through a Linux input core (input subsystem core layer) in an input subsystem in the Kernel layer in the event type data.
S5: the Event hub program located in the USER layer is responsible for receiving the key data transmitted by the Linux input core and then sending out a broadcast for informing the voice search application located in the USER layer that the corresponding virtual sound card is controlled to be changed from the Setup state to the Running state after the key data is detected.
S6: and when the Voicecap program positioned in the USER layer detects that the state of the virtual sound card is changed into Running, issuing an instruction for opening the MIC of the remote controller. According to the protocol specification, the command passes through the UHID, the Bluetooth protocol stack, the Bluetooth device driver and the Bluetooth dongle in sequence and is finally transmitted to the Bluetooth remote controller.
S7: after the Bluetooth remote controller receives an instruction for indicating the remote controller to open the MIC, the MIC is controlled to start recording, and voice data are compressed and then output to the smart television through the Bluetooth interface.
S8: after receiving the voice data, a UHID device driver at the intelligent television end writes the voice data into a HIDRAW device driver, a Voicecap application program positioned at a USER layer polls whether the data in the HIDRAW device is readable, and when the voice data is readable, the voice data is read, decompressed and written into a virtual sound card. The hidaw Device may be an HID Device supporting a non-standard User interface Device.
S9: the voice search application program obtains voice data from the virtual Sound card through a standard ALSA (Advanced Linux Sound Architecture) interface, stores the voice data as a recording file, and uploads the recording file to the cloud server for voice recognition.
Therefore, in the prior art, the logic for controlling the MIC of the remote controller to be turned on or off is arranged in an upper USER layer (USER layer) of Linux, and by adopting the method, after a USER presses a voice key of the remote controller, the remote controller cannot turn on the recording function in time, and usually, after 1 second of delay, the remote controller can turn on the recording function, so that voice data of the first 1 second sent by the USER is not recorded, and the voice recognition rate is greatly reduced.
Disclosure of Invention
The invention provides a control method and a control device for a remote controller microphone, which are used for improving the response speed of the remote controller microphone while ensuring the stability of a system, and further improving the integrity and the accuracy of voice recognition.
The invention provides a method for controlling a remote controller microphone by an intelligent television, which comprises the following steps:
receiving first key data sent by a remote controller, wherein the first key data is used for requesting the intelligent television to enter an operation state of preparing to receive voice data;
the kernel layer of the smart television responds to the first key data, controls the smart television to enter the running state, and inquires the current state of the microphone of the remote controller in a state recording table, wherein the kernel layer integrates control logic for controlling the switch of the microphone of the remote controller, and the state recording table is configured to record the current state of the microphone of the remote controller, which is turned on or turned off;
and responding to the current state as a closing state, and issuing an instruction for indicating the remote controller to open a microphone to the remote controller.
Correspondingly, the invention further provides the intelligent television, and the intelligent television is used for executing the method.
According to the technical scheme, the control scheme of the microphone of the remote controller can be realized in the kernel layer of the intelligent television, and the response speed of the intelligent television to the remote controller is improved. Firstly, the first key data for requesting the smart television to enter the running state of being ready to receive the voice data is sent by the receiving remote controller, and the process does not need to be controlled by an upper application layer, but the command of the remote controller is quickly responded by a kernel layer of the smart television, so that the response speed of the smart television to the remote controller is improved on the premise of ensuring the stability of the system, and the integrity and the accuracy of voice recognition are further improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a flow chart illustrating a prior art speech search scheme;
fig. 2 is a schematic flow chart of a method for controlling a remote control microphone by a smart television according to the present invention;
fig. 3(a) is a schematic flow chart of opening a MIC on a remote controller according to an embodiment of the present invention;
fig. 3(b) is a schematic flow chart of closing the MIC on the remote controller according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for controlling a remote controller microphone by a smart television in an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention can be applied to various intelligent terminals (such as intelligent televisions, intelligent mobile phones, tablet computers and other devices), and is particularly suitable for intelligent televisions with Bluetooth voice search functions. According to the invention, the MIC (microphone) on the Bluetooth remote controller matched with the intelligent television can be quickly opened by the intelligent television, the integrity of the audio data recorded by the Bluetooth remote controller is ensured on the premise of ensuring the system stability of the intelligent television, and the recognition rate and success rate of the Bluetooth voice search function of the intelligent television are improved.
Fig. 2 is a schematic flowchart illustrating a method for controlling a remote control microphone by a smart tv in the present invention, where as shown in fig. 2, the flowchart may include:
step 21: and receiving human-computer interaction HID data sent by the remote controller.
Step 22: the kernel layer of the intelligent television identifies first HID key data in the HID data, wherein the first HID key data is used for requesting the intelligent television to enter an operation state of preparing to receive voice data.
Step 23: after the intelligent television is controlled to enter the running state according to the indication of the first HID key data, an instruction for indicating the remote controller to start the microphone is sent to the remote controller.
Optionally, in step 22, the kernel layer of the smart television determines the type of the device that sends the HID data according to the identification information, which is carried in the HID data and used for indicating the device that sends the HID data; if the device sending the HID data is a remote controller, determining the type of the remote controller data carried in the HID data according to the identifier which is used for representing the type of the carried remote controller data in the HID data; if the type of the remote controller data carried in the HID data is a key type, obtaining a remote controller key value carried in the HID data, and searching a function corresponding to the remote controller key value in a pre-stored key value corresponding table; if the function corresponding to the key value of the remote controller key is used for requesting the intelligent television to enter the running state of preparing to receive voice data, determining the HID data as first HID key data, and intercepting the first HID key data; otherwise, the HID data is ignored.
Optionally, after step 22 and before step 23, querying a current state of the remote controller microphone in a preset state recording table for recording the current state of the remote controller microphone; if the current state of the microphone of the remote controller is in a closed state, sending an instruction for indicating the remote controller to open the microphone to the remote controller, and changing the current state of the microphone of the remote controller into an open state in a state record table; otherwise, ignoring the intercepted first HID key data, and controlling the intelligent television to enter a forbidden state of forbidding receiving the voice data.
Optionally, in the above step, if it is monitored that the smart television is switched from the running state in which the smart television is ready to receive the voice data to the prohibited state in which the smart television is prohibited from receiving the voice data, an instruction for instructing the remote controller to turn off the microphone is issued to the remote controller.
Optionally, in the above step, after monitoring that the operating state of the smart television is switched from the operating state of the smart television ready for receiving the voice data to the prohibited state of the smart television prohibited from receiving the voice data, before issuing an instruction for instructing the remote controller to close the microphone to the remote controller, querying the current state of the microphone of the remote controller in a preset state recording table for recording the current state of the microphone of the remote controller; and when the current state of the microphone of the remote controller is in an opening state, sending an instruction for indicating the remote controller to close the microphone to the remote controller, and changing the current state of the microphone of the remote controller into a closing state in a state record table.
Overall, the invention has the following advantages:
first, the invention can ensure the stability of the smart television in receiving and processing the voice data. In the invention, the remote controller informs the intelligent television to enter the running state of preparing to receive the voice data, and then the remote controller starts the MIC for recording after the intelligent television enters the running state of preparing to receive the voice data, thereby avoiding the system downtime phenomenon caused by that the intelligent television is not prepared to receive a larger voice data packet.
Secondly, the invention can improve the response speed of the smart television to the special keys of the remote controller. In the invention, for the intelligent television based on the Linux kernel, the logic for controlling the remote controller to open or close the MIC can be transplanted to the Linux kernel layer, and particularly to UHID (human-computer interaction) equipment drive, so as to improve the response speed of the intelligent television to the key which is sent by the remote controller and is used for controlling the remote controller to open or close the MIC.
Thirdly, the MIC on the remote controller can be quickly started, and the integrity of the recorded data is ensured. In the invention, the intelligent television can quickly respond to the key which is sent by the remote controller and used for controlling the MIC on or off of the remote controller, so that the intelligent television can be indicated to quickly enter the running state for receiving the voice data, once the remote controller obtains the instruction which is sent by the intelligent television after entering the running state and indicates the remote controller to start the MIC, the MIC on the remote controller can be quickly started, particularly for the application scene that a user snatches, the problem of incomplete recorded data can be solved, and the starting speed of the MIC on the remote controller can be greatly improved.
The following describes the present invention in detail only by taking the smart tv based on Linux kernel as a host and taking a bluetooth remote controller matched with the smart tv as an example. It should be noted that, in the embodiment of the present invention, although only a bluetooth remote controller is taken as an example to describe an interaction flow between the remote controller and the smart television by way of example, in practical application, the method provided by the present invention may also be applied to remote controllers of various other communication technologies, such as an infrared remote controller, a WIFI remote controller, and the like, which is not described in detail herein by way of example.
Fig. 3(a) shows a schematic flowchart of a process of opening a MIC on a remote controller in an embodiment of the present invention, and as shown in fig. 3(a), the process may include:
step 301: the Bluetooth remote controller is successfully paired with the smart television.
Step 302: a UHID (USB HID, USB Human-machine interaction) Device driver receives HID (Human Interface Device) data transferred via a bluetooth protocol stack.
Step 303: the UHID device driver judges whether the received HID data is HID data sent by a Bluetooth remote controller, if so, the step 304 is continuously executed; otherwise, the flow is directly ended.
In specific implementation, the embodiment of the present invention may confirm whether the HID data packet is transmitted by the bluetooth remote controller through bluetooth device information included in the HID data packet, for example, identification such as PID (product identification code) and VID (vendor ID).
Step 304: the UHID device driver judges whether the HID data sent by the Bluetooth remote controller contains key values of the Bluetooth remote controller keys for starting the voice search function, if so, the step 305 is continuously executed; otherwise, the flow is directly ended.
In specific implementation, each HID data packet is actually equivalent to a Report (Report), and generally, each Report is uniquely identified by using a Report ID, so that the smart television can perform corresponding processing on data according to different Report IDs. For different types of data, for example: the key data, voice data or air mouse data are all identified by corresponding Report ID, each frame data is a Report, and the first byte of each frame data is the Report ID. The embodiment of the invention can judge whether the HID data is the data of the key type through the Report ID of the HID data packet, if the HID data is determined to be the data of the key type, further judge whether the key value of the Bluetooth remote controller key carried in the HID data is the Bluetooth remote controller key used for indicating the intelligent television to start the voice search function, if the HID data carries the Bluetooth remote controller key used for indicating the intelligent television to start the voice search function, continue to execute the step 305; otherwise, the flow is directly ended.
Step 305: the UHID device driver changes the virtual sound card state to a Running state (Running).
During specific implementation, if the HID data carries a bluetooth remote controller key for indicating the smart television to start a voice search function, the state of the virtual sound card is changed to Running, so that the smart television is ready to receive voice data.
Step 306: the UHID equipment driver inquires whether the current state of a Bluetooth remote controller MIC is a closing state in a state record table maintained in advance, if so, the step 307 is continuously executed; otherwise, step 308 is performed directly.
In specific implementation, the embodiment of the present invention may pre-maintain a state recording table for recording the MIC state of the bluetooth remote controller, and only when the current state of the MIC is the off state, continue to issue an instruction for instructing the bluetooth remote controller to start the MIC, that is, continue to execute step 307; otherwise, the operation of the voice search key pressed by the user this time is ignored, that is, step 308 is directly executed.
Step 307: and the UHID equipment driver issues an instruction for indicating the Bluetooth remote controller to start the MIC, and updates the state record table.
During specific implementation, the UHID device driver issues an instruction for indicating the Bluetooth remote controller to start the MIC, and meanwhile, the latest MIC state recorded in the state recording table is further modified into the starting state.
After the execution of step 307 is completed, the flow is terminated.
Step 308: neglecting the operation of the voice search key pressed by the user at this time, changing the state of the virtual sound card into a forbidden state (Setup) for forbidding receiving voice data, and updating the state record table.
During specific implementation, if the current state of the MIC of the bluetooth remote controller is already an on state, the MIC of the bluetooth remote controller does not need to be controlled to be on again, so that the operation of the voice search key pressed by the user at this time can be ignored, and the latest state of the MIC recorded in the state record table is further modified into an off state.
After the execution of step 308 is completed, the flow is terminated.
In this way, by executing the steps 301 to 308, the logic control of directly starting the MIC of the bluetooth remote controller by the UHID device driver located in the kernel layer of Linux is realized. Therefore, the embodiment of the invention can integrate the logic control of MIC of the Bluetooth remote controller into the kernel layer of Linux, thereby improving the speed of starting the MIC of the Bluetooth remote controller, avoiding the problem of incomplete recording data caused by the fact that the MIC recording is not started by the Bluetooth remote controller after a user presses a voice search key, further improving the recognition rate, success rate and accuracy rate of voice search, and further improving the user experience.
The following description will proceed to the present invention by taking the Linux kernel-based smart tv as the host and the bluetooth remote controller matched with the smart tv as an example. It should be noted that, in the embodiment of the present invention, although only a bluetooth remote controller is taken as an example to describe an interaction flow between the remote controller and the smart television by way of example, in practical application, the method provided by the present invention may also be applied to remote controllers of various other communication technologies, such as an infrared remote controller, a WIFI remote controller, and the like, which is not described in detail herein by way of example.
Fig. 3(b) shows a schematic flowchart of a process of turning off a MIC on a remote controller in an embodiment of the present invention, and as shown in fig. 3(b), the process may include:
step 311: the Bluetooth remote controller is successfully paired with the smart television.
Step 312: and the UHID device driver monitors the state of the virtual sound card in real time.
Step 313: the UHID device driver determines whether the state of the virtual sound card is a disabled state (Setup) for disabling reception of the voice data, and if so, proceeds to step 314; otherwise, the process jumps back to step 312.
During specific implementation, when the smart television executes an effective voice search process, that is, the smart television receives voice data recorded by a MIC of a user through a bluetooth remote controller, and uploads the received voice data to a cloud analysis server for voice recognition processing, the smart television continues to execute corresponding operations according to a recognized result, and meanwhile, after the voice recognition process is finished, a voice search application program located on an upper user layer informs the virtual sound card that a Running state is changed into a Setup state. Therefore, in the embodiment of the present invention, the UHID device driver may also monitor the state change condition of the virtual sound card in real time, and once it is monitored that the state of the virtual sound card jumps from Running state to Setup state, the step 314 is continuously executed; otherwise, the flow is directly ended.
Step 314: the UHID equipment driver inquires whether the current state of a Bluetooth remote controller MIC is an open state in a state record table maintained in advance, if so, the step 315 is continuously executed; otherwise, the flow is directly ended.
In a specific implementation, the embodiment of the present invention may pre-maintain a state record table for recording the MIC state of the bluetooth remote controller, and only when the current state of the MIC is the on state, the embodiment of the present invention continues to issue an instruction for instructing the bluetooth remote controller to turn off the MIC, that is, continues to execute step 315.
Step 315: and the UHID equipment driver issues an instruction for indicating the Bluetooth remote controller to close the MIC, and updates the state record table.
During specific implementation, the UHID device driver issues an instruction for indicating the Bluetooth remote controller to close the MIC, and meanwhile, the latest MIC state recorded in the state recording table is further modified into a closed state.
After the execution of step 315 is completed, the flow is terminated.
In this way, through executing the steps 311 to 315, the logic control of directly starting the MIC of the bluetooth remote controller by the UHID device driver located in the kernel layer of Linux is realized. Therefore, the embodiment of the invention can integrate the logic control of MIC of the Bluetooth remote controller into the kernel layer of Linux, thereby improving the speed of the Bluetooth remote controller for controlling MIC and further improving the user experience.
According to the technical scheme, the control scheme of the microphone of the remote controller can be realized in the kernel layer of the intelligent television, and the response speed of the intelligent television to the remote controller is improved. Firstly, after receiving human-computer interaction HID data sent by a remote controller, the invention identifies key data in the HID data for requesting the intelligent television to enter the running state of preparing to receive voice data by a kernel layer of the intelligent television.
Based on the same technical concept, an embodiment of the present invention further provides a control apparatus for a remote controller microphone, fig. 4 shows a schematic structural diagram of the control apparatus for a remote controller microphone in the embodiment of the present invention, and as shown in fig. 4, the apparatus may include:
the receiving unit 41 is used for receiving human-computer interaction HID data sent by a remote controller;
the identification unit 42 is located in a kernel layer of the smart television and is used for identifying first HID key data in the HID data, wherein the first HID key data is used for requesting the smart television to enter an operating state in which voice data are to be received;
and the control unit 43 is configured to issue, to the remote controller, an instruction for instructing the remote controller to turn on a microphone after controlling the smart television to enter the operating state according to the instruction of the first HID key data.
Optionally, the identification unit 42 is specifically configured to:
determining the type of the device sending the HID data according to identification information which is carried in the HID data and used for representing the device sending the HID data; when the device sending the HID data is a remote controller, determining the type of the remote controller data carried in the HID data according to the identifier which is used for representing the type of the carried remote controller data in the HID data; when the type of the remote controller data carried in the HID data is a key type, obtaining a remote controller key value carried in the HID data, and searching a function corresponding to the remote controller key value in a pre-stored key value corresponding table; when the function corresponding to the key value of the remote controller key is used for requesting the intelligent television to enter an operation state for preparing to receive voice data, determining the HID data as the first HID key data, and intercepting the first HID key data; otherwise, the HID data is ignored.
Optionally, the apparatus further comprises:
the query unit is used for querying the current state of the microphone of the remote controller in a preset state recording table for recording the current state of the microphone of the remote controller after identifying first HID key data in the HID data and before issuing an instruction for indicating the remote controller to start the microphone to the remote controller;
the control unit is specifically configured to: when the current state of the microphone of the remote controller inquired by the inquiry unit is a closed state, sending an instruction for indicating the remote controller to open the microphone to the remote controller, and changing the current state of the microphone of the remote controller into an open state in the state record table; otherwise, ignoring the intercepted first HID key data, and controlling the intelligent television to enter a forbidden state of forbidding to receive the voice data.
Optionally, the control unit 43 is further configured to:
when the situation that the intelligent television is switched from the running state of being ready to receive the voice data to the forbidden state of being forbidden to receive the voice data is monitored, an instruction for instructing the remote controller to close the microphone is issued to the remote controller.
Optionally, the apparatus further comprises:
the query unit is used for querying the current state of the microphone of the remote controller in a preset state recording table for recording the current state of the microphone of the remote controller before issuing an instruction for indicating the remote controller to close the microphone to the remote controller after monitoring that the intelligent television is switched from the running state of the voice data to be received to the forbidden state of the voice data to be received;
the control unit is specifically configured to: and when the current state of the microphone of the remote controller is the opening state, the inquiry unit issues an instruction for indicating the remote controller to close the microphone to the remote controller, and the current state of the microphone of the remote controller is changed into the closing state in the state record table.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, implement the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (8)

1. A method for controlling a remote controller microphone by an intelligent television is characterized by comprising the following steps:
receiving first key data sent by a remote controller, wherein the first key data is used for requesting the intelligent television to enter an operation state of preparing to receive voice data;
the kernel layer of the smart television responds to the first key data, controls the smart television to enter the running state, and inquires the current state of the microphone of the remote controller in a state recording table, wherein the kernel layer integrates control logic for controlling the switch of the microphone of the remote controller, and the state recording table is configured to record the current state of the microphone of the remote controller, which is turned on or turned off;
and responding to the current state as a closing state, and issuing an instruction for indicating the remote controller to open a microphone to the remote controller.
2. The method of claim 1, further comprising, after responding to the current state being an off state:
and changing the current state of the microphone of the remote controller into an opening state in the state record table.
3. The method of claim 1, wherein after said querying a current state of the remote control microphone, the method further comprises:
and responding to the condition that the current state in the state record table is the opening state, and ignoring the first key data received this time.
4. The method according to any one of claims 1-3, wherein the receiving the first key data transmitted by the remote controller comprises:
receiving user interaction data sent by the remote controller, wherein the user interaction data comprises Bluetooth equipment information and the first key data;
and identifying the first key data in the user interaction data after responding to the Bluetooth equipment information representation that the user interaction data is sent by the remote controller.
5. The method of claim 4, wherein:
the Bluetooth device information comprises a product identification code and a supplier identity identification number.
6. The method of claim 4, wherein:
the user interaction data further comprises a report identity identification code, the report identity identification code is used for identifying data of different types, and the kernel layer of the smart television identifies the first key data according to the report identity identification code.
7. The method according to any one of claims 1 to 3,
before the receiving the first key data, further comprising: the remote controller is successfully paired with the intelligent television.
8. An intelligent television, characterized in that the intelligent television is configured to perform the method of claims 1-7.
CN201910375859.3A 2016-05-31 2016-05-31 Method for controlling remote controller microphone by smart television and smart television Active CN110121092B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910375859.3A CN110121092B (en) 2016-05-31 2016-05-31 Method for controlling remote controller microphone by smart television and smart television

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910375859.3A CN110121092B (en) 2016-05-31 2016-05-31 Method for controlling remote controller microphone by smart television and smart television
CN201610378045.1A CN105979324B (en) 2016-05-31 2016-05-31 A kind of method and device of smart television control remote controler microphone

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201610378045.1A Division CN105979324B (en) 2016-05-31 2016-05-31 A kind of method and device of smart television control remote controler microphone

Publications (2)

Publication Number Publication Date
CN110121092A CN110121092A (en) 2019-08-13
CN110121092B true CN110121092B (en) 2021-04-16

Family

ID=57009970

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610378045.1A Active CN105979324B (en) 2016-05-31 2016-05-31 A kind of method and device of smart television control remote controler microphone
CN201910375859.3A Active CN110121092B (en) 2016-05-31 2016-05-31 Method for controlling remote controller microphone by smart television and smart television

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201610378045.1A Active CN105979324B (en) 2016-05-31 2016-05-31 A kind of method and device of smart television control remote controler microphone

Country Status (1)

Country Link
CN (2) CN105979324B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979324B (en) * 2016-05-31 2019-06-07 青岛海信电器股份有限公司 A kind of method and device of smart television control remote controler microphone
CN106782552B (en) * 2016-12-06 2020-05-22 深圳Tcl数字技术有限公司 Tail sound identification method and voice remote controller
CN106775724A (en) * 2016-12-19 2017-05-31 四川长虹电器股份有限公司 Bluetooth body-sensing data processing method based on hidraw
CN108664345A (en) * 2018-05-15 2018-10-16 青岛海信电器股份有限公司 Blue-teeth data processing method, device, equipment and storage medium
CN109587539B (en) * 2018-12-29 2021-04-20 江苏爱仕达电子有限公司 High-safety control method for motion sensing remote controller of smart television
CN110012328B (en) * 2019-03-13 2021-05-07 青岛海信传媒网络技术有限公司 Method and device for interacting with smart television
CN110035308A (en) * 2019-04-10 2019-07-19 青岛海信电器股份有限公司 Data processing method, equipment and storage medium
CN110111790B (en) * 2019-05-09 2022-01-28 海信视像科技股份有限公司 Method, device and equipment for processing external equipment access of intelligent equipment
JP7206167B2 (en) * 2019-08-13 2023-01-17 Tvs Regza株式会社 receiver
CN110536276B (en) * 2019-09-09 2022-05-13 思必驰科技股份有限公司 Voice data transmission method, system and remote controller based on USBHID protocol
CN114424578A (en) * 2019-09-12 2022-04-29 海信视像科技股份有限公司 Video searching method, control equipment and television
CN112492393A (en) * 2020-11-25 2021-03-12 海信视像科技股份有限公司 Method for realizing MIC switch associated energy-saving mode and display equipment
CN112468595B (en) * 2020-11-30 2023-04-07 深圳创维-Rgb电子有限公司 Equipment control method, device and system based on gateway
CN113241069B (en) * 2021-04-15 2023-12-12 王维坤 Method for improving voice interaction success rate
CN113810802B (en) * 2021-08-27 2023-09-29 青岛歌尔智能传感器有限公司 Intelligent microphone and electronic device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1667389A (en) * 2004-03-12 2005-09-14 杨攸中 Spontaneous universal speech remote control system and method
CN103648009A (en) * 2013-12-17 2014-03-19 乐视致新电子科技(天津)有限公司 Android system based infrared remote control responding method and device and smart television
CN104092825A (en) * 2014-07-07 2014-10-08 深圳市微思客技术有限公司 Bluetooth voice control method and device and intelligent terminal
CN104506910A (en) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 Remote control method and dual-mode Bluetooth remote controller
CN105979324A (en) * 2016-05-31 2016-09-28 青岛海信电器股份有限公司 Method and device of intelligent TV for controlling remote controller microphone

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6747566B2 (en) * 2001-03-12 2004-06-08 Shaw-Yuan Hou Voice-activated remote control unit for multiple electrical apparatuses
JP5817368B2 (en) * 2011-09-13 2015-11-18 ソニー株式会社 Information processing apparatus and information processing method
CN202551276U (en) * 2012-03-14 2012-11-21 赖建新 Microphone
CN103002147A (en) * 2012-11-29 2013-03-27 广东欧珀移动通信有限公司 Auto-answer method and device for mobile terminal (MT)
CN104110779A (en) * 2013-10-22 2014-10-22 广东美的制冷设备有限公司 Voice air conditioner, control method thereof and air conditioner control system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1667389A (en) * 2004-03-12 2005-09-14 杨攸中 Spontaneous universal speech remote control system and method
CN103648009A (en) * 2013-12-17 2014-03-19 乐视致新电子科技(天津)有限公司 Android system based infrared remote control responding method and device and smart television
CN104092825A (en) * 2014-07-07 2014-10-08 深圳市微思客技术有限公司 Bluetooth voice control method and device and intelligent terminal
CN104506910A (en) * 2014-12-31 2015-04-08 青岛歌尔声学科技有限公司 Remote control method and dual-mode Bluetooth remote controller
CN105979324A (en) * 2016-05-31 2016-09-28 青岛海信电器股份有限公司 Method and device of intelligent TV for controlling remote controller microphone

Also Published As

Publication number Publication date
CN105979324B (en) 2019-06-07
CN110121092A (en) 2019-08-13
CN105979324A (en) 2016-09-28

Similar Documents

Publication Publication Date Title
CN110121092B (en) Method for controlling remote controller microphone by smart television and smart television
CN104780154B (en) Apparatus bound method and apparatus
CN104917632B (en) The detection method and device for channel status of networking, electronic equipment
TWI512489B (en) Multi-screen interactive method, center equipment, terminal equipment and systems
CN105825851B (en) Voice control method and system based on Android system
WO2014183365A1 (en) Method, apparatus and system for intelligently controlling device, and plug-and-play device
CN107264447B (en) Method, system and device for controlling speech recognition in vehicle
CN111131966B (en) Mode control method, earphone system, and computer-readable storage medium
CN104540091A (en) Automatic pairing system and automatic pairing method based on bluetooth equipment
CN110876077B (en) Control method of smart television, mobile terminal and computer readable storage medium
CN106713418A (en) Reset result confirmation method and apparatus, server and mobile terminal
CN102929385A (en) Method for controlling application program by voice
US20170019482A1 (en) Method and apparatus for downloading control program
CN106101836A (en) The player method of intelligent television and device
CN105005489B (en) A kind of the starting method and terminal device of terminal device
WO2017219872A1 (en) Set top box upgrading and channel changing methods and systems
CN103170136A (en) Method and system of achieving game control through set top box
EP3373140B1 (en) Method for processing ordered broadcast and electronic device
CN103327387A (en) Television remote control method and system
WO2015131813A1 (en) Method and system for operating device
WO2016155554A1 (en) Interface display method and terminal
CN104298528A (en) Application program installation control method and device
CN106507160B (en) Multimedia application playing control method and system based on remote Bluetooth equipment
CN114095295B (en) Intelligent doorbell information inheritance method, intelligent doorbell and computer readable storage medium
CN103686013A (en) Television peripheral recognizing method, television and television system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant after: Hisense Video Technology Co.,Ltd.

Address before: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant before: HISENSE ELECTRIC Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant