CN115101071A - Low-power-consumption Bluetooth voice control terminal, method, device and equipment - Google Patents
Low-power-consumption Bluetooth voice control terminal, method, device and equipment Download PDFInfo
- Publication number
- CN115101071A CN115101071A CN202210992811.9A CN202210992811A CN115101071A CN 115101071 A CN115101071 A CN 115101071A CN 202210992811 A CN202210992811 A CN 202210992811A CN 115101071 A CN115101071 A CN 115101071A
- Authority
- CN
- China
- Prior art keywords
- bluetooth
- voice control
- peripheral interface
- communication module
- control command
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000002093 peripheral effect Effects 0.000 claims abstract description 92
- 238000004891 communication Methods 0.000 claims abstract description 71
- 238000004590 computer program Methods 0.000 claims abstract description 27
- 230000006870 function Effects 0.000 claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000013507 mapping Methods 0.000 claims description 19
- 230000009471 action Effects 0.000 claims description 18
- 230000005540 biological transmission Effects 0.000 description 10
- 238000011161 development Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 239000003999 initiator Substances 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L2012/284—Home automation networks characterised by the type of medium used
- H04L2012/2841—Wireless
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Selective Calling Equipment (AREA)
Abstract
The disclosure relates to a low-power Bluetooth voice control terminal, a method, a device and equipment. Wherein the terminal includes: a Bluetooth communication module; the universal peripheral interface is used for connecting a plurality of different intelligent household devices; a non-volatile memory for storing a computer program; a processor for invoking execution of a computer program to implement: receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode; decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command; and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of voice control, in particular to a low-power Bluetooth voice control terminal, method, device and equipment.
Background
At present, with the continuous development of the internet of things industry, intelligent terminal equipment based on voice control is more and more widely applied. For example, in the field of smart homes, intelligent lamp switching, air conditioner temperature adjustment and the like can be realized based on a voice control technology, namely, actions such as switching on and off of equipment are controlled through voice.
In the correlation technique, the appointed APP based on the smart mobile phone installation usually establishes Bluetooth communication connection with a plurality of intelligent terminal devices with Bluetooth functions of the family environment such as a television, an intelligent lamp, an intelligent thermometer and the like based on the appointed APP, the user operates the appointed APP again to collect voice sent by the user, the voice is recognized to obtain a voice instruction, and the voice instruction is transmitted to the corresponding intelligent terminal through Bluetooth, so that the action of the voice control intelligent terminal is realized.
The inventor finds that some problems still exist in the application of the related technology, for example, under the long-distance conditions of a plurality of rooms, and the like, related to a home environment, the current bluetooth transmission distance is limited, so that a remote intelligent terminal cannot be effectively controlled by voice, and a smart phone with a specified APP is used as bluetooth initiator equipment, voice recognition is required to obtain a voice command, and then the voice command is transmitted to the intelligent terminal through bluetooth to indirectly control the intelligent terminal, which requires that the specified APP of the initiator equipment at least has a voice recognition module, so that the functional complexity and the development cost of the specified APP are increased, and the universality is not strong; in addition, the smart phone with the appointed APP needs to establish Bluetooth communication connection with each smart terminal first and then transmit a voice command, although Bluetooth communication connection can be established with a plurality of smart terminals, at present, one smart terminal is generally connected at a single time for voice control, then another smart terminal is connected for control after disconnection, operation is very complicated during actual use, and the number of the smart terminals capable of being controlled simultaneously is limited. Finally, the current appointed APP recognizes that the voice command is obtained and then transmits the voice command to the intelligent terminal in a Bluetooth mode to indirectly control the intelligent terminal, so that the accuracy of the voice control intelligent terminal is reduced.
Disclosure of Invention
In order to solve the technical problems or at least partially solve the technical problems, embodiments of the present disclosure provide a bluetooth low energy voice control terminal, method, apparatus, and device.
In a first aspect, an embodiment of the present disclosure provides a bluetooth low energy voice control terminal, including:
a Bluetooth communication module;
the universal peripheral interface is used for connecting a plurality of different intelligent household devices;
a non-volatile memory for storing a computer program;
a processor for invoking execution of the computer program to implement the following speech control method steps:
a) receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode;
b) decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
c) and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
In one embodiment, the processor is specifically configured to perform speech recognition on the audio decoding data to obtain corresponding speech feature information, match the speech feature information with a speech recognition library stored in the non-volatile memory to obtain a speech text, and determine a corresponding speech control command based on the speech text; wherein the speech recognition library comprises different speech characteristic information and corresponding speech texts.
In one embodiment, a plurality of the smart home devices are respectively located in a living room and a plurality of rooms, the plurality of rooms at least comprise a first room and a second room, and the first room is located above the second room.
In one embodiment, the universal peripheral interface is configured to connect to a plurality of different peripheral interface circuits, each peripheral interface circuit is connected to a corresponding one of the smart home devices, each peripheral interface circuit has a respective interface identifier, the processor is specifically configured to determine a name of a target smart home device and target smart home device action information based on the voice text, generate a voice control instruction based on the target smart home device action information, determine a target interface identifier corresponding to the target smart home device based on the name of the target smart home device and a preset mapping table, and send the voice control instruction to the peripheral interface circuit indicated by the target interface identifier, so that the target smart home device corresponding to the voice control instruction acts; the preset mapping table comprises mapping relations between different intelligent household equipment names and corresponding interface identifications of the peripheral interface circuits.
In one embodiment, the plurality of peripheral interface circuits includes general purpose input/output (GPIO), I2C bus, Serial Peripheral Interface (SPI), Pulse Width Modulation (PWM) interface, and integrated circuit built-in audio bus I2S.
In one embodiment, the bluetooth communication module comprises a bluetooth version 5.2 or higher communication module; the Bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor are integrated on a system-on-chip (SoC).
In one embodiment, the bluetooth communication module further comprises a power management module for managing power supply of the bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor to reduce power consumption.
In a second aspect, an embodiment of the present disclosure provides a bluetooth low energy voice control method, where the method is applied to a bluetooth terminal, the bluetooth terminal includes a bluetooth communication module, a universal peripheral interface for connecting to multiple different smart home devices, a nonvolatile memory for storing a computer program, and a processor, and the method is implemented by the processor invoking and executing the computer program, and includes the following steps:
receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode after being encoded by a voice signal collected by an electronic device with an external Bluetooth function;
decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
In a third aspect, an embodiment of the present disclosure provides a bluetooth low energy voice control apparatus, where the apparatus is applied to a bluetooth terminal, the bluetooth terminal includes a bluetooth communication module, a general peripheral interface for connecting to multiple different smart home devices, a nonvolatile memory for storing a computer program, and a processor, and the apparatus is implemented by the processor invoking and executing the computer program, and includes:
the data receiving module is used for receiving audio stream data sent by the Bluetooth communication module, and the audio stream data is collected by an electronic device with an external Bluetooth function and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode;
the audio processing module is used for decoding the audio stream data to obtain audio decoding data and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and the voice control module is used for driving the universal peripheral interface based on the voice control command so as to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
In a fourth aspect, an embodiment of the present disclosure provides an electronic device, including:
a Bluetooth communication module;
the universal peripheral interface is used for connecting a plurality of different intelligent household devices;
a non-volatile memory for storing a computer program;
a processor for invoking execution of the computer program to implement the following speech control method steps:
receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode;
decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:
the low-power-consumption Bluetooth voice control terminal, the method, the device and the equipment provided by the embodiment of the disclosure are characterized in that a universal peripheral interface is used for connecting a plurality of different intelligent household equipment, a processor is used for receiving audio stream data sent by a Bluetooth communication module, and the audio stream data is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode after being collected by electronic equipment with a Bluetooth function from the outside; decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command; and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment. The embodiment is provided with the Bluetooth voice control terminal, wherein a universal peripheral interface is arranged to be directly connected with a plurality of different intelligent household devices, an electronic device with a Bluetooth function such as an intelligent mobile phone transmits audio stream data for voice control to the Bluetooth voice control terminal in a Bluetooth connectionless broadcast mode, the Bluetooth voice control terminal locally performs voice recognition to obtain a voice control instruction and directly drives a corresponding target intelligent household device to act through the universal peripheral interface, so that the problem of limited Bluetooth transmission distance can be overcome, the external electronic device is matched with the Bluetooth voice control terminal to effectively realize voice control of a remote intelligent terminal of a plurality of rooms, and the external electronic device is used as a Bluetooth initiator device, does not need to perform voice recognition to obtain a voice command per se and does not need to be provided with a voice recognition module, thereby simplifying functions and development cost of related APP, the universality is strong; in addition, the external electronic equipment does not need to establish Bluetooth communication connection with each intelligent terminal, only transmits collected audio data to the Bluetooth voice control terminal in a Bluetooth connectionless broadcasting mode, directly controls a target intelligent terminal after voice recognition of the Bluetooth voice control terminal, does not need to interrupt one intelligent terminal and then perform voice control by connecting the Bluetooth with another intelligent terminal in the existing mode, simplifies user operation, and can increase the number of a plurality of intelligent terminals which are simultaneously controlled. Finally, the voice control command obtained through recognition in the embodiment is directly transmitted to the intelligent terminal through the interface to directly control the intelligent terminal, so that the unreliability in the transmission process caused by the wireless mode of Bluetooth transmission of the voice control command is avoided, and the accuracy of the voice control intelligent terminal is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present disclosure, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic diagram of a bluetooth low energy voice control terminal according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram illustrating a connection between a universal peripheral interface and smart home devices in an embodiment of the present disclosure;
FIG. 3 is a flowchart of a Bluetooth low energy voice control method according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a bluetooth low energy voice control apparatus according to an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, aspects of the present disclosure will be further described below. It should be noted that the embodiments and features of the embodiments of the present disclosure may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced in other ways than those described herein; it is to be understood that the embodiments disclosed in the specification are only a few embodiments of the present disclosure, and not all embodiments.
It is to be understood that, hereinafter, "at least one" means one or more, "a plurality" means two or more. "and/or" is used to describe the association relationship of the associated objects, meaning that there may be three relationships, for example, "a and/or B" may mean: only A, only B and both A and B are present, wherein A and B may be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of single item(s) or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, c may be single or plural.
Fig. 1 is a schematic diagram of a bluetooth low energy voice control terminal according to an embodiment of the present disclosure, which includes the following component units: a Bluetooth communication module; the universal peripheral interface is used for connecting a plurality of different intelligent household devices such as an intelligent thermometer, a Bluetooth voice lamp, a Bluetooth voice air conditioner and the like; a non-volatile memory for storing a computer program; a processor for invoking execution of the computer program to implement the following speech control method steps: a) receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode; b) decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command; c) and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
In one example, the external electronic device with bluetooth function may be a smart phone, which may be installed with a designated APP, where the APP may collect a user voice signal, and transmit audio stream data to a bluetooth communication module in the bluetooth voice control terminal in a bluetooth connectionless broadcast manner after encoding. The coding can adopt a codec LC3 module, the sampling rate of which supports 8/16/24/32/44.1/48kHz, and the bit rate of which supports 16-320 kbps. In the bluetooth low energy BLE technology, there are 4 broadcast events: non-directionally connectable event (ADV _ IND), directionally connectable event (ADV _ DIRECT _ IND), non-directionally unconnected event (ADV _ non nconn _ IND) non-directionally SCAN event (ADV _ DISCOVER _ IND/ADV _ SCAN _ IND). In this embodiment, a non-directional non-connectable event is used to transmit audio stream data in a bluetooth connectionless broadcast manner. The decoding of the audio stream data may also employ a codec LC3 module. After the voice control command is obtained by voice recognition of the audio decoding data, the target intelligent household equipment is directly triggered to act through the peripheral universal interface, such as starting, closing or adjusting the temperature of an air conditioner. The scheme of the embodiment aims to realize the low-power Bluetooth voice transmission and recognize the specific voice command to intelligently control the action of the target intelligent equipment.
The embodiment is provided with the Bluetooth voice control terminal, wherein a universal peripheral interface is arranged to be directly connected with a plurality of different intelligent home devices, which is equivalent to the connection of different intelligent home devices through a data line, an electronic device with a Bluetooth function such as an intelligent mobile phone transmits audio stream data for voice control to the Bluetooth voice control terminal in a Bluetooth connectionless broadcast mode, the Bluetooth voice control terminal locally performs voice recognition to obtain a voice control instruction and directly drives a corresponding target intelligent home device to act through the universal peripheral interface, so that the problem of limited transmission distance of the current Bluetooth can be overcome, the external electronic device is matched with the Bluetooth voice control terminal to effectively realize voice control of a plurality of remote intelligent terminals of rooms, and the external electronic device is used as a Bluetooth initiator device and does not need to perform voice recognition to obtain a voice command, a voice recognition module is not needed, so that the functions and development cost of the related APP are simplified, and the universality is high; in addition, the external electronic equipment does not need to establish Bluetooth communication connection with each intelligent terminal, only transmits collected audio data to the Bluetooth voice control terminal in a Bluetooth connectionless broadcasting mode, directly controls the target intelligent terminal after voice recognition of the Bluetooth voice control terminal, does not need to interrupt one intelligent terminal and then connect another intelligent terminal for voice control in the existing mode, simplifies user operation, and can increase the number of a plurality of intelligent terminals which are simultaneously controlled. Finally, the voice control command obtained through recognition in the embodiment is directly transmitted to the intelligent terminal through the interface to directly control the intelligent terminal, so that the unreliability in the transmission process caused by the wireless mode of transmitting the voice control command through the Bluetooth is avoided, and the accuracy of the voice control intelligent terminal is improved.
In order to further improve the accuracy of the voice-controlled intelligent terminal, in an embodiment, the processor is specifically configured to perform voice recognition on the audio decoding data to obtain corresponding voice feature information, match the voice feature information with a voice recognition library stored in the non-volatile memory to obtain a voice text, and determine a corresponding voice control command based on the voice text; wherein the speech recognition library comprises different speech characteristic information and corresponding speech texts. Illustratively, for example, if the matched voice text is "adjust the air conditioner temperature to 26 °", the voice control command is "set 26", although not limited thereto.
That is to say, in this embodiment, the local voice recognition of the bluetooth voice control terminal and the matching of the voice recognition library based on the local setting result obtain the voice text, so that the accuracy and the recognition speed of the voice recognition can be improved, and further, the determined voice control command is more accurate, and thus, the accuracy of the voice control intelligent terminal is further improved.
In one embodiment, the above scheme of this embodiment is applied to a scenario where a plurality of smart home devices are respectively located in a living room and a plurality of rooms, where the plurality of rooms at least include a first room and a second room, and the first room is located above the second room. The intelligent terminal far away from the user position faces the problem that the Bluetooth transmission distance is limited under the scene, the intelligent terminal far away from the user position cannot be effectively controlled, the scheme of the embodiment can overcome the problem that the current Bluetooth transmission distance is limited, the external electronic equipment is matched with the Bluetooth voice control terminal to effectively realize the fact that the voice control relates to the far intelligent terminal in the rooms going upstairs and downstairs, and the intelligent terminals can be controlled simultaneously, and the number of the intelligent terminals is not limited generally.
In an embodiment, as shown in fig. 2, the universal peripheral interface is configured to connect to a plurality of different peripheral interface circuits, each peripheral interface circuit is connected to a corresponding one of the smart home devices (i.e., connected to a data line), each peripheral interface circuit has a respective interface identifier, the processor is specifically configured to determine, based on the voice text, a name of a target smart home device, such as "air conditioner and lamp", and target smart home device action information, such as "adjust temperature to 26 ° and turn on the lamp", generate a voice control instruction, such as "set 26, on", based on the target smart home device name, such as "air conditioner and lamp", and a preset mapping table, determine target interface identifiers ID1 and ID2 corresponding to the target smart home device, i.e., air conditioner, and send the voice control instruction, such as "set 26", to the peripheral interface circuit indicated by the target interface identifier ID1, and sending the voice control command such as 'on' to a peripheral interface circuit indicated by the target interface identification ID2, so that the target intelligent household equipment corresponding to the voice control command, such as an air conditioner and a Bluetooth lamp, acts, such as the air conditioner adjusts the temperature to 26 ℃, and the Bluetooth lamp is turned on. The preset mapping table comprises mapping relations between different intelligent household equipment names and corresponding interface identifications of the peripheral interface circuits. The preset mapping table may be previously established and stored into the nonvolatile memory and may be updated. Therefore, the one-to-one correspondence between the name of each intelligent household device and the interface identification ID of the corresponding peripheral interface circuit can be realized, so that the generated voice control instruction can be accurately sent to the corresponding target intelligent household device, the false sending or the wrong sending can be avoided, and the accuracy of controlling the plurality of intelligent terminals through voice can be improved.
In one embodiment, the plurality of peripheral interface circuits include, but are not limited to, a general purpose input/output (GPIO), an I2C bus, a Serial Peripheral Interface (SPI), a Pulse Width Modulation (PWM) interface, an integrated circuit (ic) built-in audio bus I2S, and the like, which are selected according to types, models, manufacturers, and the like of different smart home devices.
In one embodiment, the bluetooth communication module comprises a bluetooth communication module of above 5.2 version, for example, composed of a radio frequency and a baseband controller, and meets the bluetooth 5.2 specification for realizing low-power voice transmission. This bluetooth communication module can be independent bluetooth function module, also can be two unification modules of bluetooth WIFI. The Bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor are integrated on a system on chip (SoC). Therefore, the system level chip SOC of the Bluetooth 5.2 and above standard chips can be integrated, so that the Bluetooth voice control terminal is high in integration level, small in size, low in power consumption and high in universality. In one embodiment, the computer program is executed In an on-chip execution (XIP) mode when called by the processor.
In one embodiment, the bluetooth communication module further comprises a power management module for managing power supply of the bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor to reduce power consumption.
The disclosed embodiment also provides a bluetooth low energy voice control method, which is applied to a bluetooth terminal, and referring to fig. 1 again, the bluetooth terminal includes a bluetooth communication module, a general peripheral interface for connecting to a plurality of different smart home devices, a nonvolatile memory for storing a computer program, and a processor, and the method is implemented by the processor invoking and executing the computer program, as shown in fig. 3, the method may include the following steps:
step 1: receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode;
step 2: decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and 3, step 3: and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
In one embodiment, the specific speech recognition in step 2 obtains corresponding speech feature information, matches the speech feature information with a speech recognition library stored on the non-volatile memory to obtain a speech text, and determines a corresponding speech control command based on the speech text; wherein the speech recognition library comprises different speech characteristic information and corresponding speech texts.
In one embodiment, a plurality of the smart home devices are respectively located in a living room and a plurality of rooms, the plurality of rooms at least comprise a first room and a second room, and the first room is located above the second room.
In one embodiment, the universal peripheral interface is configured to connect to a plurality of different peripheral interface circuits, each peripheral interface circuit is connected to a corresponding one of the smart home devices, each peripheral interface circuit has a respective interface identifier, in step 2, a target smart home device name and target smart home device action information are determined based on the voice text, a voice control instruction is generated based on the target smart home device action information, a target interface identifier corresponding to the target smart home device is determined based on the target smart home device name and a preset mapping table, and in step 3, the voice control instruction is sent to the peripheral interface circuit indicated by the target interface identifier, so that the target smart home device corresponding to the voice control instruction acts; the preset mapping table comprises mapping relations between different intelligent household equipment names and corresponding interface identifications of the peripheral interface circuits.
In one embodiment, the plurality of peripheral interface circuits includes general purpose input/output (GPIO), I2C bus, Serial Peripheral Interface (SPI), Pulse Width Modulation (PWM) interface, and Integrated Circuit (IC) embedded audio bus I2S.
The detailed description of the method in the above embodiment, the specific manner in which each step performs the operation, and the corresponding technical effects brought about have been described in the above embodiment related to the terminal in detail, and will not be elaborated herein.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc. Additionally, it will also be readily appreciated that the steps may be performed synchronously or asynchronously, e.g., among multiple modules/processes/threads.
As shown in fig. 4, an embodiment of the present disclosure provides a bluetooth low energy voice control apparatus, which is applied to a bluetooth terminal, where the bluetooth terminal includes a bluetooth communication module, a general peripheral interface for connecting to multiple different smart home devices, a nonvolatile memory for storing a computer program, and a processor, and the apparatus is implemented by the processor invoking and executing the computer program, and includes:
the data receiving module 401 is configured to receive audio stream data sent by the bluetooth communication module, where the audio stream data is collected by an electronic device with a bluetooth function from the outside and then transmitted to the bluetooth communication module in a bluetooth connectionless broadcast manner;
an audio processing module 402, configured to decode the audio stream data to obtain audio decoding data, and perform speech recognition processing on the audio decoding data to obtain a corresponding speech control command;
and a voice control module 403, configured to drive the universal peripheral interface based on the voice control command, so as to enable a target smart home device corresponding to the voice control command to act, where the target smart home device is one or more of the multiple smart home devices.
In one embodiment, the audio processing module is specifically configured to perform speech recognition on the audio decoding data to obtain corresponding speech feature information, match the speech feature information with a speech recognition library stored in the non-volatile memory to obtain a speech text, and determine a corresponding speech control command based on the speech text; wherein the speech recognition library comprises different speech characteristic information and corresponding speech texts.
In one embodiment, a plurality of the smart home devices are respectively located in a living room and a plurality of rooms, the plurality of rooms at least comprise a first room and a second room, and the first room is located above the second room.
In one embodiment, the universal peripheral interface is configured to connect to a plurality of different peripheral interface circuits, each peripheral interface circuit is connected to a corresponding one of the smart home devices, each peripheral interface circuit has a respective interface identifier, the audio processing module is specifically configured to determine a name of a target smart home device and action information of the target smart home device based on the voice text, generate a voice control instruction based on the action information of the target smart home device, and determine a target interface identifier corresponding to the target smart home device based on the name of the target smart home device and a preset mapping table, where the voice control module is configured to send the voice control instruction to an external interface circuit indicated by the target interface identifier, so that the target smart home device corresponding to the voice control instruction acts; the preset mapping table comprises mapping relations between different intelligent household equipment names and corresponding interface identifications of the peripheral interface circuits.
In one embodiment, the plurality of peripheral interface circuits includes general purpose input/output (GPIO), I2C bus, Serial Peripheral Interface (SPI), Pulse Width Modulation (PWM) interface, and integrated circuit built-in audio bus I2S.
In one embodiment, the bluetooth communication module comprises a bluetooth version 5.2 or higher communication module; the Bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor are integrated on a system on chip (SoC).
In one embodiment, the bluetooth terminal further comprises a power management module for managing power supply of the bluetooth communication module, the universal peripheral interface, the non-volatile memory and the processor to reduce power consumption.
The detailed description of the apparatus in the above embodiments, the specific manner in which each module performs operations, and the corresponding technical effects, have been described in the above embodiments related to the terminal, and will not be described in detail herein.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functions of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units. The components shown as modules or units may or may not be physical units, i.e. may be located in one place or may also be distributed over a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood-disclosed scheme. One of ordinary skill in the art can understand and implement it without inventive effort.
An embodiment of the present disclosure further provides an electronic device, including: a Bluetooth communication module; the universal peripheral interface is used for connecting a plurality of different intelligent household devices; a non-volatile memory for storing a computer program; a processor for invoking execution of the computer program to implement the following speech control method steps: receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode; decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command; and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
In one embodiment, the processor is specifically configured to perform speech recognition on the audio decoding data to obtain corresponding speech feature information, match the speech feature information with a speech recognition library stored in the non-volatile memory to obtain a speech text, and determine a corresponding speech control command based on the speech text; wherein the speech recognition library comprises different speech characteristic information and corresponding speech texts.
In one embodiment, a plurality of the smart home devices are respectively located in a living room and a plurality of rooms, the plurality of rooms at least comprise a first room and a second room, and the first room is located above the second room.
In one embodiment, the universal peripheral interface is configured to connect to a plurality of different peripheral interface circuits, each peripheral interface circuit is connected to a corresponding one of the smart home devices, each peripheral interface circuit has a respective interface identifier, the processor is specifically configured to determine a name of a target smart home device and target smart home device action information based on the voice text, generate a voice control instruction based on the target smart home device action information, determine a target interface identifier corresponding to the target smart home device based on the name of the target smart home device and a preset mapping table, and send the voice control instruction to the peripheral interface circuit indicated by the target interface identifier, so that the target smart home device corresponding to the voice control instruction acts; the preset mapping table comprises mapping relations between different intelligent household equipment names and corresponding interface identifications of the peripheral interface circuits.
In one embodiment, the plurality of peripheral interface circuits includes general purpose input/output (GPIO), I2C bus, Serial Peripheral Interface (SPI), Pulse Width Modulation (PWM) interface, and Integrated Circuit (IC) embedded audio bus I2S.
In one embodiment, the bluetooth communication module comprises a bluetooth version 5.2 or higher communication module; the Bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor are integrated on a system on chip (SoC).
In one embodiment, the bluetooth communication module further comprises a power management module for managing power supply of the bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor to reduce power consumption.
With regard to the electronic device in the above-mentioned embodiment, the specific manner in which each module performs operations and the corresponding technical effects have been described in detail in the above-mentioned embodiment related to the terminal, and will not be described in detail herein.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the method steps according to the above-mentioned embodiments of the present disclosure.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description is only for the purpose of describing particular embodiments of the present disclosure, so as to enable those skilled in the art to understand or implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A low-power Bluetooth voice control terminal, comprising:
a Bluetooth communication module;
the universal peripheral interface is used for connecting a plurality of different intelligent household devices;
a non-volatile memory for storing a computer program;
a processor for invoking execution of the computer program to implement the following speech control method steps:
a) receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode after being encoded by a voice signal collected by an electronic device with an external Bluetooth function;
b) decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
c) and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
2. The terminal of claim 1, wherein the processor is specifically configured to speech-recognize the audio decoding data to obtain corresponding speech feature information, match the speech feature information with a speech recognition library stored in the non-volatile memory to obtain a speech text, and determine a corresponding speech control command based on the speech text; wherein the speech recognition library comprises different speech characteristic information and corresponding speech texts.
3. The terminal according to claim 2, wherein a plurality of the smart home devices are respectively located in a living room and a plurality of rooms, the plurality of rooms including at least a first room and a second room, the first room being located above the second room.
4. The terminal according to claim 2 or 3, wherein the universal peripheral interface is configured to connect to a plurality of different peripheral interface circuits, each peripheral interface circuit is connected to a corresponding smart home device, each peripheral interface circuit has a respective interface identifier, the processor is specifically configured to determine a name of a target smart home device and action information of the target smart home device based on the voice text, generate a voice control instruction based on the action information of the target smart home device, determine a target interface identifier corresponding to the target smart home device based on the name of the target smart home device and a preset mapping table, and send the voice control instruction to an external interface circuit indicated by the target interface identifier, so that the target smart home device corresponding to the voice control instruction acts; the preset mapping table comprises mapping relations between different intelligent household equipment names and corresponding interface identifications of the peripheral interface circuits.
5. The terminal of claim 4, wherein the plurality of peripheral interface circuits comprises general purpose input/output (GPIO), I2C bus, Serial Peripheral Interface (SPI), Pulse Width Modulation (PWM) interface, Integrated Circuit (IC) built-in audio bus I2S.
6. The terminal of claim 4, wherein the bluetooth communication module comprises a bluetooth 5.2 version or more communication module; the Bluetooth communication module, the universal peripheral interface, the nonvolatile memory and the processor are integrated on a system on chip (SoC).
7. The terminal of claim 6, further comprising a power management module to manage power to the bluetooth communication module, the universal peripheral interface, the non-volatile memory, and the processor to reduce power consumption.
8. A low-power Bluetooth voice control method is applied to a Bluetooth terminal, the Bluetooth terminal comprises a Bluetooth communication module, a universal peripheral interface used for connecting a plurality of different intelligent household devices, a nonvolatile memory used for storing a computer program and a processor, the method is realized by the processor calling and executing the computer program, and the method comprises the following steps:
receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode after being encoded by a voice signal collected by an electronic device with an external Bluetooth function;
decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
9. A low-power Bluetooth voice control device is applied to a Bluetooth terminal, the Bluetooth terminal comprises a Bluetooth communication module, a universal peripheral interface used for connecting a plurality of different intelligent household devices, a nonvolatile memory used for storing a computer program and a processor, and the device is realized by the processor calling and executing the computer program and comprises:
the data receiving module is used for receiving audio stream data sent by the Bluetooth communication module, and the audio stream data is collected by an electronic device with a Bluetooth function from the outside and then is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode;
the audio processing module is used for decoding the audio stream data to obtain audio decoding data and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and the voice control module is used for driving the universal peripheral interface based on the voice control command so as to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
10. An electronic device, comprising:
a Bluetooth communication module;
the universal peripheral interface is used for connecting a plurality of different intelligent household devices;
a non-volatile memory for storing a computer program;
a processor for invoking execution of the computer program to implement the following speech control method steps:
receiving audio stream data sent by the Bluetooth communication module, wherein the audio stream data is transmitted to the Bluetooth communication module in a Bluetooth connectionless broadcast mode after being encoded by a voice signal collected by an electronic device with an external Bluetooth function;
decoding the audio stream data to obtain audio decoding data, and performing voice recognition processing on the audio decoding data to obtain a corresponding voice control command;
and driving the universal peripheral interface based on the voice control command to enable target intelligent home equipment corresponding to the voice control command to act, wherein the target intelligent home equipment is one or more of the intelligent home equipment.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210992811.9A CN115101071A (en) | 2022-08-18 | 2022-08-18 | Low-power-consumption Bluetooth voice control terminal, method, device and equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210992811.9A CN115101071A (en) | 2022-08-18 | 2022-08-18 | Low-power-consumption Bluetooth voice control terminal, method, device and equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115101071A true CN115101071A (en) | 2022-09-23 |
Family
ID=83301354
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210992811.9A Pending CN115101071A (en) | 2022-08-18 | 2022-08-18 | Low-power-consumption Bluetooth voice control terminal, method, device and equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115101071A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115665672A (en) * | 2022-11-21 | 2023-01-31 | 成都市安比科技有限公司 | Bluetooth-based low-power-consumption multi-user real-time voice transmission method |
CN116708065A (en) * | 2023-06-27 | 2023-09-05 | 北京联盛德微电子有限责任公司 | Low-power consumption Bluetooth voice control method and system in intelligent home environment |
CN117174089A (en) * | 2023-11-01 | 2023-12-05 | 中电科新型智慧城市研究院有限公司 | Control method, control device, electronic equipment and storage medium |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102111314A (en) * | 2010-12-30 | 2011-06-29 | 广州市聚晖电子科技有限公司 | Smart home voice control system and method based on Bluetooth transmission |
CN105577486A (en) * | 2014-10-15 | 2016-05-11 | 珠海格力电器股份有限公司 | Control method of intelligent household appliance and household control center |
CN105573142A (en) * | 2014-10-15 | 2016-05-11 | 珠海格力电器股份有限公司 | Intelligent household control system |
CN108173728A (en) * | 2018-02-11 | 2018-06-15 | 张戈零 | Intelligent appliance equipment and intelligent appliance system |
CN108200541A (en) * | 2018-02-11 | 2018-06-22 | 张戈零 | Bluetooth control terminal based on Internet of Things |
CN108400914A (en) * | 2018-02-11 | 2018-08-14 | 张戈零 | Internet of Things network control method based on Bluetooth communication |
CN110555321A (en) * | 2019-09-11 | 2019-12-10 | 腾讯科技(深圳)有限公司 | data processing method and device in intelligent household system and storage medium |
CN113314119A (en) * | 2021-07-27 | 2021-08-27 | 深圳百昱达科技有限公司 | Voice recognition intelligent household control method and device |
-
2022
- 2022-08-18 CN CN202210992811.9A patent/CN115101071A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102111314A (en) * | 2010-12-30 | 2011-06-29 | 广州市聚晖电子科技有限公司 | Smart home voice control system and method based on Bluetooth transmission |
CN105577486A (en) * | 2014-10-15 | 2016-05-11 | 珠海格力电器股份有限公司 | Control method of intelligent household appliance and household control center |
CN105573142A (en) * | 2014-10-15 | 2016-05-11 | 珠海格力电器股份有限公司 | Intelligent household control system |
CN108173728A (en) * | 2018-02-11 | 2018-06-15 | 张戈零 | Intelligent appliance equipment and intelligent appliance system |
CN108200541A (en) * | 2018-02-11 | 2018-06-22 | 张戈零 | Bluetooth control terminal based on Internet of Things |
CN108400914A (en) * | 2018-02-11 | 2018-08-14 | 张戈零 | Internet of Things network control method based on Bluetooth communication |
CN110555321A (en) * | 2019-09-11 | 2019-12-10 | 腾讯科技(深圳)有限公司 | data processing method and device in intelligent household system and storage medium |
CN113314119A (en) * | 2021-07-27 | 2021-08-27 | 深圳百昱达科技有限公司 | Voice recognition intelligent household control method and device |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115665672A (en) * | 2022-11-21 | 2023-01-31 | 成都市安比科技有限公司 | Bluetooth-based low-power-consumption multi-user real-time voice transmission method |
CN115665672B (en) * | 2022-11-21 | 2023-02-28 | 成都市安比科技有限公司 | Bluetooth-based low-power-consumption multi-user real-time voice transmission method |
CN116708065A (en) * | 2023-06-27 | 2023-09-05 | 北京联盛德微电子有限责任公司 | Low-power consumption Bluetooth voice control method and system in intelligent home environment |
CN117174089A (en) * | 2023-11-01 | 2023-12-05 | 中电科新型智慧城市研究院有限公司 | Control method, control device, electronic equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN115101071A (en) | Low-power-consumption Bluetooth voice control terminal, method, device and equipment | |
US9892634B2 (en) | Remote control docking station and system | |
US8280086B2 (en) | Remote control system for a hearing aid | |
EP3173888A1 (en) | Method and system for managing household devices | |
CN206097455U (en) | Speech recognition controlgear | |
EP3474131B1 (en) | Multiprotocol audio7voice internet-of-things devices and related systems | |
CN103824099A (en) | Method and system for connecting and controlling equipment automatically by intelligent terminal via identification tags | |
CN103051734A (en) | Remote voice control method and system for household electrical appliance and communication terminal | |
CN203325206U (en) | Infrared remote-control learning and control device | |
US10101771B2 (en) | Remote control docking station and system | |
CN108877185B (en) | Bluetooth remote control method and circuit | |
CN110738992B (en) | Voice information processing method and device, storage medium and electronic device | |
CN112837526A (en) | Universal integrated remote control method, control device and universal integrated remote control device | |
US20060129408A1 (en) | A remote control device and method with speech control | |
CN111240222A (en) | Intelligent household control system, method and device | |
CN112712683B (en) | Control method and system of household appliance, remote controller and server | |
CN112133075A (en) | Wireless bluetooth speaker system with intelligent control | |
CN217443749U (en) | Integrated control box and intelligent home control system | |
CN110942612A (en) | Remote controller control method, remote controller and remote controller system | |
CN215118307U (en) | Remote control module integrating voice recognition and Bluetooth BLE | |
JP2008131633A (en) | Rf communication system, and control method therefore | |
CN113129578A (en) | Matching method, control method, system and storage medium of infrared equipment | |
WO2020216089A1 (en) | Voice control system and method, and voice suite and voice apparatus | |
CN113314117A (en) | Voice recognition and Bluetooth BLE integrated remote control module and remote control method | |
CN111554291A (en) | Device control method, voice input terminal, voice platform and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220923 |
|
RJ01 | Rejection of invention patent application after publication |