CN112233677A - Intelligent interaction equipment - Google Patents
Intelligent interaction equipment Download PDFInfo
- Publication number
- CN112233677A CN112233677A CN201910573493.0A CN201910573493A CN112233677A CN 112233677 A CN112233677 A CN 112233677A CN 201910573493 A CN201910573493 A CN 201910573493A CN 112233677 A CN112233677 A CN 112233677A
- Authority
- CN
- China
- Prior art keywords
- processor
- signal
- processed
- wake
- acquisition component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 73
- 238000004891 communication Methods 0.000 claims abstract description 31
- 230000005540 biological transmission Effects 0.000 claims abstract description 7
- 230000007613 environmental effect Effects 0.000 claims abstract description 7
- 230000000903 blocking effect Effects 0.000 claims abstract description 3
- 230000002452 interceptive effect Effects 0.000 claims description 44
- 230000009467 reduction Effects 0.000 claims description 27
- 238000000034 method Methods 0.000 claims description 16
- 230000002618 waking effect Effects 0.000 claims description 3
- 230000006870 function Effects 0.000 description 25
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 11
- 238000012544 monitoring process Methods 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 5
- 238000007781 pre-processing Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 2
- 241000700605 Viruses Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- ZXQYGBMAQZUVMI-GCMPRSNUSA-N gamma-cyhalothrin Chemical compound CC1(C)[C@@H](\C=C(/Cl)C(F)(F)F)[C@H]1C(=O)O[C@H](C#N)C1=CC=CC(OC=2C=CC=CC=2)=C1 ZXQYGBMAQZUVMI-GCMPRSNUSA-N 0.000 description 1
- 208000015181 infectious disease Diseases 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4418—Suspend and resume; Hibernate and awake
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/005—Language recognition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Security & Cryptography (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
Abstract
The application provides intelligent interaction equipment which comprises an acquisition component, a wake-up processor, a main processor and a communication module; the acquisition component is used for converting the acquired environmental signals into signals to be processed; the wake-up processor is used for carrying out instruction identification on the signal to be processed; the wake-up processor is also used for controlling the signals to be processed to be transmitted to the main processor under the condition that the signals to be processed contain the wake-up instruction; and blocking the transmission of the signal to be processed to the main processor under the condition that the signal to be processed contains the sleep instruction; the main processor is used for carrying out subsequent processing on the signal to be processed and communicating with the remote server through the communication module. Because the function of the wake-up processor is independent of the main processor, the wake-up function of the wake-up processor is not influenced by programmed instructions loaded in the main processor and is not communicated with a remote server through a communication module, so that the problem of being controlled by the remote illegal server is avoided.
Description
Technical Field
The application relates to the technical field of artificial intelligence, in particular to intelligent interaction equipment.
Background
Intelligent interactive devices such as smart speakers have been used in home, office, and other application scenarios. Taking the smart sound box as an example, the user can trigger the smart sound box to complete the designated action in a voice interaction manner. Specifically, the method comprises the following steps: the voice produced by the user is received by a sound pickup of the intelligent sound box and converted into audio information, and the audio information is processed by a voice recognition module of the intelligent sound box; if the voice recognition module obtains the awakening words, the subsequent processing module is awakened to process the audio information, and the audio information obtained by the sound pickup is continuously sent to the subsequent module; if the speech recognition module does not detect the wake-up word, the audio information is discarded.
Under normal conditions, for example, in the process of a user performing a private conversation, the smart sound box is generally controlled to be in a dormant state, so that privacy information is prevented from being leaked. However, under abnormal conditions such as infection of the intelligent sound box by a Trojan horse virus, the method that the user controls the sleep of the intelligent sound box through sound may fail, the subsequent processing of the intelligent sound box may be in a secret working state all the time, the voice information audio information generated by the sound pickup is obtained, and corresponding information is not fed back to the user through the sound box (that is, the intelligent sound box is in a false sleep state); thus, the smart sound box becomes a tool for illegally monitoring the user and acquiring the privacy information of the user.
Disclosure of Invention
The application provides an intelligent interaction device, which avoids the problem that the privacy of a user is illegally obtained because the intelligent interaction device is illegally controlled by a remote server by changing the internal structure of the intelligent interaction device.
The application provides intelligent interaction equipment which comprises an acquisition component, a wake-up processor, a main processor and a communication module;
the acquisition component is used for converting the acquired environmental signals into signals to be processed;
the wake-up processor is used for performing instruction identification on a signal to be processed;
the wake-up processor is further used for controlling the signals to be processed to be transmitted to the main processor under the condition that the signals to be processed contain the wake-up instruction; and the number of the first and second groups,
blocking the transmission of the signal to be processed to the main processor under the condition that the signal to be processed contains a sleep instruction;
the main processor is used for carrying out subsequent processing on the signal to be processed and communicating with the remote server through the communication module.
In one implementation, the intelligent interactive device comprises a control switch;
the control end of the control switch is connected with the output end of the awakening processor;
two working ends of the control switch are respectively connected with the output end of the acquisition component and the input end of the main processor;
and the awakening processor controls whether to transmit a signal to be processed to the main processor or not by controlling the working state of the control switch.
In one implementation, the intelligent interactive device comprises a noise reduction filter circuit; the input end of the noise reduction filter circuit is connected with the output end of the acquisition component;
the input of awakening processor with the output of collection part is connected, includes: the awakening processor is connected with the output end of the acquisition component through the noise reduction filter circuit;
two working ends of the control switch are respectively connected with the output end of the acquisition component and the input end of the main processor, and the control switch comprises: one working end of the control switch is connected with the acquisition component through the noise reduction filter circuit, and the other working end of the control switch is connected with the main processor.
In one implementation, the wake-up processor is further configured to:
awakening the main processor under the condition that the signal to be processed contains an awakening instruction; and the number of the first and second groups,
and controlling the main processor to enter a sleep state under the condition that the signal to be processed contains a sleep instruction.
The application provides another intelligent interaction device, which comprises a first acquisition component, a second acquisition component, a wake-up processor, a main processor and a communication module;
the first acquisition component is used for converting the acquired environment signal into a first signal to be processed;
the second acquisition component is used for converting the acquired environment signal into a second signal to be processed;
the wake-up processor is used for carrying out instruction identification on the first signal to be processed;
the wake-up processor is further used for controlling the second acquisition component to be powered on to work under the condition that the first signal to be processed contains a wake-up instruction;
the main processor is used for processing the second signal to be processed and communicating with a remote server through the communication module.
In a specific implementation application, the wake-up processor is further configured to control the second collecting unit to stop working when the first signal to be processed includes a sleep instruction.
In one implementation, the intelligent interactive device comprises a control switch;
the control end of the control switch is connected with the output end of the awakening processor, and the working end of the control switch is connected with the component to be acquired in series;
and the awakening processor controls whether the second acquisition component is electrified to work or not by controlling the working state of the control switch.
In one implementation, the wake-up processor is further configured to:
when the first signal to be processed contains a wake-up instruction, waking up the main processor; and the number of the first and second groups,
and controlling the main processor to enter a sleep state under the condition that the first signal to be processed contains a sleep instruction.
In one implementation, the intelligent interactive device comprises a noise reduction filter circuit;
the input of awakening processor is connected with the output of first acquisition component, including: the input end of the awakening processor is connected with the output end of the first acquisition component through the noise reduction filter circuit;
the input end of the main processor is connected with the output end of the second acquisition component, and the method comprises the following steps: the input end of the main processor is connected with the output end of the second acquisition component through the noise reduction filter circuit.
In a specific implementation application, in a case that the first signal to be processed includes a wake-up instruction, an input end of the wake-up processor is switched to be connected with an output end of the second acquisition component, so as to process a second signal to be processed;
and the awakening processor is also used for controlling the second acquisition component to stop working and switching the input end of the awakening processor to be connected with the output end of the first acquisition component under the condition that the second signal to be processed contains a sleep instruction.
In some embodiments of the present application, the wake-up processor function is configured independently of the main processor. Because the function of the wake-up processor is independent of the main processor, the wake-up processor can independently determine whether the signal to be processed needs to be controlled to be sent to the main processor according to the signal to be processed, the wake-up function of the wake-up processor is not influenced by programmed instructions loaded in the main processor, and the wake-up processor can not be communicated with a remote server through a communication module, so that the problem of being controlled by the remote illegal server can not occur.
In some other embodiments of the present application, the wake-up processor function is configured independently of the main processor. The wake-up processor independently determines whether to electrify the second acquisition component according to the first signal to be processed, and then controls whether to generate and send a second signal to be processed to the main processor. The function of the wake-up processor is independent of the main processor, the function of the wake-up processor is not influenced by programmed instructions loaded in the main processor, and the wake-up processor is not communicated with a remote server through a communication module, so that the problem of being controlled by the remote illegal server is solved.
Drawings
FIG. 1 is a block diagram of a prior art smart speaker;
FIG. 2 is a schematic structural diagram of an intelligent interaction device according to an embodiment;
FIG. 3 is a diagram illustrating an intelligent interactive device according to an embodiment after structure refinement;
FIG. 4 is a schematic structural diagram of an intelligent interaction device provided in the second embodiment;
FIG. 5 is a diagram of an intelligent interactive device provided by the second embodiment after structure refinement;
FIG. 6 is a schematic structural diagram of an intelligent interaction device according to a third embodiment;
wherein: 01-sound pick-up, 02-loudspeaker, 03-main control board, 04-central processing unit, 05-random access memory, 06-flash memory, 07-communication module, 11-acquisition component, 12-awakening processor, 13-main processing unit, 14-communication module, 15-control switch, 16-first acquisition component, and 17-second acquisition component.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
The embodiment of the application provides intelligent interaction equipment, and the internal circuit structure of the intelligent interaction equipment is optimized so as to avoid the problem that a user is illegally controlled but not illegally monitored.
Before the intelligent interaction device provided by the embodiment of the application is specifically analyzed, the reason that the existing intelligent interaction device can be used for illegally monitoring the user is analyzed by combining the structure of the existing intelligent interaction device in the prior art; in the following, an intelligent sound box is taken as an example (of course, the intelligent interactive device may also be an intelligent audio-visual device).
Fig. 1 is a block diagram of a smart speaker in the prior art. As shown in fig. 1, a smart sound box in the prior art includes a sound pickup 01, a speaker 02 and a main control board 03; the main control board 03 is provided with a central processing unit 04(CPU), a random access memory 05 (internal memory), a flash memory 06, a communication module 07, and an interface unit for connecting the sound pickup 01 and the processor (of course, the main control board 03 may also be provided with an encoder and a decoder for processing sound signals).
When the microphone is powered on, the central processing unit 04 loads a programmed instruction to process a signal to be processed acquired by the sound pickup 01, for example, an awakening instruction in a sound signal is extracted; after the wake-up instruction in the sound signal is extracted, the smart sound box processes a subsequent signal to be processed collected by the sound pickup 01, and sends the obtained voice information to the remote server through the communication module 07, so that the instruction of the user is identified by using the powerful processing function of the remote server, and subsequent operation is performed according to the information issued by the remote server.
As mentioned above, it is because the cpu 04 identifies the wake-up command in the signal to be processed by loading the programmed command; under the condition that programming instructions (also called program codes) in the intelligent sound box have bugs and are utilized maliciously, awakening code instructions of the intelligent sound box can be controlled by a remote illegal server to skip or delete, and the remote illegal server also controls the intelligent sound box to be in a secret activation working state, namely, the intelligent sound box becomes a tool for illegally monitoring users and acquiring user privacy.
To avoid the foregoing problems, the following embodiments of the present application provide several improved intelligent interaction devices.
Example one
Fig. 2 is a schematic structural diagram of an intelligent interaction device according to an embodiment. As shown in fig. 2, the intelligent interactive device provided in the first embodiment includes an acquisition component 11, a wake-up processor 12, a main processor 13, and a communication module 14.
The acquisition component 11 is used for converting the acquired environment signal into a signal to be processed. In specific application, the acquisition component 11 makes different selections according to different interaction types of the intelligent interaction device.
For example, in the case where the interaction type is voice interaction and the environmental signal is a sound signal, the collecting part 11 is a sound pickup; in the case that the interaction type is motion interaction and the environment signal is light signal, the acquisition component 11 and the second acquisition component 11 are both image sensors (which may be image sensors in the visible light range, and may also be image sensors in the infrared light range or other bands).
In specific application, the acquisition component 11 converts an environmental signal into an analog signal; in order to facilitate subsequent processing, an analog-to-digital conversion chip matched with the acquisition equipment for use can be further arranged in the intelligent interaction equipment so as to convert the signals to be processed in the analog mode into the signals to be processed in the digital mode.
The wake-up processor 12 is used for analyzing and processing the signal to be processed. Specifically, the functions of the wake-up processor 12 mainly include: (1) performing data processing on the signal to be processed to acquire possible instruction information in the signal to be processed; namely, carrying out instruction identification on the signal to be processed; (2) controlling the signal to be processed to be transmitted to the main processor 13 under the condition that the signal to be processed is determined to contain the wake-up instruction; (3) in a case where it is determined that the sleep instruction is contained in the signal to be processed, transmission of the signal to be processed to the main processor 13 is blocked.
The main processor 13 is used for performing subsequent processing on the signal to be processed (the specific function can be referred to the processing action of the existing central processor of the intelligent interactive device, but excluding the identification of the wake-up command), for example: (1) analyzing and processing the signal to be processed to obtain natural language information contained in the signal to be processed; (2) executing some operation instructions corresponding to the natural language information which can determine the content; (3) some natural language information is sent to a remote server (or a remote cloud) through the communication module 14, and a processing result returned by the remote server is received, and a corresponding operation instruction is generated according to the processing result.
According to different interaction types of the intelligent interaction equipment, the intelligent interaction equipment also can be provided with corresponding output components so as to realize interaction with the user and feedback information to the user. For example: (1) under the condition that the interaction type is voice interaction, the output component is a loudspeaker; (2) in case the interaction type is a multimedia interaction, the output means is a display and/or a speaker; such devices are therefore not central to the inventive concept of the present application and are therefore not described further.
It should be noted that in the intelligent interactive device provided in the first embodiment, the wake-up processor 12 is a processor functionally independent from the main processor 13; the following is a detailed analysis with reference to the foregoing description of the structure of the intelligent interactive device in the prior art.
In the intelligent interactive device provided in the first embodiment, the main processor 13 may be a central processor with a structure similar to that of an existing intelligent interactive device, and may process the signal to be processed by loading a programmed instruction, communicate with a remote server through the communication module 14, and generate a corresponding operation instruction according to a processing result returned by the remote server.
Wake-up processor 12 is a processor that functions independently of main processor 13; under the normal application condition, the wake-up processor 12 cannot be controlled by the programmed instruction loaded by the main processor 13, and cannot communicate with a remote server through the communication module 14, only when the intelligent interactive device is powered on, a stored specific data processing algorithm is loaded, instruction identification is performed on the signal to be processed, whether the signal to be processed contains a wake-up instruction or a sleep instruction is determined, transmission of subsequent signals to be processed (or all signals to be processed) to the main processor 13 is controlled under the condition that the signal to be processed contains the wake-up instruction, and transmission of the signal to be processed to the main processor 13 is blocked under the condition that the signal to be processed contains the sleep instruction.
Since the wake-up processor 12 functions independently of the main processor 13, its functions are not affected by programmed instructions loaded in the main processor 13 and do not communicate with a remote server through the communication module 14, and thus there is no problem of being controlled by a remote illegal server.
Under normal operation, the wake-up processor 12 controls whether to send the signal to be processed to the main processor 13 only when a specific environment signal occurs in the environment where the intelligent interactive device is located (i.e. an instruction signal for the user to wake up the intelligent interactive device).
Even if the programmed instruction loaded by the main processor 13 in the intelligent interactive device is tampered by a remote illegal server, the main processor 13 cannot acquire the signal to be processed containing the user information under the condition that the wake-up processor 12 does not receive the wake-up instruction, and thus cannot illegally monitor the user.
By adopting the intelligent interaction device provided by the first embodiment, the possibility of illegally monitoring the user by using the intelligent interaction device can be avoided by cutting off the data source, so that the problem of privacy disclosure of the user under a specific working state of the intelligent interaction device can be avoided.
It should be noted that the foregoing explicitly mentions that the wake-up processor 12 and the main processor 13 are two functionally independent processors; however, it is only the functional independence of the wake-up processor 12 and the main processor 13, and it is not the physical independence of the two separate processors (or two separate chips); in some intelligent interaction devices, for example, in the case where the intelligent interaction device employs a dedicated processing chip, the wake-up processor 12 and the main processor 13 may be integrated into one chip.
Of course, in view of convenience of use and modularization requirements, in most cases, the intelligent interactive device may employ two chips as the wake-up processor 12 and the main processor 13, respectively. In practical applications, the chip used by the wake-up processor 12 may be a DSP chip or an FPGA chip, or may be a chip type available in the field, such as a chip of the aforementioned central processor architecture. A dedicated data processing chip such as a DSP is preferably employed in view of the functional specialization of the wake-up processor 12, only for the purpose of performing specific processing and instruction recognition on the signal to be processed.
Fig. 3 is a schematic diagram of an intelligent interaction device provided in the first embodiment after a structure is refined. Referring to fig. 3, in an embodiment, the intelligent interactive device may include a control switch 15, so as to utilize the control switch 15 to control the transmission of the signal to be processed.
Specifically, the control switch 15 includes a control end and a working end; wherein, the control end of the control switch 15 is connected with the output end of the wake-up processor 12, and two working ends of the control switch 15 are respectively connected with the output end of the acquisition component 11 and the input end of the main processor 13. The wake-up processor 12 controls whether to transmit a signal to be processed to the main processor 13 by controlling the operating state of the control switch 15.
When the wake-up processor 12 recognizes the wake-up command, the two working ends of the control switch 15 are short-circuited, so that the output end of the acquisition component 11 is communicated with the input end of the main processor 13, and the signal to be processed can be transmitted to the main processor 13 through the acquisition component 11; when the wake-up processor 12 recognizes the sleep command, the two working ends of the control switch 15 are disconnected, so that the output end of the acquisition component 11 and the input end of the main processor 13 are disconnected, and the signal to be processed cannot be transmitted to the main processor 13.
In some practical applications, the operation-executing part of the control switch 15 may be a single-pole single-throw switch, and two operation terminals are respectively connected to the acquisition unit 11 and the main processor 13.
In other practical applications, the execution work part of the control switch 15 can be a single-pole double-throw switch, and in addition, the intelligent interactive device is also provided with some load resistors. The movable end of the control switch 15 is connected with the acquisition part 11; two fixed ends of the control switch 15 are respectively connected with the main processor 13 and the load resistor; when the wake-up processor 12 recognizes the sleep command, the output end of the acquisition component 11 is connected to the load resistor to consume power by the load resistor to avoid signal reflection and other problems (for example, signal reflection may be avoided to cause signals to be processed to be transmitted to the wake-up processor 12 in an overlapping manner).
In the foregoing, only the working principle of the control switch 15 is mentioned, and in practical application, the control switch 15 may be a relay switch applied in a conventional circuit, or a switch circuit with a relay control function formed by transistors used in an integrated circuit, and the application is not limited in particular. However, in view of the size advantage of the integrated circuit, the control switch 15 is preferably provided as a switch circuit composed of the transistor control switch 15.
Fig. 3 shows the control switch 15 and wake-up processor 12 as two functionally independent components; in practice, the control switch 15 may be integrated with the wake-up processor 12 in one chip, which only provides pins for connection to external components.
It should be noted that in the foregoing application provided in the first embodiment, the main processor 13 can receive the signal to be processed only when the wake-up processor 12 issues the wake-up instruction, and the signal to be processed transmitted to the main processor 13 excludes the signal to be processed from including the wake-up instruction, which causes the wake-up processor 12 to generate the wake-up instruction.
In some other applications provided in the first embodiment, a memory may also be provided, an input end of the memory is communicated with the acquisition unit 11, one output end of the temporary storage is connected with the wake-up processor 12, and the other output end is connected with the main processor 13 through the control switch 15; the main processor 13 may obtain a signal to be processed including a wake-up instruction by reading the content stored in the memory; it should be noted that at this point it should be ensured that no signal preceding the signal to be processed including the wake-up instruction is transmitted to the main processor 13.
With continued reference to fig. 3, in some specific applications of the first embodiment, the intelligent interactive device may further include a noise reduction filter circuit, where the noise reduction filter circuit is configured to perform preprocessing on the signal to be processed acquired by the acquisition component 11, where the preprocessing includes improving a signal-to-noise ratio, discarding a signal segment to be processed that includes only white noise, and the like.
Specifically, the input terminal of the noise reduction filter circuit is directly connected to the output terminal of the acquisition component 11. The awakening processor 12 is connected with the noise reduction filter circuit and the output end of the acquisition component 11; one working end of the control switch 15 is connected with the acquisition component 11 through a noise reduction filter circuit.
In some applications provided in the first embodiment, the wake-up processor 12 may also function to wake up or shut down the main processor 13, specifically: in case the signal to be processed comprises a wake-up instruction, the wake-up processor 12 wakes up the main processor 13; in case the standby processor contains a sleep instruction, the wake-up processor 12 controls the main processor 13 to enter a sleep state. Thus, if the intelligent interactive device is in a sleep state, the main processor 13 may be turned off so that the main processor 13 is in a non-power consuming or low power consuming state.
Example two
Fig. 4 is a schematic structural diagram of the intelligent interaction device provided in the second embodiment. As shown in fig. 4, the intelligent interaction device provided in the second embodiment includes a first acquisition component 16, a second acquisition component 17, a wake-up processor 12, a main processor 13, and a communication module 14.
The first acquisition component 16 is used for converting the acquired environmental signal into a first signal to be processed; the second acquisition component 17 is used for converting the acquired environmental signal into a second signal to be processed.
When the intelligent interactive device provided by the second embodiment is applied as a product, the first collecting component 16 and the second collecting component 17 may be components having the same working principle or different working principles.
For example, in case the smart interactive device is a smart sound box, the first collecting element 16 and the second collecting element 17 may both be sound pick-ups.
For another example, in the case that the intelligent interactive device is a multimedia interactive device, the first collecting component 16 is a sound pickup, and the second collecting component 17 is an image sensor; alternatively, the first pickup part 16 is an image sensor, and the second pickup part 17 is a sound pickup.
In the intelligent interactive device provided in the second embodiment, the function of the wake-up processor 12 is similar to that of the intelligent interactive device provided in the first embodiment, and is used for analyzing and processing the first signal to be processed; specifically, the functions of the wake-up processor 12 mainly include: (1) performing data processing on the first signal to be processed to acquire instruction information in the first signal to be processed; namely, performing instruction identification on the first signal to be processed; (2) and under the condition that the signal to be processed contains the awakening instruction, controlling the second acquisition part 17 to be electrified and operated.
The input end of the main processor 13 is connected to the output end of the second acquisition unit 17, and is configured to identify the second signal to be processed, and communicate with the remote server through the communication module 14. In particular, the functions that the main processor 13 may perform may include: (1) analyzing and processing the second signal to be processed to obtain natural language information contained in the second signal to be processed; (2) executing some operation instructions corresponding to natural language information which can determine contents; (3) some natural language information is sent to a remote server (or a remote cloud) through the communication module 14, and a processing result returned by the remote server is received, and a corresponding operation instruction is generated according to the processing result.
Of course, similar to the intelligent interaction device provided in the first embodiment, the intelligent interaction device provided in the second embodiment may also include an output component such as a speaker or a display. Similar to the embodiment, the wake-up processor 12 is a processor functionally independent of the main processor 13, as will be described in detail below.
Wake-up processor 12 is a processor that functions independently of main processor 13; under the normal application condition, the wake-up processor 12 cannot be controlled by the programmed instruction loaded by the main processor 13, and cannot communicate with the remote server through the communication module 14, and only loads the stored specific data processing algorithm when the intelligent interactive device is powered on, performs instruction identification on the first signal to be processed, determines whether the first signal to be processed contains the wake-up instruction, and controls the power-on operation of the second acquisition component 17 when the signal to be processed contains the wake-up instruction.
The main processor 13 may be a central processor with a structure similar to that of an existing intelligent interaction device, and may process the second signal to be processed by loading a programmed instruction, and may communicate with the remote server through the communication module 14, and generate a corresponding operation instruction according to a processing result returned by the remote server.
As can be seen from the foregoing structural and functional description, in the intelligent interaction device provided in the second embodiment, after the wake-up processor 12 recognizes that the first to-be-processed signal includes the wake-up instruction, it only enables the second acquisition component 17 to be powered on, so that the main processor 13 can obtain the second to-be-processed signal generated by the second acquisition component 17 processing the environment signal.
Since the wake-up processor 12 functions independently of the main processor 13, its functions are not affected by programmed instructions loaded in the main processor 13 and do not communicate with a remote server through the communication module 14, and thus there is no problem of being controlled by a remote illegal server.
Under normal working conditions, the wake-up processor 12 will control the second collecting unit 17 connected to the main processor 13 to power up only when a specific environment signal appears in the environment where the intelligent interactive device is located (i.e. an instruction signal for the user to wake up the intelligent interactive device).
Even if the programmed instruction loaded by the main processor 13 in the intelligent interactive device is tampered by the remote illegal server, the main processor 13 cannot acquire the second signal to be processed containing the user information without the wake-up processor 12 receiving the wake-up instruction, and thus cannot illegally monitor the user at this time.
By adopting the intelligent interaction device provided by the second embodiment, the possibility of illegally monitoring the user by using the intelligent interaction device can be avoided in a manner of cutting off a data source, so that the problem of privacy disclosure of the user under a specific working state of the intelligent interaction device can be avoided.
As in the first embodiment, it is explicitly mentioned that the wake-up processor 12 and the main processor 13 are two functionally independent processors, that is to say that they are physically two separate processors (or two independent chips); in some intelligent interaction devices, for example, in the case where the intelligent interaction device employs a dedicated processing chip, the wake-up processor 12 and the main processor 13 may be integrated into one chip.
Of course, as in the first embodiment, the intelligent interactive device provided in the second embodiment preferably uses two chips as the wake-up processor 12 and the main processor 13. In practical applications, the chip used by the wake-up processor 12 may be a DSP chip or an FPGA chip, or may be a chip type available in the field, such as a chip of the aforementioned central processor architecture. A dedicated data processing chip such as a DSP is preferably employed in view of the functional specialization of the wake-up processor 12, only for the purpose of performing specific processing and instruction recognition on the signal to be processed.
Fig. 5 is a schematic diagram of the intelligent interaction device provided in the second embodiment after the structure is refined. Referring to fig. 4, in a second embodiment, the intelligent interactive device may include a control switch 15 to control the operating state of the second collecting unit 17.
The control switch 15 comprises a control end and a working end; wherein, the control end of the control switch 15 is connected with the output end of the wake-up processor 12, and the working end of the control switch 15 is connected with the second collecting component 17 in series. The wake-up processor 12 controls whether the second collecting unit 17 is powered on to operate by controlling the operating state of the control switch 15, and then controls whether the main processor 13 can receive the second signal to be processed.
Also similar to the first embodiment, the control switch 15 may be a relay switch used in a conventional circuit, or may be a switch circuit having a relay control function formed of transistors used in an integrated circuit.
Fig. 5 shows the control switch 15 and wake-up processor 12 as two functionally independent components; in practice, the control switch 15 may be integrated with the wake-up processor 12 in one chip, which only provides pins for connection to external components.
In a specific application of the intelligent interactive device provided in the second embodiment, the wake-up processor 12 is further configured to control the second acquiring unit 17 to stop working when the first signal to be processed includes the sleep instruction, so that the main processor 13 cannot acquire the second signal to be processed including the user information any more. In the case of including the control switch 15, the wake-up processor 12 controls the switch-off of the working terminal of the control switch 15 to power-off and stop the second collecting part 17, thereby implementing the aforementioned functions.
In addition, in the intelligent interaction device provided in the second embodiment, the wake-up processor 12 may further have the following functions: (1) in case the first signal to be processed contains a wake-up instruction, waking up the main processor 13; (2) in the case where the first signal to be processed contains a sleep instruction, the main processor 13 is controlled to enter a sleep state.
Thus, if the intelligent interactive device is in a sleep state, the main processor 13 may be turned off so that the main processor 13 is in a non-power consuming or low power consuming state. In practical applications, the wake-up processor 12 may control whether the main processor 13 is in the wake-up state or the sleep state by controlling the power on and off of the main processor 13.
Similar to the first embodiment, the second embodiment provides the intelligent interaction device further comprising a noise reduction filter circuit; the noise reduction filter circuit is used for preprocessing the signals to be processed acquired by the acquisition components (the first acquisition component 16 and the second acquisition component 17), wherein the preprocessing includes improving the signal-to-noise ratio, discarding the signal segments to be processed including only white noise, and the like.
The awakening processor 12 is connected with the output end of the first acquisition component 16 through a noise reduction filter circuit; the input end of the main processor 13 is connected with the output end of the second acquisition component 17 through a noise reduction filter circuit.
In some applications, the number of noise reduction filter circuits may be two, one of which is provided between the first acquisition component 16 and the wake-up processing component and dedicated to processing the first signal to be processed, and the other of which is provided between the second acquisition component 17 and the main processor 13 and dedicated to processing the second signal to be processed.
In other applications, the noise reduction filter circuit may be only one, and a corresponding switching sub-circuit is provided: when the noise reduction filter circuit receives the first signal to be processed acquired by the first acquisition component 16, the processed first signal to be processed is sent to the wake-up processor 12; when the noise reduction filter circuit receives the second signal to be processed acquired by the second acquisition component 17, the processed second signal to be processed is sent to the main processor 13.
EXAMPLE III
Fig. 6 is a schematic structural diagram of an intelligent interaction device provided in the third embodiment. As shown in fig. 6, the intelligent interaction device provided in the third embodiment also includes a first acquisition component 16, a second acquisition component 17, a wake-up processor 12, a main processor 13, and a communication module 14.
In the intelligent interaction device provided in the third embodiment, the functions of the main processor 13 and the communication module 14 are the same as those of the second embodiment, and are not repeated here; only the structure in the third embodiment different from that in the second embodiment will be described below.
In the intelligent interactive device provided in the third embodiment, the first collecting component 16 is configured to convert the collected environment signal into a first signal to be processed during power-on operation, and the second collecting component 17 is configured to convert the collected environment signal into a second signal to be processed during power-on operation.
However, the first acquisition part 16 and the second acquisition part 17 may differ in acquisition accuracy, the number of actual sensors. For example, in the case where the smart interactive apparatus is a microphone, the first collecting part 16 may be only one microphone, and the second collecting part 17 is a microphone array composed of a plurality of microphones; compared with the first collection component 16, the second collection component 17 has higher collection precision for the environment signal, and obtains a processed far-field signal (the sound signal can be collected more accurately even if the user is far away from the intelligent interaction device).
In a specific application, a user may wake up the smart interactive device when the user is close to the smart interactive device, and may move to a distant location during an interactive process.
Similar to the second embodiment, in the third embodiment, the wake-up processor 12 is configured to perform instruction identification on the first signal to be processed, and control the second collecting unit 17 to be powered on and operated when the first signal to be processed includes a wake-up instruction;
the input end of the main processor 13 is connected to the second acquisition unit 17, and is configured to identify the second signal to be processed, and communicate with the remote server through the communication module 14.
In addition, under the condition that the first signal to be processed contains the wake-up instruction, the input end of the wake-up processor 12 is switched to be connected with the output end of the second acquisition component 17 to process the second signal to be processed; subsequently, the wake-up processor 12 is further configured to control the second collecting element 17 to stop operating when the second signal to be processed includes a sleep instruction, so that the input of the wake-up processor 12 is switched to the output of the first collecting element 16.
The wake-up processor 12 switches its input from the connection with the first acquisition component 16 to the connection with the output of the second acquisition component 17 after controlling the second acquisition component 17 to be powered on (at this time, the first acquisition component 16 may be in a power-off state; after determining that the second signal to be processed includes a sleep command, the wake-up processor 12 further controls the second acquisition component 17 to stop working, so that the input of the wake-up processor 12 is switched to be connected with the output of the first acquisition component 16 (at this time, the first acquisition component 16 may be powered on again).
By adopting the structure, under the condition that the user is far away from the intelligent interaction device, the sent signal containing the sleep control instruction information can be transmitted to the awakening processor 12 after being acquired by the second acquisition part 17, and the awakening processor 12 is utilized to control the second acquisition part 17 to stop working.
In specific application, the wake-up processor 12 may control whether the first collecting component 16 and the second collecting component 17 are powered on to work through the control switch 15, and control the input end of the wake-up processor to be connected with the first collecting component 16 or the second collecting component 17 through the control switch 15; the specific type of control switch 15 is as in example two.
In addition, other structures of the intelligent interaction device provided by the third embodiment are similar to those of the second embodiment, and in the case that the control logic does not conflict with the foregoing, the corresponding structures can refer to the second embodiment, and are not expanded here.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method embodiment, and is not described herein again.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the invention. For example, the above features may be interchanged with other features disclosed in this application, but not limited to those having similar functions.
Claims (10)
1. The intelligent interaction device is characterized by comprising an acquisition component, a wake-up processor, a main processor and a communication module;
the acquisition component is used for converting the acquired environmental signals into signals to be processed;
the wake-up processor is used for performing instruction identification on a signal to be processed;
the wake-up processor is further used for controlling the signals to be processed to be transmitted to the main processor under the condition that the signals to be processed contain the wake-up instruction; and the number of the first and second groups,
blocking the transmission of the signal to be processed to the main processor under the condition that the signal to be processed contains a sleep instruction;
the main processor is used for carrying out subsequent processing on the signal to be processed and communicating with the remote server through the communication module.
2. The intelligent interaction device of claim 1, wherein:
the intelligent interaction equipment comprises a control switch;
the control end of the control switch is connected with the output end of the awakening processor;
two working ends of the control switch are respectively connected with the output end of the acquisition component and the input end of the main processor;
and the awakening processor controls whether to transmit a signal to be processed to the main processor or not by controlling the working state of the control switch.
3. The intelligent interaction device of claim 2, wherein:
the intelligent interaction device comprises a noise reduction filter circuit; the input end of the noise reduction filter circuit is connected with the output end of the acquisition component;
the input of awakening processor with the output of collection part is connected, includes: the awakening processor is connected with the output end of the acquisition component through the noise reduction filter circuit;
two working ends of the control switch are respectively connected with the output end of the acquisition component and the input end of the main processor, and the control switch comprises: one working end of the control switch is connected with the acquisition component through the noise reduction filter circuit, and the other working end of the control switch is connected with the main processor.
4. The intelligent interactive device of claim 1, wherein the wake-up processor is further configured to:
awakening the main processor under the condition that the signal to be processed contains an awakening instruction; and the number of the first and second groups,
and controlling the main processor to enter a sleep state under the condition that the signal to be processed contains a sleep instruction.
5. The intelligent interaction device is characterized by comprising a first acquisition component, a second acquisition component, a wake-up processor, a main processor and a communication module;
the first acquisition component is used for converting the acquired environment signal into a first signal to be processed;
the second acquisition component is used for converting the acquired environment signal into a second signal to be processed;
the wake-up processor is used for carrying out instruction identification on the first signal to be processed;
the wake-up processor is further used for controlling the second acquisition component to be powered on to work under the condition that the first signal to be processed contains a wake-up instruction;
the main processor is used for processing the second signal to be processed and communicating with a remote server through the communication module.
6. The intelligent interaction device of claim 5, wherein:
the wake-up processor is further used for controlling the second acquisition part to stop working under the condition that the first signal to be processed contains a sleep instruction.
7. The intelligent interaction device of claim 5 or 6, wherein:
the intelligent interaction equipment comprises a control switch;
the control end of the control switch is connected with the output end of the awakening processor, and the working end of the control switch is connected with the component to be acquired in series;
and the awakening processor controls whether the second acquisition component is electrified to work or not by controlling the working state of the control switch.
8. The intelligent interactive device of claim 7, wherein the wake-up processor is further configured to:
when the first signal to be processed contains a wake-up instruction, waking up the main processor; and the number of the first and second groups,
and controlling the main processor to enter a sleep state under the condition that the first signal to be processed contains a sleep instruction.
9. The intelligent interaction device of claim 7, wherein:
the intelligent interaction device comprises a noise reduction filter circuit;
the input of awakening processor is connected with the output of first acquisition component, including: the input end of the awakening processor is connected with the output end of the first acquisition component through the noise reduction filter circuit;
the input end of the main processor is connected with the output end of the second acquisition component, and the method comprises the following steps: the input end of the main processor is connected with the output end of the second acquisition component through the noise reduction filter circuit.
10. The intelligent interaction device of claim 5, wherein:
under the condition that the first signal to be processed contains a wake-up instruction, the input end of the wake-up processor is switched to be connected with the output end of the second acquisition component and is used for processing a second signal to be processed;
and the awakening processor is also used for controlling the second acquisition component to stop working and switching the input end of the awakening processor to be connected with the output end of the first acquisition component under the condition that the second signal to be processed contains a sleep instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910573493.0A CN112233677A (en) | 2019-06-28 | 2019-06-28 | Intelligent interaction equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910573493.0A CN112233677A (en) | 2019-06-28 | 2019-06-28 | Intelligent interaction equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112233677A true CN112233677A (en) | 2021-01-15 |
Family
ID=74111587
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910573493.0A Pending CN112233677A (en) | 2019-06-28 | 2019-06-28 | Intelligent interaction equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112233677A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112151023A (en) * | 2019-06-28 | 2020-12-29 | 北京奇虎科技有限公司 | Device for avoiding illegal information acquisition of intelligent interaction equipment |
| CN112882759A (en) * | 2021-02-10 | 2021-06-01 | 联想(北京)有限公司 | Control method and device and electronic equipment |
| CN114285892A (en) * | 2021-08-26 | 2022-04-05 | 海信视像科技股份有限公司 | Server, intelligent device and method for awakening intelligent device with screen |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104346482A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Acquisition method and electronic equipment |
| CN104603716A (en) * | 2012-08-27 | 2015-05-06 | 三星电子株式会社 | An apparatus and method for waking up a processor |
| CN104866067A (en) * | 2015-05-11 | 2015-08-26 | 联想(北京)有限公司 | Low power consumption control method and electronic device |
| CN106200853A (en) * | 2016-07-02 | 2016-12-07 | 上海与德通讯技术有限公司 | A kind of wake-up circuit and awakening method |
| CN108877805A (en) * | 2018-06-29 | 2018-11-23 | 上海与德通讯技术有限公司 | Speech processes mould group and terminal with phonetic function |
| CN109473110A (en) * | 2018-12-29 | 2019-03-15 | 深圳市慧声信息科技有限公司 | It is a kind of to prevent method, apparatus, system and application method of the interactive voice equipment by false wake-up |
-
2019
- 2019-06-28 CN CN201910573493.0A patent/CN112233677A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104603716A (en) * | 2012-08-27 | 2015-05-06 | 三星电子株式会社 | An apparatus and method for waking up a processor |
| CN104346482A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Acquisition method and electronic equipment |
| CN104866067A (en) * | 2015-05-11 | 2015-08-26 | 联想(北京)有限公司 | Low power consumption control method and electronic device |
| CN106200853A (en) * | 2016-07-02 | 2016-12-07 | 上海与德通讯技术有限公司 | A kind of wake-up circuit and awakening method |
| CN108877805A (en) * | 2018-06-29 | 2018-11-23 | 上海与德通讯技术有限公司 | Speech processes mould group and terminal with phonetic function |
| CN109473110A (en) * | 2018-12-29 | 2019-03-15 | 深圳市慧声信息科技有限公司 | It is a kind of to prevent method, apparatus, system and application method of the interactive voice equipment by false wake-up |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112151023A (en) * | 2019-06-28 | 2020-12-29 | 北京奇虎科技有限公司 | Device for avoiding illegal information acquisition of intelligent interaction equipment |
| CN112882759A (en) * | 2021-02-10 | 2021-06-01 | 联想(北京)有限公司 | Control method and device and electronic equipment |
| CN114285892A (en) * | 2021-08-26 | 2022-04-05 | 海信视像科技股份有限公司 | Server, intelligent device and method for awakening intelligent device with screen |
| CN114285892B (en) * | 2021-08-26 | 2023-10-31 | 海信视像科技股份有限公司 | Server, intelligent device and awakening method of intelligent device with screen |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10720158B2 (en) | Low power detection of a voice control activation phrase | |
| CN104252860B (en) | Speech recognition | |
| US20170194001A1 (en) | Microphone circuit assembly and system with speech recognition | |
| CN107591155B (en) | Voice recognition method and device, terminal and computer readable storage medium | |
| CN112233677A (en) | Intelligent interaction equipment | |
| EP2788978B1 (en) | Low power integrated circuit to analyze a digitized audio stream | |
| US20160086603A1 (en) | Power-Efficient Voice Activation | |
| KR20190111624A (en) | Electronic device and method for providing voice recognition control thereof | |
| US11605372B2 (en) | Time-based frequency tuning of analog-to-information feature extraction | |
| EP3185521B1 (en) | Voice wake-up method and device | |
| US9799337B2 (en) | Microphone apparatus for enhancing power conservation | |
| EP3851952A2 (en) | Signal processing method, signal processing device, and electronic device | |
| US20210110837A1 (en) | Electronic device supporting improved speech recognition | |
| US20220044670A1 (en) | Electronic device for performing voice recognition using microphones selected on basis of operation state, and operation method of same | |
| KR20200045851A (en) | Electronic Device and System which provides Service based on Voice recognition | |
| CN111755002A (en) | Speech recognition device, electronic apparatus, and speech recognition method | |
| CN111128201A (en) | Interaction method, device, system, electronic equipment and storage medium | |
| CN112423176A (en) | Earphone noise reduction method and device, storage medium and noise reduction earphone | |
| CN111147530B (en) | System, switching method, intelligent terminal and storage medium of multi-voice platform | |
| CN116705033A (en) | System on chip for wireless intelligent audio equipment and wireless processing method | |
| CN111045641B (en) | Electronic terminal and voice recognition method | |
| CN111028832B (en) | Microphone mute mode control method and device, storage medium and electronic equipment | |
| CN109346067B (en) | Voice information processing method and device and storage medium | |
| CN110718215A (en) | Terminal control method and device and terminal | |
| CN113961265A (en) | Intelligent terminal, operation control method and system thereof, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |