WO2023184535A1 - 语音交互系统及方法、智能设备 - Google Patents
语音交互系统及方法、智能设备 Download PDFInfo
- Publication number
- WO2023184535A1 WO2023184535A1 PCT/CN2022/085051 CN2022085051W WO2023184535A1 WO 2023184535 A1 WO2023184535 A1 WO 2023184535A1 CN 2022085051 W CN2022085051 W CN 2022085051W WO 2023184535 A1 WO2023184535 A1 WO 2023184535A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- voice interaction
- unit
- voice
- instruction
- interaction unit
- Prior art date
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 256
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000009471 action Effects 0.000 claims abstract description 10
- 230000006698 induction Effects 0.000 claims description 48
- 230000000875 corresponding effect Effects 0.000 claims description 18
- 238000001746 injection moulding Methods 0.000 claims description 16
- 230000008054 signal transmission Effects 0.000 claims description 15
- 239000012778 molding material Substances 0.000 claims description 9
- 239000000463 material Substances 0.000 claims description 8
- 238000002834 transmittance Methods 0.000 claims description 7
- 230000001276 controlling effect Effects 0.000 claims description 6
- 229920000122 acrylonitrile butadiene styrene Polymers 0.000 claims description 4
- 239000002245 particle Substances 0.000 claims description 4
- XECAHXYUAAWDEL-UHFFFAOYSA-N acrylonitrile butadiene styrene Chemical compound C=CC=C.C=CC#N.C=CC1=CC=CC=C1 XECAHXYUAAWDEL-UHFFFAOYSA-N 0.000 claims description 3
- 239000004676 acrylonitrile butadiene styrene Substances 0.000 claims description 3
- 239000004033 plastic Substances 0.000 claims description 3
- 229920003023 plastic Polymers 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 12
- 239000000243 solution Substances 0.000 description 9
- 230000008569 process Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000002347 injection Methods 0.000 description 3
- 239000007924 injection Substances 0.000 description 3
- 238000007789 sealing Methods 0.000 description 3
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 239000000565 sealant Substances 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- 239000004594 Masterbatch (MB) Substances 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 235000021443 coca cola Nutrition 0.000 description 1
- 238000002788 crimping Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000007591 painting process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000036581 peripheral resistance Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 238000007650 screen-printing Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Definitions
- the present disclosure relates to the technical field of smart devices, and in particular, to a voice interaction system and method, and smart devices.
- Speech recognition technology is a technology with rich application scenarios in the Internet of Things, and the microphone, as a signal collection device for speech recognition technology, affects the ability of speech recognition.
- Embodiments of the present disclosure provide a voice interaction system and method, and an intelligent device, which can realize body sensing to open the intelligent voice speaker and interact with the entire intelligent device, and can effectively prevent the omission of effective voice commands and improve the intelligence of the voice interaction system. degree of ization.
- Embodiments of the present disclosure provide a voice interaction system, including:
- the voice interaction unit is used to collect and recognize the user's target voice instructions
- Photoelectric induction unit the photoelectric induction unit is connected to the voice interaction unit, used to receive and identify the user's target limb instructions, and control the switch of the voice interaction unit according to the target limb instructions;
- An instruction control unit which is connected to the voice interaction unit and is used to determine whether the voice interaction unit is in an open state; if so, determine whether the voice interaction unit receives the target voice instruction within a predetermined time.
- the voice interaction unit receives and recognizes the user's target voice command, and controls the smart device to perform actions corresponding to the target voice command; if the target voice command is not received within the predetermined time, When receiving a voice command, a standby command is sent to the voice interaction unit.
- the instruction control unit is also configured to identify whether the voice interaction unit receives a voice instruction within the predetermined standby time; if not, send a first shutdown instruction to the voice interaction unit.
- the photoelectric sensing unit includes a photoelectric sensor, and the photoelectric sensor is a laser distance sensor.
- the sensing distance of the laser distance sensor is 80 to 150 mm.
- the photoelectric sensing unit is provided with an indicator light, and the indicator light includes a first color indicator light and a second color indicator light;
- the voice interaction unit is also configured to: when receiving the first closing instruction, send a second closing instruction to the photoelectric sensing unit;
- the photoelectric sensing unit is also configured to light up the first color indicator light when receiving the second closing instruction or a closing operation from the user; and to light up the first color indicator light when receiving the first opening instruction or an opening operation from the user. Turn on the second color indicator light.
- the photoelectric sensing unit includes:
- Shell the inside of the shell is hollow, the shell includes a front end and a rear end, the end face of the front end is provided with an indicator mark, and the rear end is open;
- a photoelectric sensor arranged in the housing
- An indicator light provided in the housing
- Signal transmission wire harness one end of the signal transmission wire harness is connected to the circuit board, and the other end extends out of the back cover.
- the indicator mark includes an engraved hollow mark, and the end surface of the front end is a black silk screen area except for the engraved hollow mark, and the black silk screen area is around the edges of the end face of the front end. Has a blank area.
- the outer shell adopts a light-transmissive injection molding shell
- the material of the light-transmitting injection molding shell is a mixed material of an injection molding material with a light transmittance greater than a predetermined threshold and color master particles.
- the injection molding material is acrylonitrile-butadiene-styrene plastic.
- a light guide strip is provided inside the housing and around the end surface of the front end.
- the indicator lights include at least two first color indicator lights and at least two second color indicator lights, wherein the at least two first color indicator lights are respectively located on opposite sides of the end surface of the front end, At least two second color indicator lights are respectively located on opposite sides of the end surface of the front end.
- the voice interaction system further includes an image acquisition unit, and the instruction control unit is connected to the image acquisition unit for receiving and identifying the image data collected by the image acquisition unit, and when the image data includes a target When making a gesture, send a first opening instruction to the voice interaction unit;
- the voice interaction unit is also configured to send a second opening instruction to the photoelectric sensing unit when receiving the first opening instruction.
- the voice interaction unit and the instruction control unit communicate through serial port instructions
- the voice interaction unit and the instruction control unit communicate through serial port instructions.
- the front end is provided with a first through hole and a second through hole;
- the photoelectric sensor is provided with a receiving electrode and an emitter, the receiving electrode is located at the first through hole, and the emitter is Located at the second through hole.
- An embodiment of the present disclosure also provides a voice interaction method, which is applied to the voice interaction system of the embodiment of the present disclosure.
- the method includes:
- the voice interaction unit determines whether the voice interaction unit receives the target voice command within the predetermined time. If the target voice command is received within the predetermined time, the voice interaction unit receives and recognizes the user's target voice command, and controls the smart phone. The device performs actions corresponding to the target voice command; if no voice command is received within the predetermined time, sends a standby command to the voice interaction unit;
- control the voice interaction unit to turn on based on the user's target limb command received and recognized by the photoelectric sensing unit, and control the smart device to execute the target voice command based on the user's target voice command received and recognized by the voice interaction unit. corresponding action.
- the method further includes: when the voice interaction unit is in an on state, determining whether the voice interaction unit receives a voice command within the predetermined standby time; if not, controlling the voice interaction unit to turn off.
- the method further includes: when the voice interaction unit is in an on state, determining whether the voice interaction unit receives a voice command within a predetermined time; if not, controlling the photoelectric sensing unit to turn off.
- the photoelectric sensing unit when the photoelectric sensing unit receives the second closing instruction or the closing operation from the user, it lights up the first color indicator light; when it receives the first opening instruction or the opening operation from the user, it lights up the third color indicator light. Two color indicator lights.
- the method further includes:
- the photoelectric sensing unit and the voice interaction unit are controlled to be turned on.
- An embodiment of the present disclosure also provides an intelligent device, on which the voice interaction system provided by the embodiment of the present disclosure is provided.
- the voice interaction system, method, and smart device combine a voice interaction unit and a photoelectric induction unit.
- the voice interaction unit can collect and identify the user's target voice instructions, and the photoelectric induction unit can receive and identify the user.
- the target body command controls the switch of the voice interaction unit.
- the command control unit determines whether the voice interaction unit is turned on. When it is turned on, the smart device can be controlled to perform corresponding actions according to the target voice command.
- the switch of the voice interaction unit can be controlled through body movements.
- the photoelectric induction unit controls the opening of the voice interaction unit and the instruction control unit to switch the voice interaction unit and the photoelectric induction unit; and the instruction control unit can also determine that the voice interaction unit is not within the predetermined time.
- the voice interaction unit is controlled to standby instead of directly controlling the voice interaction unit to shut down immediately. This can avoid the problem of missing effective voice commands that may be caused by the voice interaction unit shutting down immediately when the user has no voice or a voice recognition error occurs in a short period of time. , improve the intelligence of voice interaction.
- Figure 1 shows a structural block diagram of a voice interaction system provided in an embodiment of the present disclosure
- Figure 2 shows a logical block diagram of the voice interaction system provided in an embodiment of the present disclosure
- Figure 3 is a schematic diagram of the communication method between the command control unit, voice interaction unit and photoelectric induction unit;
- Figure 4 is a schematic structural diagram of a photoelectric sensing unit in an embodiment of the present disclosure.
- Figure 5 shows a schematic structural diagram of the front end of the housing of the photoelectric induction unit in an embodiment of the present disclosure
- Figure 6 shows the arrangement position relationship diagram of the light source, light guide strip and photoelectric sensing unit in the photoelectric sensing unit in the embodiment of the present disclosure
- FIG. 7 shows an exploded view of the structure of the microphone module in the embodiment of the present disclosure.
- the voice interaction system provided by the embodiments of the present disclosure can be applied to various smart devices, such as smart refrigerators, smart washing machines, smart TVs, etc.
- Figure 1 shows a structural block diagram of the voice interaction system provided in an embodiment of the present disclosure
- Figure 2 shows a logical block diagram of the voice interaction system provided in an embodiment of the present disclosure.
- a voice interaction system for smart devices provided by embodiments of the present disclosure includes:
- the voice interaction unit 100 is used to collect and recognize the user's target voice instructions
- Photoelectric induction unit 200 the photoelectric induction unit 200 is connected to the voice interaction unit 100, used to receive and identify the user's target limb instructions, and control the switch of the voice interaction unit 100 according to the target limb instructions;
- Instruction control unit 300 the instruction control unit 300 is connected to the voice interaction unit 100, and is used to determine whether the voice interaction unit 100 is in an on state; if so, determine whether the voice interaction unit 100 receives the target voice within a predetermined time. instructions, where,
- the voice interaction unit 100 receives and recognizes the user's target voice command, and controls the smart device to perform actions corresponding to the target voice command; if within the predetermined time When no voice command is received, a standby command is sent to the voice interaction unit 100 .
- the voice interaction unit 100 and the photoelectric induction unit 200 are combined together.
- the voice interaction unit 100 can collect and identify the user's target voice instructions, and the photoelectric induction unit 200 can receive and identify the user's target body instructions to control the voice interaction.
- the instruction control unit 300 determines whether the voice interaction unit 100 is turned on.
- the smart device can be controlled to perform corresponding actions according to the target voice command.
- the switch of the voice interaction unit 100 can be controlled through body movements to achieve integration with the entire machine.
- the photoelectric induction unit 200 controls the voice interaction unit 100 to open and the instruction control unit 300 to switch the voice interaction unit 100 and the photoelectric induction unit 200 on and off; and the instruction control unit 300 can also determine that the voice interaction unit 100 is not present.
- the voice interaction unit 100 is controlled to standby, instead of directly controlling the voice interaction unit 100 to be turned off immediately. This can avoid the possibility of the voice interaction unit 100 being turned off immediately when the user has no voice or a voice recognition error occurs within a short period of time. solve the problem of missing effective voice commands and improve the intelligence of voice interaction.
- the instruction control unit 300 is also configured to identify whether the voice interaction unit 100 receives a voice instruction within the predetermined standby time; if not, send a first shutdown instruction to the voice interaction unit 100 .
- the standby time can be set, such as 30 seconds, and the voice interaction unit 100 will be turned off when no valid voice command is recognized during the standby time. In this way, while saving energy consumption, the voice interaction unit 100 will not be shut down immediately without receiving a voice command within a short period of time, thus preventing the collection of valid voice from being missed.
- the voice interaction unit 100 Immediate shutdown will miss the collection of valid voice; and, when no voice command is recognized within the predetermined standby time, the voice interaction unit 100 is closed, which can effectively prevent the collection of sounds such as non-voice commands and protect user privacy.
- the photoelectric sensing unit 200 is provided with an indicator light, which may include a first color indicator light 410 and a second color indicator light 420; the voice interaction unit 100 is also used to: When receiving the first closing instruction, send the second closing instruction to the photoelectric sensing unit 200;
- the photoelectric sensing unit 200 is also configured to light the first color indicator light 410 and turn off the second color indicator light 420 when receiving the second shutdown instruction or a shutdown operation from the user;
- the voice interaction unit 100 sends a first opening instruction or a user performs an opening operation, the second color indicator light 420 is turned on and the first color indicator light 410 is turned off.
- the photoelectric sensing unit 200 can be closed when receiving the first closing command, and can realize the automatic opening or closing function when receiving the first opening command.
- the photoelectric sensing unit 200 may also be provided with an operable switch or a touchable display screen, and the user can turn on or off or operate the operable switch or the touchable display screen to realize the opening or closing of the photoelectric sensing unit 200. closure.
- the photoelectric induction unit 200 can be provided in the photoelectric induction unit 200 to achieve the purpose of the photoelectric induction unit 200 indicating through different color indicator lights in different working states.
- the first color indicator light The colors that the second color indicator light 410 and the second color indicator light 420 can emit are different, and the specific colors are not limited.
- the first color indicator light 410 may be a light-emitting diode capable of emitting green light
- the second color indicator light 420 may be a light-emitting diode capable of emitting white light.
- the instruction control unit 300 autonomously sends an opening instruction to the voice interaction unit 100, and the voice The interactive unit 100 begins to receive voice commands and sends audio data to the command control unit 300.
- the voice interactive unit 100 sends a turn-on command to the photoelectric induction unit 200.
- the second color indicator light 420 of the photoelectric induction unit 200 goes out, and the first color indicator light 410 lights up.
- the voice interaction unit 100 receives the closing instruction, the second color indicator light 420 lights up and the first color indicator light 410 goes out.
- the second color indicator light lights up when the photoelectric induction unit 200 is not working. In this way, in outdoor use scenarios, the second color indicator light is in a lit state, making it easier for consumers to find the location and perform operations.
- the user turns on the photoelectric induction unit 200 through physical instructions such as waving and other body movements.
- the photoelectric induction unit 200 receives information
- the first color indicator light 410 lights up
- the second color indicator light 420 indicates that the photoelectric induction unit 200 Enter the working state and wake up the voice interaction unit to record.
- the voice interaction system further includes an image acquisition unit 400 , the instruction control unit 300 is connected to the image acquisition unit 400 , and the instruction control unit 300 is also configured to receive and identify the information generated by the image acquisition unit 400 .
- the collected image data and when the image data includes a target gesture, send a first opening instruction to the voice interaction unit 100; the voice interaction unit 100 is also configured to send a first opening instruction to the voice interaction unit 100 when receiving the first opening instruction.
- the photoelectric sensing unit 200 sends a second opening command.
- the voice interaction unit 100 may include a microphone module (MIC) or the like.
- the voice interaction unit 100 has different requirements for sound quality according to different usage environments, so different models of COMS silicon microphones can be selected, and microphone modules with different numbers of COMS silicon microphones can be designed.
- the way to collect and recognize the user's target voice command may be to turn on the microphone module, record and form an audio file, and send the audio file to the command control unit 300 .
- the instruction control unit 300 may be a computer, an MCU (Micro Control Unit), etc., for example, the instruction control unit 300 may be a host (PC) of an intelligent device.
- MCU Micro Control Unit
- PC host
- the voice interaction unit 100 and the instruction control unit 300 communicate through serial port instructions, and the voice interaction unit 100 and the instruction control unit 300 communicate through serial port instructions. Communicate.
- voice interaction unit 100 The specific structures of the voice interaction unit 100 , the photoelectric sensing unit 200 and the command control unit 300 will be further described later.
- voice interaction implementation process of the voice interaction system will be explained in more detail below.
- the voice interaction method of the voice interaction system of the smart device may include the following process:
- the user opens the voice interaction unit 100 autonomously (the user can directly perform an operation to open the voice interaction unit 100 on the voice interaction unit 100, or the user opens the voice interaction unit 100 through physical instructions such as waving a hand), the instruction
- the control unit 300 receives the target voice command sent by the voice interaction unit 100, and controls the smart device to perform actions corresponding to the target voice command according to the voice interaction unit 100 receiving and recognizing the user's target voice command to achieve voice interaction.
- the process is sequence number B ⁇ sequence number C.
- the smart device is a smart refrigerator and the voice interaction unit 100 is a microphone
- the voice interaction unit 100 is a microphone
- the smart refrigerator will perform the corresponding action according to the voice command, for example,
- the command control unit 300 in the smart refrigerator door will send the designated goods to the shipping port according to the customer's specified needs, so that the user can take away the designated goods.
- the instruction control unit 300 determines whether the voice interaction unit 100 receives a voice instruction within a predetermined time; if not, sends a standby instruction to the voice interaction unit 100 , the voice interaction unit 100 does not receive the voice instruction within the predetermined standby time, and the instruction control unit 300 sends a closing instruction to the voice interaction unit 100;
- the instruction control unit 300 detects that the voice interaction unit 100 does not collect voice within the predetermined standby time, the instruction control unit 300 will send a shutdown instruction to the voice interaction unit 100 ( Serial number 2), the voice interaction unit 100 stops recording and will no longer send voice commands to the command control unit 300 (serial number 3). At the same time, the voice interaction unit 100 sends a close command (serial number 4) to the photoelectric sensing unit 200, and the photoelectric sensing unit 200 Off, the second color indicator light 420 is on, and the first color indicator light 410 is off.
- the voice interaction unit 100 does not receive a voice command, it first waits for a certain period of time.
- the voice interaction unit 100 is controlled to be closed. This can avoid missing valid voices and set After a certain standby time, the voice interaction unit 100 can be turned off to protect user privacy.
- the voice interaction unit 100 When the voice interaction unit 100 is in a closed state and the photoelectric sensing unit 200 senses the user's target limb command, it sends an instruction to the voice interaction unit 100 to control the voice interaction unit 100 to turn on.
- the instruction control unit 300 receives the target voice instruction sent by the voice interaction unit 100, and controls the smart device to perform actions corresponding to the target voice instruction according to the user's target voice instruction received and recognized by the voice interaction unit 100 to achieve voice control. Interaction.
- the photoelectric sensing unit 200 moves towards the photoelectric sensing unit 200.
- the voice interaction unit 100 sends a start command, and the voice interaction unit 100 starts recording and sends the recording data to the command control unit 300.
- the command control unit 300 recognizes text according to the recorded audio and takes corresponding actions according to the user's voice. In the logic block diagram In the middle, it is serial number A ⁇ serial number B ⁇ serial number C.
- the instruction control unit 300 can autonomously send a first opening instruction (serial number Y) to the voice interaction unit 100.
- the voice interaction unit 100 is enabled, and sends the received audio data including the target voice instruction to the instruction control unit 300 (serial number Z). ), the voice interaction unit 100 sends a second opening command to the photoelectric sensing unit 200, and the photoelectric sensing unit 200 is turned on.
- the voice interaction system also includes an image acquisition unit 400.
- the instruction control unit 300 can instruct the control unit 300 according to the image collected by the image acquisition unit 400. For example, when the collected image includes the target gesture, the instruction The control unit 300 determines that the user has the intention to open the voice interaction unit 100, and thus sends a first opening instruction (serial number V) to the voice interaction unit 100. At the same time, the voice interaction unit 100 sends a second opening instruction to the photoelectric sensing unit 200 to open the Voice interaction unit 100 and photoelectric sensing unit 200.
- Figure 3 is a schematic diagram of the communication method between the command control unit 300, the voice interaction unit 100 and the photoelectric induction unit 200.
- the command control unit 300 is the host (PC side) of the smart device, and the voice interaction unit 100 includes a microphone module (MIC).
- the photoelectric induction unit 200 includes a photoelectric induction unit, a first indicator light and a second indicator light as a specific embodiment.
- the specific work flow between the instruction control unit 300, the voice interaction unit 100 and the photoelectric induction unit 200 is described as follows:
- the photoelectric induction unit 200 is connected to the voice interaction unit 100, and the voice interaction unit 100 is connected to the command control unit 300.
- the voice interaction unit 100 defaults to the muted state (i.e., MUTE ON state), and the voice interactive system remains in the standby state.
- the voice interactive unit 100 switches its current muted state to the command control unit.
- the status is sent to the photoelectric induction unit 200, the first color indicator light 410 of the photoelectric induction unit 200 goes out, and the second color indicator light 420 lights up;
- the command control unit 300 sends a first shutdown command to the voice interaction unit 100 through UART (Universal Asynchronous Receiver/Transmitter). (MUTE ON command), the voice interaction unit 100 is turned off, and at the same time, the voice interaction unit 100 sends a second turn-off instruction to the photoelectric induction unit 200 through the serial port, the photoelectric induction unit 200 is turned off, and the first color indicator light 410 goes out at this time. , the second color indicator light 420 lights up;
- UART Universal Asynchronous Receiver/Transmitter
- the instruction control unit 300 sends an opening instruction (i.e., MUTE OFF instruction) to the voice interaction unit 100 through UART
- the voice interaction unit 100 is turned on.
- the voice interaction unit 100 sends a first opening instruction to the photoelectric sensing unit 200 through the serial port to control
- the photoelectric sensing unit 200 is turned on, the first color indicator light 410 lights up and the second color indicator light 420 goes out.
- the photoelectric sensing unit 200 can only receive the user's body instructions when the voice interaction unit 100 is in the MUTE ON state. At this time, the first color indicator light 410 goes out and the second color indicator light 420 lights up; the photoelectric sensing unit 200 In the MUTE OFF state of the voice interaction unit 100, the user's body instructions cannot be received. At this time, the first color indicator light 410 lights up and the second color indicator light 420 goes out.
- control instructions in the voice interaction system are as shown in Table 1:
- AT+10, AT+11 and AT+12 in Table 1 are the instructions sent by the photoelectric sensing unit to the voice interaction unit.
- AT+10 means the instruction sent by the photoelectric sensing unit in its current standby state to the voice interaction unit;
- AT+11 AT+12 means that the photoelectric sensing unit sends the second closing command (microphone closing command) to the voice interaction unit;
- AT+12 means the photoelectric sensing unit sends the first opening command (microphone opening command) to the voice interaction unit.
- AT+00 and AT+01 are instructions for the voice interaction unit to return its current status to the photoelectric induction unit.
- AT+00 indicates that the voice interaction unit is in the closed microphone state;
- AT+01 indicates that the voice interaction unit is in the recording state.
- AT+20, AT+21 and AT+22 are commands sent by the command control unit to the voice interaction unit.
- AT+20 represents the command for the command control unit to control the voice interaction unit to turn off the microphone, that is, the first closing command;
- AT+21 represents the command.
- the control unit controls the instruction for turning on the microphone of the voice interaction unit, that is, the first turn-on instruction;
- AT+22 represents an instruction sent by the instruction control unit to the voice interaction unit to query the current status of the voice interaction unit.
- AT+00 and AT+01 are instructions for the voice interaction unit to return to the command control unit.
- AT+00 is an instruction indicating that the voice interaction unit is in a closed microphone state;
- AT+01 is an instruction indicating that the voice interaction unit is in a recording state.
- the photoelectric sensing unit 200 includes: a housing 210, a photoelectric sensor 220, a circuit board 230, an indicator light, a back cover 240 and a first signal transmission harness (not shown in the figure).
- the interior of the housing 210 is hollow, the housing 210 includes a front end and a rear end, an indicator mark 211 is provided on the end face of the front end, and the rear end is open; the photoelectric sensor 220 and the light source are provided on the housing 210 inside; the circuit board 230 is arranged in the housing 210, and a switch circuit is provided on the circuit board 230, and the switch circuit is connected to the photoelectric sensor 220; the back cover 240 is buckled on the back of the housing 210 end; one end of the first signal transmission harness is connected to the circuit board 230, and the other end extends out of the back cover 240.
- the photoelectric induction unit also includes an indicator light disposed in the housing 210.
- the indicator light is used to indicate the current on or off status of the photoelectric sensing unit.
- the indicator light may use a light emitting diode.
- the indicator light may include a first color indicator light 410 and a second color indicator light 420 .
- the indicator lights include at least two first color indicator lights 410 and at least two second color indicator lights 420, wherein the at least two first color indicator lights 410 are respectively Located on opposite sides of the end surface of the front end, at least two second color indicator lights 420 are respectively located on opposite sides of the end surface of the front end.
- the first color indicator light 410 and the second color indicator light 420 are provided on opposite sides of the end surface of the front end of the housing 210, the brightness display uniformity of the housing can be improved. And the light source is set at the edge of the casing, which can avoid the space in the middle area of the circuit board, and the space layout is more compact and reasonable. It should be understood that the specific number and specific arrangement positions of the first color indicator lights 410 and the second color indicator lights 420 are not limited.
- the rear end of the housing 210 is connected to the back cover 240 through snaps.
- the rear end of the housing 210 may be provided with a buckle groove
- the back cover 240 may be provided with a buckle 241.
- the front end is provided with a first through hole 213 and a second through hole 214;
- the photoelectric sensor 220 is provided with a receiving electrode 221 and an emitter electrode 222.
- the receiving electrode 221 is located at the first through hole 213, and the emitter electrode 222 is located at the second through hole 214, so that the receiving electrode 221 and the emitter electrode 222 of the photoelectric sensor 220 are exposed.
- the size of the first through hole 213 and the second through hole 214 is consistent with exposing the receiving electrode and the emitter.
- the diameters of the first through hole 213 and the second through hole 214 can be is 2.8mm.
- the indication mark includes an incised hollow mark.
- an engraved hollow mark on the front surface of the housing 210, which can clearly display the mark on the surface of the photoelectric induction unit housing 210.
- the mark is text, such as "Wave Hand To Speak", reminding the user to open the photoelectric induction unit with a wave of his hand. Wake up the microphone to record.
- the relief design depth of the negative-engraved hollow mark on the front surface of the shell 210 can be about 0.3 mm.
- the negative-engraved hollow mark has a clearer font.
- the positive-engraved fonts are thicker. If the shell 210 is formed by injection molding and the surface is spray-painted, the light transmittance of the shell 210 is not good. The thicker the fonts, the darker the display and the worse the contrast effect. If the engraved and hollow form is used, the fonts are thinned, the display is brighter, and the contrast effect is better, which solves the technical problem of unclear display of the mark 210 on the housing when the photoelectric sensing unit is working.
- the end surface of the front end is a black silk screen area 231 in the area other than the engraved hollow logo 211, and the black silk screen area 231 has white space around the edges of the end surface of the front end. District 232.
- black silk screen printing is used around the engraved hollow logo, and the brightness display contrast is better, and a blank area 232 can be left around the front end of the housing.
- the width of the blank area 232 can be about 2 mm, which is convenient for the front end of the housing 210 Light is transmitted all around.
- the housing 210 adopts a light-transmissive injection molded shell
- the material of the light-transmissive injection molded shell is a mixed material of an injection molding material with a light transmittance greater than a predetermined threshold and color master particles.
- the injection molding material can be acrylonitrile-butadiene-styrene plastic (ABS plastic).
- the injection molding material with a light transmittance greater than the predetermined threshold refers to a highly transparent injection molding material.
- the value of the predetermined threshold is not specifically limited here. It should be understood that any injection molding material with a good light transmittance can be used. applied here.
- the mixed material of the injection molding shell and the masterbatch particles is a known mixed material, which will not be described again here.
- Injection molding can be used as the shell, with good transmittance and toughness, uniform display, and easy assembly.
- the shell may also be spray-painted on the surface of the injection molded shell.
- this method requires additional painting processes and is costly.
- a light guide strip 500 is provided inside the housing 210 and around the end surface of the front end.
- the light guide strip 500 can increase the brightness around the display area at the front end of the housing.
- the photoelectric sensing unit 200 includes a photoelectric sensor, and the photoelectric sensor is a laser distance sensor. That is, the photoelectric sensing unit 200 can use a laser distance sensing switch, which is a switching device based on laser pulse sensing technology. The principle is to use the principle of laser pulse signal transmission. The laser pulse signal encounters different reflections at the distance of the obstacle. The intensity is also different, and the distance of obstacles is detected according to the set sensing distance. Combining the laser sensor with the switch circuit forms a laser sensing distance switch.
- the way in which the photoelectric sensor is used to receive and identify the user's target body instructions can be that the user performs certain body movements within the sensing distance of the photoelectric sensor, such as approaching the photoelectric sensing unit or waving and other body movements, and the photoelectric sensing unit responds to the reflected light received Signal, identify body movement instructions based on light signals.
- the photoelectric induction unit 200 can also use an infrared induction sensor, and a laser distance sensor is used as the photoelectric induction unit 200.
- the laser distance sensor can be used in an outdoor lighting environment, which solves the problem of the infrared induction sensor under sunlight. The problem of interference from infrared light in natural light.
- the sensing distance of the laser distance sensor 210 can reach 80 to 150 mm.
- the sensing distance of the laser distance sensor is not limited to this range and can be reasonably adjusted according to actual applications.
- the laser distance sensor 210 may include two photodiodes: an emitter 221 and a receiver 222.
- the laser distance sensor 210 determines the range of the energizing current and the sensing distance of the laser sensor through the size of the peripheral resistance on the circuit board 230. In outdoor use environments, the use of laser distance sensors can avoid the impact of the infrared band of natural light on the sensor.
- the laser emitter first emits laser pulses.
- the emitted laser pulses will reflect the light back under the reflection of blocking obstacles.
- the laser sensor receiving electrode will detect the reflected laser signal, convert the signal into an electrical signal, and at the same time wake up the voice interaction unit 100 according to the UART command.
- the circuit board 230 includes a first side and a second side arranged oppositely, and the indicator light (for example, the first color indicator light 410 and the second Color indicator light 420), the indicator light can be a light-emitting diode. After it is lit, the light can pass through the housing 210, so that the engraved hollow logo 211 on the front end of the housing 210 can be displayed.
- the laser distance sensor 220 and peripheral resistors are also provided on the first surface.
- the light guide strip 500 is disposed on the first surface and surrounds the front end of the housing 210 to increase the brightness around the display screen.
- a photoelectric induction main chip and a first signal transmission harness are provided on the second side.
- the photoelectric induction main chip receives the signal sent by the infrared sensor, processes the signal, and sends a turn-on signal to the microphone module. instruction.
- One end of the first signal transmission wire harness is connected to the circuit board 230 , and the other end passes through the through hole opened in the center of the back cover 240 and is connected to the first signal transmission wire harness of the microphone module.
- the photoelectric induction unit Both receiving and sending instructions are transmitted through the signal transmission harness.
- the voice interaction unit 100 includes a microphone module.
- the figure shows an exploded view of the structure of an embodiment of a microphone module.
- the microphone module includes: an upper cover 110, at least two sound-collecting microphones (not shown in the figure), a printed circuit board 120, a sealing ring 130 and a bottom cover 140.
- the inside of the upper cover 110 Hollow, the upper cover 110 includes a front end and a rear end, the front end is provided with at least two sound collecting holes, and the rear end is open; at least two sound collecting microphones are provided inside the upper cover 110, each of the sound collecting microphones is Corresponding to one of the sound collecting holes, a sealing ring 130 is provided at each sound collecting hole; the printed circuit board 120 is provided inside the upper cover 110, and the printed circuit board 120 is connected to the sound collecting microphone;
- the bottom cover 140 is disposed at the rear end of the upper cover 110 .
- the microphone module further includes: a second signal transmission harness connected to the printed circuit board 120, and a second signal transmission harness disposed on the printed circuit board 120 for suppressing the second signal transmission.
- the wire harness pressing plate 150 The bottom cover 140 and the pressing plate are fixed to the upper cover 110 through buckles and sealed with sealant.
- the upper cover 110 of the microphone module is screen-printed with a black mark (LOGO) to facilitate user identification.
- a black mark There are two sound collecting holes on the top and bottom of the surface of the upper cover 110, corresponding to the holes on the sealing ring 130. The location is more conducive to sound collection.
- the printed circuit board 120 includes a front face facing the upper cover 110 and a back face opposite to the front face. Taking the number of microphones as two as an example, the two microphones are arranged on opposite sides of the front face. at both ends. Taking the number of microphones in this microphone module as an example, after the environmental noise is sampled, the sound waveform is analyzed and phase-operated, and superimposed on the sampling waveform of the main microphone to form phase offset, so that one microphone can stably maintain clear recording, and the other microphone can record clearly.
- One microphone actively eliminates physical noise, and then processes the algorithm to record clearer sound, which solves the technical problem of poor recording effect of microphones in noisy environments. Dual microphones can improve signal quality when dealing with changing and complex sound environments. The noise ratio keeps the recorded sound pure, and the post-processing algorithm is more accurate.
- a voice signal main chip is also provided on the front of the printed circuit board 120.
- the voice signal main chip can perform noise reduction, algorithm optimization and other processing based on the sound data input by the two microphones.
- the voice signal main chip includes a serial port interface for Send and receive instructions from the photoelectric sensing unit 200 and the instruction control unit 300.
- a reset button is provided on the back of the printed circuit board 120 for subsequent software upgrade operations.
- connection wire jack is also provided on the back of the printed circuit board 120 for connecting the second signal transmission wire harness to maintain signal data transmission between the photoelectric sensing unit and the PC terminal.
- the bottom cover 140 and the crimping cover can be connected to the upper cover 110 through snaps and sealed with sealant to prevent damage by external force.
- Embodiments of the present disclosure also provide a voice interaction method, including:
- the voice interaction unit 100 determines whether the voice interaction unit 100 receives the target voice command within the predetermined time. If the target voice command is received within the predetermined time, the voice interaction unit 100 receives and recognizes the user's target voice command, Control the smart device to perform actions corresponding to the target voice command; if no voice command is received within the predetermined time, send a standby command to the voice interaction unit 100;
- control the voice interaction unit 100 to turn on according to the user's target limb command received and recognized by the photoelectric sensing unit 200, and control the smart device to execute the above-mentioned operation according to the user's target voice command received and recognized by the voice interaction unit 100.
- the target voice commands the corresponding action.
- the method further includes:
- the voice interaction unit 100 When the voice interaction unit 100 is in the on state, whether the voice interaction unit 100 receives a voice command within the predetermined standby time; if not, the voice interaction unit 100 is turned off.
- the method further includes:
- the voice interaction unit 100 When the voice interaction unit 100 is in the on state, it is determined whether the voice interaction unit 100 receives a voice command within a predetermined time; if not, the photoelectric sensing unit 200 is controlled to turn off.
- the photoelectric sensing unit 200 when the photoelectric sensing unit 200 receives the second closing instruction or a closing operation from the user, it lights the first color indicator light 410; When the voice interaction unit 100 receives a second opening instruction or a user's opening operation, the second color indicator light 420 is lit.
- the method further includes:
- the photoelectric sensing unit 200 and the voice interaction unit 100 are controlled to be turned on.
- the specific voice interaction process of the voice interaction method is the same as the specific voice interaction process of the voice interaction system provided by the present disclosure, and will not be described again here.
- An embodiment of the present disclosure also provides an intelligent device, on which the voice interaction system provided by the embodiment of the present disclosure is provided.
- the smart devices provided by the embodiments of the present disclosure can include smart refrigerators, smart washing machines, smart TVs, etc.
- the application scenarios are not limited to household appliances, but can also be applied to shopping guides in clothing malls, self-service convenience stores and other application scenarios.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
一种语音交互系统及方法、智能设备，该系统包括：语音交互单元(100)，用于采集并识别用户的目标语音指令；光电感应单元(200)，用于接收并识别用户的目标肢体指令，根据目标肢体指令控制语音交互单元(100)开关；指令控制单元(300)，用于判断语音交互单元(100)是否处于开启状态；若是，判断语音交互单元(100)在预定时间内是否接收到目标语音指令，若在预定时间内接收到目标语音指令时，根据语音交互单元(100)接收和识别用户的目标语音指令，控制智能设备执行与目标语音指令相应的动作；若在预定时间内未接收到语音指令时，向语音交互单元(100)发送待机指令。语音交互系统及方法、智能设备，可肢体感应打开智能语音音箱，与智能设备整机交互。
Description
本公开涉及智能设备技术领域，尤其涉及一种语音交互系统及方法、智能设备。
物联网已成为全球新一轮科技革命与产业变革的重要驱动力。语音识别技术是物联网中的一种应用场景丰富的技术，而麦克风作为语音识别技术的信号采集设备，影响着语音识别的能力。
发明内容
本公开实施例提供了一种语音交互系统及方法、智能设备，能够实现肢体感应打开智能语音音箱，与整个智能设备整机进行交互，且可有效防止遗漏有效语音指令，提高语音交互系统的智能化程度。
本公开实施例所提供的技术方案如下：
本公开实施例提供了一种语音交互系统，包括：
语音交互单元，用于采集并识别用户的目标语音指令；
光电感应单元，所述光电感应单元与所述语音交互单元连接，用于接收并识别用户的目标肢体指令，并根据所述目标肢体指令控制所述语音交互单元开关；
指令控制单元，所述指令控制单元与所述语音交互单元连接，用于判断语音交互单元是否处于开启状态；若是，判断所述语音交互单元在预定时间内是否接收到目标语音指令，若在所述预定时间内接收到目标语音指令时，根据所述语音交互单元接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作；若在所述预定时间内未接收到语音指令时，向所述语音交互单元发送待机指令。
示例性的，所述指令控制单元还用于识别所述语音交互单元在所述预定待机时间内是否接收到语音指令；若否，向所述语音交互单元发送第一关闭 指令。
示例性的，所述光电感应单元包括光电传感器，且所述光电传感器为激光距离传感器。
示例性的，所述激光距离传感器的感应距离为80～150mm。
示例性的，所述光电感应单元上设有指示灯，所述指示灯包括第一颜色指示灯和第二颜色指示灯；
所述语音交互单元还用于：当接收到所述第一关闭指令时，向所述光电感应单元发送第二关闭指令；
所述光电感应单元还用于在接收到所述第二关闭指令或来自用户的关闭操作时，点亮所述第一颜色指示灯；接收到第一开启指令或来自用户的开启操作时，点亮所述第二颜色指示灯。
示例性的，所述光电感应单元包括：
外壳，所述外壳的内部中空，所述外壳包括前端和后端，所述前端的端面上设有指示标识，后端开口；
设置于所述外壳内的光电传感器；
设置于外壳内的线路板，所述线路板上设有开关电路，所述开关电路与所述光电传感器连接；
设置于所述外壳内的指示灯；
扣装在所述外壳的后端的后盖；
信号传输线束，所述信号传输线束一端与线路板连接，另一端伸出所述后盖。
示例性的，所述指示标识包括阴刻镂空标识，且所述前端的端面在除所述阴刻镂空标识之外的区域为黑色丝印区，所述黑色丝印区在所述前端的端面四周边缘具有留白区。
示例性的，所述外壳采用可透光的注塑壳体，所述可透光的注塑壳体的材料为透光率大于预定阈值的注塑材料与色母粒子的混合材料。
示例性的，所述注塑材料选用丙烯腈-丁二烯-苯乙烯塑料。
示例性的，在所述外壳内侧且围绕所述前端的端面四周设有导光条。
示例性的，所述指示灯包括至少两个第一颜色指示灯和至少两个第二颜 色指示灯，其中，至少两个所述第一颜色指示灯分别位于所述前端的端面相对两侧，至少两个第二颜色指示灯分别位于所述前端的端面相对两侧。
示例性的，所述语音交互系统还包括图像采集单元，所述指令控制单元与所述图像采集单元连接，用于接收并识别图像采集单元所采集的图像数据，并当所述图像数据包括目标手势时，向所述语音交互单元发送第一开启指令；
所述语音交互单元还用于接收到所述第一开启指令时，向所述光电感应单元发送第二开启指令。
示例性的，所述语音交互单元与所述指令控制单元之间通过串口指令进行通讯，
所述语音交互单元与所述指令控制单元之间通过串口指令进行通讯。
示例性的，所述前端上设有第一通孔和第二通孔；所述光电传感器上设有接收极和发射极，所述接收极位于所述第一通孔处，所述发射极位于所述第二通孔处。
本公开实施例还提供一种语音交互方法，应用于本公开实施例的语音交互系统，所述方法包括：
判断语音交互单元是否处于开启状态；
若是，判断所述语音交互单元是否在预定时间内接收到目标语音指令，若在所述预定时间内接收到目标语音指令时，根据所述语音交互单元接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作；若在所述预定时间内未接收到语音指令时，向所述语音交互单元发送待机指令；
若否，根据光电感应单元所接收和识别的用户的目标肢体指令，控制语音交互单元开启，并根据所述语音交互单元接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作。
示例性的，所述方法还包括：所述语音交互单元处于开启状态时，判断语音交互单元在所述预定待机时间内是否接收到语音指令；若否，控制语音交互单元关闭。
示例性的，所述方法还包括：所述语音交互单元处于开启状态时，判断在预定时间内所述语音交互单元是否接收到语音指令；若否，控制光电感应 单元关闭。
示例性的，所述光电感应单元接收到第二关闭指令或来自用户的关闭操作时，点亮第一颜色指示灯；接收到所述第一开启指令或来自用户的开启操作时，点亮第二颜色指示灯。
示例性的，所述方法还包括：
接收并识别图像采集单元所采集的图像数据；
当所述图像数据包括目标手势时，控制所述光电感应单元和所述语音交互单元开启。
本公开实施例还提供一种智能设备，在所述智能设备上设有本公开实施例提供的语音交互系统。
本公开实施例所带来的有益效果如下：
本公开实施例所提供的语音交互系统及方法、智能设备，将语音交互单元与光电感应单元结合在一起，其中语音交互单元可采集并识别用户的目标语音指令，光电感应单元可接收并识别用户的目标肢体指令而控制语音交互单元开关，指令控制单元判断语音交互单元是否开启，当开启时，可根据目标语音指令来控制智能设备执行相应动作，可以实现通过肢体动作，控制语音交互单元开关，实现与整机进行交互，解决光电感应单元如何控制语音交互单元打开以及指令控制单元开关语音交互单元与光电感应单元的技术难题；并且，指令控制单元还可以在判断语音交互单元没有在预定时间内接收到语音指令的情况下控制语音交互单元待机，而不是直接控制语音交互单元立即关闭，这样可以避免短暂时间内用户没有语音或语音识别错误时语音交互单元立即关闭可能造成的有效语音指令遗漏问题，提升语音交互智能化程度。
图1所示为本公开实施例中提供的语音交互系统的结构框图；
图2所示为本公开实施例中提供的语音交互系统的逻辑框图；
图3为指令控制单元、语音交互单元和光电感应单元之间的通讯方式示意图；
图4为本公开实施例中的光电感应单元的一种结构示意图；
图5所示为本公开实施例中光电感应单元的外壳前端结构示意图；
图6所示为本公开实施例中光电感应单元中光源、导光条及光电感应单元的布置位置关系图；
图7所示为本公开实施例中麦克风模组的结构爆炸图。
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例的附图，对本公开实施例的技术方案进行清楚、完整地描述。显然，所描述的实施例是本公开的一部分实施例，而不是全部的实施例。基于所描述的本公开的实施例，本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例，都属于本公开保护的范围。
除非另外定义，本公开使用的技术术语或者科学术语应当为本公开所属领域内具有一般技能的人士所理解的通常意义。本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性，而只是用来区分不同的组成部分。同样，“一个”、“一”或者“该”等类似词语也不表示数量限制，而是表示存在至少一个。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同，而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接，而是可以包括电性的连接，不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系，当被描述对象的绝对位置改变后，则该相对位置关系也可能相应地改变。
本公开实施例所提供的语音交互系统可应用于各种智能设备上，例如，智能冰箱、智能洗衣机、智能电视等。
图1所示为本公开实施例中提供的语音交互系统的结构框图，图2所示为本公开实施例中提供的语音交互系统的逻辑框图。
请参见图1和图2，本公开实施例提供的智能设备的语音交互系统包括：
语音交互单元100，用于采集并识别用户的目标语音指令；
光电感应单元200，所述光电感应单元200与所述语音交互单元100连接，用于接收并识别用户的目标肢体指令，并根据所述目标肢体指令控制所 述语音交互单元100开关；
指令控制单元300，所述指令控制单元300与所述语音交互单元100连接，用于判断语音交互单元100是否处于开启状态；若是，判断所述语音交互单元100是否在预定时间内接收到目标语音指令，其中，
若在所述预定时间内接收到目标语音指令时，根据所述语音交互单元100接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作；若在所述预定时间内未接收到语音指令时，向所述语音交互单元100发送待机指令。
上述方案中，将语音交互单元100与光电感应单元200结合在一起，其中语音交互单元100可采集并识别用户的目标语音指令，光电感应单元200可接收并识别用户的目标肢体指令而控制语音交互单元100开关，指令控制单元300判断语音交互单元100是否开启，当开启时，可根据目标语音指令来控制智能设备执行相应动作，可以实现通过肢体动作，控制语音交互单元100开关，实现与整机进行交互，解决光电感应单元200如何控制语音交互单元100打开以及指令控制单元300开关语音交互单元100与光电感应单元200的技术难题；并且，指令控制单元300还可以在判断语音交互单元100没有在预定时间内接收到语音指令的情况下控制语音交互单元100待机，而不是直接控制语音交互单元100立即关闭，这样可以避免短暂时间内用户没有语音或语音识别错误时语音交互单元100立即关闭可能造成的有效语音指令遗漏问题，提升语音交互智能化程度。
在一些实施例中，所述指令控制单元300还用于识别所述语音交互单元100在所述预定待机时间内是否接收到语音指令；若否，向所述语音交互单元100发送第一关闭指令。采用上述方案，可设置待机时长，例如30s等时长，当在待机时间内语音交互单元100一直未识别到有效的语音指令时再关闭。这样，在节省能耗的同时，不会在短时间内未接收到语音指令就立即关闭，防止了遗漏有效语音的采集，例如，当用户下发语音指令时中间出现停顿，若是语音交互单元100立即关闭，会遗漏有效语音的采集；并且，在预定待机时长内识别到未有语音指令时再关闭语音交互单元100，这样又能有效防止非语音指令等声音采集，保护了用户隐私。
此外，一些实施例中，所述光电感应单元200上设有指示灯，所述指示灯可以包括第一颜色指示灯410和第二颜色指示灯420；所述语音交互单元100还用于：当接收到第一关闭指令时，向所述光电感应单元200发送所述第二关闭指令；
所述光电感应单元200还用于在接收到所述第二关闭指令或来自用户的关闭操作时，点亮所述第一颜色指示灯410，关闭第二颜色指示灯420；接收到由所述语音交互单元100发送的第一开启指令或来自用户的开启操作时，点亮所述第二颜色指示灯420，关闭第一颜色指示灯410。
这里需要说明的是，上述方案中，所述光电感应单元200可以是接收到指令所述第一关闭指令时关闭，接收到第一开启指令时实现自动开启或关闭功能。所述光电感应单元200也可以设置可操作开关或者设置可触控显示屏，通过用户在该可操作开关或者可触控显示屏上进行开启或关闭或操作，来实现光电感应单元200的开启或关闭。
采用上述方案，可在所述光电感应单元200中设置两种颜色的指示灯，实现光电感应单元200在不同工作状态下通过不同颜色指示灯指示的目的，应当理解的是，第一颜色指示灯410和第二颜色指示灯420的能够发出的颜色不同，具体颜色不限。例如，第一颜色指示灯410可以是能够发出绿光的发光二极管，第二颜色指示灯420可以是能够发出白光的发光二极管，这样，指令控制单元300自主向语音交互单元100发送开启指令，语音交互单元100开始接收语音指令，并将音频数据发送到指令控制单元300，语音交互单元100向光电感应单元200发送开启命令，光电感应单元200的第二颜色指示灯420熄灭，第一颜色指示灯410亮起。当语音交互单元100接收到关闭指令时，则第二颜色指示灯420点亮，第一颜色指示灯410熄灭。
上述方案，所述光电感应单元200不工作的时候第二颜色指示灯点亮，这样，在户外使用场景下，第二颜色指示灯处于点亮状态下，便于消费者找到位置并进行操作。用户通过肢体指令例如挥手等肢体动作打开所述光电感应单元200，所述光电感应单元200接收到信息，第一颜色指示灯410点亮，第二颜色指示灯420，表示所述光电感应单元200进入工作状态，唤醒语音交互单元进行录音。
在一些实施例中，所述语音交互系统还包括图像采集单元400，所述指令控制单元300与所述图像采集单元400连接，所述指令控制单元300还用于接收并识别图像采集单元400所采集的图像数据；并当所述图像数据包括目标手势时，向所述语音交互单元100发送第一开启指令；所述语音交互单元100还用于接收到所述第一开启指令时，向所述光电感应单元200发送第二开启指令。
以下对本公开实施例提供的语音交互系统进行更为详细的说明：
本公开实施例所提供的语音交互系统中，所述语音交互单元100可以包括麦克风模组(MIC)等。语音交互单元100根据不同的使用环境，对音质质量有不同的要求，则可以选用不同型号的COMS硅麦克风，同时可以设计具有不同COMS硅麦克风数量的麦克风模组。以麦克风模组为例，其采集和识别用户的目标语音指令的方式可以是，麦克风模组开启，录制并形成音频文件，将音频文件发送至指令控制单元300。
所述指令控制单元300可以为计算机、MCU(微控制单元)等，例如，所述指令控制单元300可以是智能设备的主机(PC端)。
在本公开实施例的语音交互系统中，所述语音交互单元100与所述指令控制单元300之间通过串口指令进行通讯，所述语音交互单元100与所述指令控制单元300之间通过串口指令进行通讯。
关于所述语音交互单元100、所述光电感应单元200和所述指令控制单元300的具体结构后文会进行进一步说明，以下先针对语音交互系统的语音交互实现过程进行更为详细的解释说明。
如图2所示，本公开实施例中提供的智能设备的语音交互系统的语音交互方法可以包括如下过程：
1)用户自主打开所述语音交互单元100(可以是用户在语音交互单元100上直接进行开启所述语音交互单元的操作，或者用户通过例如挥手等肢体指令打开语音交互单元100)，所述指令控制单元300接收语音交互单元100所发送的目标语音指令，并根据所述语音交互单元100接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作，以实现语音交互。逻辑框图中该过程为序号B→序号C。例如，以智能设备为智能冰箱， 语音交互单元100为麦克风为例，当麦克风通过用户挥手或直接操作等方式开启后，用户说出相应语音指令则智能冰箱会根据语音指令执行相应动作，例如，用户说出“Please give me a coca cola”，智能冰箱门内指令控制单元300会根据客户指定需求将指定商品送到出货口，从而用户可以取走指定商品。
2)在所述语音交互单元100处于开启状态时，所述指令控制单元300判断在预定时间内所述语音交互单元100是否接收到语音指令；若否，向所述语音交互单元100发送待机指令，在预定待机时间内语音交互单元100未收到语音指令，指令控制单元300向该语音交互单元100发送关闭指令；
具体的，例如，所述指令控制单元300根据算法，当检测到语音交互单元100在预定待机时间内没有采集到语音的情况下，所述指令控制单元300会发送给语音交互单元100关闭指令(序号②)，语音交互单元100停止录音，不会再向指令控制单元300发送语音指令(序号③)，同时，语音交互单元100向光电感应单元200发送关闭命令(序号④)，光电感应单元200关闭，第二颜色指示灯420点亮，而第一颜色指示灯410熄灭。这里，由于在语音交互单元100未接收到语音指令时，先待机一定时间，在预定待机时间内还未收到语音指令时，则控制语音交互单元100关闭，可以避免遗漏有效语音，且设定一定待机时间，可以在待机时间结束后关闭语音交互单元100，保护用户隐私。
3)当所述语音交互单元100处于关闭状态时，所述光电感应单元200感应到用户的目标肢体指令时，向所述语音交互单元100发送指令，控制所述语音交互单元100开启，所述指令控制单元300接收语音交互单元100所发送的目标语音指令，并根据所述语音交互单元100接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作，以实现语音交互。
例如，当用户靠近光电感应单元200(即，用户与光电感应单元200的距离小于预定距离)或者用户在光电感应单元200的传感器前做目标肢体动作(例如，挥手)时，光电感应单元200向语音交互单元100发送开启指令，语音交互单元100开始录音，并将录音数据发送到指令控制单元300，指令控制单元300根据录制音频识别文字，按照使用者的语音做出相应的动作， 在逻辑框图中为序号A→序号B→序号C。
4)指令控制单元300可自主向语音交互单元100发送第一开启指令(序号Y)，语音交互单元100开启，并将接收到的包括目标语音指令的音频数据发送到指令控制单元300(序号Z)，语音交互单元100向光电感应单元200发送第二开启命令，光电感应单元200开启。
例如，以智能设备为智能冰箱为例，所述语音交互系统还包括图像采集单元400，当用户距离光电感应单元200距离较远而超过阈值，或者光电感应单元200受干扰而导致灵敏性下降时，可能无法通过肢体动作来打开光电感应单元200和语音交互单元100，那么，指令控制单元300可根据图像采集单元400所采集到的图像，例如，当所采集的图像中包括目标手势时，则指令控制单元300判断用户具有有打开语音交互单元100的意图，从而向语音交互单元100发送第一开启指令(序号V)，同时，语音交互单元100向光电感应单元200发送第二开启指令，以打开语音交互单元100和光电感应单元200。
图3为指令控制单元300、语音交互单元100和光电感应单元200之间的通讯方式的示意图，以指令控制单元300为智能设备的主机(PC端)，语音交互单元100包括麦克风模组(MIC)，光电感应单元200包括光电感应单元、第一指示灯和第二指示灯为具体实施例，指令控制单元300、语音交互单元100和光电感应单元200之间具体的工作流程说明如下：
1)如图3所示，光电感应单元200与语音交互单元100连接，语音交互单元100与指令控制单元300连接。所述语音交互系统开机，语音交互单元100默认闭麦状态(即MUTE ON状态)，语音交互系统保持待机状态，此时没有语音指令发送至指令控制单元；语音交互单元100将其当前的闭麦状态发送至光电感应单元200，光电感应单元200的第一颜色指示灯410熄灭，第二颜色指示灯420点亮；
2)当待机时间超过预定待机时间，指令控制单元300未检测到有效语音指令时，指令控制单元300通过UART(异步收发传输器，Universal Asynchronous Receiver/Transmitter)向语音交互单元100发送第一关闭指令(闭麦指令，即MUTE ON指令)，语音交互单元100关闭，同时语音交互单 元100通过串口向光电感应单元200发送第二关闭指令，光电感应单元200关闭，此时第一颜色指示灯410熄灭，第二颜色指示灯420点亮；
3)当指令控制单元300通过UART向语音交互单元100发送开启指令(即MUTE OFF指令)后，语音交互单元100开启，同时语音交互单元100通过串口向光电感应单元200发送第一开启指令，控制光电感应单元200开启，此时第一颜色指示灯410点亮，第二颜色指示灯420熄灭。
需要说明的是，光电感应单元200只有在语音交互单元100 MUTE ON的状态下才能接收用户的肢体指令，此时第一颜色指示灯410熄灭，第二颜色指示灯420点亮；光电感应单元200在语音交互单元100 MUTE OFF状态下，无法接收用户的肢体指令，此时第一颜色指示灯410点亮，第二颜色指示灯420熄灭。
具体的，所述语音交互系统中控制指令如表1所示：
表1指令控制单元-语音互动单元-光电感应单元控制指令
其中，表1中AT+10、AT+11和AT+12为光电感应单元向语音交互单元发送的指令，AT+10表示光电感应单元发送其当前待机状态给语音交互单元的指令；AT+11表示光电感应单元发送第二关闭指令(闭麦指令)给语音交互单元；AT+12表示光电感应单元发送第一开启指令(即开麦指令)给语音交互单元。
AT+00、AT+01为语音交互单元将其当前状态返回至光电感应单元的指令，AT+00表示语音交互单元处于闭麦状态的指令；AT+01表示语音交互单元处于录音状态的指令。
AT+20、AT+21和AT+22为指令控制单元向语音交互单元发送的指令，AT+20表示指令控制单元控制语音交互单元闭麦的指令，即第一关闭指令； AT+21表示指令控制单元控制语音交互单元开麦的指令，即第一开启指令；AT+22表示指令控制单元向语音交互单元发送的查询语音交互单元当前状态的指令。
AT+00、AT+01为语音互动单元返回至指令控制单元的指令，AT+00为表示语音交互单元处于闭麦状态的指令；AT+01为表示语音交互单元处于录音状态的指令。
以上是针对本公开实施例提供的智能设备的语音交互系统的逻辑设计进行的说明，以下对本公开实施例提供的智能设备的语音交互系统中各单元从结构上再进行详细说明。
在一些实施例中，如图4和图5所示，所述光电感应单元200包括：外壳210、光电传感器220、线路板230、指示灯、后盖240和第一信号传输线束(图中未示意)，所述外壳210的内部中空，所述外壳210包括前端和后端，前端的端面上设有指示标识211，后端开口；所述光电传感器220和所述光源设置于所述外壳210内；所述线路板230设置于外壳210内，所述线路板230上设有开关电路，所述开关电路与所述光电传感器220连接；所述后盖240扣装在所述外壳210的后端；所述第一信号传输线束一端与线路板230连接，另一端伸出所述后盖240，所述光电感应单元还包括设置于所述外壳210内的指示灯。该指示灯用于指示所述光电感应单元的当前开启或关闭状态。例如，所述指示灯可以采用发光二极管。具体的一些实施例中，所述指示灯可以包括第一颜色指示灯410和第二颜色指示灯420。
一些实施例中，如图6所示，所述指示灯包括至少两个第一颜色指示灯410和至少两个第二颜色指示灯420，其中，至少两个所述第一颜色指示灯410分别位于所述前端的端面相对两侧，至少两个第二颜色指示灯420分别位于所述前端的端面相对两侧。
这样的设置，由于在外壳210前端的端面相对两侧均设有第一颜色指示灯410和第二颜色指示灯420，这样可以提高外壳亮度显示均匀性。且光源设置在外壳的边缘位置，可避让线路板中间区域的空间，空间布局也更为紧凑合理。应当理解的是，对于所述第一颜色指示灯410和所述第二颜色指示灯420的具体数量及具体布置位置并不为限。
在一些实施例中，如图4所示，所述外壳210的后端与所述后盖240通过卡扣连接。例如，所述外壳210的后端可设置卡扣槽，所述后盖240上设卡扣241，通过将后盖240上的卡扣241卡在所述外壳210的卡扣槽内，通过所述后盖240盖住外壳210后，可以防止脱落。
此外，在一些实施例中，如图5所示，所述前端上设有第一通孔213和第二通孔214；所述光电传感器220上设有接收极221和发射极222，所述接收极221位于所述第一通孔213处，所述发射极222位于所述第二通孔214处，以便于所述光电传感器220的接收极221和发射极222露出。
上述方案中，所述第一通孔213和所述第二通孔214的尺寸以露出接收极和发射极为准，例如，所述第一通孔213和所述第二通孔214的直径可以为2.8mm。
此外，在本公开一些实施例中，所述指示标识包括阴刻镂空标识。这样，在外壳210的前端表面具有阴刻镂空标识，能够在光电感应单元外壳210表面清晰地显示标记，例如，标记为文字，如“Wave Hand To Speak”，提醒用户可挥手打开光电感应单元，唤醒麦克风进行录音。
外壳210的前端表面阴刻镂空标识的浮雕设计深度可以为0.3mm左右，采用阴刻镂空标识相较于阳刻镂空标记来说，字体更清晰。阳刻字体较厚，若外壳210为注塑工艺成型，表面喷漆，外壳210光的透过性不好，字体越厚则显示越暗，对比效果越差。若采用阴刻镂空的形式，字体减薄，显示越亮，对比效果越好，解决光电感应单元工作时外壳210标记显示不清晰的技术问题。
此外，在一些实施例中，所述前端的端面在除所述阴刻镂空标识211之外的区域为黑色丝印区231，且所述黑色丝印区231在所述前端的端面四周边缘具有留白区232。这样，阴刻镂空标识的四周使用黑色丝印，亮度显示对比更优，且外壳前端的端面四周可留有留白区232，该留白区232的宽度可以为2mm左右，便于外壳210的前端端面四周透光。
此外，在一些实施例中，所述外壳210采用可透光的注塑壳体，所述可透光的注塑壳体的材料为透光率大于预定阈值的注塑材料与色母粒子的混合材料。例如所述注塑材料可选用丙烯腈-丁二烯-苯乙烯塑料(ABS塑料)。
这里需要说明的是，透光率大于预定阈值的注塑材料是指高透注塑材料，预定阈值的取值在此并不具体限定，应当理解的是，只要透光率较好的注塑材料均可应用于此。
此外，注塑壳体和色母粒子的混合材料，是一种已知的混合材料，这里对此不再赘述。采用注塑可以作为外壳，透过率和韧性较好，显示画面均匀，组装方便。在一些未示意出的实施例中，所述外壳也可以是选用注塑壳体表面喷漆方式，但是这种方式需要增加喷漆工艺，成本较高。
此外，一些实施例中，在所述外壳210内侧且围绕所述前端的端面四周设有导光条500。该导光条500可以提升外壳前端显示区域四周的亮度。
所述光电感应单元200包括光电传感器，且所述光电传感器为激光距离传感器。即，所述光电感应单元200可以选用激光距离感应开关，其是一种基于激光脉冲传感技术的开关设备，原理是利用激光脉冲信号传输的原理，激光脉冲信号遇到障碍物距离的不同反射的强度也不同，根据设置的感应距离大小进行障碍物远近的检测。将激光传感器与开关电路结合在一起，就形成了一种激光感应距离开关。采用光电传感器接收并识别用户的目标肢体指令的方式可以是，用户在光电传感器的感应距离内进行某种肢体动作，例如，靠近光电感应单元或者挥手等肢体动作，光电感应单元根据接收到反射光信号，根据光信号识别肢体动作指令。
所述光电感应单元200也可以选用红外感应传感器，采用激光距离传感器作为光电感应单元200，相较于红外感应传感器来说，激光距离传感器可以在户外光照环境下使用，解决红外感应传感器在日光下受自然光中红外光线干扰的问题。
此外，所述激光距离传感器210的感应距离可以达到80～150mm。当然可以理解的是，所述激光距离传感器的感应距离不局限于此范围，可根据实际应用进行合理调整。
如图6所示，激光距离传感器210可以包括发射极221和接收极222两个光电二极管，激光距离传感器210通过线路板230上外围电阻大小决定通电电流的范围、决定激光传感器的感应距离。在户外使用环境中，使用激光距离传感器可以避免自然光中红外波段对传感器的影响。激光传感器工作时， 先由激光发射极发射激光脉冲，当用户进行肢体指令动作时(例如用户在感应距离内挥手)时，发射出的激光脉冲会在遮挡障碍物的反射下，将光线反射回，此时激光传感器接收极会检测到反射回来的激光信号，并将信号转换成电信号，同时根据UART指令唤醒语音交互单元100。
此外，在一种具体示例性实施例中，所述线路板230包括相背设置的第一面和第二面，在第一面设置所述指示灯(例如第一颜色指示灯410和第二颜色指示灯420)，该指示灯可以选用发光二极管，其被点亮后，光线可透过外壳210，从而使得外壳210前端上的阴刻镂空标识211可显示。在所述第一面还设置所述激光距离传感器220以及外围电阻等。
所述导光条500设置在所述第一面且围绕在外壳210前端的四周，用于提升显示画面四周亮度。
在所述第二面设置光电感应主芯片和第一信号传输线束，所述光电感应主芯片接收到所述红外感应器所发送的信号，并对信号进行处理，向所述麦克风模组发送开启指令。所述第一信号传输线束一端连接至所述线路板230，另一端穿过所述后盖240中心开设的通孔，与所述麦克风模组的第一信号传输线束相连，所述光电感应单元接收与发送指令均都通过信号传输线束传输。
此外，在一些实施例中，所述语音交互单元100包括麦克风模组。图所示为麦克风模组的一种实施例的结构爆炸图。
如图7所示，所述麦克风模组包括：上盖110、至少两个收音麦克风(图中未示意出)、印刷电路板120、密封圈130和底盖140，其中所述上盖110内部中空，所述上盖110包括前端和后端，所述前端设有至少两个收音孔，所述后端开口；至少两个收音麦克风设置于所述上盖110内部，每一所述收音麦克风对应一个所述收音孔设置，且每一所述收音孔处设置一密封圈130；所述印刷电路板120设置于所述上盖110内部，所述印刷电路板120与所述收音麦克风连接；所述底盖140设置于所述上盖110的后端。
在一些实施例中，所述麦克风模组还包括：连接于所述印刷电路板120上的第二信号传输线束、及设置于所述印刷电路板120上用于压住所述第二信号传输线束的压线板150。所述底盖140和所述压线板通过卡扣固定在所述上盖110，并通过密封胶封装。
作为一种示例性的实施例，所述麦克风模组的上盖110丝印黑色标记(LOGO)，便于用户识别，所述上盖110的表面上下分别为两个收音孔，对应在密封圈130的位置，更加有利于声音的收集。
作为一种示例性的实施例，所述印刷电路板120包括面向上盖110的正面和与所述正面相背的背面，以麦克风数量为两个为例，两个麦克风设置在正面的相对的两端位置上。以该麦克风模组中麦克风数量为两个为例，环境噪音采样后，声音波形经过分析和相位操作，叠加到主麦克风的采样波形上，形成相位抵消，使其中一个麦克风稳定保持清晰录音，另一个麦克风主动消除物理噪音，再经过算法处理，录出来的声音更清晰，解决了麦克风在嘈杂环境中，录音效果差的技术难题，双麦克风在处理变化的、复杂的声音环境时，可以提高信噪比，保持录制声音纯净，后期算法处理更为精准。
在印刷电路板120的正面还设置语音信号主芯片，语音信号主芯片可根据两个麦克风录入的声音数据进行降噪、以及算法优化等处理，同时，语音信号主芯片内包括串口接口，用于发送和接收光电感应单元200和指令控制单元300的指令。
在印刷电路板120的背面设置有复位键，用于后续升级软件操作。
在印刷电路板120的背面还设有连接线插孔，用于连接第二信号传输线束，保持与光电感应单元和PC端之间的信号数据传输。
所述底盖140和所述压线盖可通过卡扣方式连接在所述上盖110，并通过密封胶封装，以防止外力受损。
本公开实施例还提供一种语音交互方法，包括：
判断语音交互单元100是否处于开启状态；
若是，判断所述语音交互单元100是否在预定时间内接收到目标语音指令，若在所述预定时间内接收到目标语音指令时，根据所述语音交互单元100接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作；若在所述预定时间内未接收到语音指令时，向所述语音交互单元100发送待机指令；
若否，根据光电感应单元200所接收和识别的用户的目标肢体指令，控制语音交互单元100开启，并根据所述语音交互单元100接收和识别用户的 目标语音指令，控制智能设备执行与所述目标语音指令相应的动作。
在一些示例性的实施例中，所述方法还包括：
语音交互单元100处于开启状态时，语音交互单元100在所述预定待机时间内是否接收到语音指令；若否，向所述语音交互单元100关闭。
在一些示例性的实施例中，所述方法还包括：
语音交互单元100处于开启状态时，判断在预定时间内所述语音交互单元100是否接收到语音指令；若否，控制光电感应单元200关闭。
在一些示例性的实施例中，所述方法中，所述光电感应单元200接收到所述第二关闭指令或来自用户的关闭操作时，点亮所述第一颜色指示灯410；接收到来自所述语音交互单元100的第二开启指令或来自用户的开启操作时，点亮所述第二颜色指示灯420。
在一些示例性的实施例中，所述方法还包括：
接收并识别智能设备中图像采集单元400所采集的图像数据；
当所述图像数据包括目标手势时，控制所述光电感应单元200和所述语音交互单元100开启。
对于该语音交互方法的具体语音交互过程，与本公开提供的语音交互系统的具体语音交互过程相同，在此不再赘述。
本公开实施例还提供一种智能设备，在所述智能设备上设有本公开实施例提供的语音交互系统。
本公开实施例提供的智能设备可以包括智能冰箱、智能洗衣机、智能电视等，应用场景不只局限于家用电器，还可应用于服装商场导购、自助便利店等应用场景。
有以下几点需要说明：
(1)本公开实施例附图只涉及到与本公开实施例涉及到的结构，其他结构可参考通常设计。
(2)为了清晰起见，在用于描述本公开的实施例的附图中，层或区域的厚度被放大或缩小，即这些附图并非按照实际的比例绘制。可以理解，当诸如层、膜、区域或基板之类的元件被称作位于另一元件“上”或“下”时，该元件可以“直接”位于另一元件“上”或“下”或者可以存在中间元件。
(3)在不冲突的情况下，本公开的实施例及实施例中的特征可以相互组合以得到新的实施例。
以上，仅为本公开的具体实施方式，但本公开的保护范围并不局限于此，本公开的保护范围应以权利要求的保护范围为准。
Claims (20)
- 一种语音交互系统，其特征在于，包括：语音交互单元，用于采集并识别用户的目标语音指令；光电感应单元，所述光电感应单元与所述语音交互单元连接，用于接收并识别用户的目标肢体指令，并根据所述目标肢体指令控制所述语音交互单元开关；指令控制单元，所述指令控制单元与所述语音交互单元连接，用于判断语音交互单元是否处于开启状态；若是，判断所述语音交互单元在预定时间内是否接收到目标语音指令，若在所述预定时间内接收到目标语音指令时，根据所述语音交互单元接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作；若在所述预定时间内未接收到语音指令时，向所述语音交互单元发送待机指令。
- 根据权利要求1所述的语音交互系统，其特征在于，所述指令控制单元还用于识别所述语音交互单元在所述预定待机时间内是否接收到语音指令；若否，向所述语音交互单元发送第一关闭指令。
- 根据权利要求1所述的语音交互系统，其特征在于，所述光电感应单元包括光电传感器，且所述光电传感器为激光距离传感器。
- 根据权利要求4所述的语音交互系统，其特征在于，所述激光距离传感器的感应距离为80～150mm。
- 根据权利要求1所述的语音交互系统，其特征在于，所述光电感应单元上设有指示灯，所述指示灯包括第一颜色指示灯和第二颜色指示灯；所述语音交互单元还用于：当接收到所述第一关闭指令时，向所述光电感应单元发送第二关闭指令；所述光电感应单元还用于在接收到所述第二关闭指令或来自用户的关闭操作时，点亮所述第一颜色指示灯；接收到第一开启指令或来自用户的开启操作时，点亮所述第二颜色指示灯。
- 根据权利要求1所述的语音交互系统，其特征在于，所述光电感应单元包括：外壳，所述外壳的内部中空，所述外壳包括前端和后端，所述前端的端面上设有指示标识，后端开口；设置于所述外壳内的光电传感器；设置于外壳内的线路板，所述线路板上设有开关电路，所述开关电路与所述光电传感器连接；设置于所述外壳内的指示灯；扣装在所述外壳的后端的后盖；信号传输线束，所述信号传输线束一端与线路板连接，另一端伸出所述后盖。
- 根据权利要求6所述的语音交互系统，其特征在于，所述指示标识包括阴刻镂空标识，且所述前端的端面在除所述阴刻镂空标识之外的区域为黑色丝印区，所述黑色丝印区在所述前端的端面四周边缘具有留白区。
- 根据权利要求6所述的语音交互系统，其特征在于，所述外壳采用可透光的注塑壳体，所述可透光的注塑壳体的材料为透光率大于预定阈值的注塑材料与色母粒子的混合材料。
- 根据权利要求8所述的语音交互系统，其特征在于，所述注塑材料选用丙烯腈-丁二烯-苯乙烯塑料。
- 根据权利要求5所述的语音交互系统，其特征在于，在所述外壳内侧且围绕所述前端的端面四周设有导光条。
- 根据权利要求10所述的语音交互系统，其特征在于，所述指示灯包括至少两个第一颜色指示灯和至少两个第二颜色指示灯，其中，至少两个所述第一颜色指示灯分别位于所述前端的端面相对两侧，至少两个第二颜色指示灯分别位于所述前端的端面相对两侧。
- 根据权利要求1所述的语音交互系统，其特征在于，所述语音交互系统还包括图像采集单元，所述指令控制单元与所述图像采集单元连接，用于接收并识别图像采集单元所采集的图像数据，并当所述图像数据包括目标手势时，向所述语音交互单元发送第一开启指令；所述语音交互单元还用于接收到所述第一开启指令时，向所述光电感应单元发送第二开启指令。
- 根据权利要求1所述的语音交互系统，其特征在于，所述语音交互单元与所述指令控制单元之间通过串口指令进行通讯，所述语音交互单元与所述指令控制单元之间通过串口指令进行通讯。
- 根据权利要求5所述的语音交互系统，其特征在于，所述前端上设有第一通孔和第二通孔；所述光电传感器上设有接收极和发射极，所述接收极位于所述第一通孔处，所述发射极位于所述第二通孔处。
- 一种语音交互方法，其特征在于，应用于如权利要求1至14任一项所述的语音交互系统，所述方法包括：判断语音交互单元是否处于开启状态；若是，判断所述语音交互单元是否在预定时间内接收到目标语音指令，若在所述预定时间内接收到目标语音指令时，根据所述语音交互单元接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作；若在所述预定时间内未接收到语音指令时，向所述语音交互单元发送待机指令；若否，根据光电感应单元所接收和识别的用户的目标肢体指令，控制语音交互单元开启，并根据所述语音交互单元接收和识别用户的目标语音指令，控制智能设备执行与所述目标语音指令相应的动作。
- 根据权利要求15所述的语音交互方法，其特征在于，所述方法还包括：所述语音交互单元处于开启状态时，判断语音交互单元在所述预定待机时间内是否接收到语音指令；若否，控制语音交互单元关闭。
- 根据权利要求15所述的语音交互方法，其特征在于，所述方法还包括：所述语音交互单元处于开启状态时，判断在预定时间内所述语音交互单元是否接收到语音指令；若否，控制光电感应单元关闭。
- 根据权利要求15所述的方法，其特征在于，所述光电感应单元接收到第二关闭指令或来自用户的关闭操作时，点亮第一颜色指示灯；接收到所述第一开启指令或来自用户的开启操作时，点亮 第二颜色指示灯。
- 根据权利要求15所述的语音交互方法，其特征在于，所述方法还包括：接收并识别图像采集单元所采集的图像数据；当所述图像数据包括目标手势时，控制所述光电感应单元和所述语音交互单元开启。
- 一种智能设备，其特征在于，在所述智能设备上设有如权利要求1至14任一项所述的语音交互系统。
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202280000691.8A CN117178321A (zh) | 2022-04-02 | 2022-04-02 | 语音交互系统及方法、智能设备 |
| PCT/CN2022/085051 WO2023184535A1 (zh) | 2022-04-02 | 2022-04-02 | 语音交互系统及方法、智能设备 |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2022/085051 WO2023184535A1 (zh) | 2022-04-02 | 2022-04-02 | 语音交互系统及方法、智能设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023184535A1 true WO2023184535A1 (zh) | 2023-10-05 |
Family
ID=88198858
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/085051 WO2023184535A1 (zh) | 2022-04-02 | 2022-04-02 | 语音交互系统及方法、智能设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN117178321A (zh) |
| WO (1) | WO2023184535A1 (zh) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004198581A (ja) * | 2002-12-17 | 2004-07-15 | Matsushita Electric Ind Co Ltd | 音声対話型制御装置 |
| CN106826838A (zh) * | 2017-04-01 | 2017-06-13 | 西安交通大学 | 一种基于Kinect视觉深度传感器的交互仿生机械臂控制方法 |
| CN108509619A (zh) * | 2018-04-04 | 2018-09-07 | 科大讯飞股份有限公司 | 一种语音交互方法及设备 |
| CN109754801A (zh) * | 2019-01-15 | 2019-05-14 | 东莞松山湖国际机器人研究院有限公司 | 一种基于手势识别的语音交互系统及方法 |
| CN113192509A (zh) * | 2021-05-28 | 2021-07-30 | 北京京东方显示技术有限公司 | 语音交互系统及方法、智能设备 |
| CN214544552U (zh) * | 2021-05-13 | 2021-10-29 | 上海匠岩智能科技有限公司 | 一种语音声控的执法记录仪 |
-
2022
- 2022-04-02 WO PCT/CN2022/085051 patent/WO2023184535A1/zh unknown
- 2022-04-02 CN CN202280000691.8A patent/CN117178321A/zh active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004198581A (ja) * | 2002-12-17 | 2004-07-15 | Matsushita Electric Ind Co Ltd | 音声対話型制御装置 |
| CN106826838A (zh) * | 2017-04-01 | 2017-06-13 | 西安交通大学 | 一种基于Kinect视觉深度传感器的交互仿生机械臂控制方法 |
| CN108509619A (zh) * | 2018-04-04 | 2018-09-07 | 科大讯飞股份有限公司 | 一种语音交互方法及设备 |
| CN109754801A (zh) * | 2019-01-15 | 2019-05-14 | 东莞松山湖国际机器人研究院有限公司 | 一种基于手势识别的语音交互系统及方法 |
| CN214544552U (zh) * | 2021-05-13 | 2021-10-29 | 上海匠岩智能科技有限公司 | 一种语音声控的执法记录仪 |
| CN113192509A (zh) * | 2021-05-28 | 2021-07-30 | 北京京东方显示技术有限公司 | 语音交互系统及方法、智能设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117178321A (zh) | 2023-12-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2022247156A1 (zh) | 语音交互系统及方法、智能设备 | |
| WO2018049637A1 (zh) | 指纹采集装置及方法、终端设备及屏幕亮灭的控制方法 | |
| EP3451335A1 (en) | Optimum control method based on multi-mode command of operation-voice, and electronic device to which same is applied | |
| CN110502109B (zh) | 信息处理方法、装置、电子设备及存储介质 | |
| CN107438852B (zh) | 一种传感器装置及移动终端 | |
| CN106444998B (zh) | 一种面板、传感器组件及移动终端 | |
| CN103345360A (zh) | 一种智能终端触摸屏手势识别方法 | |
| WO2017166066A1 (zh) | 红外遥控方法、终端及装置 | |
| US20120092254A1 (en) | Proximity sensor with motion detection | |
| CN109597531A (zh) | 一种基于平面手势操作的照明设备控制装置及控制系统 | |
| WO2022042274A1 (zh) | 一种语音交互方法及电子设备 | |
| TW201421280A (zh) | 手勢辨識裝置及複合式光學裝置 | |
| CN109388285A (zh) | 接近检测模式切换方法、装置、电子设备及存储介质 | |
| CN108156729A (zh) | 照明设备、照明设备的控制方法及装置 | |
| CN108710436A (zh) | 一种基于tof手势识别的控制系统 | |
| WO2019100955A1 (zh) | 显示装置及电子设备 | |
| CN108803426A (zh) | 一种基于tof手势识别的车机控制系统 | |
| US20240152098A1 (en) | Display method, wrist-worn device and computer-readable storage medium | |
| WO2023184535A1 (zh) | 语音交互系统及方法、智能设备 | |
| CN110580115B (zh) | 一种镜面显示装置及控制方法 | |
| CN206209631U (zh) | 一种智能笔和交互设备 | |
| WO2017181385A1 (zh) | 一种手持电子设备 | |
| CN107506704A (zh) | 移动终端及其指纹检测方法 | |
| CN215730852U (zh) | 语音交互系统及智能设备 | |
| CN110196617A (zh) | 移动终端 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22934364 Country of ref document: EP Kind code of ref document: A1 |