WO2023109415A1 - 一种全息互动系统 - Google Patents
一种全息互动系统 Download PDFInfo
- Publication number
- WO2023109415A1 WO2023109415A1 PCT/CN2022/132356 CN2022132356W WO2023109415A1 WO 2023109415 A1 WO2023109415 A1 WO 2023109415A1 CN 2022132356 W CN2022132356 W CN 2022132356W WO 2023109415 A1 WO2023109415 A1 WO 2023109415A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- capacitor
- terminal
- control chip
- chip
- resistor
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Definitions
- the invention relates to the technical field of data processing, in particular to a holographic interactive system.
- An electronic pet is an electronic toy composed of electronic components (hardware and software). Now it also refers to a specific program that runs on a computer or an Internet server. ) are widely used. Electronic pets have the same life characteristics as real pets.
- the patent document with the application number of 201610414739.6 in China and the publication date of 2017.9.26 discloses a smart electronic pet voice interaction system and method; it includes a startup module, a voice control module, a local processing module, a cloud storage module and a local storage module;
- the startup module is used to set growth tasks;
- the voice control module is used to control the input, output and recognition of voice;
- the local processing module is used to call the data in the local storage module to determine and judge the user's voice information And perform corresponding operations according to the judgment result;
- the cloud storage module is used to store data in the cloud;
- the local storage module is used to store data.
- the system determines and judges the voice information and performs corresponding operations; however, the system can only judge the waveform of the voice information; and output the corresponding voice information based on the waveform; it cannot distinguish different users by inputting voice information; It cannot produce different interactive effects with different users, and the interactive effect is poor.
- the invention provides a holographic interactive system with good interactive effect.
- the technical solution of the present invention is: a holographic interactive system; an interactive device and a control circuit; the interactive device includes a control chip, a voice recognition module, a voice output module and a display device; the control chip, the voice module and the display device pass through The control circuit is electrically connected.
- the speech recognition module includes a speech recognition unit and a voiceprint recognition unit; the speech recognition unit is used to recognize voice input information and convert the voice input information into a voice waveform; the voiceprint recognition unit is used to recognize voiceprint information; the control chip voiceprint storage unit and more than one first storage unit, the voiceprint storage unit stores voiceprint information; a first storage unit is correspondingly set according to a kind of voiceprint information; the first storage unit stores a first signal waveform, voice output information and interactive information; The first signal waveform is set corresponding to the voice output information and interactive information; the control chip is used to compare the voice waveform and the first signal waveform, and control the voice output module to output the voice output information of the corresponding storage unit according to the comparison result, and control the display device to output the corresponding storage. Interaction information for the unit.
- the voiceprint recognition unit recognizes the voiceprint information; recognizes the identity of the user who has input the current voice information through the voiceprint recognition unit; the control chip outputs the first voice in the first storage unit corresponding to the voiceprint information output information and the first interactive information; since a first storage unit is correspondingly set with a kind of voiceprint information; in this way, the first voice output information and the first interactive information in different first storage units are output for different users; Different users produce different interactive effects; at the same time, the first voice output information and the first interactive information correspond to the first signal waveform; furthermore, when a user inputs different voice input information, the control chip Information; output different first voice output information and first interaction information in a first storage unit.
- the voice recognition module also includes a voice wake-up unit; the voice wake-up unit is used to identify the wake-up signal and convert the wake-up signal into a wake-up waveform; the control chip includes a second storage unit; the second storage unit stores the second signal waveform The control chip is used for comparing the wake-up waveform and the second signal waveform, and controlling the voice recognition unit to recognize the voice input information according to the comparison result.
- the voice wake-up unit is set; when the control chip recognizes the wake-up signal, the voice recognition unit starts to identify the voice input information; the second waveform signal is set to wake up the voice recognition unit; the voice recognition unit performs the wake-up signal. Recognition, improving the accuracy of the speech recognition unit to recognize speech input information.
- the interactive device includes a bracket; the bracket includes a cover, a bottom plate and a support; the cover is located above the bottom; one end of the support is connected to the cover; the other end of the support is connected to the bottom; the display device includes a projector and a three-dimensional The beam splitter; the projector is installed on the cover plate; the stereo beam splitter is arranged on the bottom plate; the projection information of the projector is projected onto the stereo beam splitter. The projection information is projected onto the three-dimensional beam splitter through the projector; the first interactive information displayed by the display device has a three-dimensional effect.
- the display device includes a display module circuit;
- the control circuit includes a power supply circuit, a step-down circuit, a drive circuit, a reset circuit and a crystal oscillator circuit;
- the power supply circuit is connected to the step-down circuit;
- the output end of the step-down circuit is connected to the power supply end of the control chip ;
- the display module circuit, the drive circuit, the reset circuit and the crystal oscillator circuit are respectively connected to the control chip.
- the power supply circuit includes a USB input module, resistor R13, switch SW1 and fuse F1; the VCC end of the USB input module is connected to an external 5V power supply; the GND end of the USB input module is grounded; the VCC end of the USB input module is connected to the input end of the switch SW1; The output terminal outputs 5V voltage.
- the step-down circuit includes a step-down circuit including AMS1117-3V3 chip, capacitor C17, electrolytic capacitor C18, electrolytic capacitor C19 and capacitor C20; the VIN terminal of the AMS1117-3V3 chip is connected to the output terminal of the switch SW1; the GND terminal of the AMS1117-3V3 chip is grounded;
- the electrolytic capacitor C20 is connected to the VIN terminal and the GND terminal of the AMS1117-3V3 chip;
- the electrolytic capacitor C18 is connected to the VOUT terminal and the GND terminal of the AMS1117-3V3 chip;
- the VIN terminal of the AMS1117-3V3 chip is also connected to the capacitor C19, and the output terminal of the capacitor C19 is grounded ;
- the VOUT end of the AMS1117-3V3 chip is connected to the capacitor C17, and the output end of the capacitor C17 is grounded; the end connected to the VOUT end of the capacitor C17 is the output end of the step-down circuit, and the VOUT end of the AMS
- the crystal oscillator circuit includes crystal oscillator X1, capacitor C2, capacitor C3, crystal oscillator X2, capacitor C4, capacitor C5, capacitor C6, capacitor C7, resistor R4 and resistor R5; one end of resistor R4 is connected to the output end of the step-down circuit; the other end of resistor R4 One end is grounded and connected to one end of capacitor C2, one end of capacitor C3, one end of capacitor C4, and one end of capacitor C5; the other end of capacitor C2 is connected to the PC14 end of the control chip, and is connected to one end of crystal oscillator X1; the other end of capacitor 3 Connect with the PC15 end of the control chip, and connect with the other end of the crystal oscillator X1; connect the other end of the capacitor C4 with the PC0 end of the control chip, and connect with one end of the crystal oscillator X1 and one end of the resistor R5; The other end is connected to the other end of the resistor R5; the capacitor C6 is connected between the resistor R4 and the capacitor C4
- the reset circuit includes a resistor R3, a button KEY1, a capacitor C1, a battery B1, a diode D2 and a diode D1; one end of the resistor R3 is connected to the output terminal of the step-down circuit; the other end of the resistor R3 is connected to one end of the button KEY1 and one end of the capacitor C1 ; The other end of the capacitor C1 is connected to the other end of the button KEY1 and the negative pole of the battery B1, and grounded; the positive pole of the battery B1 is connected to the input end of the diode D2; the input end of the diode D2 is connected to the VBAT end of the control chip, and connected to the diode The output terminal of D1 is connected; the input terminal of diode D1 is connected with the output terminal of the step-down circuit.
- the drive circuit includes drive chip, diode D3, resistor R6, capacitor C12, capacitor C13, transistor Q1, resistor R7, resistor R8, resistor R9, transistor Q2, resistor C14, crystal oscillator X3, capacitor C15 and capacitor C16; the GND terminal of the driver chip Grounding; the TXD end of the driver chip is connected to the PA9 end of the control chip; the RXD end of the driver chip is connected to the PA10 end of the control chip; the VCC end of the driver chip is connected to the VCC end of the USB input module, and is connected to one end of the capacitor C12 and the capacitor One end of C13 is connected; the other end of capacitor C12 is connected to the other end of capacitor C13, and grounded; the DTR end of the driver chip is connected to one end of resistor R17; the other end of resistor R17 is connected to the base of transistor Q1; the collector of transistor Q1 The electrode is connected to the output end of the diode D3 and one end of the resistor R6; the input end of the
- the V3 end of the driver chip is connected to one end of the capacitor C14; the other end of the capacitor C14 is grounded; the D3 end of the driver chip is connected to the D1 end of the USB input module; the D4 end of the driver chip is connected to the D2 end of the USB input module; the NC end of the driver chip It is connected with one end of the capacitor C15 and one end of the crystal oscillator X3; the other end of the crystal oscillator X3 is connected with the other end of the capacitor C15 and grounded; the capacitor C16 is connected between the capacitor C15 and the crystal oscillator X3.
- the VCC end of the USB input module is connected to an external 5V power supply; the 5V voltage is converted to a 3.3V voltage through the step-down circuit; the output terminal of the step-down circuit outputs a voltage of 3.3V for the control chip, reset circuit, crystal oscillator circuit and display module circuit Power supply; at the same time, the output terminal of the step-down circuit is connected to the D2 terminal of the USB; in this way, the 3.3V voltage that has completed the step-down is input into the USB input module, and the level of the electrical signal output by the USB input module is raised; the level is raised
- the driving circuit for the input of the final electrical signal; the electrical signal after the raised level output by the USB input module is input into the transistor Q1 and the transistor Q2 of the driving circuit; the transistor Q1 and the transistor Q2 are turned on; at the same time, the VCC terminal of the USB input module Connect with one end of the capacitor C12 in the driving circuit; the USB input module provides a 5V power supply voltage for the driving circuit; connect the control chip
- a capacitor C8 is connected between the VDD1 end of the control chip and the VSS1 end of the control chip; a capacitor C9 is connected between the VDD2 end of the control chip and the VSS2 end of the control chip; the VDD3 end of the control chip and the VSS3 end of the control chip A capacitor C10 is connected between them; a capacitor C1 is connected between the VDD4 end of the control chip and the VSS4 end of the control chip.
- the PC10 end of the control chip is connected with the voice recognition module and the voice output module; the power supply terminal of the voice recognition module is connected with the output terminal of the step-down circuit; the ground terminal of the voice recognition module is grounded; the power supply terminal of the voice output module is connected with the step-down circuit The output end of the circuit is connected; the ground end of the voice output module is grounded.
- the display module circuit also includes a capacitor C21, a capacitor C22, a capacitor C23 and a display power supply; the GND end of the display chip is grounded; the VDD end of the display chip is connected to one end of the capacitor C21; the BLVDD end of the display chip is connected to one end of the capacitor C23
- the other end of the capacitor C21 is connected to the other end of the capacitor C21 and one end of the capacitor C22, and is connected to the display power supply; the other end of the capacitor C22 is connected to the display power supply; the display power supply is connected to the output end of the step-down circuit.
- 1 is a schematic diagram of the connection between the voice recognition module, voice output module, display device, drive circuit, power supply circuit, step-down circuit, reset circuit and crystal oscillator circuit of the present invention and the control chip.
- Fig. 2 is a schematic diagram of the power supply circuit of the present invention.
- Fig. 3 is a schematic diagram of the step-down circuit of the present invention.
- FIG. 4 is a schematic diagram of the driving circuit of the present invention.
- FIG. 5 is a schematic diagram of the control chip of the present invention.
- FIG. 6 is a schematic diagram of VBAT, VDD and VSS pins of the control chip in the present invention.
- FIG. 7 is a schematic diagram of the crystal oscillator circuit of the present invention.
- FIG. 8 is four schematic diagrams of the invented reset circuit.
- FIG. 9 is a schematic diagram of a display module circuit of the present invention.
- FIG. 10 is a schematic diagram of the speech recognition module of the present invention.
- Fig. 11 is a schematic diagram of the speech output module of the present invention.
- Fig. 12 is a schematic diagram of the bracket and the display device of the present invention.
- a holographic interactive system As shown in Figure 1-12; a holographic interactive system; an interactive device and a control circuit; the interactive device includes a control chip 1, a voice recognition module 2, a voice output module 3 and a display device; a control chip 1, a voice recognition module, and a voice output The module and the display device are electrically connected through the control circuit.
- the voice recognition module 2 includes a voice recognition unit and a voiceprint recognition unit; the voice recognition unit is used to recognize voice input information, and converts the voice input information into a voice waveform; the voiceprint recognition unit is used to recognize voiceprint information; the control chip 1 includes voice A fingerprint storage unit and more than one first storage unit, the voiceprint storage unit stores voiceprint information; a first storage unit is correspondingly set according to a kind of voiceprint information; the first storage unit stores the first signal waveform, voice output information and Interactive information; the first signal waveform is set correspondingly to the voice output information and the interactive information; the control chip 1 is used to compare the voice waveform and the first signal waveform, and control the voice output module 3 to output the voice output information and control of the corresponding storage unit according to the comparison result
- the display device outputs interaction information corresponding to the storage unit.
- the voiceprint recognition unit recognizes the voiceprint information; recognizes the identity of the user who has input the current voice information through the voiceprint recognition unit; the control chip 1 outputs the first voice output information in the first storage unit corresponding to the voiceprint information and the first interactive information; because a first storage unit is correspondingly set with a kind of voiceprint information; thus outputting the first voice output information and the first interactive information in different first storage units for different users; this can be compared with different
- the user generates different interactive effects; at the same time, the first voice output information and the first interactive information correspond to the first signal waveform; furthermore, when a user inputs different voice input information, the control chip 1 will input information according to the current user's voice ; Output different first voice output information and first interaction information in a first storage unit.
- the voice recognition module 2 also includes a voice wake-up unit; the voice wake-up unit is used to identify the wake-up signal, and converts the wake-up signal into a wake-up waveform; the control chip 1 includes a second storage unit; the second storage unit stores the second signal waveform, The control chip 1 is used for comparing the wake-up waveform and the second signal waveform, and controlling the voice recognition unit to recognize voice input information according to the comparison result.
- the voice wake-up unit is set; when the control chip 1 recognizes the wake-up signal, the voice recognition unit starts to identify the voice input information again; the second waveform signal is set to wake up the voice recognition unit; the voice recognition unit recognizes the information after the wake-up signal, Improve the accuracy of the speech recognition unit to recognize speech input information.
- the interactive device includes a bracket; the bracket includes a cover plate 41, a base plate 42 and a support member 43; the cover plate 41 is located above the base plate 42; one end of the support member 43 is connected to the cover plate 41; the other end of the support member 43 is connected to the base plate 42;
- the device includes a projector 44 and a three-dimensional beam splitter 45; the projector 44 is installed on the cover plate 41; The projection information is projected onto the three-dimensional beam splitter 45 by the projector 44; the first interactive information displayed by the display device has a three-dimensional effect.
- the display device comprises a display module circuit 46; the control circuit comprises a power supply circuit 5, a step-down circuit 6, a drive circuit 7, a reset circuit 8 and a crystal oscillator circuit 9; the power supply circuit 5 is connected with the step-down circuit 6; the output terminal of the step-down circuit 6 is connected with the step-down circuit The power terminal of the control chip 1 is connected; the display module circuit 46 , the driving circuit 7 , the reset circuit 8 and the crystal oscillator circuit 9 are respectively connected to the control chip 1 .
- the control chip model is STM32F103RCT6;
- the power supply circuit 5 includes a USB input module, resistor R13, switch SW1 and fuse F1;
- the VCC end of the USB input module is connected to an external 5V power supply;
- the GND end of the USB input module is grounded;
- the VCC end of the USB input module is connected to the switch SW1 The input terminal is connected; the output terminal of the switch SW1 outputs 5V voltage.
- Step-down circuit 6 includes step-down circuit 6 including AMS1117-3V3 chip, capacitor C17, electrolytic capacitor C18, electrolytic capacitor C19 and capacitor C20; the VIN end of AMS1117-3V3 chip is connected to the output end of switch SW1; the GND end of AMS1117-3V3 chip Ground; the electrolytic capacitor C20 is connected to the VIN terminal and the GND terminal of the AMS1117-3V3 chip; the electrolytic capacitor C18 is connected to the VOUT terminal and the GND terminal of the AMS1117-3V3 chip; the VIN terminal of the AMS1117-3V3 chip is also connected to the capacitor C19, and the output of the capacitor C19 The VOUT terminal of the AMS1117-3V3 chip is connected to the capacitor C17, and the output terminal of the capacitor C17 is grounded; the end of the capacitor C17 connected to the VOUT terminal is the output terminal of the step-down circuit 6, and the VOUT terminal of the AMS1117-3V3 chip is connected to the step-down circuit 6 The output end
- Crystal oscillator circuit 9 includes crystal oscillator X1, capacitor C2, capacitor C3, crystal oscillator X2, capacitor C4, capacitor C5, capacitor C6, capacitor C7, resistor R4 and resistor R5; one end of resistor R4 is connected to the output end of step-down circuit 6; resistor R4 The other end of the capacitor is grounded and connected to one end of the capacitor C2, one end of the capacitor C3, one end of the capacitor C4, and one end of the capacitor C5; the other end of the capacitor C2 is connected to the PC14 end of the control chip 1, and is connected to one end of the crystal oscillator X1; the capacitor C3 The other end of the capacitor C4 is connected to the PC15 end of the control chip 1, and is connected to the other end of the crystal oscillator X1; the other end of the capacitor C4 is connected to the PC0 end of the control chip 1, and is connected to one end of the crystal oscillator X1 and one end of the resistor R5; the other end of the capacitor C5 One end is connected to the other end of
- the reset circuit 8 includes a resistor R3, a button KEY1, a capacitor C1, a battery B1, a diode D2 and a diode D1; one end of the resistor R3 is connected to the output terminal of the step-down circuit 6; the other end of the resistor R3 is connected to one end of the button KEY1 and the capacitor C1 One end is connected; the other end of the capacitor C1 is connected to the other end of the button KEY1 and the negative pole of the battery B1, and grounded; the positive pole of the battery B1 is connected to the input end of the diode D2; the input end of the diode D2 is connected to the VBAT end of the control chip 1, And it is connected with the output end of the diode D1; the input end of the diode D1 is connected with the output end of the step-down circuit 6 .
- the driving circuit 7 includes a driving chip 71, a diode D3, a resistor R6, a capacitor C12, a capacitor C13, a transistor Q1, a resistor R7, a resistor R8, a resistor R9, a transistor Q2, a resistor C14, a crystal oscillator X3, a capacitor C15 and a capacitor C16;
- the driver chip is CH340CC chip; the GND terminal of the driver chip is grounded;
- the TXD terminal of the driver chip is connected to the PA9 terminal of the control chip 1;
- the RXD terminal of the driver chip is connected to the PA10 terminal of the control chip 1;
- the VCC terminal of the driver chip is connected to the VCC terminal of the USB input module connected to one end of capacitor C12 and one end of capacitor C13; the other end of capacitor C12 is connected to the other end of capacitor C13 and grounded;
- the DTR end of the driver chip is connected to one end of resistor R17; the other end of resistor R17 is connected
- the V3 end of the driver chip is connected to one end of the capacitor C14; the other end of the capacitor C14 is grounded; the D3 end of the driver chip is connected to the D1 end of the USB input module; the D4 end of the driver chip is connected to the D2 end of the USB input module; the D3 end of the driver chip is the positive pole; the D4 terminal of the driver chip is the negative pole.
- the NC end of the driver chip is connected to one end of the capacitor C15 and one end of the crystal oscillator X3; the other end of the crystal oscillator X3 is connected to the other end of the capacitor C15 and grounded; the capacitor C16 is connected between the capacitor C15 and the crystal oscillator X3.
- the VCC end of the USB input module is externally connected to a 5V power supply; the 5V voltage is converted to a 3.3V voltage by the step-down circuit 6; the output terminal of the step-down circuit 6 outputs a voltage of 3.3V for the control chip 1, the reset circuit 8, the crystal oscillator circuit 9 and the display
- the module circuit 46 supplies power; the output end of the step-down circuit 6 is connected to the D2 end of the USB simultaneously; the 3.3V voltage that will complete the step-down is input in the USB input module in this way, and the level of the electrical signal output by the USB input module is raised;
- the driving circuit 7 for the input of the electrical signal after the raised level; the electrical signal after the raised level output by the USB input module is input to the transistor Q1 and the transistor Q2 of the driver circuit 7; the transistor Q1 and the transistor Q2 are turned on; at the same time
- the VCC end of the USB input module is connected with one end of the capacitor C12 in the drive circuit 7; the USB input module provides the power supply voltage of 5
- a capacitor C8 is connected between the VDD1 end of the control chip 1 and the VSS1 end of the control chip 1; a capacitor C9 is connected between the VDD2 end of the control chip 1 and the VSS2 end of the control chip 1; the VDD3 end of the control chip 1 is connected to the VSS2 end of the control chip 1 A capacitor C10 is connected between the VSS3 terminals of the control chip 1 ; a capacitor C1 is connected between the VDD4 terminal of the control chip 1 and the VSS4 terminal of the control chip 1 . Connect capacitors between the VDD1 terminal and VDD2 terminal, between VDD2 terminal and VSS2 terminal, between VDD3 terminal and VSS3 terminal, between VDD4 terminal and VSS4 terminal of control chip 1; other pins of control chip 1.
- the PC10 end of the control chip 1 is connected with the voice recognition module 2 and the voice output module 3; the power supply end of the voice recognition module 2 is connected with the output end of the step-down circuit 6; the ground terminal of the voice recognition module 2 is grounded; the power supply of the voice output module 3 The end is connected with the output end of the step-down circuit 6; the ground end of the voice output module 3 is grounded.
- the display module circuit 46 includes a display chip 461; the display chip is a TFTLCD chip; the PA6 end, PA7 end, PB0 end, PB1 end, PB2 end, PB3 end, PB4 end, PB5 end, PB6 end, PB7 end, PB8 end of the control chip 1 terminal, PB9 terminal, PB10 terminal, PB11 terminal, PB12 terminal, PB13 terminal, PB14 terminal, PB15 terminal, PC0 terminal, PC1 terminal, PC6 terminal, PC7 terminal, PC8 terminal, PC9 terminal and PC10 terminal and the TMISO terminal of the display chip, TMOSI terminal, LCDD0 terminal, LCDD1 terminal, LCDD2 terminal, LCDD3 terminal, LCDD4 terminal, LCDD5 terminal, LCDD6 terminal, LCDD7 terminal, LCDD8 terminal, LCDD9 terminal, LCDD10 terminal, LCDD11 terminal, LCDD12 terminal, LCDD13 terminal, LCDD14 terminal, LCDD15 terminal , TSKN end, TPEN end,
- the display module circuit 46 also includes a capacitor C21, a capacitor C22, a capacitor C23 and a display power supply 462; the GND end of the display chip is grounded; the VDD end of the display chip is connected to one end of the capacitor C21; the BLVDD end of the display chip is connected to one end of the capacitor C23; The other end of the capacitor C21 is connected to the other end of the capacitor C21 and one end of the capacitor C22, and is connected to the display power supply 462; the other end of the capacitor C22 is connected to the display power supply 462;
- the interactive method of the interactive system includes the following steps:
- Pre-recorded voiceprint information one kind of voiceprint information corresponds to one first storage unit;
- the voice wake-up unit receives voice information in real time, and converts the received voice information into a wake-up waveform; the control chip compares the current wake-up waveform with the second signal waveform; if the current wake-up waveform is similar to the second signal waveform , proceed to step (4); if the current wake-up waveform is not similar to the second signal waveform, repeat step (3).
- the control chip determines that the current wake-up waveform is a wake-up signal, and the control chip controls the voice recognition module to start.
- the speech recognition module receives the speech information, and if the speech recognition module receives the speech information, proceed to step (5).
- the voiceprint recognition unit recognizes the voiceprint information in the current voice information, the voice recognition unit recognizes the voice input information in the current voice information, and converts the received voice input information into a voice waveform; the control chip detects the voiceprint storage unit Whether there is currently recognized voiceprint information in , if yes, go to step (6).
- Step (7) if the current voice waveform is not similar to the first signal waveform, go to step (4.1).
- the voice output module outputs the first voice output information corresponding to the first signal waveform; the display device outputs the first interaction information corresponding to the first signal waveform.
- the voice recognition unit recognizes the voice input information again, and the voice recognition unit recognizes the accuracy of the voice input information; then after the voiceprint information in the voice information is recognized; the control chip Identify the first storage unit that matches the current voiceprint information from several first storage units; then identify the voice input information in the voice information and convert it into a voice waveform; output the current voice waveform in the first storage unit that matches the current voice waveform Corresponding first voice output information and first interaction information; different users are distinguished by identifying voiceprint information, and the information in the first storage unit corresponding to the user is output; according to the voice input information of the current user, the corresponding first voice input information is output A voice output information and the first interactive information; to achieve different interactive effects with different users; at the same time, different voice input information input by the same user can also produce different interactive effects.
- the voice information can be input repeatedly to improve the accuracy of the recognition result of the
Abstract
一种全息互动系统，包括互动装置，互动装置中的声纹识别单元识别声纹信息，从而获得输入当前语音信息的使用者的身份；互动装置中的控制芯片输出与该声纹信息对应的第一储存单元中的第一语音输出信息和第一互动信息；由于一个第一储存单元与一种声纹信息对应设置；这样针对不同使用者输出不同第一储存单元中的第一语音输出信息和第一互动信息；这样能与不同的使用者产生不同的互动效果；同时第一语音输出信息和第一互动信息与第一信号波形对应；进而当一个使用者输入不同的语音输入信息时，控制芯片根据当前使用者的语音输入信息；输出一个第一储存单元中不同的第一语音输出信息和第一互动信息。
Description
本发明涉及数据处理技术领域，具体涉及一种全息互动系统。
宠物饲养过程中，需要人员定时监管，但许多上班族由于工作规定，工作时间禁止携带宠物，因此无法同时兼顾工作与家庭，经常遇到将宠物搁置家中无人看管的状况，宠物需要主人的陪伴也需要娱乐消耗精力，否则会因为抑郁影像健康或因为精力旺盛破坏家中的物品，影响饲养者的正常生活，因此需要在家中无人时也提供宠物的娱乐与陪伴。电子宠物是由电子元件(硬件和软件)构成的电子玩具，现在也指使用电脑或因特网服务器上运行的特定程序，目前的电子宠物概念在有显示屏的电子器件(如宠物机，手机，电脑)的应用都比较广泛。电子宠物具有和真实宠物同样的生命特性。
在中国申请号为201610414739.6，公布日为2017.9.26的专利文献公开了一种智能电子宠物语音交互系统及方法；统包括启动模块、语音控制模块、本地处理模块、云端存储模块以及本地存储模块；所述启动模块用于设定成长任务；所述语音控制模块用于控制语音的输入、输出以及识别；所述本地处理模块用于调用本地存储模块内的数据对用户的语音信息进行确定、判断并根据判断结果执行相应的操作；所述云端存储模块用于在云端存储数据；所述本地存储模块用于存储数据。
该系统通过对语音信息进行确定、判断并执行相应的操作；但是该系统只能对语音信息的波形进行判断；并根波形输出对应的语音信息；其不能通过输入语音信息区分不同的使用者；不能与不同使用者产生不同的交互效果，互动效果差。
发明内容
本发明提供一种互动效果好的全息互动系统。
为达到上述目的，本发明的技术方案是：一种全息互动系统；互动装置和控制电路；互动装置包括控制芯片、语音识别模块、语音输出模块和显示装置；控制芯片、语音模块和显示装置通过控制电路电连接。
语音识别模块包括语音识别单元和声纹识别单元；语音识别单元用于识别语音输入信息，并将语音输入信息转换为语音波形；声纹识别单元用于识别声纹信息；控制芯片声纹储存单元和一个以上的第一储存单元，声纹储存单元储存有声纹信息；一个第一储存单元根据 一种声纹信息对应设置；第一储存单元储存有第一信号波形、语音输出信息和互动信息；第一信号波形与语音输出信息和互动信息对应设置；控制芯片用于对比语音波形和第一信号波形，并根据对比结果控制语音输出模块输出对应储存单元的语音输出信息、控制显示装置输出对应储存单元的互动信息。
以上设置，声纹识别单元识别声纹信息；通过声纹识别单元识别出识别出输入当前语音信息的使用者的身份；控制芯片输出与该声纹信息对应的第一储存单元中的第一语音输出信息和第一互动信息；由于一个第一储存单元与一种声纹信息对应设置；这样针对不同使用者输出不同第一储存单元中的第一语音输出信息和第一互动信息；这样能与不同的使用者产生不同的互动效果；同时第一语音输出信息和第一互动信息与第一信号波形对应；进而当一个使用者输入不同的语音输入信息时，控制芯片根据当前使用者的语音输入信息；输出一个第一储存单元中不同的第一语音输出信息和第一互动信息。
进一步的，语音识别模块还包括语音唤醒单元；语音唤醒单元用于识别唤醒信号，并将唤醒信号转换为唤醒波形；所述控制芯片包括第二储存单元；第二储存单元储存有第二信号波形，控制芯片用于对比唤醒波形和第二信号波形，并根据对比结果控制语音识别单元识别语音输入信息。
以上设置，设置语音唤醒单元；当控制芯片识别到唤醒信号时，语音识别单元启动再对语音输入信息进行识别；同时设置第二波形信号唤醒语音识别单元；语音识别单元对唤醒信号之后的信息进行识别，提高语音识别单元识别语音输入信息的准确性。
进一步的，互动装置包括支架；支架包括盖板、底板和支撑件；所述盖板位于底板上方；支撑件一端与盖板连接；支撑件的另一端与底板连接；显示装置包括投影仪和立体分光镜；投影仪安装在盖板上；所述立体分光镜设置在底板上；投影仪的投影信息投影到立体分光镜上。通过投影仪将投影信息投影到立体分光镜上；显示装置显示的第一互动信息具有立体感。
进一步的，显示装置包括显示模块电路；控制电路包括电源电路、降压电路、驱动电路、复位电路和晶振电路；电源电路与降压电路连接；降压电路的输出端与控制芯片的电源端连接；显示模块电路、驱动电路、复位电路和晶振电路分别与控制芯片连接。
电源电路包括USB输入模块、电阻R13、开关SW1和保险丝F1；USB输入模块的VCC端外接5V电源；USB输入模块的GND端接地；USB输入模块的VCC端与开关SW1输入端连接；开关SW1的输出端输出5V电压。
降压电路包括降压电路包括AMS1117-3V3芯片、电容C17、电解电容C18、电解电容C19和电容C20；AMS1117-3V3芯片的VIN端连接开关SW1的输出端；AMS1117-3V3芯片的GND 端接地；电解电容C20连接在AMS1117-3V3芯片的VIN端与GND端；电解电容C18连接在AMS1117-3V3芯片的VOUT端与GND端；AMS1117-3V3芯片的VIN端还连接电容C19，电容C19的输出端接地；AMS1117-3V3芯片的VOUT端连接电容C17，电容C17的输出端接地；电容C17与VOUT端相连的一端为降压电路的输出端，AMS1117-3V3芯片的VOUT端连接降压电路的输出端；降压电路的输出端输出3.3V电压；降压电路的输出端与电阻R13的一端连接；电阻R13的另一端与USB输入模块的D2端连接。
晶振电路包括晶振X1、电容C2、电容C3、晶振X2、电容C4、电容C5、电容C6、电容C7、电阻R4和电阻R5；电阻R4的一端与降压电路的输出端连接；电阻R4的另一端接地且与电容C2的一端、电容C3的一端、电容C4的一端、电容C5的一端连接；电容C2的另一端与控制芯片的PC14端连接，且与晶振X1一端连接；电容3的另一端与控制芯片的PC15端连接，且与晶振X1另一端连接；电容C4的另一端与控制芯片的PC0端连接，且与晶振X1一端和电阻R5的一端连接；电容C5的另一端与与晶振X1另一端和电阻R5的另一端连接；电容C6连接在电阻R4于电容C4之间；电容C6的一端与控制芯片的VDDA端连接；电容C6的另一端与控制芯片的VSSA端连接；电容C7与电容C6并联。
复位电路包括电阻R3、按键KEY1、电容C1、电池B1、二极管D2和二极管D1；电阻R3的一端与降压电路的输出端连接；电阻R3的另一端与按键KEY1的一端和电容C1的一端连接；电容C1的另一端与按键KEY1的另一端和电池B1的负极连接，且接地；电池B1的正极与二极管D2的输入端连接；二极管D2的输入端与控制芯片的VBAT端连接，且与二极管D1的输出端连接；二极管D1的输入端与降压电路的输出端连接。
驱动电路包括驱动芯片、二极管D3、电阻R6、电容C12、电容C13、三极管Q1、电阻R7、电阻R8、电阻R9、三极管Q2、电阻C14、晶振X3、电容C15和电容C16；驱动芯片的GND端接地；驱动芯片的TXD端与控制芯片的PA9端连接；驱动芯片的RXD端与控制芯片的PA10端连接；驱动芯片的VCC端与USB输入模块的VCC端连接，且与电容C12的一端和电容C13的一端连接；电容C12的另一端与电容C13的另一端连接，且接地；驱动芯片的DTR端与电阻R17的一端连接；电阻R17的另一端与三极管Q1的基极连接；三极管Q1的集电极与二极管D3的输出端和电阻R6的一端连接；二极管D3的输入端与控制芯片的REAET端连接；电阻R6的另一端与降压电路的输出端连接；三极管Q1的发射极与电阻R8的一端和驱动芯片的RTS端连接；电阻R8的另一端与三极管Q2的基极连接；三极管Q2的发射极与降压电路的输出端连接；三极管Q2的集电极与电阻R9的一端连接；电阻R9的另一端与控制芯片的BOOT0端连接。
驱动芯片的V3端与电容C14的一端连接；电容C14的另一端接地；驱动芯片的D3端 与USB输入模块D1端连接；驱动芯片的D4端与USB输入模块D2端连接；驱动芯片的NC端与电容C15一端和晶振X3的一端连接；晶振X3的另一端与电容C15另一端连接，且接地；电容C16连接在电容C15与晶振X3之间。
以上设置，USB输入模块的VCC端外接5V电源；通过降压电路将5V电压转换为3.3V电压；降压电路的输出端输出3.3V的电压为控制芯片、复位电路、晶振电路和显示模块电路供电；同时降压电路的输出端与USB的D2端连接；这样将完成降压的3.3V电压输入到USB输入模块中，将USB输入模块输出的电信号的电平升高；升高电平后的电信号输入的驱动电路；通过USB输入模块输出的升高电平后的电信号输入到驱动电路的三极管Q1和三极管Q2中；导通三极管Q1和三极管Q2；同时USB输入模块的VCC端与驱动电路中电容C12的一端连接；USB输入模块为驱动电路提供5V的供电电压；使控制芯片与驱动电路连通；由于电信号的电平升高后驱动电路能更好的检测到升高电平后的电信号；进而三极管Q1和三极管Q2的导通更稳定；使得控制芯片与驱动电路连接更稳定。
进一步的，控制芯片的VDD1端与控制芯片的VSS1端之间连接有电容C8；控制芯片的VDD2端与控制芯片的VSS2端之间连接有电容C9；控制芯片的VDD3端与控制芯片的VSS3端之间连接有电容C10；控制芯片的VDD4端与控制芯片的VSS4端之间连接有电容C1。
以上设置，在控制芯片的VDD1端与VDD2端之间、VDD2端与VSS2端之间、VDD3端与VSS3端之间、VDD4端与VSS4端之间连接电容；避免电流变化时产生的电压微小波动传递到控制芯片的其它引脚上。
进一步的，控制芯片的PC10端与语音识别模块和语音输出模块连接；语音识别模块的电源端与降压电路的输出端连接；语音识别模块的接地端接地；语音输出模块的电源端与降压电路的输出端连接；语音输出模块的接地端接地。
进一步的，控制芯片的PA6端、PA7端、PB0端、PB1端、PB2端、PB3端、PB4端、PB5端、PB6端、PB7端、PB8端、PB9端、PB10端、PB11端、PB12端、PB13端、PB14端、PB15端、PC0端、PC1端、PC6端、PC7端、PC8端、PC9端和PC10端与显示芯片的TMISO端、TMOSI端、LCDD0端、LCDD1端、LCDD2端、LCDD3端、LCDD4端、LCDD5端、LCDD6端、LCDD7端、LCDD8端、LCDD9端、LCDD10端、LCDD11端、LCDD12端、LCDD13端、LCDD14端、LCDD15端、TSKN端、TPEN端、LCDRD端、LCDWR端、LCDRS端、LCDCS端、LCDBL端连接。
进一步的，显示模块电路还包括电容C21、电容C22、电容C23和显示电源；显示芯片的GND端接地；显示芯片的VDD端与电容C21的一端连接；显示芯片的BLVDD端与电容C23的一端连接；电容C21的另一端与电容C21的另一端和电容C22的一端连接，且与显示电源连接；电容C22的另一端与显示电源连接；显示电源与降压电路的输出端连接。
图1为本发明语音识别模块、语音输出模块、显示装置、驱动电路、电源电路、降压电路、复位电路和晶振电路与控制芯片连接的示意图。
图2为本发明电源电路的示意图。
图3为本发明降压电路的示意图。
图4为本发明驱动电路的示意图。
图5为本发明的控制芯片的示意图。
图6为本发明中控制芯片VBAT、VDD和VSS引脚的示意图。
图7为本发明晶振电路的示意图。
图8为发明复位电路的四意图。
图9为本发明显示模块电路的示意图。
图10为本发明语音识别模块的示意图。
图11为本发明语音输出模块的示意图。
图12为本发明支架与显示装置的示意图。
下面结合附图和具体实施方式对本发明做进一步详细说明。
如图1-12所示；一种全息互动系统；互动装置和控制电路；互动装置包括控制芯片1、语音识别模块2、语音输出模块3和显示装置；控制芯片1、语音识别模块、语音输出模块和显示装置通过控制电路电连接。
语音识别模块2包括语音识别单元和声纹识别单元；语音识别单元用于识别语音输入信息，并将语音输入信息转换为语音波形；声纹识别单元用于识别声纹信息；控制芯片1包括声纹储存单元和一个以上的第一储存单元，声纹储存单元储存有声纹信息；一个第一储存单元根据一种声纹信息对应设置；第一储存单元储存有第一信号波形、语音输出信息和互动信息；第一信号波形与语音输出信息和互动信息对应设置；控制芯片1用于对比语音波形和第一信号波形，并根据对比结果控制语音输出模块3输出对应储存单元的语音输出信息、控制显示装置输出对应储存单元的互动信息。
声纹识别单元识别声纹信息；通过声纹识别单元识别出识别出输入当前语音信息的使用者的身份；控制芯片1输出与该声纹信息对应的第一储存单元中的第一语音输出信息和第一互动信息；由于一个第一储存单元与一种声纹信息对应设置；这样针对不同使用者输出不同第一储存单元中的第一语音输出信息和第一互动信息；这样能与不同的使用者产生不同的互 动效果；同时第一语音输出信息和第一互动信息与第一信号波形对应；进而当一个使用者输入不同的语音输入信息时，控制芯片1根据当前使用者的语音输入信息；输出一个第一储存单元中不同的第一语音输出信息和第一互动信息。
语音识别模块2还包括语音唤醒单元；语音唤醒单元用于识别唤醒信号，并将唤醒信号转换为唤醒波形；所述控制芯片1包括第二储存单元；第二储存单元储存有第二信号波形，控制芯片1用于对比唤醒波形和第二信号波形，并根据对比结果控制语音识别单元识别语音输入信息。设置语音唤醒单元；当控制芯片1识别到唤醒信号时，语音识别单元启动再对语音输入信息进行识别；同时设置第二波形信号唤醒语音识别单元；语音识别单元对唤醒信号之后的信息进行识别，提高语音识别单元识别语音输入信息的准确性。
互动装置包括支架；支架包括盖板41、底板42和支撑件43；所述盖板41位于底板42上方；支撑件43一端与盖板41连接；支撑件43的另一端与底板42连接；显示装置包括投影仪44和立体分光镜45；投影仪44安装在盖板41上；所述立体分光镜45设置在底板42上；投影仪44的投影信息投影到立体分光镜45上。通过投影仪44将投影信息投影到立体分光镜45上；显示装置显示的第一互动信息具有立体感。
显示装置包括显示模块电路46；控制电路包括电源电路5、降压电路6、驱动电路7、复位电路8和晶振电路9；电源电路5与降压电路6连接；降压电路6的输出端与控制芯片1的电源端连接；显示模块电路46、驱动电路7、复位电路8和晶振电路9分别与控制芯片1连接。
控制芯片型号为STM32F103RCT6；电源电路5包括USB输入模块、电阻R13、开关SW1和保险丝F1；USB输入模块的VCC端外接5V电源；USB输入模块的GND端接地；USB输入模块的VCC端与开关SW1输入端连接；开关SW1的输出端输出5V电压。
降压电路6包括降压电路6包括AMS1117-3V3芯片、电容C17、电解电容C18、电解电容C19和电容C20；AMS1117-3V3芯片的VIN端连接开关SW1的输出端；AMS1117-3V3芯片的GND端接地；电解电容C20连接在AMS1117-3V3芯片的VIN端与GND端；电解电容C18连接在AMS1117-3V3芯片的VOUT端与GND端；AMS1117-3V3芯片的VIN端还连接电容C19，电容C19的输出端接地；AMS1117-3V3芯片的VOUT端连接电容C17，电容C17的输出端接地；电容C17与VOUT端相连的一端为降压电路6的输出端，AMS1117-3V3芯片的VOUT端连接降压电路6的输出端；降压电路6的输出端输出3.3V电压；降压电路6的输出端与电阻R13的一端连接；电阻R13的另一端与USB输入模块的D2端连接。USB输入模块的D2端为正极；USB输入模块的D1端为负极。
晶振电路9包括晶振X1、电容C2、电容C3、晶振X2、电容C4、电容C5、电容C6、电容C7、电阻R4和电阻R5；电阻R4的一端与降压电路6的输出端连接；电阻R4的另一端接 地且与电容C2的一端、电容C3的一端、电容C4的一端、电容C5的一端连接；电容C2的另一端与控制芯片1的PC14端连接，且与晶振X1一端连接；电容C3的另一端与控制芯片1的PC15端连接，且与晶振X1另一端连接；电容C4的另一端与控制芯片1的PC0端连接，且与晶振X1一端和电阻R5的一端连接；电容C5的另一端与与晶振X1另一端和电阻R5的另一端连接；电容C6连接在电阻R4于电容C4之间；电容C6的一端与控制芯片1的VDDA端连接；电容C6的另一端与控制芯片1的VSSA端连接；电容C7与电容C6并联。
复位电路8包括电阻R3、按键KEY1、电容C1、电池B1、二极管D2和二极管D1；电阻R3的一端与降压电路6的输出端连接；电阻R3的另一端与按键KEY1的一端和电容C1的一端连接；电容C1的另一端与按键KEY1的另一端和电池B1的负极连接，且接地；电池B1的正极与二极管D2的输入端连接；二极管D2的输入端与控制芯片1的VBAT端连接，且与二极管D1的输出端连接；二极管D1的输入端与降压电路6的输出端连接。
驱动电路7包括驱动芯片71、二极管D3、电阻R6、电容C12、电容C13、三极管Q1、电阻R7、电阻R8、电阻R9、三极管Q2、电阻C14、晶振X3、电容C15和电容C16；驱动芯片为CH340CC芯片；驱动芯片的GND端接地；驱动芯片的TXD端与控制芯片1的PA9端连接；驱动芯片的RXD端与控制芯片1的PA10端连接；驱动芯片的VCC端与USB输入模块的VCC端连接，且与电容C12的一端和电容C13的一端连接；电容C12的另一端与电容C13的另一端连接，且接地；驱动芯片的DTR端与电阻R17的一端连接；电阻R17的另一端与三极管Q1的基极连接；三极管Q1的集电极与二极管D3的输出端和电阻R6的一端连接；二极管D3的输入端与控制芯片1的REAET端连接；电阻R6的另一端与降压电路6的输出端连接；三极管Q1的发射极与电阻R8的一端和驱动芯片的RTS端连接；电阻R8的另一端与三极管Q2的基极连接；三极管Q2的发射极与降压电路6的输出端连接；三极管Q2的集电极与电阻R9的一端连接；电阻R9的另一端与控制芯片1的BOOT0端连接。
驱动芯片的V3端与电容C14的一端连接；电容C14的另一端接地；驱动芯片的D3端与USB输入模块D1端连接；驱动芯片的D4端与USB输入模块D2端连接；驱动芯片的D3端为正极；驱动芯片的D4端为负极。驱动芯片的NC端与电容C15一端和晶振X3的一端连接；晶振X3的另一端与电容C15另一端连接，且接地；电容C16连接在电容C15与晶振X3之间。
USB输入模块的VCC端外接5V电源；通过降压电路6将5V电压转换为3.3V电压；降压电路6的输出端输出3.3V的电压为控制芯片1、复位电路8、晶振电路9和显示模块电路46供电；同时降压电路6的输出端与USB的D2端连接；这样将完成降压的3.3V电压输入到USB输入模块中，将USB输入模块输出的电信号的电平升高；升高电平后的电信号输入的驱动电路7；通过USB输入模块输出的升高电平后的电信号输入到驱动电路7的三极管Q1和三极管Q2中；导通三极管Q1和三极管Q2；同时USB输入模块的VCC端与驱动电路7中电容C12 的一端连接；USB输入模块为驱动电路7提供5V的供电电压；使控制芯片1与驱动电路7连通；由于电信号的电平升高后驱动电路7能更好的检测到升高电平后的电信号；进而三极管Q1和三极管Q2的导通更稳定；使得控制芯片1与驱动电路7连接更稳定。
控制芯片1的VDD1端与控制芯片1的VSS1端之间连接有电容C8；控制芯片1的VDD2端与控制芯片1的VSS2端之间连接有电容C9；控制芯片1的VDD3端与控制芯片1的VSS3端之间连接有电容C10；控制芯片1的VDD4端与控制芯片1的VSS4端之间连接有电容C1。在控制芯片1的VDD1端与VDD2端之间、VDD2端与VSS2端之间、VDD3端与VSS3端之间、VDD4端与VSS4端之间连接电容；避免电流变化时产生的电压微小波动传递到控制芯片1的其它引脚上。
控制芯片1的PC10端与语音识别模块2和语音输出模块3连接；语音识别模块2的电源端与降压电路6的输出端连接；语音识别模块2的接地端接地；语音输出模块3的电源端与降压电路6的输出端连接；语音输出模块3的接地端接地。
显示模块电路46包括显示芯片461；显示芯片为TFTLCD芯片；控制芯片1的PA6端、PA7端、PB0端、PB1端、PB2端、PB3端、PB4端、PB5端、PB6端、PB7端、PB8端、PB9端、PB10端、PB11端、PB12端、PB13端、PB14端、PB15端、PC0端、PC1端、PC6端、PC7端、PC8端、PC9端和PC10端与显示芯片的TMISO端、TMOSI端、LCDD0端、LCDD1端、LCDD2端、LCDD3端、LCDD4端、LCDD5端、LCDD6端、LCDD7端、LCDD8端、LCDD9端、LCDD10端、LCDD11端、LCDD12端、LCDD13端、LCDD14端、LCDD15端、TSKN端、TPEN端、LCDRD端、LCDWR端、LCDRS端、LCDCS端、LCDBL端连接。
显示模块电路46还包括电容C21、电容C22、电容C23和显示电源462；显示芯片的GND端接地；显示芯片的VDD端与电容C21的一端连接；显示芯片的BLVDD端与电容C23的一端连接；电容C21的另一端与电容C21的另一端和电容C22的一端连接，且与显示电源462连接；电容C22的另一端与显示电源462连接；显示电源与降压电路6的输出端连接。
互动系统的互动方法包括以下步骤：
(1).预录入声纹信息，一种声纹信息与一个第一储存单元对应；
(2).在第一储存单元中预录入第一信号波形，并根据第一信号波形录入语音输出信息和互动信息。
(3).语音唤醒单元实时接收语音信息，并将接收的语音信息转为为唤醒波形；控制芯片将当前的唤醒波形和第二信号波形进行对比；若当前的唤醒波形与第二信号波形相似，则进行步骤(4)；若当前的唤醒波形与第二信号波形不相似，则重复进行步骤(3)。
(4).控制芯片判断当前唤醒波形为唤醒信号，控制芯片控制语音识别模块启动。
(4.1).语音识别模块接收语音信息，若语音识别模块接收到语音信息，则进行步骤(5)。
(5).声纹识别单元识别当前语音信息中的声纹信息，语音识别单元识别当前语音信息中的语音输入信息，并将接收的语音输入信息转换为语音波形；控制芯片检测声纹储存单元中是否存在当前识别到声纹信息，若存在，则进行步骤(6)。
(6).识别与该声纹信息匹配的第一储存单元，控制芯片当前的语音波形与当前第一储存单元中的第一信号波形进行对比；若语音波形与第一信号波形相似，则进行步骤(7)；若当前的语音波形与第一信号波形不相似，则进行步骤(4.1)。
(7).语音输出模块输出与该第一信号波形波形对应的第一语音输出信息；显示装置输出该第一信号波形波形对应的第一互动信息。
以上方法，当控制芯片识别到唤醒信号后，语音识别单元再对语音输入信息就行识别，高语音识别单元识别语音输入信息的准确性；然后对语音信息中的声纹信息进行识别后；控制芯片从若干个第一储存单元中识别与当前声纹信息匹配的第一储存单元；然后对语音信息中的语音输入信息进行识别，并转换为语音波形；输出当前第一储存单元中与当前语音波形对应的第一语音输出信息和第一互动信息；通过识别声纹信息区别不同的使用者，输出对应使用者的第一储存单元中的信息；根据当前使用者的语音输入信息，输出对应的第一语音输出信息和第一互动信息；实现与不同使用者产生不同的互动效果；同时同一使用使用者输入不同的语音输入信息，也能产生不同的互动效果。同时若当前的语音波形与第一信号波形不相似，则可以重复输入语音信息，提高语音识别单元识别结果的准确性。
Claims (8)
- 一种全息互动系统；其特征在于：互动装置和控制电路；互动装置包括控制芯片、语音识别模块、语音输出模块和显示装置；控制芯片、语音识别模块、语音输出模块和显示装置通过控制电路电连接；语音识别模块包括语音识别单元和声纹识别单元；语音识别单元用于识别语音输入信息，并将语音输入信息转换为语音波形；声纹识别单元用于识别声纹信息；控制芯片声纹储存单元和一个以上的第一储存单元，声纹储存单元储存有声纹信息；一个第一储存单元根据一种声纹信息对应设置；第一储存单元储存有第一信号波形、第一语音输出信息和第一互动信息；第一信号波形与第一语音输出信息和第一互动信息对应设置；控制芯片用于对比语音波形和第一信号波形，并根据对比结果控制语音输出模块输出对应储存单元的第一语音输出信息、控制显示装置输出对应储存单元的第一互动信息。
- 根据权利要求1所述的一种全息互动系统；其特征在于：语音识别模块还包括语音唤醒单元；语音唤醒单元用于识别唤醒信号，并将唤醒信号转换为唤醒波形；所述控制芯片包括第二储存单元；第二储存单元储存有第二信号波形，控制芯片用于对比唤醒波形和第二信号波形，并根据对比结果控制语音识别单元识别语音输入信息。
- 根据权利要求1所述的一种全息互动系统；其特征在于：互动装置包括支架；支架包括盖板、底板和支撑件；所述盖板位于底板上方；支撑件一端与盖板连接；支撑件的另一端与底板连接；显示装置包括投影仪和立体分光镜；投影仪安装在盖板上；所述立体分光镜设置在底板上；投影仪的投影信息投影到立体分光镜上。
- 根据权利要求1所述的一种全息互动系统；其特征在于：显示装置包括显示模块电路；控制电路包括电源电路、降压电路、驱动电路、复位电路和晶振电路；电源电路与降压电路连接；降压电路的输出端与控制芯片的电源端连接；显示模块电路、驱动电路、复位电路和晶振电路分别与控制芯片连接；电源电路包括USB输入模块、电阻R13、开关SW1和保险丝F1；USB输入模块的VCC端外接5V电源；USB输入模块的GND端接地；USB输入模块的VCC端与开关SW1输入端连接；开关SW1的输出端输出5V电压；降压电路包括降压电路包括AMS1117-3V3芯片、电容C17、电解电容C18、电解电容C19和电容C20；AMS1117-3V3芯片的VIN端连接开关SW1的输出端；AMS1117-3V3芯片的GND端接地；电解电容C20连接在AMS1117-3V3芯片的VIN端与GND端；电解电容C18连接在AMS1117-3V3芯片的VOUT端与GND端；AMS1117-3V3芯片的VIN端 还连接电容C19，电容C19的输出端接地；AMS1117-3V3芯片的VOUT端连接电容C17，电容C17的输出端接地；电容C17与VOUT端相连的一端为降压电路的输出端，AMS1117-3V3芯片的VOUT端连接降压电路的输出端；降压电路的输出端输出3.3V电压；降压电路的输出端与电阻R13的一端连接；电阻R13的另一端与USB输入模块的D2端连接；晶振电路包括晶振X1、电容C2、电容C3、晶振X2、电容C4、电容C5、电容C6、电容C7、电阻R4和电阻R5；电阻R4的一端与降压电路的输出端连接；电阻R4的另一端接地且与电容C2的一端、电容C3的一端、电容C4的一端、电容C5的一端连接；电容C2的另一端与控制芯片的PC14端连接，且与晶振X1一端连接；电容3的另一端与控制芯片的PC15端连接，且与晶振X1另一端连接；电容C4的另一端与控制芯片的PC0端连接，且与晶振X1一端和电阻R5的一端连接；电容C5的另一端与与晶振X1另一端和电阻R5的另一端连接；电容C6连接在电阻R4于电容C4之间；电容C6的一端与控制芯片的VDDA端连接；电容C6的另一端与控制芯片的VSSA端连接；电容C7与电容C6并联；复位电路包括电阻R3、按键KEY1、电容C1、电池B1、二极管D2和二极管D1；电阻R3的一端与降压电路的输出端连接；电阻R3的另一端与按键KEY1的一端和电容C1的一端连接；电容C1的另一端与按键KEY1的另一端和电池B1的负极连接，且接地；电池B1的正极与二极管D2的输入端连接；二极管D2的输入端与控制芯片的VBAT端连接，且与二极管D1的输出端连接；二极管D1的输入端与降压电路的输出端连接；驱动电路包括驱动芯片、二极管D3、电阻R6、电容C12、电容C13、三极管Q1、电阻R7、电阻R8、电阻R9、三极管Q2、电阻C14、晶振X3、电容C15和电容C16；驱动芯片的GND端接地；驱动芯片的TXD端与控制芯片的PA9端连接；驱动芯片的RXD端与控制芯片的PA10端连接；驱动芯片的VCC端与USB输入模块的VCC端连接，且与电容C12的一端和电容C13的一端连接；电容C12的另一端与电容C13的另一端连接，且接地；驱动芯片的DTR端与电阻R17的一端连接；电阻R17的另一端与三极管Q1的基极连接；三极管Q1的集电极与二极管D3的输出端和电阻R6的一端连接；二极管D3的输入端与控制芯片的REAET端连接；电阻R6的另一端与降压电路的输出端连接；三极管Q1的发射极与电阻R8的一端和驱动芯片的RTS端连接；电阻R8的另一端与三极管Q2的基极连接；三极管Q2的发射极与降压电路的输出端连接；三极管Q2的集电极与电阻R9的一端连接；电阻R9的另一端与控制芯片的BOOT0端连接；驱动芯片的V3端与电容C14的一端连接；电容C14的另一端接地；驱动芯片的D3 端与USB输入模块D1端连接；驱动芯片的D4端与USB输入模块D2端连接；驱动芯片的NC端与电容C15一端和晶振X3的一端连接；晶振X3的另一端与电容C15另一端连接，且接地；电容C16连接在电容C15与晶振X3之间。
- 根据权利要求4所述的一种全息互动系统；其特征在于：控制芯片的VDD1端与控制芯片的VSS1端之间连接有电容C8；控制芯片的VDD2端与控制芯片的VSS2端之间连接有电容C9；控制芯片的VDD3端与控制芯片的VSS3端之间连接有电容C10；控制芯片的VDD4端与控制芯片的VSS4端之间连接有电容C1。
- 根据权利要求4所述的一种全息互动系统；其特征在于：控制芯片的PC10端与语音识别模块和语音输出模块连接；语音识别模块的电源端与降压电路的输出端连接；语音识别模块的接地端接地；语音输出模块的电源端与降压电路的输出端连接；语音输出模块的接地端接地。
- 根据权利要求4所述的一种全息互动系统；其特征在于：显示模块电路包括显示芯片；控制芯片的PA6端、PA7端、PB0端、PB1端、PB2端、PB3端、PB4端、PB5端、PB6端、PB7端、PB8端、PB9端、PB10端、PB11端、PB12端、PB13端、PB14端、PB15端、PC0端、PC1端、PC6端、PC7端、PC8端、PC9端和PC10端与显示芯片的TMISO端、TMOSI端、LCDD0端、LCDD1端、LCDD2端、LCDD3端、LCDD4端、LCDD5端、LCDD6端、LCDD7端、LCDD8端、LCDD9端、LCDD10端、LCDD11端、LCDD12端、LCDD13端、LCDD14端、LCDD15端、TSKN端、TPEN端、LCDRD端、LCDWR端、LCDRS端、LCDCS端、LCDBL端连接。
- 根据权利要求7所述的一种全息互动系统；其特征在于：显示模块电路还包括电容C21、电容C22、电容C23和显示电源；显示芯片的GND端接地；显示芯片的VDD端与电容C21的一端连接；显示芯片的BLVDD端与电容C23的一端连接；电容C21的另一端与电容C21的另一端和电容C22的一端连接，且与显示电源连接；电容C22的另一端与显示电源连接；显示电源与降压电路的输出端连接。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111541982.1A CN114155865A (zh) | 2021-12-16 | 2021-12-16 | 一种全息互动系统 |
| CN202111541982.1 | 2021-12-16 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023109415A1 true WO2023109415A1 (zh) | 2023-06-22 |
Family
ID=80451489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/132356 WO2023109415A1 (zh) | 2021-12-16 | 2022-11-16 | 一种全息互动系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114155865A (zh) |
| WO (1) | WO2023109415A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114155865A (zh) * | 2021-12-16 | 2022-03-08 | 广州城市理工学院 | 一种全息互动系统 |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN200956163Y (zh) * | 2006-07-13 | 2007-10-03 | 东莞市步步高教育电子产品有限公司 | 一种电子宠物娱乐学习系统 |
| CN107393538A (zh) * | 2017-07-26 | 2017-11-24 | 上海与德通讯技术有限公司 | 机器人交互方法及系统 |
| CN207324076U (zh) * | 2017-08-23 | 2018-05-08 | 实丰文化发展股份有限公司 | 语音交互式智能玩具车电路 |
| CN109147800A (zh) * | 2018-08-30 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | 应答方法和装置 |
| CN109473101A (zh) * | 2018-12-20 | 2019-03-15 | 福州瑞芯微电子股份有限公司 | 一种差异化随机问答的语音芯片结构和方法 |
| CN111724789A (zh) * | 2019-03-19 | 2020-09-29 | 华为终端有限公司 | 语音交互的方法和终端设备 |
| CN112099628A (zh) * | 2020-09-08 | 2020-12-18 | 平安科技（深圳）有限公司 | 基于人工智能的vr互动方法、装置、计算机设备及介质 |
| US20210142796A1 (en) * | 2016-03-31 | 2021-05-13 | Sony Corporation | Information processing apparatus, information processing method, and program |
| CN114155865A (zh) * | 2021-12-16 | 2022-03-08 | 广州城市理工学院 | 一种全息互动系统 |
| CN114187915A (zh) * | 2021-12-16 | 2022-03-15 | 广州城市理工学院 | 一种互动方法 |
-
2021
- 2021-12-16 CN CN202111541982.1A patent/CN114155865A/zh active Pending
-
2022
- 2022-11-16 WO PCT/CN2022/132356 patent/WO2023109415A1/zh unknown
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN200956163Y (zh) * | 2006-07-13 | 2007-10-03 | 东莞市步步高教育电子产品有限公司 | 一种电子宠物娱乐学习系统 |
| US20210142796A1 (en) * | 2016-03-31 | 2021-05-13 | Sony Corporation | Information processing apparatus, information processing method, and program |
| CN107393538A (zh) * | 2017-07-26 | 2017-11-24 | 上海与德通讯技术有限公司 | 机器人交互方法及系统 |
| CN207324076U (zh) * | 2017-08-23 | 2018-05-08 | 实丰文化发展股份有限公司 | 语音交互式智能玩具车电路 |
| CN109147800A (zh) * | 2018-08-30 | 2019-01-04 | 百度在线网络技术（北京）有限公司 | 应答方法和装置 |
| CN109473101A (zh) * | 2018-12-20 | 2019-03-15 | 福州瑞芯微电子股份有限公司 | 一种差异化随机问答的语音芯片结构和方法 |
| CN111724789A (zh) * | 2019-03-19 | 2020-09-29 | 华为终端有限公司 | 语音交互的方法和终端设备 |
| CN112099628A (zh) * | 2020-09-08 | 2020-12-18 | 平安科技（深圳）有限公司 | 基于人工智能的vr互动方法、装置、计算机设备及介质 |
| CN114155865A (zh) * | 2021-12-16 | 2022-03-08 | 广州城市理工学院 | 一种全息互动系统 |
| CN114187915A (zh) * | 2021-12-16 | 2022-03-15 | 广州城市理工学院 | 一种互动方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114155865A (zh) | 2022-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2023109415A1 (zh) | 一种全息互动系统 | |
| CN106874265A (zh) | 一种与用户情绪匹配的内容输出方法、电子设备及服务器 | |
| JP2001184146A (ja) | 共通シリアルバスコネクターを具えた携帯電子機器 | |
| CN110673821B (zh) | 一种智能设备唤醒反馈方法及智能设备 | |
| TWI553506B (zh) | 具有語音控制功能之電腦系統以及語音控制方法 | |
| CN112463138B (zh) | 一种软硬件结合的人工智能教育学习系统 | |
| KR102546510B1 (ko) | 복수의 입력 간에 매핑된 정보 제공 방법 및 이를 지원하는 전자 장치 | |
| JP2021182371A (ja) | ユーザー気分調整方法、装置、電子デバイス、コンピュータ可読記憶媒体及びコンピュータプログラム | |
| CN106201033A (zh) | 手写智能输入笔 | |
| CN213565687U (zh) | 一种智能车载语音设备 | |
| US7719863B2 (en) | Active start judgment circuit | |
| CN108540664A (zh) | 一种开机方法及电子设备 | |
| US20200202114A1 (en) | Electronic device for tracking user activity and method of operating the same | |
| CN114247159A (zh) | 一种基于智能积木的数据交互方法和相关设备 | |
| KR20210040856A (ko) | 스마트 백미러의 인터랙션 방법, 장치, 전자기기와 저장매체 | |
| WO2023246558A1 (zh) | 语义理解方法、装置、介质及设备 | |
| TWI606354B (zh) | 用於可穿戴型裝置之利用同屬性分類器以訓練個人化分類器之技術 | |
| CN114185295A (zh) | 一种交互装置的电路 | |
| CN209453563U (zh) | 一种智能机器人 | |
| CN109501685A (zh) | 一种方控数据处理方法、装置、电子设备及存储介质 | |
| TWM622826U (zh) | 一種利用物聯網技術主動聯網的雲端點讀筆 | |
| CN213904673U (zh) | 一种用于教学的树莓派扩展板 | |
| CN112767520A (zh) | 数字人生成方法、装置、电子设备及存储介质 | |
| CN112233670A (zh) | 一种基于alexa云服务的语音交互方法及系统 | |
| CN110708422A (zh) | 一种智能应急的方法、装置、存储介质以及终端 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22906167 Country of ref document: EP Kind code of ref document: A1 |