CN207397659U - A kind of line holographic projections multimedia display platform based on voice and gesture control - Google Patents
A kind of line holographic projections multimedia display platform based on voice and gesture control Download PDFInfo
- Publication number
- CN207397659U CN207397659U CN201721479648.7U CN201721479648U CN207397659U CN 207397659 U CN207397659 U CN 207397659U CN 201721479648 U CN201721479648 U CN 201721479648U CN 207397659 U CN207397659 U CN 207397659U
- Authority
- CN
- China
- Prior art keywords
- voice
- gesture
- main control
- control chip
- display platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003993 interaction Effects 0.000 abstract description 4
- 238000000034 method Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
本实用新型公开了一种基于语音及手势控制的全息投影多媒体展示平台,包括主控芯片、SD卡、全息投影展示台、TTS模块、用于识别用户手势的手势识别模块以及用于识别语音的语音识别模块,其中,主控芯片与全息投影展示台、TTS模块、SD卡、手势识别模块及语音识别模块相连接,该展示平台能够基于语音及手势控制实现人机交互。
The utility model discloses a holographic projection multimedia display platform based on voice and gesture control. Voice recognition module, wherein the main control chip is connected with holographic projection display stand, TTS module, SD card, gesture recognition module and voice recognition module. The display platform can realize human-computer interaction based on voice and gesture control.
Description
技术领域technical field
本实用新型涉及一种多媒体展示平台,具体涉及一种基于语音及手势控制的全息投影多媒体展示平台。The utility model relates to a multimedia display platform, in particular to a holographic projection multimedia display platform based on voice and gesture control.
背景技术Background technique
多媒体展示平台是利用媒介把文字、图形、影象、动画、声音及视频等媒体信息展示出来,使用最为广泛的为展示柜、电子显示屏等。如今,随着科技的发展,出现了全息投影技术,利用干涉和衍射原理记录并再现物体真是的三维图像,立体逼真的显示效果满足人们的视觉需求。The multimedia display platform uses media to display media information such as text, graphics, video, animation, sound and video. The most widely used ones are display cabinets and electronic display screens. Nowadays, with the development of science and technology, holographic projection technology has appeared, which uses the principle of interference and diffraction to record and reproduce the real three-dimensional image of the object, and the three-dimensional and realistic display effect meets people's visual needs.
例如申请号为CN201710424998.1,名称为:“一种基于光学干涉和衍射的展示柜全息展示装置”的实用新型专利,该实用新型专利的技术方案是:包括承载架、隔板、镀膜玻璃、投影架、摄像头、LED显示器、投影成像玻璃、全息投影膜、照明灯、投影仪、承载台、转台机构及控制系统,可在展示过程中,灵活对所需展示物品进行多个角度全面展示。再例如申请号:CN201710375335.5,名称为:“一种折叠全息投影音乐播放器”的实用新型专利,该实用新型专利的技术方案是:由出声面、充电处、全息画面播放处、折叠面、USB接口、底板组成的全息投影音乐播放器,在听音乐的过程中欣赏mv画面。上述显示平台可实现全息投影的良好视觉效果,但仅实现了简单的显示功能,无法进行人机交互,设备智能化的要求仍未实现。For example, the application number is CN201710424998.1, and the name is: "a holographic display device for display cabinets based on optical interference and diffraction". Projection stand, camera, LED display, projection imaging glass, holographic projection film, lighting lamp, projector, bearing table, turntable mechanism and control system can flexibly display the required display items from multiple angles during the display process. Another example is the application number: CN201710375335.5, the utility model patent named "a foldable holographic projection music player". The holographic projection music player composed of surface, USB interface and bottom plate can enjoy the mv picture in the process of listening to music. The above-mentioned display platform can achieve good visual effects of holographic projection, but only realizes simple display functions, and cannot perform human-computer interaction, and the requirement for intelligent equipment has not yet been realized.
实用新型内容Utility model content
本实用新型的目的在于克服上述现有技术的缺点,提供了一种基于语音及手势控制的全息投影多媒体展示平台,该展示平台能够基于语音及手势控制实现人机交互。The purpose of the utility model is to overcome the above-mentioned shortcomings of the prior art, and provide a holographic projection multimedia display platform based on voice and gesture control, which can realize human-computer interaction based on voice and gesture control.
为达到上述目的,本实用新型所述的基于语音及手势控制的全息投影多媒体展示平台包括主控芯片、SD卡、全息投影展示台、TTS模块、用于识别用户手势的手势识别模块以及用于识别语音的语音识别模块,其中,主控芯片与全息投影展示台、TTS模块、SD卡、手势识别模块及语音识别模块相连接。In order to achieve the above object, the holographic projection multimedia display platform based on voice and gesture control described in the utility model includes a main control chip, an SD card, a holographic projection display stand, a TTS module, a gesture recognition module for recognizing user gestures, and a gesture recognition module for A speech recognition module for recognizing speech, wherein the main control chip is connected with the holographic projection display stand, the TTS module, the SD card, the gesture recognition module and the speech recognition module.
还包括与主控芯片相连接的显示屏。It also includes a display screen connected to the main control chip.
语音识别模块通过SPI总线与主控芯片相连接。The speech recognition module is connected with the main control chip through the SPI bus.
手势识别模块通过IIC总线与主控芯片相连接。The gesture recognition module is connected with the main control chip through the IIC bus.
TTS模块通过串口与主控芯片相连接。The TTS module is connected with the main control chip through the serial port.
主控芯片的型号为STM32F407;The model of the main control chip is STM32F407;
TTS模块的型号为XFS5152CE;The model of the TTS module is XFS5152CE;
语音识别模块的型号为LD3320;The model of the speech recognition module is LD3320;
手势识别模块的型号为APDS9960。The model of the gesture recognition module is APDS9960.
本实用新型具有以下有益效果:The utility model has the following beneficial effects:
本实用新型所述的基于语音及手势控制的全息投影多媒体展示平台在具体操作时,主控芯片通过语音识别模块及手势识别模块识别用户发出的信息,再对全息投影展示台进行控制,实现基于语音及手势控制的人机交互,结构简单,操作方便,实用性极强。During the specific operation of the holographic projection multimedia display platform based on voice and gesture control described in the utility model, the main control chip recognizes the information sent by the user through the voice recognition module and the gesture recognition module, and then controls the holographic projection display platform to realize The human-computer interaction controlled by voice and gesture has simple structure, convenient operation and strong practicability.
附图说明Description of drawings
图1为本实用新型的结构示意图。Fig. 1 is the structural representation of the utility model.
其中,1为主控芯片、2为手势识别模块、3为语音识别模块、4为TTS模块、5为全息投影展示台、6为SD卡、7为显示屏。Among them, 1 is the main control chip, 2 is the gesture recognition module, 3 is the speech recognition module, 4 is the TTS module, 5 is the holographic projection display stand, 6 is the SD card, and 7 is the display screen.
具体实施方式Detailed ways
下面结合附图对本实用新型做进一步详细描述:Below in conjunction with accompanying drawing, the utility model is described in further detail:
参考图1,本实用新型所述的基于语音及手势控制的全息投影多媒体展示平台包括主控芯片1、SD卡6、全息投影展示台5、TTS模块4、用于识别用户手势的手势识别模块2以及用于识别语音的语音识别模块3,其中,主控芯片1与全息投影展示台5、TTS模块4、SD卡6、手势识别模块2及语音识别模块3相连接。Referring to Fig. 1, the holographic projection multimedia display platform based on voice and gesture control of the present invention includes a main control chip 1, an SD card 6, a holographic projection display stand 5, a TTS module 4, and a gesture recognition module for recognizing user gestures 2 and a speech recognition module 3 for recognizing speech, wherein the main control chip 1 is connected to the holographic projection display stand 5, the TTS module 4, the SD card 6, the gesture recognition module 2 and the speech recognition module 3.
本实用新型还包括与主控芯片1相连接的显示屏7;语音识别模块3通过SPI总线与主控芯片1相连接;手势识别模块2通过IIC总线与主控芯片1相连接;TTS模块4通过串口与主控芯片1相连接。The utility model also includes a display screen 7 connected with the main control chip 1; the speech recognition module 3 is connected with the main control chip 1 through the SPI bus; the gesture recognition module 2 is connected with the main control chip 1 through the IIC bus; the TTS module 4 Connect with the main control chip 1 through the serial port.
主控芯片1的型号为STM32F407;TTS模块4的型号为XFS5152CE;语音识别模块3的型号为LD3320;手势识别模块2的型号为APDS9960。The model of main control chip 1 is STM32F407; the model of TTS module 4 is XFS5152CE; the model of speech recognition module 3 is LD3320; the model of gesture recognition module 2 is APDS9960.
本实用新型的具体工作过程为:Concrete work process of the present utility model is:
SD卡6预存储有若干常见问题及该问题的答案,所述手势识别模块2可以识别用户的手向上移动、向下移动、向左移动、向右移动、靠近及远离的状态,再将用户手的移动状态发送至主控芯片1中,主控芯片1根据用户手的移动状态产生对应的控制指令,然后根据所述控制指令控制全息投影展示台5工作,其中,用户手的一种移动状态对应一种控制指令;另外,语音识别模块3识别用户发出的语音信息,然后将用户的语音信息发送至主控芯片1中,主控芯片1判断所述用户语音信息的类型,当用户发出的语音为控制指令时,则控制全息投影展示台5进行工作,当所述用户发出的语音为语音问题时,则通过TTS模块4回答用户提出的问题,其中,主控芯片1的判断过程中,主控芯片1根据所述用户发出的语音信息在SD卡6中查询的问题答案,当查询到问题答案时,则识别出来的用户语音为语音问题,主控芯片1即可将查询得到的问题答案通过TTS模块4进行播报;当不能查询到问题的答案时,则识别出来的用户语音信息为控制指令。SD card 6 is pre-stored with some frequently asked questions and the answers to the questions, and the gesture recognition module 2 can identify the state of the user's hand moving up, down, left, right, close and far away, and then the user The movement state of the hand is sent to the main control chip 1, and the main control chip 1 generates a corresponding control command according to the movement state of the user's hand, and then controls the holographic projection display stand 5 to work according to the control command, wherein a movement of the user's hand The state corresponds to a control command; in addition, the speech recognition module 3 recognizes the voice information sent by the user, and then sends the user's voice information to the main control chip 1, and the main control chip 1 judges the type of the user's voice information. When the voice is a control command, the holographic projection display stand 5 is controlled to work; when the voice issued by the user is a voice problem, the TTS module 4 is used to answer the question raised by the user, wherein, in the judgment process of the main control chip 1 , the main control chip 1 searches the question answer in the SD card 6 according to the voice information sent by the user. The answer to the question is broadcast through the TTS module 4; when the answer to the question cannot be found, the recognized voice information of the user is a control instruction.
同时主控芯片1还能够控制显示屏7中显示虚拟人物,同时控制虚拟人物显示用户的手势动作。At the same time, the main control chip 1 can also control the display screen 7 to display the avatar, and at the same time control the avatar to display the user's gestures.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721479648.7U CN207397659U (en) | 2017-11-08 | 2017-11-08 | A kind of line holographic projections multimedia display platform based on voice and gesture control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721479648.7U CN207397659U (en) | 2017-11-08 | 2017-11-08 | A kind of line holographic projections multimedia display platform based on voice and gesture control |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN207397659U true CN207397659U (en) | 2018-05-22 |
Family
ID=62325376
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201721479648.7U Active CN207397659U (en) | 2017-11-08 | 2017-11-08 | A kind of line holographic projections multimedia display platform based on voice and gesture control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN207397659U (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109671380A (en) * | 2019-03-01 | 2019-04-23 | 烟台市吉旭伟网络科技有限公司 | A kind of interactive type advertisement play system |
| CN109857260A (en) * | 2019-02-27 | 2019-06-07 | 百度在线网络技术(北京)有限公司 | Control method, the device and system of three-dimensional interactive image |
| CN110025172A (en) * | 2019-05-27 | 2019-07-19 | 广东金石卖场建设有限公司 | Voice-controlled clothes display stand |
| CN111123851A (en) * | 2019-11-11 | 2020-05-08 | 珠海格力电器股份有限公司 | Method, device and system for controlling electric equipment according to user emotion |
-
2017
- 2017-11-08 CN CN201721479648.7U patent/CN207397659U/en active Active
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109857260A (en) * | 2019-02-27 | 2019-06-07 | 百度在线网络技术(北京)有限公司 | Control method, the device and system of three-dimensional interactive image |
| CN109671380A (en) * | 2019-03-01 | 2019-04-23 | 烟台市吉旭伟网络科技有限公司 | A kind of interactive type advertisement play system |
| CN110025172A (en) * | 2019-05-27 | 2019-07-19 | 广东金石卖场建设有限公司 | Voice-controlled clothes display stand |
| CN111123851A (en) * | 2019-11-11 | 2020-05-08 | 珠海格力电器股份有限公司 | Method, device and system for controlling electric equipment according to user emotion |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN207397659U (en) | A kind of line holographic projections multimedia display platform based on voice and gesture control | |
| CN104166851B (en) | The interactive multimedia learning system and method for a kind of papery teaching material | |
| CN204066456U (en) | Based on the interactive teaching system device of internet | |
| WO2018036149A1 (en) | Multimedia interactive teaching system and method | |
| CN105629653A (en) | Interactive holographic projection method on the basis of three-dimensional model | |
| CN103885598A (en) | Calligraphy digital system under natural interactive interface and method for performing real-time calligraphic writing by means of calligraphy digital system | |
| CN110618965B (en) | Intelligent integrated desktop for classrooms and its use method | |
| CN206470975U (en) | A kind of Intelligent platform based on finger vein recognition system | |
| CN109637208A (en) | A kind of stereoscopic teaching system and its teaching method based on virtual reality technology | |
| CN203588489U (en) | A situational teaching device | |
| CN207541795U (en) | A kind of multimedia education system based on wear-type visor | |
| CN209895305U (en) | Gesture interaction system | |
| CN205451551U (en) | Speech recognition driven augmented reality human -computer interaction video language learning system | |
| CN103996317A (en) | Novel wireless multi-media interactive teaching system | |
| CN109545012A (en) | A kind of shared tutoring system | |
| CN108961862A (en) | A kind of school's teaching platform based on Internet of Things | |
| CN110929051B (en) | Integrated system and method for controlling music, vision and lamplight through image recognition | |
| CN209311987U (en) | A kind of integration interactive device | |
| WO2022188145A1 (en) | Method for interaction between display device and terminal device, and storage medium and electronic device | |
| CN103996315A (en) | System safety setting method for novel wireless multi-media interactive teaching system | |
| CN103543829A (en) | Intelligent 3D (three-dimensional) visual presenter capable of realizing projection touch | |
| CN203085064U (en) | Virtual starry sky teaching device | |
| CN112037593A (en) | Learning interaction implementation method and system based on augmented reality | |
| CN105280079A (en) | Laser sensing interactive digital sand table model | |
| CN205354417U (en) | All -round type wisdom classroom |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |