CN203164866U - Man-machine interaction equipment based on body feelings - Google Patents
Man-machine interaction equipment based on body feelings Download PDFInfo
- Publication number
- CN203164866U CN203164866U CN 201320026829 CN201320026829U CN203164866U CN 203164866 U CN203164866 U CN 203164866U CN 201320026829 CN201320026829 CN 201320026829 CN 201320026829 U CN201320026829 U CN 201320026829U CN 203164866 U CN203164866 U CN 203164866U
- Authority
- CN
- China
- Prior art keywords
- human
- computer interaction
- body sense
- central processing
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The utility model discloses man-machine interaction equipment based on body feelings. The equipment comprises an acquiring unit for acquiring motion and voice information of a user, a central processor connected with the acquiring unit and used for identifying acquired motion and voice information, and a transmission unit connected with the central processor and used for outputting identification results to controlled equipment so as to enable the controlled equipment to execute corresponding orders according to the identification results. Through the man-machine interaction equipment, the identification results of motion and voice of the user can be directly output to common controlled equipment, the common equipment does not need to conduct motion and voice identification, and therefore body feeling control can be applied to common equipment, and user experience is good.
Description
Technical field
The utility model relates to field of human-computer interaction, in particular to a kind of human-computer interaction device based on the body sense.
Background technology
Have now in the input equipment of traditional computing machine or computing equipment, the most frequently used is mouse, keyboard, touch-screen, simple remote control etc.It is simple that these input equipments have input, quick, advantage accurately, but shortcoming also is directly perceived inadequately, the people need directly operate input equipment with hand just can finish the information input.Under the man-machine mutual situation of other, the user wishes that contact arrangement can not finish the equipment operation yet, more typical situation as: wish to break away from equipment during somatic sensation television game and fetter; Do not wish touch apparatus during the public arena information inquiry, but wish directly to obtain information by language, action, more natural, can also keeping off infection property disease; The Internet community exchanges, and by duplicator's action, voice make that interchange is more authentic and valid; Use robot imitation human action, robot is controlled etc.
At present, most of man-machine interactive device does not possess the characteristics of man-machine interaction nature, can't finish seizure and the identification of human action, sound, in order to address this problem, Microsoft has released body sense input equipment kinect, still, the pattern-recognition of this equipment need be finished at xbox or computing machine, the main equipment processing speed is required height, and environment for use is limited, can't be generalized to common controlled device.
Can't be generalized to the problem of common controlled device at body sense input equipment in the correlation technique, not propose effective solution at present as yet.
The utility model content
Fundamental purpose of the present utility model is to provide a kind of human-computer interaction device based on the body sense, to solve the problem that body sense input equipment can't be generalized to common controlled device.
To achieve these goals, according to an aspect of the present utility model, provide a kind of human-computer interaction device based on the body sense.
Comprise according to the human-computer interaction device based on the body sense of the present utility model: acquiring unit is used for obtaining user action and acoustic information; Central processing unit is connected with acquiring unit, is used for action and acoustic information that identification gets access to; Transmission unit is connected with central processing unit, is used for exporting recognition result to controlled device, so that controlled device is carried out corresponding order according to recognition result.
Further, acquiring unit comprises: the action acquiring unit, for the image that obtains user action; And the voice acquiring unit, be used for obtaining user's voice information.
Further, the action acquiring unit comprises: structured light projector, for the space that structured light is projected to the user place; Image acquisition device is for the image in the space of gathering the structured light projection; And programmable gate array, for the depth map that calculates and export the image that collects.
Further, image acquisition device is monochrome image sensor; Structured light projector is single wavelength structure light projector; And monochrome image sensor has the logical light filter plate of the band identical with single wavelength structure light projector wavelength.
Further, structured light projector is connected by first digital signal line with programmable gate array; Image acquisition device is connected by second digital signal line with programmable gate array; And programmable gate array is connected by the three digital signal line with central processing unit.
Further, the voice acquiring unit comprises: the voice collecting device, be used for gathering user's voice signal, and voice signal is converted to electric signal; Signal conditioning circuit is used for electric signal is carried out amplification filtering; And the audio frequency analog to digital converter, being used for the analog signal conversion after the amplification filtering is to export after the digital signal.
Further, the voice collecting device is connected by first analog signal line with signal conditioning circuit; Signal conditioning circuit is connected by second analog signal line with the audio frequency analog to digital converter; And the audio frequency analog to digital converter is connected by the 4th digital signal line with central processing unit.
Further, this equipment also comprises: wireless input device is used for receiving the control signal that the user imports; And wireless transceiver, be connected with central processing unit with wireless input device, be used for exporting control signal to controlled device via central processing unit and transmission unit.
Further, wireless input device comprises: Wireless Keyboard, wireless mouse, earphone-microphone and/or wireless controller.
Further, central processing unit is connected by the 5th digital signal line with wireless transceiver.
By the utility model, adopt the human-computer interaction device based on the body sense comprise following structure, be used for obtaining the acquiring unit of user action and acoustic information, be connected with acquiring unit and be used for action that identification gets access to and the central processing unit of acoustic information; Be connected with central processing unit and be used for recognition result is exported to the transmission unit of controlled device, controlled device is carried out corresponding order according to recognition result, solved the problem that body sense input equipment can't be generalized to common controlled device, can directly export the recognition result of user action and sound to common controlled device, need not conventional equipment and carry out motion and sound identification, and then reached body sense control has been applied in the conventional equipment effect that the user experiences.
Description of drawings
The accompanying drawing that constitutes the application's a part is used to provide further understanding of the present utility model, and illustrative examples of the present utility model and explanation thereof are used for explaining the utility model, do not constitute improper restriction of the present utility model.In the accompanying drawings:
Fig. 1 is the theory diagram based on the human-computer interaction device of body sense according to the utility model embodiment; And
Fig. 2 is the human-computer interaction device's connection diagram based on the body sense according to the utility model embodiment.
Embodiment
Need to prove that under the situation of not conflicting, embodiment and the feature among the embodiment among the application can make up mutually.Describe the utility model below with reference to the accompanying drawings and in conjunction with the embodiments in detail.
This embodiment describes the embodiment based on the human-computer interaction device of body sense that the application provides, this equipment can obtain user action and acoustic information, identify then and recognition result is transferred to controlled device, for example this controlled device can be computing machine, household electrical appliance, public operation equipment (comprises cash machine, the bank's number of getting machine, restaurant's dish ordering machine etc.), the application's the human-computer interaction device based on the body sense is connected to controlled device, corresponding control program is set in the controlled device, behind the recognition result that gets access to human-computer interaction device's output, carry out the control command of recognition result correspondence, realize the control based on the body sense.
Fig. 1 is the theory diagram based on the human-computer interaction device of body sense according to the utility model embodiment, as shown in Figure 1, should comprise acquiring unit 20, central processing unit 40 and transmission unit 60 based on human-computer interaction device of body sense.
Wherein, acquiring unit 20 is used for obtaining user action and acoustic information, for example, takes user action continuously by camera, obtains motion images; Obtain user's sound of speaking by microphone, obtain voice signal etc.Central processing unit 40 is connected with acquiring unit 20, and action and acoustic information by algorithm for pattern recognition identification gets access to export recognition result to controlled device via transmission unit then, so that controlled device is carried out corresponding order according to recognition result.Wherein, central processing unit should have stronger data-handling capacity, satisfies data packing and the transmission requirement of real-time action recognition, speech recognition, transmission unit.
Particularly, this human-computer interaction device's connection diagram as shown in Figure 2, acquiring unit 20 comprises three digital videos stream acquiring unit (also namely move acquiring unit) and sound signal stream acquiring unit (also being the voice acquiring unit), wherein, the three-dimensional video stream acquiring unit comprises structured light projector, camera and programmable gate array; The sound signal stream acquiring unit comprises microphone, signal conditioning circuit and audio frequency analog to digital converter; Central processing unit is identified the information that three-dimensional video stream acquiring unit and sound signal stream acquiring unit get access to as action, voice recognition unit.
The annexation of each part mentioned above is as follows: structured light projector is connected by digital signal line S1 with programmable gate array; Camera is connected by digital signal line S2 with programmable gate array; Programmable gate array is connected by digital signal line S3 with central processing unit, and this digital signal line S3 can use the external memory access mode, and uses many bit parallels data transmission; Microphone is connected by analog signal line M1 with signal conditioning circuit; Signal conditioning circuit is connected by analog signal line M2 with the audio frequency analog to digital converter; The audio frequency analog to digital converter is connected by digital signal line S4 with central processing unit; Above-mentioned central processing unit is supported USB (universal serial bus), is used for carrying out data communication with outside controlled device.
This human-computer interaction device's principle of work is as follows: programmable gate array produces structured light by digital signal line S1 control structure light projector, and structured light is projected the space.Surface profile by the object in the said structure optical illumination zone or human body can be modulated structured light, makes the structured light of original projection produce distortion.Camera is with spatial image in certain frame per second continuous acquisition field of illumination, and view data is passed to programmable gate array by digital signal line S2.Programmable gate array is pre-configured depth map acquisition algorithm, be used for the signal of acquired original is processed in real time the video flowing of depth map, offering the subsequent action algorithm for pattern recognition uses, therefore, the programmable gate permutation is handled the data that camera transmits continuously, calculate the depth value of each imaging point according to the distortion situation of modulation back structured light, each two field picture can obtain a frame depth map, sequential frame image obtains the depth map of successive frame, and programmable gate array is delivered to central processing unit by digital signal line S3 with continuous frame depth map.After central processing unit is received the depth map of successive frame, carry out pattern identification by the software algorithm of inside, recognition result is passed to outside controlled device by USB (universal serial bus).
Structured light projector can adopt the mode of projected spot or grid.Preferably, can use the structured light scheme of single wavelength, be convenient to when Image Acquisition, adopt certain scheme filtering environmental light to disturb.System's design the time preestablishes mode of delivery, and the power supply that programmable gate array can the control structure light projector conveniently reduces system power dissipation under park mode.
Camera can use monochrome image sensor.The preferred use has the logical light filter plate of the band identical with above-mentioned single wavelength, is beneficial to filtering environmental light and disturbs.Sensor should use the bigger sensor of photosensitive area on selecting as far as possible, can reduce the luminous power requirement to structured light projector like this, obtains effect preferably.
Microphone converts environmental sound signal to electric signal, and M1 outputs to signal conditioning circuit by analog signal line.Signal conditioning circuit is done amplification filtering to the signal that microphone transmits as required, and M2 outputs to analog to digital converter by analog signal line.Analog to digital converter becomes digital signal to the analog signal conversion that signal conditioning circuit transmits, and S4 outputs to central processing unit by digital signal line.Central processing unit carries out speech recognition by the software algorithm of inside after receiving the digital signal that digital signal line S4 transmits, and recognition result is passed to external unit by USB (universal serial bus).
Signal conditioning circuit should have functions such as better dynamic scope, signal to noise ratio (S/N ratio), gain control.Be conducive to obtain high-quality voice signal, be conducive to speech recognition and voice reproduction simultaneously.
Obtain by above-mentioned principle class, when structured light projector projects locus, user place with structured light, the action that the user is different makes structured light produce different distortion, programmable gate array picture after the camera collection distortion, the depth map of programmable gate array export structure light image, central processing unit obtains recognition result according to depth map, also namely identifies user action.This recognition method identification accuracy height based on depth map, and to the main frame transmission be recognition result, avoiding transmitting depth map influences transmission speed and image effect.
When the user controls outside controlled device by voice, microphone can collect user's the sound of speaking, and send central processing unit to through signal conditioning circuit and audio frequency analog to digital converter, central processing unit obtains recognition result according to audio digital signal, also namely identify user speech, and send voice recognition result to outside controlled device.
Preferably, this human-computer interaction device also comprises wireless receiver, is connected with wireless device by wireless channel W1, and user's input that wireless device is received transfers to central processing unit, wherein, wireless device comprises wireless controller, Wireless Keyboard and mouse, earphone-microphone etc.Wherein, central processing unit is connected by digital signal line S5 with wireless transceiver, and wireless transceiver is supported wireless receiving and dispatching ability and the agreement of main flow, and such as supporting bluetooth, wifi etc. support the starlike data of many equipment to connect simultaneously.
In the preferred embodiment, wireless controller, Wireless Keyboard, wireless mouse obtain user control signal or earphone-microphone catches user voice signal, W1 sends transceiver to by wireless channel, transceiver sends to central processing unit with control signal or the voice signal that receives by digital signal line S5, central processing unit is passed to outside controlled device with control signal and voice identification result by USB (universal serial bus) after receiving the digital signal that digital signal line S5 transmits.Therefore, voice signal can obtain from microphone, also can obtain by wireless microphone, depends on the user.Get rid of the situation that ambient sound disturbs for needs, the microphone that is worn on user's head can be obtained better effect.
Further, the audio digital signals that outside controlled device is play sends central processing unit to by USB (universal serial bus), central processing unit receives that the audio digital signals that outside controlled device is play sends transceiver to by digital signal line S5, transceiver sends to earphone-microphone with the audio digital signals that central processing unit transmits by wireless channel, the user hears sound, realizes the transmitted in both directions of signal.
From above description, as can be seen, the utility model has been realized following technique effect: action and the voice that should pass through to catch human body based on the human-computer interaction device of body sense, and will move and do pattern-recognition with voice, send the pattern-recognition result to outside controlled device, finish people self and controlled device and carry out mutual process, wherein, but human-computer interaction device self execution, obtaining and pattern-recognition of voice, directly recognition result is passed to outside controlled device, outside controlled device only need be finished application program and handle, and has reduced the main frame rate request, makes to use more extensive based on the control of body sense.
Further, should transmit depth map based on the human-computer interaction device of body sense and adopt many bit parallels interface, solve the problem of transmission channel bandwidth deficiency; Support wireless connections, can support equipment such as Wireless Keyboard, wireless mouse, earphone-microphone, wireless controller, solved the problem of meticulous accurate input control.
The above is preferred embodiment of the present utility model only, is not limited to the utility model, and for a person skilled in the art, the utility model can have various changes and variation.All within spirit of the present utility model and principle, any modification of doing, be equal to replacement, improvement etc., all should be included within the protection domain of the present utility model.
Claims (10)
1. the human-computer interaction device based on the body sense is characterized in that, comprising:
Acquiring unit is used for obtaining user action and acoustic information;
Central processing unit is connected with described acquiring unit, is used for action and acoustic information that identification gets access to;
Transmission unit is connected with described central processing unit, is used for exporting recognition result to controlled device, so that described controlled device is carried out corresponding order according to described recognition result.
2. the human-computer interaction device based on the body sense according to claim 1 is characterized in that, described acquiring unit comprises:
The action acquiring unit is for the image that obtains described user action; And
The voice acquiring unit is used for obtaining described user's voice information.
3. the human-computer interaction device based on the body sense according to claim 2 is characterized in that, described action acquiring unit comprises:
Structured light projector is for the space that structured light is projected to described user place;
Image acquisition device is for the image in the space of gathering described structured light projection; And
Programmable gate array is for the depth map that calculates and export the image that collects.
4. the human-computer interaction device based on the body sense according to claim 3 is characterized in that,
Described image acquisition device is monochrome image sensor;
Described structured light projector is single wavelength structure light projector; And
Described monochrome image sensor has the logical light filter plate of the band identical with described single wavelength structure light projector wavelength.
5. the human-computer interaction device based on the body sense according to claim 3 is characterized in that,
Described structured light projector is connected by first digital signal line with described programmable gate array;
Described image acquisition device is connected by second digital signal line with described programmable gate array; And
Described programmable gate array is connected by the three digital signal line with described central processing unit.
6. the human-computer interaction device based on the body sense according to claim 2 is characterized in that, described voice acquiring unit comprises:
The voice collecting device is used for gathering described user's voice signal, and described voice signal is converted to electric signal;
Signal conditioning circuit is used for described electric signal is carried out amplification filtering; And
The audio frequency analog to digital converter, being used for the analog signal conversion after the amplification filtering is to export after the digital signal.
7. the human-computer interaction device based on the body sense according to claim 6 is characterized in that,
Described voice collecting device is connected by first analog signal line with signal conditioning circuit;
Described signal conditioning circuit is connected by second analog signal line with described audio frequency analog to digital converter; And
Described audio frequency analog to digital converter is connected by the 4th digital signal line with described central processing unit.
8. the human-computer interaction device based on the body sense according to claim 1 is characterized in that, also comprises:
Wireless input device is used for receiving the control signal that the user imports; And
Wireless transceiver is connected with described central processing unit with described wireless input device, is used for exporting described control signal to described controlled device via described central processing unit and described transmission unit.
9. the human-computer interaction device based on the body sense according to claim 8 is characterized in that, described wireless input device comprises: Wireless Keyboard, wireless mouse, earphone-microphone and/or wireless controller.
10. the human-computer interaction device based on the body sense according to claim 8 is characterized in that, described central processing unit is connected by the 5th digital signal line with described wireless transceiver.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201320026829 CN203164866U (en) | 2013-01-17 | 2013-01-17 | Man-machine interaction equipment based on body feelings |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201320026829 CN203164866U (en) | 2013-01-17 | 2013-01-17 | Man-machine interaction equipment based on body feelings |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN203164866U true CN203164866U (en) | 2013-08-28 |
Family
ID=49026037
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201320026829 Expired - Fee Related CN203164866U (en) | 2013-01-17 | 2013-01-17 | Man-machine interaction equipment based on body feelings |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN203164866U (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103599621A (en) * | 2013-11-18 | 2014-02-26 | 四川长虹电器股份有限公司 | Treadmill system with voice control function and control method for treadmill system |
| CN104166466A (en) * | 2014-09-17 | 2014-11-26 | 北京行云时空科技有限公司 | Body feeling manipulating system and method provided with auxiliary control function |
| WO2015176467A1 (en) * | 2013-05-24 | 2015-11-26 | 文霞 | Robot |
| WO2019080934A1 (en) * | 2017-10-27 | 2019-05-02 | Oppo广东移动通信有限公司 | Image processing method and device as well as electronic device |
-
2013
- 2013-01-17 CN CN 201320026829 patent/CN203164866U/en not_active Expired - Fee Related
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015176467A1 (en) * | 2013-05-24 | 2015-11-26 | 文霞 | Robot |
| CN103599621A (en) * | 2013-11-18 | 2014-02-26 | 四川长虹电器股份有限公司 | Treadmill system with voice control function and control method for treadmill system |
| CN104166466A (en) * | 2014-09-17 | 2014-11-26 | 北京行云时空科技有限公司 | Body feeling manipulating system and method provided with auxiliary control function |
| WO2019080934A1 (en) * | 2017-10-27 | 2019-05-02 | Oppo广东移动通信有限公司 | Image processing method and device as well as electronic device |
| US11315268B2 (en) | 2017-10-27 | 2022-04-26 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing methods, image processing apparatuses and electronic devices |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107358007B (en) | It controls the method, apparatus of smart home system and calculates readable storage medium storing program for executing | |
| CN104410883B (en) | The mobile wearable contactless interactive system of one kind and method | |
| CN104049721B (en) | Information processing method and electronic equipment | |
| CN104156065B (en) | Home media playback equipment control method, device and equipment | |
| CN101370096B (en) | Interactive television remote control based on spacing positioning | |
| CN106346487A (en) | Interactive VR sand table show robot | |
| CN106773766A (en) | Smart home house keeper central control system and its control method with learning functionality | |
| CN106790628A (en) | Smart home house keeper central control system and its control method with body-sensing function | |
| CN203164866U (en) | Man-machine interaction equipment based on body feelings | |
| WO2015192631A1 (en) | Video conferencing system and method | |
| CN106782559A (en) | Smart home house keeper central control system and its control method with telecommunication control | |
| CN109068087A (en) | Intelligent meeting optical projection system | |
| CN107147769A (en) | Apparatus control method, device and mobile terminal based on mobile terminal | |
| CN205490994U (en) | Multi -functional intelligent sound box | |
| CN208969451U (en) | A kind of intelligent home control system | |
| CN208013683U (en) | Smart home house keeper's control device with body-sensing function | |
| CN108021046A (en) | A kind of robot for realizing human-computer interaction | |
| CN107479854A (en) | A kind of projecting apparatus and projecting method | |
| CN102413023B (en) | Interactive delight system and method | |
| WO2020151255A1 (en) | Display control system and method based on mobile terminal | |
| CN106998517A (en) | The method that electronic installation and audio are focused on again | |
| CN203966055U (en) | Wireless interaction optical projection system | |
| CN109743558A (en) | Project robot | |
| WO2023124972A1 (en) | Display state switching method, apparatus and system, electronic device and storage medium | |
| CN113014960B (en) | Method, device and storage medium for online video production |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130828 Termination date: 20180117 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |