CN102236408A - Multi-point human-computer interaction system for fusing large screen based on image recognition and multiple projectors - Google Patents
Multi-point human-computer interaction system for fusing large screen based on image recognition and multiple projectors Download PDFInfo
- Publication number
- CN102236408A CN102236408A CN2010101544103A CN201010154410A CN102236408A CN 102236408 A CN102236408 A CN 102236408A CN 2010101544103 A CN2010101544103 A CN 2010101544103A CN 201010154410 A CN201010154410 A CN 201010154410A CN 102236408 A CN102236408 A CN 102236408A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- projector
- user
- projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a multi-point human-computer interaction system for fusing a large screen based on image recognition and multiple projectors, and belongs to the technical field of computer software and projection. The multi-point human-computer interaction system comprises an image layout module, a projection data receiving module, a projection data merging module, a standard effect module, an effect detection module and a data output module aiming at fulfilling the aim of fusing the large screen based on the image recognition and multiple projectors corresponding to a projecting apparatus and projection screen equipment, and comprises a user output monitoring module, a user output recognition module, a screen coordinate conversion module and a user output result data merging module aiming at fulfilling the aim of human-computer interaction. According to the system, various images are effectively merged and displayed, and the action of the user is effectively converted into a trigger command, so that the sense of immersion of a scene is enhanced and a more natural human-computer interaction mode is realized.
Description
Technical field
The present invention relates to the technical field of computer software and projection, relate in particular to a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector.
Background technology
In the displaying that places such as science and technology center, museum, Stadium and kursaal are the theme with the scene movie theatre, use common image export technique, people generally can't see a wideer picture, visual impact is big inadequately, influence the feeling of immersion of exhibition item or displaying content to a great extent, do not reached desirable effect.
At above-mentioned phenomenon, Chinese patent (Granted publication CN201159827Y) discloses a kind of full-length splicing optical projection system, the projection screen that comprises a wide cut, a plurality of projectors are installed before the projection screen, one image output computing machine is arranged, a synchronous output pattern accelerator card of hyperchannel image is installed on this computing machine, and described a plurality of projectors signal input part is linked into respectively on each passage of described graphics acceleration card.By by a computing machine and a multichannel image synchronization output pattern accelerator card, in system, implant the heterochromia that software masking causes because of projector's hardware again, take all factors into consideration the smooth excessiveness of luminance index between hyperchannel, calculate fitting function, carry out Digital Image Processing, realize merging effective fusion of image in the band.Chinese patent (publication number CN101183276A) has proposed a kind of " based on the interactive system of CCD camera porjector technology ", comprise: camera, projector, computing machine, interactive identification module, rendering module, described projector with the image projection played up on setting regions; Described camera is caught fixed scene, here fixed scene refers to and comprises projector projects and come out picture in an interior zone, after camera photographs this piece zone, in the image of taking, identify the zone of projected picture, and then further analyze by the interactive identification module; Described interactive identification module analysis goes out after forefathers' position and action message to rendering module transmission message; Described rendering module is made response to the message of interactive identification module input, finishes corresponding animation and generates and real-time rendering.
In view of the above-mentioned state of the art, the present invention proposes a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, corresponding projector and projection screen equipment, with realize based on image recognition, multi-projector is large screen-fused is purpose, and image layout module, data for projection receiver module, data for projection die section, standard effects module, effect monitoring module and data outputting module are set; To realize that man-machine interaction is a purpose, be provided with that the user exports monitoring modular, the user exports identification module, screen coordinate modular converter and user and exports the result data Fusion Module, corresponding again scene makes man-machine interaction more natural in the enhanced scene feeling of immersion.
Summary of the invention
The purpose of this invention is to provide a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, multiple image is merged demonstration effectively, and transfer user's action to triggering command effectively, strengthened the feeling of immersion of scene and realized a kind of more natural man-machine interaction mode.
Of the present invention based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it includes the projection screen that is used to realize the projector of projection and accepts projecting function, and this system also comprises:
The image layout module, it is the modular structure that is used for view data is carried out according to the purpose that merges regional layout;
The data for projection receiver module, it is to be used to receive the modular structure that need carry out the project content of data processing;
The data for projection die section, it utilizes aforesaid image layout module, comes the picture material that aforesaid data for projection receiver module is obtained is carried out layout processing, will handle the functional structure that the back data are carried out amalgamation then;
The standard effects module, it is the modular structure that is provided for detecting the standard content of data amalgamation effect;
Effect monitoring module, its correspondence the setting of aforesaid data for projection die section, utilize aforesaid standard effects module, come the data content that aforesaid data for projection die section is obtained is compared, thus the effect that decision data merges;
Data outputting module, it is connected with aforesaid effect monitoring module and aforesaid data for projection die section, under the situation that obtains the permission of effect monitoring module, data is exported;
The user exports monitoring modular, and it is the modular structure that is used for monitor user ' interactive information output situation;
The user exports identification module, and it is to export monitoring modular with aforesaid user to be connected, and the user profile that is used for the user is exported is carried out the module identified structure, includes user interaction information standard module;
The screen coordinate modular converter, it is to be used for that aforesaid user is exported identification module to obtain
The user exports the result data Fusion Module, and it is to be used for screen coordinate data that aforesaid screen coordinate modular converter is converted to, is fused in the aforesaid data for projection die section, forms the modular structure of interactive operation.
Further, described based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, also have following technical characterictic:
Described user exports monitoring modular, realizes by camera.This camera can be to infrared light activated infrared camera.
Described user exports the pairing user's output information of identification module and includes the three primary colors generator.This three primary colors generator can be to include trichromatic light pen or include a kind of in the trichromatic gloves.
Described system includes 2-4 projector.Between the described projector, be provided with projector angle configurations assembly, be used for adjusting angle between the projector according to the pattern of image co-registration.
Described image layout module, pairing picture material comprise that all can be through the content-form of projector Projection Display.
Advantage of the present invention:
Multiple spot man-machine interactive system of the present invention, corresponding projector and projection screen equipment, with realize based on image recognition, multi-projector is large screen-fused is purpose, this multiple spot man-machine interactive system includes image layout module, data for projection receiver module, data for projection die section, standard effects module, effect monitoring module and data outputting module; Realizing that man-machine interaction is a purpose, this multiple spot man-machine interactive system includes that the user exports monitoring modular, the user exports identification module, screen coordinate modular converter and user and exports the result data Fusion Module.The present invention is merged multiple image with demonstration effectively, and user's action is changed into triggering command effectively, has strengthened the feeling of immersion of scene and has realized a kind of more natural man-machine interaction mode.
Description of drawings
Below in conjunction with accompanying drawing, based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, be described in further detail of the present invention:
Fig. 1 is the theory diagram of multiple spot man-machine interactive system of the present invention.
Fig. 2 is a kind of specific embodiment of multiple spot man-machine interactive system of the present invention.
Label declaration among the figure:
Multiple spot man-machine interactive system-100, image layout module-110, data for projection receiver module-120, data for projection die section-130, standard effects module-140, effect monitoring module-150, data outputting module-160, the user exports monitoring modular-170, and the user exports identification module-180, user interaction information standard module-181, screen coordinate modular converter-190, the user exports result data Fusion Module-200, camera-210, projector-220, projection screen-230, command identification body-240.
Embodiment
At first, the present invention is done an integral body introduction with reference to the theory diagram of multiple spot man-machine interactive system of the present invention shown in Figure 1.
Of the present inventionly be primarily aimed at existing projector and projection screen system, add image amalgamation and human-computer interaction function based on image recognition, the large screen-fused multiple spot man-machine interactive system 100 of multi-projector.This multiple spot man-machine interactive system includes the projection screen that is used to realize the projector of projection and accepts projecting function, this system includes 2-4 projector, between each projector, be provided with the projector angle configurations assembly that is used for adjusting the angle between the projector according to the pattern of image co-registration.
Corresponding projector and projection screen, in order to realize based on image recognition, the function that multi-projector is large screen-fused, this multiple spot man-machine interactive system 100 includes image layout module 110, data for projection receiver module 120, data for projection die section 130, standard effects module 140, effect monitoring module 150 and data outputting module 160, wherein, image layout module 110 is the modular structures that are used for view data is carried out according to the purpose that merges regional layout, the pairing picture material of this module comprises that all can be through the content-form of projector Projection Display, it can be about landscape, personage's etc. static images, the dynamic demonstration that also can relate to impart knowledge to students are tested or are showed the relevant video content of purposes with other.Data for projection receiver module 120 is to be used to receive the modular structure that need carry out the project content of data processing, and project content described here is similar to aforesaid picture material.
Corresponding aforesaid image layout module 110 and data for projection receiver module 120, this system is provided with data for projection die section 130, it is to utilize aforesaid image layout module 110, come the picture material that aforesaid data for projection receiver module 120 is obtained is carried out layout processing, will handle the functional structure that the back data are carried out amalgamation then.For example, in Chemistry Teaching of Senior High School, the teacher needs to prepare the chemical equation of sodium in water, the reacting phenomenon of sodium in water in order to show the vigorous reaction of sodium in water to students.In order further to allow theory combine with phenomenon, chemical equation and the synchronous displaying of real reaction phenomenon more can be deepened the understanding of students, at this moment, carry out layout processing with regard to the picture that needs to include the chemical equation that sodium reacts in water and actual reacting phenomenon, then that it is corresponding data mode is fused in the giant-screen.
In order to judge the data fusion effect of aforesaid data for projection die section 130, corresponding aforesaid data for projection die section 130, this system is provided with standard effects module 140 and effect monitoring module 150.Wherein, standard effects module 140 is to include in advance being used to of setting up to detect the modular structure of the standard content of data amalgamation effect; Effect monitoring module 150 is to utilize aforesaid standard effects module 140, comes the data content that aforesaid data for projection die section 130 is obtained is compared, thus the functional structure of decision data syncretizing effect.Via effect monitoring module 150 actual fused result and standard effects module 140 corresponding standard fusion results are compared, when the actual fused result reaches or surmount the standard fusion results, this effect monitoring module will be in " permission " state, otherwise is in " disapproving " state.
Both are connected with aforesaid data for projection die section 130 and effect monitoring module 150, be provided with data outputting module 160, when effect monitoring module 150 was in " permission " state, data outputting module 160 will export the fusion results of system on the projection screen to.
Corresponding projector and projection screen, in order to realize the function of man-machine interaction, this multiple spot man-machine interactive system includes that the user exports monitoring modular 170, the user exports identification module 180, screen coordinate modular converter 190 and user and exports result data Fusion Module 200, wherein, it is the modular structures that are used for monitor user ' interactive information output situation that the user exports monitoring modular 170, this user exports monitoring modular 170 and can realize by camera, for example and without limitation, camera can be to infrared light activated infrared camera.This user exports monitoring modular 170 and mainly utilizes camera to shoot with video-corder user's corelation behaviour operation, and for example, at the displaying contents on the projection screen, the user carries out clicking operation on certain icon.
Export monitoring modular 170 with aforesaid user and be connected, be provided with the user that the user profile that is used for that the user is exported discerns and export identification module 180, this module includes user interaction information standard module 181.In described user interaction information standard module 181, include the Standard User interactive information that sets in advance.For example, at the displaying contents on the projection screen, the user carries out clicking operation on certain icon, when the user clicks, and corresponding left mouse button; When the user clicks twice, corresponding right mouse button.Wherein, described user exports identification module 180 pairing user's output informations and includes the three primary colors generator, and this three primary colors generator can be to include trichromatic light pen or include a kind of in the trichromatic gloves.
Corresponding aforesaid user exports identification module 180, is provided with screen coordinate modular converter 190, and this module is used for aforesaid user is exported the recognition result that identification module 180 is obtained, and converts the screen coordinate data to.For example and without limitation, when the user clicked in the lower right corner of projection screen, this screen coordinate modular converter 190 will change into coordinate data in the position that it is corresponding.
Corresponding aforesaid screen coordinate modular converter 190, be provided with the user and export result data Fusion Module 200, it is to be used for screen coordinate data that aforesaid screen coordinate modular converter 190 is converted to, be fused in the aforesaid data for projection die section 130, form the modular structure of human-computer interaction operation.For example, at the displaying contents on the projection screen, when the user clicks, will on projection screen, trigger and show the content of left mouse button correspondence on certain icon in the lower right corner.
Specific embodiment
Fig. 2 is a kind of specific embodiment of multiple spot man-machine interactive system of the present invention.In Chemistry Teaching of Senior High School,, need the 1. chemical equation of sodium in water, 2. these two scenes of the reacting phenomenon of sodium in water if show the vigorous reaction of sodium in water to students.Chemical equation and the synchronous displaying of reacting phenomenon more can be deepened the understanding of students, corresponding in the present embodiment aforesaid two scenes, setting is in order to gather the camera 210 of chemical equation picture and the reaction video of sodium in water, corresponding camera 210 is provided with projector 220, with the data transmission related of aforementioned collection with chemical equation picture and the reaction video of sodium in water to the data for projection receiver module, utilize the image layout module that it is carried out layout, and the data mode of correspondence is fused on the projection screen 230 according to layout format.
In concrete explanation process, camera 210 is shot with video-corder user's hand and is clicked on projection screen 230, export identification module and screen coordinate modular converter via the user who is arranged in the system, user's click behavior is changed into the operation of left mouse button correspondence, utilizing the user to export the result data Fusion Module is fused to this trigger action in the aforesaid projection scene, change into corresponding command identification body 240, thereby implement corresponding human-computer interaction operation.
More than be the description of this invention and non-limiting, based on other embodiment of inventive concept, all among protection scope of the present invention.
Claims (9)
1. one kind based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, and it includes the projection screen that is used to realize the projector of projection and accepts projecting function, it is characterized in that this system comprises:
The image layout module, it is the modular structure that is used for view data is carried out according to the purpose that merges regional layout;
The data for projection receiver module, it is to be used to receive the modular structure that need carry out the project content of data processing;
The data for projection die section, it utilizes aforesaid image layout module, comes the picture material that aforesaid data for projection receiver module is obtained is carried out layout processing, will handle the functional structure that the back data are carried out amalgamation then;
The standard effects module, it is the modular structure that is provided for detecting the standard content of data amalgamation effect;
Effect detection module, its correspondence the setting of aforesaid data for projection die section, utilize aforesaid standard effects module, come the data content that aforesaid data for projection die section is obtained is compared, thus the effect that decision data merges;
Data outputting module, it is to be connected with aforesaid effect monitoring module and aforesaid data for projection die section, under the situation that obtains the permission of effect detection module, data is exported;
The user exports monitoring modular, and it is the modular structure that is used for monitor user ' interactive information output situation;
The user exports identification module, and it is exported monitoring modular with aforesaid user and is connected, and the user profile that is used for the user is exported is carried out the module identified structure, includes user interaction information standard module;
The screen coordinate modular converter, it is to be used for aforesaid user is exported the recognition result that identification module obtains, and converts the modular structure of screen coordinate data to;
The user exports the result data Fusion Module, and it is to be used for screen coordinate data that aforesaid screen coordinate modular converter is converted to, is fused in the aforesaid data for projection die section, forms the modular structure of interactive operation.
2. according to claim 1 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described user exports monitoring modular, realizes by camera.
3. according to claim 2 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described camera is to infrared photosensitive
4. according to claim 1 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described user exports the pairing user's output information of identification module and includes the three primary colors generator.
5. according to claim 4 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described three primary colors generator is to include trichromatic light pen.
6. according to claim 4 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described three primary colors generator is to include trichromatic gloves.
7. according to claim 1 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described system includes 2-4 projector.
8. according to claim 1 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: between the described projector, be provided with projector angle configurations assembly, be used for adjusting angle between the projector according to the pattern of image co-registration.
9. according to claim 1 a kind of based on image recognition, the large screen-fused multiple spot man-machine interactive system of multi-projector, it is characterized in that: described image layout module, pairing picture material comprise that all can be through the content-form of projector Projection Display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101544103A CN102236408A (en) | 2010-04-23 | 2010-04-23 | Multi-point human-computer interaction system for fusing large screen based on image recognition and multiple projectors |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101544103A CN102236408A (en) | 2010-04-23 | 2010-04-23 | Multi-point human-computer interaction system for fusing large screen based on image recognition and multiple projectors |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102236408A true CN102236408A (en) | 2011-11-09 |
Family
ID=44887129
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101544103A Pending CN102236408A (en) | 2010-04-23 | 2010-04-23 | Multi-point human-computer interaction system for fusing large screen based on image recognition and multiple projectors |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102236408A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765443A (en) * | 2014-01-03 | 2015-07-08 | 伊吉士摩斯科技股份有限公司 | Image type virtual interaction device and implementation method thereof |
| CN105679126A (en) * | 2014-11-21 | 2016-06-15 | 台达电子工业股份有限公司 | Display device, video system, display method and projector |
| CN106803932A (en) * | 2017-03-31 | 2017-06-06 | 合肥安达创展科技股份有限公司 | A kind of utilization dynamic recognition technique and the method for image fusion technology interactive demonstration |
| WO2018000519A1 (en) * | 2016-06-28 | 2018-01-04 | 广景视睿科技（深圳）有限公司 | Projection-based interaction control method and system for user interaction icon |
| CN110121062A (en) * | 2018-02-04 | 2019-08-13 | 郑州工业应用技术学院 | A kind of interactive system and its exchange method based on more projection arrangements |
| CN110267020A (en) * | 2018-03-12 | 2019-09-20 | 郑州工业应用技术学院 | A kind of interactive system and its exchange method based on more projection arrangements |
-
2010
- 2010-04-23 CN CN2010101544103A patent/CN102236408A/en active Pending
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765443A (en) * | 2014-01-03 | 2015-07-08 | 伊吉士摩斯科技股份有限公司 | Image type virtual interaction device and implementation method thereof |
| CN104765443B (en) * | 2014-01-03 | 2017-08-11 | 异奇科技股份有限公司 | Image type virtual interaction device and implementation method thereof |
| CN105679126A (en) * | 2014-11-21 | 2016-06-15 | 台达电子工业股份有限公司 | Display device, video system, display method and projector |
| CN105679126B (en) * | 2014-11-21 | 2018-10-26 | 台达电子工业股份有限公司 | Display device, video system, display methods and projector |
| WO2018000519A1 (en) * | 2016-06-28 | 2018-01-04 | 广景视睿科技（深圳）有限公司 | Projection-based interaction control method and system for user interaction icon |
| CN106803932A (en) * | 2017-03-31 | 2017-06-06 | 合肥安达创展科技股份有限公司 | A kind of utilization dynamic recognition technique and the method for image fusion technology interactive demonstration |
| CN110121062A (en) * | 2018-02-04 | 2019-08-13 | 郑州工业应用技术学院 | A kind of interactive system and its exchange method based on more projection arrangements |
| CN110267020A (en) * | 2018-03-12 | 2019-09-20 | 郑州工业应用技术学院 | A kind of interactive system and its exchange method based on more projection arrangements |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Walter et al. | StrikeAPose: revealing mid-air gestures on public displays | |
| CN102540464B (en) | Head-mounted display device which provides surround video | |
| Vatavu | There's a world outside your TV: exploring interactions beyond the physical TV screen | |
| CN102236408A (en) | Multi-point human-computer interaction system for fusing large screen based on image recognition and multiple projectors | |
| US20120056989A1 (en) | Image recognition apparatus, operation determining method and program | |
| CN206402367U (en) | A kind of seamless optical projection system of three-dimensional scenic ring curtain based on Unity3D | |
| CN105139701A (en) | Interactive children teaching system | |
| Li et al. | Interactive two-sided transparent displays: designing for collaboration | |
| CN105929538A (en) | Virtual reality equipment display method and device | |
| JP4555701B2 (en) | Information processing method, interface device, program, and recording medium | |
| CN110174950B (en) | Scene switching method based on transmission gate | |
| CN112071130A (en) | Knowledge education system and education method based on VR technology | |
| JP5279482B2 (en) | Image processing apparatus, method, and program | |
| CN102740029A (en) | Light emitting diode (LED) display module, LED television and LED television system | |
| US20210081092A1 (en) | Information processing system, information processing method, and program | |
| Pauchet et al. | TableTops: Worthwhile experiences of collocated and remote collaboration | |
| CN208224991U (en) | A kind of Chinese character wall interactive device | |
| JP6699406B2 (en) | Information processing device, program, position information creation method, information processing system | |
| CN103309444A (en) | Kinect-based intelligent panoramic display method | |
| AlKassim | Virtual laser keyboards: A giant leap towards human-computer interaction | |
| CN106710445A (en) | Intelligent three-dimensional advertisement player with touching and adjusting functions | |
| Moriarty et al. | Utilizing explorable visual environments for experiential applications | |
| Marinos et al. | Large-area moderator tracking and demonstrational configuration of position based interactions for virtual studios | |
| JP4766696B2 (en) | Interface device and interface system | |
| Demitševa | Gesture based computer controlling using Kinect camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| DD01 | Delivery of document by public notice |
Addressee: Shanghai Aishuo Software Technology Co.,Ltd. Document name: Notification of before Expiration of Request of Examination as to Substance |
|
| DD01 | Delivery of document by public notice |
Addressee: Shanghai Aishuo Software Technology Co.,Ltd. Document name: Notification that Application Deemed to be Withdrawn |
|
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20111109 |