CN103412681A - Intelligent 3D projection virtual touch control display technology - Google Patents
Intelligent 3D projection virtual touch control display technology Download PDFInfo
- Publication number
- CN103412681A CN103412681A CN2013101428500A CN201310142850A CN103412681A CN 103412681 A CN103412681 A CN 103412681A CN 2013101428500 A CN2013101428500 A CN 2013101428500A CN 201310142850 A CN201310142850 A CN 201310142850A CN 103412681 A CN103412681 A CN 103412681A
- Authority
- CN
- China
- Prior art keywords
- image
- screen
- cursor
- virtual
- image processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention relates to an intelligent 3D projection virtual touch control display technology. Hardware needed by implementation of the intelligent 3D projection virtual touch control display technology comprises a projection device used for 3D image display, a special screen matched with the projection device, an indicating device for virtual touch control, a virtual image real-time capture camera, a virtual image processing device and a master control device. The projection device for 3D image display can achieve naked-eye 3D on the obverse side of the matched special screen, and a 3D image can be directly observed. Light beams emitted by the indicating device for touch control penetrate through a 3D image imaging layer on the obverse side of the special screen to form an obvious cursor on the third layer of the special screen. The virtual image real-time capture camera captures the cursor on the reverse side of the special screen in real time, the virtual image processing device processes a captured image, and outputs the image to the projection device, comparison calculation is carried out between the image and an original image, and coordinate data of operations on the original image are obtained. The virtual image processing device can also identify the track of the cursor, a system has control over the image according to predefined operations of the track, and intelligence can be achieved.
Description
Technical field
This patent relates to the touch-control field, is specifically related to the virtual touch-control display technique of a kind of intelligent 3D projection
Background technology
It is a kind of brand-new display technique that 3D shows, can give the very strong three-dimensional realism of observer.Usually the implementation method of 3D technology is to obtain left-eye/right-eye two group image informations, and it is projected on screen, and the observer carrys out separate picture information with glasses, makes left eye obtain a group image information, and right eye obtains other one group.Bore hole 3D display technique is mainly used in panel display screen, adopt optical barrier type technology, lens pillar technology etc., wherein the optical barrier type technology adopts the slit grating, separate the left/right image information, the lens pillar technology is the array lens pillar of arranging on the lcd screen top layer, form certain image, can observe the 3D image at certain angle.
Touch technology is mainly used in flat pannel display, and the method for enforcement is on the LCD/OLED screen, application one touch-control module.The sensor of finger touch touch-control module, produce touching signals at touch point, and the absolute coordinates of this signal is transferred in screen, thereby this some place content is operated.Representative touch technology is projecting type capacitor touch technology, OGS etc., present stage touch technology be mainly used in the electronic products such as outdoor query facility, notebook, Pad and mobile phone, larger sized screen application touch technology less.
3D projection and virtual touch are two general orientation of the development of display technique, and both technological incorporation will bring spectators extraordinary visual experience.For large-area Projection Display, in the theory of " virtual touch-control " technology of picture, become market focus, to the operation of projection virtual screen, be the difficult point of this technology.
Summary of the invention
Patent of the present invention provides a kind of 3D shadow casting technique and virtual touch control integrated implementation method is realized to the virtual touch control operation to projected picture, has in addition also increased the intelligent function to the cursor movement track identification.
The device that the Technology Need that implementing this patent provides possesses comprises: for the projector equipment that 3D rendering shows, with the special screen that projector equipment is complementary, virtual touch-control indicating equipment, virtual image is caught camera, image processing apparatus, master control equipment in real time.
The projection image that described 3D rendering shows, in the front of screen, produces the 3D figure thereon, for observer's appreciation of this side.Here the screen front for generation of the 3D image comprises that ground floor can be the microtrabeculae lens board, also can be the slit grating layer, also can be other new function layers; The second layer is diffuse reflector.
The projector equipment that described 3D rendering shows can be realized bore hole 3D on the front screen of coupling, the observer need not wear the 3D glasses.
Described virtual image is caught the reverse side rear that camera is placed in special screen in real time, catch the virtual touch-control cursor of indicating equipment at the screen reverse side, through the virtual image treating apparatus, process picture, obtain the coordinate position of cursor in picture and the dimension information of picture.Coordinate position and picture dimension information are transported in the main control equipment of 3D rendering and the calculating of comparing with real picture, thereby obtain the coordinate information to showing that original picture operates.In addition, this virtual image treating apparatus can be differentiated the track of cursor, thereby realizes the content that the intelligent operation screen shows.
The accompanying drawing explanation
Accompanying drawing is included in order to the further understanding to the embodiment of the present invention is provided, and accompanying drawing is comprised in this instructions and forms its part, below will be elaborated to accompanying drawing.
Fig. 1: the virtual touch technology layout of a kind of intelligent 3D projection, in figure, 101 is projector equipments that 3D rendering shows, the 102nd, with the ground floor of the special screen of projector equipment coupling, the 103rd, with the second layer of the special screen of projector equipment coupling, the 104th, with the 3rd layer of the special screen of projector equipment coupling, the 105th, the image that is positioned at screen reverse side rear is caught camera in real time, and the 106th, virtual touch-control indicating equipment.
Fig. 2: the virtual touch technology schematic diagram of a kind of intelligent 3D projection, in figure, 201 is projector equipments that 3D rendering shows, the 202nd, special screen, the 203rd, image is caught camera, the 204th, image processing apparatus, the 205th, master control equipment in real time.
Fig. 3: catch in real time camera and obtain the picture schematic diagram, stain in figure (being not limited in black) is the cursor of indication equipment at the screen reverse side.The little figure in right side is after picture is carried out and cuts apart for N time, the situation of indicateing arm in cutting apart figure.
Fig. 4: image processing apparatus cursor Path Recognition schematic diagram, in figure from top to bottom, from bottom to top sliding path represent respectively before picture, turning over, after the operation such as turn over, circle, left oblique line, right oblique line, L shaped pattern etc. in picture, can be endowed special screen operation but be not limited to these figures in addition.
Embodiment
The virtual touch-control display technique of a kind of intelligent 3D projection of patent of invention, the hardware of implementing comprises: the projector equipment [101] that 3D rendering shows, front [102] and [103] with the special screen of projector equipment coupling, reverse side [104] with the special screen of projector equipment coupling, virtual touch-control indicating equipment [106], the image that is positioned at screen reverse side rear is caught camera [105] in real time, and camera is caught to the device [204] that image is processed, main control equipment [205].
Wherein, the screen that the described projector equipment shown with 3D rendering mates comprises two-layer, ground floor and the second layer show for positive 3D rendering, the 3rd layer of background colour for back side camera, can be common black etc., but must make in front the cursor of virtual touch-control indicating equipment (as laser pen etc.) can significantly present overleaf, and the picture of screen ground floor does not affect second layer picture.
Wherein by the front of image projection in special screen, the observer can bore hole observe the 3D image at homonymy, uses simultaneously virtual touch-control with indicating equipment, picture to be operated with projector equipment in the 3D rendering demonstration.
Wherein image capture camera and image processing apparatus collaborative work, image pickup head capturing visual exports it to image processing apparatus, this device is searched the cursor (accompanying drawing 3) of touch-control indicating equipment at the screen reverse side in image, if catch less than information, image processing apparatus feeds back to camera, camera carries out position adjustment and picture refreshing, again carries out picture catching and feeds back to image processing device, until image processing apparatus finds cursor.
Wherein image processing device to the initial alignment method of picture is: the operator can be along the line of the projection screen upper left corner to the lower right corner with virtual indicating equipment, also can be along the line of the projection screen upper right corner to the lower left corner, also can to the lower right corner and the upper right corner, intersect line to the lower left corner for successively doing the upper left corner, can be also the clockwise or counterclockwise stroke rectangular operation along four jiaos.Camera tracks the motion track of above-mentioned cursor, thereby determines four jiaos of picture, usings this as according to location.
Image processing apparatus to the disposal route of picture is, the positioning image corner location, then carry out the inferior ranks of N (N>2) to image and cut apart, and cuts apart image until cell size and the cursor sizableness of catching, and calculates the coordinate position of cursor in picture.Then image processing apparatus feeds back to main control equipment by image information and cursor coordinates, and main control equipment, according to image information and coordinate position, calculates the position coordinates with respect to cursor in real picture.
Image processing apparatus carries out record to the changes in coordinates of cursor, and judges the action implication of virtual touch-control indicating device, and this information also is output to main control equipment, thereby main control equipment operates accordingly to real picture, realizes the intellectualized operation virtual screen.Wherein on picture, the changes in coordinates of cursor and motion track comprise: point touches the ON/OFF that is defined as virtual contactor control device; Circle on screen of top-down line, line from bottom to top, cursor, left oblique line, right oblique line, L shaped pattern etc., but be not limited to these figures, all can be endowed corresponding screen operation.
Claims (10)
1. patent of the present invention relates to the virtual touch-control display technique of a kind of intelligent 3D projection, this brand-new touching technique has merged 3D shadow casting technique and virtual touch technology, implementing the hardware that this Technology Need possesses comprises: the projector equipment shown for 3D rendering, the special screen be complementary with projector equipment, virtual touch-control indicating equipment, image is caught camera, image processing apparatus, master control equipment in real time.
2. according to claims 1, the equipment of the projection that described 3D rendering shows can be realized bore hole 3D on the front screen of coupling, and the screen observer need not wear the 3D glasses.
3. according to claims 1,2, the screen mated with the described projector equipment shown with 3D rendering comprises three layers, ground floor and the second layer show for positive 3D rendering, the 3rd layer of background colour for back side camera, can be common black etc., but must make in front virtual touch-control indicating equipment emission of light (as laser pen etc.), at cursor, can significantly present overleaf, and the picture of screen ground floor does not affect first and second layer picture.
4. according to claims 1,2,3 is described, can be the microtrabeculae lens board be used to the screen ground floor that shows 3D rendering, also can be the slit grating layer, or other new function layer; The second layer is diffuse reflector.During above-mentioned two-layer being used in conjunction with, realize that the 3D of projects images shows, appreciate the 3D image for the observer of homonymy.
5. according to claims 1,2,3,4 is described, described image catches camera and image processing apparatus collaborative work in real time, image pickup head capturing visual exports it to image processing apparatus, this device is searched the cursor of touch-control indicating equipment at the screen reverse side in image, if catch less than information, image processing apparatus feeds back to camera, camera carries out refreshing of position adjustment and picture, again carries out picture catching and feeds back to image processing device, until image processing apparatus finds cursor.
6. according to claims 1,2,3,4,5 is described, image pickup head and image processing apparatus collaborative work, can follow the trail of in real time the cursor at the screen back side, the principle of identification cursor is: the intersection of the spot on image and spot neighbour bright-dark degree maximum, i.e. the place of contrast maximum, be judged to be the position of cursor.
7. according to claims 1,2,3,4,5,6 is described, image processing device is that the operator can, along the line of the projection screen upper left corner to the lower right corner, also can rule to the lower left corner along the projection screen upper right corner to the initial alignment method of picture, also can to the lower right corner and the upper right corner, intersect line to the lower left corner for successively doing the upper left corner, can be also the clockwise or counterclockwise stroke rectangular operation along four jiaos.
8. according to claim 1,2,3,4,5,6 is described, from catching in real time camera and image processing apparatus, to the localization method of cursor coordinates be: determine four jiaos, picture with the described location of claim 7 rule, then catch in real time the image that camera directly will catch and do the inferior ranks dividing processing of N (N>2), dividing processing is until the size of cell and screen back side cursor sizableness, think that now the coordinate of cursor in cutting apart image is actual coordinate, and this coordinate is fed back in master control system.
9. according to claims 1,2,3,4,5,6 is described, and master control system is to image information and cursor coordinates that image processing apparatus feeds back to, carries out certain algorithmic transformation and make the information of itself and real screen approach or consistent and definite cursor coordinates.Master control system also receives from the cursor movement track of image processing device simultaneously to be judged, implements the scheduled operation to original picture with this.
10. according to above claims, virtual contactor control device is deferred to following principle to projecting to the Operation Definition of picture on screen: point touches the ON/OFF that is defined as virtual contactor control device; Front page turning is defined as the top-down line of virtual contactor control device; Rear page turning is defined as the line from bottom to top of virtual contactor control device; The circle of cursor on screen, left oblique line, right oblique line, L shaped pattern etc., but be not limited to these figures, can be endowed special screen operation, thereby realize the intellectualized operation virtual screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013101428500A CN103412681A (en) | 2013-04-22 | 2013-04-22 | Intelligent 3D projection virtual touch control display technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013101428500A CN103412681A (en) | 2013-04-22 | 2013-04-22 | Intelligent 3D projection virtual touch control display technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103412681A true CN103412681A (en) | 2013-11-27 |
Family
ID=49605697
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2013101428500A Pending CN103412681A (en) | 2013-04-22 | 2013-04-22 | Intelligent 3D projection virtual touch control display technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103412681A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412680A (en) * | 2013-04-22 | 2013-11-27 | 深圳市富兴科技有限公司 | Intelligent 3D projection virtual touch control display technology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011137156A1 (en) * | 2010-04-30 | 2011-11-03 | Corning Incorporated | Laser scanning projector device for interactive screen applications |
| CN102445762A (en) * | 2012-01-06 | 2012-05-09 | 清华大学深圳研究生院 | Naked eye 3D (three-dimensional) projection screen and naked eye 3D projection system |
| CN102508546A (en) * | 2011-10-31 | 2012-06-20 | 冠捷显示科技（厦门）有限公司 | Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method |
| CN202870437U (en) * | 2012-10-30 | 2013-04-10 | 东莞市凯博美光电科技股份有限公司 | Three-dimensional (3D) display screen for naked eye |
| CN103412680A (en) * | 2013-04-22 | 2013-11-27 | 深圳市富兴科技有限公司 | Intelligent 3D projection virtual touch control display technology |
-
2013
- 2013-04-22 CN CN2013101428500A patent/CN103412681A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011137156A1 (en) * | 2010-04-30 | 2011-11-03 | Corning Incorporated | Laser scanning projector device for interactive screen applications |
| CN102508546A (en) * | 2011-10-31 | 2012-06-20 | 冠捷显示科技（厦门）有限公司 | Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method |
| CN102445762A (en) * | 2012-01-06 | 2012-05-09 | 清华大学深圳研究生院 | Naked eye 3D (three-dimensional) projection screen and naked eye 3D projection system |
| CN202870437U (en) * | 2012-10-30 | 2013-04-10 | 东莞市凯博美光电科技股份有限公司 | Three-dimensional (3D) display screen for naked eye |
| CN103412680A (en) * | 2013-04-22 | 2013-11-27 | 深圳市富兴科技有限公司 | Intelligent 3D projection virtual touch control display technology |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412680A (en) * | 2013-04-22 | 2013-11-27 | 深圳市富兴科技有限公司 | Intelligent 3D projection virtual touch control display technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6417702B2 (en) | Image processing apparatus, image processing method, and image processing program | |
| US9734392B2 (en) | Image processing device and image processing method | |
| US10045007B2 (en) | Method and apparatus for presenting 3D scene | |
| US9367951B1 (en) | Creating realistic three-dimensional effects | |
| CN103914152B (en) | Multi-point touch and the recognition methods and system that catch gesture motion in three dimensions | |
| RU2524834C2 (en) | Autostereoscopic rendering and display apparatus | |
| WO2017075932A1 (en) | Gesture-based control method and system based on three-dimensional displaying | |
| EP3696774A1 (en) | Method and apparatus for scanning a 3d object | |
| TW201426413A (en) | Three-dimensional interactive device and operation method thereof | |
| CN102508578B (en) | Projection positioning device and method as well as interaction system and method | |
| CN104166509A (en) | Non-contact screen interaction method and system | |
| KR20160108386A (en) | 3d silhouette sensing system | |
| Chan et al. | Enabling beyond-surface interactions for interactive surface with an invisible projection | |
| CN105373266A (en) | Novel binocular vision based interaction method and electronic whiteboard system | |
| CN102566827A (en) | Method and system for detecting object in virtual touch screen system | |
| EP3172721B1 (en) | Method and system for augmenting television watching experience | |
| KR20230065978A (en) | Systems, methods and media for directly repairing planar surfaces in a scene using structured light | |
| US9426416B2 (en) | System and method for utilizing a surface for remote collaboration | |
| CN103412680A (en) | Intelligent 3D projection virtual touch control display technology | |
| KR101426378B1 (en) | System and Method for Processing Presentation Event Using Depth Information | |
| CN107538485B (en) | Robot guiding method and system | |
| CN102541417A (en) | Multi-object tracking method and system in virtual touch screen system | |
| CN103412681A (en) | Intelligent 3D projection virtual touch control display technology | |
| US8760437B2 (en) | Sensing system | |
| CN101620485B (en) | Device and method for positioning light source |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| DD01 | Delivery of document by public notice |
Addressee: Shenzhen Fuxing Technology Co., Ltd. Document name: Notification that Application Deemed to be Withdrawn |
|
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20131127 |