CN103412680A - Intelligent 3D projection virtual touch control display technology - Google Patents

Intelligent 3D projection virtual touch control display technology Download PDF

Info

Publication number
CN103412680A
CN103412680A CN2013101425945A CN201310142594A CN103412680A CN 103412680 A CN103412680 A CN 103412680A CN 2013101425945 A CN2013101425945 A CN 2013101425945A CN 201310142594 A CN201310142594 A CN 201310142594A CN 103412680 A CN103412680 A CN 103412680A
Authority
CN
China
Prior art keywords
screen
cursor
image
virtual
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2013101425945A
Other languages
Chinese (zh)
Inventor
林建国
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN FUXING TECHNOLOGY Co Ltd
Original Assignee
SHENZHEN FUXING TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN FUXING TECHNOLOGY Co Ltd filed Critical SHENZHEN FUXING TECHNOLOGY Co Ltd
Priority to CN2013101425945A priority Critical patent/CN103412680A/en
Publication of CN103412680A publication Critical patent/CN103412680A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention relates to an intelligent 3D projection virtual touch control display technology. Hardware which is needed for implementing the technology comprises projection equipment used for displaying 3D images, a special screen, indicating equipment for virtual touch control, a camera for capturing virtual images in real time, a device for processing the virtual images and main control equipment. The special screen is matched with the projection equipment. Naked eye 3D functions can be achieved on the front screen matched with the projection equipment by the projection equipment for displaying the 3D images, and then the 3D images can be directly observed. Light beams emitted by the indicating equipment for touch control transmit a 3D image imaging layer on the front side of the special screen to form obvious cursors on the third layer of the screen. The camera for capturing the images in real time captures the cursors on the reverse side of the screen, the captured images are processed by the device for processing the virtual images, then output to the projection equipment, and calculated by being compared with an original picture, and then coordinate data for operating an original picture are acquired. The device for processing the virtual images can also identify cursor tracks, the system controls the picture according to predefined operation of the track, and therefore intelligentization is achieved.

Description

The virtual touch-control display technique of a kind of intelligent 3D projection
Technical field
This patent relates to the touch-control field, is specifically related to the virtual touch-control display technique of a kind of intelligent 3D projection
Background technology
It is a kind of brand-new display technique that 3D shows, can give the very strong three-dimensional realism of observer.Usually the implementation method of 3D technology is to obtain left-eye/right-eye two group image informations, and it is projected on screen, and the observer carrys out separate picture information with glasses, makes left eye obtain a group image information, and right eye obtains other one group.Bore hole 3D display technique is mainly used in panel display screen, adopt optical barrier type technology, lens pillar technology etc., wherein the optical barrier type technology adopts the slit grating, separate the left/right image information, the lens pillar technology is the array lens pillar of arranging on the lcd screen top layer, form certain image, can observe the 3D image at certain angle.
Touch technology is mainly used in flat pannel display, and the method for enforcement is on the LCD/OLED screen, application one touch-control module.The sensor of finger touch touch-control module, produce touching signals at touch point, and the absolute coordinates of this signal is transferred in screen, thereby this some place content is operated.Representative touch technology is projecting type capacitor touch technology, OGS etc., present stage touch technology be mainly used in the electronic products such as outdoor query facility, notebook, Pad and mobile phone, larger sized screen application touch technology less.
3D projection and virtual touch are two general orientation of the development of display technique, and both technological incorporation will bring spectators extraordinary visual experience.For large-area Projection Display, in the theory of " virtual touch-control " technology of picture, become market focus, to the operation of projection virtual screen, be the difficult point of this technology.
Summary of the invention
Patent of the present invention provides a kind of 3D shadow casting technique and virtual touch control integrated implementation method is realized to the virtual touch control operation to projected picture, has in addition also increased the intelligent function to the cursor movement track identification.
The device that the Technology Need that implementing this patent provides possesses comprises: for the projector equipment that 3D rendering shows, with the special screen that projector equipment is complementary, virtual touch-control indicating equipment, virtual image is caught camera, image processing apparatus, master control equipment in real time.
The projection image that described 3D rendering shows, in the front of screen, produces the 3D figure thereon, for observer's appreciation of this side.Here the screen front for generation of the 3D image comprises that ground floor can be the microtrabeculae lens board, also can be the slit grating layer, also can be other new function layers; The second layer is diffuse reflector.
The projector equipment that described 3D rendering shows can be realized bore hole 3D on the front screen of coupling, the observer need not wear the 3D glasses.
Described virtual image is caught the reverse side rear that camera is placed in special screen in real time, catch the virtual touch-control cursor of indicating equipment at the screen reverse side, through the virtual image treating apparatus, process picture, obtain the coordinate position of cursor in picture and the dimension information of picture.Coordinate position and picture dimension information are transported in the main control equipment of 3D rendering and the calculating of comparing with real picture, thereby obtain the coordinate information to showing that original picture operates.In addition, this virtual image treating apparatus can be differentiated the track of cursor, thereby realizes the content that the intelligent operation screen shows.
The accompanying drawing explanation
Accompanying drawing is included in order to the further understanding to the embodiment of the present invention is provided, and accompanying drawing is comprised in this instructions and forms its part, below will be elaborated to accompanying drawing.
Fig. 1: the virtual touch technology layout of a kind of intelligent 3D projection, in figure, 101 is projector equipments that 3D rendering shows, the 102nd, with the ground floor of the special screen of projector equipment coupling, the 103rd, with the second layer of the special screen of projector equipment coupling, the 104th, with the 3rd layer of the special screen of projector equipment coupling, the 105th, the image that is positioned at screen reverse side rear is caught camera in real time, and the 106th, virtual touch-control indicating equipment.
Fig. 2: the virtual touch technology schematic diagram of a kind of intelligent 3D projection, in figure, 201 is projector equipments that 3D rendering shows, the 202nd, special screen, the 203rd, image is caught camera, the 204th, image processing apparatus, the 205th, master control equipment in real time.
Fig. 3: catch in real time camera and obtain the picture schematic diagram, stain in figure (being not limited in black) is the cursor of indication equipment at the screen reverse side.The little figure in right side is after picture is carried out and cuts apart for N time, the situation of indicateing arm in cutting apart figure.
Fig. 4: image processing apparatus cursor Path Recognition schematic diagram, in figure from top to bottom, from bottom to top sliding path represent respectively before picture, turning over, after the operation such as turn over, circle, left oblique line, right oblique line, L shaped pattern etc. in picture, can be endowed special screen operation but be not limited to these figures in addition.
Embodiment
The virtual touch-control display technique of a kind of intelligent 3D projection of patent of invention, the hardware of implementing comprises: the projector equipment [101] that 3D rendering shows, front [102] and [103] with the special screen of projector equipment coupling, reverse side [104] with the special screen of projector equipment coupling, virtual touch-control indicating equipment [106], the image that is positioned at screen reverse side rear is caught camera [105] in real time, and camera is caught to the device [204] that image is processed, main control equipment [205].
Wherein, the screen that the described projector equipment shown with 3D rendering mates comprises two-layer, ground floor and the second layer show for positive 3D rendering, the 3rd layer of background colour for back side camera, can be common black etc., but must make in front the cursor of virtual touch-control indicating equipment (as laser pen etc.) can significantly present overleaf, and the picture of screen ground floor does not affect second layer picture.
Wherein by the front of image projection in special screen, the observer can bore hole observe the 3D image at homonymy, uses simultaneously virtual touch-control with indicating equipment, picture to be operated with projector equipment in the 3D rendering demonstration.
Wherein image capture camera and image processing apparatus collaborative work, image pickup head capturing visual exports it to image processing apparatus, this device is searched the cursor (accompanying drawing 3) of touch-control indicating equipment at the screen reverse side in image, if catch less than information, image processing apparatus feeds back to camera, camera carries out position adjustment and picture refreshing, again carries out picture catching and feeds back to image processing device, until image processing apparatus finds cursor.
Wherein image processing device to the initial alignment method of picture is: the operator can be along the line of the projection screen upper left corner to the lower right corner with virtual indicating equipment, also can be along the line of the projection screen upper right corner to the lower left corner, also can to the lower right corner and the upper right corner, intersect line to the lower left corner for successively doing the upper left corner, can be also the clockwise or counterclockwise stroke rectangular operation along four jiaos.Camera tracks the motion track of above-mentioned cursor, thereby determines four jiaos of picture, usings this as according to location.
Image processing apparatus to the disposal route of picture is, the positioning image corner location, then carry out the inferior ranks of N (N>2) to image and cut apart, and cuts apart image until cell size and the cursor sizableness of catching, and calculates the coordinate position of cursor in picture.Then image processing apparatus feeds back to main control equipment by image information and cursor coordinates, and main control equipment, according to image information and coordinate position, calculates the position coordinates with respect to cursor in real picture.
Image processing apparatus carries out record to the changes in coordinates of cursor, and judges the action implication of virtual touch-control indicating device, and this information also is output to main control equipment, thereby main control equipment operates accordingly to real picture, realizes the intellectualized operation virtual screen.Wherein on picture, the changes in coordinates of cursor and motion track comprise: point touches the ON/OFF that is defined as virtual contactor control device; Circle on screen of top-down line, line from bottom to top, cursor, left oblique line, right oblique line, L shaped pattern etc., but be not limited to these figures, all can be endowed corresponding screen operation.

Claims (10)

1. patent of the present invention relates to the virtual touch-control display technique of a kind of intelligent 3D projection, this brand-new touching technique has merged 3D shadow casting technique and virtual touch technology, implementing the hardware that this Technology Need possesses comprises: the projector equipment shown for 3D rendering, the special screen be complementary with projector equipment, virtual touch-control indicating equipment, image is caught camera, image processing apparatus, master control equipment in real time.
2. according to claims 1, the equipment of the projection that described 3D rendering shows can be realized bore hole 3D on the front screen of coupling, and the screen observer need not wear the 3D glasses.
3. according to claims 1,2, the screen mated with the described projector equipment shown with 3D rendering comprises three layers, ground floor and the second layer show for positive 3D rendering, the 3rd layer of background colour for back side camera, can be common black etc., but must make in front virtual touch-control indicating equipment emission of light (as laser pen etc.), at cursor, can significantly present overleaf, and the picture of screen ground floor does not affect first and second layer picture.
4. according to claims 1,2,3 is described, can be the microtrabeculae lens board be used to the screen ground floor that shows 3D rendering, also can be the slit grating layer, or other new function layer; The second layer is diffuse reflector.During above-mentioned two-layer being used in conjunction with, realize that the 3D of projects images shows, appreciate the 3D image for the observer of homonymy.
5. according to claims 1,2,3,4 is described, described image catches camera and image processing apparatus collaborative work in real time, image pickup head capturing visual exports it to image processing apparatus, this device is searched the cursor of touch-control indicating equipment at the screen reverse side in image, if catch less than information, image processing apparatus feeds back to camera, camera carries out refreshing of position adjustment and picture, again carries out picture catching and feeds back to image processing device, until image processing apparatus finds cursor.
6. according to claims 1,2,3,4,5 is described, image pickup head and image processing apparatus collaborative work, can follow the trail of in real time the cursor at the screen back side, the principle of identification cursor is: the intersection of the spot on image and spot neighbour bright-dark degree maximum, i.e. the place of contrast maximum, be judged to be the position of cursor.
7. according to claims 1,2,3,4,5,6 is described, image processing device is that the operator can, along the line of the projection screen upper left corner to the lower right corner, also can rule to the lower left corner along the projection screen upper right corner to the initial alignment method of picture, also can to the lower right corner and the upper right corner, intersect line to the lower left corner for successively doing the upper left corner, can be also the clockwise or counterclockwise stroke rectangular operation along four jiaos.
8. according to claim 1,2,3,4,5,6 is described, from catching in real time camera and image processing apparatus, to the localization method of cursor coordinates be: determine four jiaos, picture with the described location of claim 7 rule, then catch in real time the image that camera directly will catch and do the inferior ranks dividing processing of N (N>2), dividing processing is until the size of cell and screen back side cursor sizableness, think that now the coordinate of cursor in cutting apart image is actual coordinate, and this coordinate is fed back in master control system.
9. according to claims 1,2,3,4,5,6 is described, and master control system is to image information and cursor coordinates that image processing apparatus feeds back to, carries out certain algorithmic transformation and make the information of itself and real screen approach or consistent and definite cursor coordinates.Master control system also receives from the cursor movement track of image processing device simultaneously to be judged, implements the scheduled operation to original picture with this.
10. according to above claims, virtual contactor control device is deferred to following principle to projecting to the Operation Definition of picture on screen: point touches the ON/OFF that is defined as virtual contactor control device; Front page turning is defined as the top-down line of virtual contactor control device; Rear page turning is defined as the line from bottom to top of virtual contactor control device; The circle of cursor on screen, left oblique line, right oblique line, L shaped pattern etc., but be not limited to these figures, can be endowed special screen operation, thereby realize the intellectualized operation virtual screen.
CN2013101425945A 2013-04-22 2013-04-22 Intelligent 3D projection virtual touch control display technology Pending CN103412680A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013101425945A CN103412680A (en) 2013-04-22 2013-04-22 Intelligent 3D projection virtual touch control display technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013101425945A CN103412680A (en) 2013-04-22 2013-04-22 Intelligent 3D projection virtual touch control display technology

Publications (1)

Publication Number Publication Date
CN103412680A true CN103412680A (en) 2013-11-27

Family

ID=49605696

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013101425945A Pending CN103412680A (en) 2013-04-22 2013-04-22 Intelligent 3D projection virtual touch control display technology

Country Status (1)

Country Link
CN (1) CN103412680A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412681A (en) * 2013-04-22 2013-11-27 深圳市富兴科技有限公司 Intelligent 3D projection virtual touch control display technology
CN110389650A (en) * 2018-04-23 2019-10-29 财团法人工业技术研究院 The control system and control method of virtual screen

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011137156A1 (en) * 2010-04-30 2011-11-03 Corning Incorporated Laser scanning projector device for interactive screen applications
CN102445762A (en) * 2012-01-06 2012-05-09 清华大学深圳研究生院 Naked eye 3D (three-dimensional) projection screen and naked eye 3D projection system
CN102508546A (en) * 2011-10-31 2012-06-20 冠捷显示科技(厦门)有限公司 Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method
CN202870437U (en) * 2012-10-30 2013-04-10 东莞市凯博美光电科技股份有限公司 Three-dimensional (3D) display screen for naked eye
CN103412681A (en) * 2013-04-22 2013-11-27 深圳市富兴科技有限公司 Intelligent 3D projection virtual touch control display technology

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011137156A1 (en) * 2010-04-30 2011-11-03 Corning Incorporated Laser scanning projector device for interactive screen applications
CN102508546A (en) * 2011-10-31 2012-06-20 冠捷显示科技(厦门)有限公司 Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method
CN102445762A (en) * 2012-01-06 2012-05-09 清华大学深圳研究生院 Naked eye 3D (three-dimensional) projection screen and naked eye 3D projection system
CN202870437U (en) * 2012-10-30 2013-04-10 东莞市凯博美光电科技股份有限公司 Three-dimensional (3D) display screen for naked eye
CN103412681A (en) * 2013-04-22 2013-11-27 深圳市富兴科技有限公司 Intelligent 3D projection virtual touch control display technology

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103412681A (en) * 2013-04-22 2013-11-27 深圳市富兴科技有限公司 Intelligent 3D projection virtual touch control display technology
CN110389650A (en) * 2018-04-23 2019-10-29 财团法人工业技术研究院 The control system and control method of virtual screen

Similar Documents

Publication Publication Date Title
JP6417702B2 (en) Image processing apparatus, image processing method, and image processing program
EP3095074B1 (en) 3d silhouette sensing system
US10045007B2 (en) Method and apparatus for presenting 3D scene
CN103914152B (en) Multi-point touch and the recognition methods and system that catch gesture motion in three dimensions
US9734392B2 (en) Image processing device and image processing method
US9367951B1 (en) Creating realistic three-dimensional effects
US8570372B2 (en) Three-dimensional imager and projection device
CN102508578B (en) Projection positioning device and method as well as interaction system and method
CN103299259A (en) Detection device, input device, projector, and electronic apparatus
TW201426413A (en) Three-dimensional interactive device and operation method thereof
WO2016168786A1 (en) Augmented interface authoring
CN104102394A (en) Optical multi-point touch control equipment and method
CN105373266A (en) Novel binocular vision based interaction method and electronic whiteboard system
CN102566827A (en) Method and system for detecting object in virtual touch screen system
US20200241721A1 (en) Interactive display apparatus and method
US10229538B2 (en) System and method of visual layering
US9426416B2 (en) System and method for utilizing a surface for remote collaboration
WO2016012044A1 (en) Method and system for augmenting television watching experience
KR101426378B1 (en) System and Method for Processing Presentation Event Using Depth Information
CN103412680A (en) Intelligent 3D projection virtual touch control display technology
CN101609363B (en) Input device and input method
US8760437B2 (en) Sensing system
CN103412681A (en) Intelligent 3D projection virtual touch control display technology
CN101620485B (en) Device and method for positioning light source
CN209248473U (en) A kind of interactive display unit

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
DD01 Delivery of document by public notice

Addressee: Shenzhen Fuxing Technology Co., Ltd.

Document name: Notification that Application Deemed to be Withdrawn

C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20131127