CN103019559B - Gesture controls projection display equipment and control method thereof - Google Patents

Gesture controls projection display equipment and control method thereof Download PDF

Info

Publication number
CN103019559B
CN103019559B CN201210491221.4A CN201210491221A CN103019559B CN 103019559 B CN103019559 B CN 103019559B CN 201210491221 A CN201210491221 A CN 201210491221A CN 103019559 B CN103019559 B CN 103019559B
Authority
CN
China
Prior art keywords
gesture
gestures
images
control
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210491221.4A
Other languages
Chinese (zh)
Other versions
CN103019559A (en
Inventor
郭大勃
崔荣荣
李磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Group Co Ltd
Original Assignee
Hisense Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Group Co Ltd filed Critical Hisense Group Co Ltd
Priority to CN201210491221.4A priority Critical patent/CN103019559B/en
Publication of CN103019559A publication Critical patent/CN103019559A/en
Application granted granted Critical
Publication of CN103019559B publication Critical patent/CN103019559B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

A kind of gesture controls projection display equipment and control method thereof, comprises projection arrangement, distance sensing device, image acquiring device and center system device.Projection device display image is to projecting plane.Distance sensing device sensing first distance and second distance.Image acquiring device obtains the images of gestures controlling gesture.Center system device is connected to projection arrangement, distance sensing device and image acquiring device, effective gesture space is determined according to the first distance, judge whether control gesture is positioned at effective gesture space according to second distance, process the images of gestures the display image controlling projection device that are positioned at the control gesture of effective gesture space.It is simple that this gesture controls projection arrangement structure, can utilize to control gesture and simply realize controlling the operation of the display image of projection, enhancing interactive experience, and be conducive to realizing the miniaturization, integrated and intelligent of gesture control projection display equipment.

Description

Gesture controls projection display equipment and control method thereof
Art
The present invention relates to projection display technique, and control projection display equipment and control method thereof in particular to a kind of gesture.
Background technology
Along with the raising of quality of life, the visual experience that people more and more like large screen display to bring, and optical projection system is because can be favored display image projection to giant-screen or metope carries out showing gradually.At present, traditional optical projection system not only comprises projector and screen, but also comprises the smart machine such as computer being connected to projector, notebook and mobile phone etc.In addition, traditional optical projection system also needs such as mouse, and the basic operation that the operational control unit such as keyboard or laser pen realizes showing image controls.Therefore, required for the structure of traditional optical projection system, equipment is numerous, and syndeton is complicated, carries and uses equal inconvenience, also effectively cannot realize the interactive controlling of the display image projected.
Therefore, be necessary to provide a kind of projection arrangement that can realize interactive controlling, to meet people for projection arrangement miniaturization, integrated and intelligentized demand.
Summary of the invention
For solving the problems of the technologies described above, the invention provides a kind of gesture and control projection display equipment, structure is simple, control gesture can be utilized simply to realize controlling the operation of projected image, strengthen interactive experience, and be conducive to realizing the miniaturization, integrated and intelligent that gesture controls projection display equipment.
The present invention also provides a kind of gesture to control the control method of projection display equipment, simply realize controlling the operation of projected image to utilize control gesture, strengthen interactive experience, and be conducive to realizing the miniaturization, integrated and intelligent that gesture controls projection display equipment.
It is adopt following technical scheme to realize that the present invention solves its technical matters.
The present invention proposes a kind of gesture and controls projection display equipment, and it comprises projection arrangement, distance sensing device, image acquiring device and center system device.Projection device display image is to projecting plane.Distance sensing device sensing first distance and second distance, the first distance is the vertical range of projection arrangement from projecting plane, and second distance controls the vertical range of gesture from projecting plane.Image acquiring device obtains the images of gestures controlling gesture.Center system device is connected to projection arrangement, distance sensing device and image acquiring device, the first distance according to distance sensing device sensing determines effective gesture space, judge whether control gesture is positioned at effective gesture space according to the second distance of distance sensing device sensing, the images of gestures being positioned at the control gesture of effective gesture space that process image acquiring device obtains, determine the steering order of corresponding images of gestures, and control projection arrangement according to steering order display display image.
The present invention also proposes the control method that a kind of gesture controls projection display equipment, and this control method utilizes projection device to show image to projecting plane; Utilize distance sensing device to sense the first distance and second distance, the first distance is the vertical range of projection arrangement from projecting plane, and second distance controls the vertical range of gesture from projecting plane; Image acquiring device is utilized to obtain the images of gestures controlling gesture; Recycling is connected to the center system device of projection arrangement, distance sensing device and image acquiring device, the first distance according to distance sensing device sensing determines effective gesture space, judge whether control gesture is positioned at effective gesture space according to the second distance of distance sensing device sensing, the images of gestures being positioned at the control gesture of effective gesture space that process image acquiring device obtains, determine the steering order of corresponding images of gestures, and control projection arrangement according to steering order display display image.
The invention has the beneficial effects as follows, it is that the first distance of utilizing distance sensing device sense by center system device and second distance judge whether control gesture is positioned at effective gesture space that gesture of the present invention controls projection display equipment and control method thereof, the images of gestures being positioned at effective gesture space that process image acquiring device obtains, and utilize center system device to determine the steering order of corresponding images of gestures, and control projection arrangement according to steering order display display image.Therefore, gesture of the present invention controls projection display equipment without the need to connecting numerous and diverse external unit such as computing machine, mouse, keyboard etc., not only structure is simple, be conducive to realizing gesture and control the miniaturization of projection arrangement, intellectuality and integrated, and realize controlling the operation of projected image by the utilization control gesture that the control method of gesture control projection display equipment can also be simple and convenient, strengthen interactive experience.
Accompanying drawing explanation
Fig. 1 is the structural representation of the gesture control projection display equipment of one embodiment of the invention.
Fig. 2 is the schematic diagram of the Projection Display of the gesture control projection display equipment of one embodiment of the invention.
Fig. 3 A to Fig. 3 F is that the gesture of one embodiment of the invention controls the control gesture of projection display equipment and the corresponding relation schematic diagram of gesture operation type.
Embodiment
For further setting forth the present invention for the technological means reaching predetermined goal of the invention and take and effect, below in conjunction with accompanying drawing and preferred embodiment, the embodiment of projection display equipment and control method thereof, structure, feature and effect thereof are controlled to gesture of the present invention, is described in detail as follows.
Fig. 1 is the structural representation of the gesture control projection display equipment of one embodiment of the invention.Fig. 2 is the schematic diagram of the Projection Display of the gesture control projection display equipment of one embodiment of the invention.See also Fig. 1 and Fig. 2, in the present embodiment, gesture controls projection display equipment 100 and comprises projection arrangement 110, distance sensing device 120, image acquiring device 130 and center system device 140.Projection arrangement 110, distance sensing device 120, image acquiring device 130 and center system device 140 are all integrated to be arranged in housing 101.
Hold above-mentioned, projection arrangement 100 can be such as any device or system module that can realize Projection Display, and it will be for showing image 102 Projection Display to projecting plane 150.Projecting plane 150 can be such as the plane such as wall or desktop.
Distance sensing device 120 is connected with center system device 140, independently can obtain the range information of institute's object sensing and send center system device 140 to.The Drive and Control Circuit that distance sensing device 120 such as comprises range sensor and is connected with range sensor.In the present embodiment, as shown in Figure 2, distance sensing device 120 can be used for sensing first apart from D1, and the first distance D1 is the vertical range of projection arrangement 120 from projecting plane 150.The the first distance D1 sensed is sent to center system device 140 by distance sensing device 120.In addition, when user's application controls gesture 105 controls display image 102, distance sensing device 120 also can be used for sensing second distance D2, and second distance D2 controls the vertical range of gesture 105 from projecting plane 150.Distance sensing device 120 can send the second distance D2 of sensed control gesture 105 to center system device 140.
Image acquiring device 130 is connected with center system device 140, image acquiring device 130 is such as the first-class image capture device of shooting, for obtaining the display image 102 that projection arrangement 110 projects and the images of gestures controlling gesture 105, and the images of gestures of the display image 102 projected by obtained projection arrangement 110 and control gesture 105 is sent to center system device 140.
Center system device 140 is connected to projection arrangement 110, distance sensing device 120 and image acquiring device 130.In the present embodiment, center system device 140 such as comprises image processing module 142, gesture control module 144 and operating system module 146.
Particularly, image processing module 142 is connected to distance sensing device 120, image acquiring device 130, gesture control module 144 and operating system module 146.Image processing module 142 receives the first distance D1 sensed from distance sensing device 120, to determine effective gesture space 103 according to the first distance D1.In the present embodiment, effective gesture space 103 is near projecting plane 150, and effectively gesture space 103 is less than the first distance D1 from the vertical space distance d on projecting plane 150.In addition, when user's application controls gesture 105 controls display image 102, image processing module 142 also receives the second distance D2 sensed from distance sensing device 120, to judge according to second distance D2 whether control gesture 105 is positioned at effective gesture space 103.When second distance D2 is less than the vertical space distance d of effective gesture space 103, controlling gesture 105 is be positioned at effective gesture space 103.It is worth mentioning that, the vertical space distance d of effective gesture space 103 such as can regulate, to guarantee that having enough vertical space distance d to make to control gesture 105 effectively controls.In the present embodiment, the initial value of the vertical space distance d of effective gesture space 103 is set to 2 centimetres, and can regulate according to the second distance D2 controlling gesture 105, can be positioned within effective gesture space 103 to make controlling gesture 105, carry out effective gesture control.In addition, when second distance D2 is greater than the vertical space distance d of effective gesture space 103, controlling gesture 105 is be positioned at outside effective gesture space 103.In other words, when second distance D2 is greater than the vertical space distance d of effective gesture space 103, control gesture 105 and namely leave effective gesture space 103, it is invalid for also namely controlling gesture 105, exits gesture control operation.Image processing module 142 is based on the judgement whether control gesture 105 being positioned to effective gesture space 103, the images of gestures being positioned at the control gesture 105 of effective gesture space 103 that process image acquiring device 130 obtains, to determine the corresponding gesture operation type controlling the images of gestures of gesture 105, and send the corresponding gesture operation type that this controls the images of gestures of gesture 105 to gesture control module 144.In addition, the information (such as coordinate information, coordinate translational speed information etc.) of image processing module 142 also for process being obtained is sent to operating system module 146, with realize showing image 102 amplification, reduce, mobile model-following control gesture 105 is synchronous.In addition, image processing module 142 also prestores the characteristic model controlling gesture, for carrying out the state recognition of the initial gesture controlling gesture 105.
Hold above-mentioned, gesture control module 144 is connected between image processing module 142 and operating system module 146, for receiving the gesture operation type from image processing module 142, and the steering order of transmission this gesture operation type corresponding is to operating system module 146.
Operating system module 146 is connected to image processing module 142, gesture control module 144 and projection arrangement 110, for receiving from the information (such as coordinate information, coordinate translational speed information etc.) of image processing module 142 and the steering order from gesture control module 144, and according to this information and this steering order control projection arrangement 110, Projection Display is carried out to display image 102.Operating system module 146 can be such as Android operation system module, Windows operating system module or (SuSE) Linux OS module etc., but is not limited to this.Operating system module 146 be arranged so that gesture control projection display equipment 100 without the need to connecting numerous and diverse external unit such as computing machine etc., in addition operating system module 146 coordinates distance sensing device 120, image acquiring device 130, image processing module 142 and gesture control module 144, the gesture that can realize showing image 102 controls, strengthen interactive experience, also avoid connecting numerous and diverse external unit such as mouse, keyboard, laser pen etc. simultaneously.In order to better realize miniaturization, integrated and intelligent, operating system module 146 can carry out module integration with projection arrangement 110.Operating system module 146 also can be provided with connectivity port, and extraneous data message is transferred to operating system module 146 by connectivity port, and will carry out Projection Display on projecting plane 150 by projection arrangement 110.In addition, operating system module 146 can also comprise Wifi module, and operating system module 146 is networked by Wifi module, to realize online playing video video, and by projection arrangement 110 directly by image frame Projection Display on projecting plane 150.
Please continue to refer to Fig. 1 and Fig. 2, below control method gesture being controlled to projection display equipment 100 is described in detail.
The projection arrangement 110 that gesture controls projection display equipment 100 will show image 102 Projection Display to projecting plane 150, and application controls gesture 105 controls display image 102.
The distance sensing device 120 that gesture controls projection display equipment 100 can sense the first distance D1 and second distance D2, and the first sensed distance D1 and second distance D2 is sent to the image processing module 142 of center system device 140.Wherein, the first distance D1 is the vertical range of projection arrangement 110 from projecting plane 150, and second distance D2 controls the vertical range of gesture 105 from projecting plane 150.
Now, the image acquiring device 130 that gesture controls projection display equipment 100 can obtain the images of gestures controlling gesture 105, and the images of gestures of obtained control gesture 105 is sent to the image processing module 142 of center system device 140.First image processing module 142 determines effective gesture space 103 according to the first distance D1.Effective gesture space 103 is near projecting plane 150, and effectively gesture space 103 is less than the first distance D1 from the vertical space distance d on projecting plane 150.In the present embodiment, the vertical space distance d from projecting plane 150 of effective gesture space 103 is such as 2 centimetres.Then, according to second distance D2, image processing module 142 judges whether control gesture 105 is positioned at effective gesture space 103.When image processing module 142 judges that second distance D2 is greater than the vertical space distance d of effective gesture space 103, namely controlling gesture 105 is positioned at outside effective gesture space 103, image processing module 142 can determine that controlling gesture 105 is invalid gesture Control Cooling, in other words can not set out corresponding control command, the display image 102 that projection arrangement 110 projects can not change.When image processing module 142 judges that second distance D2 is less than the vertical space distance d of effective gesture space 103, namely controlling gesture 105 is be positioned at effective gesture space 103, image processing module 142 can process the images of gestures of the control gesture 105 being positioned at effective gesture space 103, to determine corresponding gesture operation type.It is worth mentioning that, the vertical space distance d of effective gesture space 103 such as can regulate, to guarantee that having enough vertical space distance d to make to control gesture 105 effectively controls.In the present embodiment, the initial value of the vertical space distance d of effective gesture space 103 is set to 2 centimetres, and can regulate according to the second distance D2 controlling gesture 105, can be positioned within effective gesture space 103 to make controlling gesture 105, carry out effective gesture control.
Concrete, Fig. 3 A to Fig. 3 F is that the gesture of one embodiment of the invention controls the control gesture 105 of projection display equipment 100 and the corresponding relation schematic diagram of gesture operation type.As shown in Figure 3A, controlling gesture 105a is singlehanded gesture, the gesture operation type of its correspondence is amplifieroperation, the initial images of gestures 105a ' of the control gesture 105a received when image processing module 142 closes up for the five fingers are bending, in the motion process that control gesture 105a launches naturally, display image 102 will be amplified continuously.As shown in Figure 3 B, controlling gesture 105b is singlehanded gesture, corresponding gesture operation type is reduction operation, the initial images of gestures 105b ' of the control gesture 105b obtained when image processing module 142 is approximated to vertical expansion for thumb and all the other four fingers, bend in the process of closing up at the five fingers controlling gesture 105b, being continued to reduce of display image 102.As shown in Figure 3 C, controlling gesture 105c is singlehanded gesture, corresponding gesture operation type is single-click operation, the initial images of gestures 105c ' of the control gesture 105c received when image processing module 142 becomes nature to launch, be placed on the picture mark position place wanting to click and stop after such as 2 seconds scheduled operating time controlling gesture 105, can single-click operation be completed.As shown in Figure 3 D, controlling gesture 105d is singlehanded gesture, corresponding gesture operation type is drag operation, the initial images of gestures 105d ' of the control gesture 105d received when image processing module 142 becomes nature to launch, at control gesture 105d along in the process of any direction movement, can realize the dragging to display image 102, and the movement of display image 102 is followed hand and is carried out synchronizing moving.Except singlehanded gesture can realize amplifieroperation and reduction operation, bimanual input also can control the mitigation and amplification showing image 102.As shown in FIGURE 3 E, control gesture 105e is bimanual input, corresponding gesture operation type is amplifieroperation, the initial images of gestures 105e of the control gesture 105e received when image processing module 142 comprises the first initial images of gestures 106 and the second initial images of gestures 107, and the first initial images of gestures 106 and the second initial images of gestures 107 are for naturally launching, controlling two hands of gesture 105e in opposite direction gradually away from moving process, being amplified continuously of display image 102.As illustrated in Figure 3 F, control gesture 105f is bimanual input, corresponding gesture operation type is reduction operation, the initial images of gestures 105f received when image processing module 142 comprises the first initial images of gestures 106 and the second initial images of gestures 107, and the first initial images of gestures 106 and the second initial images of gestures 107 are for naturally launching, controlling two hands of gesture 105f along relative direction gradually in moving process, being reduced continuously of display image 102.
Concrete example is illustrated that image processing module 142 is to the identification of the images of gestures of control gesture 105 and process below.When image processing module 142 judges that second distance D2 is less than the vertical space distance d of effective gesture space 103, namely controlling gesture 105 is when being positioned at effective gesture space 103, image acquiring device 130 will obtain the piece image of the display image 102 comprising and be projected in projecting plane 150 and the images of gestures controlling gesture 105, and is sent to image processing module 142.The piece image received and original display image 102 compare by image processing module 142, thus obtain differential image model (images of gestures), and the characteristic model of the control gesture this differential image model and image processing module 142 prestored mates, extract the gesture feature model of coupling, namely carry out the state recognition of the initial gesture controlling gesture 105.Simultaneously, image processing module 142 is to control the circumscribed rectangular centre of the images of gestures of gesture 105 for controlling the geometric center of gesture 105, to show the lower left corner of image 102 for reference coordinate, obtain the relative coordinate controlling gesture 105, and the relative coordinate of the geometric center controlling gesture 105 is mapped in operating system module 146.Afterwards, the image of acquisition can be sent to image processing module 142 by image acquiring device 120 continuously, image processing module 142 can draw the vector controlling the position coordinates of the geometric center of gesture 105 in the position coordinates of the geometric center controlling gesture 105 in front piece image to rear piece image, by that analogy, image processing module 142 just can process the motion track of the vector of the position coordinates obtaining the geometric center controlling gesture 105, namely controls the vectorial variation track of the circumscribed rectangular centre coordinate of the images of gestures of gesture 105.In other words, to control the motion track of gesture 105 are circumscribed rectangular centre coordinates of the initial images of gestures controlling gesture 105 is benchmark, and represents with the motion track of the circumscribed rectangular centre coordinate of the images of gestures controlling gesture 105.Image processing module 142 sends the motion track of vector of the position coordinates controlling the geometric center of gesture 105 to operating system module 146, with utilize operating system module 146 realize display image 102 amplification, reduce, mobile model-following control gesture 105 is synchronously amplified, reduce, mobile.
In addition, if through the state recognition of initial gesture, image processing module 142 determines that controlling gesture 105 is singlehanded gesture, image processing module 142 also constantly can calculate the circumscribed rectangular area of the images of gestures controlling gesture 105, to control the circumscribed rectangular area of the initial images of gestures of gesture 105 for benchmark, and judge corresponding gesture operation type according to the Changing Pattern of the circumscribed rectangular area size of the images of gestures of control gesture 105 and the motion track of control gesture 105.Such as, if the circumscribed rectangular area controlling the images of gestures of gesture 105 within scheduled operating time (such as 2 seconds) reduces gradually, and the motion track length controlling gesture 105 is less than the half on the long limit of circumscribed rectangle of the initial images of gestures controlling gesture 105, then corresponding gesture operation type is reduction operation; If the circumscribed rectangular area controlling the images of gestures of gesture 105 within scheduled operating time (such as 2 seconds) increases gradually, and the motion track length controlling gesture 105 is less than the half on the long limit of circumscribed rectangle of the initial images of gestures controlling gesture 105, then corresponding gesture operation type is amplifieroperation; If the circumscribed rectangular area controlling the images of gestures of gesture 105 within scheduled operating time (such as 2 seconds) is substantially constant, control the circumscribed rectangular centre changes in coordinates of the images of gestures of gesture 105, then corresponding gesture operation type is drag operation; If the circumscribed rectangular area and the circumscribed rectangular centre coordinate that exceed the images of gestures of control scheduled operating time (such as 2 seconds) gesture 105 are all substantially constant, then corresponding gesture operation type carries out single-click operation at the circumscribed rectangular centre coordinate place controlling gesture 105.If image processing module 142 is determined to control gesture 105 for bimanual input through the state recognition of initial gesture, namely image processing module 142 identifies the quantity of hand in the state of the initial gesture controlling gesture 105 is 2, the initial images of gestures controlling gesture 105 comprises the first initial images of gestures and the second initial images of gestures, the images of gestures controlling gesture 105 comprises first gesture image and the second images of gestures, so, image processing module 142 needs the circumscribed rectangular centre coordinate motion track of first gesture image and the circumscribed rectangular centre coordinate motion track of the second images of gestures according to controlling gesture 105 to judge corresponding gesture operation type.Such as, when the circumscribed rectangular centre coordinate of first gesture image and the circumscribed rectangular centre changes in coordinates of the second images of gestures that control gesture 105 within scheduled operating time (such as 2 seconds) and in reverse direction away from time mobile, the gesture operation type of correspondence is amplifieroperation; When the circumscribed rectangular centre coordinate of first gesture image and the circumscribed rectangular centre changes in coordinates of the second images of gestures that control gesture 105 within scheduled operating time (such as 2 seconds) and in relative direction when mobile, the gesture operation type of correspondence is reduction operation.Therefore, image processing module 142 combines the state of the initial images of gestures controlling gesture 105, controls the circumscribed rectangular centre coordinate motion track of the circumscribed rectangular area change of the images of gestures of gesture 105 and the images of gestures of control gesture 105, corresponding gesture operation type can be determined, and the gesture operation type of correspondence is sent to gesture control module.In addition, the circumscribed rectangular centre coordinate of images of gestures and the translational speed of circumscribed rectangular centre coordinate that control gesture 105 are also sent to operating system module 146 by image processing module 142, to utilize the synchronous amplification of operating system module 146 realization display image 102, reduce or move.
Hold above-mentioned, the gesture control module 142 of gesture control projection display equipment 100 receives the gesture operation type from image processing module 142, and the steering order of transmission this gesture operation type corresponding is to operating system module 146.The operating system module 146 that gesture controls projection display equipment 100 receives from the information (such as coordinate information, coordinate translational speed information etc.) of image processing module 142 and the steering order from gesture control module 142, and controls projection arrangement 110 Projection Display display image 102 according to this information and this steering order.
In sum, it is that the first distance D1 of utilizing distance sensing device 120 sense by center system device 140 and second distance D2 judge whether control gesture 105 is positioned at effective gesture space 103 that gesture of the present invention controls projection display equipment 100 and control method thereof, the images of gestures being positioned at effective gesture space 103 that process image acquiring device 120 obtains, and utilize center system device 140 to determine the steering order of corresponding images of gestures, and control projection arrangement 110 according to steering order Projection Display display image 102.Therefore, gesture of the present invention controls projection display equipment 100 without the need to connecting numerous and diverse external unit such as computing machine, mouse, keyboard etc., not only structure is simple, be conducive to realizing gesture and control the miniaturization of projection arrangement, intellectuality and integrated, and realize controlling the operation of projected image by the utilization control gesture that the control method of gesture control projection display equipment can also be simple and convenient, strengthen interactive experience.
Above gesture control projection display equipment provided by the present invention and control method thereof are described in detail, apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping; Meanwhile, for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.

Claims (14)

1. gesture controls a projection display equipment, and it is characterized in that, it comprises:
Projection arrangement, projection-display image is to projecting plane;
Distance sensing device, sensing first distance and second distance, this first distance is the vertical range of this projection arrangement from this projecting plane, and this second distance controls the vertical range of gesture from this projecting plane;
Image acquiring device, obtains the images of gestures of this control gesture; And
Center system device, be connected to this projection arrangement, this distance sensing device and this image acquiring device, effective gesture space is determined according to this first distance that this distance sensing device senses, judge whether this control gesture is positioned at this effective gesture space according to this second distance that this distance sensing device senses, process this images of gestures being positioned at this control gesture of this effective gesture space that this image acquiring device obtains, determine should the steering order of images of gestures, and control this projection arrangement according to this display image of this steering order Projection Display.
2. gesture according to claim 1 controls projection display equipment, it is characterized in that, this effective gesture space is near this projecting plane, and this effective gesture space is less than this first distance from the vertical space distance on this projecting plane, when this second distance is less than this vertical space distance of this effective gesture space, this control gesture is positioned at this effective gesture space, and when this second distance is greater than this vertical space distance of this effective gesture space, this control gesture is positioned at outside this effective gesture space.
3. gesture according to claim 1 controls projection display equipment, and it is characterized in that, this center system device comprises image processing module, gesture control module and operating system module; This image processing module connects this distance sensing device, this image acquiring device, this gesture control module and this operating system module, this effective gesture space is determined according to this first distance that this distance sensing device senses, judge whether this control gesture is positioned at this effective gesture space according to this second distance that this distance sensing device senses, and process this images of gestures being positioned at this control gesture of this effective gesture space of this image acquiring device acquisition, to determine that corresponding gesture operation type is sent to this gesture control module; This gesture control module is connected to this image processing module and this operating system module, receives this gesture operation type from this image processing module, and the steering order of transmission this gesture operation type corresponding is to this operating system module; This operating system module is connected to this gesture control module and this projection arrangement, receives this steering order from this gesture control module, and controls this projection device according to this steering order and show this display image.
4. gesture according to claim 3 controls projection display equipment, it is characterized in that, this control gesture is singlehanded gesture, and this images of gestures of this this control gesture of image processing module process is this gesture operation type determining controlling gesture according to the circumscribed rectangular area of this images of gestures and circumscribed rectangular centre coordinate motion track.
5. gesture according to claim 4 controls projection display equipment, it is characterized in that, within scheduled operating time, this circumscribed rectangular area of this images of gestures becomes large and this circumscribed rectangular centre coordinate motion track length of this images of gestures is less than the half on the long limit of circumscribed rectangle of the initial images of gestures of this control gesture gradually, is amplifieroperation to this gesture operation type that should control gesture; Within this scheduled operating time, this circumscribed rectangular area of this images of gestures diminishes and this circumscribed rectangular centre coordinate motion track length of this images of gestures is less than the half on this long limit of circumscribed rectangle of this initial images of gestures of this control gesture gradually, is reduction operation to this gesture operation type that should control gesture; Exceed this circumscribed rectangular area of this of this images of gestures scheduled operating time and this circumscribed rectangular centre coordinate all constant time, be single-click operation to this gesture operation type that should control gesture; And within this scheduled operating time during constant and this circumscribed rectangular centre changes in coordinates of this circumscribed rectangular area of this images of gestures, be drag operation to this gesture operation type that should control gesture.
6. gesture according to claim 3 controls projection display equipment, it is characterized in that, this control gesture is bimanual input, this images of gestures of this control gesture comprises first gesture image and the second images of gestures, and this this images of gestures of image processing module process is to determine this corresponding gesture operation type according to the circumscribed rectangular centre coordinate motion track of this first gesture image and this second images of gestures.
7. gesture according to claim 6 controls projection display equipment, it is characterized in that, this circumscribed rectangular centre coordinate of this first gesture image and this circumscribed rectangular centre changes in coordinates of this second images of gestures within scheduled operating time and in reverse direction away from time mobile are amplifieroperations to this gesture operation type that should control gesture; And within this scheduled operating time this circumscribed rectangular centre coordinate of this first gesture image and this circumscribed rectangular centre changes in coordinates of this second images of gestures and in relative direction when mobile, be reduction operation to this gesture operation type that should control gesture.
8. gesture according to claim 3 controls projection display equipment, it is characterized in that, this operating system module is provided with connectivity port and Wifi module, extraneous data message is transferred to this operating system module by this connectivity port, this operating system module is networked by this Wifi module simultaneously, and carries out Projection Display by this projection arrangement.
9. gesture controls a control method for projection display equipment, and it is characterized in that, it comprises:
Utilize projection arrangement will show image projection display to projecting plane;
Utilize distance sensing device to sense the first distance and second distance, this first distance is the vertical range of this projection arrangement from this projecting plane, and this second distance controls the vertical range of gesture from this projecting plane;
Image acquiring device is utilized to obtain the images of gestures of this control gesture; And
Utilize the center system device being connected to this projection arrangement, this distance sensing device and this image acquiring device, effective gesture space is determined according to this first distance that this distance sensing device senses, judge whether this control gesture is positioned at this effective gesture space according to this second distance that this distance sensing device senses, process this images of gestures being positioned at this control gesture of this effective gesture space that this image acquiring device obtains, determine should the steering order of images of gestures, and control this projection arrangement according to this display image of this steering order Projection Display.
10. control method according to claim 9, it is characterized in that, this effective gesture space is near this projecting plane, and this effective gesture space is less than this first distance from the vertical space distance on this projecting plane, when this second distance is less than this vertical space distance of this effective gesture space, this control gesture is positioned at this effective gesture space, and when this second distance is greater than this vertical space distance of this effective gesture space, this control gesture is positioned at outside this effective gesture space.
11. control methods according to claim 9, it is characterized in that, this center system device comprises image processing module, gesture control module and operating system module, this image processing module connects this distance sensing device, this image acquiring device, this gesture control module and this operating system module, this gesture control module connects this image processing module and this operating system module, and this operating system module connects this gesture control module and this projection arrangement, utilize this images of gestures being positioned at this control gesture of this effective gesture space that this image acquiring device of center system device process obtains, determine should the steering order of images of gestures, and control this projection arrangement and comprise according to this display image of this steering order Projection Display:
Utilize this images of gestures being positioned at this control gesture of this effective gesture space that this this image acquiring device of image processing module process obtains, to determine the gesture operation type that should control gesture and to be sent to this gesture control module;
This gesture operation type utilizing this gesture control module to receive from this image processing module also sends the steering order of this gesture operation type corresponding to this operating system module; And
Utilize this operating system module to receive this steering order from this gesture control module and control this projection device according to this steering order and show this display image.
12. control methods according to claim 11, it is characterized in that, utilize this images of gestures being positioned at this control gesture of this effective gesture space that this this image acquiring device of image processing module process obtains, to determine that this gesture operation type to controlling gesture comprises:
This image processing module is utilized to carry out the identification of the initial images of gestures of this control gesture; And
With the circumscribed rectangular area of this initial images of gestures and circumscribed rectangular centre coordinate for benchmark, this gesture operation type utilizing this image processing module to obtain the circumscribed rectangular area Changing Pattern of this images of gestures of this control gesture and circumscribed rectangular centre coordinate motion track to determine gesture should be controlled.
13. control methods according to claim 12, it is characterized in that, this control gesture of this image processing module identification is singlehanded gesture, when within scheduled operating time, this circumscribed rectangular area of this images of gestures becomes large and this circumscribed rectangular centre coordinate motion track length of this images of gestures is less than the half on the long limit of circumscribed rectangle of this initial images of gestures of this control gesture gradually, to should this gesture operation type of images of gestures be amplifieroperation; When within this scheduled operating time, this circumscribed rectangular area of this images of gestures diminishes and this circumscribed rectangular centre coordinate motion track length of this images of gestures is less than the half on this long limit of circumscribed rectangle of this initial images of gestures of this control gesture gradually, to should this gesture operation type of images of gestures be reduction operation; When this circumscribed rectangular area and this circumscribed rectangular centre coordinate of exceeding this of this images of gestures all constant scheduled operating time, to should this gesture operation type of images of gestures be single-click operation; And within this scheduled operating time during constant and this circumscribed rectangular centre changes in coordinates of this circumscribed rectangular area of this images of gestures, to should this gesture operation type of images of gestures be drag operation.
14. control methods according to claim 12, it is characterized in that, this control gesture of this image processing module identification is bimanual input, this images of gestures of this control gesture comprises first gesture image and the second images of gestures, when this circumscribed rectangular centre coordinate of this first gesture image and this circumscribed rectangular centre changes in coordinates of this second images of gestures and in reverse direction away from time mobile within scheduled operating time, to should this gesture operation type of images of gestures be amplifieroperation, and when this circumscribed rectangular centre coordinate of this first gesture image and this circumscribed rectangular centre changes in coordinates of this second images of gestures and in relative direction when mobile within this scheduled operating time, to should this gesture operation type of images of gestures be reduction operation.
CN201210491221.4A 2012-11-27 2012-11-27 Gesture controls projection display equipment and control method thereof Active CN103019559B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210491221.4A CN103019559B (en) 2012-11-27 2012-11-27 Gesture controls projection display equipment and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210491221.4A CN103019559B (en) 2012-11-27 2012-11-27 Gesture controls projection display equipment and control method thereof

Publications (2)

Publication Number Publication Date
CN103019559A CN103019559A (en) 2013-04-03
CN103019559B true CN103019559B (en) 2016-03-23

Family

ID=47968216

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210491221.4A Active CN103019559B (en) 2012-11-27 2012-11-27 Gesture controls projection display equipment and control method thereof

Country Status (1)

Country Link
CN (1) CN103019559B (en)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103257713B (en) * 2013-05-31 2016-05-04 华南理工大学 A kind of gesture control method
CN104375817B (en) * 2013-08-16 2017-12-29 联想(北京)有限公司 Operate the method and device of projection objects
CN103558919A (en) * 2013-11-15 2014-02-05 深圳市中兴移动通信有限公司 Method and device for sharing visual contents
CN104883596B (en) * 2014-02-28 2018-02-27 联想(北京)有限公司 One kind instruction generation method, device and electronic equipment
CN105450962B (en) * 2014-08-22 2019-04-23 联想(北京)有限公司 A kind of electronic equipment and information processing method
US20160189340A1 (en) * 2014-12-29 2016-06-30 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Adjusting content on an interactive display to user physical height and reach
CN105824399A (en) * 2015-01-06 2016-08-03 中兴通讯股份有限公司 Control method, system and apparatus for projection equipment
CN106033256A (en) * 2015-03-17 2016-10-19 深圳市加珠宝有限公司 Man-machine interaction device
CN105373329A (en) * 2015-06-30 2016-03-02 北京鸿合智能系统股份有限公司 Interactive method and system for display and booth
CN105094675B (en) * 2015-07-28 2019-04-02 中国联合网络通信集团有限公司 A kind of man-machine interaction method and touch screen wearable device
CN105607407B (en) * 2015-12-31 2018-05-11 苏州佳世达光电有限公司 A kind of control method of projection arrangement and projection arrangement
CN105786393A (en) * 2016-03-31 2016-07-20 联想(北京)有限公司 Information processing method and electronic equipment
CN107024959B (en) * 2017-04-12 2018-12-25 浙江思珀整合传播有限公司 A kind of Multimedia System
CN107357356A (en) * 2017-07-04 2017-11-17 北京有初科技有限公司 Miniature projection computer and the method using gesture control Miniature projection computer page turning
CN107290856A (en) * 2017-07-07 2017-10-24 合肥龙图腾信息技术有限公司 A kind of method, system and intelligent glasses for controlling to image based on eye motion
CN107765848A (en) * 2017-09-04 2018-03-06 中山大学 A kind of control method and device of projected image
CN108595001A (en) * 2018-04-20 2018-09-28 丝路视觉科技股份有限公司 Method for controlling projection, projection operation bench and host
CN108920043A (en) * 2018-06-12 2018-11-30 珠海格力电器股份有限公司 A kind of control method and electronic equipment of household appliance
CN109032360A (en) * 2018-08-30 2018-12-18 广东小天才科技有限公司 A kind of method for controlling projection and intelligent desk lamp of intelligent desk lamp
CN109828660B (en) * 2018-12-29 2022-05-17 深圳云天励飞技术有限公司 Method and device for controlling application operation based on augmented reality
CN113052561A (en) * 2021-04-01 2021-06-29 苏州惟信易量智能科技有限公司 Flow control system and method based on wearable device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101943947A (en) * 2010-09-27 2011-01-12 鸿富锦精密工业(深圳)有限公司 Interactive display system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8593402B2 (en) * 2010-04-30 2013-11-26 Verizon Patent And Licensing Inc. Spatial-input-based cursor projection systems and methods

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101943947A (en) * 2010-09-27 2011-01-12 鸿富锦精密工业(深圳)有限公司 Interactive display system

Also Published As

Publication number Publication date
CN103019559A (en) 2013-04-03

Similar Documents

Publication Publication Date Title
CN103019559B (en) Gesture controls projection display equipment and control method thereof
US10852841B2 (en) Method of performing function of device and device for performing the method
US10929851B2 (en) Portable apparatus and method for changing screen of the same
US11360728B2 (en) Head mounted display apparatus and method for displaying a content
US10976831B2 (en) Interactive system and device with gesture recognition function
US20140300542A1 (en) Portable device and method for providing non-contact interface
CN111586286A (en) Electronic device and method for changing image magnification by using multiple cameras
CN105610471B (en) Wireless data input and output method and apparatus
KR20150046304A (en) Method and apparatus for controlling terminal device by using non-contact gesture
CN103929603A (en) Image Projection Device, Image Projection System, And Control Method
WO2021004412A1 (en) Handheld input device, and method and apparatus for controlling display position of indication icon thereof
CN107003821A (en) Promote to watch ability for the improvement of glass displays
US20150128031A1 (en) Contents display method and electronic device implementing the same
TW201638728A (en) Computing device and method for processing movement-related data
US10936184B2 (en) Display apparatus and controlling method thereof
US20130257750A1 (en) Establishing an input region for sensor input
US20160291692A1 (en) Information processing system, information processing method, and program
CN103207678A (en) Electronic equipment and unblocking method thereof
US11886643B2 (en) Information processing apparatus and information processing method
WO2018076720A1 (en) One-hand operation method and control system
KR20150081749A (en) Screen updating method, machine-readable storage medium and electronic device
TW202309547A (en) Electronic device for tracking objects
CN104699228A (en) Mouse realization method and system for intelligent TV screen terminal
US11481036B2 (en) Method, system for determining electronic device, computer system and readable storage medium
CN104777900A (en) Gesture trend-based graphical interface response method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant