CN105334951B - A kind of 3-D view control method, device and electronic equipment - Google Patents
A kind of 3-D view control method, device and electronic equipment Download PDFInfo
- Publication number
- CN105334951B CN105334951B CN201410301004.3A CN201410301004A CN105334951B CN 105334951 B CN105334951 B CN 105334951B CN 201410301004 A CN201410301004 A CN 201410301004A CN 105334951 B CN105334951 B CN 105334951B
- Authority
- CN
- China
- Prior art keywords
- image
- user gesture
- user
- view
- gesture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000875 corresponding Effects 0.000 claims abstract description 140
- 230000003287 optical Effects 0.000 claims description 12
- 230000001276 controlling effect Effects 0.000 claims description 11
- 230000001815 facial Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 21
- 238000005516 engineering process Methods 0.000 description 7
- 238000000034 method Methods 0.000 description 6
- 238000010276 construction Methods 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000005755 formation reaction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006011 modification reaction Methods 0.000 description 1
- 230000000750 progressive Effects 0.000 description 1
Abstract
A kind of 3-D view control method of offer of the embodiment of the present invention, device and electronic equipment, wherein method include：Play tripleplane's image；User gesture image is acquired by described first image harvester；Identify the corresponding control instruction of the user gesture image；Tripleplane's image, which is controlled, according to the control instruction carries out corresponding operating.An embodiment of the present invention provides a kind of mechanism that achievable user interacts with 3-D view, realize the control of the 3-D view to being shown.
Description
Technical field
The present invention relates to technical field of image processing, more specifically to a kind of 3-D view control method, device and
Electronic equipment.
Background technology
Three-dimensional image projection (such as line holographic projections) is also referred to as virtual image technology, be using interference and diffraction principle record and again
A kind of technology of the true 3-D view of existing object.
Three-dimensional image projection is based primarily upon tripleplane's equipment and realizes, at present structure there are mainly two types of tripleplane's equipment,
A kind of structure includes：Electronic equipment (such as tablet computer, mobile phone, notebook etc. are mainly used for playing tripleplane's image), light source
(can be the camera of electronic equipment) and mirror plane, the structure realize that the cardinal principle of tripleplane is that electronic equipment is broadcast
The tripleplane's image put sends out corresponding optical signal by light source, and optical signal generates three after the processing of mirror plane
Tie up projected image；Another structure includes：(diffraction film is generally laid in electronic equipment table for electronic equipment, light source and diffraction film
Face), which realizes that the cardinal principle of tripleplane is, tripleplane's image that electronic equipment plays sends out correspondence by light source
Optical signal, optical signal generates tripleplane image after diffraction film process.
The present inventor, which studies, to be found：Current tripleplane's mode is only capable of realizing the three-dimensional display of image, has no
Method realizes control of the user to the 3-D view shown, lacks the interaction mechanism between user and 3-D view.
Invention content
In view of this, a kind of 3-D view control method of offer of the embodiment of the present invention, device and electronic equipment, existing to solve
There is the problem of technology cannot achieve control of the user to the 3-D view shown.
To achieve the above object, the embodiment of the present invention provides the following technical solutions：
A kind of 3-D view control method, applied to the electronic equipment for being equipped with the first image collecting device, the electronics
Equipment is used to play tripleplane's image, the method includes：
Play tripleplane's image；
User gesture image is acquired by described first image harvester；
Identify the corresponding control instruction of the user gesture image；
Tripleplane's image, which is controlled, according to the control instruction carries out corresponding operating.
Wherein, described to include according to control instruction control tripleplane's image progress corresponding operating：
Determine the 3-D view region corresponding to gesture in the user gesture image；
The 3-D view region, which is controlled, according to the control instruction carries out corresponding operating.
Wherein, the 3-D view region in the determination user gesture image corresponding to gesture includes：
Determine the first 3D coordinates corresponding to gesture in the user gesture image, the first 3D coordinates are with described the
One image collector is set to the coordinate in the three-dimensional system of coordinate that origin is established；
According to the preset three-dimensional system of coordinate with carry out three-dimensional image projection the interfaces 3D correspondence, determine described in
The corresponding 2nd 3D coordinates of first 3D coordinates, the 2nd 3D coordinates are the coordinate in the interfaces 3D；
It determines the 3-D view region corresponding to the 2nd 3D coordinates, is the 3-D view area corresponding to the gesture
Domain.
Wherein, the corresponding control instruction of the identification user gesture image includes：
It obtains and the symmetrically arranged second image collecting device acquired image of described first image harvester；
The user acquired by the second image collecting device acquired image and described first image harvester
Images of gestures, the screen and the light corresponding to the tripleplane's image played to the electronic equipment for determining the electronic equipment
The relative position for the mirror plane that signal is handled；
School is carried out to the user gesture image acquired by described first image harvester by the relative position
Just；
Identify that user gesture corresponding with the user gesture image after correction, determination are opposite with the user gesture identified
The control instruction answered.
Wherein, the corresponding control instruction of the identification user gesture image includes：
Identify the corresponding user gesture of the user gesture image；
According to the correspondence of scheduled user gesture and control instruction, determination is corresponding with the user gesture identified
Control instruction.
Wherein, described to include by described first image harvester acquisition user gesture image：
Obtain the first user gesture image that described first image harvester is acquired；
The first user gesture image is reduced according to predetermined ratio, forms second user images of gestures；
The second user images of gestures is handled using local clarity complexity LDC algorithms, cuts out third
User gesture image；
Determine that the third user gesture image is the user gesture image finally acquired.
Wherein, described to include by described first image harvester acquisition user gesture image：
Obtain the first user gesture image that described first image harvester is acquired；
The region being selected in the first user gesture image is determined by moving window, is formed and the region being selected
Corresponding fourth user images of gestures；
The fourth user images of gestures is handled using local clarity complexity LDC algorithms, cuts out the 5th
User gesture image；
Determine that the 5th user gesture image is the user gesture image finally acquired.
Wherein, the method further includes：
User's facial image is acquired by described first image harvester；
Position of user's face relative to the screen of the electronic equipment is calculated according to face recognition algorithms；
The projection pattern of the 3-D view is controlled by the position.
The embodiment of the present invention also provides a kind of 3-D view control device, applied to being equipped with the first image collecting device
Electronic equipment, for playing tripleplane's image, described device includes the electronic equipment：
Playing module, for playing tripleplane's image；
Acquisition module, for acquiring user gesture image by described first image harvester；
Identification module, for identification corresponding control instruction of the user gesture image；
Control module carries out corresponding operating for controlling tripleplane's image according to the control instruction.
Wherein, the control module includes：
Area determination unit, for determining the 3-D view region in the user gesture image corresponding to gesture；
Operation control unit carries out corresponding operating for controlling the 3-D view region according to the control instruction.
Wherein, the area determination unit includes：
First 3D coordinate determination subelements, for determining that the first 3D in the user gesture image corresponding to gesture is sat
Mark, the first 3D coordinates are the coordinate in the three-dimensional system of coordinate established by origin with described first image harvester；
2nd 3D coordinate determination subelements, for according to the preset three-dimensional system of coordinate and progress three-dimensional image projection
The correspondence at the interfaces 3D determines that the corresponding 2nd 3D coordinates of the first 3D coordinates, the 2nd 3D coordinates are 3D circle
Coordinate in face；
Area results determination subelement is described for determining the 3-D view region corresponding to the 2nd 3D coordinates
3-D view region corresponding to gesture.
Wherein, the identification module includes：
Image acquisition unit, for obtaining and symmetrically arranged second image collecting device of described first image harvester
Acquired image；
Relative position determination unit, for passing through the second image collecting device acquired image and described first
The user gesture image of image acquisition device determines the screen of the electronic equipment and is played to the electronic equipment
The relative position for the mirror plane that optical signal corresponding to tripleplane's image is handled；
Correct unit, for by the relative position to the user hand that is acquired by described first image harvester
Gesture image is corrected；
Recognition unit, user gesture corresponding with the user gesture image after correction, determines and is identified for identification
The corresponding control instruction of user gesture.
Wherein, the identification module includes：
Gesture identification unit, for identification corresponding user gesture of the user gesture image；
Instruction-determining unit is determined and is identified for the correspondence according to scheduled user gesture and control instruction
The corresponding control instruction of user gesture.
Wherein, the acquisition module includes：
First acquisition unit, the first user gesture image acquired for obtaining described first image harvester；
Reducing unit forms second user gesture figure for reducing the first user gesture image according to predetermined ratio
Picture；
First processing units, for using local clarity complexity LDC algorithms to the second user images of gestures into
Row processing, cuts out third user gesture image；
First final determining unit, for determining that the third user gesture image is the user gesture figure finally acquired
Picture.
Wherein, the acquisition module includes：
Second acquisition unit, the first user gesture image acquired for obtaining described first image harvester；
Selection unit, for determining the region being selected in the first user gesture image, formation and institute by moving window
State the corresponding fourth user images of gestures in the region being selected；
Second processing unit, for using local clarity complexity LDC algorithms to the fourth user images of gestures into
Row processing, cuts out the 5th user gesture image；
Second final determining unit, for determining that the 5th user gesture image is the user gesture figure finally acquired
Picture.
Wherein, described device further includes：
Man face image acquiring module, for acquiring user's facial image by described first image harvester；
Position computation module, for calculating screen of user's face relative to the electronic equipment according to face recognition algorithms
Position；
Project control module, the projection pattern for controlling tripleplane's image by the position.
The embodiment of the present invention also provides a kind of electronic equipment, including 3-D view control device described above.
Based on the above-mentioned technical proposal, display control method provided in an embodiment of the present invention plays three-dimensional throw in electronic equipment
When shadow image, the use can be identified by the first image acquisition device user gesture image being set on electronic equipment
The corresponding control instruction of family images of gestures, and then control tripleplane's image according to the control instruction and accordingly grasped
Make, realizes the control of the 3-D view to being shown.3-D view control method provided in an embodiment of the present invention provides one
The mechanism that user interacts with 3-D view can be achieved in kind, realizes the control of the 3-D view to being shown.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is the flow chart of 3-D view control method provided in an embodiment of the present invention；
Fig. 2 is another flow chart of 3-D view control method provided in an embodiment of the present invention；
Fig. 3 is another flow chart of 3-D view control method provided in an embodiment of the present invention；
Fig. 4 is the another flow chart of 3-D view control method provided in an embodiment of the present invention；
Fig. 5 is the schematic diagram of the first 3D coordinates corresponding to gesture in three-dimensional system of coordinate provided in an embodiment of the present invention；
Fig. 6 is the method flow diagram of correcting user images of gestures provided in an embodiment of the present invention；
Fig. 7 is the method flow diagram of acquisition user gesture image provided in an embodiment of the present invention；
Fig. 8 is that image flame detection provided in an embodiment of the present invention handles schematic diagram；
Fig. 9 is the another method flow chart of acquisition user gesture image provided in an embodiment of the present invention；
Figure 10 is another schematic diagram of image flame detection provided in an embodiment of the present invention processing；
Figure 11 is the method flow diagram of the projection pattern of adjustment 3-D view provided in an embodiment of the present invention；
Figure 12 is the structure diagram of 3-D view control device provided in an embodiment of the present invention；
Figure 13 is the structure diagram of control module provided in an embodiment of the present invention；
Figure 14 is the structure diagram of area determination unit provided in an embodiment of the present invention；
Figure 15 is the structure diagram of identification module provided in an embodiment of the present invention；
Figure 16 is another structure diagram of identification module provided in an embodiment of the present invention；
Figure 17 is the structure diagram of acquisition module provided in an embodiment of the present invention；
Figure 18 is another structure diagram of acquisition module provided in an embodiment of the present invention；
Figure 19 is another structure diagram of 3-D view control device provided in an embodiment of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Fig. 1 is the flow chart of 3-D view control method provided in an embodiment of the present invention, and this method can be applied to broadcasting three
The electronic equipment of projected image is tieed up, which can be equipped at least one image collecting device (such as camera), be pacified
The image collecting device of dress includes the first image collecting device, and referring to Fig.1, this method may include：
Step S100, tripleplane's image is played；
When carrying out three-dimensional image projection, the optical signal corresponding to tripleplane's image that electronic equipment is played will be through
Mirror plane or diffraction film process generate 3-D view.
Step S110, user gesture image is acquired by described first image harvester；
Optionally, the first image collecting device may be disposed at edge (upper side edge of such as electronic equipment, the downside of electronic equipment
Side, left side, right edge etc.), so as to detect the gesture operation of user, carry out the acquisition of user gesture image；Obviously,
The embodiment of the present invention can not also be restricted the installation position of the first image collecting device, as long as the first image collecting device energy
The gesture operation for enough detecting user collects user gesture image.
The case where optical signal corresponding to tripleplane's image that electronic equipment is played is handled through mirror plane
Under, the set-up mode of the first image collecting device preferably towards speculum some face, so that user's finger is flat in speculum
When face or electronic equipment screen act, user gesture image is collected.
Step S120, the corresponding control instruction of the user gesture image is identified；
Optionally, the correspondence of predeterminable user gesture and control instruction of the embodiment of the present invention, in electronic equipment
When collecting user gesture image, the corresponding user gesture of the user gesture image can recognize that, by the correspondence, determine
Go out the corresponding control instruction of gesture corresponding with the user gesture image acquired.
Optionally, the embodiment of the present invention can the instruction of preset various control, such as reduce projected 3-D view, amplify and thrown
The 3-D view of shadow, the projected 3-D view etc. of rotation, preset specific control instruction can be by user's sets itself, can
It is changed according to practical situations, the embodiment of the present invention is not restricted.Meanwhile user gesture corresponding with control instruction also may be used
By user's sets itself, can also be changed according to practical situations, the embodiment of the present invention is not restricted.
Step S130, it controls tripleplane's image according to the control instruction and carries out corresponding operating.
After the corresponding control instruction of user gesture image is determined, the executable identified control of the embodiment of the present invention refers to
It enables, control tripleplane image executes operate corresponding with identified control instruction.
Display control method provided in an embodiment of the present invention can be by setting when electronic equipment plays tripleplane's image
The first image acquisition device user gesture image being placed on electronic equipment, identifies the corresponding control of the user gesture image
System instruction, and then control tripleplane's image according to the control instruction and carry out corresponding operating is realized to being shown
The control of 3-D view.Display control method provided in an embodiment of the present invention provides a kind of achievable user and is handed over 3-D view
Mutual mechanism realizes the control of the 3-D view to being shown.
Optionally, the embodiment of the present invention is controlling tripleplane's image progress corresponding operating according to the control instruction
When, whole control can be carried out to tripleplane's image, such as controlled tripleplane's image and rotated integrally, reduce etc.；It also can be to three
Some 3-D view region of dimension projected image is controlled, such as the hand of control tripleplane image lifts, foot lifts,
Optionally, hand lift the control instruction lifted with foot can be the same, be only the 3-D view region that control instruction is controlled
It is different.
In the case of carrying out whole control to tripleplane's image, the embodiment of the present invention is adopted by the first image collecting device
Collect user gesture image, after determining the corresponding control instruction of user gesture image, you can control tripleplane image carry out with
The control to the 3-D view shown is realized in the corresponding operation of the control instruction.
Compared with the case where carrying out whole control to tripleplane's image, to a certain 3-D view area of tripleplane's image
The case where domain is controlled also needs the positioning for carrying out 3-D view region.Corresponding, Fig. 2 shows offers of the embodiment of the present invention
3-D view control method another flow chart, with reference to Fig. 2, this method may include：
Step S200, tripleplane's image is played；
Step S210, user gesture image is acquired by described first image harvester；
Step S220, the corresponding control instruction of the user gesture image is identified；
Step S230, the 3-D view region corresponding to gesture in the user gesture image is determined；
3-D view region can be certain part of tripleplane's image, if tripleplane's image is the people of a dancing,
Then 3-D view region can be the hand of people, foot, the positions such as head, this part citing only 3-D view area for ease of understanding
The relationship in domain and tripleplane's image should not become the limitation of the scope of the present invention.
In embodiments of the present invention, the 3-D view region corresponding to gesture can be understood as the graphics pointed by gesture
As region.
Optionally, the 3D coordinates in the interfaces 3D that the embodiment of the present invention can be by carrying out three-dimensional image projection determine graphics
As region.
Step S240, it controls the 3-D view region according to the control instruction and carries out corresponding operating.
Optionally, the scheme that the embodiment of the present invention controls 3-D view region is passing through the first image collector
It sets after collecting user gesture image, in addition to the corresponding control instruction of identification user gesture image, also needs to determine user gesture
3-D view region in image corresponding to gesture, to just the 3-D view region can control to execute and identified control
The corresponding operation of instruction.
Optionally, it for the different 3-D view regions of tripleplane's image, can be controlled with control instruction having the same
Instruction can be only corresponding with the gesture of user, and unrelated with the 3-D view region corresponding to gesture in user gesture image；Such as
Tripleplane's image be a dancing people, then the hand of people and foot can correspond to it is identical lift control instruction, if lifting control
3-D view region in the corresponding user gesture image of system instruction corresponding to gesture is foot, then can execute and lift to foot
Control instruction is lifted to control foot, if lifting in the user gesture image corresponding to control instruction three corresponding to gesture
Dimension image-region is hand, then can be executed to hand and lift control instruction, lifted to control hand.This part citing is only just
In understanding different 3-D view regions, the scope of the present invention can should not be become with the meaning of control instruction having the same
Limitation.
Clearly for the different 3-D view regions of tripleplane's image, there can be different control instructions.
Optionally, the embodiment of the present invention can correspond to the absolute coordinate of user gesture to 3D circle for carrying out three-dimensional image projection
3D coordinates in face, to realize the determination in the 3-D view region corresponding to gesture.Corresponding, Fig. 3 shows of the invention real
Another flow chart of the 3-D view control method of example offer is applied, with reference to Fig. 3, this method may include：
Step S300, tripleplane's image is played；
Step S310, user gesture image is acquired by described first image harvester；
Step S320, the corresponding control instruction of the user gesture image is identified；
Step S330, the absolute coordinate corresponding to gesture in user gesture image is determined；
Absolute coordinate can be the real space three-dimensional coordinate of gesture, and the embodiment of the present invention can set object of reference as origin
Three-dimensional system of coordinate is established, so that it is determined that absolute coordinate of the gesture in the three-dimensional system of coordinate, setting object of reference can be that electronics is set
Standby screen, first image collecting device etc. specifically can be depending on practical situations.
Step S340, absolute coordinate is converted to the 3D coordinates at the interfaces 3D for carrying out three-dimensional image projection；
Optionally, the embodiment of the present invention can make a reservation for the three-dimensional system of coordinate established by origin to set object of reference, with progress
The correspondence at the interfaces 3D of three-dimensional image projection, to after determining the corresponding absolute coordinate of gesture, be closed according to the correspondence
System, determines the 3D coordinates at the interfaces 3D corresponding to the absolute coordinate, and then determine 3-D view region by the 3D coordinates.
Step S350, the 3-D view region corresponding to the 3D coordinates is determined；
Step S360, it controls the 3-D view region according to the control instruction and carries out corresponding operating.
In an optional implementation manner, the embodiment of the present invention can be set to origin with the first image collector and establish three-dimensional
Coordinate system, in the gesture operation for detecting user, determine absolute coordinate of the gesture in the three-dimensional system of coordinate, thus will
The absolute coordinate is corresponded to the 3D coordinates in the interfaces 3D for carrying out three-dimensional image projection, realizes the 3-D view area corresponding to gesture
The determination in domain.Corresponding, Fig. 4 shows the another flow chart of 3-D view control method provided in an embodiment of the present invention, reference
Fig. 4, this method may include：
Step S400, tripleplane's image is played；
Step S410, user gesture image is acquired by described first image harvester；
Step S420, the corresponding control instruction of the user gesture image is identified；
Step S430, the first 3D coordinates corresponding to gesture in the user gesture image, the first 3D coordinates are determined
For the coordinate in the three-dimensional system of coordinate established by origin with described first image harvester；
For ease of understanding, Fig. 5 shows the schematic diagram of the first 3D coordinates corresponding to gesture in three-dimensional system of coordinate, can carry out
Reference.
Step S440, according to the corresponding pass of the preset three-dimensional system of coordinate and the interfaces 3D for carrying out three-dimensional image projection
System determines that the corresponding 2nd 3D coordinates of the first 3D coordinates, the 2nd 3D coordinates are the coordinate in the interfaces 3D；
Step S450, the 3-D view region corresponding to the 2nd 3D coordinates is determined；
Step S460, it controls the 3-D view region according to the control instruction and carries out corresponding operating.
3-D view control method provided in an embodiment of the present invention can be realized to the control of tripleplane's image entirety, also may be used
Realize the control to some 3-D view region of tripleplane's image；3-D view control method provided in an embodiment of the present invention
A kind of mechanism that achievable user interacts with 3-D view is provided, the control of the 3-D view to being shown is realized.
Optionally, in order to accurately carry out the gesture identification of user gesture image, by mirror plane to electronic equipment
In the case that the optical signal corresponding to tripleplane's image played is handled, the embodiment of the present invention is passing through the first image
After harvester collects user gesture image, processing can be corrected to the user gesture image acquired；It is a kind of optional
Correcting mode is, on an electronic device setting and the second symmetrical image collecting device of the first image collecting device, to logical
The second image collecting device is crossed to be corrected user gesture image.Corresponding, Fig. 6 shows a kind of correcting user images of gestures
Method flow diagram, with reference to Fig. 6, this method may include：
Step S500, acquisition and symmetrically arranged second image collecting device of described first image harvester are acquired
Image；
Step S510, pass through the second image collecting device acquired image and described first image harvester
The user gesture image of acquisition determines the screen of the electronic equipment and the tripleplane's image played to the electronic equipment
The relative position for the mirror plane that corresponding optical signal is handled；
Step S520, by the relative position to the user gesture figure that is acquired by described first image harvester
As being corrected.
The embodiment of the present invention the second image collecting device by being arranged with the first image collecting device symmetry direction into
After row image rectification, the screen of electronic equipment and the relative position of mirror plane can be obtained, which can be used for correcting
Gesture identification obtains more accurate control instruction；That is, after the user gesture image corrected, the embodiment of the present invention can
It identifies user gesture corresponding with the user gesture image after correction, determines control corresponding with the user gesture identified
Instruction.
Since the original image of the first image acquisition device is generally warp image, (such as the first image collector is set to
The case where wide-angle camera) or the larger image of resolution ratio, in order to reduce the calculation amount in 3-D view region, or reduce hand
The calculation amount of gesture identification.The embodiment of the present invention can carry out correction process to the original image that the first image collecting device is acquired,
Using the user gesture image after correction process as being that the embodiment of the present invention is acquired by described first image harvester
User gesture image accurately determines the corresponding control instruction of user gesture can subsequently to use smaller calculation amount, or
3-D view region.Corresponding, Fig. 7 shows the method flow diagram of acquisition user gesture image provided in an embodiment of the present invention,
With reference to Fig. 7, this method may include：
Step S600, the first user gesture image that described first image harvester is acquired is obtained；
Step S610, the first user gesture image is reduced according to predetermined ratio, forms second user images of gestures；
Step S620, using LDC (Local definition-complexity, local clarity complexity) algorithm pair
The second user images of gestures is handled, and third user gesture image is cut out；
Step S630, determine that the third user gesture image is the user gesture image finally acquired.
Obtained final user gesture image can be used for carrying out gesture identification and obtain control instruction；It can also be used for three
The determination for tieing up image-region, specifically, the corresponding absolute coordinate of gesture can be determined by final user gesture image, in turn
The 3D coordinates for determining the interfaces 3D determine 3-D view region by the 3D coordinates.
For ease of understanding, Fig. 8 shows that the first image collector is set under wide-angle lens, and corresponding image flame detection processing is shown
It is intended to, reference can be carried out.
The embodiment of the present invention is also provided with another original image acquired to the first image collecting device and corrects
The scheme of processing, corresponding, Fig. 9 shows the another method flow of acquisition user gesture image provided in an embodiment of the present invention
Figure, with reference to Fig. 9, this method may include：
Step S700, the first user gesture image that described first image harvester is acquired is obtained；
Step S710, the region being selected in the first user gesture image is determined by moving window, is formed and the quilt
The corresponding fourth user images of gestures in region of selection；
Moving window (Moving Window) can be pre-defined, can also be chosen and be determined by user.
Step S720, the fourth user images of gestures is handled using LDC algorithms, cuts out the 5th user gesture
Image；
Step S730, determine that the 5th user gesture image is the user gesture image finally acquired.
Obtained final user gesture image can be used for carrying out gesture identification and obtain control instruction；It can also be used for three
The determination for tieing up image-region, specifically, the corresponding absolute coordinate of gesture can be determined by final user gesture image, in turn
The 3D coordinates for determining the interfaces 3D determine 3-D view region by the 3D coordinates.
For ease of understanding, Figure 10 shows another schematic diagram of image flame detection processing, can carry out reference.
Optionally, the embodiment of the present invention can also be adjusted the projection pattern of 3-D view according to user location, such as adjust
Whole three-dimensional image is shown in face of user；Corresponding, Figure 11 shows adjustment 3-D view provided in an embodiment of the present invention
Projection pattern method flow diagram, referring to Fig.1 1, this method may include：
Step S800, user's facial image is acquired by described first image harvester；
Step S810, position of user's face relative to the screen of the electronic equipment is calculated according to face recognition algorithms；
Step S820, the projection pattern of tripleplane's image is controlled by the position.
3-D view control method provided in an embodiment of the present invention provides a kind of achievable user and is interacted with 3-D view
Mechanism, realize the control of the 3-D view to being shown.
3-D view control device provided in an embodiment of the present invention is introduced below, 3-D view control described below
Device processed can correspond reference with above-described 3-D view control method.
Figure 12 is the structure diagram of 3-D view control device provided in an embodiment of the present invention, which can be applied to play
The electronic equipment of tripleplane's image, the electronic equipment can be equipped at least one image collecting device, and the image installed is adopted
Acquisition means include the first image collecting device, and referring to Fig.1 2, which may include：
Playing module 100, for playing tripleplane's image；
Acquisition module 200, for acquiring user gesture image by described first image harvester；
Identification module 300, for identification corresponding control instruction of the user gesture image；
Control module 400 carries out corresponding operating for controlling tripleplane's image according to the control instruction.
Optionally, the embodiment of the present invention can carry out tripleplane's image whole control, also can be to tripleplane's image
Some 3-D view region controlled.In the case where controlling 3-D view region, Figure 13 shows the present invention
A kind of alternative construction for the control module 400 that embodiment provides, referring to Fig.1 3, control module 400 may include：
Area determination unit 410, for determining the 3-D view region in the user gesture image corresponding to gesture；
Operation control unit 411 carries out corresponding operating for controlling the 3-D view region according to the control instruction.
Optionally, Figure 14 shows a kind of alternative construction of area determination unit 410 provided in an embodiment of the present invention, reference
Figure 14, area determination unit 410 may include：
First 3D coordinates determination subelement 4101, for determining the first 3D in the user gesture image corresponding to gesture
Coordinate, the first 3D coordinates are the coordinate in the three-dimensional system of coordinate established by origin with described first image harvester；
2nd 3D coordinates determination subelement 4102, for according to the preset three-dimensional system of coordinate and progress 3-D view throwing
The correspondence at the interfaces 3D of shadow determines the corresponding 2nd 3D coordinates of the first 3D coordinates, and the 2nd 3D coordinates are described
Coordinate in the interfaces 3D；
Area results determination subelement 4103 is for determining the 3-D view region corresponding to the 2nd 3D coordinates
3-D view region corresponding to the gesture.
Optionally, in order to accurately carry out the gesture identification of user gesture image, the embodiment of the present invention is passing through the first figure
After collecting user gesture image as harvester, processing can be corrected to the user gesture image acquired；It is corresponding, figure
15 show a kind of alternative construction of identification module 300 provided in an embodiment of the present invention, referring to Fig.1 5, identification module 300 can be with
Including：
Image acquisition unit 310, for obtaining and symmetrically arranged second Image Acquisition of described first image harvester
Device acquired image；
Relative position determination unit 311, for passing through the second image collecting device acquired image and described the
The user gesture image of one image acquisition device determines that the screen of the electronic equipment is played with to the electronic equipment
Tripleplane's image corresponding to the relative position of mirror plane that is handled of optical signal；
Correct unit 312, for by the relative position to the use that is acquired by described first image harvester
Family images of gestures is corrected；
Recognition unit 313, user gesture corresponding with the user gesture image after correction, determines and is known for identification
Other corresponding control instruction of user gesture.
Optionally, Figure 16 shows another alternative construction of identification module 300 provided in an embodiment of the present invention, with reference to figure
16, identification module 300 may include：
Gesture identification unit 320, for identification corresponding user gesture of the user gesture image；
Instruction-determining unit 321 determines and is known for the correspondence according to scheduled user gesture and control instruction
Other corresponding control instruction of user gesture.
Optionally, the embodiment of the present invention can carry out correction process to the original image that the first image collecting device is acquired,
Using the user gesture image after correction process as be the embodiment of the present invention pass through described first image harvester acquire user
Images of gestures accurately determines the corresponding control instruction of user gesture, or three-dimensional can subsequently to use smaller calculation amount
Image-region.Corresponding, Figure 17 shows a kind of alternative constructions of acquisition module 100 provided in an embodiment of the present invention, with reference to figure
17, acquisition module 100 may include：
First acquisition unit 110, the first user gesture image acquired for obtaining described first image harvester；
Reducing unit 111 forms second user gesture for reducing the first user gesture image according to predetermined ratio
Image；
First processing units 112 are cut out for being handled the second user images of gestures using LDC algorithms
Third user gesture image；
First final determining unit 113, for determining that the third user gesture image is the user gesture finally acquired
Image.
Optionally, Figure 18 shows another alternative construction of acquisition module 100 provided in an embodiment of the present invention, with reference to figure
18, acquisition module 100 may include：
Second acquisition unit 120, the first user gesture image acquired for obtaining described first image harvester；
Selection unit 121, for determining the region being selected in the first user gesture image by moving window, formed with
The corresponding fourth user images of gestures in the region being selected；
Second processing unit 122 is cut out for being handled the fourth user images of gestures using LDC algorithms
5th user gesture image；
Second final determining unit 123, for determining that the 5th user gesture image is the user gesture finally acquired
Image.
Optionally, Figure 19 shows another structure diagram of 3-D view control device provided in an embodiment of the present invention, knot
It closes shown in Figure 12 and Figure 19, which can also include：
Man face image acquiring module 500, for acquiring user's facial image by described first image harvester；
Position computation module 600, for calculating user's face relative to the electronic equipment according to face recognition algorithms
The position of screen；
Project control module 700, the projection pattern for controlling tripleplane's image by the position.
3-D view control device provided in an embodiment of the present invention provides a kind of achievable user and is interacted with 3-D view
Mechanism, realize the control of the 3-D view to being shown.
The embodiment of the present invention also provides a kind of electronic equipment, including 3-D view control device described above, about three
The specific introduction of image control apparatus is tieed up, reference can be made to the description of corresponding part above, details are not described herein again.
Each embodiment is described by the way of progressive in this specification, the highlights of each of the examples are with other
The difference of embodiment, just to refer each other for identical similar portion between each embodiment.For device disclosed in embodiment
For, since it is corresponded to the methods disclosed in the examples, so description is fairly simple, related place is said referring to method part
It is bright.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, depends on the specific application and design constraint of technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention.
Various modifications to these embodiments will be apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest range caused.
Claims (15)
1. a kind of 3-D view control method, which is characterized in that applied to the electronic equipment for being equipped with the first image collecting device,
The electronic equipment is used to play tripleplane's image, the method includes：
Play tripleplane's image；
User gesture image is acquired by described first image harvester；
Identify the corresponding control instruction of the user gesture image；
Tripleplane's image, which is controlled, according to the control instruction carries out corresponding operating；
Wherein, it is described user gesture image is collected by described first image harvester after, further include：To the user
Images of gestures is corrected processing；
It is described processing is corrected to the user gesture image to include：
It obtains and the symmetrically arranged second image collecting device acquired image of described first image harvester；
The user gesture acquired by the second image collecting device acquired image and described first image harvester
Image, the screen and the optical signal corresponding to the tripleplane's image played to the electronic equipment for determining the electronic equipment
The relative position of the mirror plane handled；
The user gesture image acquired by described first image harvester is corrected by the relative position.
2. 3-D view control method according to claim 1, which is characterized in that described to be controlled according to the control instruction
Tripleplane's image carries out corresponding operating：
Determine the 3-D view region corresponding to gesture in the user gesture image；
The 3-D view region, which is controlled, according to the control instruction carries out corresponding operating.
3. 3-D view control method according to claim 2, which is characterized in that the determination user gesture image
3-D view region corresponding to middle gesture includes：
Determine that the first 3D coordinates corresponding to gesture in the user gesture image, the first 3D coordinates are with first figure
Coordinate in the three-dimensional system of coordinate established by origin as harvester；
According to the correspondence of the preset three-dimensional system of coordinate and the interfaces 3D for carrying out three-dimensional image projection, described first is determined
The corresponding 2nd 3D coordinates of 3D coordinates, the 2nd 3D coordinates are the coordinate in the interfaces 3D；
It determines the 3-D view region corresponding to the 2nd 3D coordinates, is the 3-D view region corresponding to the gesture.
4. 3-D view control method according to claim 1, which is characterized in that the identification user gesture image
Corresponding control instruction includes：
Identify user gesture corresponding with the user gesture image after correction；
According to the correspondence of scheduled user gesture and control instruction, control corresponding with the user gesture identified is determined
Instruction.
5. according to claim 1-4 any one of them 3-D view control methods, which is characterized in that described to pass through described first
Image acquisition device user gesture image includes：
Obtain the first user gesture image that described first image harvester is acquired；
The first user gesture image is reduced according to predetermined ratio, forms second user images of gestures；
The second user images of gestures is handled using local clarity complexity LDC algorithms, cuts out third user
Images of gestures；
Determine that the third user gesture image is the user gesture image finally acquired.
6. according to claim 1-4 any one of them 3-D view control methods, which is characterized in that described to pass through described first
Image acquisition device user gesture image includes：
Obtain the first user gesture image that described first image harvester is acquired；
The region being selected in the first user gesture image is determined by moving window, is formed corresponding with the region being selected
Fourth user images of gestures；
The fourth user images of gestures is handled using local clarity complexity LDC algorithms, cuts out the 5th user
Images of gestures；
Determine that the 5th user gesture image is the user gesture image finally acquired.
7. 3-D view control method according to claim 1, which is characterized in that further include：
User's facial image is acquired by described first image harvester；
Position of user's face relative to the screen of the electronic equipment is calculated according to face recognition algorithms；
The projection pattern of the 3-D view is controlled by the position.
8. a kind of 3-D view control device, which is characterized in that applied to the electronic equipment for being equipped with the first image collecting device,
For playing tripleplane's image, described device includes the electronic equipment：
Playing module, for playing tripleplane's image；
Acquisition module, for acquiring user gesture image by described first image harvester；
Identification module, for identification corresponding control instruction of the user gesture image；
Control module carries out corresponding operating for controlling tripleplane's image according to the control instruction；
Wherein, the identification module includes：
Image acquisition unit is adopted for obtaining with symmetrically arranged second image collecting device of described first image harvester
The image of collection；
Relative position determination unit, for passing through the second image collecting device acquired image and described first image
The user gesture image of harvester acquisition determines the screen of the electronic equipment and the three-dimensional played to the electronic equipment
The relative position for the mirror plane that optical signal corresponding to projected image is handled；
Correct unit, for by the relative position to the user gesture figure that is acquired by described first image harvester
As being corrected.
9. 3-D view control device according to claim 8, which is characterized in that the control module includes：
Area determination unit, for determining the 3-D view region in the user gesture image corresponding to gesture；
Operation control unit carries out corresponding operating for controlling the 3-D view region according to the control instruction.
10. 3-D view control device according to claim 9, which is characterized in that the area determination unit includes：
First 3D coordinate determination subelements, for determining the first 3D coordinates in the user gesture image corresponding to gesture, institute
The first 3D coordinates are stated as the coordinate in the three-dimensional system of coordinate established by origin with described first image harvester；
2nd 3D coordinate determination subelements, for according to the preset three-dimensional system of coordinate and 3D circle for carrying out three-dimensional image projection
The correspondence in face determines that the corresponding 2nd 3D coordinates of the first 3D coordinates, the 2nd 3D coordinates are in the interfaces 3D
Coordinate；
Area results determination subelement is the gesture for determining the 3-D view region corresponding to the 2nd 3D coordinates
Corresponding 3-D view region.
11. 3-D view control device according to claim 8, which is characterized in that the identification module further includes：
Gesture identification unit, for identification user gesture corresponding with the user gesture image after correction；
Instruction-determining unit, for the correspondence according to scheduled user gesture and control instruction, the use for determining and being identified
The corresponding control instruction of family gesture.
12. according to claim 8-11 any one of them 3-D view control devices, which is characterized in that the acquisition module packet
It includes：
First acquisition unit, the first user gesture image acquired for obtaining described first image harvester；
Reducing unit forms second user images of gestures for reducing the first user gesture image according to predetermined ratio；
First processing units, at using local clarity complexity LDC algorithms to the second user images of gestures
Reason, cuts out third user gesture image；
First final determining unit, for determining that the third user gesture image is the user gesture image finally acquired.
13. according to claim 8-11 any one of them 3-D view control devices, which is characterized in that the acquisition module packet
It includes：
Second acquisition unit, the first user gesture image acquired for obtaining described first image harvester；
Selection unit is formed and the quilt for determining the region being selected in the first user gesture image by moving window
The corresponding fourth user images of gestures in region of selection；
Second processing unit, at using local clarity complexity LDC algorithms to the fourth user images of gestures
Reason, cuts out the 5th user gesture image；
Second final determining unit, for determining that the 5th user gesture image is the user gesture image finally acquired.
14. 3-D view control device according to claim 8, which is characterized in that further include：
Man face image acquiring module, for acquiring user's facial image by described first image harvester；
Position computation module, for calculating position of user's face relative to the screen of the electronic equipment according to face recognition algorithms
It sets；
Project control module, the projection pattern for controlling tripleplane's image by the position.
15. a kind of electronic equipment, which is characterized in that including claim 8-14 any one of them 3-D view control devices.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410301004.3A CN105334951B (en) | 2014-06-27 | A kind of 3-D view control method, device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410301004.3A CN105334951B (en) | 2014-06-27 | A kind of 3-D view control method, device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105334951A CN105334951A (en) | 2016-02-17 |
| CN105334951B true CN105334951B (en) | 2018-08-31 |
Family
ID=
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102508546A (en) * | 2011-10-31 | 2012-06-20 | 冠捷显示科技（厦门）有限公司 | Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method |
| CN102736728A (en) * | 2011-04-11 | 2012-10-17 | 宏碁股份有限公司 | Control method and system for three-dimensional virtual object and processing device for three-dimensional virtual object |
| CN103176605A (en) * | 2013-03-27 | 2013-06-26 | 刘仁俊 | Control device of gesture recognition and control method of gesture recognition |
| CN103793061A (en) * | 2014-03-03 | 2014-05-14 | 联想(北京)有限公司 | Control method and electronic equipment |
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102736728A (en) * | 2011-04-11 | 2012-10-17 | 宏碁股份有限公司 | Control method and system for three-dimensional virtual object and processing device for three-dimensional virtual object |
| CN102508546A (en) * | 2011-10-31 | 2012-06-20 | 冠捷显示科技（厦门）有限公司 | Three-dimensional (3D) virtual projection and virtual touch user interface and achieving method |
| CN103176605A (en) * | 2013-03-27 | 2013-06-26 | 刘仁俊 | Control device of gesture recognition and control method of gesture recognition |
| CN103793061A (en) * | 2014-03-03 | 2014-05-14 | 联想(北京)有限公司 | Control method and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9135753B2 (en) | Apparatus and method of augmented reality interaction | |
| USRE46976E1 (en) | Image processing device, image processing method, and image processing program | |
| US20140267427A1 (en) | Projector, method of controlling projector, and program thereof | |
| US10070048B2 (en) | Panorama photographing method, panorama displaying method, and image capturing method | |
| WO2012141872A1 (en) | Object tracking with projected reference patterns | |
| CN104104862A (en) | Image processing device and image processing method | |
| WO2014131329A1 (en) | Image acquisition method and device | |
| TW200930098A (en) | Camera control system capable of positioning and tracking object in space and method thereof | |
| CN105260008B (en) | A kind of method and device of position location | |
| WO2021035891A1 (en) | Augmented reality technology-based projection method and projection device | |
| US9538079B2 (en) | Methods and electronic devices enabling panoramic photography | |
| WO2015100205A1 (en) | Remote sensitivity adjustment in an interactive display system | |
| CN109059929A (en) | Air navigation aid, device, wearable device and storage medium | |
| CN105718052B (en) | A kind of indicating means and device for correcting body feeling interaction tracking failure | |
| US20190197666A1 (en) | Receiving and displaying sensor data on a substantially spherical surface of a display device | |
| US20230034538A1 (en) | Image pickup apparatus used as action camera, control method therefor, and storage medium storing control program therefor | |
| US11849217B2 (en) | Image pickup apparatus used as action camera, calibration system, control method for image pickup apparatus, and storage medium storing control program for image pickup apparatus | |
| TW201310993A (en) | Display device and rotation method thereof | |
| US8810641B2 (en) | Television, control method and control device for the television | |
| WO2018014517A1 (en) | Information processing method, device and storage medium | |
| EP2662829B1 (en) | System and method of book leaf tracking | |
| JPWO2018146922A1 (en) | Information processing apparatus, information processing method, and program | |
| JP6219037B2 (en) | Information processing program, information processing apparatus, information processing system, and information processing method | |
| CN105334951B (en) | A kind of 3-D view control method, device and electronic equipment | |
| CN108628487A (en) | A kind of method of determining position information, projection device and computer storage media |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |