CN104683786B - The tracing of human eye method and device of bore hole 3D equipment - Google Patents
The tracing of human eye method and device of bore hole 3D equipment Download PDFInfo
- Publication number
- CN104683786B CN104683786B CN201510090654.2A CN201510090654A CN104683786B CN 104683786 B CN104683786 B CN 104683786B CN 201510090654 A CN201510090654 A CN 201510090654A CN 104683786 B CN104683786 B CN 104683786B
- Authority
- CN
- China
- Prior art keywords
- rotation
- coordinate
- eyes
- target area
- bore hole
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The present invention relates to the tracing of human eye method and device of bore hole 3D equipment.A kind of tracing of human eye method of bore hole 3D equipment, including the facial image of user is obtained, obtain the coordinate at eyes midpoint in facial image；Determine that the coordinate at eyes midpoint falls outside default target area in the picture, target area is arranged in image between default 3D left figures vision area and 3D right figure vision areas；Rotation bore hole 3D equipment, makes the coordinate at eyes midpoint fall into target area.To solve the problems, such as that user is difficult to find when using bore hole 3D equipment and keeps eyes in the range of optimal viewing angle, make user in the range of visual range, viewing angle need not deliberately be found or viewing angle is kept, removed and dazzled the serious impression of dizzy, crosstalk, easily experience preferable 3D effect.
Description
Technical field
The present invention relates to tracing of human eye technical field, more particularly to bore hole 3D equipment tracing of human eye method and device.
Background technology
The technology that the 3D stereoscopic displays of current main-stream are applied to equipment has polarised light, shutter, and they can not put us
The constraint of de- Special spectacles, this causes that its range of application and usage comfort are all made a discount.Can allow prolonged experiencer
There is the sensation of discomfort.Then, the power of sustainable development is capable of in 3D stereoscopic displays, has just fallen this forward position of bore hole 3D Display Techniques
With science and technology.The mainstream technology that bore hole 3D has been applied at present is mainly using parallax barrier technology, lens pillar technology, realizes
In the case of not using special eyeglasses, the effect of 3D images is presented during viewing word and picture.Optical barrier type (raster pattern), post
Shape lens this two technologies, step into the visual field of domestic consumer in a small amount of product at present on the market.Bore hole 3D technology master
It is applied to a small amount of display screen such as mobile phone, panel computer, colour TV, advertisement machine.
From the point of view of technically, bore hole 3D display screens can be divided into optical barrier type, lens pillar technology and point to three kinds of light source.Though
The constraint of glasses has so been broken away from, but bore hole 3D technology also exists much at aspects such as resolution ratio, visible angle and visual ranges
It is not enough.Using these technical users, it is necessary to the position certain with display device holding can just see 3D effect when viewing
Image (3D effect by angle effects larger), otherwise crosstalk is serious, and its content received to right and left eyes is exchanged, and does not have 3D to imitate
Really, discomfort is caused.When using bore hole 3D display devices, most difficult is exactly to find suitable position to user, and suitable position
Put mainly is influenceed by two factors of visible angle and visual range, wherein again with by the larger maximum of angle effects.Because, currently
Led display screens, pixel is all discrete arrangement, and there is black interval centre, in order to avoid black interval is done to valid pixel color
Disturb, when optical screen or lens pillar is designed, in order to reduce the interference of black line, so that 3D effect is received to regard best angle scope very
Small, the especially display device of single view.This directly results in domestic consumer, looks for position difficult.During position is looked for, obtain
To be to dazzle the serious impression of dizzy, crosstalk.Even if user have found position, due to visual angle is small, user will be maintained at one
Can not have somewhat shifted on individual position, position is otherwise readjusted again, it is poor to experience.Defect based on principle, does not have also at present
There is the method that manufacturer proposes to make user that position and holding position is more easily found.User can only go to fit according to experience is used
Should, to the user for using for the first time, for experience very it is bad.
The content of the invention
For drawbacks described above, it is an object of the invention to provide the tracing of human eye method and device of bore hole 3D equipment, to solve
Certainly user is difficult the problem found and keep eyes in the range of optimal viewing angle when using bore hole 3D equipment.
It is, up to this purpose, the invention provides a kind of tracing of human eye method of bore hole 3D equipment, to comprise the following steps：
The facial image in the image of user is obtained, the coordinate at eyes midpoint in the facial image is obtained；
Determine that the coordinate at the eyes midpoint falls outside preset target area in described image, the target area is set
In described image between default 3D left figures vision area and 3D right figure vision areas；
The bore hole 3D equipment is rotated, the coordinate at eyes midpoint is fallen into the target area.
It is preferred that the rotation bore hole 3D equipment, makes the coordinate at eyes midpoint fall into the target area, specifically
Including：
The position of coordinate according to the eyes midpoint in described image, judges the direction of rotation for tracking human eye；
The bore hole 3D equipment is rotated into default first anglec of rotation at least one times to the direction of rotation, until eyes
Untill the coordinate at midpoint is fallen into the target area.
It is preferred that the rotation bore hole 3D equipment, makes the coordinate at eyes midpoint fall into the target area, specifically
Including：
The position of coordinate according to the eyes midpoint in described image, judges the direction of rotation for tracking human eye；
According to the coordinate at the eyes midpoint, show that the bore hole 3D equipment is rotated to up to target area to the direction of rotation
The second required anglec of rotation in domain；
The bore hole 3D equipment is rotated into second anglec of rotation to the direction of rotation.
It is preferred that the position according to the coordinate at the eyes midpoint in described image, judges for tracking human eye
Direction of rotation, specifically include：
Left datum target region and right datum target region in default described image, the left datum target region and the right side
Datum target region is in the target area；
When the 3D that the coordinate at the eyes midpoint is fallen between the left datum target region and right datum target region is left
When figure vision area or 3D right figure vision areas, if the coordinate at the eyes midpoint is near the target area of adjacent left-hand, the rotation side
To for counterclockwise；If the coordinate at the eyes midpoint is near the target area of adjacent right side, the direction of rotation
Clockwise；When the coordinate at the eyes midpoint falls into the left side in the left datum target region, then the direction of rotation is
Counterclockwise；When the coordinate at the eyes midpoint falls into the right side in the right datum target region, then the direction of rotation is
Clockwise.
It is preferred that the position according to the coordinate at the eyes midpoint in described image, judges for tracking human eye
Direction of rotation, specifically include：
When the center line of described image falls in target area, if the coordinate at the eyes midpoint is fallen into described image
In 3D left figures vision area or 3D right figure vision areas on the left of heart line, then the direction of rotation is for clockwise；If the eyes midpoint
The 3D left figures vision area that falls on the right side of described image center line of coordinate or 3D right figure vision areas in, then the direction of rotation is counterclockwise
Direction.
It is preferred that the rotation bore hole 3D equipment, after the coordinate at eyes midpoint is fallen into the target area,
Also include：
When the left side of the target area where the eyes midpoint is 3D left figure vision areas, the bore hole 3D device plays are exchanged
Left-eye video and right eye video.
It is preferred that obtain user image in facial image after, also include：
Obtain the distance of the eyes in the facial image；
Distance according to the eyes is calculated the distance of human eye and screen；
The distance of confirmation face and screen sends prompt message not in the range of preset preferred viewing distance.
Be up to this purpose, present invention also offers a kind of tracing of human eye device of bore hole 3D equipment,
Including camera, processor and whirligig, wherein camera is arranged in the bore hole 3D equipment or fixed
On the rotation platform, the bore hole 3D equipment is fixed on the whirligig；
The camera is used to obtain the facial image of user；
The processor is used to obtain the coordinate at eyes midpoint in the facial image, determines the coordinate at the eyes midpoint
Fall in described image outside default target area, send rotation instruction to the rotation platform, the target area is arranged at
In described image between default 3D left figures vision area and 3D right figure vision areas；
The whirligig is used to drive the bore hole 3D equipment and the camera to revolve after receiving the rotation instruction
Turn, the coordinate at eyes midpoint is fallen into the target area.
It is preferred that also including direction determining module and the first instruction sending module in the processor；
The direction determining module is used to determine that the coordinate at the eyes midpoint falls the default target area in described image
After overseas, the position of coordinate according to the eyes midpoint in described image judges the direction of rotation for tracking human eye；Institute
The first instruction sending module is stated for the whirligig will to be sent to comprising the first of the direction of rotation the rotation instruction；
The whirligig receive after the first rotation instruction by the bore hole 3D equipment and the camera to
The direction of rotation rotates default first anglec of rotation at least one times, until the coordinate at eyes midpoint falls into the target area
Untill interior.
It is preferred that also including that direction determining module, angle calculation module and the second instruction send mould in the processor
Block；
The direction determining module is used to determine that the coordinate at the eyes midpoint falls the default target area in described image
After overseas, the position of coordinate according to the eyes midpoint in described image judges the direction of rotation for tracking human eye；
The angle calculation module is used for the coordinate according to the eyes midpoint, calculates the bore hole 3D equipment to described
Direction of rotation rotates to required second anglec of rotation up in target area；
Second instruction sending module is used for comprising the direction of rotation and second anglec of rotation second
Rotation instruction is sent to the whirligig；
The whirligig receive after the second rotation instruction by the bore hole 3D equipment and the camera to
The direction of rotation rotates second anglec of rotation.
It is preferred that also including eye distance acquisition module, distance calculation module and distance prompt module in the processor：
The eye distance acquisition module is used to obtain the distance of the eyes in the facial image；
The distance calculation module is used to be calculated according to the distance of the eyes distance of human eye and screen；
The distance prompt module is used to confirm the distance of face and screen not in the scope of preset preferred viewing distance
It is interior, send prompt message.
The present invention uses above-mentioned technical proposal, compared with existing technical scheme, with following beneficial effect：
By the coordinate at eyes midpoint in the image for obtaining user, rotation bore hole 3D equipment falls into the coordinate at eyes midpoint
In target area, user is in the range of visual range, it is not necessary to deliberately finds viewing angle or keeps viewing angle, removes and dazzle
Dizzy, preferable 3D effect is easily experienced in the serious impression of crosstalk.By two datum target regions in pre-set image or pass through
The direction of rotation of bore hole 3D equipment is judged on the basis of picture centre line, makes tracing of human eye quicker, coherent, accurate.
Brief description of the drawings
Fig. 1 is a kind of flow chart one of the tracing of human eye method of bore hole 3D equipment in inventive embodiments one；
Fig. 2 is a kind of flowchart 2 of the tracing of human eye method of bore hole 3D equipment in the embodiment of the present invention one；
Fig. 3 is a kind of flow chart 3 of the tracing of human eye method of bore hole 3D equipment in the embodiment of the present invention one；
Fig. 4 is a kind of flow chart four of the tracing of human eye method of bore hole 3D equipment in the embodiment of the present invention one；
Fig. 5 is the space schematic diagram of camera acquisition image in the present invention；
Fig. 6 is human eye and the distance of screen and the space schematic diagram of the distance of eyes in the present invention；
Fig. 7 is the top view of the screen of bore hole 3D equipment in the present invention；
Fig. 8 is each area schematic of image that post mirror vertical setting of types patch method bore hole 3D equipment is obtained；
Fig. 9 is each area schematic of image that post mirror tiltedly arranges the acquisition of patch method bore hole 3D equipment；
Figure 10 is a kind of structured flowchart of the tracing of human eye device of bore hole 3D equipment in the embodiment of the present invention two；
Figure 11 is a kind of structured flowchart of the tracing of human eye device of bore hole 3D equipment in the embodiment of the present invention three；
Figure 12 is the structural representation of the whirligig in the embodiment of the present invention two and embodiment three；
Figure 13 is a kind of flow chart five of the tracing of human eye method of bore hole 3D equipment in the embodiment of the present invention one；
Figure 14 is a kind of flow chart six of the tracing of human eye method of bore hole 3D equipment in the embodiment of the present invention one.
Specific embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right below in conjunction with drawings and Examples
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Bore hole 3D equipment in the present invention refers to bore hole 3D display screens or the mobile phone for being integrated with bore hole 3D display screens,
The smart machines such as panel computer, colour TV, advertisement machine.
Embodiment one
A kind of flow chart of the tracing of human eye method of bore hole 3D equipment that accompanying drawing 1-4,13-14 are provided for the present invention, including
Following steps：
100：The facial image in the image of user is obtained, the coordinate at eyes midpoint in facial image is obtained.Such as Fig. 5 institutes
Show, pickup camera catches the image of the object in the imitative taper regional space in front, it is necessary first to obtain the image comprising user's face,
The general image for obtaining or image data are yuv forms, are switched to be easy to the general rgb forms of image recognition, by face
Identification technology identifies facial image, and identifies the eyes midpoint in facial image, obtains eyes midpoint seat in the picture
Mark.
After facial image in the image for obtaining user, typically also include：
101：Obtain the distance of the eyes in facial image.Using the people in the image of face recognition technology identifying user
Face, the eyes of face in identification image, obtains the distance of the eyes of face in image, in units of pixel.
102：Distance according to eyes is calculated the distance of human eye and screen.Such as in this example, as shown in figure 5, capturing
The resolution ratio of image is set to 320*240, the subtended angle of camera catching range in advanceIt is 60 degree, face in the image for capturing
The distance of eyes be 50 pixels.The distance of the actual eyes of human eye standard is 6.5cm or so.As shown in fig. 6-7, then 50/
320 multiplied by with 60 degree, it is possible to which the number of degrees of a being converted into figure are 9.4 degree, by 9.4 degree be not difficult to calculate human eye and screen away from
It is 6.5/tana=39.26cm with a distance from y.
103：The distance of confirmation face and screen sends prompt message not in the range of preset preferred viewing distance.
Optimal visual distance is D, then at optimal visual distance, the width that real image is captured It is angle
Degree, D is that the position of such W length areas and the actual human eye x coordinate (0~320) of seizure there is a linear corresponding pass
System's (note：Actually camera imaging has wide-angle distortion problem, but generally, all watched close to front here,
Visual angle is smaller, can approximately see linear, is ignored here in institute).Optimal visual range D is 30-40cm, this implementation
D=35cm in example, visual range is little to influential effect in 20% or so of optimal visual distance deviation range, therefore all
Can be as preferred viewing distance, as above y=39.26cm in example, eyes midpoint in then obtaining image in preferred viewing distance
Coordinate, the i.e. coordinate for two midpoints of eyes line of people in the picture, if face exceeds 0.8D-1.2D with the distance of screen,
Prompt message is then sent, user's adjustment distance is reminded.
200：Determine that the coordinate at eyes midpoint falls outside target area preset in the picture, target area is arranged in image
Between default 3D left figures vision area and 3D right figure vision areas.
The straight line where A, B, C, D, E as Figure 8-9 is the preset target area of image in the present embodiment, 3D left figures
Vision area and 3D right figure vision area interval settings, target area is the region between any 3D left figures vision area and 3D right figure vision areas；Human eye
The left-eye video without crosstalk, human eye is watched to fall to seen in 3D right figure vision areas in the picture when falling into 3D left figure vision areas in the picture
See the right eye video without crosstalk, eyes midpoint falls at target area, and eyes midpoint falls at target area, there are two kinds of feelings
Condition, a kind of situation：The left eye of people falls into 3D left figure vision areas in the picture, and right eye falls into 3D right figure vision areas, now uses in the picture
3D video of the crosstalk in error allowed band is watched at family, the feelings of target area as where eyes midpoint in accompanying drawing 8 midpoint A, C
Condition；Another situation：The right eye of people falls into 3D left figure vision areas in the picture, and left eye falls into 3D right figure vision areas in the picture, now
If the left-eye video of 3D bore hole device plays and 3D right eye videos are exchanged (to exchange setting 3D left figures vision area to be regarded with 3D right figures
Area), then user watches 3D video of the crosstalk in error allowed band, the target area as where eyes midpoint in point B, D
Situation.Can require to set the size of objective area in image that the level of target area is wide according to the different of error precision
Degree correspondence human eye can extend the deadline the mobile horizontal range without tracking in the scope of preferred viewing distance, if wanting, reaching optimal 3D sees
Effect is seen, objective area in image can be a pixel line, and as Figure 8-9, this kind of setting may be such that tracking rotates excessively
Sensitive also more accurate, human eye is slightly moved, and bore hole 3D equipment just starts rotation.The resolution ratio of image is higher, and target area is got over
Narrow, then tracking accuracy is higher.
300：The bore hole 3D equipment is rotated, the coordinate at eyes midpoint is fallen into target area.
Step 300 is specifically included:
301：The position of coordinate according to the eyes midpoint in described image, judges the rotation side for tracking human eye
To.Wherein specifically include step 310-311.
310:When the size of the screen of bore hole 3D equipment is larger, or center line is not fallen within when in target area, can be with
Left datum target region and right datum target region in pre-set image, left datum target region and right datum target region are in mesh
Mark region in, can have between left datum target region and right datum target region one or more 3D left figures vision area and/or
3D right figure vision areas.(3D figures vision area is 3D left figures multiple 3D figures vision areas between left datum target region and right datum target region
The general designation of vision area and 3D right figure vision areas), then necessarily there is target area, this kind of method to set up is commonly used in the screen of bore hole 3D equipment
It is larger-size in the case of；Can also only have without target area between left datum target region and right datum target region
One 3D left figures vision area or 3D right figure vision areas, this kind of method to set up are general scheme.
311：When the 3D left figures that the coordinate at eyes midpoint is fallen between left datum target region and right datum target region are regarded
When area or 3D right figure vision areas, if the distance of the coordinate at eyes midpoint and adjacent left side target area than with adjacent right side target
When the distance in region is near, then direction of rotation is for counterclockwise；If the coordinate at eyes midpoint and adjacent left side target area
Distance than with the distance of adjacent right side target area it is remote when, then direction of rotation is for clockwise, wherein eyes midpoint
Coordinate refers both to the distance on rotation direction of principal axis with the distance of target area.When the coordinate at eyes midpoint falls into left benchmark mesh
The left side in region is marked, then direction of rotation is for counterclockwise；The coordinate at eyes midpoint falls into the right side in right datum target region, then
Direction of rotation is for clockwise.
And when the center line of image falls in target area, it is also possible to rotation side is judged on the basis of the center line of image
To：
If in the 3D left figures vision area that the coordinate at eyes midpoint is fallen on the left of picture centre line or 3D right figure vision areas, rotation side
To for clockwise；If in the 3D left figures vision area that the coordinate at eyes midpoint is fallen on the right side of picture centre line or 3D right figure vision areas,
Then direction of rotation is for counterclockwise.
Clockwise and counterclockwise above is the direction in the plane of rotary shaft, such as institute in accompanying drawing 7
The P directions for showing with vertical direction to be rotary shaft Rotation screen in the present embodiment counterclockwise and Q directions are clockwise, certainly,
Possible screen can be inclined during viewing video, and rotary shaft can also be in vertical direction with certain angle.
302：Bore hole 3D equipment is rotated default first anglec of rotation at least one times to direction of rotation, until eyes midpoint
Coordinate fall into the target area untill.First anglec of rotation is generally unit angle or less angle, can basis
The self-defined settings of factor such as tracking accuracy, tracking velocity, user's custom.Specifically, bore hole 3D equipment is rotated to direction of rotation
After first anglec of rotation, by the coordinate at eyes midpoint in the image for obtaining user, whether point coordinates is in image in determining eyes
Target area in, in this way, then terminate tracking, if not, can continue to rotate default first anglec of rotation to direction of rotation
Degree.
Step 300 can also be in the following ways：
301：Coordinate according to eyes midpoint position in the picture, judges the direction of rotation for tracking human eye, specifically
See above.
303：According to the coordinate at eyes midpoint, show that bore hole 3D equipment is rotated to up in target area to the direction of rotation
The second required anglec of rotation.In assume that camera can catch the half of angle and beWhole visual angle is exactlySoAngle is just set up with 0-320 coordinates and be contacted by, and per one coordinate position of unit of error, corresponding angular error is exactlyThe relation of rotation angle of equipment and the coordinate offset distance at eyes midpoint has been built such that it, it is easy to draw second
The anglec of rotation.
304：The bore hole 3D equipment is rotated into second anglec of rotation to the direction of rotation.It is fast in order to rotate tracking
Victory, generally rotating bore hole 3D equipment according to direction of rotation makes the coordinate at eyes midpoint fall into its 3D left figure vision area being currently located
Or in the target area of 3D right figure vision areas side, when the coordinate at eyes midpoint is excessively partial to the avris of image, it would however also be possible to employ
Second anglec of rotation of wide-angle, makes the coordinate at eyes midpoint fall into 3D left figures vision area or 3D right figure vision areas that distance is currently located
Target area farther out, makes screen quickly return just to the position of face.
400：When the left side of the target area where eyes midpoint is 3D left figure vision areas, then need to exchange bore hole 3D equipment
The left-eye video and right eye video of broadcasting, it causes 3D left figures vision area and the position of 3D right figure vision areas is exchanged, and now eyes are seen
To be 3D videos effect.
Nowadays the screen of bore hole 3D equipment uses two kinds of post mirror laminating types, post mirror vertical setting of types patch method and post mirror tiltedly to arrange patch method.
Immediately ahead of vertical setting of types patch method bore hole 3D device screens spatially, right and left eyes content area is vertically to be alternately arranged, and post mirror is tiltedly arranged
Immediately ahead of patch method bore hole 3D device screens spatially, right and left eyes content area is oblique being alternately arranged.By target in Fig. 8-9
Region is set to a pixel line, and the linear equation y=kx+b that can record arbitrary target region (can certainly be a mesh
Mark regions, its zone boundary linear equation of area) its center pillar mirror vertical setting of types patch method when, k=0, in this coordinate system only need consider
The x-axis coordinate size of point coordinates, draws the horizontal range at eyes midpoint and each target area in eyes；When post mirror tiltedly arranges patch method,
Point coordinates (xo, yo), brings yo into linear equations in the eyes for obtaining, so as to draw the level at eyes midpoint and each target area
Distance, is easy to judge direction of rotation.The target area where B points and D points in Fig. 8-9, is exactly the optimum position of person's eye midpoint,
And the coordinate for working as eyes midpoint fall into A points and C points where target area, then need to exchange the left eye of bore hole 3D device plays
Video and right eye video.
Embodiment two
The structured flowchart of the tracing of human eye device of a kind of bore hole 3D equipment for being provided for the present invention as shown in Figure 10, for reality
Method in existing above-described embodiment one, including camera 500, processor 600 and whirligig 700, bore hole 3D equipment are fixed
On the spinning device.Processor 600 is used to obtain the coordinate at eyes midpoint in facial image, determines that the coordinate at eyes midpoint falls
In image outside default target area, rotation instruction is sent to whirligig 700, whirligig 700 is used to receive rotation instruction
Bore hole 3D equipment and camera rotation are driven afterwards, the coordinate at eyes midpoint is fallen into target area.
Camera 500 can be the front camera being arranged in bore hole 3D equipment, or be fixed on whirligig
The camera that upper and bore hole 3D equipment is together rotated, in the present embodiment, the front camera carried using bore hole 3D equipment, CCD
Imageing sensor pickup camera, pickup camera catches the object in the imitative taper regional space in front, in the case where light condition is bad
Thermal camera can also be used.Camera is used to obtain the facial image of user.
Processor 600 is used to obtain the coordinate at eyes midpoint in facial image, determines that the coordinate at eyes midpoint falls in image
In outside default target area, send rotation instruction to whirligig, default 3D left figures are regarded during target area is arranged at image
Between area and 3D right figure vision areas, specific explanations are shown in step 100 in embodiment one.Processor can be bore hole 3D device interiors
CPU。
Also include eye distance acquisition module 611, distance calculation module 612, distance prompt module 613, eye distance in processor 600
Acquisition module 611 is used to obtain the distance of the eyes in facial image；Distance calculation module 612 is based on the distance according to eyes
Calculation obtains the distance of human eye and screen；Distance prompt module 613 is used to confirming the distance of face and screen not preset preferred
In the range of viewing distance, prompt message is sent.
Also include the instruction sending module 602 of direction determination unit 601 and first in processor 600；
After direction determination unit 601 is used to determining that the coordinate at eyes midpoint to fall outside default target area in the picture, root
According to the coordinate position in the picture at eyes midpoint, the direction of rotation for tracking human eye is judged.
When the size of the screen of bore hole 3D equipment is larger, or center line is not fallen within when in target area, direction determining
Unit 601 includes benchmark presetting module and direction determining module.
Left datum target region and right datum target region that benchmark presetting module is used in pre-set image.
Direction determining module be used for when the coordinate at eyes midpoint fall into left datum target region and right datum target region it
Between 3D left figures vision area or 3D right figure vision areas when, if the coordinate at eyes midpoint is near adjacent left side target area, rotation side
To for counterclockwise；If, near adjacent right side target area, direction of rotation is for clockwise for the coordinate at eyes midpoint；
When the coordinate at eyes midpoint falls into the left side in left datum target region, then direction of rotation is for counterclockwise；The seat at eyes midpoint
Village enters the right side in right datum target region, then direction of rotation is for clockwise.
And when the center line of image falls in target area, direction determination unit can also be with the center line of image as base
Standard judges direction of rotation：If in the 3D left figures vision area that the coordinate at eyes midpoint is fallen on the left of picture centre line or 3D right figure vision areas,
Then direction of rotation is for clockwise；If 3D left figures vision area or 3D right figures that the coordinate at eyes midpoint is fallen on the right side of picture centre line
In vision area, then direction of rotation is for counterclockwise.
Above-described clockwise and counterclockwise is the direction in the plane of rotary shaft, such as accompanying drawing 7
Shown in P directions with vertical direction to be rotary shaft Rotation screen in the present embodiment counterclockwise and Q directions are clockwise,
Certainly, possible screen can be inclined when watching video, and rotary shaft can also be in vertical direction with certain angle.
First instruction sending module 602 is used to for the first rotation instruction comprising direction of rotation to be sent to whirligig, one
As the first instruction sending module can be the wireless communication module such as wifi communication modules, bluetooth communication, or it is wired
Communication module.
Whirligig 700 receive the first rotation instruction after by bore hole 3D equipment and camera 500 to direction of rotation extremely
It is few once to rotate default first anglec of rotation, untill the coordinate at eyes midpoint is fallen into target area.Bore hole 3D is set
After standby first anglec of rotation to direction of rotation rotation, whirligig 700 sends instructions to the CPU of bore hole 3D equipment, so as to control
The coordinate at eyes midpoint in the image of the acquisition user of camera 500, whether point coordinates is in image in the determination eyes of processor 600
In target area, in this way, then terminate tracking, if not being, by the first instruction sending module 602 by comprising direction of rotation first
Rotation instruction is sent to whirligig 700, then whirligig 700 can continue to rotate default first anglec of rotation to direction of rotation
Degree, then the image of user is obtained by camera 500, and the coordinate at eyes midpoint is obtained by controller, determine eyes midpoint
Coordinate fall outside default target area in the picture, then again send rotation instruction to whirligig 700, until in making eyes
The coordinate of point is fallen into target area.
In the present embodiment, whirligig 700 includes fixed support 701, the controller 703 of motor turntable 702/ and communication
Module 704, bore hole 3D equipment is fixed on fixed support 701, and controller 703 is arranged on motor turntable 702, line communication mould
Block 704 receives the rotation comprising direction of rotation and instructs to controller 703.Communication module 704 can be wifi communication modules, bluetooth
Communication module etc..Certain communication module 704 can also be replaced using wired communication interface and data wire.Controller 703 can be with
Using control chips such as PLC chips, drive motor turntable 702 rotates second anglec of rotation, makes eyes midpoint to direction of rotation
Coordinate fall into target area.
When the left side of the target area where eyes midpoint is 3D left figure vision areas, device also includes video Transpose module, adjusts
The left-eye video and right eye video of bore hole 3D device plays are changed, to cause that 3D left figures vision area and 3D right figure vision areas are exchanged, video
Transpose module is processed by the CPU of bore hole 3D device interiors and realized.
Embodiment three
The structured flowchart of the tracing of human eye device of a kind of bore hole 3D equipment that Figure 11 is provided for the present invention, only by embodiment two
In the first instruction sending module 602 replace with the instruction sending module 621 of angle calculation module 620 and second.
Angle calculation module 620 is used for the coordinate according to eyes midpoint, calculates bore hole 3D equipment and is rotated to direction of rotation
Reach second anglec of rotation required in target area.Specifically calculate the step 303 seen in embodiment one.
Second instruction sending module 621 is used for comprising the second of direction of rotation and second anglec of rotation the rotation instruction hair
Give whirligig.
Whirligig 700 is received bore hole 3D equipment and camera after the second rotation instruction to direction of rotation rotation the
Communication module 704 receives the rotation comprising direction of rotation and second anglec of rotation in the present embodiment in two anglec of rotation embodiments two
Turn instruction to controller 703, the drive motor turntable 702 of controller 703 rotates second anglec of rotation, makes eyes to direction of rotation
The coordinate at midpoint is fallen into target area.
Quick in order to rotate tracking, generally rotating bore hole 3D equipment according to direction of rotation falls into the coordinate at eyes midpoint
In the neighbouring target area of 3D left figures vision area or 3D right figure vision areas side that it is currently located, when the coordinate at eyes midpoint is excessively inclined
To image avris when, it would however also be possible to employ second anglec of rotation of wide-angle, the coordinate at eyes midpoint is fallen into apart from current institute
3D left figures vision area or 3D right figures vision area target area farther out, screen is quickly returned just to the position of face.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, under the premise without departing from the principles of the invention, some improvements and modifications can also be made, these improvements and modifications also should
It is considered as protection scope of the present invention.
Claims (7)
1. a kind of tracing of human eye method of bore hole 3D equipment, it is characterised in that comprise the following steps:
The facial image in the image of user is obtained, the coordinate at eyes midpoint in the facial image is obtained；
Determine that the coordinate at the eyes midpoint falls outside preset target area in described image, the target area is arranged at institute
State in image between default 3D left figures vision area and 3D right figure vision areas, the target area is a pixel line；
The bore hole 3D equipment is rotated, the coordinate at eyes midpoint is fallen into the target area, specifically included：
The position of coordinate according to the eyes midpoint in described image, judges the direction of rotation for tracking human eye；
The bore hole 3D equipment is rotated into default first anglec of rotation at least one times to the direction of rotation, until eyes midpoint
Coordinate fall into the target area untill；Or according to the coordinate at the eyes midpoint, draw the bore hole 3D equipment to
The direction of rotation rotates to required second anglec of rotation up in target area, by the bore hole 3D equipment to the rotation side
To rotation second anglec of rotation.
2. the method for claim 1, it is characterised in that the coordinate according to the eyes midpoint is in described image
Position, judge the direction of rotation for tracking human eye, specifically include：
Left datum target region and right datum target region in default described image, the left datum target region and right benchmark
Target area is in the target area；
When the 3D left figures that the coordinate at the eyes midpoint is fallen between the left datum target region and right datum target region are regarded
When area or 3D right figure vision areas, if the coordinate at the eyes midpoint is near the target area of adjacent left-hand, the direction of rotation is
Counterclockwise；If the coordinate at the eyes midpoint is near the target area of adjacent right side, the direction of rotation is up time
Pin direction；When the coordinate at the eyes midpoint falls into the left side in the left datum target region, then the direction of rotation is the inverse time
Pin direction；When the coordinate at the eyes midpoint falls into the right side in the right datum target region, then the direction of rotation is up time
Pin direction.
3. the method for claim 1, it is characterised in that the coordinate according to the eyes midpoint is in described image
Position, judge the direction of rotation for tracking human eye, specifically include：
When the center line of described image falls in target area, if the coordinate at the eyes midpoint falls into described image center line
In the 3D left figures vision area or 3D right figure vision areas in left side, then the direction of rotation is for clockwise；If the seat at the eyes midpoint
Village enters in 3D left figures vision area or 3D right figure vision areas on the right side of described image center line, then the direction of rotation is square counterclockwise
To.
4. the method for claim 1, it is characterised in that the rotation bore hole 3D equipment, makes the seat at eyes midpoint
After village enters in the target area, also include：
When the left side of the target area where the eyes midpoint is 3D left figure vision areas, a left side for the bore hole 3D device plays is exchanged
Eye video and right eye video.
5. the method for claim 1, it is characterised in that obtain after the facial image in the image of user, also include：
Obtain the distance of the eyes in the facial image；
Distance according to the eyes is calculated the distance of human eye and screen；
The distance of confirmation face and screen sends prompt message not in the range of preset preferred viewing distance.
6. a kind of tracing of human eye device of bore hole 3D equipment, it is characterised in that including camera, processor and whirligig,
Wherein camera is arranged in the bore hole 3D equipment or is fixed on the whirligig, and the bore hole 3D equipment is fixed on institute
State on whirligig；
The camera is used to obtain the facial image of user；
The processor is used to obtain the coordinate at eyes midpoint in the facial image, determines that the coordinate at the eyes midpoint falls
In described image outside default target area, rotation instruction is sent to the whirligig, the target area is arranged at described
In image between default 3D left figures vision area and 3D right figure vision areas, the target area is a pixel line；
The whirligig is used to drive the bore hole 3D equipment and the camera to rotate after receiving the rotation instruction, makes
The coordinate at eyes midpoint is fallen into the target area；
The processor includes direction determining module and the first instruction sending module；Or including direction determining module, angle
Degree computing module and the second instruction sending module；
Wherein, the direction determining module is used to determine that the coordinate at the eyes midpoint falls the default target area in described image
After overseas, the position of coordinate according to the eyes midpoint in described image judges the direction of rotation for tracking human eye；Institute
The first instruction sending module is stated for the whirligig will to be sent to comprising the first of the direction of rotation the rotation instruction；
The whirligig is received the bore hole 3D equipment and the camera after first rotation is instructed to described
Direction of rotation rotates default first anglec of rotation at least one times, until the coordinate at eyes midpoint is fallen into the target area being
Only；
The angle calculation module is used for the coordinate according to the eyes midpoint, calculates the bore hole 3D equipment to the rotation
Direction rotates to required second anglec of rotation up in target area；
Second instruction sending module is used for comprising the second of the direction of rotation and second anglec of rotation the rotation
Instruction is sent to the whirligig；
The whirligig is received the bore hole 3D equipment and the camera after second rotation is instructed to described
Direction of rotation rotates second anglec of rotation.
7. device as claimed in claim 6, it is characterised in that also include eye distance acquisition module, distance meter in the processor
Calculate module and distance prompt module：
The eye distance acquisition module is used to obtain the distance of the eyes in the facial image；
The distance calculation module is used to be calculated according to the distance of the eyes distance of human eye and screen；
The distance prompt module is sent out for confirming the distance of face and screen not in the range of preset preferred viewing distance
Go out prompt message.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510090654.2A CN104683786B (en) | 2015-02-28 | 2015-02-28 | The tracing of human eye method and device of bore hole 3D equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510090654.2A CN104683786B (en) | 2015-02-28 | 2015-02-28 | The tracing of human eye method and device of bore hole 3D equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104683786A CN104683786A (en) | 2015-06-03 |
| CN104683786B true CN104683786B (en) | 2017-06-16 |
Family
ID=53318275
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510090654.2A Active CN104683786B (en) | 2015-02-28 | 2015-02-28 | The tracing of human eye method and device of bore hole 3D equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104683786B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105072431A (en) * | 2015-07-28 | 2015-11-18 | 上海玮舟微电子科技有限公司 | Glasses-free 3D playing method and glasses-free 3D playing system based on human eye tracking |
| CN104994373A (en) | 2015-07-31 | 2015-10-21 | 京东方科技集团股份有限公司 | Three-dimensional display device and three-dimensional display method |
| CN105787980B (en) * | 2016-03-17 | 2018-12-25 | 北京牡丹视源电子有限责任公司 | A kind of detection virtual reality shows the method and system of equipment field angle |
| CN108616736A (en) * | 2016-12-29 | 2018-10-02 | 深圳超多维科技有限公司 | Method for tracking and positioning and device for stereoscopic display |
| CN107833263A (en) * | 2017-11-01 | 2018-03-23 | 宁波视睿迪光电有限公司 | Feature tracking method and device |
| CN107908285B (en) * | 2017-11-13 | 2021-09-14 | 联想(北京)有限公司 | Data processing method, device and system |
| CN108881880A (en) * | 2018-08-01 | 2018-11-23 | 上海玮舟微电子科技有限公司 | Naked eye 3D display method, apparatus, equipment and storage medium based on tracing of human eye |
| CN109040736B (en) * | 2018-08-08 | 2020-11-03 | 张家港康得新光电材料有限公司 | Method, device, equipment and storage medium for calibrating spatial position of human eye |
| CN110807729B (en) * | 2019-10-30 | 2023-06-23 | 口碑(上海)信息技术有限公司 | Image data processing method and device |
| CN111968104B (en) * | 2020-08-27 | 2023-04-07 | 中冶赛迪信息技术(重庆)有限公司 | Machine vision-based steel coil abnormity identification method, system, equipment and medium |
| CN112540649B (en) * | 2020-12-11 | 2024-02-20 | 深圳市创智成科技股份有限公司 | Rotation control method of display screen and notebook computer |
| CN112804504B (en) * | 2020-12-31 | 2022-10-04 | 成都极米科技股份有限公司 | Image quality adjusting method, image quality adjusting device, projector and computer readable storage medium |
| TWI796856B (en) * | 2021-12-02 | 2023-03-21 | 宏碁股份有限公司 | Method for mitigating 3d crosstalk and 3d display |
| CN115035825A (en) * | 2022-05-31 | 2022-09-09 | 中国第一汽车股份有限公司 | Device for displaying naked eye 3D image, method, equipment and medium for displaying 3D pattern |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19737449A1 (en) * | 1997-08-22 | 1999-02-25 | Hertz Inst Heinrich | Viewer-tracking autostereoscopic flat screen display |
| KR101112735B1 (en) * | 2005-04-08 | 2012-03-13 | 삼성전자주식회사 | 3D display apparatus using hybrid tracking system |
| CN102033549B (en) * | 2009-09-30 | 2014-02-05 | 三星电子（中国）研发中心 | Viewing angle adjusting device of display device |
| CN102681654B (en) * | 2011-03-18 | 2016-06-29 | 深圳富泰宏精密工业有限公司 | 3D visual perspective automatic adjustment system and method |
| WO2012144039A1 (en) * | 2011-04-20 | 2012-10-26 | 株式会社東芝 | Image processing device and image processing method |
| KR102019125B1 (en) * | 2013-03-18 | 2019-09-06 | 엘지전자 주식회사 | 3D display device apparatus and controlling method thereof |
| CN104144337B (en) * | 2014-08-05 | 2016-07-06 | 深圳市华星光电技术有限公司 | The method for displaying image of a kind of multi-viewpoint three-dimensional display and device |
-
2015
- 2015-02-28 CN CN201510090654.2A patent/CN104683786B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN104683786A (en) | 2015-06-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104683786B (en) | The tracing of human eye method and device of bore hole 3D equipment | |
| US10375381B2 (en) | Omnistereo capture and render of panoramic virtual reality content | |
| KR101991080B1 (en) | Omni-stereo capture and rendering of panoramic virtual reality content | |
| KR102023587B1 (en) | Camera Rig and Stereoscopic Image Capture | |
| CN102098524B (en) | Tracking type stereo display device and method | |
| CN107885325A (en) | A kind of bore hole 3D display method and control system based on tracing of human eye | |
| CA2938159C (en) | Omnistereo imaging | |
| US8817369B2 (en) | Three dimensional display device and method of controlling parallax barrier | |
| JP6658529B2 (en) | Display device, display device driving method, and electronic device | |
| CN108174182A (en) | Three-dimensional tracking mode bore hole stereoscopic display vision area method of adjustment and display system | |
| US20170078651A1 (en) | Stereo rendering system | |
| JP2008227865A (en) | Head-mounted imaging/displaying device and image generating device | |
| US10631008B2 (en) | Multi-camera image coding | |
| CN105892063B (en) | The display methods and device of plug-in screen device, outer hanging panel Formula V R glasses and screen | |
| KR101046259B1 (en) | Stereoscopic image display apparatus according to eye position | |
| CN105263011B (en) | Multi-view image shows equipment and its multi-view image display methods | |
| US10802390B2 (en) | Spherical omnipolar imaging | |
| KR101670328B1 (en) | The appratus and method of immersive media display and image control recognition using real-time image acquisition cameras | |
| WO2016067729A1 (en) | Image generation device, image generation method and calibration method | |
| JP6649010B2 (en) | Information processing device | |
| CN101547373A (en) | Method for avoiding blind zones in optical grating three-dimensional display screen | |
| CA3086502A1 (en) | System and method for corrected video-see-through for head mounted displays | |
| JP5767720B2 (en) | Head-mounted display device, virtual image generation device, system having the same, and control method | |
| KR20130070303A (en) | Rendering method and apparatus for multi-view autostereoscopic 3d image display | |
| CN104717488B (en) | Show equipment and display methods |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200403 Address after: 215634 north side of Chengang road and west side of Ganghua Road, Jiangsu environmental protection new material industrial park, Zhangjiagang City, Suzhou City, Jiangsu Province Patentee after: ZHANGJIAGANG KANGDE XIN OPTRONICS MATERIAL Co.,Ltd. Address before: 201203. Room 5, building 690, No. 202 blue wave road, Zhangjiang hi tech park, Shanghai Patentee before: WZ TECHNOLOGY Inc. |