CN109960401A - A kind of trend projecting method, device and its system based on face tracking - Google Patents
A kind of trend projecting method, device and its system based on face tracking Download PDFInfo
- Publication number
- CN109960401A CN109960401A CN201711435378.4A CN201711435378A CN109960401A CN 109960401 A CN109960401 A CN 109960401A CN 201711435378 A CN201711435378 A CN 201711435378A CN 109960401 A CN109960401 A CN 109960401A
- Authority
- CN
- China
- Prior art keywords
- angle
- projection
- face
- trend
- projection arrangement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 230000001815 facial effect Effects 0.000 claims abstract description 18
- 230000008859 change Effects 0.000 claims abstract description 15
- 230000003287 optical effect Effects 0.000 claims description 20
- 230000015654 memory Effects 0.000 claims description 18
- 238000012937 correction Methods 0.000 claims description 14
- 238000004422 calculation algorithm Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 208000036829 Device dislocation Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 230000002040 relaxant effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The present embodiments relate to projection display technique fields, more particularly to a kind of trend projecting method, device and its system based on face tracking.Wherein, which comprises acquisition facial image and the position for determining face；According to the position of face, the angle in Image Acquisition direction is calculated；According to the angle in the described image acquisition direction being calculated, the angle in adjustment described image acquisition direction；Orientation angle is acquired according to adjustment described image, calculates the projection angle that projection arrangement needs to change；According to the projection angle for the projection arrangement being calculated, the projection angle is adjusted；It is projected according to the projection angle adjusted, project content is made to be shown in the right opposite of face.By the above method, the change of the face location of the user moved according to tracking, can adjust projection angle in real time and make to be tracked user always has the visual enjoyment of general perspective picture, enhances the viewing experience of user.
Description
Technical field
The present embodiments relate to projection display technique fields, project more particularly to a kind of trend based on face tracking
Method, apparatus and its system.
Background technique
With the development of science and technology with the continuous improvement of living standards of the people, people get over the requirement in terms of visual experience
Come higher, on the one hand, requirement of the people to the display device of man-machine interface is increasingly towards miniature, large-size screen monitors and high-resolution side
To development；On the other hand, in display effect, people tend to pursue augmented reality, visual enjoyment on the spot in person again.Mesh
Before, interaction technology just progresses into daily life, and is gradually developing to the direction of tracking user intent.
Applicant has found that existing interaction technology lacks flexibility in the implementation of the present invention, can't
So preferable that be projected according to user's trend, user experience is bad.
Summary of the invention
In view of this, the trend projecting method that the main purpose of the present invention is to provide a kind of based on face tracking and its being
System, to solve the problems, such as that projection arrangement can not be followed by the movement of face and move and project in the prior art.
In order to solve the above technical problems, the embodiment of the invention discloses following technical solutions:
In a first aspect, the embodiment of the invention provides a kind of trend projecting method based on face tracking, the method packet
It includes:
It acquires facial image and determines the position of face；
According to the position of face, the angle in Image Acquisition direction is calculated；
According to the angle in the described image acquisition direction being calculated, the angle in adjustment described image acquisition direction；
Orientation angle is acquired according to adjustment described image, calculates the projection angle that projection arrangement needs to change；
According to the projection angle for the projection arrangement being calculated, the projection angle is adjusted；
It is projected according to the projection angle adjusted, project content is made to be shown in the right opposite of face.
Optionally, the position of the acquisition facial image and determining face includes: by image acquisition device face
Image, user's face detection algorithm detect face and determine position of the face in present frame relative to image collecting device.
Optionally, the angle for calculating Image Acquisition direction includes:
Calculate level angle and vertical angles；
Vertical angles, the vertical angles are folder of the face location relative to described image acquisition device in the vertical direction
Angle；
Level angle, the level angle are folder of the face location relative to described image acquisition device in the horizontal direction
Angle.
Optionally, the calculating projection angle includes:
When image collecting device moved horizontally any angle be when, then projection arrangement also moves horizontally identical angle.
Optionally, when image collecting device vertical shift any angle, then projection arrangement needs the angle of vertical shift
Degree includes:
By calculating face at a distance from image collecting device vertical direction, rotating projection arrangement and calculating projection in real time
The actual range of device and projection plane, when the angle of rotation makes the actual range and projection arrangement of projection arrangement and projection plane
To when being equidistant of projection plane of face right opposite, then the angle of the rotation is that projection arrangement needs project
Direction.
Second aspect, the embodiment of the invention provides a kind of trend projection arrangement based on face tracking, the method packet
It includes, described device includes:
Image acquisition units, for acquiring the position of facial image and determining face；
First calculates analytical unit, for the position according to face, calculates the angle in Image Acquisition direction；
First direction control unit adjusts the figure for the angle according to the described image acquisition direction being calculated
As the angle in acquisition direction；
Second calculates analytical unit, for acquiring orientation angle according to adjustment described image, calculates projection arrangement needs and changes
The projection angle of change；
Second direction control unit adjusts the throwing for the projection angle according to the projection arrangement being calculated
Shadow angle；
Projection display unit makes project content be shown in people for being projected according to the projection angle adjusted
The right opposite of face.
Optionally, described device further include: triggering start unit, the triggering start unit is for starting standby mode
Trend projection arrangement.
Optionally, the triggering start unit can be with are as follows:
Remote control module, for by the portable mini button device of user's control, the trend for starting standby mode to be thrown
Image device；And/or
Voice module, for starting the trend projection arrangement of standby mode according to corresponding phonetic order；And/or
Action recognition module, the body languages triggering such as gesture for receiving image acquisition units acquisition, starts standby shape
The trend projection arrangement of state.
Optionally, described device further include: photography correction unit is carried out for covering acquired projections picture area image
Projected picture correction.
The third aspect, the embodiment of the invention provides a kind of trend optical projection systems, comprising:
Trend projection arrangement as described above,
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
A processor executes, so that at least one described processor is able to carry out method as described above.
Fourth aspect, the embodiment of the invention provides a kind of non-volatile computer readable storage medium storing program for executing, the computers
Readable storage medium storing program for executing is stored with computer executable instructions, and the computer executable instructions are for enabling trend projection arrangement
Execute method as described above.
The beneficial effect of embodiment of the present invention is: being in contrast to the prior art, the invention discloses one kind to be based on
Trend projecting method, device and its system of face tracking are being moved according to the method, apparatus and system by tracking
User face location change, can adjust projection angle in real time and make to be tracked user always has the view of general perspective picture
Feel and enjoy, enhances the viewing experience of user.
Detailed description of the invention
One or more embodiments are illustrated by the picture in corresponding attached drawing, these exemplary theorys
The bright restriction not constituted to embodiment, the element in attached drawing with same reference numbers label are expressed as similar element, remove
Non- to have special statement, composition does not limit the figure in attached drawing.
Fig. 1 is a kind of flow diagram of trend projecting method based on face tracking provided in an embodiment of the present invention；
Fig. 2 is a kind of floor map of angle for calculating Image Acquisition direction provided in an embodiment of the present invention；
Fig. 3 is a kind of stereoscopic schematic diagram of angle for calculating Image Acquisition direction provided in an embodiment of the present invention；
Fig. 4, Fig. 5, Fig. 6 are provided in an embodiment of the present invention respectively under three kinds of different situations, calculate projection arrangement and need
The method schematic diagram of the projection angle of change；
Fig. 7 is the plan view for the center location that a kind of image collecting device provided in an embodiment of the present invention is got；
Fig. 8 is a kind of structural schematic diagram of trend projection arrangement based on face tracking provided in an embodiment of the present invention；
Fig. 9 is a kind of structural schematic diagram of triggering start unit based on face tracking provided in an embodiment of the present invention；
Figure 10 is a kind of structural schematic diagram of trend optical projection system provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
In addition, as long as technical characteristic involved in the various embodiments of the present invention described below is each other not
Constituting conflict can be combined with each other.
The embodiment of the present invention is a kind of embodiment of trend projecting method provided by the invention.If Fig. 2 is that the present invention is implemented
A kind of flow diagram for trend projecting method that example provides.A kind of trend projecting method of the embodiment of the present invention can be by Fig. 8 institute
The trend projection arrangement 10 shown executes.
Referring to Fig.1, which comprises
101: acquisition facial image and the position for determining face；
In embodiments of the present invention, it when using image acquisition device facial image, is adopted by image collecting device
Collect facial image, user's face detection algorithm detects face and determines position of the face in present frame relative to image collecting device
It sets.Wherein, described image acquisition device includes: the Image Acquisition and three bit depth distance measurement functions of conventional two-dimension human face.It is described
Image collecting device can be binocular camera, or the infrared camera equipped with optional infrared eyeglass.
102: according to the position of face, calculating the angle in Image Acquisition direction；
In embodiments of the present invention, the angle for calculating Image Acquisition direction includes: to calculate hanging down for Image Acquisition direction
Straight deviation angle and offset of vertical angle；Wherein, the offset of vertical angle is that face location is acquired relative to described image
The angle that device deviates in the vertical direction；The horizontal-shift angle is that face location exists relative to described image acquisition device
The angle deviated in horizontal direction.
103: according to the angle in the described image acquisition direction being calculated, the angle in adjustment described image acquisition direction；
In embodiments of the present invention, the calculated result that the angle in direction is acquired according to described image, adjusts Image Acquisition side
To angle, target face is made to be always positioned at the center of subsequent acquired image.
104: orientation angle being acquired according to adjustment described image, calculates the projection angle that projection arrangement needs to change；
In embodiments of the present invention, face is obtained apart from institute by being installed on the depth camera of described image acquisition device
State the distance of image collecting device, and using measuring device measure the fixation of the projection arrangement and described image acquisition device away from
From.When described image acquisition device moves certain angle along horizontal direction, then projection arrangement needs the angle moved horizontally
It spends identical as the angle that described image acquisition device moves in the horizontal direction；When image collecting device moves along vertical direction
When certain angle, then the projection arrangement is needed according to the positional relationship of face and described image acquisition device along vertical
The mobile different angle in direction.
105: according to the projection angle for the projection arrangement being calculated, adjusting the projection angle；
In embodiments of the present invention, the projection arrangement changes with Image Acquisition orientation angle method particularly includes: described
The horizontal sextant angle of the initial position of projection arrangement and image collecting device is 180 degree, according to the projection arrangement being calculated
Projection angle, by adjusting the angle of the projection arrangement, so that the position after the two final adjustment remains 180 degree
Relative position.
106: being projected according to the projection angle adjusted, project content is made to be shown in the right opposite of face.
In embodiments of the present invention, it is projected according to the projection angle adjusted, project content is made to be shown in people
The right opposite of face is adjusted the angle when camera detection is to face so that face is in the center of image.
The beneficial effect of the embodiment of the present invention is: being in contrast to the prior art, the invention discloses one kind to be based on people
The trend projecting method of face tracking, according to the method, the change of the face location by tracking the user moved can be real
When adjustment projection angle make to be tracked user always and have the visual enjoyment of general perspective picture, enhance the comfortable of user's viewing
Sense.
Fig. 2 is a kind of floor map of angle for calculating Image Acquisition direction provided in an embodiment of the present invention；Fig. 3 is this
A kind of stereoscopic schematic diagram of the angle in calculating Image Acquisition direction that inventive embodiments provide.
In embodiments of the present invention, user's face detection algorithm detects face first, and the Face datection algorithm includes: institute
After stating image collecting device reception facial image, facial feature localization is carried out to the human face region in image, determines face in present frame
Position；As shown in Figures 2 and 3, C point for face in present frame position in the picture, A point be the center for acquiring image
Point, O are the position where image collecting device camera, and the angle for calculating Image Acquisition direction includes: to calculate OC and OA
It is formed by angle, as shown in Fig. 2, it includes: level angle x_angle_c and vertical angle that the OC and OA, which are formed by angle,
Spend y_angle_c, wherein L2 is distance of the face perpendicular to horizontal plane, d be image collecting device perpendicular to horizontal plane away from
From incorporated by reference to Fig. 3, dx is that the point A that described image acquisition device camera is projected on horizontal plane and the face project to water
The distance between point B in plane, therefore known L2 and dx, can calculate the angle of the x_angle_o and x_angle_c
Degree, can similarly be calculated described image acquisition device in the deflection angle y_angle_c of vertical direction.Therefore, the figure
After analyzing as acquisition device camera facial image collected, positional relationship model as shown in Figure 2 is established, is calculated
Obtain the vertical angle x_angle_c changed needed for described image acquisition device and vertical angles y_angle_c and by face
It is moved to the center of image, using track algorithm, real-time tracking face, and according to the angle of calculating, rotate described image acquisition
Device arrests face conveniently so that target face is in the center of image always to judge user intent to change
The angle of projection arrangement.
Fig. 4, Fig. 5, Fig. 6 are respectively provided in an embodiment of the present invention under three kinds of different situations, calculate projection arrangement and need
The method schematic diagram of the projection angle of change.
In embodiments of the present invention, the projection arrangement changes with Image Acquisition orientation angle method particularly includes: institute
The horizontal sextant angle for stating the initial position of projection arrangement and image collecting device is 180 degree, is filled according to the projection being calculated
The projection angle set, by adjusting the angle of the projection arrangement, so that the position after the two final adjustment remains 180 degree
Relative position, while the angle of projector is adjusted, so that projector is projected in the right opposite of face, it should be noted that be
The sight of adjustment face is not blocked by the projection arrangement, and appropriate adjustment angle is on the upper side or on the lower side or to the left or to the right.
In embodiments of the present invention, the method for calculating projection angle includes:
As shown in Fig. 4, Fig. 5, Fig. 6, the distance of face range image acquisition device is L；Projection arrangement and image collector
The fixed range set is h；The angle that image collecting device moves horizontally is x_ca；Projection arrangement needs the angle that moves horizontally to be
x_pr；The angle of image collecting device vertical shift is y_ca；It is y_pr that projection arrangement, which needs the angle of vertical shift,；Face with
Distance on image collecting device vertical direction is h1；The actual range of projection arrangement and projection plane is L_pr；Projection arrangement
Distance to the projection plane of face right opposite is L_pr_measure；
L is obtained by depth camera, and measures h；
When the angle that image collecting device moves horizontally is x_ca, the angle that the projection arrangement needs to move horizontally is same
Sample is x_ca；Therefore the x_pr is equal with the x_ca.
When the angle of image collecting device vertical shift is y_ca, then the calculation method of y_pr is divided into following three kinds of feelings
Condition:
As shown in figure 4, when face location is located at the lower section of described image acquisition device, by calculating h1=L*sin (y_
Ca the distance for) obtaining h1, the value of L_pr when rotating the projection arrangement and calculating the angle y_pr rotated every time in real time, wherein
The L_pr=(h+h1)/sin (y_pr), when L_pr is equal with L_pr_measure, then the angle y_pr rotated is i.e.
The direction projected is needed for projector.
As shown in figure 5, when face location is located at the top of described image acquisition device, by calculating h1=L*cos (y_
Ca)-h obtains h1, the value of L_pr when rotating projection arrangement and calculating the angle y_pr rotated every time in real time, wherein the L_pr
=h1/sin (y_pr), when L_pr is equal with L_pr_measure, then the angle y_pr rotated is projector's needs
The direction of projection.
As shown in fig. 6, when face location is between described image acquisition device and projection arrangement, by calculating h1=
H-L*cos (y_ca) obtains h1, the value of L_pr when rotating projection arrangement and calculating the angle y_pr rotated every time in real time, wherein
The L_pr=h1/sin (y_pr), when L_pr is equal with L_pr_measure, then the angle y_pr rotated is to throw
Image device needs the direction projected.Wherein, the measurement method of the L_pr_measure is as follows:
Assuming that camera and the central axis of projector are in the same horizontal line, two are projected in same level using projector
The circle of line, as shown below, x1, x2 represent the coordinate position in the center of circle of same horizontal line
The location drawing picture schematic diagram in the center of circle that camera is got is as follows: what image collecting device was got
As shown in fig. 7, the central axis of described image acquisition device and projection arrangement is set in the same horizontal line, using described
Projection device two circles in same horizontal line,
Wherein, if x1, x2 are the coordinate position in two centers of circle of same horizontal line；F is fixed coefficient；D0 be video camera and
The actual range of camera；W is the width of image；What d was indicated is the actual range in two centers of circle detected；Abs indicates absolute
Value；
By abs ((x1+x2)/2-w/2)/d0=abs (x1-x2)/d, d can be calculated；
By L_pr_measure/f=d/abs (x1-x2), L_pr_measure can be calculated,
It should be noted that (x1+x2)/2 represents center of two centers of circle on x-axis line, the w/2 is
Center in X-direction on the image, (the x1+x2)/2-w/2 are the offset distance in X-direction in the picture, institute
It states (x1-x2) and represents the offset distance of reality in the direction of the x axis.
The embodiment of the present invention is a kind of embodiment of the trend optical projection system based on face tracking provided by the invention.Such as figure
8 be a kind of schematic diagram of the trend optical projection system based on face tracking provided in an embodiment of the present invention.
Referring to Fig. 8, described device trend optical projection system 80 includes:
Start unit 801 is triggered, for starting the trend optical projection system of standby mode.
Incorporated by reference to Fig. 9, the triggering start unit 801 includes:
Remote control module 901, for starting the trend of standby mode by the portable mini button device of user's control
Optical projection system；And/or
Voice module 902, for starting the trend optical projection system of standby mode according to corresponding phonetic order；And/or
Action recognition module 903, the body languages triggering such as gesture for receiving image acquisition units acquisition, starts standby
The trend optical projection system of state.
In embodiments of the present invention, user can be by controlling portable mini button device, and corresponding voice refers to
Order and limbs voice, start the trend optical projection system 80 of standby mode, wherein the trend optical projection system is equipped with central processing
Module, the central processing module connect and control each unit in the trend optical projection system, by triggering start unit
801 can star the starting that the central processing module controls the trend optical projection system 80.
Image acquisition units 802, for acquiring the position of facial image and determining face；
In embodiments of the present invention, described image acquisition unit 802 acquires facial image and user's face detection algorithm, inspection
It surveys face and determines position of the face in present frame relative to image acquisition units 802.
First calculates analytical unit 803, for the position according to face, calculates the angle in Image Acquisition direction；
In embodiments of the present invention, described image acquisition unit 802 acquires facial image and determines face in present frame phase
Behind the position of image acquisition units 802, is analyzed by the first calculating analytical unit 803 and calculate face relative to institute
State angle of the image acquisition units 802 in the vertical direction and in horizontal direction.
First direction control unit 804, for the angle according to the described image acquisition direction being calculated, described in adjustment
The angle in Image Acquisition direction；
In embodiments of the present invention, the first direction control unit 804 calculates analytical unit 803 by described first and counts
Angle of the face of calculating relative to described image acquisition unit 802 in the vertical direction and in horizontal direction adjusts image
Acquisition unit 802, and the face is made to be always positioned at the center of subsequent acquired image.
Second calculates analytical unit 805, for acquiring orientation angle according to adjustment described image, calculates projection arrangement and needs
The projection angle of change；
In embodiments of the present invention, by be installed on described image acquisition unit 802 depth camera obtain face away from
With a distance from described image acquisition unit 802, and the fixed range of the projection arrangement and described image acquisition unit 802.When
When described image acquisition unit 802 moves certain angle along horizontal direction, then projection arrangement needs the angle moved horizontally
It is identical as the angle that described image acquisition unit 802 moves in the horizontal direction；When image acquisition units 802 along vertical direction
When moving certain angle, then the projection arrangement is according to the positional relationship needs of face and described image acquisition unit 802
Mobile different angle along vertical direction.
Second direction control unit 806, for according to the projection angle of the projection arrangement being calculated, described in adjustment
Projection angle
In embodiments of the present invention, by the projection arrangement, according to the depth for being installed on described image acquisition unit 802
Camera obtains distance of the face apart from described image acquisition unit 802, and using measuring device measure the projection arrangement with
The fixed range of described image acquisition unit 802.When described image acquisition unit 802 moves certain angle along horizontal direction
When, then projection arrangement needs the angle that moves horizontally to move in the horizontal direction with described image acquisition unit 802 angle phase
Together；When image acquisition units 802 move certain angle along vertical direction, then the projection arrangement is according to face and institute
State the mobile different angle of the positional relationship needs of image acquisition units 802 along vertical direction.
Projection display unit 807, for showing project content.
In embodiments of the present invention, the projection display unit 807 is adjusted according to the second direction control unit 806
Projection angle projects project content to the right opposite of the face.
Photography correction unit 808 carries out projected picture correction for covering acquired projections picture area image.
In embodiments of the present invention, the photography correction unit 808 is when the projection display unit 807 projects, covering
Acquired projections picture area image carries out projected picture correction；Wherein the photography correction unit 808 is corrected including trapezoidal projection
(not shown) and projection brightness correct (not shown), the trapezoidal projection correction and projection brightness correction difference
The correction of shape and brightness is carried out for the project content to the projection arrangement.
In embodiments of the present invention, the triggering start unit 801 starts described image acquisition unit 802, described image
The face information that acquisition unit 802 is acquired facial image and determines, described first calculates analytical unit 803 according to described
The face information that image acquisition units 802 acquire calculates the angle in Image Acquisition direction, the first direction control unit 804
Calculate that analytical unit 803 calculates as a result, adjusting the angle in Image Acquisition direction according to described first, described second calculates analysis
The projection angle of the change according to needed for the angle calculation projection arrangement that described image acquires direction of unit 805, the second direction
The projection angle that control unit 806 is calculated according to the second calculating analytical unit 805, adjusts the projected angle
Degree, the project content for projecting the projection display unit 807 are always positioned at the right opposite of the face, and the projection is aobvious
Show unit 807 in projection, the photography correction unit 808 covers acquired projections picture area image, carries out projected picture school
Just.
It should be noted that in embodiments of the present invention, institute of the embodiment of the present invention can be performed in the trend projection arrangement 80
The trend projecting method of offer has the corresponding functional module of execution method and beneficial effect.Not in trend projection arrangement 80
The technical detail of detailed description in embodiment, reference can be made to trend projecting method provided by the embodiment of the present invention.
The beneficial effect of embodiment of the present invention is: being in contrast to the prior art, the invention discloses one kind to be based on
The trend optical projection system of face tracking, according to the system, the change of the face location by tracking the user moved can
Adjustment projection angle, which makes to be tracked user always, in real time the visual enjoyment of general perspective picture, enhances relaxing for user's viewing
Suitable sense.
Figure 10 is trend projection system architecture schematic diagram provided in an embodiment of the present invention, as shown in Figure 10, trend projection
System 100 includes:
One or more processors 1001 and memory 1002, in Figure 10 by taking a processor 1001 as an example.
Processor 1001 can be connected with memory 1002 by bus or other modes, to pass through bus in Figure 100 1
For connection.
Memory 1002 is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile software journey
Sequence, non-volatile computer executable program and module, such as the corresponding program of trend projecting method in the embodiment of the present invention
Instruction/unit is (for example, attached triggering start unit 801 shown in Fig. 8, image acquisition units 802, first calculate analytical unit
803, first direction control unit 804, second calculates analytical unit 805, second direction control unit 806, projection display unit
807, photography correction unit 808).Processor 1001 by operation be stored in memory 1002 non-volatile software program,
Instruction and unit, thereby executing the various function application and data processing of trend optical projection system, i.e. realization the method is real
Apply the trend projecting method of example.
Memory 1002 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function；Storage data area can store to be used according to trend optical projection system and be created
Data etc..In addition, memory 1002 may include high-speed random access memory, it can also include nonvolatile memory, example
Such as at least one disk memory, flush memory device or other non-volatile solid state memory parts.In some embodiments, it deposits
Optional reservoir 1002 includes the memory remotely located relative to processor 1001, these remote memories can be connected by network
It is connected to trend optical projection system.The embodiment of the network includes but is not limited to internet, intranet, local area network, moves and lead to
Letter net and combinations thereof.
One or more of units are stored in the memory 1002, when by one or more of processors
When 1001 execution, the method for executing trend projection as described above, for example, executing the method and step 101 in Fig. 1 described above
To step 106, the function of the unit 801-808 in Fig. 8 is realized.
Trend projecting method provided by the present invention can be performed in the trend optical projection system, has the corresponding function of execution method
It can module and beneficial effect.The technical detail of detailed description not in trend optical projection system embodiment, reference can be made to the present invention provides
Trend projecting method.
The embodiment of the invention provides a kind of non-volatile computer readable storage medium storing program for executing, the computer-readable storage mediums
Matter is stored with computer executable instructions, which is executed by one or more processors, for example, execute with
Method and step 101 in Fig. 1 of upper description realizes the function of the unit 801-808 in Fig. 8 to step 106.
It should be noted that the apparatus embodiments described above are merely exemplary, wherein described be used as separation unit
The unit that part illustrates may or may not be physically separated, and component shown as a unit can be or can also
Not to be physical unit, it can it is in one place, or may be distributed over multiple network units.It can be according to reality
Need that some or all of the modules therein is selected to achieve the purpose of the solution of this embodiment.
By the description of above embodiment, those of ordinary skill in the art can be understood that each embodiment can borrow
Help software that the mode of general hardware platform is added to realize, naturally it is also possible to pass through hardware.Those of ordinary skill in the art can manage
Solution realize all or part of the process in the embodiment method be can be instructed by computer program relevant hardware come
It completes, the program can be stored in a computer-readable storage medium, and the program is when being executed, it may include such as described each
The process of the embodiment of method.Wherein, the storage medium can be magnetic disk, CD, read-only memory (Read-Only
Memory, ROM) or random access memory (RandomAccessMemory, RAM) etc..
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；At this
It under the thinking of invention, can also be combined between the technical characteristic in above embodiments or different embodiment, step can be with
It is realized with random order, and there are many other variations of different aspect present invention as described above, for simplicity, they do not have
Have and is provided in details；Although the present invention is described in detail referring to the foregoing embodiments, the ordinary skill people of this field
Member is it is understood that it is still possible to modify the technical solutions described in the foregoing embodiments, or to part of skill
Art feature is equivalently replaced；And these are modified or replaceed, each reality of the present invention that it does not separate the essence of the corresponding technical solution
Apply the range of a technical solution.
Claims (11)
1. a kind of trend projecting method based on face tracking, which is characterized in that the described method includes:
It acquires facial image and determines the position of face；
According to the position of face, the angle in Image Acquisition direction is calculated；
According to the angle in the described image acquisition direction being calculated, the angle in adjustment described image acquisition direction；
Orientation angle is acquired according to adjustment described image, calculates the projection angle that projection arrangement needs to change；
According to the projection angle for the projection arrangement being calculated, the projection angle is adjusted；
It is projected according to the projection angle adjusted, project content is made to be shown in the right opposite of face.
2. trend projecting method according to claim 1, which is characterized in that the acquisition facial image simultaneously determines face
Position includes: to detect face by image acquisition device facial image, user's face detection algorithm and determine that face is being worked as
Position of the previous frame relative to image collecting device.
3. trend projecting method according to claim 1, which is characterized in that the angle packet for calculating Image Acquisition direction
It includes:
Calculate level angle and vertical angles；
Vertical angles, the vertical angles are angle of the face location relative to described image acquisition device in the vertical direction；
Level angle, the level angle are angle of the face location relative to described image acquisition device in the horizontal direction.
4. trend projecting method according to claim 1, which is characterized in that the calculating projection angle includes:
When image collecting device has moved horizontally any angle, then the projection arrangement also moves horizontally identical angle.
5. trend projecting method according to claim 4, which is characterized in that further include:
When image collecting device vertical shift any angle, then the projection arrangement needs the angle of vertical shift to include:
By calculate face and described image acquisition device in the vertical direction at a distance from, rotation projection arrangement simultaneously calculates institute in real time
The actual range for stating projection arrangement and projection plane, when the angle of rotation makes the actual range of the projection arrangement and projection plane
With when being equidistant of projection plane of the projection arrangement to face right opposite, then the angle of the rotation is described
Projection arrangement needs the angle projected.
6. a kind of trend projection arrangement based on face tracking, which is characterized in that described device includes:
Image acquisition units, for acquiring the position of facial image and determining face；
First calculates analytical unit, for the position according to face, calculates the angle in Image Acquisition direction；
First direction control unit, for the angle according to the described image acquisition direction being calculated, adjustment described image is adopted
Collect the angle in direction；
Second calculates analytical unit, for acquiring orientation angle according to adjustment described image, calculates what projection arrangement needed to change
Projection angle；
Second direction control unit adjusts the projected angle for the projection angle according to the projection arrangement being calculated
Degree；
Projection display unit makes project content be shown in face for being projected according to the projection angle adjusted
Right opposite.
7. trend projection arrangement according to claim 6, which is characterized in that described device further include: triggering start unit,
The triggering start unit is used to start the trend projection arrangement of standby mode.
8. trend projection arrangement according to claim 7, which is characterized in that the triggering start unit includes:
Remote control module, for starting the trend projection dress of standby mode by the portable mini button device of user's control
It sets；And/or
Voice module, for starting the trend projection arrangement of standby mode according to corresponding phonetic order；And/or
Action recognition module, the body languages triggering such as gesture for receiving image acquisition units acquisition, starts standby mode
Trend projection arrangement.
9. trend projection arrangement according to claim 6, which is characterized in that described device further include: photography correction unit,
For covering acquired projections picture area image, projected picture correction is carried out.
10. a kind of trend optical projection system characterized by comprising
The trend projection arrangement as described in claim 6-9,
At least one processor；And
The memory being connect at least one described processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
It manages device to execute, so that at least one described processor is able to carry out described in any item methods of claim 1-5.
11. a kind of non-volatile computer readable storage medium storing program for executing, the computer-readable recording medium storage have computer that can hold
Row instruction, the computer executable instructions are for being able to carry out trend projection arrangement described in any one of claim 1-5
Method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711435378.4A CN109960401B (en) | 2017-12-26 | 2017-12-26 | Dynamic projection method, device and system based on face tracking |
| PCT/CN2018/089628 WO2019128109A1 (en) | 2017-12-26 | 2018-06-01 | Face tracking based dynamic projection method, device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711435378.4A CN109960401B (en) | 2017-12-26 | 2017-12-26 | Dynamic projection method, device and system based on face tracking |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109960401A true CN109960401A (en) | 2019-07-02 |
| CN109960401B CN109960401B (en) | 2020-10-23 |
Family
ID=67022499
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711435378.4A Active CN109960401B (en) | 2017-12-26 | 2017-12-26 | Dynamic projection method, device and system based on face tracking |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN109960401B (en) |
| WO (1) | WO2019128109A1 (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110458617A (en) * | 2019-08-07 | 2019-11-15 | 卓尔智联(武汉)研究院有限公司 | Advertisement placement method, computer installation and readable storage medium storing program for executing |
| CN110897604A (en) * | 2019-12-26 | 2020-03-24 | 深圳市博盛医疗科技有限公司 | Laparoscope system for reducing three-dimensional distortion in 3D vision and use method |
| CN111031298A (en) * | 2019-11-12 | 2020-04-17 | 广景视睿科技（深圳）有限公司 | Method and device for controlling projection of projection module and projection system |
| CN111179694A (en) * | 2019-12-02 | 2020-05-19 | 广东小天才科技有限公司 | Dance teaching interaction method, intelligent sound box and storage medium |
| CN111491146A (en) * | 2020-04-08 | 2020-08-04 | 上海乂学教育科技有限公司 | Interactive projection system for intelligent teaching |
| CN111489594A (en) * | 2020-05-09 | 2020-08-04 | 兰州石化职业技术学院 | Man-machine interaction platform |
| CN114782901A (en) * | 2022-06-21 | 2022-07-22 | 深圳市禾讯数字创意有限公司 | Sand table projection method, device, equipment and medium based on visual change analysis |
| CN115113553A (en) * | 2021-09-03 | 2022-09-27 | 博泰车联网科技(上海)股份有限公司 | Control method, control system and control device for vehicle-mounted video and audio playing |
| CN115494961A (en) * | 2022-11-17 | 2022-12-20 | 南京熊大巨幕智能科技有限公司 | Novel interactive surrounding intelligent display equipment based on face recognition |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111046729A (en) * | 2019-11-05 | 2020-04-21 | 安徽爱学堂教育科技有限公司 | Double-sided screen lifting adjustment system based on face tracking |
| CN111144327B (en) * | 2019-12-28 | 2023-04-07 | 神思电子技术股份有限公司 | Method for improving recognition efficiency of face recognition camera of self-service equipment |
| CN114554031A (en) * | 2022-03-07 | 2022-05-27 | 云知声智能科技股份有限公司 | Method, device, terminal and storage medium for prompting |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307288A (en) * | 2011-07-27 | 2012-01-04 | 中国计量学院 | Projection system moving along with sightline of first person based on human face recognition |
| CN106650665A (en) * | 2016-12-26 | 2017-05-10 | 北京旷视科技有限公司 | Human face tracing method and device |
| CN107065409A (en) * | 2017-06-08 | 2017-08-18 | 广景视睿科技（深圳）有限公司 | Trend projection arrangement and its method of work |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103996215A (en) * | 2013-11-05 | 2014-08-20 | 深圳市云立方信息科技有限公司 | Method and apparatus for realizing conversion from virtual view to three-dimensional view |
| CN107195277A (en) * | 2017-05-15 | 2017-09-22 | 盐城华星光电技术有限公司 | A kind of LCD MODULE（LCM）And its method for displaying image |
-
2017
- 2017-12-26 CN CN201711435378.4A patent/CN109960401B/en active Active
-
2018
- 2018-06-01 WO PCT/CN2018/089628 patent/WO2019128109A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307288A (en) * | 2011-07-27 | 2012-01-04 | 中国计量学院 | Projection system moving along with sightline of first person based on human face recognition |
| CN106650665A (en) * | 2016-12-26 | 2017-05-10 | 北京旷视科技有限公司 | Human face tracing method and device |
| CN107065409A (en) * | 2017-06-08 | 2017-08-18 | 广景视睿科技（深圳）有限公司 | Trend projection arrangement and its method of work |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110458617A (en) * | 2019-08-07 | 2019-11-15 | 卓尔智联(武汉)研究院有限公司 | Advertisement placement method, computer installation and readable storage medium storing program for executing |
| CN110458617B (en) * | 2019-08-07 | 2022-03-18 | 卓尔智联(武汉)研究院有限公司 | Advertisement putting method, computer device and readable storage medium |
| US20210235066A1 (en) * | 2019-11-12 | 2021-07-29 | Iview Displays (Shenzhen) Company Ltd. | Method for controlling projection of projection module, projection system, and storage medium |
| US11758117B2 (en) * | 2019-11-12 | 2023-09-12 | Iview Displays (Shenzhen) Company Ltd. | Method for controlling projection of projection module, projection system, and storage medium |
| CN111031298A (en) * | 2019-11-12 | 2020-04-17 | 广景视睿科技（深圳）有限公司 | Method and device for controlling projection of projection module and projection system |
| CN111031298B (en) * | 2019-11-12 | 2021-12-10 | 广景视睿科技（深圳）有限公司 | Method and device for controlling projection of projection module and projection system |
| WO2021092885A1 (en) * | 2019-11-12 | 2021-05-20 | 广景视睿科技（深圳）有限公司 | Method for controlling projection by projection module, device, and projection system |
| CN111179694A (en) * | 2019-12-02 | 2020-05-19 | 广东小天才科技有限公司 | Dance teaching interaction method, intelligent sound box and storage medium |
| CN110897604A (en) * | 2019-12-26 | 2020-03-24 | 深圳市博盛医疗科技有限公司 | Laparoscope system for reducing three-dimensional distortion in 3D vision and use method |
| CN111491146A (en) * | 2020-04-08 | 2020-08-04 | 上海乂学教育科技有限公司 | Interactive projection system for intelligent teaching |
| CN111489594A (en) * | 2020-05-09 | 2020-08-04 | 兰州石化职业技术学院 | Man-machine interaction platform |
| CN111489594B (en) * | 2020-05-09 | 2022-02-18 | 兰州石化职业技术学院 | Man-machine interaction platform |
| CN115113553A (en) * | 2021-09-03 | 2022-09-27 | 博泰车联网科技(上海)股份有限公司 | Control method, control system and control device for vehicle-mounted video and audio playing |
| CN114782901A (en) * | 2022-06-21 | 2022-07-22 | 深圳市禾讯数字创意有限公司 | Sand table projection method, device, equipment and medium based on visual change analysis |
| CN115494961A (en) * | 2022-11-17 | 2022-12-20 | 南京熊大巨幕智能科技有限公司 | Novel interactive surrounding intelligent display equipment based on face recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109960401B (en) | 2020-10-23 |
| WO2019128109A1 (en) | 2019-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109960401A (en) | A kind of trend projecting method, device and its system based on face tracking | |
| US11381758B2 (en) | System and method for acquiring virtual and augmented reality scenes by a user | |
| US11405558B2 (en) | Automated control of image acquisition via use of hardware sensors and camera content | |
| CN107466474B (en) | For the omnibearing stereo capture of mobile device | |
| KR20150013709A (en) | A system for mixing or compositing in real-time, computer generated 3d objects and a video feed from a film camera | |
| CN107027014A (en) | A kind of intelligent optical projection system of trend and its method | |
| CN107079141A (en) | Image mosaic for 3 D video | |
| CN105931263A (en) | Target tracking method and electronic equipment | |
| CN106027887B (en) | For the method, apparatus and electronic equipment of the rifle ball linkage control of rotating mirror holder | |
| US20130114851A1 (en) | Relative pose estimation of non-overlapping cameras using the motion of subjects in the camera fields of view | |
| CN102257456A (en) | Correcting angle error in a tracking system | |
| EP1292877A1 (en) | Apparatus and method for indicating a target by image processing without three-dimensional modeling | |
| KR20160019548A (en) | Method and device for refocusing multiple depth intervals, and electronic device | |
| US20180035100A1 (en) | Method and apparatus for extending binocular camera positioning range | |
| CN105898107A (en) | Target object snapping method and system | |
| CN110926334A (en) | Measuring method, measuring device, electronic device and storage medium | |
| CN112346798A (en) | Information acquisition method and device | |
| CN107957772B (en) | Processing method for collecting VR image in real scene and method for realizing VR experience | |
| CN110170167B (en) | Picture display method, device, equipment and medium | |
| CN106131421A (en) | The method of adjustment of a kind of video image and electronic equipment | |
| CN103632627B (en) | Method for information display, device and mobile navigation electronic equipment | |
| KR102101512B1 (en) | Apparatusand server for calculating spin of rotating object | |
| CN111888758A (en) | Fluency detection method, device, equipment and storage medium | |
| CN104113684B (en) | Control method and electronic installation | |
| EP3882846B1 (en) | Method and device for collecting images of a scene for generating virtual reality data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20231226 Granted publication date: 20201023 |
|
| PP01 | Preservation of patent right |