CN106254845A - Method, device and the electronic equipment of a kind of bore hole stereo display - Google Patents

Abstract

The invention provides method, device and the electronic equipment of a kind of bore hole stereo display.The method comprise the steps that the user's face obtaining active user the first coordinate under the photographic head coordinate system that a photographic head is corresponding；Between the initial point of the display screen coordinate system corresponding according to a predetermined display screen and described photographic head coordinate system, displacement and described photographic head coordinate system are relative to the first spin matrix of display screen coordinate system, are the second coordinate under described display screen coordinate system by described first Coordinate Conversion；According to described second coordinate, row's figure that three-dimensional film source to be shown carries out on described display screen bore hole stereo display processes.The present invention can reduce the position error of user's human eye in bore hole stereo display, improves the display effect of bore hole stereo display.

Description

Method, device and the electronic equipment of a kind of bore hole stereo display

Technical field

The present invention relates to bore hole stereo display technique field, be specifically related to a kind of bore hole stereo display method, Device and electronic equipment.

Background technology

In the bore hole stereo display of tracking mode, it usually needs a locating module (device), it is used for positioning Three-dimensional space position to active user's eyes, it is common that the three-dimensional space position of eyes central point.Then, Carry out the three-dimensional row's nomography of bore hole on the display screen to process and display according to this locus, thus will be vertical Left and right view in body film source projects in the right and left eyes of user accurately, reaches tracking-bore hole solid and shows Show effect.

For various reasons, the position of locating module actual installation, the most not at the centre bit of display screen Put, in some instances it may even be possible to farther out, this is at the small size electronics such as smart mobile phone, panel computer at distance display screen center In equipment especially common.When locating module distance display screen center farther out time, the three of user's eyes can be aggravated The error of the location data of dimension space position, and then because location data are forbidden, cause the crosstalk showing signal Strengthening, effective viewing areas such as diminishes relatively at the situation, and this brings adverse influence to bore hole stereo display.

Summary of the invention

The embodiment of the present invention to solve the technical problem that a kind of method of bore hole stereo display that is to provide, device and Electronic equipment, in order to reduce the position error of user's human eye in bore hole stereo display, improves bore hole stereo display Display effect.

For solving above-mentioned technical problem, the method for the bore hole stereo display that the embodiment of the present invention provides, including:

The user's face of acquisition active user the first coordinate under the photographic head coordinate system that a photographic head is corresponding；

The display screen coordinate system corresponding according to a predetermined display screen and described photographic head coordinate system Initial point between displacement and described photographic head coordinate system relative to the first spin moment of display screen coordinate system Battle array, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion；

According to described second coordinate, described display screen carries out bore hole to three-dimensional film source to be shown three-dimensional Row's figure of display processes.

Wherein, in such scheme, described first spin matrix is that described photographic head coordinate system is relative to display screen Curtain coordinate system is at the product of three axial three spin matrixs.

Wherein, in such scheme, described first coordinate is that the central point between active user's eyes is taken the photograph described As the coordinate under head coordinate system.

Wherein, in such scheme, the described user's face of active user that obtains is in shooting corresponding to a photographic head The step of the first coordinate under head coordinate system, including:

Set up the standard coordinate from a predetermined standard faces, to the pixel of the facial image of active user The functional relationship of coordinate, wherein, described standard faces is positioned at the X/Y plane of photographic head coordinate system, and supposes The face location of active user is being rotated according to one second spin matrix by described standard faces and there occurs Obtaining after one displacement, described second spin matrix and the first displacement are unknown parameters, people in described functional relationship The pixel coordinate of face image is the function about described unknown parameter；

Obtaining the facial image of the active user that camera collection arrives, detection obtains the pixel of described facial image Coordinate, and determine the standard coordinate that described pixel coordinate is corresponding；

According to the standard coordinate that the described pixel coordinate that obtains of detection and described pixel coordinate are corresponding, to described Unknown parameter in functional relationship solves, and obtains described second spin matrix and the first displacement；

By described first displacement, as user's face the first coordinate under described photographic head coordinate system.

Wherein, in such scheme, described foundation is from the standard coordinate of a predetermined standard faces, to working as The step of the functional relationship of the pixel coordinate of the facial image of front user includes:

According to described second spin matrix and the first displacement, set up the actual coordinate of user's face of active user Coordinate transformation relation with the standard coordinate of described standard faces；

According to the inner parameter of predetermined photographic head, set up the actual coordinate of user's face to user's face Projection relation at the pixel coordinate of image coordinate system；

According to described coordinate transformation relation and described projection relation, determine from the standard coordinate of standard faces to The functional relationship of the pixel coordinate of family face, described functional relationship is with described second spin matrix and the first displacement For parameter to be asked.

Wherein, in such scheme, the described described pixel coordinate obtained according to detection and described pixel coordinate Corresponding standard coordinate, the step that the unknown parameter in described functional relationship is solved, including:

Described function is carried out Taylor expansion, obtains a Taylor expansion；

Set an initial value for described unknown parameter, and by method of least square, described Taylor expansion is entered The loop computation that row iteration updates, solves and obtains described unknown parameter.

Wherein, in such scheme, described on described display screen, three-dimensional film source to be shown is carried out bore hole The step that row's figure of stereo display processes, including:

Scheme the cycle according to described second coordinate and predetermined row, determine each unit of display on display screen Display properties, described display properties includes for indicating the left figure in the three-dimensional film source of display or the left and right figure of right figure Label and for indicate display location point the unit of display index；

Display properties according to each unit of display and three-dimensional film source to be shown, determine that each unit of display needs Color value to be shown also shows.

Wherein, in such scheme, the described display properties according to each unit of display and Stereogram to be shown Source, determines that each unit of display needs the color value of display and carries out the step shown, including:

According to the display properties of each unit of display, from described three-dimensional film source, obtain each unit of display corresponding The first color value；

Select the part shear point in the described unit of display or whole shear point, and to selected shear point Color value is adjusted, and makes color value corresponding to selected shear point reduce or reduces in shear point adjacent two The difference of the color value between the individual unit of display, wherein, described shear point includes different adjacent of left and right figure label The unit of display；

According to the color value that each unit of display after adjusting is currently corresponding, carry out color and show.

Wherein, in such scheme, when the color value making selected shear point reduces, described to selected Shear point color value be adjusted including: by color value and the first penalty coefficient phase of selected shear point Take advantage of, the color value after being adjusted；

When the difference of the color value reduced in shear point between adjacent two units of display, described to selected Shear point color value is adjusted including: by a unit of display in two units of display adjacent in shear point Color value deduct an adjusted value, and, by the first color value of another unit of display plus described adjustment Value, the color value after being adjusted, wherein, described adjusted value is these adjacent two unit of display current colors The difference of value and the product of one second penalty coefficient；

Wherein, described first penalty coefficient and the second penalty coefficient be more than 0 and a constant less than 1 or Random number.

Wherein, in such scheme, described in the part shear point selected in the described unit of display include: from entirely Portion's corresponding point randomly chooses out described part shear point.

The embodiment of the present invention additionally provides the device of a kind of bore hole stereo display, including:

Coordinate acquiring unit, sits at the photographic head that a photographic head is corresponding for obtaining user's face of active user The first coordinate under mark system；

Coordinate transformation unit, for according to display screen coordinate system corresponding to a predetermined display screen with Between the initial point of described photographic head coordinate system, displacement and described photographic head coordinate system are relative to display screen coordinate First spin matrix of system, is the second seat under described display screen coordinate system by described first Coordinate Conversion Mark；

Row's figure unit, for according to described second coordinate, to Stereogram to be shown on described display screen Source carries out row's figure of bore hole stereo display and processes.

Wherein, in said apparatus, described first spin matrix is that described photographic head coordinate system is relative to display screen Curtain coordinate system is at the product of three axial three spin matrixs.

Wherein, in said apparatus, described first coordinate is that the central point between active user's eyes is taken the photograph described As the coordinate under head coordinate system.

Wherein, in said apparatus, described coordinate acquiring unit includes:

Modeling unit, for setting up the standard coordinate from a predetermined standard faces, arrives active user's The functional relationship of the pixel coordinate of facial image, wherein, described standard faces is positioned at photographic head coordinate system X/Y plane, and suppose active user face location by described standard faces according to one second spin matrix Obtaining after rotating and there occurs the first displacement, described second spin matrix and the first displacement are unknown parameters, institute Stating the pixel coordinate of facial image in functional relationship is the function about described unknown parameter；

Detector unit, for obtaining the facial image of the active user that camera collection arrives, detection obtains described The pixel coordinate of facial image, and determine the standard coordinate that described pixel coordinate is corresponding；

Solve unit, for the mark that the described pixel coordinate obtained according to detection and described pixel coordinate are corresponding Quasi coordinates, solves the unknown parameter in described functional relationship, obtains described second spin matrix and One displacement, by described first displacement, as user's face the first coordinate under described photographic head coordinate system.

Wherein, in said apparatus, described modeling unit specifically for:

According to described second spin matrix and the first displacement, set up the actual coordinate of user's face of active user Coordinate transformation relation with the standard coordinate of described standard faces；

According to the inner parameter of predetermined photographic head, set up the actual coordinate of user's face to user's face Projection relation at the pixel coordinate of image coordinate system；

According to described coordinate transformation relation and described projection relation, determine from the standard coordinate of standard faces to The functional relationship of the pixel coordinate of family face, described functional relationship is with described second spin matrix and the first displacement For parameter to be asked.

Wherein, in said apparatus, described in solve unit specifically for:

Described function is carried out Taylor expansion, obtains a Taylor expansion；

Set an initial value for described unknown parameter, and by method of least square, described Taylor expansion is entered The loop computation that row iteration updates, solves and obtains described unknown parameter.

Wherein, in said apparatus, described row's figure unit includes:

Attribute determining unit, for scheming the cycle according to described second coordinate and predetermined row, determines display screen The display properties of each unit of display on curtain, described display properties includes for indicating in the three-dimensional film source of display The left and right figure label of left figure or right figure and for indicating the unit of display index of display location point；

Color display unit, for the display properties according to each unit of display and three-dimensional film source to be shown, Determine that each unit of display needs the color value of display and shows.

Wherein, in said apparatus, described color display unit includes:

Color extraction unit, for the display properties according to each unit of display, obtains from described three-dimensional film source Obtain the first color value that each unit of display is corresponding；

Color adjusting unit, for selecting the part shear point in the described unit of display or whole shear point, And selected shear point color value is adjusted, make color value corresponding to selected shear point reduce or Reducing in shear point the difference of color value between adjacent two units of display, wherein, described shear point includes a left side The adjacent unit of display that right figure label is different；

Display processing unit, for the color value currently corresponding according to each unit of display after adjusting, is carried out Color shows.

Wherein, in said apparatus, described color adjusting unit, it is further used for making selected shear point Color value reduce time, the color value of selected shear point is multiplied with the first penalty coefficient, is adjusted After color value；And, when the difference of the color value reduced in shear point between adjacent two units of display, The color value of a unit of display in two units of display adjacent in shear point is deducted an adjusted value, with And, by the first color value of another unit of display plus described adjusted value, the color value after being adjusted, Wherein, described adjusted value is difference and one second penalty coefficient of these adjacent two unit of display current color values Product；

Wherein, described first penalty coefficient and the second penalty coefficient be more than 0 and a constant less than 1 or Random number.

Wherein, in said apparatus, described in state color adjusting unit, be further used for from whole corresponding points with Described part shear point selected by machine.

The embodiment of the present invention additionally provides the electronic equipment of a kind of bore hole stereo display, including:

Housing, processor, memorizer, display screen, circuit board and power circuit, wherein, circuit board is pacified Put the interior volume surrounded at housing, processor and memorizer to arrange on circuit boards；Power circuit, is used for Each circuit or device for electronic equipment are powered；Memorizer is used for storing executable program code；Processor The journey corresponding with executable program code is run by reading the executable program code of storage in memorizer Sequence, for performing following steps:

The user's face of acquisition active user the first coordinate under the photographic head coordinate system that a photographic head is corresponding；

The display screen coordinate system corresponding according to a predetermined display screen and described photographic head coordinate system Initial point between displacement and described photographic head coordinate system relative to the first spin moment of display screen coordinate system Battle array, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion；

According to described second coordinate, described display screen carries out bore hole to three-dimensional film source to be shown three-dimensional Row's figure of display processes.

Compared with prior art, the method and device of the bore hole stereo display that the embodiment of the present invention provides, pass through Conversion process to location data coordinate system, improves the accuracy of Face detection, reduces position error, Thus improve follow-up stereo display effect.Further, the embodiment of the present invention is also by introducing at the face of user side Reason mechanism, takes into full account the impact of user's face deflection angle, improves the standard of the coordinate setting of user's face Really property, further improves follow-up bore hole stereo display effect.It addition, the embodiment of the present invention is also by right The color value adjustment of shear point etc. process, and can improve the display effect caused because of the error of Face detection data The problem being deteriorated, and pass through random penalty coefficient or punish position at random, the crosstalk decreasing shear point is existing As the generation with moire fringes, improve bore hole stereo display effect, improve the viewing experience of user.

Accompanying drawing explanation

The schematic flow sheet of the method for the bore hole stereo display that Fig. 1 provides for the embodiment of the present invention one；

Fig. 2 is the schematic diagram of positioning shooting head deviation screen center in the embodiment of the present invention；

Fig. 3 A and Fig. 3 B is respectively the direct picture of user's face and the schematic diagram of side image；

The schematic flow sheet of the method for the bore hole stereo display that Fig. 4 provides for the embodiment of the present invention two；

The schematic flow sheet of the method for the bore hole stereo display that Fig. 5 provides for the embodiment of the present invention three；

The schematic flow sheet of the method for the bore hole stereo display that Fig. 6 provides for the embodiment of the present invention four；

The structural representation of the device of the bore hole stereo display that Fig. 7 provides for the embodiment of the present invention five.

Detailed description of the invention

In the electronic equipment of a lot of application trackings-bore hole stereo display technique, for positioning position of human eye Locating module is generally not arranged on the center of display screen, obtains directly using this locating module Location data when carrying out bore hole stereo display, can cause showing signal because location error in data is relatively big Crosstalk strengthens, and effective viewing areas such as diminishes relatively at the rough sledding.For this situation, the present invention implements Example provides a kind of Nakedness-yet stereoscopic display method, can reduce the error of above-mentioned location data, improves bore hole and stands Body display effect.For making the technical problem to be solved in the present invention, technical scheme and advantage clearer, below To be described in detail in conjunction with the drawings and the specific embodiments.

<embodiment one>

Refer to Fig. 1, the method for the bore hole stereo display that the embodiment of the present invention provides, comprise the following steps:

Step 11, obtains user's face of active user under the photographic head coordinate system that a photographic head is corresponding First coordinate.

Here, the embodiment of the present invention photographic head by locating module, carrys out real-time tracking and detects user's face Three-dimensional space position coordinate under photographic head coordinate system.Concrete, the acquisition mode of the first coordinate has multiple, For example, it is possible to by the facial picture of single camera collection face, and combine laser ranging or infrared distance measurement Etc. mode, determine the coordinate of face；Again for example, it may be drawn by the face of two camera collection faces Face, and utilize location algorithm to determine the coordinate under a face photographic head coordinate system wherein；The most such as, use The glasses being provided with multiple LED can be worn in family, by the image of single camera collection LED, enters And according to the position relationship between multiple LED, determine the position coordinates of face, etc..Here can adopt Using various prior art, obtain above-mentioned first coordinate, this is not especially limited by the embodiment of the present invention.

It addition, in row's nomography of bore hole stereo display, it is common that utilize the position of the central point of user's eyes Putting coordinate and carry out row's figure process, the most above-mentioned first coordinate can be that the central point between active user's eyes exists Coordinate under described photographic head coordinate system.

Step 12, the display screen coordinate system corresponding according to a predetermined display screen and described shooting Between the initial point of head coordinate system, displacement and described photographic head coordinate system are relative to the first of display screen coordinate system Spin matrix, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion.

Here, display screen coordinate system with the central point of display screen as initial point, above-mentioned photographic head coordinate system and Display screen coordinate system can be all based on right-handed coordinate system, it is assumed that x_p-y_pPlane is that display screen place is put down Face, z-axis is perpendicular to display screen place plane.Displacement (initial point meta between the initial point of two coordinate systems Move), can directly be obtained by measurement, the first spin matrix then can be by the photographic head of prior art The mode of external parameter correction measures acquisition, and here is omitted.

Fig. 2 gives a concrete example of above-mentioned photographic head coordinate system and display screen coordinate system, Fig. 2 Middle mobile phone 20 is horizontal placement, and wherein locating module is followed the tracks of by the front-facing camera 21 of mobile phone 20 and adopted Collection user's face location coordinate.Fig. 2 shows photographic head coordinate system x of front-facing camera 21 correspondence_c-y_c-z_c With display screen coordinate system x_p-y_p-z_p.Wherein, photographic head coordinate system x_c-y_c-z_cInitial point be C, display screen Curtain coordinate system x_p-y_p-z_pInitial point be P.Therefore, the first coordinate that the photographic head 21 of locating module gathers, It is the coordinate data with C as initial point, and the initial point of actual display screen is C, it is therefore desirable to the first coordinate Carry out the correction of coordinate system, specifically can pass through below equation (1) and carry out Coordinate Conversion:

$\left[\begin{array}{c}{x}^{\&prime;}\\ y^{\&prime;}\\ z^{\&prime;}\end{array}\right]=\left[\begin{array}{c}x\\ y\\ z\end{array}\right]+\left[\begin{array}{c}{x}_{CP}\\ y_{CP}\\ z_{CP}\end{array}\right]---\left(1\right)$

In above-mentioned formula (1), (x, y z) are the location data of the first coordinate with C as initial point； (x_cP, y_CP, z_CP) be two coordinate systems initial point between displacement, i.e. C point is equivalent to P point displacement；(x', y', z') is Revised location data (being modified to P as initial point).

But under practical situation, photographic head 21 is due to design, installation error factors, and its coordinate axes also differs Surely it is completely parallel to the coordinate axes of screen, therefore on the basis of above-mentioned formula (1), needs to consider further The factor rotated:

$\left[\begin{array}{c}{x}^{\&prime;}\\ y^{\&prime;}\\ z^{\&prime;}\end{array}\right]=R_{\mathrm{\&gamma;}}{R}_{\mathrm{\&beta;}}{R}_{\mathrm{\&alpha;}}\left[\begin{array}{c}x\\ y\\ z\end{array}\right]+\left[\begin{array}{c}{x}_{CP}\\ y_{CP}\\ z_{CP}\end{array}\right]---\left(2\right)$

Wherein R_γ, R_β, R_αRepresent that photographic head coordinate system ties up to z, y and x tri-relative to screen coordinate respectively Rotation parameter on the Zhou Xiang matrix of a 3*3 (each rotation parameter be), R_γR_βR_αRepresent that photographic head is sat Mark system is relative to the first spin matrix of display screen coordinate system, and the i.e. first spin matrix is that described photographic head is sat Mark system relative to display screen coordinate system at the product of three axial three spin matrixs.

By above-mentioned formula (2), by three axially on displacement, rotation parameter, can be by photographic head coordinate Location data correction under Xi is to screen coordinate system.As a rule, displacement parameter (x_CP, y_CP, z_CP) for same For the equipment of one model, it is relatively mostly, can be regarded as a fixed value；And rotation parameter (R_γ, R_β, R_α) the most do not fix, it is required for each concrete equipment and does the correction of external parameter and obtain.

Step 13, according to described second coordinate, enters three-dimensional film source to be shown on described display screen Row's figure of row bore hole stereo display processes.

Here, after obtaining revised described second coordinate, can be to the left view in three-dimensional film source and the right side View carries out row's figure process and display, for example, it is possible to scheme the cycle according to described second coordinate and predetermined row, Determining the display properties of each unit of display on display screen, described display properties includes for indicating display vertical Left figure in body film source or the left and right figure label of right figure and for indicating the unit of display index of display location point, The described unit of display can be pixel or sub-pixel；Then, according to the display properties of each unit of display with treat The three-dimensional film source of display, determines that each unit of display needs the color value of display and shows, thus to incite somebody to action Left and right view in three-dimensional film source projects in the right and left eyes of user accurately, it is achieved tracking-bore hole is three-dimensional Display effect.

From above step it can be seen that the embodiment of the present invention considers the installation site of the photographic head of locating module Be typically off the center in display screen, and user get used to just display screen being watched this because of Element, according to the rotation relationship between two coordinate systems and displacement relation, obtains user's face to locating module and sits Mark is modified, and utilizes revised coordinate to carry out row's figure process so that row figure result and spectators just to aobvious The viewing custom of display screen curtain is consistent, thus reduces the string between the relative error of location data and the unit of display Disturb, effective viewing areas can be increased, improve stereo display effect.

<embodiment two>

When only with single photographic head real-time tracking face, it usually needs pre-build and preserve a standard Face coordinate data under photographic head coordinate system, when track human faces, the user people arrived based on actual acquisition Face image and the coordinate data of this standard faces, determine the physical location of user's face.

Above-mentioned standard faces is used for the positive face of analog subscriber, for example, it is possible to based on great amount of samples user's face Statistical average data, the data such as shape size determining standard faces, if eyes interpupillary distance is 65mm etc.. Then, it is assumed that this standard faces, just to photographic head, now gathers this standard faces under photographic head coordinate system Coordinate data (hereinafter referred to as standard coordinate) also preserves.Here, described can be just standard to photographic head Central point between face eyes overlaps with the initial point of photographic head coordinate system.In actual treatment, generally choose The coordinate of the multiple labelling points on face is used as the coordinate data of face, and concrete labelling point can pass through people Face track algorithm obtains.

In actual application, the installation site of the photographic head of locating module is typically off the center in display screen, And user gets used to just watching display screen, therefore during locating module track human faces, generally gather To be the side face image of user, and anon-normal face image.The one that Fig. 3 A collects when showing photographic head Direct picture, Fig. 3 B shows a kind of side image that camera collection arrives.It can be seen that user side Image there occurs the rotation of certain angle relative to direct picture.

As it has been described above, standard faces is the positive face of analog subscriber, and the facial image that camera collection arrives may It it is the side face after the positive face of user rotates certain angle.The embodiment of the present invention is in coordinate data based on standard faces When determining the physical location of user's face, it is contemplated that the impact of above-mentioned rotation, improve in bore hole stereo display The coordinate precision of face tracking, and then follow-up bore hole stereo display effect can be improved.Below in conjunction with attached Figure further illustrates.

Refer to shown in Fig. 4, the method for the bore hole stereo display that the present embodiment provides, comprise the following steps:

Step 41, sets up the pixel coordinate from the standard coordinate of the standard faces facial image to active user Functional relationship, in which it is assumed that the face location of active user by described standard faces according to one second rotation Obtaining after turning matrix rotation and there occurs the first displacement, described second spin matrix and the first displacement are unknown ginsengs Number, in described functional relationship, the pixel coordinate of facial image is the function about described unknown parameter.

Here, when the space coordinates carrying out face only with single photographic head detects, it is impossible to directly detect To the actual coordinate of face, need to rely on the coordinate data of the standard faces pre-build, according to above-mentioned function Relation, solves the space coordinates obtaining face.Owing to facial image includes multiple labelling point, therefore, on Stating functional relationship is to set up for the multiple labelling points in face, for example, it is possible to in facial image All labelling points set up above-mentioned functional relationship.Further, since standard faces is just to photographic head, and eyes Central point overlaps with the initial point of photographic head coordinate system, and the most above-mentioned second displacement can be actual as active user The locus coordinate of the central point between face eyes, this is also that final needs solves the space coordinates obtained Parameter.

Step 42, obtains the facial image of the active user that camera collection arrives, and detection obtains described face The pixel coordinate of image, and determine the standard coordinate that described pixel coordinate is corresponding.

Here, the coordinate under the pixel coordinate of facial image is image coordinate system.Labelling point on facial image Can be obtained by Face tracking algorithm, and then can detect and obtain the pixel of each labelling point on facial image Coordinate, then can find the standard coordinate that each labelling point is corresponding in the coordinate data of standard faces, I.e. determine same labelling point at the pixel coordinate of facial image and the standard coordinate in standard faces.

The standard that step 43, the described pixel coordinate obtained according to detection and described pixel coordinate are corresponding is sat Mark, solves the unknown parameter in described functional relationship, obtains described second spin matrix and first Move, and using described first displacement as user's face the first coordinate under described photographic head coordinate system.

Here, multiple labelling point is utilized to sit at the pixel coordinate of facial image and the standard in standard faces Mark, solves the unknown parameter in described functional relationship, can obtain the second spin matrix and first The numerical value moved, and according to solving the first displacement obtained, determine actual coordinate (i.e. first seat of user's face Mark).In above-mentioned solution procedure, not only in view of the displacement between standard faces and user's face, also Consider the side image problem that caused of photographic head deviation display screen center, owing to being to be simultaneous for simultaneously Unknown parameter including the second spin matrix and the first displacement solves so that solves the result obtained and more can Reflect the real space position of user's face accurately, improve the accuracy of user's face location detection.

Step 44, between the initial point according to predetermined display screen coordinate system and described photographic head coordinate system Displacement and described photographic head coordinate system are relative to the first spin matrix of display screen coordinate system, by described First Coordinate Conversion is the second coordinate under described display screen coordinate system.

Step 45, according to described second coordinate, enters three-dimensional film source to be shown on described display screen Row's figure of row bore hole stereo display processes.

Here, further contemplate the installation site of photographic head and be typically off the center in display screen, therefore, Obtain user's face space coordinates (the first coordinate) after, the present embodiment in above-mentioned steps 44～45, According to the processing mode being similar in embodiment one, it is described display screen coordinate by described first Coordinate Conversion The second coordinate under Xi, then, further according to described second coordinate, carries out row's figure on described display screen, To overcome above-mentioned installation site to deviate the location error in data that screen center is brought, such that it is able to change further It is apt to the crosstalk between the unit of display on display screen, increases effective viewing areas of display screen, improve user's Bore hole stereos copic viewing is experienced.

In above-mentioned steps 41, the embodiment of the present invention establishes with the second spin matrix and the first displacement as the unknown The described functional relationship of parameter, process of specifically setting up may include that

Step 411, according to described second spin matrix and the first displacement, sets up user's face of active user The coordinate transformation relation of standard coordinate of actual coordinate and described standard faces.

Here, suppose that user's face be by standard faces according to second spin matrix rotate after and movement first Obtain after shifting, therefore, it can obtain below equation (3):

$\left[\begin{array}{c}xc\\ yc\\ zc\end{array}\right]=R\left[\begin{array}{c}xm\\ ym\\ zm\end{array}\right]+T---\left(3\right)$

Wherein, (xm, ym, zm) is the coordinate of the labelling point of standard faces under photographic head coordinate system, (xc, yc, zc) is the coordinate of labelling point corresponding on user's face under photographic head coordinate system, and R, T represent respectively The spin matrix of current face and displacement, be also unknown number to be solved.It is pointed out that here (xc, yc, zc) is to only rely on single photographic head to measure the parameter obtained, at the calculating process of the present embodiment In be equivalent to one the pixel coordinate of user's facial image associated with the standard coordinate of standard faces Intermediate variable.

Step 412, according to the inner parameter of predetermined photographic head, sets up the actual coordinate of user's face To user's face at the projection relation of the pixel coordinate of image coordinate system.

Here, photographic head inner parameter includes (fx, fy, px, py), and wherein, fx, fy represent respectively and take the photograph As head focal length in plane of delineation x-axis and y-axis when imaging, (px, py) then represents on the plane of delineation Principal point coordinate.The inner parameter of photographic head can consult the description of product of photographic head or according to the survey of prior art Metering method records, and here is omitted.Converted by the projection relation of actual coordinate to pixel coordinate, permissible Obtain below equation (4):

$\left[\begin{array}{c}u\\ v\\ 1\end{array}\right]=\left[\begin{array}{ccc}fx& 0& px\\ 0& fy& py\\ 0& 0& 1\end{array}\right]\left[\begin{array}{c}xc/zc\\ yc/zc\\ 1\end{array}\right]=\left[\begin{array}{c}fx\frac{xc}{zc}+px\\ fy\frac{yc}{zc}+py\\ 1\end{array}\right]---\left(4\right)$

Wherein, (u, v] it is the pixel coordinate of labelling point in facial image.

Step 413, according to described coordinate transformation relation and described projection relation, determines the mark from standard faces Quasi coordinates is to the functional relationship of the pixel coordinate of user's face, and described functional relationship is with described second spin matrix It is parameter to be asked with the first displacement.

Here, by above step 411～412, following relation can be set up:

$\left\{\begin{array}{c}\left[\begin{array}{c}xc\\ yc\\ zc\end{array}\right]=R\left[\begin{array}{c}xm\\ ym\\ zm\end{array}\right]+T---\left(3\right)\\ \left[\begin{array}{c}u\\ v\\ 1\end{array}\right]=\left[\begin{array}{ccc}fx& 0& px\\ 0& fy& py\\ 0& 0& 1\end{array}\right]\left[\begin{array}{c}xc/zc\\ yc/zc\\ 1\end{array}\right]=\left[\begin{array}{c}fx\frac{xc}{zc}+px\\ fy\frac{yc}{zc}+py\\ 1\end{array}\right]---\left(4\right)\end{array}\right.$

By above-mentioned formula (3) (4) is carried out mathematic(al) manipulation, (xc, yc, zc) can be eliminated, marked Standard coordinate (xm, ym, the zm) pixel coordinate corresponding with this labelling point of note point (u, v) between functional relationships System.Here, the standard coordinate of labelling point is predetermined, and pixel coordinate then can pass through software track Algorithm detection obtains, and therefore R, T in this functional relationship are unknown parameters.Therefore, the present embodiment is in step In rapid 43, it is possible to use the multiple labelling points in the face obtained in step 42 are at the coordinate figure of facial image Coordinate figure (standard coordinate) in (pixel coordinate) and standard faces, by various existing Mathematicals Method, solves and obtains the second spin matrix R and the numerical value of the first displacement T.

Next explanation the present embodiment solution procedure based on method of least square, to solving of above-mentioned steps 43 It is described in detail.It is pointed out that this solution procedure is only the one of which side that the present invention can use Method, is not limited to the present invention, and the present invention can use various existing mathematical algorithm to solve. Such as, in above-mentioned steps 43, first described function is carried out Taylor expansion, obtain a Taylor expansion； Then, set an initial value for described unknown parameter, and by method of least square, to described Taylor expansion It is iterated the loop computation updated, finally solves and obtain described unknown parameter.

Below by formula, above-mentioned solution procedure is described in detail.For simplified operation, can be to upper State formula (4) to carry out obtaining formula (5) with down conversion, with by pixel coordinate (u, v) is transformed to (u', v'), this In by (u', v') be referred to as through photographic head inner parameter revised labelling point pixel coordinate:

$\left\{\begin{array}{c}\left[\begin{array}{c}xc\\ yc\\ zc\end{array}\right]=R\left[\begin{array}{c}xm\\ ym\\ zm\end{array}\right]+T---\left(3\right)\\ \left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\\ 1\end{array}\right]=\left[\begin{array}{c}(u-px)/fx\\ (v-py)/fy\\ 1\end{array}\right]=\left[\begin{array}{c}xc/zc\\ yc/zc\\ 1\end{array}\right]---\left(5\right)\end{array}\right.$

Face labelling point pixel coordinate that solution procedure is through detecting (u, v) and the face mark preset Note space of points coordinate (xm, ym, zm), is calculated unknown number (R, T).Here, unknown parameter is set to K=[α, β, γ, T_x,T_y,T_z]^T, and make $f\left(k\right)=\left[\begin{array}{c}\mathrm{xc}/\mathrm{zc}\\ \mathrm{yc}/\mathrm{zc}\end{array}\right].$ Here, the second spin matrix R can use α, beta, gamma represents, and α, beta, gamma represent respectively user's face relative to standard faces in photographic head coordinate system The anglec of rotation on x, y, z axle, T_x,T_y,T_zRepresent the most respectively according to the second postrotational mark of spin matrix Quasi-face moves the displacement to user's face, on the x, y, z direction of principal axis of photographic head coordinate system.

Then, carry out Taylor expansion according to f (n), can obtain below equation:

$\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]=f\left(k\right)=f\left(k_1\right)+f^{\&prime;}\left(k_1\right)(k-k_1)+\frac{f^{\&prime;\&prime;}\left(k_1\right)}{2!}{(k-k_1)}^2+...+\frac{f^{\left(n\right)}\left(k_1\right)}{n!}{(k-k_1)}^n+R_n\left(k\right)$

Wherein, above-mentioned multinomial is that function f (k) is at k₁The Taylor expansion at place, f⁽ⁿ⁾(k₁) represent that f (k) exists k₁The n order derivative at place, R_nK () is the remainder of Taylor expansion.In view of amount of calculation and error allowed band, The most only take above-mentioned polynomial first two and carry out subsequent calculations, i.e. obtain equation below (6):

$\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]=f\left(k_1\right)+f^{\&prime;}\left(k_1\right)(k-k_1)---\left(6\right)$

According to the iterative formula of method of least square, above-mentioned formula (6) is finally changed following iterative formula (7):

$\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]=f\left(k_j\right)+J(k_{j+1}-k_j)$

$J(k_{j+1}-k_j)=\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]-f\left(k_j\right)$

$k_{j+1}-k_j={\left(J^{T}J\right)}^{-1}{J}^T(\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]-f(k_j\left)\right)$

$k_{j+1}={\left(J^{T}J\right)}^{-1}{J}^T(\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]-f(k_j\left)\right)+k_j---\left(7\right)$

In above-mentioned formula, J is the matrix of 2s × 6, and s represents the quantity of the labelling point participating in calculating.J^TTable Show the transposed matrix of J, J^-1The inverse matrix of expression J:

$J=\left[\begin{array}{c}{J}_1\\ J_2\\ \begin{array}{c}.\\ .\\ .\end{array}\\ J_s\end{array}\right]---\left(8\right)$

Wherein, J_iIt is expressed as follows, here, 1≤i≤s:

$J_i=\left[\begin{array}{cccccc}\frac{\&part;{u_i}^{\&prime;}}{\&part;\mathrm{\&alpha;}}& \frac{\&part;{u_i}^{\&prime;}}{\&part;\mathrm{\&beta;}}& \frac{\&part;{u_i}^{\&prime;}}{\&part;\mathrm{\&gamma;}}& \frac{\&part;{u_i}^{\&prime;}}{\&part;T_x}& \frac{\&part;{u_i}^{\&prime;}}{\&part;T_y}& \frac{\&part;{u_i}^{\&prime;}}{\&part;T_z}\\ \frac{\&part;{v_i}^{\&prime;}}{\&part;\mathrm{\&alpha;}}& \frac{\&part;{v_i}^{\&prime;}}{\&part;\mathrm{\&beta;}}& \frac{\&part;{v_i}^{\&prime;}}{\&part;\mathrm{\&gamma;}}& \frac{\&part;{v_i}^{\&prime;}}{\&part;T_x}& \frac{\&part;{v_i}^{\&prime;}}{\&part;T_y}& \frac{\&part;{v_i}^{\&prime;}}{\&part;T_z}\end{array}\right]---\left(9\right)$

J_iBeing the local derviation matrix to k, representative function f (k) is along a descent direction in k parameters direction. u_i', v_i' represent that i-th is through photographic head inner parameter revised labelling point pixel coordinate respectively.

After obtaining above-mentioned iterative formula (7), can be updated by iteration and calculate, solve unknown ginseng Number k, concrete iteration renewal process is as follows:

Step a, sets an initial value to unknown parameter k, and as k₁, the most now k_jSubscript j=1.Just Arranging of initial value can be according to probably distance and the user of user distance display screen in concrete application scenarios Face is arranged relative to the deflection situation of display screen.

Step b, calculates J according to above-mentioned formula (8) and formula (9).

Step c, according to above-mentioned formula (7), calculates k_j+1。

Step d, according to k calculated in step c_j+1, it may be judged whether meet predetermined exit criteria: if It is then to exit circulation, and according to current k_j+1, determine the result of calculation of the first displacement T；If it is not, then Above-mentioned steps b is returned after j is added 1.

Here, the exit criteria in step d can be that cycle-index j reaches predetermined threshold, or k_j+1-_jDifference less than a preset first threshold value, or $\left[\begin{array}{c}{u}^{\&prime;}\\ v^{\&prime;}\end{array}\right]-f\left(k_j\right)$ Difference preset the less than one Two threshold values, etc..

By the result of calculation of more newly obtained the first displacement T of above-mentioned iteration, can be as user's face The locus coordinate of the central point between eyes.During above-mentioned calculating, by the deflection of user's face Together consider with displacement and solve, the error of Face detection can be effectively reduced, thus improve follow-up Bore hole stereo display effect, improves the viewing experience of user.

It addition, as a kind of optional embodiment, the present embodiment obtains described first in above-mentioned steps 43 After coordinate, it is also possible to directly carry out the three-dimensional row's figure of bore hole according to this first coordinate and process, and no longer by the One Coordinate Conversion is the second coordinate.Owing to the first coordinate obtained after being processed by above-mentioned steps 41～43 is one Determine to reduce in degree the error of face space orientation data, therefore can also improve tracking to a certain extent The display effect that-bore hole is three-dimensional.

<embodiment three>

Owing to the position error of user's face cannot be completely eliminated, therefore in bore hole stereo display, remove Reduce outside this position error, it is also possible to by row's nomography is optimized, improve because of location by mistake as far as possible The problem that the stereoeffect that difference causes is deteriorated.

Table 1 below gives an example of the display content of each unit of display after row's nomography processes.

L1

L2

L3

R4

R5

R6

L7

L8

L9

R10

R11

R12

…

Table 1

As a example by above table 1, each lattice represents a unit of display (can be pixel or sub-pixel), Word content in each grid represents the display properties of this unit of display, specifically includes: left and right figure label and The unit of display indexes.Here, representing display left view with L, R represents display right view；Numeral then represents The unit of display indexes, i.e. a level index from left to right.Left and right figure label is to represent in this unit of display The left figure information in three-dimensional film source or right figure information should be used.

Assume that in upper table, (L1, L2, L3, R4, R5, R6) is that a row schemes the cycle, (L7, L8, L9, R10, R11, R12) It is that an ensuing row schemes the cycle.Different bore hole stereoscopic screens has different rows and schemes the cycle, lifts here Example is with 6 units of display as cycle.According to traditional row's nomography, the position of L1 will be composed It is worth first color value of left figure, the position of R4 will be assigned the 4th color value of right figure, with this Analogize.

Inventor finds, the position that the left and right icon label in the adjacent unit of display change (is referred to herein as cut Height), the as above L3 in table, R4, R6, L7, L9, R10 ... on these positions, its color value will Largely affect last crosstalk effect.Display effect, the present embodiment is improved in order to reduce cross talk effects A kind of method providing bore hole stereo display, as it is shown in figure 5, comprise the following steps:

Step 51, according to the display properties of each unit of display on display screen, from Stereogram to be shown Obtaining the color value that each unit of display is corresponding in source, wherein, described display properties includes for indicating display The left and right figure label of left figure or right figure and for indicating the unit of display index of display location point.

Here, including left and right view in three-dimensional film source, each unit of display may show left view therein Or right view, the described unit of display can be specifically pixel or sub-pixel.Interior shown by each unit of display Hold, can determine that each shows by the current position coordinates of user's face and row's nomography set in advance Showing the display properties of unit, this attribute includes left and right figure label and unit of display index, according to this display properties, May determine which position in each unit of display display left view or right view, and display respective view Put content a little.

Step 52, selects the part shear point in the described unit of display or whole shear point, and to selected The shear point color value selected is adjusted, and makes the color value that selected shear point is corresponding reduce or reduce shear The difference of color value between adjacent two units of display in point, wherein, described shear point includes left and right figure label The different adjacent units of display.

Step 53, according to the color value that each unit of display after adjusting is currently corresponding, carries out color and shows.

Here, the unit of display on display screen is to scheme the cycle according to the row in row's nomography, the most aobvious Show a number of left view and right view, thus cause possible display between the adjacent unit of display different View, i.e. forms above-mentioned shear point.Here between the adjacent same a line unit of display referred on display screen Neighbouring relations.The color value of the unit of display that the present embodiment is related to by amendment shear point, such as, reduces The difference of the color value of adjacent two units of display of its color value or reduction shear point, it is possible to reduce stereo display In cross talk effects, and then weaken the bad stereo display effect caused because of Face detection error.

Concrete, in above-mentioned steps 52, can be by the color value of selected shear point and the first punishment Multiplication, the color value after being adjusted, so that the color value of selected shear point reduces.Here, First penalty coefficient is the constant more than 0 and less than 1.The adjustment mode of this color value is directly to reduce The color value of shear point, can be regarded as a kind of definitely punishment.Such as, carry out according to below equation (10) Adjust:

C '=C*e1 (10)

Wherein C is the color value adjusting this shear point front, and C ' is the color value adjusting rear cutout height, and e is punishment Coefficient, the constant that e1 is typically between 0.0～1.0, according to the spy of different autostereoscopic display screen curtains Property, different e1 values can be set.Value that what e1 was concrete arranged can be in conjunction with according to the crosstalk in different e1 values Measurement result finally selects.

For example, it is possible to the color value of the L3 position in upper table 1 is carried out above-mentioned adjustment, similar, also may be used Same adjustment algorithm is applied on R4, by that analogy.

In above-mentioned steps 52, it is also possible to by single for a display in two units of display adjacent in shear point The color value of position deducts an adjusted value, and, by the first color value of another unit of display plus described tune Whole value, the color value after being adjusted, to reduce in shear point color value between adjacent two units of display Difference.Here, described adjusted value is that the difference of these adjacent two unit of display current color values is punished with one second The product of penalty factor, the second penalty coefficient is the constant more than 0 and less than 1.The adjustment of this color value The difference of color value between adjacent two units of display can be changed, therefore can be regarded as one and relatively punish Penalize.This adjustment mode is by reducing the difference degree of the colour-difference of the shear adjacent unit of display of point, thus subtracts Weak crosstalk effect.In general the color distinction of left and right figure is the biggest, and crosstalk effect is the most obvious.If colour-difference The least, crosstalk will reduce, and therefore only can reduce colour-difference on shear point, so can weaken string Disturb effect, also will not substantially change the difference of of left and right figure itself simultaneously.Such as, according to below equation (11) It is adjusted:

$\left\{\begin{array}{c}{C}_L^{\&prime;}=C_L-e2(C_L-C_R)\\ C_R^{\&prime;}=C_R-e2(C_R-C_L)\end{array}\right.---\left(11\right)$

Wherein, C_L,C_RBeing the color value of two units of display before certain shear point adjusts, e2 is punishment system Number, the usually constant between 0.0～1.0, C '_L,C′_RIt it is the color value of two units of display after adjusting.

It is for example, it is possible to the color value of L3, the R4 position in upper table 1 is carried out above-mentioned adjustment, similar, Same adjustment algorithm can also be applied on R6, L7 position, by that analogy.

In two kinds of adjustment modes described above, e1 and e2 is all constant.When all shear points are all carried out During above-mentioned adjustment, this adjustment (or punishment) is all based on the physical location of the unit of display, will present one Fixed regularity, the position i.e. punished be the distribution of the rule in cycle on the display screen, such as, Mei Geban Individual row's figure cycle occurs once.The periodic law of the grating outside the phenomenon of this periodic law and display floater It is superimposed upon one piece, it is possible to produce the phenomenon of moire fringes, and moire fringes can reduce the display quality of stereoscopic picture plane. Therefore, above adjustment mode is improved by the present embodiment further, such as, changes above-mentioned e1/e2, makes Be no longer a fixed value, but the random value between 0.0～1.0.When stochastic variable x obeys one Location parameter is μ, scale parameter is the probability distribution of σ, and its probability density function is:

$g(x;\mathrm{\&mu;},\mathrm{\&sigma;})=\frac{1}{\sqrt{2\mathrm{\&pi;}}\mathrm{\&sigma;}}\exp (-\frac{{(x-\mathrm{\&mu;})}^2}{2{\mathrm{\&sigma;}}^2}),$

Then this stochastic variable x is normal random variable, i.e. can be expressed as x～N (μ, σ).Therefore, this reality Execute the first penalty coefficient or second penalty coefficient of e2～N (μ, σ) that can use e1～N (μ, σ) in example. That is, e1/e2 is the variable value meeting normal distribution.Certainly, the present embodiment can also select the e1/e2 to be Meet a variable value of uniformly distributed function, Poisson distribution function, exponential distribution function etc..Then, then Utilize above formula (10) or (11), the color value of shear point is adjusted, thus obtained adjustment After color value can reduce the generation of moire fringes phenomenon, improve the effect of stereo display.

The present embodiment, in above-mentioned steps 52, can all carry out color value to shear points all on display screen Adjustment process, it is also possible to only part shear point is carried out color value adjustment.Only part shear point is being carried out When color value adjusts, can arbitrarily select the shear point needing to carry out color value adjustment, such as, randomly choose and cut Height, i.e. the present embodiment no longer can carry out color value adjustment in the fixing unit of display.

As a example by above table 1, originally at L3, R4, R6, L7, L9, R10... these should carry out color value adjustment On position, decide whether to be adjusted according to a kind of random value.That is, by a kind of stochastic selection algorithm, From shear point, select the shear point needing to adjust, and then utilize above-mentioned formula (10) or (11) to carry out face The adjustment of colour.Here, the e1/e2 in above-mentioned formula (10) or (11) can be between 0.0～1.0 Constant or variable value.So, by using random penalty coefficient or punishment position, the present embodiment is permissible Reduce crosstalk, weaken the effect of moire fringes, thus improve cause because human eye location is inaccurate bad aobvious Showing problem, the stereos copic viewing improving user is experienced.

<embodiment four>

Refer to Fig. 6, the method for the bore hole stereo display that the embodiment of the present invention provides, comprise the following steps:

Step 61, obtains user's face of active user under the photographic head coordinate system that a photographic head is corresponding First coordinate.

Here, the embodiment of the present invention photographic head by locating module, carrys out real-time tracking and detects user's face Three-dimensional space position coordinate under photographic head coordinate system.Concrete, the acquisition mode of the first coordinate has multiple, Various prior art can be utilized, it is also possible to reference to the step 41～43 in embodiment two, obtain the first seat Mark, to reduce because positioner deviates the location of the face locus that display screen center causes by mistake Difference, for saving length, here is omitted.

Step 62, the display screen coordinate system corresponding according to predetermined display screen and described photographic head Between the initial point of coordinate system, displacement and described photographic head coordinate system are revolved relative to the first of display screen coordinate system Torque battle array, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion.

Here it is possible to reference to the step 12 in embodiment one, be the second coordinate by the first Coordinate Conversion, with Reducing the error of Face detection data, for saving length, here is omitted.

Step 63, schemes the cycle according to described second coordinate and predetermined row, determines on display screen each The display properties of the unit of display, described display properties includes for indicating the left figure in the three-dimensional film source of display or the right side The left and right figure label of figure and for indicating the unit of display index of display location point.

Step 64, according to display properties and the three-dimensional film source to be shown of each unit of display, determines each The unit of display needs the color value of display and shows.

Here, above-mentioned steps 64 specifically may include that

Step 641, according to the display properties of each unit of display, obtains each from described three-dimensional film source and shows Show the first color value that unit is corresponding；

Step 642, selects the part shear point in the described unit of display or whole shear point, and to selected The shear point color value selected is adjusted, and makes the color value that selected shear point is corresponding reduce or reduce shear The difference of color value between adjacent two units of display in point, wherein, described shear point includes left and right figure label The different adjacent units of display；

Step 642, according to the color value that each unit of display after adjusting is currently corresponding, carries out color and shows.

In above-mentioned steps 642, when needs select part shear point to carry out color value adjustment, can be from entirely Portion's corresponding point randomly chooses out part shear point；Reduce when needing the color value making selected shear point Time, the color value of selected shear point can be multiplied with the first penalty coefficient, thus after being adjusted Color value；When the difference of the color value needed to reduce in shear point between adjacent two units of display, can be by In shear point, the color value of a unit of display in adjacent two units of display deducts an adjusted value, and, By the first color value of another unit of display plus described adjusted value, the color value after being adjusted, wherein, Described adjusted value is the difference of these adjacent two unit of display current color values and taking advantage of of one second penalty coefficient Long-pending；

Above-mentioned first penalty coefficient and the second penalty coefficient are the constant more than 0 and less than 1 or random Number.Wherein, when using random number as first/second penalty coefficient, can be reduced or avoided further The generation of moire fringes, improves stereo display effect.Here it is possible to select to meet normal state random distribution, Poisson Distribution, the random number of exponential equal distribution function, as first/second penalty coefficient.

The present embodiment, by being adjusted shear point color value, can alleviate because Face detection error in data is led The bad display problem caused.It addition, when use the part shear point that randomly chooses carry out color value adjust and/ Or use random number as the adjustment mode of penalty coefficient, it is possible to the product of moire fringes is reduced or avoided further Raw, improve stereo display effect, the stereos copic viewing improving user is experienced.Further, the present embodiment can pass through Coordinate system correction (the first Coordinate Conversion is the second coordinate) and side face treatment mechanism (reference example two), Reduce the position error of face locus, improve the vertical of follow-up row's figure based on face locus process Body display effect.

<embodiment five>

Method based on the bore hole stereo display that above example is provided, present embodiments provide a kind of in order to Realize the device of said method.Refer to Fig. 7, the device of the bore hole stereo display that the present embodiment provides, bag Include:

Coordinate acquiring unit 71, for obtaining user's face of active user in shooting corresponding to a photographic head The first coordinate under head coordinate system.

Here, the central point that described first coordinate is preferably between active user's eyes is at described photographic head coordinate Coordinate under Xi.

Coordinate transformation unit 72, for the display screen coordinate corresponding according to a predetermined display screen Between the initial point of system and described photographic head coordinate system, displacement and described photographic head coordinate system are relative to display screen First spin matrix of coordinate system, is second under described display screen coordinate system by described first Coordinate Conversion Coordinate.

Here, described first spin matrix can use described photographic head coordinate system relative to display screen coordinate The product tying up to three axial three spin matrixs represents.

Row's figure unit 73, for according to described second coordinate, standing to be shown on described display screen Body film source carries out row's figure of bore hole stereo display and processes.

By said units, the device of the bore hole stereo display of the present embodiment, by user's face at a photographic head Corresponding the first coordinate under photographic head coordinate system, is converted to the second coordinate under display screen coordinate system, And then carry out row's figure process according to the second coordinate, can reduce because positioning shooting head deviates caused by screen center Position error, improve bore hole stereo display effect.

It is typically off the center in display screen, for entering one in view of positioner (positioning shooting head) Step reduces the position error of Face detection data, and above-mentioned coordinate acquiring unit 71 can include with lower unit, Further to improve the accuracy of location data:

Modeling unit, for setting up the standard coordinate from a predetermined standard faces, arrives active user's The functional relationship of the pixel coordinate of facial image, wherein, described standard faces is positioned at photographic head coordinate system X/Y plane, and suppose active user face location by described standard faces according to one second spin matrix Obtaining after rotating and there occurs the first displacement, described second spin matrix and the first displacement are unknown parameters, institute Stating the pixel coordinate of facial image in functional relationship is the function about described unknown parameter；

Detector unit, for obtaining the facial image of the active user that camera collection arrives, detection obtains described The pixel coordinate of facial image, and determine the standard coordinate that described pixel coordinate is corresponding；

Solve unit, for the mark that the described pixel coordinate obtained according to detection and described pixel coordinate are corresponding Quasi coordinates, solves the unknown parameter in described functional relationship, obtains described second spin matrix and One displacement, by described first displacement, as user's face the first coordinate under described photographic head coordinate system.

More specifically:

Described modeling unit specifically for: according to described second spin matrix and the first displacement, set up current using The actual coordinate of user's face at family and the coordinate transformation relation of the standard coordinate of described standard faces；According in advance The inner parameter of the photographic head first determined, sets up the actual coordinate of user's face to user's face in image coordinate The projection relation of the pixel coordinate of system；According to described coordinate transformation relation and described projection relation, determine from mark The standard coordinate of quasi-face is to the functional relationship of the pixel coordinate of user's face, and described functional relationship is with described Two spin matrixs and the first displacement are parameter to be asked.

Described solve unit specifically for: described function is carried out Taylor expansion, obtains a Taylor expansion； Set an initial value for described unknown parameter, and by method of least square, described Taylor expansion is carried out repeatedly The loop computation that generation updates, solves and obtains described unknown parameter.

In the present embodiment, above-mentioned row's figure unit 73 specifically may include that

Attribute determining unit, for scheming the cycle according to described second coordinate and predetermined row, determines display screen The display properties of each unit of display on curtain, described display properties includes for indicating in the three-dimensional film source of display The left and right figure label of left figure or right figure and for indicating the unit of display index of display location point；

Color display unit, for the display properties according to each unit of display and three-dimensional film source to be shown, Determine that each unit of display needs the color value of display and shows.

Process for realizing the adjustment to shear point color value, reduce crosstalk phenomenon, improve stereo display effect, Described color display unit can include with lower unit again:

Color extraction unit, for the display properties according to each unit of display, obtains from described three-dimensional film source Obtain the first color value that each unit of display is corresponding；

Color adjusting unit, for selecting the part shear point in the described unit of display or whole shear point, And selected shear point color value is adjusted, make color value corresponding to selected shear point reduce or Reducing in shear point the difference of color value between adjacent two units of display, wherein, described shear point includes a left side The adjacent unit of display that right figure label is different；

Display processing unit, for the color value currently corresponding according to each unit of display after adjusting, is carried out Color shows.

Here, described color adjusting unit, it is further used for the color value making selected shear point and reduces Time, the color value of selected shear point is multiplied with the first penalty coefficient, the color value after being adjusted； And, when the difference of the color value reduced in shear point between adjacent two units of display, by phase in shear point The color value of a unit of display in adjacent two units of display deducts an adjusted value, and, another is shown Show the first color value of unit plus described adjusted value, the color value after being adjusted, wherein, described adjustment Value is the difference product with one second penalty coefficient of these adjacent two unit of display current color values；

Wherein, described first penalty coefficient and the second penalty coefficient be more than 0 and a constant less than 1 or Random number.

It addition, when only needing part shear point is carried out color value and adjusting, described in state color adjusting unit, Can also be further used for from whole corresponding points, randomly choosing out described part shear point, with random to position Shear point carry out color value adjustment, it is to avoid on fixed position, carry out color value adjustment, to reduce moire fringes Generation.

In order to preferably realize above-mentioned purpose, the embodiment of the present invention additionally provides the electricity of a kind of bore hole stereo display Subset, including:

Housing, processor, memorizer, display screen, circuit board and power circuit, wherein, circuit board is pacified Put the interior volume surrounded at housing, processor and memorizer to arrange on circuit boards；Power circuit, is used for Each circuit or device for electronic equipment are powered；Memorizer is used for storing executable program code；Processor The journey corresponding with executable program code is run by reading the executable program code of storage in memorizer Sequence, for performing following steps:

The user's face of acquisition active user the first coordinate under the photographic head coordinate system that a photographic head is corresponding；

The display screen coordinate system corresponding according to a predetermined display screen and described photographic head coordinate system Initial point between displacement and described photographic head coordinate system relative to the first spin moment of display screen coordinate system Battle array, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion；

According to described second coordinate, described display screen carries out bore hole to three-dimensional film source to be shown three-dimensional Row's figure of display processes.

This electronic equipment exists in a variety of forms, includes but not limited to:

(1) mobile communication equipment: the feature of this kind equipment is to possess mobile communication function, and to provide words Sound, data communication are main target.This Terminal Type includes: smart mobile phone (such as iPhone or based on peace The mobile phone of tall and erect operating system), multimedia handset, functional mobile phone, and low-end mobile phone etc.；

(2) super mobile personal computer equipment: this kind equipment belongs to the category of personal computer, have calculating and Process function, the most also possess mobile Internet access characteristic.This Terminal Type includes: PC, PDA, MID and UMPC Equipment etc., such as iPad；

(3) portable entertainment device: this kind equipment can show and play content of multimedia.This kind equipment bag Include: audio frequency, video player (such as iPod), handheld device, e-book, and intelligent toy and Portable car-mounted navigator；

(4) other have the electronic installation of data interaction function.

It should be noted that the electronic equipment that the embodiment of the present invention provides is to apply above-mentioned bore hole solid to show Show that the electronic equipment of method, all embodiments of the most above-mentioned stereo display method and beneficial effect thereof are all applicable to This electronic equipment.

In sum, the method and device of the bore hole stereo display that the embodiment of the present invention provides, by location The conversion process of data coordinate system, user side face process and the color value adjustment of shear point processes, permissible Greatly reduce the error of Face detection data, reduce crosstalk phenomenon and the generation of moire fringes of shear point, improve Bore hole stereo display effect, improves the viewing experience of user.

The above is the preferred embodiment of the present invention, it is noted that for the common skill of the art For art personnel, on the premise of without departing from principle of the present invention, it is also possible to make some improvements and modifications, These improvements and modifications also should be regarded as protection scope of the present invention.

Claims (21)

1. the method for a bore hole stereo display, it is characterised in that including:

The user's face of acquisition active user the first coordinate under the photographic head coordinate system that a photographic head is corresponding；

The display screen coordinate system corresponding according to a predetermined display screen and described photographic head coordinate system Initial point between displacement and described photographic head coordinate system relative to the first spin moment of display screen coordinate system Battle array, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion；

According to described second coordinate, described display screen carries out bore hole to three-dimensional film source to be shown three-dimensional Row's figure of display processes.

2. the method for claim 1, it is characterised in that described first spin matrix be described in take the photograph As head coordinate system relative to display screen coordinate system at the product of three axial three spin matrixs.

3. the method for claim 1, it is characterised in that described first coordinate is that active user is double The central point between Yan coordinate under described photographic head coordinate system.

4. the method for claim 1, it is characterised in that the user people of described acquisition active user The step of the face the first coordinate under the photographic head coordinate system that a photographic head is corresponding, including:

Set up the standard coordinate from a predetermined standard faces, to the pixel of the facial image of active user The functional relationship of coordinate, wherein, described standard faces is positioned at the X/Y plane of photographic head coordinate system, and supposes The face location of active user is being rotated according to one second spin matrix by described standard faces and there occurs Obtaining after one displacement, described second spin matrix and the first displacement are unknown parameters, people in described functional relationship The pixel coordinate of face image is the function about described unknown parameter；

Obtaining the facial image of the active user that camera collection arrives, detection obtains the pixel of described facial image Coordinate, and determine the standard coordinate that described pixel coordinate is corresponding；

According to the standard coordinate that the described pixel coordinate that obtains of detection and described pixel coordinate are corresponding, to described Unknown parameter in functional relationship solves, and obtains described second spin matrix and the first displacement；

By described first displacement, as user's face the first coordinate under described photographic head coordinate system.

5. method as claimed in claim 4, it is characterised in that described foundation is from a predetermined mark The standard coordinate of quasi-face, to the step bag of functional relationship of pixel coordinate of the facial image of active user Include:

According to described second spin matrix and the first displacement, set up the actual coordinate of user's face of active user Coordinate transformation relation with the standard coordinate of described standard faces；

According to the inner parameter of predetermined photographic head, set up the actual coordinate of user's face to user's face Projection relation at the pixel coordinate of image coordinate system；

According to described coordinate transformation relation and described projection relation, determine from the standard coordinate of standard faces to The functional relationship of the pixel coordinate of family face, described functional relationship is with described second spin matrix and the first displacement For parameter to be asked.

6. method as claimed in claim 4, it is characterised in that the described described picture obtained according to detection Element coordinate and standard coordinate corresponding to described pixel coordinate, carried out the unknown parameter in described functional relationship The step solved, including:

Described function is carried out Taylor expansion, obtains a Taylor expansion；

Set an initial value for described unknown parameter, and by method of least square, described Taylor expansion is entered The loop computation that row iteration updates, solves and obtains described unknown parameter.

7. the method as described in any one of claim 1-6, it is characterised in that described at described display screen On three-dimensional film source to be shown carried out the step that row's figure of bore hole stereo display processes, including:

Scheme the cycle according to described second coordinate and predetermined row, determine each unit of display on display screen Display properties, described display properties includes for indicating the left figure in the three-dimensional film source of display or the left and right figure of right figure Label and for indicate display location point the unit of display index；

Display properties according to each unit of display and three-dimensional film source to be shown, determine that each unit of display needs Color value to be shown also shows.

8. method as claimed in claim 7, it is characterised in that described showing according to each unit of display Show attribute and three-dimensional film source to be shown, determine that each unit of display needs the color value of display and shows Step, including:

According to the display properties of each unit of display, from described three-dimensional film source, obtain each unit of display corresponding The first color value；

Select the part shear point in the described unit of display or whole shear point, and to selected shear point Color value is adjusted, and makes color value corresponding to selected shear point reduce or reduces in shear point adjacent two The difference of the color value between the individual unit of display, wherein, described shear point includes different adjacent of left and right figure label The unit of display；

According to the color value that each unit of display after adjusting is currently corresponding, carry out color and show.

9. method as claimed in claim 8, it is characterised in that

When the color value making selected shear point reduces, described selected shear point color value is carried out Adjustment includes: the color value of selected shear point be multiplied with the first penalty coefficient, the face after being adjusted Colour；

When the difference of the color value reduced in shear point between adjacent two units of display, described to selected Shear point color value is adjusted including: by a unit of display in two units of display adjacent in shear point Color value deduct an adjusted value, and, by the first color value of another unit of display plus described adjustment Value, the color value after being adjusted, wherein, described adjusted value is these adjacent two unit of display current colors The difference of value and the product of one second penalty coefficient；

Wherein, described first penalty coefficient and the second penalty coefficient be more than 0 and a constant less than 1 or Random number.

10. method as claimed in claim 9, it is characterised in that described in select in the described unit of display Part shear point include: from whole corresponding points, randomly choose out described part shear point.

The device of 11. 1 kinds of bore hole stereo displays, it is characterised in that including:

Coordinate acquiring unit, sits at the photographic head that a photographic head is corresponding for obtaining user's face of active user The first coordinate under mark system；

Coordinate transformation unit, for according to display screen coordinate system corresponding to a predetermined display screen with Between the initial point of described photographic head coordinate system, displacement and described photographic head coordinate system are relative to display screen coordinate First spin matrix of system, is the second seat under described display screen coordinate system by described first Coordinate Conversion Mark；

Row's figure unit, for according to described second coordinate, to Stereogram to be shown on described display screen Source carries out row's figure of bore hole stereo display and processes.

12. devices as claimed in claim 11, it is characterised in that described first spin matrix is described Photographic head coordinate system relative to display screen coordinate system at the product of three axial three spin matrixs.

13. methods as claimed in claim 11, it is characterised in that described first coordinate is active user The central point between eyes coordinate under described photographic head coordinate system.

14. devices as claimed in claim 11, it is characterised in that described coordinate acquiring unit includes:

Modeling unit, for setting up the standard coordinate from a predetermined standard faces, arrives active user's The functional relationship of the pixel coordinate of facial image, wherein, described standard faces is positioned at photographic head coordinate system X/Y plane, and suppose active user face location by described standard faces according to one second spin matrix Obtaining after rotating and there occurs the first displacement, described second spin matrix and the first displacement are unknown parameters, institute Stating the pixel coordinate of facial image in functional relationship is the function about described unknown parameter；

Detector unit, for obtaining the facial image of the active user that camera collection arrives, detection obtains described The pixel coordinate of facial image, and determine the standard coordinate that described pixel coordinate is corresponding；

Solve unit, for the mark that the described pixel coordinate obtained according to detection and described pixel coordinate are corresponding Quasi coordinates, solves the unknown parameter in described functional relationship, obtains described second spin matrix and One displacement, by described first displacement, as user's face the first coordinate under described photographic head coordinate system.

15. devices as claimed in claim 14, it is characterised in that described modeling unit specifically for:

According to described second spin matrix and the first displacement, set up the actual coordinate of user's face of active user Coordinate transformation relation with the standard coordinate of described standard faces；

According to the inner parameter of predetermined photographic head, set up the actual coordinate of user's face to user's face Projection relation at the pixel coordinate of image coordinate system；

According to described coordinate transformation relation and described projection relation, determine from the standard coordinate of standard faces to The functional relationship of the pixel coordinate of family face, described functional relationship is with described second spin matrix and the first displacement For parameter to be asked.

16. devices as claimed in claim 14, it is characterised in that described in solve unit specifically for:

Described function is carried out Taylor expansion, obtains a Taylor expansion；

Set an initial value for described unknown parameter, and by method of least square, described Taylor expansion is entered The loop computation that row iteration updates, solves and obtains described unknown parameter.

17. devices as claimed in claim 11, it is characterised in that described row's figure unit includes:

Attribute determining unit, for scheming the cycle according to described second coordinate and predetermined row, determines display screen The display properties of each unit of display on curtain, described display properties includes for indicating in the three-dimensional film source of display The left and right figure label of left figure or right figure and for indicating the unit of display index of display location point；

Color display unit, for the display properties according to each unit of display and three-dimensional film source to be shown, Determine that each unit of display needs the color value of display and shows.

18. devices as claimed in claim 17, it is characterised in that described color display unit includes:

Color extraction unit, for the display properties according to each unit of display, obtains from described three-dimensional film source Obtain the first color value that each unit of display is corresponding；

Color adjusting unit, for selecting the part shear point in the described unit of display or whole shear point, And selected shear point color value is adjusted, make color value corresponding to selected shear point reduce or Reducing in shear point the difference of color value between adjacent two units of display, wherein, described shear point includes a left side The adjacent unit of display that right figure label is different；

Display processing unit, for the color value currently corresponding according to each unit of display after adjusting, is carried out Color shows.

19. devices as claimed in claim 18, it is characterised in that

Described color adjusting unit, is further used for when the color value making selected shear point reduces, will The color value of selected shear point is multiplied with the first penalty coefficient, the color value after being adjusted；And, When the difference of the color value reduced in shear point between adjacent two units of display, by shear point adjacent two The color value of a unit of display in the unit of display deducts an adjusted value, and, by another unit of display The first color value plus described adjusted value, the color value after being adjusted, wherein, described adjusted value was for should The difference of adjacent two unit of display current color values and the product of one second penalty coefficient；

Wherein, described first penalty coefficient and the second penalty coefficient be more than 0 and a constant less than 1 or Random number.

20. devices as claimed in claim 19, it is characterised in that described in state color adjusting unit, enter One step is for randomly choosing out described part shear point from whole corresponding points.

The electronic equipment of 21. 1 kinds of bore hole stereo displays, it is characterised in that including:

Housing, processor, memorizer, display screen, circuit board and power circuit, wherein, circuit board is pacified Put the interior volume surrounded at housing, processor and memorizer to arrange on circuit boards；Power circuit, is used for Each circuit or device for electronic equipment are powered；Memorizer is used for storing executable program code；Processor The journey corresponding with executable program code is run by reading the executable program code of storage in memorizer Sequence, for performing following steps:

The user's face of acquisition active user the first coordinate under the photographic head coordinate system that a photographic head is corresponding；

The display screen coordinate system corresponding according to a predetermined display screen and described photographic head coordinate system Initial point between displacement and described photographic head coordinate system relative to the first spin moment of display screen coordinate system Battle array, is the second coordinate under described display screen coordinate system by described first Coordinate Conversion；

According to described second coordinate, described display screen carries out bore hole to three-dimensional film source to be shown three-dimensional Row's figure of display processes.