CN108156442A - A kind of three-dimensional imaging processing method, device and electronic equipment - Google Patents

Abstract

The present embodiments relate to stereo display technique fields, specifically disclose a kind of three-dimensional imaging processing method, and method includes：Obtain the first left view and the first right view；Determine the spatial positional information of the first left view and the object in the first right view, according to the spatial positional information of object, with pre-set spatial positional information and the correspondence of parallax adjustment offset, the corresponding parallax adjustment offset of spatial positional information of object is determined；Offset is adjusted according to parallax, parallax adjustment is carried out to the first left view and the first right view, to obtain the second left view and the second right view, according to the second left view and the second right view, carries out three-dimensional imaging.By the above-mentioned means, the embodiment of the present invention, so as to meet the perception demand of user, can promote user's viewing experience to the carry out parallax adjustment of stereo-picture.

Description

A kind of three-dimensional imaging processing method, device and electronic equipment

Technical field

The present invention relates to a kind of stereo display technique field more particularly to three-dimensional imaging processing method, device and electronics to set It is standby.

Background technology

In daily life, if human eye is very near from observed objects, then can feel when human eye is look at object Feel that intraocular pressure is especially big, can feel special unnatural, so there are one more comfortable observed ranges for human eye.

And when being shown using stereoscopic display device to stereo-picture progress solid, stereo-picture shape in human eye Into stereoscopic effect it is not necessarily best, for example, it is possible to which the three-dimensional protruding effect of the scene can protrude very much, people is allowed to feel Feel very near apart from human eye, in this case, human eye can be very uncomfortable.Moreover, too many image is protruded in stereoscopic display, hold Crosstalk is also easy to produce, can also influence the effect of stereoscopic display to a certain extent.

Invention content

The embodiment of the present invention provides a kind of three-dimensional imaging processing method, device and electronic equipment, can solve the prior art It is possible that the problem of not feeling well when human eye watches stereoscopically displaying images, good stereo display effect is effectively ensured, meets The perception demand of user promotes user experience.

In a first aspect, the embodiment of the present invention provides a kind of three-dimensional imaging processing method, it is described applied to stereoscopic display device Binocular camera is provided on stereoscopic display device, the method includes：

Obtain the first left view and the first right view of the binocular camera shooting；

Determine the spatial positional information of first left view and the object in first right view；

Offset is adjusted with parallax according to the spatial positional information of the object and pre-set spatial positional information Correspondence, determine the spatial positional information corresponding parallax adjustment offset of the object；

Offset is adjusted according to the parallax, parallax adjustment is carried out to first left view and first right view, To obtain the second left view and the second right view, so that the parallax of second left view and second right view is relative to institute The parallax for stating the first left view and first right view increases or reduces the parallax adjustment offset；

According to second left view and second right view, three-dimensional imaging is carried out.

With reference to first aspect, it is described to determine first left view and institute in the first embodiment of first aspect The spatial positional information for stating the object in the first right view includes：

First left view and the corresponding depth map of first right view are obtained, according to the depth map, determines institute The depth information of the first left view and the object in second left view is stated, according to the depth information of the object, really The spatial positional information of the fixed object；

Or

Determine the image location information of object described in first left view and/or first right view, according to The image location information of the object determines the spatial positional information of the object.

In the first embodiment with reference to first aspect, in second of embodiment of first aspect, the acquisition First left view and the corresponding depth map of first right view include：

First left view and first right view correspondence that the ranging hardware provides are obtained at ranging hardware Depth map；

Or

Using Stereo Matching Algorithm, first left view and the corresponding depth map of first right view are obtained.

In the first embodiment with reference to first aspect, in the third embodiment of first aspect, the target Object is human eye；

The image location information packet for determining object described in first left view and/or first right view It includes：

Determine the human face region in first left view and/or first right view；

Using face alignment algorithm, the human face characteristic point of the human face region is detected；

According to the position of the human face characteristic point detected, determine the human eye in first left view and/or institute State the position in the first right view.

With reference to first aspect or first aspect the first to any one embodiment in the third embodiment, In 4th kind of embodiment of first aspect, the spatial positional information according to the object and pre-set space Location information and the correspondence of parallax adjustment offset determine the corresponding parallax adjustment of spatial positional information of the object Offset includes：

Using the spatial positional information of the object as index, pre-set offset data library, acquisition and institute are inquired State the corresponding parallax adjustment offset of spatial positional information；

Or

The spatial positional information of the object is substituted into the letter of pre-set parallactic shift amount and spatial positional information Number relationship obtains parallax adjustment offset corresponding with the spatial positional information.

The 4th kind of embodiment with reference to first aspect, it is described by described in the 5th kind of embodiment of first aspect The spatial positional information of object substitutes into pre-set parallactic shift amount and the functional relation of spatial positional information, acquisition and institute The corresponding parallax adjustment offset of spatial positional information is stated to include：

By the following formula, parallax adjustment offset corresponding with the spatial positional information is obtained：

Wherein, newp adjusts offset for parallax, and d is the spatial positional information of the object, d1 and d2 to set in advance The spatial position section put, p1 and p2 adjust offset for pre-set parallax corresponding with the d1 and d2.

With reference to first aspect, it is described according to second left view and institute in the 6th kind of embodiment of first aspect The second right view is stated, three-dimensional imaging is carried out and includes：

Second left view and second right view are synthesized into the second stereo-picture；

Bore hole stereoscopic display is carried out using second stereo-picture, so as to fulfill three-dimensional imaging.

With reference to first aspect, in the 7th kind of embodiment of first aspect, the first left view of the acquisition and first right side View includes：

Obtain the first left view and the first right view of binocular camera shooting；

Or

Stereo-picture is obtained, the stereo-picture includes the first left view and the first right view.

Second aspect, the embodiment of the present invention provides a kind of three-dimensional imaging processing unit, described applied to stereoscopic display device Binocular camera is provided on stereoscopic display device, described device includes：

First acquisition unit, for obtaining the first left view and the first right view of the binocular camera shooting；

First determination unit, for determining the space bit of the object in first left view and first right view Confidence ceases；

Second determination unit, for the spatial positional information according to the object and pre-set space bit confidence Breath and the correspondence of parallax adjustment offset determine the corresponding parallax adjustment offset of spatial positional information of the object Amount；

Processing unit, for adjusting offset according to the parallax, to first left view and first right view Parallax adjustment is carried out, to obtain the second left view and the second right view, so that second left view and second right view Parallax increase or reduce the parallax relative to the parallax of first left view and first right view and adjust offset；

Display unit, for according to second left view and second right view, carrying out three-dimensional imaging.

With reference to second aspect, in the first embodiment of second aspect, first determination unit includes：

First acquisition module, for obtaining first left view and the corresponding depth map of first right view；

First determining module, for according to the depth map, determining in first left view and second left view Object depth information；

Second determining module for the depth information according to the object, determines the space bit confidence of the object Breath；

Or

Third determining module, for determining object described in first left view and/or first right view Image location information；

4th determining module for the image location information according to the object, determines the space bit of the object Confidence ceases.

With reference to the first embodiment of second aspect, in second of embodiment of second aspect, described first obtains Modulus block is specifically used for：

First left view and first right view correspondence that the ranging hardware provides are obtained at ranging hardware Depth map；

Or

Using Stereo Matching Algorithm, first left view and the corresponding depth map of first right view are obtained.

With reference to the first embodiment of second aspect, in the third embodiment of second aspect, the object For human eye；

The third determining module is specifically used for：

Determine the human face region in first left view and/or first right view；

Using face alignment algorithm, the human face characteristic point of the human face region is detected；

According to the position of the human face characteristic point detected, determine the human eye in first left view and/or institute State the position in the first right view.

With reference to any one embodiment in the first of second aspect or second aspect to the third embodiment, In 4th kind of embodiment of second aspect, second determination unit includes：

Enquiry module, for using the spatial positional information of the object as index, inquiring pre-set offset number According to library, parallax adjustment offset corresponding with the spatial positional information is obtained；

Or

Computing module, for the spatial positional information of the object to be substituted into pre-set parallactic shift amount and space The functional relation of location information obtains parallax adjustment offset corresponding with the spatial positional information.

With reference to the 4th kind of embodiment of second aspect, in the 5th kind of embodiment of second aspect, the calculating mould Block is specifically used for：

By the following formula, parallax adjustment offset corresponding with the spatial positional information is obtained：

Wherein, newp adjusts offset for parallax, and d is the spatial positional information of the object, d1 and d2 to set in advance The spatial position section put, p1 and p2 adjust offset for pre-set parallax corresponding with the d1 and d2.

With reference to second aspect, in the 6th kind of embodiment of second aspect, the display unit includes：

Synthesis module, for second left view and second right view to be synthesized the second stereo-picture；

Image-forming module carries out bore hole stereoscopic display, so as to fulfill three-dimensional imaging using second stereo-picture.

With reference to second aspect, in the 7th kind of embodiment of second aspect, the first acquisition unit is specifically used for：

Obtain the first left view and the first right view of binocular camera shooting；

Or

Stereo-picture is obtained, the stereo-picture includes the first left view and the first right view.

The third aspect, the embodiment of the present invention provide a kind of electronic equipment, including：

At least one processor；And

The memory being connect at least one processor communication；Wherein,

The memory is stored with the instruction that can be performed by least one processor, and described instruction is by described at least one A processor performs, so that at least one processor is able to carry out three-dimensional imaging processing method as described above.

Fourth aspect, the embodiment of the present invention provide a kind of computer readable storage medium, the computer-readable storage medium Matter is stored with computer executable instructions, the computer executable instructions for make computer perform it is as described above it is three-dimensional into As processing method.

5th aspect, the embodiment of the present invention additionally provide a kind of computer program product, the computer program product packet The computer program being stored on computer readable storage medium is included, the computer program includes program instruction, when the journey When sequence instruction is computer-executed, the computer is made to perform three-dimensional imaging processing method as described above.

The advantageous effect of the embodiment of the present invention is：It is different from the situation of the prior art, solid provided in an embodiment of the present invention Image processing method, device and electronic equipment, after the first left view and the first right view is got, it is first determined the first left view The spatial positional information of object in figure and the first right view, i.e. object are regarded relative to the first left view of shooting and first right side The spatial positional information of the stereo camera of figure based on the spatial positional information, determines that parallax adjusts offset, and is regarded based on this Difference adjustment offset carries out parallax adjustment to first left view and first right view, obtains the second left view and second Right view, that is, so that parallax between second left view and second right view relative to first left view and Parallax between first right view increases or reduces parallax adjustment offset size, according further to second left view and Second right view carries out three-dimensional imaging, can change the stereo concave-convex display effect that the stereo-picture is showed, provide Good stereo display effect for a user, the eyes for avoiding the occurrence of user watch the feelings not felt well during stereo-picture Condition so as to meet the perception demand of user, promotes user's viewing experience.

Description of the drawings

In order to illustrate the technical solution of the embodiments of the present invention more clearly, it will make below to required in the embodiment of the present invention Attached drawing is briefly described.It should be evident that drawings described below is only some embodiments of the present invention, for For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings Attached drawing.

Fig. 1 is a kind of flow diagram for three-dimensional imaging processing method that the embodiment of the present invention one provides；

Fig. 2 is the example schematic diagram of the first left view that the embodiment of the present invention one provides and the first right view；

Fig. 3 is the example schematic diagram of the second left view that the embodiment of the present invention one provides and the second right view；

Fig. 4 is the flow diagram of another three-dimensional imaging processing method provided by Embodiment 2 of the present invention；

Fig. 5 is third left view graph region provided by Embodiment 2 of the present invention and the example schematic diagram in third right view region；

Fig. 6 is the example schematic diagram of the second left view and the second right view provided by Embodiment 2 of the present invention；

Fig. 7 is a kind of structure diagram for three-dimensional imaging processing unit that the embodiment of the present invention three provides；And

Fig. 8 is the structure diagram for a kind of electronic equipment that the embodiment of the present invention four provides.

Specific embodiment

In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, it is right The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only to explain the present invention, not For limiting the present invention.

If it should be noted that not conflicting, each feature in the embodiment of the present invention can be combined with each other, in this hair Within bright protection domain.In addition, though having carried out function module division in schematic device, show patrol in flow charts Sequence is collected, but in some cases, it can be with shown in the sequence execution in the module division being different from device or flow chart The step of going out or describing.In addition, the printed words such as " first " " second " " third " " 4th " employed herein to data and are not held Row order is defined, and is only that function and the essentially identical identical entry of effect or similar item are distinguished.

In recent years, the stereo display techniques such as 3D, VR already become a research hotspot of display field, and are widely used in The numerous areas such as advertisement, game, video display, science and technology.With the development of stereo display technique, people are to the viewing experience of stereo content It also proposed higher requirement.Particularly, in the field high to vision shock effect requirements such as video display, game, in order to pursue Image or portrait protrusion show the negative parallax display effect of screen, are clapped usually when shooting stereo-picture using larger binocular Take the photograph the acquisition that spacing carries out binocular view so that shooting obtains binocular view with larger negative parallax value, so as in Reference object is now built during the binocular view apart from the very near negative parallax stereo display effect of eyes of user.

However, in daily life, if human eye is very near from observed objects, then when human eye is look at object It can feel that intraocular pressure is especially big, can feel special unnatural, so more comfortable observed range there are one human eyes, but everyone Observation comfort zone also can difference.Also, in stereo display technique, the picture that is obtained by stereoscopic shooting, including true Real scene image and virtual scene image, when carrying out stereoscopic display using stereoscopic display device, the practical shape in human eye Into stereoscopic effect it is not necessarily best.It can be seen that show identical stereogram on different stereoscopic display devices Picture even shows identical stereo-picture on identical stereoscopic display device but goes to experience by different users, and having can Different viewing effect can be obtained.For example, it is possible to which the three-dimensional protruding effect of the scene can protrude very much, people is allowed to feel distance Human eye is very near, and in this case, human eye can be very uncomfortable.Moreover, too many image is protruded in stereoscopic display, easily generate Crosstalk can also influence the effect of stereoscopic display to a certain extent.

Based on this, an embodiment of the present invention provides a kind of three-dimensional imaging processing method, device and stereoscopic display device, for In the stereo-picture captured by the binocular camera set on stereoscopic display device, before stereoscopic display is carried out, stereogram is detected As in object spatial positional information, i.e., stereo-picture relative to binocular camera spatial positional information, due to binocular Distance of the spacing and binocular camera of camera apart from photographed scene can influence the parallax of captured stereo-picture, and be somebody's turn to do Spatial positional information can characterize the binocular camera distance objective object i.e. distance of photographed scene, therefore, can obtain corresponding Parallax adjusts offset, and then carries out parallax adjustment processing to stereo-picture to be shown according to the parallactic shift amount, by regarding Difference adjustment processing changes the parallax of stereo-picture, therefore, can improve the stereo concave-convex display effect that the stereo-picture is showed Fruit provides good stereo display effect for a user, avoid the occurrence of user eyes viewing stereo-picture when feel not Suitable situation so as to meet the perception demand of user, promotes user's viewing experience.

Wherein, which can be applied to arbitrary electronic equipment, such as：3D display equipment, VR glasses etc., It is specifically as follows mobile phone, tablet computer, personal computer, stereoscopic display etc., passes through the first left view to getting (that is, original left view of a certain stereo-picture) and the first right view (that is, original right view of the stereo-picture) carry out parallax Adjustment processing gets the second left view (that is, treated left view) and the second right view (that is, treated right view), makes The pixel of same position in the first left view and the first right view is obtained in second left view and second right view Horizontal displacement enables to the parallax between second left view and second right view relative to first left view And the first parallax between right view increases or reduces, further, according to second left view and second right view Three-dimensional imaging is carried out, the stereo concave-convex display effect that the stereo-picture is showed can be changed, so as to meet the perception of user Demand promotes user's viewing experience.Also, it can also effectively avoid due to shadows such as the crosstalks that three-dimensional concave-convex effect is prominent and brings The problem of ringing stereo display effect.

Three-dimensional imaging processing method provided in an embodiment of the present invention can be applied to a variety of scenes that stereo-picture is presented, example Such as：The parallax of stereo-picture can be adjusted according to three-dimensional imaging process instruction input by user when showing stereo-picture It is whole, the viewing demand of sense is felt or is recessed to the protrusion of stereo-picture to meet user；Alternatively, it can be used for aobvious according to solid Show that the parallax tolerance of equipment carries out parallax adjustment to stereo-picture or three-dimensional video-frequency, it can be in the stereoscopic display device In show best stereo display effect.

Need what is illustrated, in the embodiment of the present invention, say parallax as the known concept in stereo display technique, here not into Row detailed description, in simple terms, says that parallax refers to, due to normal interpupillary distance and gaze angle difference, causes left and right For image on eyes retina there are a degree of level difference, " parallax " specifically refers to a certain reference object in left view As and its picture in right view horizontal offset, if the reference object in left view as it is opposite its in right view As horizontal-shift to the left, then positive parallax is formed, it is bigger that this faces absolute value of the difference (i.e. its horizontal offset), is carrying out three-dimensional show The recessed sense of the reference object is stronger when showing；If picture of the reference object in left view and its horizontal-shift in right view Amount is zero, then forms parallax free, and when carrying out stereoscopic display, the reference object is located on display screen；If the reference object is on a left side Picture in view then forms negative parallax with respect to its picture in right view horizontal-shift to the right, the absolute value of the negative parallax (i.e. its Horizontal offset) it is bigger, when carrying out stereoscopic display, the protrusion sense of the reference object is stronger.In embodiments of the present invention, pass through Picture of the reference object in left view is adjusted with respect to the leftward or rightward horizontal offset of its picture in right view to adjust this The concave-convex sense of stereo-picture, so as to meet the viewing demand of user.

In addition it is also necessary to explanation is：In embodiments of the present invention, unless otherwise specified, the value of " parallax " is actual value, Including positive value, zero-sum negative value, when the parallax value of stereo-picture is positive value, positive parallax display effect is showed, value is bigger, recessed It is stronger into feeling；When the parallax value of stereo-picture is zero, parallax free display effect is showed；When the parallax value of stereo-picture is negative During value, negative parallax display effect is showed, value is smaller, and protrusion sense is stronger.Therefore, in embodiments of the present invention, when needs obtain When obtaining stronger recessed sense, parallax can be increased；When needing to obtain stronger protrusion sense, parallax can be reduced.

Below in conjunction with the accompanying drawings, the embodiment of the present invention is further elaborated.

Embodiment one

Fig. 1 is a kind of flow diagram of three-dimensional imaging processing method provided in an embodiment of the present invention, at the three-dimensional imaging Reason method can be performed by any type of electronic equipment, in the present embodiment, be using the electronic equipment as stereoscopic display device Example illustrates.

Specifically, referring to Fig. 1, the three-dimensional imaging processing method can include but is not limited to following steps：

110th, the first left view and the first right view are obtained.

In the present embodiment, the first left view and the first right view are discrete before this in advance, obtain first in this step respectively Left view and the first right view.And the first left view and the first right view can also be synthesized on a stereo-picture, Ke Yitong It crosses and obtains the stereo-picture, obtain the first left view and the first right view." first left view " can be that any one is vertical The original left view of body image, " first right view " is then the original right view of the stereo-picture, by respectively should The left eye viewing that first left view is presented to the user, the right eye which is presented to the user are watched, you can in user Brain in form the stereo-picture.Wherein, which can be existing, i.e. pre-stored or real-time It is obtaining, for example, being obtained at some data source or current carrying out what stereoscopic shooting obtained.

Wherein, first left view and the first right view are by multiple regularly arranged along horizontal direction and vertical direction Pixel is formed, and " pixel " refers to the minimum unit of image, and therefore, picture material is in the first left view or the first right view In position can be characterized by the position of pixel corresponding with the picture material.In the present embodiment, the first left view There is the pixel of corresponding pixel, i.e. same position with the first right view, also that is, " corresponding pixel " refers to when by the When one left view and the first right view are overlapped, co-located a pair of of pixel, that is to say, that " corresponding pixel " i.e. The pixel of same position in first left view and the first right view.Generally, due to being stereo-picture, the two For pixel there are parallax, picture material, that is, pixel value is different.Certainly, the picture material in the two pixels can be phase Same can also be different, if the picture material in the two pixels is identical, illustrate the first left view and first right side Between view the parallax of the point may be 0, if the picture material in the two pixels differs, illustrate the first left view and The parallax of the point between first right view may not be 0.

Such as：As shown in Fig. 2, Fig. 2 (a) is the first left view of a stereo-picture, by regularly arranged pixel area Domain a, b, c, d, e, f, g, h, i, j, k and m are formed；For the benefit of understand, including a pixel here with pixel region carries out Explanation.Fig. 2 (b) is the first right view of the stereo-picture, is made of A, B, C, D, E, F, G, H, I, J, K and M；When by first When left view and the first right view are overlapped, as shown in Fig. 2 (c), pixel a-A, b-B, c-C, d-D, e-E, f-F, g-G, h-H, I-I, j-J, k-K and m-M difference are co-located, therefore, pixel a and pixel A be " corresponding pixel " (or Claim, the pixel of same position in the first left view and the first right view), similarly it is found that b-B, c-C, d-D, e-E, f-F, g- G, h-H, i-I, j-J, k-K and m-M are also " corresponding pixel ".It should be understood that in practical applications, the first left view Figure and the first right view can be made of more pixels, usually, with the number of pixels in horizontal direction in view and vertically Number of pixels on direction characterizes the resolution ratio of the view, such as：View has 1920 pixels in the horizontal direction, vertical There are 1080 pixels on direction, then the resolution ratio of the view is 1920*1080.

Specifically, in the present embodiment, according to different application scenarios, can the first left view be obtained by different modes Figure and the first right view.For example, in some embodiments, first left view and the first right view is are acquired by binocular camera The binocular view arrived, then, in the application scenarios, the specific embodiment of the first left view of the acquisition and the first right view can To be：Obtain the first left view and the first right view of binocular camera shooting.For another example, in further embodiments, this first Left view and the first right view are the original left view and original right view in a certain existing stereo-picture, then, in the application In scene, first left view and the specific embodiment of the first right view of obtaining can also be：It is existing to directly acquire this Stereo-picture includes first left view and the first right view in the stereo-picture.

Optionally, in practical applications, stereoscopic display device can receive regarding about a certain stereo-picture of adjustment When " the three-dimensional imaging process instruction " of difference, the first left view and the first right view of the stereo-picture are obtained.Wherein, the stereogram As that can be existing, it can also currently carry out what stereoscopic shooting obtained.Being somebody's turn to do " three-dimensional imaging process instruction " can be aobvious by solid Show that equipment autonomously is sent out, such as：When stereoscopic display device judges the maximum negative parallax value (minimum of the stereo-picture of the stereo-picture The absolute value of parallax value) or maximum face difference more than its parallax tolerance when, automatic trigger should " three-dimensional imaging processing refers to Enable ", to increase or reduce the parallax of the stereo-picture, the stereo-picture is enable to be showed most in the stereoscopic display device Good display effect.Alternatively, being somebody's turn to do " three-dimensional imaging process instruction " can also be sent out by user, such as：User is watching a certain stand It during body image, needs to adjust the concave-convex display effect of the stereo-picture, can be inputted by any way to stereoscopic display device " three-dimensional imaging process instruction ".

120th, the spatial positional information of the first left view and the object in the first right view is determined.

It is in this step, determining first left view and first is right after the first left view and the first right view is got The spatial positional information of view, specifically, object is opposite in scene of the spatial positional information captured by binocular camera The spatial positional information of binocular camera is answered, distance of the object apart from binocular camera, i.e., double when can be used for characterizing shooting The shooting distance of mesh camera.Specifically, the spatial positional information includes the distance of object and binocular camera.

Known in those skilled in the art, the spacing of binocular camera, the shooting distance of binocular camera can influence The parallax of captured obtained stereo-picture, the i.e. parallax of the first left view and the first right view, in the spacing of binocular camera In the case of fixed setting, captured by the obtained parallax of stereo-picture be substantially dependent upon shooting distance, therefore, can basis The shooting distance tentatively judges whether the parallax of the object is reasonable, that is, whether the parallax of the stereo-picture is reasonable, if energy One good stereo display effect etc. is provided.Based on this, in the embodiment of the present invention, determine object relative to binocular camera shooting The spatial positional information of head determines that the parallax of stereo-picture adjusts offset, so as to change this based on the spatial positional information The stereo concave-convex display effect that stereo-picture is showed provides good stereo display effect for a user, avoids out Situation about not feeling well during the eyes viewing stereo-picture at current family, meets the perception demand of user, promotes user's viewing experience.

Wherein, why not object limits, the shooting main body being specifically as follows in the first left view and the first right view, example If personage, a certain position of personage, article, special marking object are (being specially placed in photographed scene for marking shooting distance Article, for example, sphere, number slip, scale, with figuratum label etc.).Due to it needs to be determined that the spatial position of the object Therefore information, can choose the things mesh the most for being easy to accurately obtain spatial positional information according to specific application scenarios Mark object.For example, it is directed to self-timer scene, i.e., user uses the three-dimensional character image that Self-timer is shot, then can will be three-dimensional The a certain position of personage or personage in image are as object, such as human eye.

Specifically, the space bit confidence of object in the first left view and the first right view can be determined there are many mode Breath, for example, can there is following two ways：

First, obtaining the first left view and the corresponding depth map of the first right view first, then according to depth map, is determined The depth information of one left view and the object in the second left view, since depth map and the first or so view have corresponding close System therefore, it is possible to read the depth information of object from depth map, based on the depth information, that is, determines the sky of object Between location information.

Wherein it is possible to using in the prior art any one can obtain the method for depth map and get depth map.Example Such as, Stereo Matching Algorithm, such as spsstereo algorithms may be used, obtain the first left view and the corresponding depth of the first right view Degree figure.Further, it is also possible to the first left view and the corresponding depth of the first right view that ranging hardware provides are obtained at ranging hardware Degree figure.Electronic equipment can be additionally provided with ranging hardware, for example, infrared distance measurement, laser ranging, light sensing is away from ultrasound Away from, structure light measurement, Kinect either the ranging hardware such as RGBD depth camera heads of class Kinect can provide depth map or Therefore the depth information of each position point in photographed scene, can obtain the first left view at ranging hardware and first right side regards Scheme corresponding depth map, i.e. depth information.

Second, can object in the view be determined according to a view in the first left view and the second right view Then image location information, i.e. pixel coordinate utilize the image location information and the inside and outside parameter of corresponding binocular camera Carry out coordinate transform, you can get the spatial positional information of object.For example, when object is behaved at the moment, it can be first Advanced row recognition of face determines the human face region in the first left view and/or the first right view, next, utilizing well known people Face alignment algorithm detects the human face characteristic point of human face region, according to the position of the human face characteristic point detected, determines human eye Picture position in one left view and/or the first right view, i.e. pixel coordinate, and then by coordinate transform, you can get people The spatial positional information of eye.

Of course, it is possible to open view using the first left view and the first right view two, it is first determined the mesh in this two views Mark the image location information of object, a kind of mode using the image location information and corresponding binocular camera inside and outside parameter into Row coordinate transform, you can get the spatial positional information of object, another way can also utilize object at this two Picture position on view determines the parallax of the object in this two views, object is determined according to the parallax of object Spatial positional information.

130. offset is adjusted with parallax according to the spatial positional information of object and pre-set spatial positional information Correspondence, determine the spatial positional information corresponding parallax adjustment offset of object.

In the embodiment of the present invention, it can be established i.e. advance by the modes such as experiment, K-theoretic operation K or the mode being combined in advance The correspondence of installation space location information and parallax adjustment offset, will be according to the previously determined space bit in this step Confidence ceases and preset correspondence, determines that parallax adjusts offset.

For object in the spatial positional information of partial section, the at this time parallax of the first left view and the first right view ratio Relatively rationally, good stereo display effect can be provided, then the corresponding parallax of the spatial positional information in the section can be adjusted Offset is set as 0, that is, does not need to carry out the first left view and the first right view the adjustment on parallax.

Specifically, it can build experiment scene for the binocular camera set by stereoscopic display device, taken the photograph with the binocular It takes the photograph and takes pictures as head, its stereoscopic effect is then watched on stereoscopic display device, and regard according to required target effect adjusting Difference sets parallax to adjust offset, the adjusted numerical value of record, and so on, record the positions of multiple typical camera sites Put the incidence relation with parallax adjustment offset.In this step, i.e., in really actual use process, the space bit that will be got The corresponding parallax adjustment offset of the spatial positional information is searched in input of the confidence breath as inquiry in above-mentioned incidence relation, If the value of this spatial positional information is between exemplary position point distance1, distance2 in incidence relation, then can adopt With the mode of linear interpolation, the corresponding parallax adjustment offset of the spatial positional information is calculated, is cut out in this, as follow-up dislocation The numerical value cut.

It gives a concrete illustration, such as：For following shooting distance distance (i.e. spatial positional information)：distance ={ 300,350,400,450,500,550,600,650,700 }, corresponding parallax adjustment offset are：PixValues= {40,30,22,16,10,7,5,1,0}；Between the shooting distance d got is in the two values in above-mentioned distance, Then, the method that linear interpolation may be used determines the parallax adjustment offset under d correspondences, and it is pre-set distance to remember d1, d2 Interval value, the corresponding parallax adjustment offset of p1, p2 d1, d2, then can be according to equation below：

It understands：

Wherein, newp adjusts offset for parallax.Assuming that d=340, then d1=300, d2=350, p1, p2 are 30 and 40.

Specifically, experiment scene can also be built for the binocular camera set by stereoscopic display device, with the binocular Camera, which is taken the photograph, takes pictures, its stereoscopic effect is then watched on stereoscopic display device, and adjust according to required target effect Parallax sets parallax to adjust offset, record adjusted numerical value, and so on, record multiple typical camera sites Position adjusts offset with parallax, then, based on this multiple position and parallax adjustment offset, carries out Function Fitting, gets The functional relation of parallactic shift amount and spatial positional information then, in this step, i.e., in really actual use process, will obtain The spatial positional information arrived is updated in above-mentioned functional relation, so as to obtain, the spatial positional information is corresponding to be regarded as input Difference adjustment offset.

140th, offset is adjusted according to parallax, parallax adjustment is carried out to the first left view and the first right view, obtains second Left view and the second right view.

Wherein, after parallax adjusts, the parallax of the second left view and the second right view is relative to first left view Parallax adjustment offset is increased or reduced with the parallax of first right view.

In the case that known to parallax adjustment offset, any one well known mode may be used and carry out parallax adjustment, For example, the mode of picture element interpolation, those skilled in the art can reasonably select, and the present invention does not limit this.

In the embodiment of the present invention, it will thus provide one kind into line misregistration by the first left view and the first right view by cutting processing The mode for obtaining the second left view and the second right view carries out parallax adjustment.

In the present embodiment, " the second left view " refers to that is obtained after cutting processing into line misregistration to the first left view regards Figure, " the second right view " refer to the view that obtains after cutting processing into line misregistration to the first right view, second left view and the Two right views show the target stereo-picture of equipment for compound stereoscopic.Wherein, the second left view and the second right view have phase With resolution ratio (pixel number), but in the first left view and the first right view same position pixel (that is, as above " corresponding pixel ") horizontal displacement in the second left view and the second right view, so that the second left view and second right side Parallax between view increases or reduces the distance of horizontal displacement relative to the parallax between the first left view and the first right view. The distance of the horizontal displacement is that aforementioned parallax adjusts offset size, that is, the variable of parallax,

According to stereo display technique it is found that the concave-convex display effect of stereo-picture is determined by the parallax of stereo-picture, thirty years of age When the parallax of body image refers to be overlapped or is side by side up and down the left view of stereo-picture and right view, a certain reference object is on a left side The horizontal offset of picture and its picture in right view in view, therefore, in embodiments of the present invention, by the first left view Figure and the first right view carry out the mode that wrong figure cuts processing and change picture of the reference object in the second left view with it second The horizontal offset of picture in right view is to adjust the parallax of stereo-picture.Wherein, due to picture material in the first left view or Position in the first right view of person can be characterized by the position of pixel corresponding with the picture material, therefore, in this hair In bright embodiment, it can be existed by " corresponding pixel " (pixel of same position) in the first left view and the first right view The second left view and distance of horizontal displacement states parallax knots modification in the second right view, wherein, it should " parallax knots modification " That is the parallax value (that is, parallax between the second left view and the second right view) of target stereo-picture and regarding for original three-dimensional image The difference of difference (that is, parallax between the first left view and the first right view).

Specifically, in the present embodiment, offset is adjusted according to parallax, first left view and first right side is regarded Figure cuts processing into line misregistration, obtains the specific embodiment of the second left view and the second right view and can be：

In the picture material of the first lateral incision water removal square upward first width of first left view, the second left view is obtained Figure；And first right view the second side excision horizontal direction on the first width picture material, obtain second right side regard Figure.

Wherein, described " the first width " adjusts offset equal to parallax.

Wherein, described " the first side " is the side in left side and right side, and " the second side " is another in left side and right side Side, that is to say, that if first side is left side, the second side is right side；If first side is right side, described The second side is left side.

Wherein, if in the left side of first left view excision horizontal direction the first width picture material, obtain the Two left views and, the right side of first right view excision horizontal direction on the first width picture material, obtain second Right view, then, the parallax between the second left view and the second right view that are obtained are regarded relative to the first left view and first right side Parallax between figure increases first width.

If the picture material of the first width, obtains the second left view in the right side of first left view excision horizontal direction Figure and, the left side of first right view excision horizontal direction on the first width picture material, obtain second right side regard Figure, then, parallax between the second left view and the second right view that are obtained relative to the first left view and the first right view it Between parallax reduce first width.

In practical applications, can offset be adjusted according to parallax and determines the first width to be cut off, and then, according to parallax The corresponding parallax adjustment direction of adjustment offset determines (corresponding to increase in the left side of the first left view and the right side of the first right view Big parallax), alternatively, in the right side of the first left view and the left side of the first right view (corresponding to reduce parallax), cut off level side The picture material of upward first width, so as to obtain the second left view and the second right view.

For example：When carrying out parallax adjustment to the first left view as shown in Figure 2 and the first right view, it is assumed that institute is really Distance of the fixed parallax adjustment offset for 1 pixel.

If increase parallax, then 1 pixel is cut off apart from corresponding figure in the left side of the first left view in the horizontal direction Picture content, i.e.,：The corresponding picture material of pixel a, b and c is cut off, so as to obtain the second left view as shown in Fig. 3 (a)； The right side of first right view cuts off 1 pixel apart from corresponding picture material, i.e.,：Cut off the corresponding image of pixel J, K and M Content, so as to obtain the second right view as shown in Fig. 3 (b).Wherein, comparison diagram 3 (a) and Fig. 3 (b) are as it can be seen that the first left view Pixel " d-D " with same position in the first right view is in the second left view (Fig. 3 (a)) and the second right view (Fig. 3 (b)) The distance of 1 pixel of horizontal displacement, and when by the second left view and the overlapping of the second right view, pixel d generic pixel points D To left, so as to which the parallax between second left view and second right view is regarded relative to the first left view and first right side Parallax between figure increases the distance of 1 pixel.

If reducing parallax, 1 pixel is cut off on the right side of the first left view in the horizontal direction apart from corresponding image Content, i.e.,：The corresponding picture material of pixel j, k and m is cut off, so as to obtain the second left view as shown in Fig. 3 (c)； The left side of one right view cuts off 1 pixel apart from corresponding picture material, i.e.,：It cuts off in the corresponding image of pixel A, B and C Hold, so as to obtain the second right view as shown in Fig. 3 (d).Wherein, comparison diagram 3 (c) and Fig. 3 (d) as it can be seen that the first left view and The pixel " d-D " of same position is in second left view (Fig. 3 (c)) and second right view (Fig. 3 (d)) in first right view The distance of middle 1 pixel of horizontal displacement, and when second left view and second right view are overlapped, pixel d is opposite Pixel D is to right translation, so as to which, parallax between second left view and second right view is relative to the first left view and the Parallax between one right view reduces the distance of 1 pixel.

Further, since after cutting processing into line misregistration to the first left view and the first right view, the second left view of acquisition Figure and the pixel of the second right view in the horizontal direction tail off, therefore, in application scenes, if three-dimensional imaging is handled Stereo-picture afterwards shown by same stereoscopic display device, the three-dimensional imaging that user sees treated stereo-picture phase Original three-dimensional image is widened in the horizontal direction.

Based on this, in some embodiments, offset is adjusted according to parallax, to first left view and first right side View cuts processing into line misregistration, and obtaining the specific embodiment of the second left view and the second right view can also include but unlimited In following three kinds：

It (1), in the first embodiment, can be in the first lateral incision of first left view water removal square upward first The picture material of width obtains the 4th left view, is spelled on the first side of the 4th left view and/or the second side horizontal direction Pure color picture is connect, obtains second left view, so that the size of second left view keeps one with first left view It causes；Meanwhile first right view the second side excision horizontal direction on the first width picture material, obtain the 4th right side regard Figure splices pure color picture on the first side of the 4th right view and/or the second side level side, obtains second right side and regards Figure, so that the size of second right view is consistent with first right view.

Wherein, first width is equal to parallax adjustment offset, and first side is one in left side and right side Side, the second side are the opposite side in left side and right side.Specifically, " the 4th left view " described in acquisition and " the 4th right side The mode of view " may refer to the description in above-described embodiment, just be not described further in detail herein.

Wherein, in this embodiment, the 4th left view and the 4th right view homonymy splicing pure color picture.Than Such as, splice the picture material pure color picture of the same size with cutting away in the left side of the 4th left view and the 4th right view；Alternatively, Splice the picture material pure color picture of the same size with cutting away on the right side of the 4th left view and the 4th right view；Alternatively, Pure color picture is spliced in the left and right sides of 4th left view and the 4th right view, the gross area of the pure color picture and the image cut away Content it is in the same size.Wherein, in some embodiments, in order to show better stereo display effect, on the 4th left side The pure color picture of same size is spliced in the left and right sides of view and the 4th right view respectively, and the pure color picture is in the horizontal direction Length be first width half.Wherein, which can be random color, preferably, in order to avoid this is pure Chromatic graph piece interferes stereo-picture the viewing experience so as to reduce user, and the color of the pure color picture is in this embodiment Black.

So as to, the second left view and the second right view obtained through the above way can make three-dimensional imaging treated it is vertical The size and Aspect Ratio of picture material in body image are consistent with original three-dimensional image.

It (2), in the second embodiment, can be in the first lateral incision of first left view water removal square upward first The picture material of width, and in the third side of first left view and/or the 4th lateral incision except the second width on vertical direction Picture material obtains second left view so that the length of second left view in the horizontal direction in vertical direction On the ratio of width be consistent with first left view；Meanwhile cut off level in the second side of first right view The picture material of first width on direction, and in the third side of first left view and/or the 4th lateral incision except on vertical direction The picture material of second width obtains second right view, and the length of second right view in the horizontal direction is with erecting The ratio of the upward width of Nogata is consistent with first right view；

Wherein, first width is equal to parallax adjustment offset, and first side is one in left side and right side Side, the second side are the opposite side in left side and right side.Specifically, to the first left view and the first right view in the horizontal direction The mode that enterprising line misregistration is cut can equally refer to the description in above-described embodiment, also no longer carefully state one by one herein.

Wherein, second width is cut width in the vertical direction, which can be according to described first Width and, the length of the left view of the first left view/second in the horizontal direction and the length-width ratio of width in the vertical direction Example, to determine.

Wherein, the third side is the side in the upper side and lower side, and the 4th side is the opposite side in the upper side and lower side, Picture material on first left view and the first right view homonymy excision vertical direction.For example, on described first left side The picture material of second width on the upside of view and first right view excision vertical direction；Alternatively, on described first left side The picture material of second width on the downside of view and first right view excision vertical direction；Alternatively, on described first left side The picture material of same widths on the both sides up and down of view and first right view excision vertical direction, also, in vertical side The overall width cut off upwards is equal to second width.

It (3), can be in the first lateral incision of first left view water removal square upward first in the third embodiment The picture material of width obtains the 5th left view；Vertical direction is removed in the third side of the 5th left view and/or the 4th lateral incision The picture material of upper second width obtains second left view, so that the length of second left view in the horizontal direction It is consistent with the ratio of width in the vertical direction with first left view；And in first right view Two lateral incisions remove water the picture material of square upward first width, obtain the 5th right view；In the third side of the 5th right view And/or the 4th lateral incision except the picture material of the second width on vertical direction, obtain second right view, second right view Length in the horizontal direction and the ratio of width in the vertical direction are consistent with first right view.

Wherein, first width is equal to parallax adjustment offset, and first side is one in left side and right side Side, the second side be left side and right side in opposite side, the third side be the upper side and lower side in side, the second side For the opposite side in the upper side and lower side, the image on the 5th left view and the 5th right view homonymy excision vertical direction Content.

Wherein, the way of example (3) is roughly the same with the above embodiment (2), differs only in, in embodiment (2) in, at the same in the horizontal direction with the first left view and the first right view are cut on vertical direction to obtain second Left view and the second right view；And in embodiment (3), first in the horizontal direction to the first left view and the first right view into Row is cut, and obtains the 5th left view and the 5th right view, so in the vertical direction to the 5th left view and the 5th right view into Row is cut, and obtains second left view and second right view.

Second left view and the second right view are obtained by the above embodiment (2) or (3), other figures can not introduced The Aspect Ratio that the picture material in stereo-picture is kept under conditions of piece is consistent with original three-dimensional image.

150th, according to second left view and second right view, three-dimensional imaging is carried out.

It should be noted that after the second left view and the second right view is obtained, two views can be preserved, and can be by institute The second or so the view preserved is sent to external stereoscopic display device and carries out stereoscopic display.With itself having stereoscopic display work( Can, then it can directly carry out three-dimensional imaging.

In the present embodiment, the first left view and the first right view are handled by way of cutting and waiting parallaxes adjustment and obtains the After two left views and the second right view, the left eye for being presented to the user the second left view by stereoscopic display device is watched, by the The right eye viewing that two right views are presented to the user, so as to fulfill three-dimensional imaging.

Alternatively, in some other embodiments, if the stereoscopic display device is bore hole stereoscopic display equipment, by regarding It, can also be first by second left side after difference the first left view of adjustment and the first right view obtain the second left view and the second right view View and second right view synthesize the second stereo-picture (second stereo-picture i.e. described in the present embodiment " target is stood Body image "), second stereo-picture is then recycled to carry out bore hole stereoscopic display, so as to fulfill three-dimensional imaging.

According to the above-mentioned technical solution, the advantageous effect of the embodiment of the present invention is：It is provided in an embodiment of the present invention vertical Body image processing method is by after the first left view and the first right view is got, to first left view and described first Right view cuts processing into line misregistration, obtains the second left view and the second right view so that the first left view and the first right view The horizontal displacement in second left view and second right view of the pixel of middle same position, enables to described second Parallax between left view and second right view increases relative to the parallax between first left view and the first right view The big or reduction parallax adjustment offset, further, is stood according to second left view and second right view Body is imaged, and can change the stereo concave-convex display effect that the stereo-picture is showed, and is provided good vertical for a user Body display effect, the eyes for avoiding the occurrence of user watch situation about not feeling well during stereo-picture, so as to meet the perception of user Demand promotes user's viewing experience.

Embodiment two

It is big for stereo-picture that after three-dimensional imaging processing is carried out, user watches in other application scenarios Small and picture material ratio does not change, and when showing stereo-picture, electronic equipment does not simultaneously use the first left view With the original size of the first right view, but a part of content therein is intercepted (that is, " third left view area in the first left view View in domain " and, the view in the first right view in " third right view region ") be presented to the user viewing, when need into During the processing of row three-dimensional imaging, intercept again picture material in original left view and original right view form it is new with current display Left view and the equal-sized left view of right view and right view.In this way, it is handled by three-dimensional imaging, shown stereogram Picture is unchanged from size and ratio, has no effect on the viewing experience of user.

Specifically can a part of content be intercepted according to preset parallax adjusting range, that is, determine to need the image for being shown to user Area size and ratio, it is assumed that parallax adjusting range is 40 pixels, then can each side staying in the first or so view Region except after 40, area pixel is third or so view area.Wherein, it can be one to be somebody's turn to do " preset parallax adjusting range " A fixed preset value or the value for being adaptive to different actual conditions and changing, such as：When the photographed scene of presentation is During distant view, the increase of parallax adjusting range, when the photographed scene of presentation is close shot, parallax adjusting range becomes smaller.

Based on the application scenarios, another three-dimensional imaging processing method is present embodiments provided.Fig. 4 is the embodiment of the present invention The difference of the flow diagram of two another the three-dimensional imaging processing method provided, the present embodiment and embodiment illustrated in fig. 1 is Step 140, other steps please refer to previous embodiment, and which is not described herein again, referring to Fig. 4, the three-dimensional imaging processing method can To include but not limited to following steps：

410th, the first left view and the first right view of binocular camera shooting are obtained.

420th, the spatial positional information of first left view and the object in first right view is determined.

430th, it is adjusted according to the spatial positional information of the object and pre-set spatial positional information and parallax inclined The correspondence of shifting amount determines the corresponding parallax adjustment offset of spatial positional information of the object.

440th, obtain third left view graph region in first left view and, the third in first right view Right view region.

In the present embodiment, it is respectively what is got that electronic equipment, which needs to be presented to the user the left view of viewing and right view, The view in the partial view region with same size in first left view and the first right view, " the third left view I.e. in the first left view, electronic equipment needs to be presented to the user the view area where the left view of viewing in region "；It is described " third right view region " i.e. in the first right view, electronic equipment needs to be presented to the user the view where the right view of viewing Region.

In this step, the third left view graph region of acquisition and third right view region are in the first left view and the second left view In position it is identical, i.e., when by the first left view and the coincidence of the first right view, third left view graph region and third right view area Domain is to overlap, and the parallax between third left view graph region and the view in third right view region is equal.Such as, it is assumed that first is left Shown in view such as Fig. 2 (a), shown in the first right view such as Fig. 2 (b), such as Fig. 2 after the first left view and the first right view are overlapped (c) shown in, then, in the present embodiment, third left view graph region can be as shown in Fig. 5 (a), by the pixel in the first left view Point e, f, h and i are formed, third right view region can as shown in Fig. 5 (b), by pixel E, F, H in the first right view and I is formed.

When by the first left view and the coincidence of the first right view, third left view graph region and third right view region are misaligned But when third left view graph region misplaces with third right view zone level, in this case, it is presented to the user the stereogram of viewing The parallax of picture increases or reduces the parallax relative to the parallax between the first left view and the first right view and adjusts offset.Cause This, can adjust parallax by the horizontal shift in third left view graph region and third right view region.

In practical applications, when receiving three-dimensional imaging process instruction, in addition to obtaining the binocular camera shooting Other than first left view and the first right view, it can also obtain and currently be presented to the user the left view of viewing in the first left view Initial views region (that is, described third left view graph region), i.e., the position in the region and, be currently presented to the user viewing Initial views region (that is, described third right view region) of the right view in the first right view.

450th, the third left view graph region is translated into the first distance along first level direction in first left view, The view in the third left view graph region after translation is obtained in first left view as the second left view；And By third right view region edge second horizontal direction opposite with the first level direction in first right view Second distance is translated, the view in the third right view region after translation is obtained in first right view as second Right view.

In the present embodiment, described " first level direction "/" second horizontal direction " is including horizontal to the left and horizontal To the right.Its specific direction is determined by parallax adjustment direction：When needing to increase parallax, the first level direction is horizontal direction A left side, second horizontal direction for it is horizontal to the right；When needing to reduce parallax, the first level direction for it is horizontal to the right, institute State the second horizontal direction for it is horizontal to the left.

" first distance " refers to that corresponding pixel is corresponding before the translation of third left view graph region in the first left view View (that is, current left view for being presented to the user viewing) and third left view graph region translate after corresponding view (that is, second Left view) in horizontal displacement distance；" second distance " refers to that corresponding pixel regards on the third right side in the first right view Corresponding view (that is, current right view for being presented to the user viewing) and third right view region are right after translating before graph region translation The distance of horizontal displacement in the view (that is, second right view) answered, so as to, first distance and the second distance and be Offset is adjusted for parallax, i.e. the pixel of same position is in the second left view and described in the first left view and the first right view The distance of horizontal displacement in second right view.

It illustrates：When carrying out parallax adjustment to the first left view as shown in Figure 2 and the first right view, it is assumed that current Shown in the third left view graph region such as Fig. 5 (a) presented to user, shown in such as Fig. 5 (b) of third right view region.

If at this point, increase parallax, also, distance of the identified parallax adjusted value for 1 pixel.Then, on first left side In view, third left view graph region is translated to the distance of 1 pixel to the left, the third after translation is obtained in the first left view View in left view graph region as the second left view (shown in such as Fig. 6 (a)), due to " first distance " (1 pixel away from From) equal with parallax adjusted value, it is possible to third right view region is not translated, it directly will be in third right view region View (that is, the right view currently presented) is as the second right view；It alternatively, can also be with the view in third left view graph region (that is, the left view currently presented) as the second left view, in the first right view, by third right view region to right translation 1 The distance of a pixel obtains the view in the third right view region after translation as the second right view in the first right view (shown in such as Fig. 6 (b)).

If reduce parallax, also, distance of the identified parallax adjusted value for 1 pixel.Then, in the first left view In, third left view graph region is translated to the right to the distance of 1 pixel, the third left view after translation is obtained in the first left view View in graph region is as the second left view (shown in such as Fig. 6 (c)), due to " the first distance " (distance of 1 pixel) It is equal with parallax adjusted value, it is possible to third right view region not to be translated, directly by regarding in third right view region (that is, the right view currently presented) is schemed as the second right view；Alternatively, can also in third left view graph region view (that is, The left view currently presented) as the second left view, in the first right view, by third right view region to 1 picture of left The distance of vegetarian refreshments, in the first right view obtain translation after third right view region in view as the second right view (such as Shown in Fig. 6 (d)).

It should be understood that above-mentioned example explanation is only used for explaining the embodiment of the present invention, it is not intended to limit the present invention Embodiment.In practical applications, the first left view and the first right view include more pixels, therefore, in the first left view There are many kinds of the middle modes for intercepting the second left view and the second right view being intercepted in the first right view, as long as making current presentation It is horizontal wrong in the second left view and the second right view to the pixel of same position in the left view and right view of user's viewing Position so that parallax between the second left view and the second right view relative to the left view for being currently presented to the user viewing and Parallax between right view increases or reduces the parallax adjustment offset, belongs to the protection model required by the embodiment of the present invention It encloses.

460th, according to second left view and second right view, three-dimensional imaging is carried out.

According to the above-mentioned technical solution, the advantageous effect of the embodiment of the present invention is：By obtaining first left view Third left view graph region in figure translates the third left view graph region along first level direction in first left view First distance obtains the view in the third left view graph region after translation as the second left view in first left view Figure；And the third right view region in acquisition first right view, the third right side is regarded in first right view Graph region is obtained along the second horizontal direction translation second distance opposite with the first level direction in first right view The view in the third right view region made even after moving, can be in the parallax tune for realizing stereo-picture as the second right view While whole, the stereo-picture with original image size, ratio all same is showed, does not influence the viewing experience of user.

Embodiment three

Fig. 7 is a kind of structure diagram for three-dimensional imaging processing unit that the embodiment of the present invention three provides, referring to Fig. 7, The device 70 includes but not limited to：First acquisition unit 71, the first determination unit 74, the second determination unit 75, processing unit 72 And display unit 73.

Wherein, first acquisition unit 71 is used to obtain the first left view of the binocular camera shooting and first right side regards Figure.

First determination unit 74, for determining the space of the object in first left view and first right view Location information；

Second determination unit 75, for the spatial positional information according to the object and pre-set spatial position The correspondence of information and parallax adjustment offset determines the corresponding parallax adjustment offset of spatial positional information of the object Amount；

Processing unit 72 is used to adjust offset according to the parallax, to first left view and first right view It is adjusted into line misregistration parallax, obtains the second left view and the second right view, so that so that second left view and described Parallax between second right view increases or reduces described relative to the parallax between first left view and the first right view Parallax adjusts offset.

Display unit 73, for obtaining the solid after parallax adjustment according to second left view and second right view Image.

Wherein, wherein, in some embodiments, the first determination unit 74 includes：

First acquisition module, for obtaining first left view and the corresponding depth map of first right view；

First determining module, for according to the depth map, determining in first left view and second left view Object depth information；

Second determining module for the depth information according to the object, determines the space bit confidence of the object Breath；

Specifically, first acquisition module is specifically used for：

First left view and first right view correspondence that the ranging hardware provides are obtained at ranging hardware Depth map；

Or

Using Stereo Matching Algorithm, first left view and the corresponding depth map of first right view are obtained.

Wherein, wherein, in some embodiments, the first determination unit 74 includes：

Third determining module, for determining object described in first left view and/or first right view Image location information；

4th determining module for the image location information according to the object, determines the space bit of the object Confidence ceases.

Specifically, the object is human eye；The third determining module is specifically used for：

Determine the human face region in first left view and/or first right view；

Using face alignment algorithm, the human face characteristic point of the human face region is detected；

According to the position of the human face characteristic point detected, determine the human eye in first left view and/or institute State the position in the first right view.

In some embodiments, the second determination unit 75 includes：

Enquiry module, for using the spatial positional information of the object as index, inquiring pre-set offset number According to library, parallax adjustment offset corresponding with the spatial positional information is obtained；

Or

Computing module, for the spatial positional information of the object to be substituted into pre-set parallactic shift amount and space The functional relation of location information obtains parallax adjustment offset corresponding with the spatial positional information.

Specifically, the computing module is specifically used for：

By the following formula, parallax adjustment offset corresponding with the spatial positional information is obtained：

Wherein, newp adjusts offset for parallax, and d is the spatial positional information of the object, d1 and d2 to set in advance The spatial position section put, p1 and p2 adjust offset for pre-set parallax corresponding with the d1 and d2.

In some embodiments, processing unit 72 is specifically used for：

The third left view graph region in first left view is obtained, by the third left view in first left view Graph region translates the first distance along first level direction, and the third left view after translation is obtained in first left view View in region is as the second left view；And

The third right view region in first right view is obtained, regards the third right side in first right view Graph region is obtained along the second horizontal direction translation second distance opposite with the first level direction in first right view The view in the third right view region made even after moving is as the second right view；

Wherein, first distance and the second distance and adjust offset equal to the parallax.

In some embodiments, processing unit 72 is specifically used for：

In the picture material of the first lateral incision water removal square upward first width of first left view, the second left view is obtained Figure；And

The picture material of the first width, obtains second right side and regards in the second side excision horizontal direction of first right view Figure；

Wherein, first width be equal to parallax adjust offset, first side be left side and right side in side, institute The second side is stated as the opposite side in left side and right side.

In some embodiments, processing unit 72 is specifically used for：

In the picture material of the first lateral incision water removal square upward first width of first left view, the 4th left view is obtained Figure splices pure color picture on the first side of the 4th left view and/or the second side horizontal direction, obtains second left view Figure, so that the size of second left view is consistent with first left view；

The picture material of the first width, obtains the 4th right side and regards in the second side excision horizontal direction of first right view Figure splices pure color picture on the first side of the 4th right view and/or the second side level side, obtains second right side and regards Figure, so that the size of second right view is consistent with first right view；

Wherein, first width be equal to parallax adjust offset, first side be left side and right side in side, institute The second side is stated as the opposite side in left side and right side, the 4th left view and the 4th right view homonymy splicing pure color figure Piece.

In some embodiments, processing unit 72 is specifically used for：

In the picture material of the first lateral incision water removal square upward first width of first left view, and described first The third side of left view and/or the 4th lateral incision remove the picture material of the second width on vertical direction, obtain second left view, So that ratio and first left view of the length of second left view in the horizontal direction with width in the vertical direction Figure is consistent；

The picture material of the first width in the second side excision horizontal direction of first right view, and described first The third side of left view and/or the 4th lateral incision remove the picture material of the second width on vertical direction, obtain second right view, The length of second right view in the horizontal direction and the ratio of width in the vertical direction are protected with first right view It holds consistent；

Wherein, first width be equal to parallax adjust offset, first side be left side and right side in side, institute The second side is stated as the opposite side in left side and right side, the third side is the side in the upper side and lower side, and the 4th side is upper Opposite side in side and downside, first left view and the first right view homonymy are cut off in the image on vertical direction Hold.

In some embodiments, processing unit 72 is specifically used for：

In the picture material of the first lateral incision water removal square upward first width of first left view, the 5th left view is obtained Figure；

The picture material of the second width on vertical direction is removed in the third side of the 5th left view and/or the 4th lateral incision, Second left view is obtained, so that the length of second left view in the horizontal direction and width in the vertical direction Ratio is consistent with first left view；

And

The picture material of the first width, obtains the 5th right side and regards in the second side excision horizontal direction of first right view Figure；

The picture material of the second width on vertical direction is removed in the third side of the 5th right view and/or the 4th lateral incision, Obtain second right view, the length of second right view in the horizontal direction and the ratio of width in the vertical direction It is consistent with first right view；

Wherein, first width be equal to parallax adjust offset, first side be left side and right side in side, institute The second side is stated as the opposite side in left side and right side, the third side is the side in the upper side and lower side, and the 4th side is upper Opposite side in side and downside, the 5th left view and the 5th right view homonymy are cut off in the image on vertical direction Hold.

In some embodiments, display unit 73 is specifically used for：

Second left view and second right view are synthesized into the second stereo-picture；

Bore hole stereoscopic display is carried out using second stereo-picture, so as to fulfill three-dimensional imaging.

In some embodiments, first acquisition unit 71 is specifically used for：

Obtain the first left view and the first right view of binocular camera shooting；

Or

Stereo-picture is obtained, the stereo-picture includes the first left view and the first right view.

It should be noted that by vertical in three-dimensional imaging processing unit in this present embodiment and above-described embodiment one and two Body image processing method is based on identical inventive concept, and therefore, the corresponding contents in embodiment of the method one and two are equally applicable to Present apparatus embodiment, no further details here.

According to the above-mentioned technical solution, the advantageous effect of the embodiment of the present invention is：By in first acquisition unit 71 When getting the first left view and the first right view, to first left view and first right view in processing unit 72 Processing is cut into line misregistration, obtains the second left view and the second right view so that identical in the first left view and the first right view The horizontal displacement in second left view and second right view of the pixel of position, enables to second left view Parallax between second right view increases or subtracts relative to the parallax between first left view and the first right view Small parallax adjusts offset, further, by display unit 73 according to second left view and second right view into Row three-dimensional imaging can change the stereo concave-convex display effect that the stereo-picture is showed, so as to meet the perception need of user It asks, promotes user's viewing experience.

Example IV

Fig. 8 is the structure diagram for a kind of electronic equipment that the embodiment of the present invention four provides, which can be Any type of intelligent terminal, for example, mobile phone, VR glasses etc..

Specifically, referring to Fig. 8, the electronic equipment 800 includes：

One or more processors 810 and memory 820, in Fig. 8 by taking a processor 810 as an example.

Processor 810 can be connected with memory 820 by bus or other modes, to be connected by bus in Fig. 8 For.

Memory 820 is used as a kind of non-transient computer readable storage medium storing program for executing, available for storing non-transient software program, non- Transitory computer executable program and module, as the corresponding program of three-dimensional imaging processing method in the embodiment of the present invention refers to Order/module (for example, attached acquiring unit shown in Fig. 7 71, cut unit 72 and imaging unit 73).Processor 810 passes through fortune Row is stored in non-transient software program, instruction and module in memory 820, so as to perform three-dimensional imaging processing unit 70 The three-dimensional imaging processing method of any of the above-described embodiment of the method is realized in various function application and data processing.

Memory 820 can include storing program area and storage data field, wherein, storing program area can store operation system System, the required application program of at least one function；Storage data field can store the use according to three-dimensional imaging processing unit 70 Data created etc..In addition, memory 820 can include high-speed random access memory, non-transient storage can also be included Device, for example, at least a disk memory, flush memory device or other non-transient solid-state memories.In some embodiments, Memory 820 is optional including relative to the remotely located memory of processor 810, these remote memories can be connected by network It is connected to the electronic equipment 800.The example of above-mentioned network includes but not limited to internet, intranet, LAN, mobile communication Net and combinations thereof.

One or more of modules are stored in the memory 820, when by one or more of processors During 810 execution, the three-dimensional imaging processing method in above-mentioned any means embodiment is performed, for example, performing in Fig. 1 described above Method and step 110 to 150, the method and step 410 to 460 in Fig. 4 realizes the function of the unit 71-75 in Fig. 7.

Embodiment five

The embodiment of the present invention five additionally provides a kind of computer readable storage medium, and the computer readable storage medium is deposited Computer executable instructions are contained, which is executed by one or more processors, for example, by Fig. 8 One processor 810 performs, may be such that said one or multiple processors perform in above-mentioned any means embodiment it is three-dimensional into As processing method, for example, perform the method and step 110 to 150 in Fig. 1 described above, the method and step 410 in Fig. 4 to 460, realize the function of the unit 71-75 in Fig. 7.

The apparatus embodiments described above are merely exemplary, wherein the unit illustrated as separating component can To be or may not be physically separate, the component shown as unit may or may not be physics list Member, you can be located at a place or can also be distributed in multiple network element.It can be selected according to the actual needs In some or all of module realize the purpose of this embodiment scheme.

Through the above description of the embodiments, those of ordinary skill in the art can be understood that each embodiment The mode of general hardware platform can be added to realize by software, naturally it is also possible to pass through hardware.Those of ordinary skill in the art can With understand all or part of flow realized in above-described embodiment method be can be instructed by computer program it is relevant hard Part is completed, and the program can be stored in a computer read/write memory medium, the program is when being executed, it may include as above State the flow of the embodiment of each method.Wherein, the storage medium can be magnetic disc, CD, read-only memory (Read- Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..

The said goods can perform the method that the embodiment of the present invention is provided, and has the corresponding function module of execution method and has Beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to the method that the embodiment of the present invention is provided.

Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；At this It under the thinking of invention, can also be combined between the technical characteristic in above example or different embodiment, step can be with It is realized with random order, and there are many other variations of different aspect present invention as described above, for simplicity, they do not have Have and provided in details；Although the present invention is described in detail referring to the foregoing embodiments, the ordinary skill people of this field Member should understand that：It can still modify to the technical solution recorded in foregoing embodiments or to which part skill Art feature carries out equivalent replacement；And these modifications or replacement, each reality of the present invention that it does not separate the essence of the corresponding technical solution Apply the range of a technical solution.

Claims (18)

1. a kind of three-dimensional imaging processing method, which is characterized in that the method includes：

Obtain the first left view and the first right view；

Determine the spatial positional information of first left view and the object in first right view；

According to the spatial positional information of the object and pre-set spatial positional information and pair of parallax adjustment offset It should be related to, determine the corresponding parallax adjustment offset of spatial positional information of the object；

Offset is adjusted according to the parallax, parallax adjustment is carried out to first left view and first right view, is obtained Second left view and the second right view, so that the parallax of second left view and second right view is relative to described first The parallax of left view and first right view increases or reduces the parallax adjustment offset；

According to second left view and second right view, three-dimensional imaging is carried out.

2. according to the method described in claim 1, it is characterized in that, described determine that first left view and first right side regard The spatial positional information of object in figure includes：

First left view and the corresponding depth map of first right view are obtained, according to the depth map, determines described The depth information of one left view and the object in second left view according to the depth information of the object, determines institute State the spatial positional information of object；

Or

The image location information of object described in first left view and/or first right view is determined, according to described The image location information of object determines the spatial positional information of the object.

3. according to the method described in claim 2, it is characterized in that, the acquisition first left view and first right side regard Scheme corresponding depth map to include：

First left view and the corresponding depth of first right view that the ranging hardware provides are obtained at ranging hardware Degree figure；

Or

Using Stereo Matching Algorithm, first left view and the corresponding depth map of first right view are obtained.

4. according to the method described in claim 2, it is characterized in that,

The object is human eye；

The image location information for determining object described in first left view and/or first right view includes：

Determine the human face region in first left view and/or first right view；

Using face alignment algorithm, the human face characteristic point of the human face region is detected；

According to the position of the human face characteristic point detected, determine the human eye in first left view and/or described Position in one right view.

5. according to claim 1-4 any one of them methods, which is characterized in that the spatial position according to the object Information and pre-set spatial positional information and the correspondence of parallax adjustment offset determine the space of the object The corresponding parallax adjustment offset of location information includes：

Using the spatial positional information of the object as index, pre-set offset data library is inquired, is obtained and the sky Between location information corresponding parallax adjustment offset；

Or

The function that the spatial positional information of the object is substituted into pre-set parallactic shift amount and spatial positional information closes System obtains parallax adjustment offset corresponding with the spatial positional information.

6. according to the method described in claim 5, it is characterized in that, the spatial positional information by the object substitutes into advance The parallactic shift amount and the functional relation of spatial positional information first set obtains parallax tune corresponding with the spatial positional information Whole offset includes：

By the following formula, parallax adjustment offset corresponding with the spatial positional information is obtained：

Wherein, newp adjusts offset for parallax, and d is that the spatial positional information of the object, d1 and d2 are pre-set Spatial position section, p1 and p2 adjust offset for pre-set parallax corresponding with the d1 and d2.

7. according to the method described in claim 1, it is characterized in that, described regard according to second left view and second right side Figure carries out three-dimensional imaging and includes：

Second left view and second right view are synthesized into the second stereo-picture；

Bore hole stereoscopic display is carried out using second stereo-picture, so as to fulfill three-dimensional imaging.

8. according to the method described in claim 1, it is characterized in that, the first left view of the acquisition and the first right view include：

Obtain the first left view and the first right view of binocular camera shooting；

Or

Stereo-picture is obtained, the stereo-picture includes the first left view and the first right view.

9. a kind of three-dimensional imaging processing unit, which is characterized in that described device includes：

First acquisition unit, for obtaining the first left view and the first right view；

First determination unit, for determining the space bit confidence of the object in first left view and first right view Breath；

Second determination unit, for the spatial positional information according to the object and pre-set spatial positional information with Parallax adjusts the correspondence of offset, determines the corresponding parallax adjustment offset of spatial positional information of the object；

Processing unit for adjusting offset according to the parallax, carries out first left view and first right view Parallax adjusts, to obtain the second left view and the second right view, so that second left view and second right view regard Difference increases or reduces the parallax relative to the parallax of first left view and first right view and adjusts offset；

Display unit, for according to second left view and second right view, carrying out three-dimensional imaging.

10. device according to claim 9, which is characterized in that first determination unit includes：

First acquisition module, for obtaining first left view and the corresponding depth map of first right view；

First determining module, for according to the depth map, determining the mesh in first left view and second left view Mark the depth information of object；

Second determining module for the depth information according to the object, determines the spatial positional information of the object；

Or

Third determining module, for determining the image of object described in first left view and/or first right view Location information；

4th determining module for the image location information according to the object, determines the space bit confidence of the object Breath.

11. device according to claim 10, which is characterized in that first acquisition module is specifically used for：

First left view and the corresponding depth of first right view that the ranging hardware provides are obtained at ranging hardware Degree figure；

Or

Using Stereo Matching Algorithm, first left view and the corresponding depth map of first right view are obtained.

12. device according to claim 10, which is characterized in that

The object is human eye；

The third determining module is specifically used for：

Determine the human face region in first left view and/or first right view；

Using face alignment algorithm, the human face characteristic point of the human face region is detected；

According to the position of the human face characteristic point detected, determine the human eye in first left view and/or described Position in one right view.

13. according to claim 9-12 any one of them devices, which is characterized in that second determination unit includes：

Enquiry module, for using the spatial positional information of the object as index, inquiring pre-set offset data library, Obtain parallax adjustment offset corresponding with the spatial positional information；

Or

Computing module, for the spatial positional information of the object to be substituted into pre-set parallactic shift amount and spatial position The functional relation of information obtains parallax adjustment offset corresponding with the spatial positional information.

14. device according to claim 13, which is characterized in that the computing module is specifically used for：

By the following formula, parallax adjustment offset corresponding with the spatial positional information is obtained：

Wherein, newp adjusts offset for parallax, and d is that the spatial positional information of the object, d1 and d2 are pre-set Spatial position section, p1 and p2 adjust offset for pre-set parallax corresponding with the d1 and d2.

15. device according to claim 9, which is characterized in that the display unit includes：

Synthesis module, for second left view and second right view to be synthesized the second stereo-picture；

Image-forming module carries out bore hole stereoscopic display, so as to fulfill three-dimensional imaging using second stereo-picture.

16. device according to claim 9, which is characterized in that the first acquisition unit is specifically used for：

Obtain the first left view and the first right view of binocular camera shooting；

Or

Stereo-picture is obtained, the stereo-picture includes the first left view and the first right view.

17. a kind of electronic equipment, which is characterized in that including：

At least one processor；And

The memory being connect at least one processor communication；Wherein,

The memory is stored with the instruction that can be performed by least one processor, and described instruction is by least one place It manages device to perform, so that at least one processor is able to carry out such as claim 1-8 any one of them methods.

18. a kind of computer readable storage medium, which is characterized in that the computer-readable recording medium storage has computer can Execute instruction, the computer executable instructions are used to that computer to be made to perform such as claim 1-8 any one of them methods.