Summary of the invention
Based on this, be necessary for above-mentioned technical matters, a kind of method and the device that manufacture footwear based on foot three-dimensionalreconstruction that realize foot-measuring shoemaking are provided.
Manufacture a method for footwear based on foot three-dimensionalreconstruction, described method comprises:
The sequence information that receiving terminal sends, described sequence information comprises the style of shoes and foot is carried out to multiple two dimensional images of various visual angles shooting, and multiple two dimensional images described contain the whole surface profile information of foot;
The three-dimensional coefficient of described foot is extracted by multiple two dimensional images described;
Generate according to the style of the three-dimensional coefficient of described foot and shoes and corresponding make footwear instruction;
Make footwear instruction be sent to shoe manufacturing machine by described, make described shoe manufacturing machine produce the footwear of described style according to the three-dimensional coefficient of described foot.
Wherein in an embodiment, the described step being obtained the three-dimensional coefficient of described foot by multiple two dimensional images described, being comprised:
Three-dimensional reconstruction is carried out to multiple two dimensional images described and obtains foot three-dimensional information;
Corresponding foot three-dimensional model is obtained according to described foot three-dimensional information;
The three-dimensional coefficient of foot is extracted according to described foot three-dimensional model.
Wherein in an embodiment, between two two dimensional images of adjacent view shooting in multiple two dimensional images described, there is picture registration part; Described the step that three-dimensional reconstruction obtains foot three-dimensional information is carried out to multiple two dimensional images described, comprising:
Extract the two dimensional character point often opening two dimensional image in multiple two dimensional images described;
Two dimensional character point corresponding for two two dimensional images adjacent in multiple two dimensional images is carried out characteristic matching and obtains two-dimentional match point, and described two-dimentional match point is converted into corresponding three-dimensional match point;
Extract public match point from described three-dimensional match point, and obtain foot three-dimensional information according to the position relationship between described public match point and described three-dimensional match point.
Wherein in an embodiment, described sequence information also comprises associated person information, and make after footwear instruction is sent to the step of footwear manufacturing machine described by described, described method also comprises:
The express delivery order of the described footwear of mailing is generated according to described associated person information.
Wherein in an embodiment, multiple two dimensional images described comprise:
Ten two dimensional images obtained after taking from the front, rear, left and right of foot, left front, left back, right front, right back and vola and visual angle, ten, sufficient face.
Manufacture a device for footwear based on foot three-dimensionalreconstruction, described device comprises:
Information receiving module, for the sequence information that receiving terminal sends, described sequence information comprises the style of shoes and foot is carried out to multiple two dimensional images of various visual angles shooting, and multiple two dimensional images described contain the whole surface profile information of foot;
Parameter extraction module, for extracting the three-dimensional coefficient of described foot by multiple two dimensional images described;
Directive generation module, corresponding makes footwear instruction for generating according to the style of the three-dimensional coefficient of described foot and described shoes;
Instruction sending module, for making footwear instruction be sent to shoe manufacturing machine by described, makes described shoe manufacturing machine produce the footwear of described style according to the three-dimensional coefficient of described foot.
Wherein in an embodiment, parameter extraction module comprises:
Three-dimensional reconstruction module, obtains foot three-dimensional information for carrying out three-dimensional reconstruction to multiple two dimensional images described;
Model acquisition module, for obtaining corresponding foot three-dimensional model according to described foot three-dimensional information;
Characteristic parameter extraction module, for extracting the three-dimensional coefficient of foot according to described foot three-dimensional model.
Wherein in an embodiment, between two two dimensional images of adjacent view shooting in multiple two dimensional images described, there is picture registration part; Described three-dimensional reconstruction module comprises:
Feature point extraction module, for extracting the two dimensional character point often opening two dimensional image in multiple two dimensional images described;
Three-dimensional match point acquisition module, obtains two-dimentional match point for two dimensional character point corresponding for two two dimensional images adjacent in multiple two dimensional images is carried out characteristic matching, and described two-dimentional match point is converted into corresponding three-dimensional match point;
Three-dimensional information acquisition module, for extracting public match point from described three-dimensional match point, and obtains foot three-dimensional information according to the position relationship between described public match point and described three-dimensional match point.
Wherein in an embodiment, described sequence information also comprises associated person information, and described device also comprises: order generation module, for generating the express delivery order of the described footwear of mailing according to described associated person information.
Wherein in an embodiment, it is characterized in that, multiple two dimensional images described comprise:
Ten two dimensional images obtained after taking from the front, rear, left and right of foot, left front, left back, right front, right back and vola and visual angle, ten, sufficient face.
Above-mentioned method and the device manufacturing footwear based on foot three-dimensionalreconstruction, can from carrying out taking from various visual angles the three-dimensional coefficient extracting foot multiple two dimensional images of obtaining to foot, and generate shoemaking instruction according to the three-dimensional coefficient of foot and style, the three-dimensional feature being produced shoes inner structure and foot by shoe manufacturing machine is coincide, the shoes that style is identical with style in sequence information.Do not use special three-dimensional digital scanner in process due to the three-dimensional coefficient of above-mentioned acquisition foot to scan foot, by mobile terminal foot taken pictures and also can realize footwear manufacturers and provide the service of foot-measuring shoemaking for ordinary populace, improve the comfortableness that people wear footwear.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
As shown in Figure 1, in one embodiment, a kind of method manufacturing footwear based on foot three-dimensionalreconstruction provided, the method comprises the steps:
Step 101, the sequence information that receiving terminal sends.
In the present embodiment, sequence information comprises the style of shoes and foot is carried out to multiple two dimensional images of various visual angles shooting, and multiple two dimensional images contain the whole surface profile information of foot.Terminal obtains user and chooses the style of shoes and multiple two dimensional images to foot shooting of submission, further, generates the sequence information of the customized footwear of foot-measuring according to the style chosen and multiple two dimensional images.Sequence information is sent to the server of footwear manufacturers.By footwear manufacturers for user provides the service of the customized footwear of foot-measuring.The quantity of multiple two dimensional images is not restricted, only needs the image information that can comprise structure foot three-dimensional model in multiple two dimensional images.In one embodiment, be identical to the shooting distance of multiple two dimensional images of foot shooting.
In the present embodiment, multiple two dimensional images are that user carries out taking the image obtained from various visual angles to foot by being with the mobile terminal of camera, and mobile terminal includes but not limited to: digital camera, smart mobile phone and panel computer etc.
As shown in Figure 2, in one embodiment, multiple two dimensional images are ten two dimensional images that (1), rear (5), left (3), right (7), left front (2), left back (4), right front (8), right back (6) and vola (10) and visual angle, (9) ten, sufficient face obtain after taking before foot.
Step 102, extracts the three-dimensional coefficient of foot by multiple two dimensional images.
In the present embodiment, based on the three-dimensional structure information of multiple reconstruction of two-dimensional images foots, and from the three-dimensional structure information of foot, extract the three-dimensional coefficient of foot.The three-dimensional coefficient of foot refers to the foot parameter must known in foot-measuring shoemaking process, concrete, and the three-dimensional coefficient of foot comprises the three-dimensional coefficient of the foot such as height and foot profile of arch of foot, foot length, boll of foot girth, foot breadth, left and right ankle.Wherein, foot length is the distance of toe end points to heel bump; Boll of foot girth is be as the criterion with the most salient point of the first sole of the foot toe and the 5th articulationes metatarsophalangeae, the girth rounded; Foot breadth is that toe end points and mid-point of heel line divide and be clipped to first and the 5th distance sum of most bump of articulationes metatarsophalangeae.
In one embodiment, as shown in Figure 3,31 is the profile information of foot side, and A is toe end points, and B is heel bump, the long distance be between an AB of pin; 32 is the profile information in face, foot front, and C is Metatarsophalangeal joint bump, and D is the 5th articulationes metatarsophalangeae bump, and foot breadth is the distance sum of a C and some D to AB line.
In one embodiment, step 102, the three-dimensional coefficient being obtained foot by multiple two dimensional images is comprised: carry out three-dimensional reconstruction to multiple two dimensional images and obtain foot three-dimensional information; Corresponding foot three-dimensional model is obtained according to foot three-dimensional information; The three-dimensional coefficient of foot is extracted according to foot three-dimensional model.
Step 103, generates according to the style of the three-dimensional coefficient of foot and shoes and corresponding makes footwear instruction.
Step 104, will make footwear instruction and be sent to shoes manufacturing machine, make shoe manufacturing machine produce the footwear of this style according to the three-dimensional coefficient of foot.
In the present embodiment, what sent by the shoe manufacturing machine reception server in workshop makes footwear instruction, further, produces the shoes of the style that to match completely with user's foot in conjunction with the three-dimensional coefficient of foot and the style of shoes.
The above-mentioned method manufacturing footwear based on foot three-dimensionalreconstruction, can from carrying out taking from various visual angles the three-dimensional coefficient extracting foot multiple two dimensional images of obtaining to foot, and generate shoemaking instruction according to the three-dimensional coefficient of foot and style, the three-dimensional feature being produced shoes inner structure and foot by shoe manufacturing machine is coincide, the shoes that style is identical with style in sequence information.Do not use special three-dimensional digital scanner in process due to the three-dimensional coefficient of above-mentioned acquisition foot to scan foot, by mobile terminal foot taken pictures and also can realize footwear manufacturers and provide the service of foot-measuring shoemaking for ordinary populace, improve the comfortableness that people wear footwear.
As shown in Figure 4, in one embodiment, the step that three-dimensional reconstruction obtains foot three-dimensional information is carried out to multiple two dimensional images, comprising:
Step 401, extracts the two dimensional character point often opening two dimensional image in multiple two dimensional images.
In the present embodiment, between two two dimensional images of adjacent view shooting in multiple two dimensional images, there is picture registration part.Picture registration part refers to the same surface profile information having photographed foot in the image of two adjacent view shootings.Such as, adjacent view shooting comprises the same position all having photographed toe in two two dimensional images of toe profile information.
The pixel of the outer table skeleton of foot can be reflected in the image that two dimensional character point obtains after referring to and carrying out two dimension shooting to foot.Two dimensional character point at least comprises following characteristics: 1, higher multiplicity, and namely take in two width image overlapping regions of same foot in different visual angles, same pixel can detect multiplicity in two images.2, unique, namely two dimensional character point should have certain uniqueness, can ensure that two dimensional character point and other point are easily distinguished.3, quantity is more, and the quantity of two dimensional character point should be abundant.
Step 402, carries out characteristic matching by two dimensional character point corresponding for two two dimensional images adjacent in multiple two dimensional images and obtains two-dimentional match point, and two-dimentional match point is converted into corresponding three-dimensional match point.
In the present embodiment, two-dimentional match point refers to the two dimensional character point all existed in adjacent two two dimensional images.Concrete, Point matching method can be adopted to carry out characteristic matching and to obtain two-dimentional match point.Point matching method is divided into two classes: based on the method for Luminance Distribution and the method based on gradient distribution.Two class methods are all for unique point structure description is for describing brightness and the gradient distribution of the local domain of two dimensional character point.Such as, characteristic matching can be carried out by Harris feature matching method to adjacent two two dimensional images, obtain two-dimentional match point.Straight line and Curve Matching method can also be adopted to carry out characteristic matching.
The conversion relation that two dimension match point is converted into three-dimensional match point is as follows: m=P × M, P=K [R|t], two-dimentional match point is m=[x, y, 1] T, and three-dimensional match point is M=[X, Y, Z, 1] T.K is camera internal reference matrix
α, β are the scale factor on image in x and y coordinate axis, and (x0, y0) is two dimensional image center point coordinate, and γ is warping factor.R is rotation matrix, and t is translation matrix.E=[t] X R, E is essential matrix, be an order is 2, have two equal singular values and the 3rd be the matrix of the 3x3 of 0.[t] X is the skew matrix be made up of translation matrix.
Step 403, extracts public match point from three-dimensional match point, and obtains foot three-dimensional information according to the position relationship between public match point and three-dimensional match point.
In the present embodiment, the point all comprised in the three-dimensional match point that public match point obtains after referring to each group of Image Feature Matching is public match point.According to the relation between public match point and other three-dimensional match points, and then three-dimensional match point and three-dimensional feature point are added in newly-built three-dimensional system of coordinate obtain foot three-dimensional information.
In one embodiment, sequence information also comprises associated person information, and in step 104, will make after footwear instruction is sent to shoes manufacturing machine, the method also comprises the steps: the express delivery order generating mailing footwear according to associated person information.
In the present embodiment, associated person information comprises: the name of user, the relevant information such as address and address, automatically generate the express delivery order of the customized shoes of mailing user according to associated person information, according to express delivery order, the shoes very first time can be mailed to user after shoes manufacture completes.Various visual angles foot Three Dimensional Reconfiguration is applied in customized footwear, satisfactory image need be taken to foot for popular by mobile phone, and send footwear manufacturers to, and the footwear manufacturers that receives that can realize staying indoors is the customized shoes of oneself foot-measuring, add the comfort level of shoes dress, improve shoes subscribed services popularization degree.
As shown in Figure 5, in one embodiment, a kind of device manufacturing footwear based on foot three-dimensionalreconstruction provided, this device comprises as lower module:
Information receiving module 51, for the sequence information that receiving terminal sends, described sequence information comprises the style of shoes and foot is carried out to multiple two dimensional images of various visual angles shooting, and multiple two dimensional images described contain the whole surface profile information of foot.In one embodiment, multiple two dimensional images comprise: ten two dimensional images obtained after taking from the front, rear, left and right of foot, left front, left back, right front, right back and vola and visual angle, ten, sufficient face.
Parameter extraction module 52, for extracting the three-dimensional coefficient of described foot by multiple two dimensional images described.
Directive generation module 53, corresponding makes footwear instruction for generating according to the style of the three-dimensional coefficient of described foot and described shoes.
Instruction sending module 54, for making footwear instruction be sent to shoe manufacturing machine by described, makes described shoe manufacturing machine produce the footwear of described style according to the three-dimensional coefficient of described foot.
As shown in Figure 6, in one embodiment, parameter extraction module 52 comprises:
Three-dimensional reconstruction module 521, obtains foot three-dimensional information for carrying out three-dimensional reconstruction to multiple two dimensional images described.
Model acquisition module 522, for obtaining corresponding foot three-dimensional model according to described foot three-dimensional information.
Characteristic parameter extraction module 523, for extracting the three-dimensional coefficient of foot according to described foot three-dimensional model.
As shown in Figure 7, in one embodiment, there is picture registration part between two two dimensional images that in multiple two dimensional images described, adjacent view is taken; Described three-dimensional reconstruction module 521 comprises:
Feature point extraction module 5211, for extracting the two dimensional character point often opening two dimensional image in multiple two dimensional images described.
Three-dimensional match point acquisition module 5212, obtains two-dimentional match point for two dimensional character point corresponding for two two dimensional images adjacent in multiple two dimensional images is carried out characteristic matching, and described two-dimentional match point is converted into corresponding three-dimensional match point.
Three-dimensional information acquisition module 5213, for extracting public match point from described three-dimensional match point, and obtains foot three-dimensional information according to the position relationship between described public match point and described three-dimensional match point.
As shown in Figure 8, in one embodiment, this device also comprises: order generation module 55, generates the express delivery order of the described footwear of mailing according to described associated person information.
Each technical characteristic of above embodiment can combine arbitrarily, for making description succinct, all possible combination of each technical characteristic in above-described embodiment is not all described, but, as long as the combination of these technical characteristics does not exist contradiction, be all considered to be the scope that this instructions is recorded.
Above embodiment only have expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but therefore can not be interpreted as the restriction to the scope of the claims of the present invention.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.