CN108765321A - It takes pictures restorative procedure, device, storage medium and terminal device - Google Patents
It takes pictures restorative procedure, device, storage medium and terminal device Download PDFInfo
- Publication number
- CN108765321A CN108765321A CN201810468017.8A CN201810468017A CN108765321A CN 108765321 A CN108765321 A CN 108765321A CN 201810468017 A CN201810468017 A CN 201810468017A CN 108765321 A CN108765321 A CN 108765321A
- Authority
- CN
- China
- Prior art keywords
- incomplete
- dimensional
- data
- dimensional data
- reparation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 239000000463 material Substances 0.000 claims description 49
- 230000008439 repair process Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 abstract description 15
- 230000002452 interceptive effect Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 21
- 230000002093 peripheral effect Effects 0.000 description 9
- 229910052573 porcelain Inorganic materials 0.000 description 9
- 210000001508 eye Anatomy 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 3
- 238000011084 recovery Methods 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009885 systemic effect Effects 0.000 description 1
Classifications
-
- G06T5/77—
Abstract
The one kind provided in the embodiment of the present application is taken pictures restorative procedure, device, storage medium and terminal device, and this method is by the way that when identification camera takes incomplete object, the object dimensional data of the incomplete object are obtained by the identification camera；The object dimensional data are identified by preset incomplete identification model, with the incomplete position on the determination incomplete object；Feature reparation is carried out to the incomplete position on the incomplete object.By using above-mentioned technical proposal, incomplete reparation can be carried out to the incomplete object of shooting according to the object dimensional data of incomplete object, enrich the interactive function of terminal device and user, optimize existing shooting technology.
Description
Technical field
The invention relates to terminal device technical field more particularly to one kind take pictures restorative procedure, device, storage be situated between
Matter and terminal device.
Background technology
With the development of the shooting technology of terminal device, most user is owned by the terminal device that can be taken pictures.It is logical
It is very easily to operate to cross terminal device and take pictures, and user only needs to press camera button after being directed at subject and can complete
Photographing operation can whenever and wherever possible take pictures with easily.But existing shooting technology is still not perfect, needs to existing
Shooting technology optimize.
Invention content
A kind of photographic method, device, storage medium and terminal device provided by the embodiments of the present application, can optimize existing
Shooting technology.
It takes pictures restorative procedure in a first aspect, the embodiment of the present application provides one kind, including：
When identification camera takes incomplete object, the object of the incomplete object is obtained by the identification camera
Three-dimensional data；
The object dimensional data are identified by preset incomplete identification model, on the determination incomplete object
Incomplete position；
Feature reparation is carried out to the incomplete position on the incomplete object.
Second aspect, the embodiment of the present application provide one kind and take pictures prosthetic device, including：
Three-dimensional data acquisition module, for when identification camera takes incomplete object, passing through the identification camera
Obtain the object dimensional data of the incomplete object；
Position determination module, for the object dimensional data to be identified by preset incomplete identification model, with
Determine the incomplete position on the incomplete object；
Repair process module, for carrying out feature reparation to the incomplete position on the incomplete object.
The third aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey
Sequence realizes the restorative procedure of taking pictures as described in the embodiment of the present application when the program is executed by processor.
Fourth aspect, the embodiment of the present application provide a kind of terminal device, including memory, processor and are stored in storage
It can realize on device and when the computer program of processor operation, the processor execute the computer program as the application is real
Apply the restorative procedure of taking pictures described in example.
The one kind provided in the embodiment of the present application is taken pictures recovery scenario, by taking incomplete object in identification camera
When, the object dimensional data of the incomplete object are obtained by the identification camera；Pass through preset incomplete identification model pair
The object dimensional data are identified, with the incomplete position on the determination incomplete object；To residual on the incomplete object
Omission, which is set, carries out feature reparation.It, can be according to the object dimensional data of incomplete object to shooting by using above-mentioned technical proposal
Incomplete object carry out incomplete reparation, enrich the interactive function of terminal device and user, optimize existing shooting technology.
Description of the drawings
Fig. 1 is a kind of flow diagram for restorative procedure of taking pictures provided by the embodiments of the present application；
Fig. 2 is a kind of schematic diagram of a scenario for restorative procedure of taking pictures provided by the embodiments of the present application；
Fig. 3 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure；
Fig. 4 is that another kind provided by the embodiments of the present application is taken pictures the schematic diagram of a scenario of restorative procedure；
Fig. 5 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure；
Fig. 6 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure；
Fig. 7 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure；
Fig. 8 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure；
Fig. 9 is the schematic diagram of initial three-dimensional data provided by the embodiments of the present application；
Figure 10 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure；
Figure 11 is a kind of structure diagram for prosthetic device of taking pictures provided by the embodiments of the present application；
Figure 12 is a kind of structural schematic diagram of terminal device provided by the embodiments of the present application；
Figure 13 is the structural schematic diagram of another terminal device provided by the embodiments of the present application.
Specific implementation mode
Further illustrate the technical solution of the application below with reference to the accompanying drawings and specific embodiments.It is appreciated that
It is that specific embodiment described herein is used only for explaining the application, rather than the restriction to the application.It further needs exist for illustrating
, illustrate only for ease of description, in attached drawing and the relevant part of the application rather than entire infrastructure.
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail
The processing described as flow chart or method.Although each step is described as the processing of sequence, many of which by flow chart
Step can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of each step can be rearranged.When its operation
The processing can be terminated when completion, it is also possible to the additional step being not included in attached drawing.The processing can be with
Corresponding to method, function, regulation, subroutine, subprogram etc..
Three-dimensional camera is gradually universal to be opened, and more and more terminal devices all use three-dimensional camera, three-dimensional camera
More information, the three-dimensional information that the application can be acquired according to three-dimensional camera can be collected compared to traditional camera
To optimize the shooting technology of terminal device.
Fig. 1 is a kind of flow diagram for restorative procedure of taking pictures provided by the embodiments of the present application, and this method can be by taking pictures
Prosthetic device executes, and wherein the device can be generally integrated in terminal device, also may be used by software and or hardware realization
It is equipped in the equipment of operating system with being integrated in other.As shown in Figure 1, this method includes：
S110, when identification camera takes incomplete object, pass through the identification camera and obtain the incomplete object
Object dimensional data.
Wherein, the incomplete object is that partial portion is blocked or the object of defect.The incompleteness object is to pass through identification
Camera is shot, and captured picture includes incomplete object.
The identification camera can be the camera on terminal device, can be the front camera of terminal device, and/
Or rear camera.Illustratively, it is generally provided at least one camera in existing terminal device, before generally all including
Set camera and rear camera.If the user of shooting is the currently used person of terminal device, the identification camera can be with
It is the front camera of terminal device, so that user can recognize the picture of shooting by the screen of terminal device.For another example, it claps
The currently used person of the object taken the photograph not instead of terminal device, other users or other objects, then the identification camera can
To be the rear camera of terminal device；The currently used person of present terminal equipment shoots other incomplete objects by terminal device
Body.
Traditional camera carries out shooting acquired image being usually 2-D data, i.e., is arranged with line-column matrix rule
Pixel color-values (rgb value) or gray value set.Further include taking in the three-dimensional data compared to 2-D data
Incomplete object depth data, that is, the different spaces point of the incomplete object shot is at a distance from camera, so three-dimensional data
It can indicate the spatial information of captured object.The identification camera can be the camera with range sensor, away from
The different spaces point on captured object can be obtained from sensor at a distance from camera, can so get shooting
The three-dimensional data of incomplete object.
The object dimensional data include：The three-dimensional data of the incomplete object of the identification camera shooting.It is described
Object dimensional data can be one group of three-dimensional data acquired when incomplete object is static.Object dimensional data can also be incomplete
Object multigroup three-dimensional data acquired when being dynamic.
Illustratively, if identification camera shooting is bust, the incompleteness object can partly be blocked
Bust can be the face picture that user has blocked eyes with cap, the brim of a hat.The then object dimensional of corresponding incomplete object
Data include the three-dimensional data at other other positions not being blocked.If identification camera shooting is other objects, such as Fig. 2
It is shown, can be that damaged porcelain 113 has occurred, having in many museums much has historical relic researching value and ornamental valence
It is worth, but the porcelain of local damage.
S111, the object dimensional data are identified by preset incomplete identification model, with the determination incompleteness
Incomplete position on object.
The object dimensional data are actually the set of one or more groups of data, need further exist for the collection according to data
Close come the analysis and identification object dimensional data actually it is corresponding be face the position repaired of needs.
The incompleteness identification model can be trained for being determined according to the object dimensional data of incomplete object
The identifying system of incomplete position.The incompleteness identification model can be pre-stored in terminal device, or be pre-stored in background server
In.When needing that object dimensional data are identified, the incomplete identification model to prestore is called to identify object dimensional data, with
Determine the incomplete position of the incomplete object of shooting.
The incompleteness position can be the position that inherent feature has been lacked on incomplete object；If the incompleteness object is eye
The face that eyeball is blocked, then the position of incomplete position, that is, eyes, if the incompleteness object is damaged object, incomplete position
It is that damaged position occurs.
S112, feature reparation is carried out to the incomplete position on the incomplete object.
Wherein it is possible to carry out feature repair place to the incomplete position of the object dimensional data according to incomplete identification model
Reason.The inherent feature of missing can be corresponded to according to incomplete location determination, and corresponding inherent feature is added on incomplete position
Material.Illustratively, if the incompleteness position is the face picture that eyes are blocked, the inherent feature of incomplete topagnosis is
The material of corresponding eye feature is arranged in eyes on incomplete position, so as to obtain include eye feature facial image；
Such user can get the facial image with complete characterization, can increase the interest that user takes pictures, and optimization is existing
Shooting technology.
Optionally, as shown in figure 3, following sides can be passed through by carrying out feature reparation to the incomplete position on the incomplete object
Formula is implemented：
S1121, according to the incomplete location determination missing information, corresponding three-dimensional repair is determined according to the missing information
Material.
Wherein, the missing information includes that the inherent feature lacked on incomplete object and the incomplete object itself have
Some characteristic informations.The three-dimensional material of repairing is the material file for filling up missing information to match with missing information,
The three-dimensional material of repairing can be systemic presupposition.Illustratively, if the incompleteness object is the incomplete historical relic in museum,
It can be the reparation material that researcher restores according to historical data that three-dimensional, which repairs material,.
Illustratively, if the incompleteness position is the hand position of character image, certain inherent feature is hand
Feature, and if the person characteristic information in the character image is women, missing information includes the hand of women.It can be true
Fixed, the hand-characteristic of women and the hand-characteristic of male have many different places, are had according to incomplete object itself
Characteristic information can further obtain more accurately three-dimensional reparation material.
S1122, feature reparation is carried out to incomplete position according to the three-dimensional material of repairing.
Wherein it is possible to be that the three-dimensional material of repairing is arranged on position corresponding with incomplete position, so that incomplete object
The garbled information of incomplete position in body is padded, and then can generate the complete image of incomplete object.
Illustratively, as shown in Figure 2 and Figure 4, incomplete object is porcelain 113, and incomplete position is that the opening of porcelain 113 is sent out
Raw damaged area 114, while porcelain 113 is blue glazed porcelain, so including according to the incomplete location determination missing information：Porcelain
The damaged block of device opening, and green glaze feature；And then determined according to the missing information and matched with damaged area 114,
And be that the three-dimensional of green glaze material repairs material 115, as shown in figure 4, the three-dimensional material 115 of repairing is provided in incomplete position
It sets on 114 corresponding positions, the image of complete porcelain 116 can be obtained.
According to the incomplete location determination missing information, corresponding three-dimensional reparation material is determined according to the missing information,
The three-dimensional authenticity for repairing material can be further increased.
The one kind provided in the embodiment of the present application is taken pictures recovery scenario, by taking incomplete object in identification camera
When, the object dimensional data of the incomplete object are obtained by the identification camera；Pass through preset incomplete identification model pair
The object dimensional data are identified, with the incomplete position on the determination incomplete object；To residual on the incomplete object
Omission, which is set, carries out feature reparation.It, can be according to the object dimensional data of incomplete object to shooting by using above-mentioned technical proposal
Incomplete object carry out incomplete reparation, enrich the interactive function of terminal device and user, optimize existing shooting technology.
Fig. 5 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure, in above-described embodiment institute
On the basis of the technical solution of offer, to according to the three-dimensional operation progress repaired material and carry out feature reparation to incomplete position
Optimization, optionally, as shown in figure 5, this method includes：
S120, when identification camera takes incomplete object, pass through the identification camera and obtain the incomplete object
Object dimensional data.
S121, the object dimensional data are identified by preset incomplete identification model, with the determination incompleteness
Incomplete position on object.
S122, according to the incomplete location determination missing information, corresponding three-dimensional repair is determined according to the missing information
Material.
The specific implementation mode of aforesaid operations can refer to associated description above, and details are not described herein.
S123, the incomplete object on the screen of terminal device taken by real-time display.
S124, the three-dimensional angles of display for repairing material is determined according to the shooting angle of the incomplete object, and according to institute
State the three-dimensional display location for repairing material described in the incomplete location determination on incomplete object.
S125, the three-dimensional reparation element is shown on the screen of terminal device according to the angles of display and display location
Material.
Wherein, real-time display is the image for the incomplete object that identification camera is got in real time, is known if user adjusts
The angle of the shooting angle of other camera, the incomplete object of corresponding real-time display can also change.According to the incomplete object
The shooting angle of body determines the angles of display of three-dimensional reparation material, and then can make the three-dimensional angles of display and incompleteness for repairing material
The angles of display of object coincide.
Meanwhile the angles of display of incomplete object can also influence the specific location of incomplete position, and three-dimensional material of repairing needs
It matches with incomplete position, so repairing the display location of material according to incomplete location determination three-dimensional, three-dimensional reparation element can be made
The display location of material and incomplete position match, and then can match with the entirety of incomplete object.
The angles of display can be the relative angle on the basis of incomplete object, and the display location can be with incompleteness
Relative position on the basis of position.
The embodiment of the present application is by determining the three-dimensional angles of display for repairing material and display location, in the screen of terminal device
Upper real-time display incompleteness object and three-dimensional reparation material, and as user adjusts the shooting angle of identification camera, three-dimensional is repaired
Material can also be moved together with movement of the incomplete object in picture, and user can be seen in real time by the screen of terminal device
The complete incomplete object of display, keeps the photographing operation of user more interesting, optimizes the camera function of terminal device.
Fig. 6 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure, in above-mentioned arbitrary implementation
On the basis of the technical solution that example is provided, to being known to the object dimensional data by preset incomplete identification model
Not, it is optimized with the operation of the incomplete position on the determination incomplete object, optionally, as shown in fig. 6, this method packet
It includes：
S130, when identification camera takes incomplete object, pass through the identification camera and obtain the incomplete object
Object dimensional data.
Specific implementation mode can refer to associated description above, and details are not described herein.
S131, the object dimensional data are identified by preset incomplete identification model, with the determination incompleteness
The object type of object.
S132, the incomplete position on the incomplete object is determined according to the object type.
Wherein, the possibility of incomplete object includes multiple types, illustratively, can be the portrait of shooting, can be porcelain,
It can also be sculpture.And the object of different types, the inherent feature possessed differ, so needing to determine incomplete object first
The object type of body, and then the incomplete position of different objects can be determined according to the type of object.Described in determination
After the object type of incomplete object, then the complete inherent feature of the object type is may further determine that, and may determine that
What the inherent feature that the incompleteness object is lacked is.
S133, feature reparation is carried out to the incomplete position on the incomplete object.
Specific implementation mode can refer to associated description above, and details are not described herein.
Optionally, as shown in fig. 7, following sides can be passed through by carrying out feature reparation to the incomplete position on the incomplete object
Formula is implemented：
S1331, the object type according to the incomplete object and the incomplete location determination missing information, according to described
Missing information determines corresponding three-dimensional reparation material.
S1332, feature reparation is carried out to incomplete position according to the three-dimensional material of repairing.
It, can be according to object type and the incomplete location determination missing after the object type that incomplete object is determined
Information determines missing information, and then determines that the three-dimensional of corresponding object type repairs material, avoids the close material of shape is wrong
With on the incomplete object of different classifications, the accuracy of feature reparation can be further increased.
The embodiment of the present application is identified the object dimensional data by preset incomplete identification model, to determine
State the object type of incomplete object；The incomplete position on the incomplete object is determined according to the object type, it can be according to object
The different type of body determines missing information, can improve the accuracy of the identification of missing information.
Fig. 8 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure, in above-mentioned arbitrary implementation
On the basis of the technical solution that example is provided, to obtaining the object dimensional data of the incomplete object by the identification camera
Operation be optimized, optionally, as shown in figure 8, this method includes：
S140, when identification camera takes incomplete object, pass through the identification camera and obtain the incomplete object
Depth data and position infrared data.
The identification camera is three-dimensional (3D, Three Dimensional) camera, and three-dimensional camera includes a variety of
Hardware configuration, it may include：Infrared sensor, range sensor and camera lens etc..
The depth data are the set of distance value of the spatial point apart from identification camera included by incomplete object；
The depth data of incomplete object can be obtained by the range sensor in identification camera.
The position infrared data is the set of the infrared data of the space point reflection included by incomplete object.Wherein, three
Tie up camera when shooting, wherein infrared sensor emits infrared signal to incomplete object, incomplete object can to infrared information into
The imaging of incomplete object may be implemented according to the infrared data of the reflection received for row reflection, infrared sensor.
S141, the initial three-dimensional data that the incomplete object is determined according to the depth data.
Wherein, include the distance value of spatial point included by incomplete object in depth data, it is possible to according to
Depth data determine the initial three-dimensional data of incomplete object.Illustratively, as shown in figure 9, figure midpoint a, b, c and d are four
A spatial point, X, Y and Z axis representation space, the wherein depth data of Z axis representation space point, the plane of X and Y-axis representation space point
Position coordinates.The depth data of its midpoint a is maximum, that is, distances of the point a apart from identification camera is farthest, can from figure
A three-dimensional centrum can be formed to according to the plane coordinates and depth data of four spatial points, to according to multiple spatial points
Depth data and the plane coordinates of spatial point can determine initial three-dimensional data.
But it if is blocked at certain details of incomplete object or there is a situation where loss of data, initial three dimensions
The problem of corresponding details position will appear shortage of data in, so needing further exist for according to position infrared data to initial three
Dimension data is corrected.
S142, the initial three-dimensional data is corrected according to the position infrared data, to obtain the incomplete object
The object dimensional data of body.
Wherein, for the spatial point included by incomplete object, the depth data and infrared data one of each spatial point are a pair of
It answers.It, can be by whole initial three according to its corresponding infrared data for the depth data of the spatial point of shortage of data
Dimension data is weighed and is compared, and then carries out feature completion to the spatial point of missing.Infrared signal is a kind of electromagnetic wave, human eye
Can not see infrared signal, but if night or environment it is dark there is no visible light when, infrared light still can be into
Row is propagated, so in dark environment, more visible imaging can also be generated according to infrared data；And then it can be according to position
Infrared data is corrected initial three-dimensional data.
It is alternatively possible to fit correlation function is established according to the depth data of consecutive points and infrared data, and according to fitting
The position infrared data of relation function and dead space point calculates corresponding depth data, and then the object three after being corrected
Dimension data；Wherein, dead space point is the spatial point of depth data missing, and adjacent space point is the adjacent sky of dead space point
Between point.
S143, the object dimensional data are identified by preset incomplete identification model, with the determination incompleteness
Incomplete position on object.
S144, feature reparation is carried out to the incomplete position on the incomplete object.
The specific implementation mode of aforesaid operations can refer to associated description above, and details are not described herein.
Although shooting the image of incomplete object by common camera, that is, the 2-D data of the incomplete object obtained leads to
The shape of incomplete object can also be identified by crossing image procossing identification technology.But 2-D data only includes the data of flat image,
For the more demanding of light, if user shoots incomplete object, the data of acquired flat image in dark environment
The accurate incomplete position of middle possible None- identified, so the accuracy of 2-D data is relatively low.
The embodiment of the present application is by determining the initial three-dimensional data of the incomplete object, root according to the depth data
The initial three-dimensional data is corrected according to the position infrared data, to obtain the object dimensional number of the incomplete object
According to；It is identified in the position of dark, initial three-dimensional data can be also corrected by position infrared data, obtain standard
True object dimensional data, and then the accuracy of the identification of incomplete position can be improved.
Figure 10 is that another kind provided by the embodiments of the present application is taken pictures the flow diagram of restorative procedure, in above-mentioned arbitrary implementation
On the basis of the technical solution that example is provided, to obtaining the object dimensional data of the incomplete object by the identification camera
Operation be optimized, optionally, as shown in Figure 10, this method includes：
S150, it default sample data is input in default grader is trained, obtain incomplete identification model；
Wherein, the incomplete identification model is used to be determined according to the object dimensional data of the incomplete object taken corresponding
Incomplete position；The default sample data includes sample three-dimensional data and the corresponding sample incompleteness position of incomplete object.
Wherein, the default sample data may include multiple and different sample data, and different sample datas corresponds to
The different incomplete objects obtained, corresponding sample three-dimensional data and corresponding incomplete position；Illustratively, if incomplete object
Body is bust, and default sample data can be the sample three-dimensional data and correspondence for the different busts for blocking different parts
Incomplete position mark.
If the object dimensional data are identified by preset incomplete identification model, with the determination incomplete object
The object type of body, and the incomplete position on the incomplete object is determined according to the object type, then corresponding default sample
Notebook data includes the sample three-dimensional data of incomplete object, the object type of incomplete object and corresponding incomplete position.Due to every
A incompleteness object is different and object type is different, and corresponding incompleteness position is also different, so by sample three
Dimension data, corresponding object type and corresponding incomplete position, which are preset as default sample data input value in grader, to carry out
Training, to obtain incomplete identification model, can be identified according to the object dimensional data of input, determine corresponding object type
Type and corresponding incomplete position.
The default grader can be neural network, be carried out by presetting default sample data input value in grader
Training；Default grader can extract the characteristic of sample three-dimensional data, due to sample three-dimensional data be labelled with it is corresponding residual
Omission is set and/or object type, it is possible to according to the characteristic of extraction determine corresponding incomplete object incompleteness position and/or
Object type.
After being trained to default grader by default sample data, obtained incomplete identification model can be to different
The object type of incomplete object is determined, and determines corresponding incomplete position.
S151, when identification camera takes incomplete object, pass through the identification camera and obtain the incomplete object
Object dimensional data.
S152, the object dimensional data are identified by preset incomplete identification model, with the determination incompleteness
Incomplete position on object.
S153, feature reparation is carried out to the incomplete position on the incomplete object.
The specific implementation mode of aforesaid operations can refer to associated description above, and details are not described herein.
After being trained to default grader by default sample data, obtained incomplete identification model can be to different
The object type of incomplete object is determined, and can improve the accuracy of the determination of incomplete position.
Figure 11 is a kind of structure diagram for prosthetic device of taking pictures provided by the embodiments of the present application, which can execute and take pictures
Restorative procedure, as shown in figure 11, which includes：
Three-dimensional data acquisition module 210, for when identification camera takes incomplete object, being imaged by the identification
Head obtains the object dimensional data of the incomplete object；
Position determination module 211, for the object dimensional data to be identified by preset incomplete identification model,
With the incomplete position on the determination incomplete object；
Repair process module 212, for carrying out feature reparation to the incomplete position on the incomplete object.
The one kind provided in the embodiment of the present application is taken pictures recovery scenario, by taking incomplete object in identification camera
When, the object dimensional data of the incomplete object are obtained by the identification camera；Pass through preset incomplete identification model pair
The object dimensional data are identified, with the incomplete position on the determination incomplete object；To residual on the incomplete object
Omission, which is set, carries out feature reparation.It, can be according to the object dimensional data of incomplete object to shooting by using above-mentioned technical proposal
Incomplete object carry out incomplete reparation, enrich the interactive function of terminal device and user, optimize existing shooting technology.
Optionally, repair process module specifically includes：
Material determining module is used for according to the incomplete location determination missing information, according to missing information determination pair
The three-dimensional reparation material answered；
Feature repair module, for carrying out feature reparation to incomplete position according to the three-dimensional material of repairing.
Optionally, feature repair module is specifically used for：
Incomplete object display module, for the incomplete object taken by the real-time display on the screen of terminal device；
Determining module is shown, for determining the three-dimensional display angle for repairing material according to the shooting angle of the incomplete object
Degree, and according to the three-dimensional display location for repairing material described in the incomplete location determination on the incomplete object；
Display module is repaired, described in being shown on the screen of terminal device according to the angles of display and display location
Three-dimensional repairs material.
Optionally, position determination module is specifically used for：
The object dimensional data are identified by preset incomplete identification model, with the determination incomplete object
Object type；
The incomplete position on the incomplete object is determined according to the object type.
Optionally, repair process module is specifically used for：
According to the object type of the incomplete object and the incomplete location determination missing information, believed according to the missing
Breath determines corresponding three-dimensional reparation material；
Feature reparation is carried out to incomplete position according to the three-dimensional material of repairing.
Optionally, the identification camera is three-dimensional camera；Correspondingly, three-dimensional data acquisition module is specifically used for：
The depth data and position infrared data of the incomplete object are obtained by the identification camera；
The initial three-dimensional data of the incomplete object is determined according to the depth data；
The initial three-dimensional data is corrected according to the position infrared data, to obtain the object of the incomplete object
Body three-dimensional data.
Optionally, further include：
Training module, for before the object dimensional data are identified by preset incomplete identification model,
Default sample data is input in default grader and is trained, incomplete identification model is obtained；
Wherein, the incomplete identification model is used to be determined according to the object dimensional data of the incomplete object taken corresponding
Incomplete position；The default sample data includes sample three-dimensional data and the corresponding sample incompleteness position of incomplete object.
A kind of storage medium including computer executable instructions that the embodiment of the present application is provided, computer are executable
The reparation operation of taking pictures being not limited to the described above is instructed, the reparation side of taking pictures that the application any embodiment is provided can also be performed
Relevant operation in method.
The embodiment of the present application also provides a kind of storage medium including computer executable instructions, and the computer is executable
When being executed by computer processor for executing restorative procedure of taking pictures, this method includes for instruction：
When identification camera takes incomplete object, the object of the incomplete object is obtained by the identification camera
Three-dimensional data；
The object dimensional data are identified by preset incomplete identification model, on the determination incomplete object
Incomplete position；
Feature reparation is carried out to the incomplete position on the incomplete object.
Storage medium --- any various types of memory devices or storage device.Term " storage medium " is intended to wrap
It includes：Install medium, such as CD-ROM, floppy disk or magnetic tape equipment；Computer system memory or random access memory, such as
DRAM, DDR RAM, SRAM, EDO RAM, blue Bath (Rambus) RAM etc.；Nonvolatile memory, such as flash memory, magnetic medium
(such as hard disk or optical storage)；The memory component etc. of register or other similar types.Storage medium can further include other
Memory of type or combinations thereof.In addition, storage medium can be located at program in the first computer system being wherein performed,
Or can be located in different second computer systems, second computer system is connected to the by network (such as internet)
One computer system.Second computer system can provide program instruction to the first computer for executing." storage is situated between term
Matter " may include may reside in different location two of (such as in different computer systems by network connection) or
More storage mediums.Storage medium can store the program instruction that can be executed by one or more processors and (such as implement
For computer program).
The embodiment of the present application provides a kind of terminal device, and bat provided by the embodiments of the present application can be integrated in the terminal device
According to prosthetic device.
Figure 12 is a kind of structural schematic diagram of terminal device provided by the embodiments of the present application, and the embodiment of the present application provides one
Kind of terminal device 30, including memory 31, processor 32 and are stored in the computer that can be run on memory 31 and in processor
Program, the processor realize the restorative procedure of taking pictures described in above-described embodiment when executing the computer program.The application is real
The terminal device for applying example offer, can optimize existing shooting technology.
Figure 13 is a kind of structural schematic diagram of terminal device provided by the embodiments of the present application.As shown in figure 13, which sets
It is standby to may include：Shell (not shown), touch screen (not shown), touch key-press (not shown), memory
301, central processing unit (Central Processing Unit, CPU) 302 (also known as processor, hereinafter referred to as CPU), circuit board
(not shown) and power circuit (not shown).The circuit board is placed in the space interior that the shell surrounds；Institute
It states CPU302 and the memory 301 is arranged on the circuit board；The power circuit, for being each of the terminal device
A circuit or device power supply；The memory 301, for storing executable program code；The CPU302 passes through described in reading
The executable program code stored in memory 301 runs computer program corresponding with the executable program code, with
Realize following steps：
When identification camera takes incomplete object, the object of the incomplete object is obtained by the identification camera
Three-dimensional data；
The object dimensional data are identified by preset incomplete identification model, on the determination incomplete object
Incomplete position；
Feature reparation is carried out to the incomplete position on the incomplete object.
The terminal device further includes：Peripheral Interface 303, RF (Radio Frequency, radio frequency) circuit 305, audio-frequency electric
Road 306, loud speaker 311, power management chip 308, input/output (I/O) subsystem 309, touch screen 312, other input/controls
Control equipment 310 and outside port 304, these components are communicated by one or more communication bus or signal wire 307.
It should be understood that graphic terminal 300 is only an example of terminal device, and terminal device 300
Can have than shown in the drawings more or less component, can combine two or more components, or can be with
It is configured with different components.Various parts shown in the drawings can be including one or more signal processings and/or special
It is realized in the combination of hardware, software or hardware and software including integrated circuit.
Just the terminal device provided in this embodiment for realizing reparation of taking pictures is described in detail below, which sets
For by taking mobile phone as an example.
Memory 301, the memory 301 can be by access such as CPU302, Peripheral Interfaces 303, and the memory 301 can
Can also include nonvolatile memory to include high-speed random access memory, such as one or more disk memory,
Flush memory device or other volatile solid-state parts.
The peripheral hardware that outputs and inputs of equipment can be connected to CPU302 and deposited by Peripheral Interface 303, the Peripheral Interface 303
Reservoir 301.
I/O subsystems 309, the I/O subsystems 309 can be by the input/output peripherals in equipment, such as touch screen 312
With other input/control devicess 310, it is connected to Peripheral Interface 303.I/O subsystems 309 may include 3091 He of display controller
One or more input controllers 3092 for controlling other input/control devicess 310.Wherein, one or more input controls
Device 3092 processed receives electric signal from other input/control devicess 310 or sends electric signal to other input/control devicess 310,
Other input/control devicess 310 may include physical button (pressing button, rocker buttons etc.), dial, slide switch, behaviour
Vertical pole clicks idler wheel.It is worth noting that input controller 3092 can with it is following any one connect：Keyboard, infrared port,
The indicating equipment of USB interface and such as mouse.
Touch screen 312, the touch screen 312 are the input interface and output interface between subscriber terminal equipment and user,
Visual output is shown to user, visual output may include figure, text, icon, video etc..
Display controller 3091 in I/O subsystems 309 receives electric signal from touch screen 312 or is sent out to touch screen 312
Electric signals.Touch screen 312 detects the contact on touch screen, and the contact detected is converted to and is shown by display controller 3091
The interaction of user interface object on touch screen 312, that is, realize human-computer interaction, the user interface being shown on touch screen 312
Object can be the icon of running game, be networked to the icon etc. of corresponding network.It is worth noting that equipment can also include light
Mouse, light mouse are the extensions for the touch sensitive surface for not showing the touch sensitive surface visually exported, or formed by touch screen.
RF circuits 305 are mainly used for establishing the communication of mobile phone and wireless network (i.e. network side), realize mobile phone and wireless network
The data receiver of network and transmission.Such as transmitting-receiving short message, Email etc..Specifically, RF circuits 305 receive and send RF letters
Number, RF signals are also referred to as electromagnetic signal, and RF circuits 305 convert electrical signals to electromagnetic signal or electromagnetic signal is converted to telecommunications
Number, and communicated with communication network and other equipment by the electromagnetic signal.RF circuits 305 may include for executing
The known circuit of these functions comprising but it is not limited to antenna system, RF transceivers, one or more amplifiers, tuner, one
A or multiple oscillators, digital signal processor, CODEC (COder-DECoder, coder) chipset, user identifier mould
Block (Subscriber Identity Module, SIM) etc..
Voicefrequency circuit 306 is mainly used for receiving audio data from Peripheral Interface 303, which is converted to telecommunications
Number, and the electric signal is sent to loud speaker 311.
Loud speaker 311, the voice signal for receiving mobile phone from wireless network by RF circuits 305, is reduced to sound
And play the sound to user.
Power management chip 308, the hardware for being connected by CPU302, I/O subsystem and Peripheral Interface are powered
And power management.
Terminal device provided by the embodiments of the present application can optimize existing shooting technology.
Prosthetic device of taking pictures, storage medium and the terminal device provided in above-described embodiment, which can perform the application, arbitrarily to be implemented
The restorative procedure of taking pictures that example is provided has and executes the corresponding function module of this method and advantageous effect.Not in above-described embodiment
In detailed description technical detail, reference can be made to the restorative procedure of taking pictures that the application any embodiment is provided.
Note that above are only preferred embodiment and the institute's application technology principle of the application.It will be appreciated by those skilled in the art that
The application is not limited to specific embodiment described here, can carry out for a person skilled in the art it is various it is apparent variation,
The protection domain readjusted and substituted without departing from the application.Therefore, although being carried out to the application by above example
It is described in further detail, but the application is not limited only to above example, in the case where not departing from the application design, also
May include other more equivalent embodiments, and scope of the present application is determined by scope of the appended claims.
Claims (10)
- The restorative procedure 1. one kind is taken pictures, which is characterized in that including：When identification camera takes incomplete object, the object dimensional of the incomplete object is obtained by the identification camera Data；The object dimensional data are identified by preset incomplete identification model, with residual on the determination incomplete object Omission is set；Feature reparation is carried out to the incomplete position on the incomplete object.
- 2. the method as described in claim 1, which is characterized in that carry out feature reparation to the incomplete position on the incomplete object Including：According to the incomplete location determination missing information, corresponding three-dimensional reparation material is determined according to the missing information；Feature reparation is carried out to incomplete position according to the three-dimensional material of repairing.
- 3. method as claimed in claim 2, which is characterized in that carry out feature to incomplete position according to the three-dimensional material of repairing Reparation includes：Incomplete object on the screen of terminal device taken by real-time display；The three-dimensional angles of display for repairing material is determined according to the shooting angle of the incomplete object, and according to the incomplete object On incomplete location determination described in the three-dimensional display location for repairing material；The three-dimensional reparation material is shown on the screen of terminal device according to the angles of display and display location.
- 4. the method as described in claim 1, which is characterized in that by preset incomplete identification model to the object dimensional number According to being identified, include with the incomplete position on the determination incomplete object：The object dimensional data are identified by preset incomplete identification model, with the object of the determination incomplete object Type；The incomplete position on the incomplete object is determined according to the object type.
- 5. method as claimed in claim 4, which is characterized in that carry out feature reparation to the incomplete position on the incomplete object Including：It is true according to the missing information according to the object type of the incomplete object and the incomplete location determination missing information Fixed corresponding three-dimensional reparation material；Feature reparation is carried out to incomplete position according to the three-dimensional material of repairing.
- 6. such as method described in any one of claim 1 to 5, which is characterized in that the identification camera is three-dimensional camera；Phase Ying Di, the object dimensional data that the incomplete object is obtained by the identification camera include：The depth data and position infrared data of the incomplete object are obtained by the identification camera；The initial three-dimensional data of the incomplete object is determined according to the depth data；The initial three-dimensional data is corrected according to the position infrared data, to obtain the object three of the incomplete object Dimension data.
- 7. such as method described in any one of claim 1 to 5, which is characterized in that by preset incomplete identification model to institute It states before object dimensional data are identified, further includes：Default sample data is input in default grader and is trained, incomplete identification model is obtained；Wherein, the incomplete identification model is used to determine corresponding incompleteness according to the object dimensional data of the incomplete object taken Position；The default sample data includes sample three-dimensional data and the corresponding sample incompleteness position of incomplete object.
- The prosthetic device 8. one kind is taken pictures, which is characterized in that including：Three-dimensional data acquisition module, for when identification camera takes incomplete object, being obtained by the identification camera The object dimensional data of the incompleteness object；Position determination module, for the object dimensional data to be identified by preset incomplete identification model, with determination Incomplete position on the incompleteness object；Repair process module, for carrying out feature reparation to the incomplete position on the incomplete object.
- 9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor The restorative procedure of taking pictures as described in any one of claim 1-7 is realized when row.
- 10. a kind of terminal device, which is characterized in that including memory, processor and storage are on a memory and can be in processor The computer program of operation, which is characterized in that the processor realizes that claim 1-7 such as appoints when executing the computer program Restorative procedure of taking pictures described in one.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810468017.8A CN108765321B (en) | 2018-05-16 | 2018-05-16 | Shooting repair method and device, storage medium and terminal equipment |
| PCT/CN2019/085452 WO2019218878A1 (en) | 2018-05-16 | 2019-05-05 | Photography restoration method and apparatus, storage medium and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810468017.8A CN108765321B (en) | 2018-05-16 | 2018-05-16 | Shooting repair method and device, storage medium and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108765321A true CN108765321A (en) | 2018-11-06 |
| CN108765321B CN108765321B (en) | 2021-09-07 |
Family
ID=64008166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810468017.8A Active CN108765321B (en) | 2018-05-16 | 2018-05-16 | Shooting repair method and device, storage medium and terminal equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108765321B (en) |
| WO (1) | WO2019218878A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019218878A1 (en) * | 2018-05-16 | 2019-11-21 | Oppo广东移动通信有限公司 | Photography restoration method and apparatus, storage medium and terminal device |
| CN112785633A (en) * | 2020-12-30 | 2021-05-11 | 深兰人工智能芯片研究院（江苏）有限公司 | Cultural relic repair strategy acquisition method and device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8704875B2 (en) * | 2011-03-25 | 2014-04-22 | Chung Hua University | Apparatus for generating real-time stereoscopic image and method thereof |
| CN105069833A (en) * | 2015-07-29 | 2015-11-18 | 苏州华漫信息服务有限公司 | Three-dimensional model repair method capable of retaining texture information data |
| CN105598450A (en) * | 2016-02-02 | 2016-05-25 | 陕西天元智能再制造股份有限公司 | Laser three-dimensional profiling repair method for damaged components and parts |
| CN106127147A (en) * | 2016-06-23 | 2016-11-16 | 深圳市唯特视科技有限公司 | A kind of face depth texture restorative procedure based on three-dimensional data |
| CN107343148A (en) * | 2017-07-31 | 2017-11-10 | 广东欧珀移动通信有限公司 | Image completion method, apparatus and terminal |
| CN107452034A (en) * | 2017-07-31 | 2017-12-08 | 广东欧珀移动通信有限公司 | Image processing method and its device |
| CN107948499A (en) * | 2017-10-31 | 2018-04-20 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101142739B1 (en) * | 2009-10-29 | 2012-05-03 | 삼성전자주식회사 | Apparatus and method for inpainting image by restricting reference image region |
| CN105763812B (en) * | 2016-03-31 | 2019-02-19 | 北京小米移动软件有限公司 | Intelligent photographing method and device |
| CN106600701A (en) * | 2016-10-28 | 2017-04-26 | 黑龙江省科学院自动化研究所 | Digital museum cultural relics display method based on virtual reality technology |
| CN107392873A (en) * | 2017-07-28 | 2017-11-24 | 上海鋆创信息技术有限公司 | The virtual restorative procedure of object, object restorative procedure and object virtual display system |
| CN107437268A (en) * | 2017-07-31 | 2017-12-05 | 广东欧珀移动通信有限公司 | Photographic method, device, mobile terminal and computer-readable storage medium |
| CN108765321B (en) * | 2018-05-16 | 2021-09-07 | Oppo广东移动通信有限公司 | Shooting repair method and device, storage medium and terminal equipment |
-
2018
- 2018-05-16 CN CN201810468017.8A patent/CN108765321B/en active Active
-
2019
- 2019-05-05 WO PCT/CN2019/085452 patent/WO2019218878A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8704875B2 (en) * | 2011-03-25 | 2014-04-22 | Chung Hua University | Apparatus for generating real-time stereoscopic image and method thereof |
| CN105069833A (en) * | 2015-07-29 | 2015-11-18 | 苏州华漫信息服务有限公司 | Three-dimensional model repair method capable of retaining texture information data |
| CN105598450A (en) * | 2016-02-02 | 2016-05-25 | 陕西天元智能再制造股份有限公司 | Laser three-dimensional profiling repair method for damaged components and parts |
| CN106127147A (en) * | 2016-06-23 | 2016-11-16 | 深圳市唯特视科技有限公司 | A kind of face depth texture restorative procedure based on three-dimensional data |
| CN107343148A (en) * | 2017-07-31 | 2017-11-10 | 广东欧珀移动通信有限公司 | Image completion method, apparatus and terminal |
| CN107452034A (en) * | 2017-07-31 | 2017-12-08 | 广东欧珀移动通信有限公司 | Image processing method and its device |
| CN107948499A (en) * | 2017-10-31 | 2018-04-20 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
Non-Patent Citations (1)
| Title |
|---|
| 熊邦书 等: "基于RBF神经网络的三维残缺数据修补算法", 《计算机工程与应用》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019218878A1 (en) * | 2018-05-16 | 2019-11-21 | Oppo广东移动通信有限公司 | Photography restoration method and apparatus, storage medium and terminal device |
| CN112785633A (en) * | 2020-12-30 | 2021-05-11 | 深兰人工智能芯片研究院（江苏）有限公司 | Cultural relic repair strategy acquisition method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019218878A1 (en) | 2019-11-21 |
| CN108765321B (en) | 2021-09-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111985265B (en) | Image processing method and device | |
| EP3700190A1 (en) | Electronic device for providing shooting mode based on virtual character and operation method thereof | |
| CN109978989B (en) | Three-dimensional face model generation method, three-dimensional face model generation device, computer equipment and storage medium | |
| US11074466B2 (en) | Anti-counterfeiting processing method and related products | |
| CN106558025B (en) | Picture processing method and device | |
| US20170039761A1 (en) | Image Processing Method And Apparatus | |
| KR101979669B1 (en) | Method for correcting user’s gaze direction in image, machine-readable storage medium and communication terminal | |
| CN108681402A (en) | Identify exchange method, device, storage medium and terminal device | |
| CN109348135A (en) | Photographic method, device, storage medium and terminal device | |
| CN108646920A (en) | Identify exchange method, device, storage medium and terminal device | |
| CN110059652B (en) | Face image processing method, device and storage medium | |
| WO2021143282A1 (en) | Three-dimensional facial model generation method and apparatus, computer device and storage medium | |
| CN108989678B (en) | Image processing method and mobile terminal | |
| CN109522863B (en) | Ear key point detection method and device and storage medium | |
| CN112581358B (en) | Training method of image processing model, image processing method and device | |
| CN111556337B (en) | Media content implantation method, model training method and related device | |
| US11284020B2 (en) | Apparatus and method for displaying graphic elements according to object | |
| KR20200038111A (en) | electronic device and method for recognizing gestures | |
| CN108921815A (en) | It takes pictures exchange method, device, storage medium and terminal device | |
| CN108765321A (en) | It takes pictures restorative procedure, device, storage medium and terminal device | |
| CN110555815A (en) | Image processing method and electronic equipment | |
| CN108491780A (en) | Image landscaping treatment method, apparatus, storage medium and terminal device | |
| CN114022532A (en) | Height measuring method, height measuring device and terminal | |
| CN108764135B (en) | Image generation method and device and electronic equipment | |
| CN111982293B (en) | Body temperature measuring method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |