CN107623814A - The sensitive information screen method and device of shooting image - Google Patents
The sensitive information screen method and device of shooting image Download PDFInfo
- Publication number
- CN107623814A CN107623814A CN201710676891.6A CN201710676891A CN107623814A CN 107623814 A CN107623814 A CN 107623814A CN 201710676891 A CN201710676891 A CN 201710676891A CN 107623814 A CN107623814 A CN 107623814A
- Authority
- CN
- China
- Prior art keywords
- information
- foreground area
- sensitive information
- structure light
- depth
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses the sensitive information screen method and device of a kind of shooting image, wherein, method is included to preview screen foreground area projective structure light source, and shoots the structure light image that structure light source passes through foreground area modulation；Phase corresponding to deformation position pixel in demodulation structure light image, the depth of view information of foreground area is generated according to phase, the 3D information of foreground area is generated according to depth of view information；The 3D information of foreground area is matched with the database to prestore, if obtaining the sensitive information that matching degree is more than predetermined threshold value in foreground area, shielding processing is carried out to sensitizing range corresponding to sensitive information.Thus, it is possible to realize the active selection to shooting image, intelligentized shielding processing can be carried out to sensitive information, better meet the demand of taking pictures of user.
Description
Technical field
The present invention relates to the sensitive information shield side in terminal device shooting technology field, more particularly to a kind of shooting image
Method.
Background technology
With the continuous development of terminal device technology, the shoot function in shoot function in terminal device is more and more richer
Richness, user also increasingly get used to using terminal equipment and shot.However, the image information captured by terminal device is abundant
Changeable, the information that shooting picture is included depends on finding a view for view finder, can not realize and include information to shooting picture
Actively select.
The content of the invention
The present invention provides a kind of the sensitive information screen method and device of shooting image, can not to solve in the prior art
Actively select in preview screen, the technical problem of the information of subject.
The embodiment of the present invention provides a kind of sensitive information screen method of shooting image, including：To preview screen foreground zone
Domain projective structure light source, and shoot the structure light image that the structure light source passes through foreground area modulation；Demodulate the knot
Phase corresponding to deformation position pixel in structure light image, the depth of view information of the foreground area is generated according to the phase, according to
The depth of view information generates the 3D information of the foreground area；The 3D information of the foreground area and the database to prestore are carried out
Matching, it is corresponding to the sensitive information if obtaining the sensitive information that matching degree is more than predetermined threshold value in the foreground area
Sensitizing range carry out shielding processing.
Another embodiment of the present invention provides a kind of sensitive information screening arrangement of shooting image, including：Taking module, it is used for
To preview screen foreground area projective structure light source, and shoot the structure light that the structure light source passes through foreground area modulation
Image；Generation module, for demodulating phase corresponding to deformation position pixel in the structure light image, generated according to the phase
The depth of view information of the foreground area, the 3D information of the foreground area is generated according to the depth of view information；Matching module, it is used for
The 3D information of the foreground area is matched with the database to prestore；Processing module, for being obtained in the foreground area
Take matching degree be more than predetermined threshold value sensitive information when, to corresponding to the sensitive information sensitizing range carry out shielding processing.
Further embodiment of this invention provides a kind of terminal device, including memory and processor, is stored in the memory
There is computer-readable instruction, when the instruction is by the computing device so that the above-mentioned implementation of the computing device present invention
The sensitive information screen method of shooting image described in example.
A further embodiment of the present invention provides a kind of non-transitorycomputer readable storage medium, is stored thereon with computer journey
Sequence, the sensitive information screen of shooting image as described in the above embodiment the present invention is realized when the computer program is executed by processor
Cover method.
Technical scheme provided in an embodiment of the present invention can include the following benefits：
To preview screen foreground area projective structure light source, and shoot the structure light that structure light source passes through foreground area modulation
Image, phase corresponding to deformation position pixel in demodulation structure light image, according to the depth of view information of phase generation foreground area, root
According to the 3D information of depth of view information generation foreground area, the 3D information of foreground area is matched with the database to prestore, if
The sensitive information that matching degree is more than predetermined threshold value is obtained in foreground area, then sensitizing range corresponding to sensitive information is shielded
Processing.Thus, it is possible to realize the active selection to shooting image, intelligentized shielding processing can be carried out to sensitive information, more
The good demand of taking pictures for meeting user.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Substantially and it is readily appreciated that, wherein：
Fig. 1 is the flow chart of the sensitive information screen method of shooting image according to an embodiment of the invention；
Fig. 2 (a) is the schematic diagram of a scenario one of structural light measurement according to an embodiment of the invention；
Fig. 2 (b) is the schematic diagram of a scenario two of structural light measurement according to an embodiment of the invention；
Fig. 2 (c) is the schematic diagram of a scenario three of structural light measurement according to an embodiment of the invention；
Fig. 2 (d) is the schematic diagram of a scenario four of structural light measurement according to an embodiment of the invention；
Fig. 2 (e) is the schematic diagram of a scenario five of structural light measurement according to an embodiment of the invention；
Fig. 3 (a) is the local diffraction structure schematic diagram of collimation beam splitting element according to an embodiment of the invention；
Fig. 3 (b) is the local diffraction structure schematic diagram of collimation beam splitting element in accordance with another embodiment of the present invention；
Fig. 4 is shown according to the implementation result of the sensitive information screen method of the shooting image of a specific embodiment of the invention
It is intended to；
Fig. 5 is the realization device according to the sensitive information screen method of the shooting image of a specific embodiment of the invention
Structured flowchart；
Fig. 6 is the structured flowchart of the sensitive information screening arrangement of shooting image according to an embodiment of the invention；
Fig. 7 is the structured flowchart of the sensitive information screening arrangement of shooting image in accordance with another embodiment of the present invention；With
And
Fig. 8 is the structural representation of the image processing circuit in the terminal device that one embodiment of the invention proposes.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end
Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
It should be appreciated that under many application scenarios, user is wanted in the picture of shooting, except wishing to clap comprising user
Outside the main information taken the photograph, also comprising other sensitive informations, if may influence what is taken pictures comprising the sensitive information in shooting picture
Photo it is attractive in appearance, or even unnecessary dispute can be brought when in use, for example invade other people portraiture rights, or, due to bag
Legal consequence is brought containing violence information etc..
In order to solve the above-mentioned technical problem, in embodiments of the invention, the information in shooting picture can be actively selected,
On the basis of guarantee can get shooting main information, sensitive information is shielded, has better met the demand of taking pictures of user.
Below with reference to the accompanying drawings the sensitive information screen method and device of the shooting image of the embodiment of the present invention are described.
Fig. 1 is the flow chart of the sensitive information screen method of shooting image according to an embodiment of the invention.
As shown in figure 1, the sensitive information screen method of the shooting image includes：
Step 101, to preview screen foreground area projective structure light source, and shoot structure light source and modulated by foreground area
Structure light image.
Step 102, phase corresponding to deformation position pixel in demodulation structure light image, foreground area is generated according to phase
Depth of view information, the 3D information of foreground area is generated according to depth of view information.
Wherein, the 3D information of the embodiment of the present invention includes the depth information of image, picture element position information etc..
It is appreciated that sensitive information where sensitizing range relative to other regions the depth of field and differ, therefore, in this reality
Apply in example, the depth of view information based on foreground area determines the sensitizing range where sensitive information.
It should be noted that according to the difference of application scenarios, different embodiments can be used to obtain the scape of foreground area
Deeply convince breath.
As a kind of possible implementation, in order to further improve the sensitizing range degree of accuracy of determination, based on structure light
The depth of view information of foreground area is obtained, wherein, the architectural feature of structure light source includes laser stripe, Gray code, sine streak,
Even speckle or, non-homogeneous speckle.
In the present embodiment, in order that those skilled in the art be more apparent from, how according to structure light come
The depth of view information of foreground area is obtained, is explained below by taking a kind of widely used optical grating projection technology (fringe projection technology) as an example
Its concrete principle is stated, wherein, optical grating projection technology belongs to sensu lato area-structure light.
When being projected using area-structure light, as shown in Fig. 2 (a), sine streak is produced by computer programming, by this
Sine streak is by projection to measured object, the degree of crook modulated using CCD camera shooting striped by object, demodulation
The curved stripes obtain phase, then phase is converted into the height of the whole audience.Certain wherein crucial point is exactly system
Demarcation, including the calibration of camera of the demarcation of system geometric parameter and CCD camera and projector equipment, are otherwise likely to produce
Error or error coupler.Because its exterior parameter is not demarcated, correct elevation information can not possibly be calculated by phasometer.
Specifically, the first step, programming produce sine streak figure, because subsequently to utilize deforming stripe figure to obtain phase,
For example phase is obtained using four step phase-shifting methods, therefore four width phase difference pi/2 striped is produced here, then by the four spokes line
Timesharing is projected on measured object (mask), is collected such as the figure on Fig. 2 (b) left sides, while to be gathered shown on the right of Fig. 2 (b)
The striped of the plane of reference.
Second step, phase recovery is carried out, calculated by phase modulation by modulation bar graph by four width collected, obtained here
To phase diagram be to block phase diagram because the result that four step Phase-shifting algorithms obtain be by arctan function calculate gained, thus
It is limited between [- pi, pi], that is to say, that whenever its value exceedes the scope, it can restart again.Obtained phase main value
As shown in Fig. 2 (c).
Wherein, it is necessary to which the saltus step that disappears, it is continuous phase that will block phase recovery, such as Fig. 2 (d) institutes under second step
Show, the left side is the continuous phase modulated, and the right is to refer to continuous phase.
3rd step, subtract each other to obtain phase difference by the continuous phase modulated and with reference to continuous phase, the phase difference then characterizes
Elevation information of the measured object with respect to the plane of reference, then phase and high-degree of conversion formula (wherein relevant parameter is by demarcating) are substituted into,
Obtain the threedimensional model of the object under test as shown in Fig. 2 (e).
It should be appreciated that in actual applications, according to the difference of concrete application scene, employed in the embodiment of the present invention
Structure light in addition to above-mentioned grating, can also be other arbitrary graphic patterns.
, wherein it is desired to, it is emphasized that as a kind of possible implementation, the present invention carries out waiting to take using pattern light
The collection of the facial information of part user, so as to according in pattern light according to preset algorithm set spot at random,
Caused displacement restores the facial relevant depth information of face (equivalent to modulation) after projecting user's face.
In the present embodiment, the diffraction element of essentially flat board can be used, the diffraction element has particular phases distribution
Embossment diffraction structure, cross section is floats with two or more concavo-convex step embossment structures, or multiple concavo-convex steps
Carve structure, the thickness substantially l microns of substrate, each step it is highly non-uniform, be 0.7 micron one 0.9 microns.Fig. 3 (a) is
The present embodiment collimation beam splitting element local diffraction structure, Fig. 3 (b) be along the A of section A one cross sectional side view, abscissa and
The unit of ordinate is micron.
So as to, multi beam diffraction light is obtained after diffraction is carried out to light beam due to common diffraction element, but per beam diffraction light light
Strong difference is big, also big to the risk of human eye injury, even carries out re-diffraction, the uniformity of obtained light beam to diffraction light
It is relatively low, object is projected in image information processing device using such light beam, drop shadow effect is poor.
Collimation beam splitting element in the present embodiment not only has the function that to collimate uncollimated rays, also has light splitting
Effect, i.e., through speculum reflection non-collimated light after collimate beam splitting element toward different angle be emitted multi-beam collimation light beam,
And the area of section approximately equal of the multi-beam collimation light beam of outgoing, flux of energy approximately equal, and then to spread out using the light beam
Scatterplot light after penetrating carries out image procossing or the effect of projection is more preferable, meanwhile, laser emitting light is dispersed to every light beam, further
The risk of injury human eye is reduced, and due to being pattern light, relative to other uniform structure lights of arrangement, reaches same
During collection effect, the electric energy consumed is lower.
Based on foregoing description, in the present embodiment, to preview screen foreground area projective structure light source, and structure light is shot
The structure light image of foreground area modulation, phase corresponding to deformation position pixel in demodulation structure light image, according to phase are passed through in source
The distortion of position calculates the depth of view information of foreground area, and the 3D information of foreground area is generated according to depth of view information.
Step 103, the 3D information of foreground area is matched with the database to prestore, if the acquisition in foreground area
Sensitive information with degree more than predetermined threshold value, then shielding processing is carried out to sensitizing range corresponding to sensitive information.
Wherein, the sensitive information of the embodiment of the present invention includes the 3D for being not intended to various elements shown in the photo in shooting
Information etc., it can include：The 3D information (such as indecency gesture information) of special gesture, special pattern 3D information (such as some
Country national flag information), the 3D information (such as various road sign prompt messages) of special mark, it is, of course, also possible to including user
The 3D information for the coherent element demarcated according to the demands of individuals of oneself, such as, user A does not like religious architecture, then for the use
Family A sensitive information includes the 3D information of religious architecture.
It is appreciated that prestore the database comprising sensitive information, such as storage or in cloud in the local database
Storage includes the database of sensitive information in server, and then, by the 3D information of foreground area and the database to prestore progress
Match somebody with somebody, if the sensitive information that matching degree is more than predetermined threshold value is obtained in foreground area, to sensitizing range corresponding to sensitive information
Shielding processing is carried out, for example mosaic processing is carried out to sensitizing range corresponding to sensitive information, or, cover at special pattern
Reason, or, delete processing etc..
Wherein, above-mentioned predetermined threshold value can demarcate according to the precision and system operations ability for obtaining 3D information, the 3D of acquisition
Precision of information is higher, the operational capability of system is stronger, and predetermined threshold value is higher, and the 3D precisions of information of acquisition are lower, system computing
Ability is weaker, and predetermined threshold value is lower.
It should be noted that according to the difference of concrete application scene, can be in different ways to corresponding to sensitive information
Sensitizing range carries out shielding processing, is illustrated below：
The first example：
The depth of view information of foreground area is carried out according to preset algorithm to calculate the baseline values for obtaining virtualization degree, according to void
The baseline values of change degree carry out Gaussian Blur processing to sensitizing range.
Wherein, depth of view information be instigate subject produce more sharp image closest approach to solstics distance, i.e.,
The spatial depth of subject energy blur-free imaging.For each pixel pair in sensitizing range where foreground area and sensitive information
The depth of view information answered, it can be inquired about according to phase difference of the pixel in the preview image data that two rear cameras obtain
Arrive.
In addition, the baseline values of virtualization degree are an a reference value of virtualization degree, can be by the basis of virtualization degree
Computing is carried out on the basis of numerical value to obtain blurring coefficient, and background area is blurred according to virtualization coefficient.
In the present embodiment, the preset algorithm that the baseline values of virtualization degree are obtained according to depth of view information can have different realities
Existing mode.For example, it may be determined that the typical value of the depth of view information of sensitizing range where foreground area and sensitive information, then basis
The typical value of the depth of view information of sensitizing range where foreground area and sensitive information carries out computing and obtains the basis of virtualization degree
Numerical value.Wherein, typical value can include but is not limited to average value, sampled value etc..The baseline values for obtaining virtualization degree are used
Operation method may include but be not limited to calculate ratio, difference or the base of foreground area and the sensitizing range where sensitive information
In ratio, either difference is further multiplied by or plus modes such as preset values.
For example, the average value of foreground area and the depth of view information of the sensitizing range where sensitive information is obtained, is calculated
The ratio of the average value of sensitizing range obtains the baseline values of virtualization degree where foreground area and sensitive information.Wherein, it is sensitive
The ratio of the average value of region and foreground area is bigger, and the baseline values for blurring degree are also bigger.
Further, Gauss is carried out to background area according to the depth of view information of the baseline values of virtualization degree and sensitizing range
Fuzzy Processing so that sensitizing range depth of view information is bigger, and virtualization degree is higher.Specifically, can be according to the basic number of virtualization degree
Value and the depth of view information of sensitizing range are that all pixels point determines a unified virtualization coefficient in sensitizing range, or are respectively
Each pixel determines to blur coefficient corresponding to one in sensitizing range, and according to virtualization coefficient to the pixel in sensitizing range
Carry out Gaussian Blur processing.
Wherein, the virtualization degree that coefficient represents sensitizing range is blurred, virtualization coefficient is bigger, and the virtualization degree of sensitizing range is got over
Height, in one embodiment of the invention, the baseline values of virtualization degree and the depth of field of each pixel in sensitizing range can be calculated
The product of information, obtain the virtualization coefficient of each pixel in sensitizing range.
In order to more clearly illustrate the sensitive information screen method of the shooting image of the embodiment of the present invention, with reference to tool
The application scenarios of body are illustrated：
As shown in Fig. 4 left figures, object A and B are contained in current preview picture, then projects and ties to preview screen foreground area
Structure light source, and shoot the structure light image that structure light source passes through foreground area modulation, deformation position picture in demodulation structure light image
Phase corresponding to element, the depth of view information of foreground area is generated according to phase, the 3D information of foreground area is generated according to depth of view information,
The 3D information of foreground area is matched with the database to prestore, finds the sensitive letter in object B 3D information and dates storehouse
The matching degree of breath is more than predetermined threshold value, then carries out shielding processing to sensitizing range where object B preview image, so as to such as Fig. 4
Shown in right figure, object B image is not included in the shooting image of acquisition.
It should be appreciated that above-described embodiment concentrate on according to the 3D information of foreground area with it is quick in the database that prestores
Sense information is matched to identify in the foreground area of shooting whether include sensitive information, in actual applications, in order to enter one
Step improves recognition accuracy, other additional informations of foreground area can be also obtained, with according to other additional informations and 3D information
Whether sensitive information is included in the common foreground area for judging shooting, certainly, under this application scenarios, except bag in database
Other additional informations are should also contain outside 3D information containing sensitive information.
Illustrated below so that the additional information of acquisition is infrared information as an example：
In this example, as shown in figure 5, terminal device includes starting module, sensitive information matching module and setup module,
When then the photograph application program in terminal device is activated, to preview screen foreground area projective structure light source, and knot is shot
Structure light image of the structure light source by foreground area modulation is to obtain the infrared image for corresponding to foreground area, demodulation structure light figure
The phase corresponding to deformation position pixel as in, the depth of view information of foreground area is generated according to phase, before being generated according to depth of view information
The 3D information of scene area.
The 3D information of infrared image and the foreground area obtained is subjected to pixel matching, builds the 3D models of foreground area,
And then matched the 3D models of foreground area with the 3D models of the foreground area of sensitive information in the database to prestore, if
The match is successful, then shows to include sensitive information in the preview image of current foreground area, then to quick corresponding to the sensitive information
Sensillary area domain carries out shielding processing.
Wherein, due in the present embodiment, when 3D information and infrared information based on foreground area are matched, due to red
External information includes abundant face detail information, therefore, carries out sensitive letter compared to the 3D information only according to foreground area and knows
Otherwise, the degree of accuracy is higher.
In summary, the sensitive information screen method of the shooting image of the embodiment of the present invention, to preview screen foreground area
Projective structure light source, and the structure light image that structure light source passes through foreground area modulation is shot, deformed in demodulation structure light image
Phase corresponding to the pixel of position, the depth of view information of foreground area is generated according to phase, foreground area is generated according to depth of view information
3D information, the 3D information of foreground area is matched with the database to prestore, be more than if obtaining matching degree in foreground area
The sensitive information of predetermined threshold value, then shielding processing is carried out to sensitizing range corresponding to sensitive information.Thus, it is possible to realize to shooting
The active selection of image, intelligentized shielding processing can be carried out to sensitive information, better meet the demand of taking pictures of user.
In order to realize above-described embodiment, the present invention also proposes a kind of sensitive information screening arrangement of shooting image, and Fig. 6 is root
According to the structured flowchart of the sensitive information screening arrangement of the shooting image of one embodiment of the invention, as shown in fig. 6, the shooting image
Sensitive information screening arrangement include taking module 100, generation module 200, matching module 300 and processing module 400.
Wherein, taking module 100, for preview screen foreground area projective structure light source, and structure light source warp is shot
Cross the structure light image of foreground area modulation.
Generation module 200, for phase corresponding to deformation position pixel in demodulation structure light image, before being generated according to phase
The depth of view information of scene area, the 3D information of foreground area is generated according to depth of view information.
Matching module 300, for the 3D information of foreground area to be matched with the database to prestore.
Processing module 400, when being more than the sensitive information of predetermined threshold value for obtaining matching degree in foreground area, to sensitivity
Sensitizing range corresponding to information carries out shielding processing.
It should be noted that according to the difference of concrete application scene, processing module 400 can use different implementations pair
Sensitizing range corresponding to sensitive information carries out shielding processing.
In one embodiment of the invention, as shown in fig. 7, on the basis of as shown in Figure 6, processing module 400 includes
Acquiring unit 410 and processing unit 420.
Wherein, acquiring unit 410, for carrying out calculating acquisition to the depth of view information of the foreground area according to preset algorithm
The baseline values of virtualization degree.
Processing unit 420, Gaussian Blur is carried out to the sensitizing range for the baseline values according to the virtualization degree
Processing.
The division of modules is only used for for example, in other realities in the sensitive information screening arrangement of above-mentioned shooting image
Apply in example, the sensitive information screening arrangement of shooting image can be divided into different modules as required, to complete above-mentioned shooting
All or part of function of the sensitive information screening arrangement of image.
It should be noted that the sensitive information screen method of the shooting image of the embodiment of the present invention is also applied for the present invention in fact
The sensitive information screening arrangement of the shooting image of example is applied, its realization principle is similar, will not be repeated here.
In summary, the sensitive information screening arrangement of the shooting image of the embodiment of the present invention, to preview screen foreground area
Projective structure light source, and the structure light image that structure light source passes through foreground area modulation is shot, deformed in demodulation structure light image
Phase corresponding to the pixel of position, the depth of view information of foreground area is generated according to phase, foreground area is generated according to depth of view information
3D information, the 3D information of foreground area is matched with the database to prestore, be more than if obtaining matching degree in foreground area
The sensitive information of predetermined threshold value, then shielding processing is carried out to sensitizing range corresponding to sensitive information.Thus, it is possible to realize to shooting
The active selection of image, intelligentized shielding processing can be carried out to sensitive information, better meet the demand of taking pictures of user.
To achieve the above object, the present invention also proposes a kind of terminal device.Above-mentioned terminal includes image processing circuit, figure
As process circuit can utilize hardware and/or component software to realize, it may include define ISP (Image Signal
Processing, picture signal processing) pipeline various processing units.Fig. 8 is the terminal device that one embodiment of the invention proposes
In image processing circuit structural representation.As shown in figure 8, for purposes of illustration only, only show related to the embodiment of the present invention
The various aspects of image processing techniques.
As shown in figure 8, image processing circuit 110 includes imaging device 1110, ISP processors 1130 and control logic device
1140.Imaging device 1110 may include the camera and structure light with one or more lens 1112, imaging sensor 1114
The projector 1116.Structured light projector 1116 is by structured light projection to measured object.Wherein, the structured light patterns can be laser strip
Line, Gray code, sine streak or, speckle pattern of random alignment etc..Imaging sensor 1114 catches projection to measured object shape
Into structure light image, and structure light image is sent to ISP processors 1130, by ISP processors 1130 to structure light image
It is demodulated the depth information for obtaining measured object.Meanwhile imaging sensor 1114 can also catch the color information of measured object.When
So, the structure light image and color information of measured object can also be caught respectively by two imaging sensors 1114.Wherein, with speckle
Exemplified by structure light, ISP processors 1130 are demodulated to structure light image, are specifically included, and quilt is gathered from the structure light image
The speckle image of thing is surveyed, by the speckle image of measured object with carrying out view data calculating according to pre-defined algorithm with reference to speckle image,
Each speckle point of speckle image on measured object is obtained relative to the displacement with reference to the reference speckle point in speckle image.Profit
The depth value of each speckle point of speckle image is calculated with trigonometry conversion, and the depth of measured object is worth to according to the depth
Spend information.It is, of course, also possible to believe by the method for binocular vision or based on jet lag TOF method to obtain the depth image
Breath etc., is not limited, as long as can obtain or belong to this reality by the method for the depth information that measured object is calculated herein
The scope that the mode of applying includes.
, can quilt after the color information that ISP processors 1130 receive the measured object that imaging sensor 1114 captures
View data corresponding to surveying the color information of thing is handled.ISP processors 1130 are analyzed view data can with acquisition
For the image statistics for the one or more control parameters for determining imaging device 1110.Imaging sensor 1114 may include color
Color filter array (such as Bayer filters), imaging sensor 1114 can obtain is caught with each imaging pixel of imaging sensor 1114
The luminous intensity and wavelength information caught, and the one group of raw image data that can be handled by ISP processors 1130 is provided.
ISP processors 1130 handle raw image data pixel by pixel in various formats.For example, each image pixel can
Bit depth with 8,10,12 or 14 bits, ISP processors 1130 can be carried out at one or more images to raw image data
Reason operation, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth
Precision is carried out.
ISP processors 1130 can also receive pixel data from video memory 1120.Video memory 1120 can be storage
Independent private memory in the part of device device, storage device or electronic equipment, and may include DMA (Direct
Memory Access, direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 1130 can carry out one or more image processing operations.
After ISP processors 1130 get color information and the depth information of measured object, it can be merged, obtained
3-D view.Wherein, can be extracted by least one of appearance profile extracting method or contour feature extracting method corresponding
The feature of measured object.Such as pass through active shape model method ASM, active appearance models method AAM, PCA PCA, discrete
The methods of cosine transform method DCT, the feature of measured object is extracted, is not limited herein.It will be extracted respectively from depth information again
The feature of measured object and feature progress registration and the Fusion Features processing that measured object is extracted from color information.Herein refer to
Fusion treatment can be the feature that will be extracted in depth information and color information directly combination or by different images
Middle identical feature combines after carrying out weight setting, it is possibility to have other amalgamation modes, finally according to the feature after fusion, generation
3-D view.
The view data of 3-D view can be transmitted to video memory 1120, to carry out other place before shown
Reason.ISP processors 1130 from the reception processing data of video memory 1120, and to the processing data carry out original domain in and
Image real time transfer in RGB and YCbCr color spaces.The view data of 3-D view may be output to display 1160, for
User watches and/or further handled by graphics engine or GPU (Graphics Processing Unit, graphics processor).
In addition, the output of ISP processors 1130 also can be transmitted to video memory 1120, and display 1160 can be from video memory
1120 read view data.In one embodiment, video memory 1120 can be configured as realizing one or more frame bufferings
Device.In addition, the output of ISP processors 1130 can be transmitted to encoder/decoder 1150, so as to encoding/decoding image data.Compile
The view data of code can be saved, and be decompressed before being shown in the equipment of display 1160.Encoder/decoder 1150 can
Realized by CPU or GPU or coprocessor.
The image statistics that ISP processors 1130 determine, which can be transmitted, gives the unit of control logic device 1140.Control logic device
1140 may include the processor and/or microcontroller that perform one or more routines (such as firmware), and one or more routines can root
According to the image statistics of reception, the control parameter of imaging device 1110 is determined.
It is the step of the sensitive information screen method of shooting image is realized with image processing techniques in Fig. 8 below：
Step 101 ', to preview screen foreground area projective structure light source, and the structure light source is shot by before described
The structure light image of scene area modulation.
Step 102 ', phase corresponding to deformation position pixel in the structure light image is demodulated, is generated according to the phase
The depth of view information of the foreground area, the 3D information of the foreground area is generated according to the depth of view information.
Step 103 ', the 3D information of the foreground area is matched with the database to prestore, if in the foreground zone
The sensitive information that matching degree is more than predetermined threshold value is obtained in domain, then sensitizing range corresponding to the sensitive information is carried out at shielding
Reason.
It should be noted that the explanation of the foregoing sensitive information screen method embodiment to shooting image is also applied for
The terminal device of the present embodiment, its realization principle is similar, and here is omitted.
In summary, the terminal device of the embodiment of the present invention, to preview screen foreground area projective structure light source, and shoot
Structure light image of the structure light source by foreground area modulation, phase corresponding to deformation position pixel in demodulation structure light image,
The depth of view information of foreground area is generated according to phase, the 3D information of foreground area is generated according to depth of view information, by foreground area
3D information is matched with the database to prestore, if obtaining the sensitive information that matching degree is more than predetermined threshold value in foreground area,
Shielding processing then is carried out to sensitizing range corresponding to sensitive information.Thus, it is possible to the active selection to shooting image is realized, can be with
Intelligentized shielding processing is carried out to sensitive information, better meets the demand of taking pictures of user.
The embodiment of the present invention also proposes a kind of non-transitorycomputer readable storage medium, is stored thereon with computer journey
Sequence, the sensitive information screen of shooting image as in the foregoing embodiment can be realized when the computer program is executed by processor
Cover method.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description
Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not
Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office
Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area
Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification
Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance
Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three
It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize custom logic function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware with another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized：With the logic gates for realizing logic function to data-signal from
Logic circuit is dissipated, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above
Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention
System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention
Type.
Claims (10)
- A kind of 1. sensitive information screen method of shooting image, it is characterised in that including：To preview screen foreground area projective structure light source, and shoot the knot that the structure light source passes through foreground area modulation Structure light image；Phase corresponding to deformation position pixel in the structure light image is demodulated, the foreground area is generated according to the phase Depth of view information, the 3D information of the foreground area is generated according to the depth of view information；The 3D information of the foreground area is matched with the database to prestore, if obtaining matching degree in the foreground area More than the sensitive information of predetermined threshold value, then shielding processing is carried out to sensitizing range corresponding to the sensitive information.
- 2. the method as described in claim 1, it is characterised in that the architectural feature of the structure light source, including：Laser stripe, Gray code, sine streak, uniform speckle or, non-homogeneous speckle.
- 3. the method as described in claim 1, it is characterised in that described to shield to sensitizing range corresponding to the sensitive information Processing is covered, including：The depth of view information of the foreground area is carried out according to preset algorithm to calculate the baseline values for obtaining virtualization degree；Gaussian Blur processing is carried out to the sensitizing range according to the baseline values of the virtualization degree.
- 4. method as claimed in claim 3, it is characterised in that the baseline values according to the virtualization degree are to described quick Sensillary area domain carries out Gaussian Blur processing, including：According to the baseline values of the virtualization degree and the depth of view information of the sensitizing range, determine each in the sensitizing range The virtualization coefficient of pixel；Gaussian Blur processing is carried out to the sensitizing range according to the virtualization coefficient of each pixel in the sensitizing range.
- 5. method as claimed in claim 4, it is characterised in that baseline values according to the virtualization degree and described quick The depth of view information in sensillary area domain, the virtualization coefficient of each pixel in the sensitizing range is determined, including：The baseline values and the product of the depth of view information of each pixel in the sensitizing range of the virtualization degree are calculated, obtain institute State the virtualization coefficient of each pixel in sensitizing range.
- 6. the method as described in claim 1, it is characterised in that described to shield to sensitizing range corresponding to the sensitive information Processing is covered, including：Mosaic processing or delete processing are carried out to sensitizing range corresponding to the sensitive information.
- A kind of 7. sensitive information screening arrangement of shooting image, it is characterised in that including：Taking module, for preview screen foreground area projective structure light source, and the structure light source is shot by before described The structure light image of scene area modulation；Generation module, for demodulating phase corresponding to deformation position pixel in the structure light image, generated according to the phase The depth of view information of the foreground area, the 3D information of the foreground area is generated according to the depth of view information；Matching module, for the 3D information of the foreground area to be matched with the database to prestore；Processing module, when being more than the sensitive information of predetermined threshold value for obtaining matching degree in the foreground area, to described quick Feel sensitizing range corresponding to information and carry out shielding processing.
- 8. device as claimed in claim 7, it is characterised in that the processing module includes：Acquiring unit, for being carried out calculating the base for obtaining virtualization degree to the depth of view information of the foreground area according to preset algorithm Plinth numerical value；Processing unit, Gaussian Blur processing is carried out to the sensitizing range for the baseline values according to the virtualization degree.
- 9. a kind of terminal device, it is characterised in that including memory and processor, stored in the memory computer-readable Instruction, when the instruction is by the computing device so that any described shootings of the computing device such as claim 1-6 The sensitive information screen method of image.
- 10. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, it is characterised in that the calculating The sensitive information screen method of the shooting image as described in claim 1-6 is any is realized when machine program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710676891.6A CN107623814A (en) | 2017-08-09 | 2017-08-09 | The sensitive information screen method and device of shooting image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710676891.6A CN107623814A (en) | 2017-08-09 | 2017-08-09 | The sensitive information screen method and device of shooting image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107623814A true CN107623814A (en) | 2018-01-23 |
Family
ID=61088977
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710676891.6A Pending CN107623814A (en) | 2017-08-09 | 2017-08-09 | The sensitive information screen method and device of shooting image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107623814A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108540717A (en) * | 2018-03-31 | 2018-09-14 | 深圳奥比中光科技有限公司 | Target image obtains System and method for |
| CN108648225A (en) * | 2018-03-31 | 2018-10-12 | 深圳奥比中光科技有限公司 | Target image obtains System and method for |
| CN108683902A (en) * | 2018-03-31 | 2018-10-19 | 深圳奥比中光科技有限公司 | Target image obtains System and method for |
| CN109410073A (en) * | 2018-09-26 | 2019-03-01 | 平安健康保险股份有限公司 | Image file desensitization method, device, computer equipment and storage medium |
| CN112040113A (en) * | 2019-06-03 | 2020-12-04 | 奇酷互联网络科技（深圳）有限公司 | Wearable device control method and wearable device |
| WO2021142600A1 (en) * | 2020-01-14 | 2021-07-22 | 华为技术有限公司 | Image recognition method and related device |
| CN113965695A (en) * | 2021-09-07 | 2022-01-21 | 福建库克智能科技有限公司 | Method, system, device, display unit and medium for image display |
| EP3848840A4 (en) * | 2018-09-03 | 2022-06-01 | Hitachi High-Tech Corporation | Display device, information terminal, personal information protection method, program, and recording medium whereon program is recorded |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101424514A (en) * | 2008-12-04 | 2009-05-06 | 上海大学 | Band tape graduation on-line automatic detection system and method based on image processing |
| CN102663810A (en) * | 2012-03-09 | 2012-09-12 | 北京航空航天大学 | Full-automatic modeling approach of three dimensional faces based on phase deviation scanning |
| CN106484704A (en) * | 2015-08-25 | 2017-03-08 | 中兴通讯股份有限公司 | A kind of image processing method and device |
-
2017
- 2017-08-09 CN CN201710676891.6A patent/CN107623814A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101424514A (en) * | 2008-12-04 | 2009-05-06 | 上海大学 | Band tape graduation on-line automatic detection system and method based on image processing |
| CN102663810A (en) * | 2012-03-09 | 2012-09-12 | 北京航空航天大学 | Full-automatic modeling approach of three dimensional faces based on phase deviation scanning |
| CN106484704A (en) * | 2015-08-25 | 2017-03-08 | 中兴通讯股份有限公司 | A kind of image processing method and device |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108648225A (en) * | 2018-03-31 | 2018-10-12 | 深圳奥比中光科技有限公司 | Target image obtains System and method for |
| CN108683902A (en) * | 2018-03-31 | 2018-10-19 | 深圳奥比中光科技有限公司 | Target image obtains System and method for |
| WO2019184183A1 (en) * | 2018-03-31 | 2019-10-03 | 深圳奥比中光科技有限公司 | Target image acquisition system and method |
| WO2019184184A1 (en) * | 2018-03-31 | 2019-10-03 | 深圳奥比中光科技有限公司 | Target image acquisition system and method |
| CN108540717A (en) * | 2018-03-31 | 2018-09-14 | 深圳奥比中光科技有限公司 | Target image obtains System and method for |
| US11445163B2 (en) | 2018-03-31 | 2022-09-13 | Orbbec Inc. | Target image acquisition system and method |
| EP3848840A4 (en) * | 2018-09-03 | 2022-06-01 | Hitachi High-Tech Corporation | Display device, information terminal, personal information protection method, program, and recording medium whereon program is recorded |
| US11947703B2 (en) | 2018-09-03 | 2024-04-02 | Hitachi High-Tech Corporation | Display device, information terminal, personal information protection method, program, and recording medium whereon program is recorded |
| CN109410073A (en) * | 2018-09-26 | 2019-03-01 | 平安健康保险股份有限公司 | Image file desensitization method, device, computer equipment and storage medium |
| CN112040113A (en) * | 2019-06-03 | 2020-12-04 | 奇酷互联网络科技（深圳）有限公司 | Wearable device control method and wearable device |
| CN113396410A (en) * | 2020-01-14 | 2021-09-14 | 华为技术有限公司 | Image identification method and related equipment |
| WO2021142600A1 (en) * | 2020-01-14 | 2021-07-22 | 华为技术有限公司 | Image recognition method and related device |
| CN113965695A (en) * | 2021-09-07 | 2022-01-21 | 福建库克智能科技有限公司 | Method, system, device, display unit and medium for image display |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107623814A (en) | The sensitive information screen method and device of shooting image | |
| CN107682607B (en) | Image acquiring method, device, mobile terminal and storage medium | |
| CN107368730A (en) | Unlock verification method and device | |
| CN107451561A (en) | Iris recognition light compensation method and device | |
| CN107610077A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107493428A (en) | Filming control method and device | |
| CN107590828A (en) | The virtualization treating method and apparatus of shooting image | |
| CN107509045A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107707831A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107705278B (en) | Dynamic effect adding method and terminal equipment | |
| CN107464280A (en) | The matching process and device of user's 3D modeling | |
| CN107610080A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107707838A (en) | Image processing method and device | |
| CN107483815A (en) | The image pickup method and device of moving object | |
| CN107509043A (en) | Image processing method and device | |
| CN107610078A (en) | Image processing method and device | |
| CN107734264A (en) | Image processing method and device | |
| CN107644440A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107705356A (en) | Image processing method and device | |
| CN107742300A (en) | Image processing method, device, electronic installation and computer-readable recording medium | |
| CN107610127A (en) | Image processing method, device, electronic installation and computer-readable recording medium | |
| CN107622496A (en) | Image processing method and device | |
| CN107610076A (en) | Image processing method and device, electronic installation and computer-readable recording medium | |
| CN107613228A (en) | The adding method and terminal device of virtual dress ornament | |
| CN107613239A (en) | Video communication background display methods and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180123 |