CN105631804A - Image processing method and device - Google Patents

Image processing method and device Download PDF

Info

Publication number
CN105631804A
CN105631804A CN201510993327.8A CN201510993327A CN105631804A CN 105631804 A CN105631804 A CN 105631804A CN 201510993327 A CN201510993327 A CN 201510993327A CN 105631804 A CN105631804 A CN 105631804A
Authority
CN
China
Prior art keywords
picture
user
background area
image
region
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510993327.8A
Other languages
Chinese (zh)
Other versions
CN105631804B (en
Inventor
陈志军
侯文迪
李明浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Technology Co Ltd
Xiaomi Inc
Original Assignee
Xiaomi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiaomi Inc filed Critical Xiaomi Inc
Priority to CN201510993327.8A priority Critical patent/CN105631804B/en
Publication of CN105631804A publication Critical patent/CN105631804A/en
Application granted granted Critical
Publication of CN105631804B publication Critical patent/CN105631804B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/14Transformations for image registration, e.g. adjusting or mapping for alignment of images

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention relates to an image processing method and device. The method comprises the steps that a first image is acquired, and the first image includes a first user region and a first background region; vitrification processing is performed in the first background region so that the processed first image is acquired; preview graphs of the processed first image and a second image are displayed through intelligent equipment, the second image includes a second user and a second background region, and the first background region and the second background region are corresponding to the same scene; image feature matching is performed by utilizing the first background region and the second background region, the preview graphs of the first image and the second image are enabled to be consistent through adjustment, and photographing of the second image is prompted; and a main image is selected from the first image and the second image and the user region is automatically extracted from the image which is not selected, and the extracted user region is integrated in the main image so that a group photograph is obtained. The group photograph obtained through the scheme is enabled to be more realistic.

Description

Image processing method and device
Technical field
It relates to image processing field, particularly relate to a kind of image processing method and device.
Background technology
Along with the development of electronic technology, the various intelligent equipment with camera function arises at the historic moment, when the group photo using intelligence equipment to take two people or many people, usually need to realize by external force, such as, request people help is taken pictures, or is taken pictures by the external equipment such as self-shooting bar, trivet. But, seeking less than others' help, or by external equipment also cannot realize many people take a group photo time, such as, the number participating in group photo is too much, and what cause that personage can not all fall into the intelligent equipment that is installed on external equipment takes pictures in scope, it is possible to obtain group photo photo by following correlation technique.
Take double group photo for user A and user B, first, start intelligence equipment program of taking pictures, by B be A take pictures obtain picture A, then under same scene, then by A be B take pictures obtain picture B; Then, start picture processing program, such as, Photoshop software, selects one as main picture by user from picture A and picture B, such as, select picture A as main picture, it may also be useful to picture B can be done stingy figure process by person, is plucked out by the body part of wherein user B, and moving to the correct position of main picture, combination obtains the double group photo photo of user A and user B. Wherein, it may also be useful to person can be any one in user A, user B, other third party users.
When generating group photo photo by above-mentioned correlation technique, stingy figure process is difficult to accomplish precisely, and generally burr all occur in the place such as clothes, portrait edge, the true sense of group photo is poor. In addition, in picture processing process, it is necessary to user carries out a large amount of manual operations, it is achieved process is complicated, and the Capability Requirement of user is higher.
Summary of the invention
For overcoming Problems existing in correlation technique, the disclosure provides a kind of image processing method and device.
First aspect according to disclosure embodiment, it is provided that a kind of image processing method, comprising: obtain the first picture, and described first picture comprises first user region and the first background area; Described first background area is carried out Vitrification management, the first picture after acquisition process; Shown the preview graph of the first picture after described process and second picture by intelligence equipment, described second picture comprises the 2nd user and the 2nd background area, and described first background area corresponds to same scene with described 2nd background area; Utilizing described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting; From described first picture and described second picture, choose main picture, and the picture being never selected extracts user region automatically, by the user's area merges extracted to, in described main picture, obtaining group photo photo.
The technical scheme that embodiment of the present disclosure provides can comprise following useful effect: not by external force when, and such scheme just can be utilized to achieve two people or many people group photo. In shooting process, it is possible to show group photo design sketch to user in real time by intelligence equipment, so just the picture-taking position of the 2nd user and posture of taking pictures can be made the appropriate adjustments, contribute to improving the true sense of the group photo utilizing disclosure embodiment scheme to obtain. Simultaneously, technology is mated by characteristics of image, adjust the first picture to be consistent with the preview graph of second picture, the first background area and the consistence of the 2nd background area can be improved, like this, the requirement to precisely degree when extracting user region in the picture being never selected can be reduced, that is, even if there is burr in the edge in the user region extracted, also can be slowed down by background area in fusion process and even eliminate Burr Problem, make the group photo utilizing disclosure embodiment scheme to obtain have more true sense. In addition, in the scheme that disclosure embodiment provides, mostly can automatically perform by intelligence equipment, seldom relate to the manual operation of user, it is achieved process is simple and convenient, the Capability Requirement of user is lower.
In the first possible enforcement mode of disclosure embodiment first aspect, described described first background area is carried out Vitrification management, the first picture after acquisition process, comprise: described first user region and described first background area are carried out Vitrification management, and the transparency of described first background area is higher than the transparency in described first user region, acquisition process after the first picture.
The technical scheme that the present embodiment provides can comprise following useful effect: the first picture is carried out Vitrification management, contribute to slowing down the first picture and second picture preview graph blocked situation, can better in conjunction with picture-taking position, the posture of taking pictures of first user in the first picture, adjust the position of the 2nd user in group photo and posture, make group photo effect have more true sense.
In the 2nd kind of disclosure embodiment first aspect possible enforcement mode, described described first background area and described 2nd background area is utilized to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, comprise: obtain the first characteristics of image and the 2nd characteristics of image, described first characteristics of image extracts from described first background area, and described 2nd characteristics of image extracts from described 2nd background area; Utilize described first characteristics of image and described 2nd characteristics of image, obtain image conversion matrix; Change matrix by described image, described first picture is adjusted to the pixel in the preview graph of described second picture and is consistent.
The technical scheme that the present embodiment provides can comprise following useful effect: in order to improve the true sense of group photo effect, technology can be mated by characteristics of image, picture is finely tuned, first picture is consistent with the preview graph of second picture, is also exactly make the consistence of the first background area and the 2nd background area reach best. Contribute to follow-up fusion treatment process, it is possible to use the Burr Problem even eliminated and extracted user region is slowed down in background area.
In the third possible enforcement mode of disclosure embodiment first aspect, the described picture being never selected extracts user region automatically, comprise: by face recognition technology, from the described picture not being selected, automatically identify first area, as user region to be extracted; From, the described picture not being selected, extracting the user region described to be extracted recognized.
The technical scheme that the present embodiment provides can comprise following useful effect: determines user region to be extracted in the picture being automatically never selected by face recognition technology, reduce the manual operation of user in picture processing process, make the process that realizes of disclosure embodiment scheme more simple and convenient, also contribute to reducing the requirement to user's ability.
In conjunction with the third possible enforcement mode of disclosure embodiment first aspect, in the 4th kind of possible enforcement mode, the described picture being never selected extracts user region automatically, also comprise: user is to the operational motion of the described picture not being selected in monitoring, automatically identifying the 2nd region that described operational motion delimited, described user region to be extracted comprises described first area and described 2nd region.
The technical scheme that the present embodiment provides can comprise following useful effect: in order to improve the handiness of disclosure embodiment scheme, interactive interface can be provided to user, other regions needing to extract are made at the picture centre circle not being selected by user, such as the shadow region in picture, contribute to improving the true sense of group photo effect.
In the 5th kind of disclosure embodiment first aspect possible enforcement mode, described by user's area merges of extracting in described main picture, comprise: the pixel coordinate in the user region extracted described in acquisition, and the user region extracted described in determining according to described pixel coordinate is corresponding to the fusion position in described main picture; The fusion position of main picture described in the user's region overlay extracted described in utilization.
The technical scheme that the present embodiment provides can comprise following useful effect: the position automatically being determined the place, user region extracted by pixel coordinate in the picture not being selected, reduce the manual operation of user in picture processing process, make the process that realizes of disclosure embodiment scheme more simple and convenient, also contribute to reducing the requirement to user's ability.
In the 6th kind of disclosure embodiment first aspect possible enforcement mode, the described prompting described second picture of shooting, comprising: by least one in text prompt, sound prompting, picture cues, the prompting described second picture of shooting.
The technical scheme that the present embodiment provides can comprise following useful effect: mates technology by picture feature, first picture is adjusted to the preview graph with second picture be consistent, namely when the consistence of the first background area and the 2nd background area reaches the best, it is possible to use word, sound, this kind of image intuitively mode point out and carry out second picture shooting. Contribute to follow-up fusion treatment process, it is possible to use the Burr Problem even eliminated and extracted user region is slowed down in background area.
Second aspect according to disclosure embodiment, it is provided that a kind of picture processing device, comprising: the first picture acquisition module, is configured to obtain the first picture, and described first picture comprises first user region and the first background area. First picture processing module, is configured to described first background area is carried out Vitrification management, the first picture after acquisition process. Picture display module, is configured to the preview graph of the first picture after showing described process and second picture, and described second picture comprises the 2nd user and the 2nd background area, and described first background area and described 2nd background area are corresponding to same scene. Characteristic matching module, is configured to utilize described first background area and described 2nd background area to carry out characteristics of image coupling, and adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting. User's region extraction module, is configured to from described first picture and described second picture and chooses main picture, and automatically extracts user region in the picture being never selected. Fusion Module, the user's area merges being configured to extract described user's region extraction module is to, in described main picture, obtaining group photo photo.
In the first possible enforcement mode of disclosure embodiment second aspect, described first picture processing module, it is configured to described first user region and described first background area are carried out Vitrification management, and the transparency of described first background area is higher than the transparency in described first user region, acquisition process after the first picture.
In the 2nd kind of disclosure embodiment second aspect possible enforcement mode, described characteristic matching module comprises: characteristics of image obtains module, it is configured to obtain the first characteristics of image and the 2nd characteristics of image, described first characteristics of image extracts from described first background area, and described 2nd characteristics of image extracts from described 2nd background area. Conversion matrix obtains module, is configured to utilize described first characteristics of image and described 2nd characteristics of image, obtains image conversion matrix. Pixel conversion module, is configured to change matrix by described image, is adjusted to the pixel in the preview graph of described second picture by described first picture and is consistent.
In the third possible enforcement mode of disclosure embodiment second aspect, described user's region extraction module comprises: first area identifies module, it is configured to by face recognition technology, from the described picture not being selected, automatically identifies first area, as user region to be extracted. User's extracted region submodule block, is configured to from, the described picture not being selected, extracting the user region described to be extracted recognized.
In conjunction with the third possible enforcement mode of disclosure embodiment second aspect, in the 4th kind of possible enforcement mode, described user's region extraction module also comprises: the 2nd region identification module, it is configured to monitoring user to the operational motion of the described picture not being selected, automatically identifying the 2nd region that described operational motion delimited, described user region to be extracted comprises described first area and described 2nd region.
In the 5th kind of disclosure embodiment second aspect possible enforcement mode, described Fusion Module comprises: described Fusion Module comprises: merge position determination module, the pixel coordinate being configured to the user region extracted described in obtaining, and the user region extracted described in determining according to described pixel coordinate is corresponding to the fusion position in described main picture. Cover module, it is configured to the fusion position of main picture described in user's region overlay of extracting described in utilizing.
The third aspect according to disclosure embodiment, it is provided that a kind of picture processing device, comprising: treater; The storer of instruction can be performed for storage of processor; Wherein, described treater is configured to: obtain the first picture, and described first picture comprises first user region and the first background area; Described first background area is carried out Vitrification management, the first picture after acquisition process; Shown the preview graph of the first picture after described process and second picture by intelligence equipment, described second picture comprises the 2nd user and the 2nd background area, and described first background area corresponds to same scene with described 2nd background area; Utilizing described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting; From described first picture and described second picture, choose main picture, and the picture being never selected extracts user region automatically, by the user's area merges extracted to, in described main picture, obtaining group photo photo.
Should be understood that, it is only exemplary and explanatory that above general description and details hereinafter describe, and can not limit the disclosure.
Accompanying drawing explanation
Accompanying drawing herein is by being incorporated in specification sheets and forms the part of this specification sheets, shows and meets embodiment of the present disclosure, and is used from specification sheets one and explains principle of the present disclosure.
Fig. 1 is the schema of a kind of image processing method according to an exemplary embodiment.
Fig. 2 is the schematic diagram of the first picture according to an exemplary embodiment.
Fig. 3 is the schematic diagram of the second picture according to an exemplary embodiment.
Fig. 4 is the schema of the method being adjusted the first picture by characteristics of image according to an exemplary embodiment.
Fig. 5 is the schematic diagram of the corresponding relation between the pixel of the first picture according to an exemplary embodiment and second picture.
Fig. 6 be according to an exemplary embodiment by schema to the method for main picture of user's area merges of extracting.
Fig. 7 is the block diagram of a kind of picture processing device according to an exemplary embodiment.
Fig. 8 is the block diagram of a kind of picture processing device according to another exemplary embodiment.
Embodiment
Here exemplary embodiment being described in detail, its example representation is in the accompanying drawings. When description below relates to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawing represents same or similar key element. Enforcement mode described in exemplary embodiment does not represent all enforcement modes consistent with the disclosure below. On the contrary, they only with as in appended claims describe in detail, the example of device that aspects more of the present disclosure are consistent and method.
Fig. 1 is the schema of a kind of image processing method according to an exemplary embodiment. This image processing method can be applied to intelligence equipment. For example, intelligence equipment can be the terminal that mobile phone, panel computer, pick up camera, photographic camera etc. have camera function. This image processing method can comprise the following steps:
In a step 101, obtaining the first picture, described first picture comprises first user region and the first background area.
Taking double group photo for user A and user B, the first picture can be the photo that user A takes for user B, schematic diagram as shown in Figure 2. In this example, first user region can be understood as user's A health region, and the first background area can be understood as scene of currently taking pictures.
For example, in conjunction with actual service condition, at least the first picture can be obtained by following two kinds of exemplary scenario.
Exemplary scenario one, it is possible to improve tradition and take pictures program, make the program of taking pictures have the function of disclosure embodiment. Corresponding to this, it is possible to when taking group photo photo, start the program of taking pictures after improving, it is that user A shooting obtains the first picture by user B.
Exemplary scenario two, it is possible to provide independent picture processing program according to the function of disclosure embodiment. Corresponding to this, it is possible to when taking group photo photo, start tradition and take pictures program, be that user A shooting obtains the first picture by user B, and then start the picture processing program of disclosure embodiment, call by picture processing program and obtain described first picture.
As a kind of example, the scheme that disclosure embodiment provides also can be applicable to many people group photo, and in this example, first user region can be understood as the region at all user's body places in the first picture. Such as, user A, B, C, D, E five people's group photo, the first picture can be user A, B, C tri-photo of taking of people for user E, and in this example, first user region refers to user A, B, C three's health region.
In a step 102, described first background area is carried out Vitrification management, the first picture after acquisition process.
In step 103, being shown the preview graph of the first picture after described process and second picture by intelligence equipment, described second picture comprises the 2nd user and the 2nd background area, and described first background area corresponds to same scene with described 2nd background area.
In the scheme that disclosure embodiment provides, in order to improve the true sense of group photo effect, it is possible to show group photo design sketch to user in real time by intelligence equipment, to adjust the position of the 2nd user in group photo, posture etc. of taking pictures accordingly. In this example, group photo design sketch can comprise the live preview figure of the first picture after process and second picture.
As a kind of example, it is possible to by the camera lens of intelligence equipment, gather the 2nd user and scene of currently taking pictures acquisition preview graph, and show described preview graph by the display screen of intelligence equipment to user.
The first picture as a kind of example, it is possible to the first background area in the first picture is carried out Vitrification management, after acquisition process. Such as, in conjunction with practical application, it is possible to being that the first background area arranges different transparency, transparency is set to 100%, or transparency is set to 80%, and this can not be limited by disclosure embodiment. So, the first picture after Vitrification management, contributes to slowing down and second picture preview graph is blocked situation, it is possible to better in conjunction with picture-taking position, the posture of taking pictures of first user in the first picture, adjust the position of the 2nd user in group photo and posture, make group photo effect have more true sense.
The first picture in a kind of possible embodiment, it is possible to respectively the first user region in the first picture and the first background area are carried out Vitrification management, after acquisition process. Meanwhile, in order to better highlight first user, to adjust the position of the 2nd user in group photo and posture accordingly, it is possible to by the transparency higher than first user region that the transparency of the first background area is arranged. Such as, the transparency in first user region is set to 50%, and the transparency of the first background area is set to 100%, and this can not be limited by disclosure embodiment. In this example, except the first background area, also Vitrification management is done in first user region, contribute to slowing down further the first picture and second picture preview graph blocked situation.
Above in the double group photo example of lifted user A, B, this step when user A takes pictures for user B, can show group photo design sketch to user A. Such as, group photo effect is the side that user B stands in the user A just now taken pictures, then user A can adjust position and the posture at user B place by group photo design sketch instruction, so that group photo effect has more true sense. In addition, in this example, the 2nd user region can be understood as user's B health region, and the 2nd background area can be understood as scene of currently taking pictures.
Or, five people of lifted user A, B, C, D, E take a group photo in example above, this step can user A for user D, E two people take pictures time, to user A show group photo design sketch. Such as, group photo effect is the side that user D, E stand in the user C just now taken pictures, then user A can adjust the position at user D, E place by group photo design sketch instruction, or, adjust the position at the user D place adjacent with user C, so that group photo effect has more true sense. In addition, in this example, the 2nd user region can be understood as both user D, E health region.
At step 104, utilizing described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting.
In the scheme that disclosure embodiment provides, in order to improve the true sense of group photo effect, technology can be mated by characteristics of image, picture is finely tuned, first picture is consistent with the preview graph of second picture, so, follow-up carry out picture merge time, just can avoid the Burr Problem that image zooming-out occurs. , it is possible to finely tuned by the first picture, for example the first picture is adjusted to the preview graph with second picture to be consistent; Or, it is also possible to the preview graph of second picture being finely tuned, the preview graph of second picture be adjusted to and be consistent with the first picture, this can not be limited by disclosure embodiment.
Consider that two pictures all currently take pictures scene and take for same, therefore the first background area and the 2nd background area comprise the characteristics of image of a lot of coupling mutually, therefore, it is possible to adopt characteristic matching technology to adjust the first picture. For example, characteristics of image can comprise color characteristic, textural characteristics, shape feature, locus feature etc.; Characteristic matching technology can be presented as sift algorithm, surf algorithm etc., and characteristics of image, characteristic matching technology can not be limited by disclosure embodiment.
In a kind of possible embodiment, it is possible to first picture is reduced process, and carrying out characteristics of image extraction from the picture after reducing process, contribute to accelerating feature extraction rate, the degree of reducing can not be limited by disclosure embodiment.
When adjustment makes the first picture be consistent with the preview graph of second picture, just can pointing out the shooting carrying out second picture, such as shooting obtains second picture shown in Fig. 3. For example, it is possible to by least one in text prompt, sound prompting, picture cues, carry out shooting prompting. Wherein, text prompt can be the default word of display on intelligence equipment, if default word is " shooting "; Sound prompting can be the intelligence preset sound that sends of equipment, as preset sound be " dichloro-diphenyl-dichlorothane "; Picture cues can be predetermined pattern or the icon of display on intelligence equipment, if preset icon is " camera identification ". The prompting mode adopted can not be limited by disclosure embodiment.
Disclosure embodiment also provides a kind of scheme being adjusted the first picture by characteristics of image, and schema shown in Figure 4 can comprise the following steps:
In step 401, obtaining the first characteristics of image and the 2nd characteristics of image, described first characteristics of image extracts from described first background area, and described 2nd characteristics of image extracts from described 2nd background area;
In step 402, utilize described first characteristics of image and described 2nd characteristics of image, obtain image conversion matrix;
In step 403, change matrix by described image, described first picture is adjusted to the pixel in the preview graph of described second picture and is consistent.
As a kind of example, it is possible to by sift algorithm, extract the first characteristics of image from the first background area, from the 2nd background area, extract the 2nd characteristics of image; RANSAC algorithm can be passed through, obtain image conversion matrix. Understandably, image conversion matrix, for the corresponding conversion relation between the pixel in the pixel that represents in the first picture and second picture, see Fig. 5, shows the corresponding relation between the pixel of the first picture shown in Fig. 2 and second picture shown in Fig. 3.
If utilizing image conversion matrix to be finely tuned by the first picture, then the pixel in the first picture can be transformed into the correspondence position of the preview graph of second picture. If utilizing image conversion matrix the preview graph of second picture to be finely tuned, then the pixel in the preview graph of second picture can be transformed into the correspondence position of the first picture.
In step 105, from described first picture and described second picture, choose main picture, and the picture being never selected extracts user region automatically, by the user's area merges extracted to, in described main picture, obtaining group photo photo.
So that the first picture is finely tuned, through above-mentioned steps, it is possible to obtain two pictures fusion treatment can be an opening and closing shadow photo by the first picture after adjustment and second picture. For example, it is possible to from two pictures, choose one as main picture, such as, the first picture after adjustment is defined as main picture, corresponding to this, then the second picture can being never selected extracts the 2nd user region, and by the 2nd user's area merges to, in main picture, obtaining group photo photo.
To sum up, not by external force when, the technical scheme that just disclosure embodiment can be utilized to provide achieves two people or many people group photo. In shooting process, it is possible to show group photo design sketch to user in real time by intelligence equipment, so just the picture-taking position of the 2nd user and posture of taking pictures can be made the appropriate adjustments, contribute to improving the true sense of the group photo utilizing disclosure embodiment scheme to obtain. Simultaneously, technology is mated by characteristics of image, adjust the first picture to be consistent with the preview graph of second picture, the first background area and the consistence of the 2nd background area can be improved, like this, the requirement to precisely degree when extracting user region in the picture being never selected can be reduced, that is, even if there is burr in the edge in the user region extracted, also can be slowed down by background area in fusion process and even eliminate Burr Problem, make the group photo utilizing disclosure embodiment scheme to obtain have more true sense. In addition, in the scheme that disclosure embodiment provides, mostly can automatically perform by intelligence equipment, seldom relate to the manual operation of user, it is achieved process is simple and convenient, the Capability Requirement of user is lower.
Except introducing above, the disclosure embodiment still provides the scheme choosing main picture, explains below.
Exemplary scenario one, in order to improve the handiness of disclosure embodiment scheme, interactive interface can be provided to user, from two pictures, one is chosen as main picture by user, such as, according to the posture of taking pictures of first user and the 2nd user, the picture at the user place that can be blocked is defined as main picture, see schematic diagram shown in Fig. 2 and Fig. 3, there will be, between the left leg of the 2nd user and first user, the situation of blocking, in order to make group photo effect have more true sense, first picture can be defined as main picture, after ensureing fusion treatment, 2nd user region can be positioned on first user region.
Exemplary scenario two, it is possible to automatically choose one from two pictures by intelligence equipment and such as, the picture taken first is defined as main picture as main picture, or the shooting quality of monitoring two pictures, be defined as main picture by picture higher for quality, etc. The mode choosing main picture can not be limited by disclosure embodiment.
Except introducing above, the disclosure embodiment still provides the scheme automatically extracting user region in the picture being never selected, and explains below.
Exemplary scenario one, it is possible to by face recognition technology, identifies first area automatically in the picture being never selected, and using first area as user region to be extracted; Then, in the picture being never selected, the user region to be extracted identified is extracted. Such as, by face recognition technology, automatically identify the 2nd user region in second picture; Again by image Segmentation Technology, from second picture, extract the 2nd user region.
Exemplary scenario two, it is also possible to provide interactive interface to user, delimit the 2nd region, and the 2nd region that the first area identified by face recognition technology and user delimit out is as region to be extracted in the picture being never selected by user. For example, intelligence equipment can monitor user to the operational motion of the picture not being selected, thus automatically identifies the 2nd region that described operational motion delimited. Such as, by face recognition technology, automatically identify the 2nd user region in second picture, meanwhile, by monitoring the operational motion of user, automatically identify the 2nd user's shadow region of user's delineation; Then by image Segmentation Technology, from second picture, the 2nd user region and the 2nd user's shadow region is extracted.
Except introducing above, the disclosure embodiment still provides by user's area merges of extracting to the scheme in main picture, and schema shown in Figure 6, can comprise the following steps:
In step 601, the pixel coordinate in the user region extracted described in acquisition, and the user region extracted described in determining according to described pixel coordinate is corresponding to the fusion position in described main picture;
In step 602, the fusion position of main picture described in the user's region overlay extracted described in utilization.
After step 104, can effectively ensure the consistence of background area contained by the first picture and second picture, therefore, can directly pass through pixel coordinate, determine that the user region extracted is corresponding to the fusion position in main picture, that is, merge the position of position in main picture and the user region the extracted position in the picture not being selected, mutually corresponding.
Such as, in the scheme that disclosure embodiment provides, it is possible to by the pixel coordinate of the optional position in user region extracted, determine to merge position, determined by the pixel coordinate of the position, edge in the user region extracted. Understandably, it is possible to obtain the coordinate of all pixels of position, edge, determine to merge position; Or, it is possible to obtaining the pixel coordinate of preset of position, edge, determine to merge position, such as, the preset of position, edge can be the head of user, four limbs etc. This can not be limited by disclosure embodiment.
Fig. 7 is the block diagram of a kind of picture processing device according to an exemplary embodiment. With reference to Fig. 7, this device 700 can comprise the first picture acquisition module 701, first picture processing module 702, picture display module 703, characteristic matching module 704, user's region extraction module 705 and Fusion Module 706.
This first picture acquisition module 701, it is possible to being configured to obtain the first picture, described first picture comprises first user region and the first background area;
This first picture processing module 702, it is possible to be configured to described first background area is carried out Vitrification management, the first picture after acquisition process;
This picture display module 703, the preview graph of the first picture after showing described process and second picture can be configured to, described second picture comprises the 2nd user and the 2nd background area, and described first background area and described 2nd background area are corresponding to same scene;
This characteristic matching module 704, it is possible to be configured to utilize described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting;
This user's region extraction module 705, it is possible to be configured to from described first picture and described second picture and choose main picture, and the picture being never selected extracts user region automatically;
This Fusion Module 706, it is possible to the user's area merges being configured to extract described user's region extraction module is to, in described main picture, obtaining group photo photo.
In sum, when the device provided by the disclosure carries out picture processing, it is not necessary to by external force, two people or many people group photo can just be realized. Wherein, picture display module 703 can show group photo design sketch to user in real time, so just the picture-taking position of the 2nd user and posture of taking pictures can be made the appropriate adjustments, contribute to improving the true sense of the group photo utilizing disclosure embodiment scheme to obtain. Characteristic matching module 704 can carry out picture adjustment in real time, first picture is consistent with the preview graph of second picture, the first background area and the consistence of the 2nd background area can be improved, like this, the requirement to precisely degree when extracting user region in the picture being never selected can be reduced, that is, even if there is burr in the edge in the user region extracted, also can be slowed down by background area in fusion process and even eliminate Burr Problem, make the group photo utilizing disclosure embodiment scheme to obtain have more true sense. The picture that user's region extraction module 705 can never be selected automatically extracts user region, Fusion Module 706 can automatically by user's area merges of extracting in main picture, that is in the scheme that disclosure embodiment provides, seldom relate to the manual operation of user, realize process simple and convenient, the Capability Requirement of user is lower.
In a kind of possible enforcement mode, this the first picture processing module 702, can be configured to described first user region and described first background area are carried out Vitrification management, and the transparency of described first background area is higher than the transparency in described first user region, acquisition process after the first picture.
In a kind of possible enforcement mode, this characteristic matching module 704 can comprise characteristics of image and obtain module, conversion matrix acquisition module and pixel conversion module.
This characteristics of image obtains module, it is possible to being configured to obtain the first characteristics of image and the 2nd characteristics of image, described first characteristics of image extracts from described first background area, and described 2nd characteristics of image extracts from described 2nd background area;
This conversion matrix obtains module, it is possible to be configured to utilize described first characteristics of image and described 2nd characteristics of image, obtains image conversion matrix;
This pixel conversion module, it is possible to be configured to change matrix by described image, described first picture be adjusted to the pixel in the preview graph of described second picture and be consistent.
In a kind of possible enforcement mode, this user's region extraction module 705 can comprise first area and identify module and user's extracted region submodule block.
This first area identifies module, it is possible to is configured to by face recognition technology, automatically identifies first area from the described picture not being selected, as user region to be extracted;
This user's extracted region submodule block, it is possible to be configured to from, the described picture not being selected, extracting the user region described to be extracted recognized.
In a kind of possible enforcement mode, this user's region extraction module 705 also comprises the 2nd region identification module.
2nd region identification module, it is possible to be configured to monitoring user to the operational motion of the described picture not being selected, identifies the 2nd region that described operational motion delimited automatically, and described user region to be extracted comprises described first area and described 2nd region.
In a kind of possible enforcement mode, this Fusion Module 706 can comprise fusion position determination module and cover module.
This fusion position determination module, it is possible to be configured to the pixel coordinate in the user region extracted described in obtaining, and the user region extracted described in determining according to described pixel coordinate is corresponding to the fusion position in described main picture;
This covering module, it is possible to be configured to the fusion position of main picture described in user's region overlay of extracting described in utilizing.
About the device in above-described embodiment, wherein the concrete mode of each module executable operations has been described in detail in about the embodiment of the method, will not elaborate explanation herein.
Fig. 8 is the block diagram of a kind of picture processing device 800 according to an exemplary embodiment. Such as, device 800 can be mobile telephone, computer, digital broadcast terminal, messaging devices, game console, tablet device, medical facilities, body-building equipment, personal digital assistant etc.
With reference to Fig. 8, device 800 can comprise following one or more assembly: processing components 802, storer 804, electric power assembly 806, multimedia groupware 808, audio-frequency assembly 810, the interface 812 of I/O (I/O), sensor module 814, and communications component 816.
The overall operation of the usual control device 800 of processing components 802, such as with display, the operation that telephone call, data corresponding, camera operation and recording operation are associated. Processing components 802 can comprise one or more treater 820 to perform instruction, to complete all or part of step of above-mentioned image processing method. In addition, processing components 802 can comprise one or more module, and what be convenient between processing components 802 and other assemblies is mutual. Such as, processing components 802 can comprise multi-media module, mutual with what facilitate between multimedia groupware 808 and processing components 802.
Storer 804 is configured to store various types of data to be supported in the operation of device 800. The example of these data comprises for any application program of operation on device 800 or the instruction of method, contact data, telephone book data, message, picture, video etc. Storer 804 can be realized by the volatibility of any type or non-volatile memory device or their combination, such as static RAM (SRAM), electrically erasable read-only storage (EEPROM), erasable programmable read-only storage (EPROM), programmable read only memory (PROM), read-only storage (ROM), magneticstorage, flash device, disk or CD.
The various assembly that electric power assembly 806 is device 800 provides electric power. Electric power assembly 806 can comprise power-supply management system, one or more power supply, and other generate, manage and distribute, with for device 800, the assembly that electric power is associated.
The screen that an output interface is provided that multimedia groupware 808 is included between described device 800 and user. In certain embodiments, screen can comprise liquid-crystal display (LCD) and touch panel (TP). If screen comprises touch panel, screen may be implemented as touch-screen, to receive the input signal from user. Touch panel comprises one or more touch sensing device with the gesture on sensing touch, slip and touch panel. Described touch sensing device can the border of not only sensing touch or sliding action, but also the detection time length relevant to described touch or slide and pressure. In certain embodiments, multimedia groupware 808 comprises a front-facing camera and/or rearmounted camera. When device 800 is in operator scheme, during such as screening-mode or video pattern, front-facing camera and/or rearmounted camera can receive outside multi-medium data. Each front-facing camera and rearmounted camera can be a fixing optical lens system or have focal length and optical zoom ability.
Audio-frequency assembly 810 is configured to export and/or input audio signal. Such as, audio-frequency assembly 810 comprises a microphone (MIC), and when device 800 is in operator scheme, during such as calling pattern, record pattern and speech recognition pattern, microphone is configured to receive external audio signal. The sound signal received can be stored in storer 804 further or be sent via communications component 816. In certain embodiments, audio-frequency assembly 810 also comprises a loud speaker, for output audio signal.
I/O interface 812 is for providing interface between processing components 802 and peripheral interface module, and above-mentioned peripheral interface module can be keyboard, some striking wheel, button etc. These buttons can include but not limited to: home button, volume button, startup button and locking button.
Sensor module 814 comprises one or more sensor, for providing the state estimation of all respects for device 800. Such as, sensor module 814 can detect the opening/closing state of device 800, the relative location of assembly, such as described assembly is indicating meter and the keypad of device 800, the position that sensor module 814 can also detect device 800 or device 800 1 assemblies changes, the presence or absence that user contacts with device 800, the temperature variation of device 800 orientation or acceleration/deceleration and device 800. Sensor module 814 can comprise close to sensor, be configured to without any physical contact time detection near the existence of object. Sensor module 814 can also comprise optical sensor, such as CMOS or ccd image sensor, for using in imaging applications. In certain embodiments, this sensor module 814 can also comprise acceleration transducer, gyro sensor, Magnetic Sensor, pressure transmitter or temperature sensor.
Communications component 816 is configured to be convenient to the communication of wired or wireless mode between device 800 and other equipment. Device 800 can access the wireless network based on communication standard, such as WiFi, 2G or 3G, or their combination. In an exemplary embodiment, communications component 816 receives the broadcast signal from outside broadcasting management systems or broadcast related information via broadcast channel. In an exemplary embodiment, described communications component 816 also comprises near-field communication (NFC) module, to promote short distance communication. Such as, can based on RF identification (RFID) technology in NFC module, Infrared Data Association (IrDA) technology, ultra broadband (UWB) technology, bluetooth (BT) technology and other technologies realize.
In the exemplary embodiment, device 800 can be realized by one or more application specific unicircuit (ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), programmable logic device part (PLD), field-programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components, for performing above-mentioned image processing method.
In the exemplary embodiment, additionally providing a kind of non-transitory computer-readable recording medium comprising instruction, such as, comprise the storer 804 of instruction, above-mentioned instruction can perform above-mentioned image processing method by the treater 820 of device 800. Such as, described non-transitory computer-readable recording medium can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage equipment etc.
Those skilled in the art, after considering specification sheets and putting into practice the disclosure, will easily expect other embodiment of the present disclosure. The application is intended to contain any modification of the present disclosure, purposes or adaptations, and these modification, purposes or adaptations are followed general principle of the present disclosure and comprised the unexposed common practise in the art of the disclosure or conventional techniques means. Specification sheets and embodiment are only regarded as exemplary, and true scope of the present disclosure and spirit are pointed out by claim below.
Should be understood that, the disclosure is not limited to accurate structure described above and illustrated in the accompanying drawings, and can carry out various amendment and change not departing from its scope. The scope of the present disclosure is only limited by appended claim.

Claims (14)

1. an image processing method, it is characterised in that, comprising:
Obtaining the first picture, described first picture comprises first user region and the first background area;
Described first background area is carried out Vitrification management, the first picture after acquisition process;
Shown the preview graph of the first picture after described process and second picture by intelligence equipment, described second picture comprises the 2nd user and the 2nd background area, and described first background area corresponds to same scene with described 2nd background area;
Utilizing described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting;
From described first picture and described second picture, choose main picture, and the picture being never selected extracts user region automatically, by the user's area merges extracted to, in described main picture, obtaining group photo photo.
2. method according to claim 1, it is characterised in that, described described first background area is carried out Vitrification management, acquisition process after the first picture, comprising:
Described first user region and described first background area are carried out Vitrification management, and the transparency of described first background area is higher than the transparency in described first user region, acquisition process after the first picture.
3. method according to claim 1, it is characterised in that, described utilize described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, comprising:
Obtaining the first characteristics of image and the 2nd characteristics of image, described first characteristics of image extracts from described first background area, and described 2nd characteristics of image extracts from described 2nd background area;
Utilize described first characteristics of image and described 2nd characteristics of image, obtain image conversion matrix;
Change matrix by described image, described first picture is adjusted to the pixel in the preview graph of described second picture and is consistent.
4. method according to claim 1, it is characterised in that, the described picture being never selected extracts user region automatically, comprising:
By face recognition technology, from the described picture not being selected, automatically identify first area, as user region to be extracted;
From, the described picture not being selected, extracting the user region described to be extracted recognized.
5. method according to claim 4, it is characterised in that, the described picture being never selected extracts user region automatically, also comprises:
User is to the operational motion of the described picture not being selected in monitoring, automatically identifies the 2nd region that described operational motion delimited, and described user region to be extracted comprises described first area and described 2nd region.
6. method according to claim 1, it is characterised in that, described by the user's area merges extracted to, in described main picture, comprising:
The pixel coordinate in the user region extracted described in acquisition, and the user region extracted described in determining according to described pixel coordinate is corresponding to the fusion position in described main picture;
The fusion position of main picture described in the user's region overlay extracted described in utilization.
7. method according to claim 1, it is characterised in that, the described prompting described second picture of shooting, comprising:
By at least one in text prompt, sound prompting, picture cues, the prompting described second picture of shooting.
8. a picture processing device, it is characterised in that, comprising:
First picture acquisition module, is configured to obtain the first picture, and described first picture comprises first user region and the first background area;
First picture processing module, is configured to described first background area is carried out Vitrification management, the first picture after acquisition process;
Picture display module, is configured to the preview graph of the first picture after showing described process and second picture, and described second picture comprises the 2nd user and the 2nd background area, and described first background area and described 2nd background area are corresponding to same scene;
Characteristic matching module, is configured to utilize described first background area and described 2nd background area to carry out characteristics of image coupling, and adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting;
User's region extraction module, is configured to from described first picture and described second picture and chooses main picture, and automatically extracts user region in the picture being never selected;
Fusion Module, the user's area merges being configured to extract described user's region extraction module is to, in described main picture, obtaining group photo photo.
9. device according to claim 8, it is characterised in that,
Described first picture processing module, is configured to described first user region and described first background area are carried out Vitrification management, and the transparency of described first background area is higher than the transparency in described first user region, acquisition process after the first picture.
10. device according to claim 8, it is characterised in that, described characteristic matching module comprises:
Characteristics of image obtains module, is configured to obtain the first characteristics of image and the 2nd characteristics of image, and described first characteristics of image extracts from described first background area, and described 2nd characteristics of image extracts from described 2nd background area;
Conversion matrix obtains module, is configured to utilize described first characteristics of image and described 2nd characteristics of image, obtains image conversion matrix;
Pixel conversion module, is configured to change matrix by described image, is adjusted to the pixel in the preview graph of described second picture by described first picture and is consistent.
11. devices according to claim 8, it is characterised in that, described user's region extraction module comprises:
First area identifies module, is configured to by face recognition technology, automatically identifies first area from the described picture not being selected, as user region to be extracted;
User's extracted region submodule block, is configured to from, the described picture not being selected, extracting the user region described to be extracted recognized.
12. devices according to claim 11, it is characterised in that, described user's region extraction module also comprises:
2nd region identification module, is configured to monitoring user to the operational motion of the described picture not being selected, and automatically identifies the 2nd region that described operational motion delimited, and described user region to be extracted comprises described first area and described 2nd region.
13. devices according to claim 8, it is characterised in that, described Fusion Module comprises:
Merge position determination module, it is configured to the pixel coordinate in the user region extracted described in obtaining, and the user region extracted described in determining according to described pixel coordinate is corresponding to the fusion position in described main picture;
Cover module, it is configured to the fusion position of main picture described in user's region overlay of extracting described in utilizing.
14. 1 kinds of picture processing devices, it is characterised in that, comprising:
Treater;
The storer of instruction can be performed for storage of processor;
Wherein, described treater is configured to:
Obtaining the first picture, described first picture comprises first user region and the first background area;
Described first background area is carried out Vitrification management, the first picture after acquisition process;
Shown the preview graph of the first picture after described process and second picture by intelligence equipment, described second picture comprises the 2nd user and the 2nd background area, and described first background area corresponds to same scene with described 2nd background area;
Utilizing described first background area and described 2nd background area to carry out characteristics of image coupling, adjustment makes described first picture be consistent with the preview graph of described second picture, the prompting described second picture of shooting;
From described first picture and described second picture, choose main picture, and the picture being never selected extracts user region automatically, by the user's area merges extracted to, in described main picture, obtaining group photo photo.
CN201510993327.8A 2015-12-24 2015-12-24 Image processing method and device Active CN105631804B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510993327.8A CN105631804B (en) 2015-12-24 2015-12-24 Image processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510993327.8A CN105631804B (en) 2015-12-24 2015-12-24 Image processing method and device

Publications (2)

Publication Number Publication Date
CN105631804A true CN105631804A (en) 2016-06-01
CN105631804B CN105631804B (en) 2019-04-16

Family

ID=56046693

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510993327.8A Active CN105631804B (en) 2015-12-24 2015-12-24 Image processing method and device

Country Status (1)

Country Link
CN (1) CN105631804B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106355549A (en) * 2016-09-30 2017-01-25 北京小米移动软件有限公司 Photographing method and equipment
CN106447741A (en) * 2016-11-30 2017-02-22 努比亚技术有限公司 Picture automatic synthesis method and system
CN107231524A (en) * 2017-05-31 2017-10-03 珠海市魅族科技有限公司 Image pickup method and device, computer installation and computer-readable recording medium
CN109035191A (en) * 2018-08-01 2018-12-18 Oppo(重庆)智能科技有限公司 Image processing method, picture processing unit and terminal device
CN110288639A (en) * 2019-06-21 2019-09-27 深圳职业技术学院 One kind assisting virtual splicing system for computer picture
CN111466112A (en) * 2018-08-10 2020-07-28 华为技术有限公司 Image shooting method and electronic equipment
CN112258611A (en) * 2020-10-23 2021-01-22 北京字节跳动网络技术有限公司 Image processing method and device
CN114205512A (en) * 2020-09-17 2022-03-18 华为技术有限公司 Shooting method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1507386A1 (en) * 2003-08-14 2005-02-16 Fuji Photo Film Co., Ltd. Image pickup device and image synthesizing method
CN104170371A (en) * 2014-01-03 2014-11-26 华为终端有限公司 Method of realizing self-service group photo and photographic device
CN104463817A (en) * 2013-09-12 2015-03-25 华为终端有限公司 Image processing method and device
CN104967790A (en) * 2014-08-06 2015-10-07 腾讯科技(北京)有限公司 Photo shooting method, photo shooting apparatus and mobile terminal

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1507386A1 (en) * 2003-08-14 2005-02-16 Fuji Photo Film Co., Ltd. Image pickup device and image synthesizing method
CN104463817A (en) * 2013-09-12 2015-03-25 华为终端有限公司 Image processing method and device
CN104170371A (en) * 2014-01-03 2014-11-26 华为终端有限公司 Method of realizing self-service group photo and photographic device
CN104967790A (en) * 2014-08-06 2015-10-07 腾讯科技(北京)有限公司 Photo shooting method, photo shooting apparatus and mobile terminal

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106355549A (en) * 2016-09-30 2017-01-25 北京小米移动软件有限公司 Photographing method and equipment
CN106447741A (en) * 2016-11-30 2017-02-22 努比亚技术有限公司 Picture automatic synthesis method and system
CN107231524A (en) * 2017-05-31 2017-10-03 珠海市魅族科技有限公司 Image pickup method and device, computer installation and computer-readable recording medium
CN109035191A (en) * 2018-08-01 2018-12-18 Oppo(重庆)智能科技有限公司 Image processing method, picture processing unit and terminal device
CN111466112A (en) * 2018-08-10 2020-07-28 华为技术有限公司 Image shooting method and electronic equipment
CN110288639A (en) * 2019-06-21 2019-09-27 深圳职业技术学院 One kind assisting virtual splicing system for computer picture
CN114205512A (en) * 2020-09-17 2022-03-18 华为技术有限公司 Shooting method and device
WO2022057384A1 (en) * 2020-09-17 2022-03-24 华为技术有限公司 Photographing method and device
CN112258611A (en) * 2020-10-23 2021-01-22 北京字节跳动网络技术有限公司 Image processing method and device
CN112258611B (en) * 2020-10-23 2024-05-31 北京字节跳动网络技术有限公司 Image processing method and device

Also Published As

Publication number Publication date
CN105631804B (en) 2019-04-16

Similar Documents

Publication Publication Date Title
US10565763B2 (en) Method and camera device for processing image
CN105631804A (en) Image processing method and device
CN107025419B (en) Fingerprint template inputting method and device
CN105491284B (en) The display methods and device of preview image
CN104700353B (en) Image filters generation method and device
CN106028143A (en) Video live broadcasting method and device
CN104090735B (en) The projecting method and device of a kind of picture
CN105635567A (en) Shooting method and device
CN107155060A (en) Image processing method and device
CN106527682B (en) Method and device for switching environment pictures
CN105491289A (en) Method and device for preventing photographing occlusion
CN104035674B (en) Picture displaying method and device
CN105282441A (en) Photographing method and device
CN105468767A (en) Method and device for acquiring calling card information
CN105513104A (en) Picture taking method, device and system
CN107426489A (en) Processing method, device and terminal during shooting image
CN104933419A (en) Method and device for obtaining iris images and iris identification equipment
CN104460185A (en) Automatic focusing method and device
CN104867112B (en) Photo processing method and device
CN104243829A (en) Self-shooting method and self-shooting device
CN104216525A (en) Method and device for mode control of camera application
CN106791563B (en) Information transmission method, local terminal equipment, opposite terminal equipment and system
CN107085823A (en) Face image processing process and device
CN105323491A (en) Image shooting method and device
JP2016535527A (en) Call transfer method, apparatus and terminal, program, and recording medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant