CN107454294B - Panorama beautifying camera mobile phone and implementation method thereof - Google Patents
Panorama beautifying camera mobile phone and implementation method thereof Download PDFInfo
- Publication number
- CN107454294B CN107454294B CN201710763172.8A CN201710763172A CN107454294B CN 107454294 B CN107454294 B CN 107454294B CN 201710763172 A CN201710763172 A CN 201710763172A CN 107454294 B CN107454294 B CN 107454294B
- Authority
- CN
- China
- Prior art keywords
- image
- panoramic
- lens
- beautifying
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Abstract
The invention discloses a panoramic face-beautifying camera mobile phone, which comprises: a mobile phone case; the first lens is arranged on the back of the mobile phone shell; the second lens is arranged on the front surface of the mobile phone shell and is symmetrically arranged with the first lens; the main control circuit board is used for controlling the operation of the electronic device, is arranged in the mobile phone shell; display device a module; wherein, the main control circuit board contains: the image processing and control module is connected with the first lens and the second lens; the input end of the first photosensitive module is connected with the first lens, and the output end of the first photosensitive module is connected with the image processing and control module; the input end of the second photosensitive module is connected with the second lens, and the output end of the second photosensitive module is connected with the image processing and control module; the storage module is connected with the image processing and control module, the first photosensitive module and the second photosensitive module; the first lens and the second lens are identical in configuration, and lenses with equivalent visual angles alpha of 94-46 degrees are adopted. The advantages are that: only the mobile phone is required to rotate by an angle smaller than 90 degrees along the perpendicular bisector, and panoramic shooting can be completed.
Description
Technical Field
The invention relates to the technical field of image communication, in particular to a panoramic face-beautifying camera mobile phone and an implementation method thereof.
Background
Whether the android system mobile phone or the IOS system mobile phone is the position of the camera function in the mobile phone, the camera function of the mobile phone product is the most attractive place for the customer, the richness of the camera function of the mobile phone product and the corresponding performance experience greatly influence the sales volume of the product and the selection of the product by the customer, and finally, whether the customer uses or continues to use the product can be determined, so that the function of adding the camera is very important.
In common third party mobile phone applications, the use of panoramic photographing functions has become quite widespread, however, panoramic photographing is generally not provided with a beautifying function. Because, in the prior art, the image data from the sensor end is correspondingly processed to separate out a plurality of data flow channels with different purposes, the data is intercepted on different data flows and is processed by a third-party algorithm, so as to realize a corresponding third-party algorithm effect, such as a beautifying effect.
Chinese patent application No.: 201610530544.8 discloses a photographing processing method and a terminal, comprising: starting a camera function; obtaining jitter information of a terminal detected by a sensor; determining a target beauty parameter value according to the dithering information, wherein the smaller the dithering information is, the larger the target beauty parameter value is; generating a target beauty treatment instruction according to the target beauty parameter value; and carrying out face beautifying processing on a face image area contained in the image acquired by the camera according to the target face beautifying processing instruction to obtain a photographed image. According to the technical scheme, the beauty parameter value can be adjusted according to the shake degree of the terminal, so that the terminal photographing is more intelligent, but the technical scheme of how to be applied to panoramic photographing is not disclosed.
Chinese patent application No.: 201410569579.3 discloses a panoramic shooting method and device, wherein the method comprises the following steps: receiving a panoramic shooting instruction; when the photographing device rotates for the first time, photographing parameters of at least two photographing positions are obtained; when the photographing device rotates for the second time, photographing is performed at the at least two photographing positions according to the obtained photographing parameters; and synthesizing the shot photos to generate panoramic pictures. The method and the device can be used for shooting by using shooting parameters corresponding to the current shooting position, so that the image quality of a shot photo is improved, and the image quality of a panoramic picture is further improved. It does not propose a technical scheme how to make the mobile phone have a panoramic beautifying function.
Secondly, when panoramic shooting, the mobile phone is required to be moved by hands, the problem that the shooting effect is influenced due to the fact that the mobile phone is unstable in the moving process is solved, and meanwhile, the shooting effect is also influenced due to the fact that the mobile phone cannot be moved at a uniform speed in the moving process. Common appliances on the market such as traditional selfie sticks also only play a role in fixing and cannot rotate.
Chinese patent application No.: 201320420454.5A hand-held panoramic photographic frame comprises a hand-held support
The upper end of the hand-held support rod is provided with a cavity, a vertically placed air cylinder is arranged in the cavity, and the outer wall of the hand-held support rod is provided with an opening for accommodating a switch button of the air cylinder; the end part of a piston rod of the cylinder is fixedly connected with a rack, the rack is meshed with a transmission gear, a transmission shaft is fixedly arranged in the transmission gear, a driving bevel gear is arranged at the end part of the transmission shaft, the driving bevel gear is meshed with a driven bevel gear, an output shaft which is vertically arranged is fixedly arranged in the driven bevel gear, and the end part of the output shaft extends out of the upper end of a hand-held support rod. It is obvious that the structure is complex, and the shooting device is also required to be held manually, so that the operation is inconvenient.
Chinese patent application No.: 20141054041.6A 360-degree panoramic camera comprises a housing having a top surface, a bottom surface and a plurality of side surfaces, wherein at least one high-definition camera and a memory card slot are mounted on each of the plurality of side surfaces, and a GPS antenna chip is mounted on the top surface of the panoramic camera. The 360-degree panoramic camera which synchronizes the image data through the GPS time and the position can be matched with the GPS time and the position information of the laser radar data, and has the characteristics of low cost, high integration level and multiple project application. However, it is more bulky from a structural point of view and is not suitable for use with thin machines such as cell phones.
Disclosure of Invention
The invention aims to provide a panoramic face-beautifying camera mobile phone and an implementation method thereof, wherein cameras with equivalent visual angles of 94-46 degrees are respectively arranged at front and back symmetrical positions of the mobile phone, so that panoramic shooting can be completed by rotating the mobile phone by an angle smaller than 90 degrees along a perpendicular bisector of the mobile phone, the shooting time is shortened, and the image quality is improved.
In order to achieve the above purpose, the present invention is realized by the following technical scheme:
a panoramic face-beautifying camera phone, comprising:
a mobile phone case;
the first lens is arranged on the back of the mobile phone shell;
the second lens is arranged on the front surface of the mobile phone shell and is symmetrically arranged with the first lens;
the main control circuit board is arranged in the mobile phone shell;
the display module is arranged on the front surface of the mobile phone shell and is positioned below the second lens;
wherein, the main control circuit board contains:
an image processing and control module;
the input end of the first photosensitive module is connected with the first lens, and the output end of the first photosensitive module is connected with the image processing and control module;
the input end of the second photosensitive module is connected with the second lens, and the output end of the second photosensitive module is connected with the image processing and control module;
the storage module is connected with the image processing and control module, the first photosensitive module and the second photosensitive module;
the first lens and the second lens adopt lenses with equivalent visual angles alpha of 94-46 degrees.
The panorama face-beautifying camera mobile phone, wherein:
and the first photosensitive module and the second photosensitive module are respectively provided with 1200 ten thousand pixel photosensitive elements.
The panorama beauty camera mobile phone, wherein the image processing and controlling module comprises:
the beautifying unit is connected with the first photosensitive module, the second photosensitive module and the storage module;
the preview unit is connected with the display module and the beautifying unit;
the panoramic display unit is connected with the display module;
the main control unit is respectively connected with the preview unit, the storage module, the beautifying unit and the panorama display unit.
The panorama beauty camera mobile phone further comprises:
and the video recording unit is connected with the main control unit.
The panorama face-beautifying camera mobile phone, wherein:
the first lens and the second lens are configured identically.
A method for realizing panoramic face-beautifying photographing of a mobile phone is characterized by comprising the following steps:
s1, placing the mobile phone in a panoramic shooting mode, enabling the mobile phone to be vertical, and pressing a shutter to enable the mobile phone to receive panoramic shooting instructions;
s2, rotating the mobile phone clockwise or anticlockwise along the perpendicular bisector of the mobile phone;
s3, the main control circuit board records continuous pictures shot by the first lens and the second lens in real time, and the preview unit transmits the pictures shot by the first lens and the second lens to the display module in real time for display.
The implementation method for the panoramic face-beautifying photographing of the mobile phone comprises the following steps:
and the rotation angle theta in the step S2 is more than or equal to (180-alpha), wherein alpha is the equivalent visual angle of the first lens or the second lens.
The method for realizing panoramic and beauty photographing of the mobile phone, wherein the process of recording the continuous pictures photographed by the first lens and the second lens by the main control circuit board in the step S3 in real time specifically comprises the following steps:
the first photosensitive module converts a picture shot by the first lens into a first RAW data image stream and outputs the first RAW data image stream to the American Yan Shanyuan; the second photosensitive module converts the picture shot by the second lens into a second RAW data image stream and outputs the second RAW data image stream to the American Yan Shanyuan;
the beautifying unit respectively performs the beautifying algorithm processing on the first RAW data image stream and the second RAW data image stream, and outputs the first beautifying data image stream and the second beautifying data image stream after the beautifying to the main control unit;
the main control unit respectively performs image stitching processing on the first beautifying data image stream and the second beautifying data image stream to obtain a first panoramic beautifying image and a second panoramic beautifying image, and stores the first panoramic beautifying image and the second panoramic beautifying image into the storage module.
The implementation method of mobile phone panoramic beauty photographing, wherein, the step S3 further comprises:
s4, pressing the shutter again, and (5) finishing photographing.
The implementation method of mobile phone panoramic beauty photographing further comprises the following step S4:
s5, when the user selects the panoramic display mode, the main control unit extracts the first panoramic beauty image and the second panoramic beauty image from the storage unit to the panoramic display unit, and the panoramic display unit splices the first panoramic beauty image and the second panoramic beauty image to obtain a panoramic beauty composite image and outputs the panoramic beauty composite image to the display module for display.
Compared with the prior art, the invention has the following advantages:
1. cameras with equivalent angles of 94-46 degrees are respectively arranged at the front-back symmetrical positions of the mobile phone, so that panoramic shooting can be completed by rotating the mobile phone by an angle smaller than 90 degrees along the perpendicular bisector of the mobile phone, the shooting time is shortened, and the image quality is improved;
2. the photosensitive modules are respectively arranged for each camera, so that the photosensitive channels of the two cameras are independent, and the interference of images is reduced;
3. the beauty unit is arranged behind the photosensitive module, so that the stored panoramic image and the previewed panoramic image are both beauty images processed by a beauty algorithm.
Drawings
FIG. 1 is a front view of a panoramic facial camera phone of the present invention;
FIG. 2 is a rear view of the panoramic facial camera phone of the present invention;
FIG. 3 is a view of a reference view of the usage status of the panoramic facial camera phone of the present invention;
FIG. 4 is a system block diagram of a panoramic beauty camera phone of the present invention;
FIG. 5 is a block diagram of an image processing and control module of the panoramic beauty camera phone of the present invention;
FIG. 6 is a flow chart of the method of the present invention;
fig. 7 is a flowchart of a brightness adjustment method according to an embodiment of the invention.
Detailed Description
The invention will be further described by the following detailed description of a preferred embodiment, taken in conjunction with the accompanying drawings.
The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
As shown in fig. 1 and 2; a panoramic, face-beautifying camera phone, comprising: a mobile phone case 1; a first lens 21 disposed on the back surface of the mobile phone case 1; the second lens 22 is arranged on the front surface of the mobile phone shell 1 and is symmetrically arranged with the first lens 21; the main control circuit board is arranged in the mobile phone shell 1; the display module is arranged on the front surface of the mobile phone shell 1 and is positioned below the second lens 22. The first lens and the second lens are identical in configuration, and lenses with equivalent visual angles alpha of 94-46 degrees are adopted. Preferably, the method comprises the steps of, the equivalent viewing angles α of the first lens 21 and the second lens 22 are 94 °.
As shown in fig. 3, cameras with equivalent angles of view of 94-46 degrees are respectively arranged at front and back symmetrical positions of the mobile phone, so that panoramic shooting can be completed by rotating the mobile phone by an angle smaller than 90 degrees along a perpendicular bisector of the mobile phone, the shooting time is shortened, and the image quality is improved; and set up photosensitive module for every camera respectively for the sensitization passageway of two cameras is independent, has reduced the interference of image.
As shown in fig. 4 and 5, the main control circuit board includes: an image processing and controlling module 44, configured to perform data processing on the input image data stream to obtain desired image information, and push or display the desired image information to a user through a user operation; the first photosensitive module 41 has an input end connected with the first lens 21 and an output end connected with the image processing and control module 44; the second photosensitive module 42 has an input end connected with the second lens 22 and an output end connected with the image processing and control module 44; the storage module 43 is connected to the image processing and control module 44, the first photosensitive module 41, and the second photosensitive module 42.
The image processing and controlling module 44 may be a mobile phone APP, or may be other image processing chips, in this embodiment, the image processing and controlling module 44 is implemented by the mobile phone APP, so long as the user downloads the image processing and controlling module through the network, the image processing and controlling module can be used for free, and the selling price cost of the mobile phone will not be increased.
Preferably, the first photosensitive module 41 and the second photosensitive module 42 are respectively provided with 1200 ten thousand pixels of photosensitive elements, and any one of a CCD or CMOS sensor may be used.
In this embodiment, the image processing and control module includes:
the first light sensing module 41, the second light sensing module 42 and the storage module 43 are connected to the united states Yan Shanyuan 442;
a preview unit 443 connected to the display module and the beautifying unit 442;
the panorama display unit 444 is connected with the display module;
the main control unit 441 is connected to the preview unit, the storage module 43, the united states Yan Shanyuan 442, and the panorama display unit 444, respectively.
From the perspective of mobile phone APK, the implementation method of each module is that RAW data from a sensor end is correspondingly processed to separate out a plurality of data flow channels with different purposes, data are intercepted on different data flows, and a third party algorithm (for example, beauty Yan Suanfa) is performed, so that a corresponding third party algorithm effect can be realized, and before the corresponding data flows of preview and preview back are separated out, beauty Yan Suanfa is added, so that the preview and preview back data have a beauty effect, and particularly, in order to combine a panoramic function and a beauty photographing function on an MT6797 platform, a brand new mode is needed to be used to realize the panoramic photographing function, namely, YUV domain on a p2node stage adopts plug-in mechanism, and a beauty algorithm is added, so that the preview back data intercepted by the panoramic function realized in real-time preview or upper layer have a beauty effect, and thus the desired function can be realized. The implementation scheme can reduce the complexity of program logic added with a plurality of third-party algorithms, realize the superposition of the desired third-party algorithm effect function on the preview call back data, and can preview, namely preview in a common mode can also have the third-party algorithm effect.
Preferably, the image processing module further comprises a video recording unit connected to the main control unit 441 for providing a video recording function for the user.
As shown in fig. 3 and 6, the invention also provides a method for realizing panoramic beauty photographing of a mobile phone, which comprises the following steps:
s1, placing the mobile phone in a panoramic shooting mode, enabling the mobile phone to be vertical, and pressing a shutter to enable the mobile phone to receive panoramic shooting instructions; preferably, after the mobile phone is placed in the panoramic mode, firstly detecting whether the mobile phone is in a vertical state; when the photographic equipment is not in a vertical state, sending out prompt information, wherein the detection function can be realized by arranging a detection unit and a prompt unit in an image processing and control module;
s2, the user rotates the mobile phone clockwise or anticlockwise along the perpendicular bisector of the mobile phone;
and S3, the main control circuit board records continuous pictures shot by the first lens 21 and the second lens 22 in real time, and the preview unit transmits the pictures shot by the first lens 21 and the second lens 22 to the display module in real time for display.
The rotation angle Θ in step S2 is equal to or greater than (180 ° - α), where α is the equivalent angle of view of the first lens 21 or the second lens 22.
The process of recording the continuous pictures shot by the first lens 21 and the second lens 22 by the main control circuit board in the step S3 in real time specifically includes:
the first photosensitive module 41 converts the picture shot by the first lens 21 into a first RAW data image stream and outputs the first RAW data image stream to the united states Yan Shanyuan 442; the second photosensitive module 42 converts the frame shot by the second lens 22 into a second RAW data image stream and outputs the second RAW data image stream to the united states Yan Shanyuan 442;
the first and second RAW data image streams are processed by the beauty Yan Shanyuan 442 by the beauty algorithm, and the first and second beauty data image streams after the beauty are output to the main control unit 441;
the main control unit 441 performs image stitching processing on the first and second beauty data image streams to obtain a first and second panoramic beauty images, and stores the first and second panoramic beauty images in the storage module 43.
The step S3 further comprises the following steps: s4, pressing the shutter again, and ending photographing.
The step S4 further comprises: and S5, when the user selects the panoramic display mode, the main control unit 441 extracts the first panoramic image and the second panoramic image from the storage unit 43 to the panoramic display unit 444, and the panoramic display unit 444 splices the first panoramic image and the second panoramic image to obtain a panoramic composite image and outputs the panoramic composite image to the display module for display.
In some embodiments, the configurations of the first lens 21 and the second lens 22 are different, and the configuration of the front camera, i.e. the second lens 22, is often lower, in this embodiment, a panoramic image may be guided by taking an ultra-wide angle image and storing the ultra-wide angle image in a memory, and then taking the panoramic image based on the image, so as to achieve a free image taking mode with unrestricted image taking mode, unrestricted image moving speed and unrestricted moving direction, and take a wider panoramic image. Specifically, the shooting process still includes two cameras, i.e., a first lens 21 and a second lens 22, for example, one is an ultra-wide angle camera (second lens 22) with a relatively low resolution but a wide angle of view, and the other is a high resolution camera (first lens 21) with focusing, which is suitable for taking panoramic pictures. The resolution of the panoramic photograph of the image is greater than the resolution of the image capturing apparatus that captured the wide-angle photograph. Firstly, the ultra-wide angle camera is started to take pictures and the pictures are cached in the memory. Because the lens is used for shooting, the shot scenery has a large range, but the deformation is obvious, the pixel density is low, and the lens cannot be directly used as a panoramic photo. But its taken wide-angle photograph can be used as a background reference for taking panoramic photographs to guide the user to take panoramic photographs of images to be taken.
In some embodiments, due to the light, the brightness of the images captured by the two cameras may have uneven brightness, resulting in uneven color formation after the images are stitched, so the panorama display unit 444 adjusts the brightness of the stitched images after the two images are stitched, and specifically, as shown in fig. 7, the brightness adjustment method includes:
s601, acquiring an image to be processed, and acquiring a single-channel brightness image according to the gray scale of each channel of the image to be processed;
s602, carrying out Gaussian filtering on the single-channel brightness image to obtain a Gaussian filtered image;
s603, adjusting the gray level of the Gaussian filtered image according to the gray level of the Gaussian filtered image and a preset proportion;
s604 comparing the adjusted gaussian filtered image with the gaussian filtered image before adjustment, acquiring the gray scale change rate of each pixel point before and after adjustment;
s605, multiplying the gray scale change rate of each pixel point by the gray scale of the corresponding pixel point in the image to be processed so as to process the image to be processed;
s606, outputting the processed image.
The image to be processed is a digital image, namely an image represented by a two-dimensional array form. As will be appreciated by those skilled in the art, the fundamental elements of a digital image are pixels (or pixels) that are obtained by discretizing a continuous space when the analog image is digitized. Each pixel has an integer row (high) and column (wide) position coordinate, while each pixel has an integer gray value or color value;
where gray scale is a quantization of the brightness change of an image to represent the brightness, the gray scale is typically 256 gray levels, i.e. the gray scale ranges from 0 to 255, and the change from 0 to 255 represents the brightness from dark to light, and the corresponding color in the image is from black to white. The gray scale of the image can also be expressed as 0-1,0 representing black, 1 representing white, and a value between 0-1 representing gray from dark to light.
The single-channel brightness image refers to an image with the maximum gray level obtained by comparing gray levels of various channels of each pixel point in the image to be processed.
For an image with only one channel, such as a gray image, the image is taken as a single-channel brightness image, for an image with three channels (R (Red), G (Green), B (Blue), each pixel point of the image has three gray scales, each gray scale corresponds to one channel, the gray scales of the three channels of the pixel point are compared for each pixel point, the maximum value in the three gray scales is obtained, and the maximum value is taken as the gray scale of the pixel point, so that the single-channel brightness image is obtained.
For images of other color modes, the images can be converted into RGB images first, then the single-channel brightness images are obtained, and the images corresponding to the channels used for representing the brightness in the images of other color modes can be directly used as the single-channel brightness images. In the embodiment of the present invention, only the image to be processed is exemplified as the RGB image.
In this step S602, the single-channel luminance image is input to a gaussian filter, and the gaussian filter is applied to the single-channel luminance image by a filter function of the gaussian filter, thereby obtaining a gaussian filtered image.
Alternatively, for two-dimensional image processing, the image may be smoothed using a two-dimensional gaussian filter function, or the image may be smoothed using a one-dimensional gaussian filter function. In the practical use process, a two-dimensional Gaussian filter function is often adopted, and smooth filtering of the image is realized at one time.
In the embodiment of the invention, the Gaussian filter is a linear smoothing filter which selects the weight according to the shape of the Gaussian function, and the Gaussian filter is adopted to carry out Gaussian filtering on the single-channel brightness image, so that the effects of smoothing the image and eliminating noise can be achieved, and the discontinuity of the image is avoided.
In the practical application process, the filter function and each parameter of the function in the filter need to be adjusted according to the size and the filtering degree of the image, which is not particularly limited in the embodiment of the present invention.
In step S603, the number of pixels corresponding to each gray level can be obtained by counting the gray levels of the gaussian filtered image, the gray level corresponding to the preset ratio is used as the first gray level, the region composed of pixels smaller than the first gray level is used as the shadow region, and the region composed of pixels larger than the first gray level is used as the highlight region. After a shadow area and a highlight area of the Gaussian filtered image are obtained, gray scales of pixel points in the shadow area and the highlight area are respectively adjusted, and the adjusted gray scales are obtained.
In step S604, the gray scale change rate of each pixel is obtained by performing a ratio operation on the gray scale of each corresponding pixel of the adjusted gaussian filtered image and the gray scale of each corresponding pixel of the gaussian filtered image before adjustment, where the gray scale change rate of each pixel is used for adjusting the brightness of the image to be processed.
In the step S605, the gray scale of the shadow area in the image to be processed is increased and the gray scale of the highlight area is decreased by multiplying the gray scale change rate of each pixel point and the gray scale of each corresponding pixel point in the image to be processed, and the image is used as the processed image.
In step S606, the processed image is output, and compared with the original image, the image increases the contrast of the image, has more detail information, and is suitable for the observation of human eyes.
According to the embodiment of the invention, the image to be processed is obtained, and the single-channel brightness image is obtained according to the gray scale of each channel of the image to be processed; carrying out Gaussian filtering on the single-channel brightness image to obtain a Gaussian filtered image; according to the gray level of the Gaussian filtered image and a preset proportion, adjusting the gray level of the Gaussian filtered image; comparing the Gaussian filtered image after adjustment with the Gaussian filtered image before adjustment to obtain the gray scale change rate of each pixel point before and after adjustment; multiplying the gray scale change rate of each pixel point with the gray scale of the corresponding pixel point in the image to be processed to process the image to be processed; and outputting the processed image. By adopting the technical proposal provided by the invention, the expression capability of the whole color channel is fully utilized by processing the gray scale of each channel of the image, and the Gaussian filtering is carried out on the single-channel brightness image, the continuity of the whole image is ensured, and the shadow and highlight areas in the Gaussian filtered image tend to be neutral by adjusting the Gaussian filtered image according to the preset proportion, so that the Gaussian filtered image is more suitable for observation of human eyes.
In this embodiment, only the image to be processed is taken as an RGB image for illustration, and the method includes:
s611, acquiring an image to be processed, and acquiring a single-channel brightness image according to the gray scale of each channel of the image to be processed;
and obtaining an image to be processed, comparing the gray scale of each brightness channel of each pixel point, obtaining the maximum value of the gray scale of each pixel point, and taking the maximum value as the gray scale of each pixel point to obtain a single-channel brightness image.
And comparing the gray scales of the corresponding R, G, B three channels of each pixel point to obtain a single-channel brightness image. Specifically, the gradation of R, G, B of each pixel of the image to be processed is compared, the maximum gradation of each pixel is obtained, and the maximum gradation of each pixel is used as the gradation of each pixel of the single-channel brightness image, so that the single-channel brightness image is obtained.
S612: carrying out Gaussian filtering on the single-channel brightness image to obtain a Gaussian filtered image;
in order to maintain the continuity of the image, the image needs to be filtered, and because the gaussian filter has a better filtering effect, the gaussian filter is preferably used to filter the single-channel brightness image in the embodiment of the present invention. Meanwhile, a suitable size is selected according to the size of the image, and preferably, the radius of the gaussian filter is 5-20 pixels. Through inputting the image to be processed into the Gaussian filter, the convolution calculation is carried out on the image to be processed and the filtering function of the Gaussian filter, and the Gaussian filtered image is obtained. By carrying out Gaussian filtering on the single-channel image, a smooth Gaussian filtered image is obtained, and discontinuity of image gray scale is avoided.
S613: determining the number of pixel points corresponding to each gray level according to the gray level of each pixel point of the Gaussian filtered image and the sequence from the small gray level to the large gray level;
the statistics of the number of pixels corresponding to each gray level of the Gaussian filtered image is equivalent to the histogram statistics of the Gaussian filtered image, the number of pixels corresponding to each gray level is obtained according to the sequence from the gray level to the large gray level, the abscissa axis of the histogram is the gray level, and the ordinate axis is the number of pixels corresponding to the gray level.
S614: determining a first numerical value according to the number of pixel points of the Gaussian filtered image and a preset proportion;
the number of pixels of the gaussian filter image is required to be consistent with the number of pixels of the image to be processed, and since the gray scale change rate obtained by the gaussian filter image in the subsequent step is used for processing the image to be processed, the total number of pixels of the gaussian filter image is required to be the same as the total number of pixels of the image to be processed. If the size of the image to be processed is M rows and N columns, the number of pixels of the image to be processed is m×n, the number of pixels of the gaussian filtered image should also be m×n, and the processing of the total number of pixels of the image may be implemented in the filtering process of step 202. And carrying out product operation on the number of pixels of the Gaussian filtered image and a preset proportion to obtain a first numerical value, wherein the first numerical value is used for obtaining first gray scale, and further a shadow area and a highlight area in the image can be distinguished. The preset proportion can be set according to the actual condition of the image, if the shadow area in the image is larger and the highlight area is smaller, the preset proportion can be set larger, such as 80%, and if the shadow area in the image is smaller and the highlight area is larger, the preset proportion can be set smaller, such as 20%.
S615: acquiring a first gray level according to the first numerical value and the determined number of pixel points corresponding to each gray level;
wherein the first gray scale is used to distinguish a shadow region and a highlight region of the image. In order to better adjust the brightness of the image, the pixel point smaller than the first gray scale is used as a shadow area, and the pixel point larger than the first gray scale is used as a highlight area, so that the brightness of the two areas is adjusted conveniently. After the first numerical value is determined, accumulating the number of pixel points corresponding to each gray level of the Gaussian filtered image according to the sequence from the gray level to the large gray level until the accumulated value of the previous time is smaller than the first numerical value and the accumulated value of the next time is larger than or equal to the first numerical value, stopping accumulating, and taking the gray level corresponding to the number of the pixel points accumulated of the next time on the histogram as the first gray level.
Steps S613-615 are processes of obtaining a first gray scale for distinguishing a shadow area and a highlight area of an image according to the number of pixels of the gaussian filtered image, the gray scale of each pixel and a preset ratio.
S616 the method comprises the following steps: according to the gray scale of each pixel point of the Gaussian filtered image and the first gray scale, adjusting the gray scale of the Gaussian filtered image;
s617: comparing the Gaussian filtered image after adjustment with the Gaussian filtered image before adjustment to obtain the gray scale change rate of each pixel point before and after adjustment;
s618: multiplying the gray scale change rate of each pixel point with the gray scale of the corresponding pixel point in the image to be processed to obtain second gray scale;
s619: when the second gray level of any pixel point is larger than a second preset value, adjusting the gray level of any pixel point to be the second preset value;
s620: the adjusted image is acquired as a processed image.
In another embodiment of the present invention, steps 618-520 may further be to multiply the gray scale change rate of each pixel point with the gray scale of the corresponding pixel point in the image to be processed, so as to process the image to be processed. The image to be processed is subjected to a series of processing, the shadow area and the highlight area are regulated, and the regulated image is suitable for the observation of human eyes and the acquisition of detail information.
S621: and outputting the processed image.
The processed image increases the contrast of the image, has more detail information, and is more suitable for the observation of human eyes after being output.
In the embodiment, a single-channel brightness image is obtained according to the gray scale of each channel of an image to be processed by obtaining the image to be processed; carrying out Gaussian filtering on the single-channel brightness image to obtain a Gaussian filtered image; according to the gray level of the Gaussian filtered image and a preset proportion, adjusting the gray level of the Gaussian filtered image; comparing the Gaussian filtered image after adjustment with the Gaussian filtered image before adjustment to obtain the gray scale change rate of each pixel point before and after adjustment; multiplying the gray scale change rate of each pixel point with the gray scale of the corresponding pixel point in the image to be processed to process the image to be processed; and outputting the processed image. By adopting the technical scheme provided by the invention, the expression capability of the whole color channel is fully utilized by processing the gray scale of each channel of the image, the continuity of the whole image is ensured by carrying out Gaussian filtering on the single-channel brightness image, and the shadow and highlight areas in the Gaussian filtered image tend to be neutral by adjusting the Gaussian filtered image according to the preset proportion, so that the method is more suitable for the observation of human eyes.
While the present invention has been described in detail through the foregoing description of the preferred embodiment, it should be understood that the foregoing description is not to be considered as limiting the invention. Many modifications and substitutions of the present invention will become apparent to those of ordinary skill in the art upon reading the foregoing. Accordingly, the scope of the invention should be limited only by the attached claims.
Claims (8)
1. A panoramic face-beautifying camera phone, comprising:
a mobile phone case;
the first lens is arranged on the back of the mobile phone shell;
the second lens is arranged on the front surface of the mobile phone shell and is symmetrically arranged with the first lens;
the main control circuit board is arranged in the mobile phone shell;
the display module is arranged on the front surface of the mobile phone shell and is positioned below the second lens;
wherein, the main control circuit board contains:
an image processing and control module;
the input end of the first photosensitive module is connected with the first lens, and the output end of the first photosensitive module is connected with the image processing and control module;
the input end of the second photosensitive module is connected with the second lens, and the output end of the second photosensitive module is connected with the image processing and control module;
the storage module is connected with the image processing and control module, the first photosensitive module and the second photosensitive module;
wherein, the first lens and the second lens adopt lenses with equivalent visual angles alpha of 94-46 degrees;
the image processing and controlling module comprises:
the beautifying unit is connected with the first photosensitive module, the second photosensitive module and the storage module;
the preview unit is connected with the display module and the beautifying unit;
the panoramic display unit is connected with the display module;
the main control unit is respectively connected with the preview unit, the storage module, the beautifying unit and the panorama display unit;
the first photosensitive module is used for converting a picture shot by the first lens into a first RAW data image stream and outputting the first RAW data image stream to the American Yan Shanyuan; the second photosensitive module is used for converting the picture shot by the second lens into a second RAW data image stream and outputting the second RAW data image stream to the American Yan Shanyuan;
the beautifying unit can respectively process the first RAW data image stream and the second RAW data image stream by a beautifying algorithm, and output the first beautifying data image stream and the second beautifying data image stream after beautifying to the main control unit;
the main control unit can respectively perform image stitching processing on the first beautifying data image stream and the second beautifying data image stream to obtain a first panoramic beautifying image and a second panoramic beautifying image, and store the first panoramic beautifying image and the second panoramic beautifying image into the storage module;
the preview unit can transmit the first panoramic beauty image and the second panoramic beauty image to the display module for display;
the main control unit can extract the first panoramic beauty image and the second panoramic beauty image from the storage unit to the panoramic display unit, and the panoramic display unit is used for splicing the first panoramic beauty image and the second panoramic beauty image to obtain a panoramic beauty composite image and outputting the panoramic beauty composite image to the display module for display.
2. The panoramic beauty camera phone of claim 1, wherein:
and the first photosensitive module and the second photosensitive module are respectively provided with 1200 ten thousand pixel photosensitive elements.
3. The panoramic facial camera phone of claim 1, wherein said image processing and control module further comprises:
and the video recording unit is connected with the main control unit.
4. The panoramic beauty camera phone of claim 1, wherein:
the first lens and the second lens are configured identically.
5. A method for realizing panoramic beauty photographing of a mobile phone, wherein the method is applied to the panoramic beauty photographing mobile phone as claimed in any one of claims 1 to 4, and the method comprises the steps of:
s1, placing the mobile phone in a panoramic shooting mode, enabling the mobile phone to be vertical, and pressing a shutter to enable the mobile phone to receive panoramic shooting instructions;
s2, rotating the mobile phone clockwise or anticlockwise along the perpendicular bisector of the mobile phone;
s3, the main control circuit board records continuous pictures shot by the first lens and the second lens in real time, and the preview unit transmits the pictures shot by the first lens and the second lens to the display module in real time for display;
the process of recording the continuous pictures shot by the first lens and the second lens by the main control circuit board in the step S3 in real time specifically comprises the following steps:
the first photosensitive module converts a picture shot by the first lens into a first RAW data image stream and outputs the first RAW data image stream to the American Yan Shanyuan; the second photosensitive module converts the picture shot by the second lens into a second RAW data image stream and outputs the second RAW data image stream to the American Yan Shanyuan;
the beautifying unit respectively performs the beautifying algorithm processing on the first RAW data image stream and the second RAW data image stream, and outputs the first beautifying data image stream and the second beautifying data image stream after the beautifying to the main control unit;
the main control unit respectively performs image stitching processing on the first beautifying data image stream and the second beautifying data image stream to obtain a first panoramic beautifying image and a second panoramic beautifying image, and stores the first panoramic beautifying image and the second panoramic beautifying image into the storage module.
6. The method for realizing panoramic beauty photographing of a mobile phone according to claim 5, which is characterized in that:
and the rotation angle theta in the step S2 is more than or equal to (180-alpha), wherein alpha is the equivalent visual angle of the first lens or the second lens.
7. The method for realizing panoramic facial photographing of a mobile phone according to claim 5, wherein the step S3 further comprises:
s4, pressing the shutter again, and ending photographing.
8. The method for realizing panoramic facial photographing of a mobile phone according to claim 7, wherein the step S4 further comprises:
s5, when the user selects the panoramic display mode, the main control unit extracts the first panoramic beauty image and the second panoramic beauty image from the storage unit to the panoramic display unit, and the panoramic display unit splices the first panoramic beauty image and the second panoramic beauty image to obtain a panoramic beauty composite image and outputs the panoramic beauty composite image to the display module for display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710763172.8A CN107454294B (en) | 2017-08-30 | 2017-08-30 | Panorama beautifying camera mobile phone and implementation method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710763172.8A CN107454294B (en) | 2017-08-30 | 2017-08-30 | Panorama beautifying camera mobile phone and implementation method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107454294A CN107454294A (en) | 2017-12-08 |
| CN107454294B true CN107454294B (en) | 2023-10-10 |
Family
ID=60494327
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710763172.8A Active CN107454294B (en) | 2017-08-30 | 2017-08-30 | Panorama beautifying camera mobile phone and implementation method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107454294B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN203466898U (en) * | 2013-08-16 | 2014-03-05 | 北京播思无线技术有限公司 | 360-degree panoramic shooting apparatus of hand-held terminal |
| CN104349044A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Method and electronic equipment for shooting panoramic picture |
| CN104486553A (en) * | 2014-12-31 | 2015-04-01 | 广东欧珀移动通信有限公司 | Method and terminal for taking panoramic photos |
| CN106454046A (en) * | 2016-11-01 | 2017-02-22 | 信利光电股份有限公司 | 360-degree panoramic camera module and electronic equipment |
| CN207070129U (en) * | 2017-08-30 | 2018-03-02 | 深圳传音通讯有限公司 | Panorama U.S. face shooting mobile phone |
-
2017
- 2017-08-30 CN CN201710763172.8A patent/CN107454294B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104349044A (en) * | 2013-08-09 | 2015-02-11 | 联想(北京)有限公司 | Method and electronic equipment for shooting panoramic picture |
| CN203466898U (en) * | 2013-08-16 | 2014-03-05 | 北京播思无线技术有限公司 | 360-degree panoramic shooting apparatus of hand-held terminal |
| CN104486553A (en) * | 2014-12-31 | 2015-04-01 | 广东欧珀移动通信有限公司 | Method and terminal for taking panoramic photos |
| CN106454046A (en) * | 2016-11-01 | 2017-02-22 | 信利光电股份有限公司 | 360-degree panoramic camera module and electronic equipment |
| CN207070129U (en) * | 2017-08-30 | 2018-03-02 | 深圳传音通讯有限公司 | Panorama U.S. face shooting mobile phone |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107454294A (en) | 2017-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10311649B2 (en) | Systems and method for performing depth based image editing | |
| JP6263623B2 (en) | Image generation method and dual lens apparatus | |
| US8531573B2 (en) | Digital camera and operating method thereof | |
| US20130258044A1 (en) | Multi-lens camera | |
| US9819861B2 (en) | Picture taking device comprising a plurality of camera modules | |
| CN104253948B (en) | For the distributed image processing in camera so that the method and apparatus that the artifact in image is sutured minimizes | |
| US20060012690A1 (en) | Image capturing apparatus and method of acquiring image | |
| CN104159020B (en) | Using the image-taking system and method for the square-shaped image sensor for flexible image orientation | |
| CN107925751A (en) | For multiple views noise reduction and the system and method for high dynamic range | |
| CN107959778A (en) | Imaging method and device based on dual camera | |
| CN102783135A (en) | Method and apparatus for providing a high resolution image using low resolution | |
| KR20150108774A (en) | Method for processing a video sequence, corresponding device, computer program and non-transitory computer-readable medium | |
| CN108028894A (en) | Control system, imaging device and program | |
| CN110365894A (en) | The method and relevant apparatus of image co-registration in camera system | |
| CN106878624A (en) | Camera head and image capture method | |
| US11558557B2 (en) | Generation of enhanced panoramic visual content | |
| CN110430370A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN107948511B (en) | Brightness of image processing method, device, storage medium and brightness of image processing equipment | |
| US9706144B2 (en) | Device for picture taking in low light and connectable to a mobile telephone type device | |
| CN101472064A (en) | Filming system and method for processing scene depth | |
| US9013542B2 (en) | Image capture device and image synthesis method thereof | |
| CN106878606B (en) | Image generation method based on electronic equipment and electronic equipment | |
| CN111866369A (en) | Image processing method and device | |
| CN107454294B (en) | Panorama beautifying camera mobile phone and implementation method thereof | |
| CN207070129U (en) | Panorama U.S. face shooting mobile phone |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |