WO2017080237A1

WO2017080237A1 - Camera imaging method and camera device

Info

Publication number: WO2017080237A1
Application number: PCT/CN2016/089030
Authority: WO
Inventors: 张鹏
Original assignee: 乐视控股（北京）有限公司; 乐视移动智能信息技术（北京）有限公司
Priority date: 2015-11-15
Filing date: 2016-07-07
Publication date: 2017-05-18
Also published as: CN105898135A

Abstract

Provided in embodiments of the present application are a camera imaging method and camera device. An image sensor collects data of a shooting target, identifies all objects included in the target from the collected data, acquires profile information corresponding to each object, divides the target into regions according to the profile information of each object, adjusts the distance between the image sensor and the target to acquire an imaging position corresponding to each region at which the sharpness is highest, extracts a regional image on the imaging position corresponding to each region, and merges the regional images corresponding to each region to obtain a target image of the target. The embodiment of the present application divides the target into regions by the profiles of the objects and extracts the most clear regional image of each region to synthesize a final image of the target, such that the final image is clearer and sharper, and the objects inside the target can all be presented clearly.

Description

Camera imaging method and camera device

The present application claims priority to Chinese Patent Application No. 2015.

Technical field

The embodiments of the present application relate to the field of electronic technologies, and in particular, to a camera imaging method and a camera device.

Background technique

At present, smart phones are gradually integrated into people's daily lives, which not only become daily communication devices, but also become everyday easy-to-carry entertainment devices. The configuration of cameras in smartphones is getting higher and higher. Based on the portability of smartphones, users are more and more fond of taking pictures with cameras on smartphones.

Generally, the camera in the smartphone can move the lens to different positions by using an Auto Focus (AF) algorithm to calculate the sharpness at the current position, and the position with the best definition as the final imaging position. The lens is then placed in the imaging position for imaging. The AF algorithm captures the sharpness of each region by dividing the image into multiple regions, but in reality each region may contain multiple scenes on the focus, which will affect the final definition calculation and can only be selected. The image is imaged at the best position, and the image of the other focus is blurred, which makes the camera less effective.

Summary of the invention

The embodiment of the present application provides a camera imaging method and a camera device, which are used to solve the problem that the camera currently has an image blur through the AF algorithm and the imaging effect is poor.

In order to achieve the above object, an embodiment of the present application provides a camera imaging method, including:

Data acquisition by the image sensor to be photographed;

Identifying each scene contained in the target from the collected data;

Obtaining contour information corresponding to each scene;

Dividing the target according to the contour information of each scene;

Adjusting a distance between the image sensor and the target, and obtaining an imaging position with the best definition corresponding to each region;

Extracting an image of the area on the imaging position corresponding to each area;

The area images corresponding to each area are combined to obtain a target image of the target.

In order to achieve the above object, an embodiment of the present application provides a camera device, including:

An acquisition module for data collection of a target to be photographed;

An identification module, configured to identify, from the collected data, each scene included in the target;

a first acquiring module, configured to acquire contour information corresponding to each scene;

a dividing module, configured to divide the target according to contour information of each scene;

a second acquiring module, configured to adjust a distance between the image sensor and the target, and obtain an imaging position with the best definition corresponding to each region;

Extracting a module, configured to extract an area image of the imaging position corresponding to each area;

And a merging module, configured to merge the area images corresponding to each area to obtain a target image of the target.

In another aspect, embodiments of the present application provide a camera apparatus, including a memory, one or more processors, and one or more programs, wherein the one or more programs are executed by the one or more processors Performing the following operations: collecting data by the image sensor to be photographed; identifying each scene included in the target from the collected data; acquiring contour information corresponding to each scene; and according to contour information of each scene Performing area division on the target; adjusting a distance between the image sensor and the target, acquiring an imaging position with the best definition corresponding to each area; and extracting an area image of the imaging position corresponding to each area And merging the area images corresponding to each area to obtain a target image of the target.

In another aspect, embodiments of the present application provide a computer readable storage medium having computer executable instructions stored thereon, the computer executable instructions causing a camera device to perform an operation in response to execution, the operation The method includes: collecting data of an object to be photographed by an image sensor; identifying each scene included in the object from the collected data; acquiring contour information corresponding to each scene; and performing the target according to contour information of each scene Dividing a region; adjusting a distance between the image sensor and the target, acquiring an image forming position corresponding to the sharpness corresponding to each region; extracting an image of the region at the imaging position corresponding to each region; The region images corresponding to the regions are merged to obtain a target image of the target.

The camera imaging method and the camera device of the embodiment of the present invention perform data collection on a target to be photographed, identify each scene included in the target from the collected data, and obtain contour information corresponding to each scene, according to each scene. The contour information divides the target into regions, adjusts a distance between the lens and the target, acquires an image forming position with the best definition corresponding to each region, and extracts an image of the region at the imaging position corresponding to each region. And combining the area images corresponding to each area to obtain a target image of the target. In the embodiment of the present application, the region is divided by the scene contour, and the clearest region image in each region is taken out of the final image of the synthetic target, so that the final image is more clear and sharp, and the scene inside the target can be clearly presented.

DRAWINGS

1 is a schematic flow chart of a camera imaging method according to Embodiment 1 of the present application;

2 is a schematic flow chart of a camera imaging method according to Embodiment 2 of the present application;

3 is a schematic structural diagram of a camera device according to Embodiment 3 of the present application;

4 is a schematic structural diagram of a camera device according to Embodiment 4 of the present application;

FIG. 5 is a schematic structural diagram of still another embodiment of a camera device provided by the present application; FIG.

FIG. 6 is a schematic structural diagram of an embodiment of a computer program product for camera imaging provided by the present application.

detailed description

The camera imaging method and the camera device provided by the embodiments of the present application are described below with reference to the accompanying drawings. Carry out a detailed description.

Embodiment 1

As shown in FIG. 1 , it is a schematic flowchart of a camera imaging method according to Embodiment 1 of the present application, and the camera imaging method includes:

Step 101: Perform data collection on an object to be photographed by an image sensor.

Specifically, when the user attempts to take a photo, the camera icon can be clicked on the touch screen to generate an instruction to the smart phone, and after the smart phone detects the click operation, the camera can be started to perform the photographing mode. In this embodiment, the image sensor in the camera can perform data collection on the target to be photographed. Specifically, the user can point the camera of the camera to the target to be photographed, and the camera will collect data from the target.

Step 102: Identify each scene included in the target from the collected data.

Step 103: Obtain contour information corresponding to each scene.

After receiving the data collected by the image sensor, the image signal processor (Image Signal Processing, ISP for short) analyzes the collected data, and can identify each scene contained in the target from the target. After recognizing each scene, the camera can extract the contours of each scene through the ISP, and then obtain contour information corresponding to each scene.

Step 104: Perform area division on the target according to contour information of each scene.

In this embodiment, the camera no longer divides the target to be imaged by vertically and horizontally dividing the data, but divides the position where each scene is located into one area. After acquiring the contour information of each scene, the camera can determine the location of each scene and the area covered, thereby completing the area division of the target to be photographed.

Step 105: Adjust a distance between the image sensor and the target, and obtain an imaging position with the best definition corresponding to each region.

After the area division is completed, the user can adjust the position between the image sensor and the target to be photographed to adjust the distance between the two. When the distance changes, the focal length between the camera and the target changes. In this way, the corresponding sharpness of each area changes. By continuously adjusting the distance between the target and the camera, the image center with the best definition corresponding to each area can be obtained, and the image forming position with the best definition is obtained. The imaging effect of each area is optimal.

Step 106: Extract an area image on the imaging position corresponding to each area.

Step 107: Combine the area images corresponding to each area to obtain a target image of the target.

By adjusting the distance between the camera and the target multiple times, the camera can acquire an area image of each area at the imaging position with the best definition, and extract the area image corresponding to each area. Further, the camera combines the extracted region images corresponding to each region to obtain a target image of the target to be photographed.

The camera imaging method provided by the embodiment collects data of an object to be photographed by an image sensor, identifies each scene included in the object from the collected data, and acquires contour information corresponding to each scene, according to contour information of each scene. Divide the target into regions, adjust the distance between the image sensor and the target, obtain the optimal imaging position corresponding to each region, and extract the region image at the imaging position corresponding to each region, corresponding to each region. The area images are merged to obtain the target image of the target. In this embodiment, the target is divided into regions by the contour of the scene, and the clearest region image of each region is taken out of the final image of the composite target, so that the final image is more clear and sharp, and the scene inside the target can be clearly presented.

Embodiment 2

FIG. 2 is a schematic flowchart diagram of a camera imaging method according to Embodiment 2 of the present application, where the camera imaging method includes:

Step 201: Perform data collection on an object to be photographed by an image sensor.

In this embodiment, the image sensor in the camera can perform data collection on the target to be photographed. Specifically, the user can point the camera of the camera to the target to be photographed, and the camera will collect data from the target.

Step 202: Perform binarization processing on the collected data according to the set threshold to generate matrix data.

The camera first sets the threshold used for binarization according to the Tuning parameter through the built-in ISP, and then uses the threshold to binarize the collected data to generate matrix data. Specifically, the camera compares the binarized data with a threshold table, and sets the binarized data greater than or equal to the threshold to 1 and will be smaller than The binarized data of the threshold is set to 0 to generate matrix data.

Step 203: Perform continuity identification on the matrix data and save area information of the continuous area.

Searching for all the second pixels adjacent to the first pixel in the matrix data to generate the continuous region; wherein the first pixel is a pixel corresponding to a value of 1 in the matrix data, the second The value of the pixel in the matrix data is 1.

That is to say, in the matrix data, the value is 1 and the top and bottom left and right coordinates of the coordinate with the value 1 and the pixel position of the upper left, lower right, upper right and lower right are searched, and the adjacent pixel points are found in the matrix data. When the value in all is 1, the position where these pixels are located is set as a continuous area, and the area information is saved.

Step 204: Filter out the area information corresponding to each scene included in the target.

Further, after acquiring the area information corresponding to all the continuous areas, the area information of each scene included in the target to be photographed may be filtered out, and the scenes in the middle target may be identified by the area information.

Step 205: Scan the area information of each scene to obtain the boundary value of each scene, and form the contour information of each scene.

Step 206: Perform area division on the target according to contour information of each scene.

After obtaining the contour information of each scene, the target can be divided according to the contour information, and each scene is an area.

Step 207: Adjust a distance between the image sensor and the target, and obtain an imaging position with the best definition corresponding to each region.

By constantly moving the camera, the user can adjust the distance between the camera and the target. After the distance changes, the corresponding sharpness of each area changes, so that the optimal resolution position corresponding to each area can be obtained. . In this embodiment, after the contours of the respective objects of the target are obtained and divided into regions, the high-frequency data of each region and the region weights are used for the calculation of the sharpness.

Step 208: Extract an area image of the imaging position corresponding to each area.

Step 209: Combine the area images corresponding to each area to obtain a target image of the target.

In order to clearly describe the embodiment, the embodiment further provides a program for executing the above method, the program is as follows:

The camera imaging method provided by the embodiment collects data of an object to be photographed by an image sensor, identifies each scene included in the object from the collected data, and acquires contour information corresponding to each scene, according to contour information of each scene. Divide the target into regions, adjust the distance between the image sensor and the target, obtain the optimal imaging position corresponding to each region, and extract the region image at the imaging position corresponding to each region, corresponding to each region. The area images are merged to obtain the target image of the target. In this embodiment, the target is divided into regions by the contour of the scene, and the clearest region image of each region is taken out of the final image of the synthetic target, so that the final imaging is more clear and sharp, and the scene inside the target can be clearly presented, and finally the focus is successful. The probability becomes larger, effectively reducing the probability of failure of focusing.

Embodiment 3

FIG. 3 is a schematic structural diagram of a camera device according to Embodiment 3 of the present application. The device includes: an acquisition module 11, an identification module 12, a first acquisition module 13, a division module 14 a second acquisition module 15, an extraction module 16, and a merge module 17.

Specifically, the acquisition module 11 is configured to perform data collection on a target to be photographed.

The identification module 12 is configured to identify each scene included in the target from the collected data.

The first obtaining module 13 is configured to acquire contour information corresponding to each scene.

The dividing module 14 is configured to divide the target into regions according to the contour information of each scene.

The second obtaining module 15 is configured to adjust a distance between the image sensor and the target, and obtain an imaging position with the best definition corresponding to each region.

The extracting module 16 is configured to extract an area image on the imaging position corresponding to each area.

The merging module 17 is configured to combine the area images corresponding to each area to obtain a target image of the target.

The function modules of the camera device provided in this embodiment can be used to execute the process of the camera imaging method shown in FIG. 1. The specific working principle is not described again. For details, refer to the description of the method embodiment.

The camera device provided by the embodiment collects data of an object to be photographed by an image sensor, identifies each scene included in the object from the collected data, and acquires contour information corresponding to each scene, according to contour information of each scene. The target is divided into regions, the distance between the image sensor and the target is adjusted, the optimal imaging position corresponding to each region is obtained, and the region image at the imaging position corresponding to each region is extracted, and each region corresponds to The area images are merged to obtain the target image of the target. In this embodiment, the target is divided into regions by the contour of the scene, and the clearest region image of each region is taken out of the final image of the composite target, so that the final image is more clear and sharp, and the scene inside the target can be clearly presented.

Embodiment 4

As shown in FIG. 6 , it is a schematic structural diagram of a camera device according to Embodiment 4 of the present application. The device includes the acquisition module 11 , the identification module 12 , the first acquisition module 13 , and the second acquisition module of the partition module 14 in the third embodiment. 15. Extract module 16 and merge module 17.

The optional implementation structure of the identification module 12 includes: a generating unit 121, an identifying unit 122, and a screening unit 123.

Specifically, the generating unit 121 is configured to perform binarization processing on the collected data according to the set threshold to generate matrix data.

The identifying unit 122 is configured to perform continuity identification on the matrix data and save area information of the continuous area.

The filtering unit 123 is configured to filter out the area information corresponding to each scene included in the target.

Further, the first acquiring module 13 scans the area information of each scene in a specific row to obtain a boundary value of each scene, and forms the contour information of each scene.

Further, the generating unit 121 is specifically configured to compare the binarized data with the threshold, and set the binarized data greater than or equal to the threshold to 1 and to be smaller than Data setting after binarization of the threshold The matrix data is generated for 0.

Further, the identifying unit is specifically configured to find all the second pixel points adjacent to the first pixel point in the matrix data to generate the continuous region; wherein the first pixel point is a value in the matrix data 1 corresponding pixel, the value of the second pixel in the matrix data is 1.

The function modules of the camera device provided in this embodiment can be used to perform the process of the camera imaging method shown in FIG. 1 and FIG. 2, and the specific working principle is not described again. For details, refer to the description of the method embodiment.

The camera device provided by the embodiment collects data of an object to be photographed by an image sensor, identifies each scene included in the object from the collected data, and acquires contour information corresponding to each scene, according to contour information of each scene. The target is divided into regions, the distance between the image sensor and the target is adjusted, the optimal imaging position corresponding to each region is obtained, and the region image at the imaging position corresponding to each region is extracted, and each region corresponds to The area images are merged to obtain the target image of the target. In this embodiment, the target is divided into regions by the contour of the scene, and the clearest region image of each region is taken out of the final image of the composite target, so that the final image is more clear and sharp, and the scene inside the target can be clearly presented. The probability of successful focus is increased, which effectively reduces the probability of failure of focus.

Embodiment 5

FIG. 5 is a schematic structural diagram of still another embodiment of a camera device provided by the present application. As shown in FIG. 5, the camera device of the embodiment of the present application includes a memory 61, one or more processors 62, and one or more programs 63.

The one or more programs 63, when executed by one or more processors 62, perform any of the above-described embodiments.

The camera device of the embodiment of the present invention collects data of a target to be photographed, identifies each scene included in the target from the collected data, acquires contour information corresponding to each scene, and compares the contour information of each scene. The target is divided into regions, and the distance between the lens and the target is adjusted to obtain the best resolution imaging position corresponding to each region. And extracting the image of the area at the imaging position corresponding to each area, and combining the area images corresponding to each area to obtain a target image of the target. In the embodiment of the present application, the region is divided by the scene contour, and the clearest region image in each region is taken out of the final image of the synthetic target, so that the final image is more clear and sharp, and the scene inside the target can be clearly presented.

Embodiment 6

FIG. 6 is a schematic structural diagram of an embodiment of a computer program product for camera imaging provided by the present application. As shown in FIG. 6, the computer program product 71 for camera imaging of the embodiment of the present application may include a signal bearing medium 72. Signal bearing medium 72 may include one or more instructions 73 that, when executed by, for example, a processor, may provide the functionality described above with respect to Figures 1-4. For example, the instructions 73 can include: one or more instructions for data acquisition by the image sensor of the object to be captured; for identifying one or more of the scenes included in the target from the collected data One or more instructions for acquiring contour information corresponding to each scene; one or more instructions for dividing the target according to contour information of each scene; for adjusting the image sensor and the a distance between the targets, one or more instructions for obtaining a sharpest imaged position corresponding to each region; one or more instructions for extracting an image of the region at the imaged position corresponding to each region; And one or more instructions for combining the region images corresponding to each region to obtain a target image of the target. Thus, for example, referring to FIG. 3, the camera device can perform one or more of the steps shown in FIG. 1 in response to instruction 73.

In some implementations, signal bearing medium 72 can include computer readable media 74 such as, but not limited to, a hard disk drive, a compact disk (CD), a digital versatile disk (DVD), a digital tape, a memory, and the like. In some implementations, the signal bearing medium 72 can include a recordable medium 75 such as, but not limited to, a memory, a read/write (R/W) CD, an R/W DVD, and the like. In some implementations, the signal bearing medium 72 can include a communication medium 76 such as, but not limited to, a digital and/or analog communication medium (eg, fiber optic cable, waveguide, wired communication link, wireless communication link, etc.). Thus, for example, computer program product 71 can One or more modules that are transmitted to the identification device of the multi-finger swipe gesture by the RF signal bearing medium 72, wherein the signal bearing medium 72 is transmitted by a wireless communication medium (eg, a wireless communication medium compliant with the IEEE 802.11 standard).

The computer program product of the embodiment of the present invention acquires the position coordinates of the corresponding touch point when the touch operation on the screen of the terminal device is detected, and corrects the position coordinates of the touch point according to the preset correction rule, and the corrected The position coordinates of the touch point are used for report output. The computer program product of the embodiment of the invention ensures that the user accurately triggers the corresponding operation by correcting the screen report point.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

Finally, it should be noted that the above embodiments are only for explaining the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present application. range.

Claims

A camera imaging method, comprising:

Data acquisition by the image sensor to be photographed;

Identifying each scene contained in the target from the collected data;

Obtaining contour information corresponding to each scene;

Dividing the target according to the contour information of each scene;

Adjusting a distance between the image sensor and the target, and obtaining an imaging position with the best definition corresponding to each region;

Extracting an image of the area on the imaging position corresponding to each area;

The area images corresponding to each area are combined to obtain a target image of the target.
The camera imaging method according to claim 1, wherein the acquiring the scenes included in the target from the collected data comprises:

Performing binarization processing on the collected data according to the set threshold to generate matrix data;

Performing continuity identification on the matrix data and storing area information of the continuous area;

The region information corresponding to each scene included in the target is filtered out.
The camera imaging method according to claim 2, wherein the acquiring contour information corresponding to each scene comprises:

The region information of each scene is scanned to obtain the boundary value of each scene, and the contour information of each scene is formed.
The camera imaging method according to claim 3, wherein the binarizing the collected data according to the set threshold to generate matrix data comprises:

Comparing the binarized data with the threshold;

The matrix data is generated by setting the binarized data greater than or equal to the threshold to 1 and the binarized data less than the threshold to 0.
The camera imaging method according to claim 4, wherein the continuously identifying the matrix data and storing the area information of the continuous area comprises:

Finding all second pixel points generated adjacent to the first pixel in the matrix data The continuous area; wherein the first pixel point is a pixel point corresponding to a value of 1 in the matrix data, and the value of the second pixel point in the matrix data is 1.
A camera device, comprising:

An acquisition module for data collection of a target to be photographed;

An identification module, configured to identify, from the collected data, each scene included in the target;

a first acquiring module, configured to acquire contour information corresponding to each scene;

a dividing module, configured to divide the target according to contour information of each scene;

a second acquiring module, configured to adjust a distance between the image sensor and the target, and obtain an imaging position with the best definition corresponding to each region;

Extracting a module, configured to extract an area image of the imaging position corresponding to each area;

And a merging module, configured to merge the area images corresponding to each area to obtain a target image of the target.
The camera device according to claim 6, wherein the identification module comprises:

a generating unit, configured to perform binarization processing on the collected data according to the set threshold, to generate matrix data;

a recognition unit, configured to continuously identify the matrix data and save area information of the continuous area;

a screening unit, configured to filter out the area information corresponding to each scene included in the target.
The camera apparatus according to claim 7, wherein the first acquisition module scans the area information of each scene in a specific row to obtain boundary values of the scenes, and forms the contour information of each scene.
The camera device according to claim 8, wherein the generating unit is specifically configured to compare the binarized data with the threshold and to binarize the threshold greater than or equal to the threshold The processed data is set to 1 and the binarized data smaller than the threshold is set to 0 to generate the matrix data.
The camera device according to claim 9, wherein the identification unit is configured to search for all the second pixels adjacent to the first pixel in the matrix data to generate the continuous region; One pixel is a pixel corresponding to a value of 1 in the matrix data, and the value of the second pixel in the matrix data is 1.