CN110072056B - Data processing method and device based on multiple camera modules - Google Patents
Data processing method and device based on multiple camera modules Download PDFInfo
- Publication number
- CN110072056B CN110072056B CN201910389446.0A CN201910389446A CN110072056B CN 110072056 B CN110072056 B CN 110072056B CN 201910389446 A CN201910389446 A CN 201910389446A CN 110072056 B CN110072056 B CN 110072056B
- Authority
- CN
- China
- Prior art keywords
- resolution
- image
- parameters
- small
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
- H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
Abstract
The invention provides a data processing method and device based on a plurality of camera modules. The data processing method of the plurality of camera modules comprises the following steps: a parameter obtaining step, namely obtaining a large image resolution and one or more small image parameters, wherein the small image parameters comprise a small image resolution, and the small image resolution is lower than the large image resolution; shooting, namely shooting according to the resolution of a large image and the resolution of one or more small images through a plurality of camera modules respectively to obtain a high-resolution material and one or more low-resolution materials, wherein the high-resolution material is a picture or a video with the resolution of the large image, and the low-resolution material is a picture or a video with the resolution of the small images; and a fusion step, namely fusing the low-resolution material into the high-resolution material. The method and the device provided by the invention can realize the picture-in-picture rapidly and efficiently, and simultaneously ensure the quality of each material in the picture-in-picture.
Description
Technical Field
The present invention relates generally to the field of image processing, and more particularly to a data processing method and apparatus based on multiple camera modules.
Background
At present, a plurality of materials are required to be obtained in advance when a picture or a video of a picture-in-picture is obtained, the materials are processed according to the position and the size of the picture-in-picture required to be realized, and one or more low-resolution materials are also displayed in a region fused into a picture-in-picture form, namely a high-resolution material. Such as upsampling and/or downsampling the material. The material processed by the method can meet the scheme of picture-in-picture, but the quality of the material is reduced, the processing time is long, and the task amount is large.
Disclosure of Invention
In order to solve the above problems in the prior art, a first aspect of the present invention provides a data processing method for multiple camera modules, including: a parameter obtaining step, namely obtaining a large image resolution and one or more small image parameters, wherein the small image parameters comprise a small image resolution, and the small image resolution is lower than the large image resolution; shooting, namely shooting according to the resolution of a large image and the resolution of one or more small images through a plurality of camera modules respectively to obtain a high-resolution material and one or more low-resolution materials, wherein the high-resolution material is a picture or a video with the resolution of the large image, and the low-resolution material is a picture or a video with the resolution of the small images; and a fusion step, namely fusing the low-resolution material into the high-resolution material.
In one example, the step of obtaining parameters includes: the method comprises the steps of determining the scene type of at least one camera module through a scene recognition network model based on a shooting scene of the at least one camera module, and obtaining the resolution and/or small picture parameters of a large picture corresponding to the at least one camera module according to the scene type.
In one example, the step of obtaining parameters includes: the method comprises the steps of determining a scene type through a scene recognition network model based on a shooting scene of a camera module, and obtaining resolution of a large image and one or more small image parameters according to the scene type.
In one example, the step of obtaining parameters further comprises: and acquiring the resolution of the large image and one or more small image parameters by receiving a user instruction.
In one example, the thumbnail parameters also include a fusion location; the fusing step further comprises: and fusing the low-resolution material into the high-resolution material according to the fusion position.
In one example, the data processing method based on a plurality of camera modules further includes: and previewing, namely acquiring a high-resolution material and one or more low-resolution materials in real time through a plurality of camera modules according to the high-image resolution and the one or more small-image resolutions respectively based on the large-image resolution and the one or more small-image resolutions after the parameter acquiring step, fusing the one or more low-resolution materials into the high-resolution material based on the fusion position, and previewing.
In one example, the data processing method based on a plurality of camera modules further includes: and a parameter adjusting step, namely adjusting the resolution of the large image and one or more parameters of the small image by receiving a user adjusting instruction.
A second aspect of the present invention provides a photographing apparatus having a plurality of cameras, the photographing apparatus comprising: a processor for executing the data processing method based on the plurality of camera modules according to the first aspect; and the cameras can respectively shoot based on the resolution of the large image and the resolution of one or more small images.
A third aspect of the present invention provides a data processing apparatus based on a plurality of camera modules, the apparatus comprising: the parameter acquisition module is used for acquiring a large image resolution and one or more small image parameters, wherein the small image parameters comprise a small image resolution, and the small image resolution is lower than the large image resolution; the shooting module is used for shooting according to the resolution of the large image and the resolution of one or more small images through the plurality of camera modules respectively to obtain a high-resolution material and one or more low-resolution materials, wherein the high-resolution material is a picture or a video with the resolution of the large image, and the low-resolution material is a picture or a video with the resolution of the small image; and the fusion module is used for fusing the low-resolution material into the high-resolution material.
A fourth aspect of the present invention provides an electronic apparatus comprising: a memory to store instructions; and the processor is used for calling the instructions stored in the memory to execute the data processing method based on the plurality of camera modules in the first aspect.
A fifth aspect of the present invention provides a computer-readable storage medium, in which instructions are stored, and when executed by a processor, the method for processing data based on multiple camera modules according to the first aspect is performed.
According to the data processing method and device based on the multiple camera modules, parameters are obtained in advance, the multiple cameras shoot according to different parameters respectively, materials are obtained and then fused, picture-in-picture can be achieved rapidly and efficiently, and meanwhile the quality of each material in the picture-in-picture is guaranteed.
Drawings
The above and other objects, features and advantages of embodiments of the present invention will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the invention are illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which:
fig. 1 is a schematic flow chart illustrating a data processing method based on a plurality of camera modules according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a picture-in-picture material obtained by the data processing method based on multiple camera modules according to the present invention;
FIG. 3 is a flow chart illustrating a data processing method based on a plurality of camera modules according to another embodiment of the present invention;
fig. 4 is a schematic flow chart illustrating a data processing method based on a plurality of camera modules according to another embodiment of the present invention;
FIG. 5 is a schematic diagram of a data processing apparatus based on a plurality of camera modules according to an embodiment of the present invention;
fig. 6 is a schematic diagram of an electronic device according to an embodiment of the present invention.
In the drawings, the same or corresponding reference numerals indicate the same or corresponding parts.
Detailed Description
The principles and spirit of the present invention will be described with reference to a number of exemplary embodiments. It is understood that these embodiments are given solely for the purpose of enabling those skilled in the art to better understand and to practice the invention, and are not intended to limit the scope of the invention in any way.
It should be noted that although the expressions "first", "second", etc. are used herein to describe different modules, steps, data, etc. of the embodiments of the present invention, the expressions "first", "second", etc. are merely used to distinguish between different modules, steps, data, etc. and do not indicate a particular order or degree of importance. Indeed, the terms "first," "second," and the like are fully interchangeable.
Fig. 1 shows a data processing method 100 based on multiple camera modules according to an embodiment of the present invention, as shown in fig. 1, where the method includes: acquiring parameters 110, shooting 120 and fusing 130. The above steps are explained in detail below.
The parameter obtaining step 110 obtains a resolution of a large image and one or more parameters of a small image, wherein the parameters of the small image comprise a resolution of the small image, and the resolution of the small image is lower than the resolution of the large image. In one example, a main camera and one or more auxiliary cameras can be included, wherein a large image resolution is used for the main camera, and high-resolution materials are obtained through the main camera, namely when picture-in-picture is generated, the materials become the background of the picture-in-picture; one or more small image parameters are correspondingly applied to one or more auxiliary cameras, and the auxiliary cameras directly acquire the material of the resolution ratio according to the resolution ratio of the small images, namely when the picture-in-picture is generated, the material becomes the foreground of the picture-in-picture. In one example, each parameter may be set to a default value, and the default value may be directly obtained, and the default value may be set reasonably by combining pixel values and positions of a plurality of cameras. In one example, the obtaining parameters step 110 can include: the method comprises the steps of determining the scene type of at least one camera module through a scene recognition network model based on a shooting scene of the at least one camera module, and obtaining the resolution and/or small picture parameters of a large picture corresponding to the at least one camera module according to the scene type. Wherein the scene can be a building, a square, a room, a portrait, a pet, a microspur, and the like. Under different scenes, scene recognition can be carried out according to scenes and scenes obtained by the cameras required to be started, large image resolution and/or small image parameters corresponding to the cameras and the scene types are obtained according to different scene types, wherein the large image resolution and the small image parameters corresponding to the different scene types can be preset, and after the scene types are determined through recognizing the network model, the large image resolution and the small image parameters can be directly obtained according to the preset settings and are used for the corresponding cameras. If the scene is acquired as a square through the rear camera (namely the main camera) of the mobile phone, and after the scene is determined through the scene recognition network model, the preset large image resolution corresponding to the square is acquired and used for the rear camera of the mobile phone; if the scene is also acquired as a portrait through the front camera (namely the auxiliary camera) of the mobile phone, and after the scene is determined through the scene recognition network model, the small image parameters corresponding to the preset portrait are acquired and used for the front camera of the mobile phone. Therefore, different parameters can be obtained according to different shooting conditions and requirements, and a more suitable picture-in-picture effect is obtained.
In another example, the obtaining parameters step 110 may include: the method comprises the steps of determining a scene type through a scene recognition network model based on a shooting scene of a camera module, and obtaining resolution of a large image and one or more small image parameters according to the scene type. In the embodiment, the scene acquired by one camera is judged and the scene type is determined, and the large image resolution and the small image parameters required by all camera modules are acquired according to the determined scene type, so that appropriate parameter information can be quickly acquired, and the picture-in-picture effect is improved.
In yet another example, the step of obtaining parameters may include: and acquiring the resolution of the large image and one or more small image parameters by receiving a user instruction. And corresponding parameters can be obtained through the setting of a user.
And a shooting step 120, in which the plurality of camera modules respectively shoot according to the resolution of the large image and the resolution of one or more small images to obtain a high-resolution material and one or more low-resolution materials, wherein the high-resolution material is a picture or a video with the resolution of the large image, and the low-resolution material is a picture or a video with the resolution of the small image. Based on the obtained parameters, including the resolution of the large image and the parameters of the small image, each parameter is distributed to different camera modules, and each camera module only collects materials according to one parameter, so that the materials with the required resolution are directly obtained, the quality is ensured, and the picture-in-picture display can be efficiently completed.
A fusion step 130, fusing the low resolution material into the high resolution material. Because shooting is carried out according to different parameters, and the obtained material resolution is preset, the low-resolution material can be directly fused into the high-resolution material, the low-resolution material can be directly copied into the high-resolution material area for fusion, and the low-resolution material can also be fused in a linear or nonlinear mode.
As fig. 2 schematically shows the fused pip materials, the above embodiment can reduce the amount of computation for completing the pip task, shorten the time, and improve the quality.
In one example, the thumbnail parameters also include a fusion location; the fusing step 130 further includes: and fusing the low-resolution material into the high-resolution material according to the fusion position. When the parameters are obtained, the fusion position information is obtained, the position of the low-resolution material fused to the high-resolution material is determined, the position can be set according to a user or can be a default value, and in one example, the position can be determined according to the scene type, so that a better picture-in-picture effect can be obtained in different scenes. The position information may be the coordinates of the center of the low resolution material in the high resolution material or the coordinates of one of the angular vertices. And during fusion, fusing the acquired low-resolution material into the high-resolution material according to the corresponding position of the low-resolution material.
Fig. 3 shows a data processing method 100 based on multiple camera modules according to another embodiment of the present invention, and as shown in fig. 3, the data processing method 100 based on multiple camera modules further includes: and a previewing step 140, after the parameter obtaining step 110, acquiring a high-resolution material and one or more low-resolution materials in real time through the plurality of camera modules according to the high-resolution and one or more small-image resolutions respectively based on the high-resolution and one or more small-image resolutions, fusing the one or more low-resolution materials into the high-resolution material based on the fusion position, and previewing. Through preview, the effect realized by real-time picture-in-picture can be conveniently seen, and parameters can be conveniently modified or reference can be provided for actual shooting.
Fig. 4 shows a data processing method 100 based on multiple camera modules according to another embodiment of the present invention, and as shown in fig. 4, the data processing method 100 based on multiple camera modules further includes: a parameter adjustment step 150, which adjusts the resolution of the large graph and one or more parameters of the small graph by receiving a user adjustment instruction. In an example, the parameter adjusting step 150 may be performed after the previewing step 140, and after receiving the preview information, the user may visually see the effect of the picture-in-picture presentation, adjust the resolution of the large picture and the parameters of the small picture according to the preview, adjust the size of the picture, adjust the size and/or the position of the low resolution material, and perform adjustment according to the preview effect, so that the shooting result is more satisfactory. In another example, the parameter adjusting step 150 may also be performed after the parameter obtaining step 110, and after the relevant parameters are obtained through scene recognition, the user may adjust the parameters according to the requirement. .
One embodiment of the present invention provides a photographing apparatus having a plurality of cameras, the photographing apparatus including: the processor executes the data processing method based on the plurality of camera modules according to any one of the embodiments; and the cameras can respectively shoot based on the resolution of the large image and the resolution of one or more small images. The existing image acquisition equipment, such as a mobile phone, is often configured with a plurality of cameras, and by the data processing method based on a plurality of camera modules according to the foregoing embodiment, a plurality of cameras can shoot according to different resolutions at the same time, so that materials with different resolutions can be obtained at high quality, and further, pip materials can be obtained efficiently.
The following description is given for illustrative purposes of the present invention.
User starting, system loading parameters: the fusion position of the large-image resolution and each low-resolution material i in the high-resolution material takes a fusion central point p (xi, yi) as an example; under different scenes, the user can adjust corresponding parameters by himself according to the resolution i (wi, hi).
And (3) opening the main camera by using image acquisition equipment such as a mobile phone camera to acquire a preview data frame.
And inputting the preview data frame into a scene recognition network model, and carrying out scene recognition on the preview data frame by the scene recognition network model to acquire scene information of the current scene, such as squares, buildings, portraits, pets, microspurs and the like.
And acquiring parameters recommended by the current scene from default parameters according to the scene information.
The image acquisition equipment, like the cell-phone camera, opens a plurality of camera modules simultaneously, every camera module simultaneously according to the preview resolution ratio size of acquireing and opens the preview video stream, acquires the preview data.
The user shoots at a certain moment, and each camera module simultaneously captures the image of the current scene, namely module 1 captures the image according to resolution 1(w1, h1), module 2 captures the image according to resolution 2(w2, h2), …, and module i captures the image according to resolution i (wi, hi).
According to the fusion center point p (xi, yi) of the low-resolution material i in the high-resolution material, calculating the fusion area of the low-resolution material in the high-resolution material:
calculating a fused upper left vertex LeftTop (x _ i, y _ i), wherein x _ i is xi-wi/2; y _ i is yi-hi/2.
Calculating a fused region Rect _ i (x _ i, y _ i, w, h), wherein x _ i is xi-wi/2; y _ i is yi-hi/2; w ═ wi; h ═ hi.
Linearly fusing each low-resolution material i into a high-resolution material according to the fusion area Rect _ i in the step 9, specifically:
for(x＝x_i；x<x_i+w；x++)；
for(y＝y_i；y<x_i+w；x++)；
dst (x, y) ═ Image1(x, y) × ratio1+ Image2(x, y) × ratio2+ …; wherein, ratio is a fusion coefficient and can include the brightness, color, transparency and the like of the material.
The picture-in-picture processing is completed and the picture-in-picture processing result Dst (x, y) is stored and displayed to the user.
Fig. 5 shows a data processing apparatus 200 based on multiple camera modules according to an embodiment of the present invention, and as shown in fig. 5, the data processing apparatus 200 based on multiple camera modules includes: an obtaining parameter module 210, configured to obtain a resolution of a large graph and one or more parameters of a small graph, where the parameters of the small graph include a resolution of the small graph, and the resolution of the small graph is lower than the resolution of the large graph; the shooting module 220 is configured to shoot through the multiple camera modules according to a large image resolution and one or more small image resolutions respectively to obtain a high resolution material and one or more low resolution materials, where the high resolution material is a picture or a video with the large image resolution, and the low resolution material is a picture or a video with the small image resolution; and a fusion module 230, configured to fuse the low-resolution material into the high-resolution material.
In one example, the parameter obtaining module 210 is further configured to: the method comprises the steps of determining the scene type of at least one camera module through a scene recognition network model based on a shooting scene of the at least one camera module, and obtaining the resolution and/or small picture parameters of a large picture corresponding to the at least one camera module according to the scene type.
In one example, the parameter obtaining module 210 is further configured to: the method comprises the steps of determining a scene type through a scene recognition network model based on a shooting scene of a camera module, and obtaining resolution of a large image and one or more small image parameters according to the scene type.
In one example, the parameter obtaining module 210 is further configured to: and acquiring the resolution of the large image and one or more small image parameters by receiving a user instruction.
In one example, the thumbnail parameters also include a fusion location; the fusion module 230 is further configured to: and fusing the low-resolution material into the high-resolution material according to the fusion position.
In one example, the data processing apparatus 200 based on a plurality of camera modules further includes: and the preview module is used for acquiring video streams in real time according to the resolution of the large image and the resolution of one or more small images through a plurality of camera modules respectively based on the resolution of the large image and the resolution of one or more small images after the resolution of the large image and the parameters of one or more small images are acquired, and previewing the acquired video streams after the acquired video streams are fused.
In one example, the data processing apparatus 200 based on a plurality of camera modules further includes: and the parameter adjusting module is used for adjusting the resolution of the large image and one or more small image parameters by receiving a user adjusting instruction after previewing.
As shown in fig. 6, one embodiment of the invention provides an electronic device 300. The electronic device 300 includes a memory 301, a processor 302, and an Input/Output (I/O) interface 303. The memory 301 is used for storing instructions. And the processor 302 is used for calling the instructions stored in the memory 301 to execute the data processing method based on the multiple camera modules according to the embodiment of the invention. The processor 302 is connected to the memory 301 and the I/O interface 303, respectively, for example, via a bus system and/or other connection mechanism (not shown). The memory 301 may be used to store programs and data, including programs of the data processing method based on a plurality of camera modules according to the embodiment of the present invention, and the processor 302 executes various functional applications and data processing of the electronic device 300 by running the programs stored in the memory 301.
In an embodiment of the present invention, the processor 302 may be implemented in at least one hardware form of a Digital Signal Processor (DSP), a Field-Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), and the processor 302 may be one or a combination of several Central Processing Units (CPUs) or other forms of Processing units with data Processing capability and/or instruction execution capability.
In the embodiment of the present invention, the I/O interface 303 may be used to receive input instructions (e.g., numeric or character information, and generate key signal inputs related to user settings and function control of the electronic device 300, etc.), and may also output various information (e.g., images or sounds, etc.) to the outside. The I/O interface 303 may comprise one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a mouse, a joystick, a trackball, a microphone, a speaker, a touch panel, and the like.
It is to be understood that while operations are depicted in the drawings in a particular order, this is not to be understood as requiring that such operations be performed in the particular order shown or in serial order, or that all illustrated operations be performed, to achieve desirable results. In certain environments, multitasking and parallel processing may be advantageous.
The methods and apparatus of embodiments of the present invention can be accomplished using standard programming techniques with rule-based logic or other logic to accomplish the various method steps. It should also be noted that the words "means" and "module," as used herein and in the claims, is intended to encompass implementations using one or more lines of software code, and/or hardware implementations, and/or equipment for receiving inputs.
Any of the steps, operations, or procedures described herein may be performed or implemented using one or more hardware or software modules, alone or in combination with other devices. In one embodiment, the software modules are implemented using a computer program product comprising a computer readable medium containing computer program code, which is executable by a computer processor for performing any or all of the described steps, operations, or procedures.
The foregoing description of the implementation of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and modifications and variations are possible in light of the above teachings or may be acquired from practice of the invention. The embodiments were chosen and described in order to explain the principles of the invention and its practical application to enable one skilled in the art to utilize the invention in various embodiments and with various modifications as are suited to the particular use contemplated.
Claims (9)
1. A data processing method based on a plurality of camera modules, wherein the camera modules comprise a main camera and one or more auxiliary cameras, and the method comprises the following steps:
a parameter obtaining step, obtaining a large image resolution and one or more small image parameters, wherein the small image parameters comprise a small image resolution, and the small image resolution is lower than the large image resolution;
a shooting step, wherein each parameter is distributed to different camera modules based on the obtained parameters, and the parameters comprise the resolution of the large image and the resolution of the small image; shooting through a plurality of camera modules according to the large image resolution and one or more small image resolutions respectively to obtain a high-resolution material and one or more low-resolution materials, wherein the large image resolution is used for the main camera, the high-resolution material is obtained through the main camera, the one or more small image parameters are correspondingly used for the one or more auxiliary cameras, and the auxiliary cameras directly obtain the low-resolution materials according to the small image resolutions; the high-resolution material is a picture or a video with the resolution of the large picture, and the low-resolution material is a picture or a video with the resolution of the small picture;
a fusion step, directly fusing the low-resolution material into the high-resolution material, wherein the fusion is carried out in a mode of directly copying the low-resolution material into the high-resolution material region, or in a linear or nonlinear mode;
wherein, the obtaining a resolution of the large image and one or more parameters of the small image comprises:
determining the scene type of at least one camera module through a scene recognition network model based on the shooting scene of at least one camera module, and acquiring the large image resolution and/or the small image parameters corresponding to at least one camera module according to the scene type;
or based on the shooting scene of one camera module, determining the scene type through a scene recognition network model, and acquiring the resolution of the large image and the one or more small image parameters according to the scene type.
2. The method of claim 1, wherein the obtaining parameters step comprises: and acquiring the resolution of the large image and the one or more small image parameters by receiving a user instruction.
3. The method of claim 1 or 2, wherein the thumbnail parameters further comprise a fusion location;
the fusing step comprises: and fusing the low-resolution material into the high-resolution material according to the fusion position.
4. The method of claim 3, wherein the method further comprises: and previewing, namely acquiring a high-resolution material and one or more low-resolution materials in real time through a plurality of camera modules according to the large-image resolution and one or more small-image resolutions respectively based on the large-image resolution and the one or more small-image resolutions after the parameter acquiring step, fusing the one or more low-resolution materials into the high-resolution material based on the fusion position, and previewing.
5. The method of claim 1 or 4, wherein the method further comprises: and a parameter adjusting step, namely adjusting the resolution of the large image and the one or more small image parameters by receiving a user adjusting instruction.
6. A photographing apparatus having a plurality of cameras, wherein the photographing apparatus comprises:
a processor for executing the data processing method based on a plurality of camera modules according to any one of claims 1 to 5;
and the cameras can respectively shoot on the basis of the large image resolution and one or more small image resolutions.
7. A data processing apparatus based on a plurality of camera modules, wherein, a plurality of camera modules include a main camera and one or more supplementary cameras, the apparatus includes:
the parameter acquisition module is used for acquiring a large image resolution and one or more small image parameters, wherein the small image parameters comprise a small image resolution, and the small image resolution is lower than the large image resolution;
the shooting module is used for distributing each parameter to different camera modules based on the obtained parameters including the large image resolution and the small image parameters, and each camera module only collects materials according to one parameter so as to directly obtain the materials with the required resolution; shooting through a plurality of camera modules according to the large image resolution and one or more small image resolutions respectively to obtain a high-resolution material and one or more low-resolution materials, wherein the large image resolution is used for the main camera, the high-resolution material is obtained through the main camera, the one or more small image parameters are correspondingly used for the one or more auxiliary cameras, and the auxiliary cameras directly obtain the low-resolution materials according to the small image resolutions; the high-resolution material is a picture or a video with the resolution of the large picture, and the low-resolution material is a picture or a video with the resolution of the small picture;
the fusion module is used for directly fusing the low-resolution material into the high-resolution material, and comprises the step of fusing the low-resolution material in a mode of directly copying the low-resolution material into the high-resolution material area, or fusing the low-resolution material in a linear or nonlinear mode;
wherein, the obtaining a resolution of the large image and one or more parameters of the small image comprises:
determining the scene type of at least one camera module through a scene recognition network model based on the shooting scene of at least one camera module, and acquiring the large image resolution and/or the small image parameters corresponding to at least one camera module according to the scene type;
or based on the shooting scene of one camera module, determining the scene type through a scene recognition network model, and acquiring the resolution of the large image and the one or more small image parameters according to the scene type.
8. An electronic device, wherein the electronic device comprises:
a memory to store instructions; and
a processor for calling the instructions stored in the memory to execute the data processing method based on multiple camera modules according to any one of claims 1 to 5.
9. A computer-readable storage medium having stored therein instructions which, when executed by a processor, perform the method for data processing based on a plurality of camera modules according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910389446.0A CN110072056B (en) | 2019-05-10 | 2019-05-10 | Data processing method and device based on multiple camera modules |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910389446.0A CN110072056B (en) | 2019-05-10 | 2019-05-10 | Data processing method and device based on multiple camera modules |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110072056A CN110072056A (en) | 2019-07-30 |
| CN110072056B true CN110072056B (en) | 2022-02-01 |
Family
ID=67370459
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910389446.0A Active CN110072056B (en) | 2019-05-10 | 2019-05-10 | Data processing method and device based on multiple camera modules |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110072056B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111147779B (en) * | 2019-12-31 | 2022-07-29 | 维沃移动通信有限公司 | Video production method, electronic device, and medium |
| CN112565589B (en) * | 2020-11-13 | 2023-03-31 | 北京爱芯科技有限公司 | Photographing preview method and device, storage medium and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101720027A (en) * | 2009-11-27 | 2010-06-02 | 西安电子科技大学 | Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera |
| CN104010135A (en) * | 2013-02-26 | 2014-08-27 | 三星电子株式会社 | Apparatus and method for photographing image |
| CN105141833A (en) * | 2015-07-20 | 2015-12-09 | 努比亚技术有限公司 | Terminal photographing method and device |
| CN105391866A (en) * | 2015-11-30 | 2016-03-09 | 东莞酷派软件技术有限公司 | Terminal and shooting method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107509029A (en) * | 2013-01-07 | 2017-12-22 | 华为技术有限公司 | A kind of image processing method and device |
-
2019
- 2019-05-10 CN CN201910389446.0A patent/CN110072056B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101720027A (en) * | 2009-11-27 | 2010-06-02 | 西安电子科技大学 | Method for cooperative acquisition of multi-target videos under different resolutions by variable-focus array camera |
| CN104010135A (en) * | 2013-02-26 | 2014-08-27 | 三星电子株式会社 | Apparatus and method for photographing image |
| CN105141833A (en) * | 2015-07-20 | 2015-12-09 | 努比亚技术有限公司 | Terminal photographing method and device |
| CN105391866A (en) * | 2015-11-30 | 2016-03-09 | 东莞酷派软件技术有限公司 | Terminal and shooting method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110072056A (en) | 2019-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6970283B2 (en) | Image stitching method and device, storage medium | |
| US10284789B2 (en) | Dynamic generation of image of a scene based on removal of undesired object present in the scene | |
| US9013592B2 (en) | Method, apparatus, and computer program product for presenting burst images | |
| WO2018058934A1 (en) | Photographing method, photographing device and storage medium | |
| JP2009193421A (en) | Image processing device, camera device, image processing method, and program | |
| EP2872963B1 (en) | Abstract camera pipeline for uniform cross-device control of image capture and processing | |
| CN109688321B (en) | Electronic equipment, image display method thereof and device with storage function | |
| TWI766067B (en) | Multi-camera post-capture image processing method, system, and non-transitory computer-readable medium | |
| US20140184646A1 (en) | Image processor and fisheye image display method thereof | |
| US20130076941A1 (en) | Systems And Methods For Editing Digital Photos Using Surrounding Context | |
| CN108665415B (en) | Image quality improving method and device based on deep learning | |
| US10726524B2 (en) | Low-resolution tile processing for real-time bokeh | |
| CN110072056B (en) | Data processing method and device based on multiple camera modules | |
| CN111107267A (en) | Image processing method, device, equipment and storage medium | |
| CN112637515A (en) | Shooting method and device and electronic equipment | |
| US9357125B2 (en) | Method and apparatus of displaying portrait on display | |
| JP6541501B2 (en) | IMAGE PROCESSING APPARATUS, IMAGING APPARATUS, AND IMAGE PROCESSING METHOD | |
| KR20110090098A (en) | Apparatus for processing digital image and thereof method | |
| JP2013157842A (en) | Image reproduction device | |
| CN112887624B (en) | Shooting method and device and electronic equipment | |
| WO2017145483A1 (en) | Image processing device, image processing system, and program | |
| CN113489920A (en) | Video synthesis method and device and electronic equipment | |
| KR20130024021A (en) | Digital photographing apparatus and control method thereof | |
| WO2016101426A1 (en) | Photographing method and apparatus | |
| JP6668646B2 (en) | Image processing apparatus, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |