WO2019179230A1

WO2019179230A1 - Raw image-based panorama stitching method and electronic device

Info

Publication number: WO2019179230A1
Application number: PCT/CN2019/072504
Authority: WO
Inventors: 陈聪; 尹程龙
Original assignee: 深圳岚锋创视网络科技有限公司
Priority date: 2018-03-22
Filing date: 2019-01-21
Publication date: 2019-09-26
Also published as: CN108550110B; CN108550110A

Abstract

The present invention provides a RAW image-based panorama stitching method and an electronic device, said method comprising: acquiring at least two RAW images; decomposing each of the RAW images into an R image, a G image, and a B image per color channel; stitching the R images, the G images, and the B images into a panoramic R image, a panoramic G image, and a panoramic B image, respectively; and according to R, B, G data arrangements in the RAW format, indexing pixel values on the corresponding panoramic R image, panoramic G image, and panoramic B image, so as to obtain a stitched panoramic image in the RAW format. Hence, the present invention can obtain a panoramic image in the RAW format, allowing for a broader room for post image processing, solving the problem of great limitations on post processing for RGB image-based panorama stitching.

Description

Panorama stitching method based on RAW image and electronic device

Technical field

The invention belongs to the field of panoramic images, and in particular relates to a panoramic stitching method based on RAW images and an electronic device.

Background technique

With the development of technology, the application of panoramic images is becoming more and more popular, and panoramic images can provide 360-degree panoramic images, giving users an immersive experience.

A RAW image is the raw data of a CMOS or CCD image sensor that converts the captured light source signal into a digital signal and is unprocessed. In contrast, RGB images are processed through lossy compression, and image details are much less detailed than RAW images. Therefore, RAW images are processed in the post-processing, such as adding and subtracting exposure, adjusting highlights/shadows, increasing and decreasing contrast, and adjusting color gradations and curves.

However, the current panoramic images are generally based on RGB image stitching. It can be seen that the panoramic stitching based on RGB images has a large limitation in post processing.

technical problem

An object of the present invention is to provide a RAW image-based panoramic splicing method, a computer readable storage medium, and an electronic device, which aim to solve the problem that the RGB image-based panoramic splicing has a large limitation in post processing.

Technical solution

In a first aspect, the present invention provides a RAW image-based panoramic splicing method, the method comprising:

Obtain at least two RAW images;

Decompose each RAW image into an R image, a G image, and a B image by color channels;

Splicing the R image, the G image, and the B image into a panoramic R image, a panoramic G image, and a panoramic B image, respectively;

According to the R, G, and B data arrangement of the RAW format, the index corresponds to the pixel value on the panoramic R image, the panoramic G image, and the panoramic B image, thereby obtaining the stitched RAW format panoramic image.

In a second aspect, the present invention provides a computer readable storage medium storing a computer program, the computer program being executed by a processor to implement steps of a RAW image-based panoramic stitching method as described above .

In a third aspect, the present invention provides an electronic device comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and It is configured to be executed by the one or more processors that, when executing the computer program, implement the steps of the RAW image-based panoramic stitching method as described above.

Beneficial effect

In the present invention, at least two RAW images are acquired; each RAW image is decomposed into an R image, a G image, and a B image by a color channel; and the R image, the G image, and the B image are respectively spliced into a panoramic R image, a panoramic G image and a panoramic B image; the splicing module is further configured to arrange R, G, and B data according to the RAW format, and index corresponding pixel values on the panoramic R image, the panoramic G image, and the panoramic B image, thereby obtaining the spliced RAW format panoramic image. It can be seen that the RAW panoramic image can be obtained by the invention, so that the image post-processing has more space, and the problem that the RGB image-based panoramic splicing has a large limitation in post-processing is avoided.

DRAWINGS

FIG. 1 is a flowchart of a RAW image-based panoramic stitching method according to Embodiment 1 of the present invention.

2 is a diagram showing an example of an exploded RAW image according to Embodiment 1 of the present invention.

3 is a block diagram showing a specific structure of an electronic device according to Embodiment 3 of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In order to explain the technical solution described in the present invention, the following description will be made by way of specific embodiments.

Embodiment 1:

Referring to FIG. 1 , a RAW image-based panoramic splicing method according to Embodiment 1 of the present invention includes the following steps: It should be noted that, if substantially the same result is obtained, the RAW image-based panoramic splicing method of the present invention is not illustrated. The sequence of processes shown in 1 is limited.

S101. Acquire at least two RAW images.

One method of obtaining a panoramic image is to splicing a series of photos with overlapping regions into a panoramic image, so that at least two RAW images need to be acquired for splicing of the panoramic images.

A RAW image is a raw data in which a CMOS or CCD image sensor converts a captured light source signal into a digital signal. A RAW image is a file that records the original information of a digital camera sensor and records some metadata (Metadata such as ISO settings, shutter speed, aperture value, white balance, etc.) generated by the camera. Therefore, in the post processing of images, RAW has more processing space than other formats.

S102. Decompose each RAW image into an R image, a G image, and a B image according to a color channel;

A RAW image has only one color channel, or an R channel or a G channel or a B channel. Since a pixel has only one color channel, it needs to be interpolated (filled) by the color around the pixel. Taking the RAW image in the GR/BG format as an example, the decomposition of the R image, the G image, and the B image is as shown in FIG. 2 . It can be understood that FIG. 2 is only an example in which the RAW image is decomposed into an R image, a G image, and a B image, and is not intended to limit the present invention.

It should also be noted that the number of bits of the R image, the G image, and the B image coincides with the RAW data. The number of bits is the pixel of the image, and the number of bits of the RAW image acquired in step S101 is how many bits of the R image, the G image, and the B image are decomposed by the RAW image.

S103. Splicing the R image, the G image, and the B image into a panoramic R image, a panoramic G image, and a panoramic B image, respectively;

Specifically, at least two RAW images that are used for splicing into a panoramic image are spliced into a panoramic R image, and the respective decomposed G images are spliced into a panoramic G image, and the respective decomposed B images are spliced into a panoramic B image.

It should be noted that the internal parameters, the external parameters, and the distortion parameters of each of the RAW images may be acquired first, and then the R image, the G image, and the B image are respectively spliced according to the internal parameter, the external parameter, and the distortion parameter. Panoramic R image, panoramic G image, and panoramic B image.

S104. According to the R, G, and B data arrangement of the RAW format, the index corresponds to the pixel value on the panoramic R image, the panoramic G image, and the panoramic B image, thereby obtaining the stitched RAW format panoramic image.

Specifically, according to the R, G, and B data arrangement of the RAW format, the value of the R channel in the RAW format is indexed in the panoramic R image, and the value of the G channel in the RAW format is indexed in the panoramic G image, The value of the B channel in the RAW format is indexed in the panoramic B image, thereby being stitched into a panoramic image in the RAW format.

In the present invention, at least two RAW images are acquired; each RAW image is decomposed into an R image, a G image, and a B image by a color channel; and the R image, the G image, and the B image are respectively spliced into a panoramic R image, The panoramic G image and the panoramic B image; according to the R, G, and B data arrangement of the RAW format, the index corresponds to the pixel value on the panoramic R image, the panoramic G image, and the panoramic B image, thereby obtaining the stitched RAW format panoramic image. It can be seen that the RAW panoramic image can be obtained by the invention, so that the image post-processing has more space, and the problem that the RGB image-based panoramic splicing has a large limitation in post-processing is avoided.

Embodiment 2:

The second embodiment of the present invention provides a computer readable storage medium, where the computer readable storage medium stores a computer program, and when the computer program is executed by the processor, the RAW image based panorama provided by the first embodiment of the present invention is implemented. The steps of the stitching method.

Embodiment 3:

3 is a block diagram showing a specific structure of an electronic device according to Embodiment 3 of the present invention. An electronic device 100 includes: one or more processors 101, a memory 102, and one or more computer programs, wherein the processor 101 and the memory 102 are connected by a bus, the one or more computer programs being stored in the memory 102 and configured to be executed by the one or more processors 101, the processor 101 executing The steps of the RAW image-based panoramic stitching method provided by the first embodiment of the present invention are implemented in the description of the computer program.

A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Read Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. Within the scope.

Claims

A RAW image-based panoramic splicing method, the method comprising:

Obtain at least two RAW images;

Decompose each RAW image into an R image, a G image, and a B image by color channels;

Splicing the R image, the G image, and the B image into a panoramic R image, a panoramic G image, and a panoramic B image, respectively;

According to the R, G, and B data arrangement of the RAW format, the index corresponds to the pixel value on the panoramic R image, the panoramic G image, and the panoramic B image, thereby obtaining the stitched RAW format panoramic image.
The method of claim 1 wherein the method further comprises:

Obtaining internal parameters, external parameters, and distortion parameters of each of the RAW images;

The splicing the R image, the G image, and the B image into a panoramic R image, a panoramic G image, and a panoramic B image:

The R image, the G image, and the B image are respectively spliced into a panoramic R image, a panoramic G image, and a panoramic B image according to the internal parameter, the external parameter, and the distortion parameter.
The method according to claim 1, wherein the R, G, and B data are arranged according to a RAW format, and the index corresponds to a pixel value on the panoramic R image, the panoramic G image, and the panoramic B image, thereby obtaining a stitched image. RAW format panoramic images include:

Indexing the R channel in the RAW format in the panoramic R image according to the R, G, B data arrangement of the RAW format, and indexing the value of the G channel in the RAW format in the panoramic G image, in the panoramic B image The index of the B channel in the RAW format is indexed, thereby obtaining a mosaic RAW format panoramic image.
The method according to any one of claims 1 to 3, wherein the number of bits of the R image, the G image, and the B image is identical to the RAW data.
A computer readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the RAW image based method according to any one of claims 1 to 4. The steps of the panorama stitching method.
An electronic device comprising: one or more processors; a memory; and one or more computer programs, wherein the one or more computer programs are stored in the memory and configured to be Executing a plurality of processors, the step of implementing the RAW image-based panoramic stitching method according to any one of claims 1 to 4 when the processor executes the computer program.