WO2012034542A1

WO2012034542A1 - Co-optical center camera, image processing device and device

Info

Publication number: WO2012034542A1
Application number: PCT/CN2011/079834
Authority: WO
Inventors: 刘源
Original assignee: 华为终端有限公司
Priority date: 2010-09-19
Filing date: 2011-09-19
Publication date: 2012-03-22
Also published as: CN101980080A; CN101980080B

Abstract

A co-optical center camera. The camera comprises: a prism (10) having a plurality of reflective surfaces (100) each having a polarizing film (101) adhered thereon, the reflective surfaces of the prism being used for reflecting incident light passing through the polarizing film, thus reflecting polarized light, the polarization direction of the film on each reflective surface being different from the polarization direction of the film on any adjacent reflective surface; a plurality of camera devices (20), corresponding respectively to each reflective surface of the prism, a polarizer (201) being arranged in front of the lens (200) of each camera device. The plurality of camera devices are used to acquire, after polarization processing by the polarizers, the polarized light reflected by each reflective surface of the prism. The polarization direction of the polarizer in front of the lens of each camera device is identical to the polarization direction of the corresponding polarization film on the respective reflective surface of the prism. Also provided are an image-processing method and device.

Description

Common optical camera, image processing method and device

This application claims priority to Chinese Patent Application No. 201010290495.8, entitled "Co-optical camera, image processing method and device", which is filed on September 19, 2010, the entire contents of which are incorporated by reference. In this application. Technical field

The present invention relates to the field of information processing technologies, and in particular, to a common optical center camera, an image processing method and apparatus. Background technique

Telepresence is a video conferencing system that creates a virtual meeting environment. Telepresence has many advantages over traditional video conferencing systems, including: Telepresence can present life-size images, showing participants smooth motion, precise limbs Behavior and eyes fully reflect the human factors of the participants, making the participants feel as if they are communicating face to face with each other and improve user satisfaction.

One of the key technologies for creating a Telepresence system is how to get a panoramic image of the venue. The current Telepresence system uses multiple cameras to capture scene images in parallel or in a concentrated manner. However, since the camera's optical center is inside the camera, the position of the camera cannot be placed so that the optical distance between the two cameras is B. 0, and the parallax of the image is related to the distance between the optical center and the depth of field. Therefore, the image obtained in this way has parallax between the overlapping portions, so that the image taken by the plurality of cameras in parallel or in a concentrated manner cannot be certain. Multiple images of the scene depth range are stitched into a panoramic image.

In order to obtain a seamlessly stitched panoramic image, the prior art adopts a common optical center camera, and the common optical center camera adopts a reflective prism, so that the camera shooting prism reflects the image to form an image, and the distance of the virtual optical center of the reflected image can be 0. The parallax problem of the image is theoretically solved. Specifically, it is assumed that the common center camera includes a glass rib P1 having three surfaces M1, M2, M3, which are silver-plated reflective surfaces, and three cameras CI, C2 and C3 are placed below the reflective surface. Figure 1 with camera C1 For example, the principle of virtual common optical center is shown, where L1 is the incident ray, R1 is the reflected ray, the normal line perpendicular to the reflective surface M1 is 100, the angle between the normal line 100 and the horizontal line 101 is a, and the reflection point is to the camera C1. The actual distance of the optical center 01 is d. According to the principle of light reflection, the camera will capture a virtual image with a virtual optical center V01. In theory, by designing the angle of the reflective surface and the position of the camera, the distance between the virtual optical centers V01 of the camera C1, the virtual optical centers V02 of the C2, and the virtual optical center V03 of the C3 can be zero, thereby obtaining the total optical center. Images. By stitching these three images, it is theoretically possible to obtain images that are seamlessly stitched at any depth.

With the above-mentioned common optical center camera, as shown in Fig. 2, L1 and R1 are incident and reflected rays of the reflecting surface M1, respectively, and L2 and R2 are incident and reflected rays of the reflecting surface M2, respectively. Where L1 is the incident ray from object 01 and L2 is the incident ray from object 02. At the edges of Ml and M2, in the ideal case, only the reflected light R2 of the reflective surface M2 can enter the lens of the camera C2, and the reflected light R1 of the reflective surface M1 cannot enter the lens of the C2. However, in actual situations, due to the parameters of the lens and the positional relationship between the lens and the reflective surface, both R1 and R2 may enter the lens of camera C2, that is, objects 01 and 02 will image at the edge of the image captured by camera C2, 01 The image is superimposed on the image of 02 in a manner similar to Alpha synthesis, thereby forming a feathered dip zone A1, as shown in FIG. The dip dye ribbon A1 cannot be used in splicing, resulting in poor splicing effect and inability to obtain high quality panoramic images. Summary of the invention

Embodiments of the present invention provide a common center camera, an image processing method, and an apparatus, which are capable of preventing the emergence of a feathered dip ribbon.

In view of this, the embodiments of the present invention provide:

A common optical camera, comprising:

a prism having a plurality of reflective surfaces and each of the reflective surfaces is provided with a polarizing film, and the incident light passes through the polarizing film and is reflected by the reflective surface of the prism to output polarized reflected light, and the polarizing film on each of the reflective surfaces The polarization direction is different from the polarization direction of the polarizing film on the adjacent reflective surface;

a plurality of imaging devices, each of the plurality of imaging devices and each of the prisms Glossy-combination, the lens of each of the imaging devices faces a reflective surface of the prism, and a polarizing plate is mounted on the front of each camera, and each of the plurality of imaging devices is used to acquire a polarizing plate for polarizing the polarized reflected light, wherein a polarization direction of the polarizing plate before the lens of each camera is the same as a polarization of the prism combined with the polarizing plate The polarization direction of the film is the same.

An image processing method includes:

Obtaining a scene image captured by the camera device;

Acquiring a brightness value of each pixel in the image of the edge portion of the scene image; wherein the edge portion image of the scene image is an image captured by the camera device, that is, a reflective surface combined with the camera device An image formed by light rays of a scene reflected by an area bordered by a reflective surface adjacent to the reflective surface;

And according to the brightness value of each pixel in the edge part image of the scene image, and the preset reflection surface combined with the imaging device and the reflective surface adjacent to the reflective surface, the image formed by the reflected light forms each of the images The brightness compensation coefficient of the pixel compensates for the brightness of each pixel in the edge portion image of the scene image.

An image processing apparatus includes:

a to-be-compensated image acquisition unit, configured to acquire a scene image captured by the camera device;

a brightness value acquiring unit, configured to acquire a brightness value of each pixel in the image of the edge portion of the scene image; wherein the edge portion image of the scene image is an image captured by the camera device, that is, combined with the camera device An image formed by the ray of the scene reflected by the area of the reflective surface adjacent to the reflective surface adjacent to the reflective surface;

a compensation unit, configured to reflect light according to a brightness value of each pixel in the edge portion image of the scene image and a preset reflective surface combined with the reflective device and a reflective surface adjacent to the reflective surface A brightness compensation coefficient of each pixel in the image is formed, and the brightness of each pixel in the edge portion image of the scene image is compensated.

The common optical center camera provided by the embodiment of the present invention has a polarizing film on the reflective surface, and the polarizing plate is disposed in front of the lens of the image capturing device, and the polarizing film on each reflecting surface has a polarization direction corresponding to the reflecting surface. The polarization direction of the polarizing plate in front of the lens is the same, and the polarization direction of the polarizing plate in front of the lens corresponding to the adjacent reflecting surface is different, so that the imaging device can only receive the reflected light from the corresponding reflecting surface, and cannot receive The reflected light of the adjacent reflective surface (the adjacent reflective surface is a reflective surface adjacent to the reflective surface corresponding to the imaging device), such that the image formed by the reflected light of the two reflective surfaces adjacent to the prism is Without folding together, there will be no feathered dyeing tape. DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.

1 is a schematic diagram of a virtual common optical center principle provided by the prior art;

2 is a schematic view of reflected light at the edges of two reflective surfaces provided by the prior art; and a schematic diagram of the resulting immersion belt;

FIG. 3A is a structural diagram of a common optical center camera according to an embodiment of the present invention; FIG.

FIG. 3B is a schematic diagram of an optical path of a reflective surface based on a prism according to an embodiment of the present invention; FIG. 4 is a schematic diagram of an optical path based on an upward reflecting surface according to an embodiment of the present invention; FIG. FIG. 6 is a schematic diagram of an optical path based on a reflective surface having a transparent protective film according to an embodiment of the present invention; FIG. 7 is a structural diagram of a common optical center camera having a spacer according to an embodiment of the present invention;

FIG. 8 is a flowchart of an image processing method according to an embodiment of the present invention;

9 is a flowchart of a method for determining a brightness compensation coefficient according to an embodiment of the present invention; FIG. 10 is a schematic diagram of an image of an edge portion in a single color image according to an embodiment of the present invention; FIG. 11 is another embodiment of the present invention. A flowchart of a method for determining a brightness compensation coefficient; FIG. 12A is a structural diagram of an image processing apparatus according to an embodiment of the present invention;

FIG. 12B is a structural diagram of another image processing apparatus according to an embodiment of the present invention. detailed description

Referring to FIG. 3A, an embodiment of the present invention provides a common optical center camera, which includes: a prism 10 and a plurality of imaging devices 20,

The prism 10 has a plurality of reflective surfaces, and each of the reflective surfaces is attached with a polarizing film. The incident light passes through the polarizing film and is reflected by the reflective surface of the prism, and outputs polarized reflected light, and the polarizing film on each reflective surface. The polarization direction is different from the polarization direction of the polarizing film on the adjacent reflective surface;

a plurality of imaging devices 20, each of the plurality of imaging devices being combined with each reflective surface of the prism 10, the lens of each of the imaging devices facing a reflective surface of the prism, and each imaging A polarizing plate is mounted on the front of the lens of the device, and each of the plurality of imaging devices is configured to acquire the polarized light of the polarized light reflected by the polarizing plate, wherein the lens of each camera device The polarization direction of the front polarizing plate is the same as the polarization direction of the polarizing film on the reflecting surface of the prism combined with the polarizing plate.

The polarization direction of the polarizing film on each reflective surface of the prism may be perpendicular to the polarization direction of the polarizing film on the adjacent reflective surface, or may be other angles, and does not affect the implementation of the present invention.

In order to make the technical solution of the embodiment of the present invention more clear, referring to FIG. 3B, the working principle of the common center camera is described by taking a reflective surface 100 of the prism as an example:

A polarizing film 101 is attached to the reflective surface 100 of the prism, and the reflective surface 100 of the prism is used for reflecting incident light transmitted through the polarizing film 101 to output polarized reflected light.

The imaging device 20 corresponds to the reflective surface 100 of the prism, and a polarizing plate 201 is mounted in front of the lens 200 of the imaging device 20, and the imaging device 20 is configured to acquire the reflective surface 100 of the prism by the polarizing plate 201. The polarized reflected light is subjected to polarization treatment.

In order to more effectively prevent the camera from receiving light reflected by the adjacent reflective surface of the combined reflective surface, the common center camera may further include: a spacer for blocking polarization of a reflective surface output of the prism The reflected light enters an imaging device corresponding to another reflective surface adjacent to the reflective surface, and the boundary between the spacer and the adjacent two reflective surfaces is coplanar.

The partition may be fixedly coupled to the outer casing of the common-mode optical camera, or may be integrally formed with the outer casing of the common-mode optical camera. The common optical center camera provided by the embodiment of the invention has a polarizing film on the reflective surface, and the polarizing film is arranged in front of the lens of the image capturing device, and the polarization direction of the polarizing film on each reflecting surface and the polarization of the camera before the lens corresponding to the reflecting surface The polarization directions of the slices are the same, and the polarization directions of the polarizers before the lens of the camera corresponding to the adjacent reflective surfaces are different, so that the camera can only receive the reflected light from the corresponding reflective surface, and cannot receive adjacent reflections. The reflected light of the surface (the adjacent reflective surface is a reflective surface adjacent to the reflective surface corresponding to the imaging device), such that the image formed by the reflected light of the two reflective surfaces adjacent to the prism does not alias Together, there will be no emergence of feathered dip tape.

In order to make the embodiments of the present invention more clear, the following embodiment will describe the common optical center camera provided by the present invention in detail.

Fig. 4 shows a schematic diagram of the optical path based on an upwardly reflecting surface, assuming that the incident light 301 is a natural light whose polarization direction is circularly polarized, and the polarization directions of the polarizing film 101 and the polarizing plate 201 are both horizontally polarized.

The reflective surface 100 of the prism 10 reflects the incident light 301 transmitted through the polarizing film 101, and outputs the polarized reflected light 302. Since the polarization direction of the polarizing film 101 is horizontally polarized, the incident light 301 passes through the polarizing film 101 and becomes The horizontally polarized linearly polarized light, the reflective surface 100 reflects the horizontally polarized linearly polarized light, and outputs a reflected ray 302, which is also horizontally polarized linearly polarized light.

The polarizing plate 201 in front of the lens 200 of the imaging device 20 polarizes the reflected light 302. Since the reflected light 302 is horizontally polarized linearly polarized light and the polarization direction of the polarizing plate 201 is horizontally polarized, the reflected light 302 can pass through. The polarizing plate 201 is incident on the lens 200 of the image pickup device 20.

The image pickup device 20 receives the light after polarization treatment of the polarized reflected light 302 reflected by the reflecting surface 100 of the prism 10 by the polarizing plate 201.

The common optical center camera provided by the embodiment of the invention has a polarizing film on the reflective surface, and the polarizing film is arranged in front of the lens of the image capturing device, and the polarization direction of the polarizing film on each reflecting surface and the polarization of the camera before the lens corresponding to the reflecting surface The polarization directions of the slices are the same, and the polarization directions of the polarizers before the lens of the camera corresponding to the adjacent reflective surfaces are different, so that the camera can only receive the reflected light from the corresponding reflective surface, and cannot receive adjacent reflections. The reflected light of the surface (the adjacent reflective surface is a reflective surface adjacent to the reflective surface corresponding to the imaging device), thus formed by the reflected light of the two reflective surfaces adjacent to the prism The images will not be aliased together and will not form a feathered dip ribbon.

Fig. 5 shows a schematic diagram of the optical path based on a downward reflecting surface, assuming that the incident light 301 is a natural light whose polarization direction is circularly polarized, and the polarization directions of the polarizing film 101 and the polarizing plate 201 are both horizontally polarized. The processing of the light on the reflective surface, the polarizing plate, and the imaging device in this embodiment is similar to the embodiment shown in FIG. 4, and details are not described herein again.

Optionally, as shown in FIG. 6, a transparent protective film 102 may be further disposed between the reflective surface 100 and the polarizing film 101 for preventing the plating layer from falling off on the reflective surface. The incident light ray 301 is sequentially incident on the reflective surface 100 through the polarizing film 101 and the transparent protective film 102, and the incident light 301 is reflected by the reflective surface 100, and the reflected light ray 302 is sequentially transmitted through the transparent protective film 102 and the polarizing film 101. Imaging device 20.

Since the polarizing plate and the polarizing film are used, the amount of light is reduced when the light passes through the polarizing plate and the polarizing film, so the amount of reflected light reaching the lens of the imaging device is smaller than the amount of incident light, and is usually only 50% of the amount of incident light. Therefore, it is possible to adjust the aperture of the imaging device to compensate for the loss of light amount caused by the polarizing plate and the polarizing film. The aperture is a device used to control the amount of light that passes through the lens and into the photosensitive surface of the body. The aperture size can be expressed as f: f value = focal length of the lens I diameter of the lens aperture. The aperture value of the aperture is usually between 2.8 and 16. The smaller the f-number of the aperture, the greater the amount of light entering the photosensitive surface of the fuselage in the same unit time. For example, the aperture is adjusted from f8 to f5.6, and the aperture is one level larger. At the same time, the amount of light entering the photosensitive surface of the body is doubled.

The common-mode optical camera introduced in the above embodiment of the present invention prevents the camera device from receiving the light reflected by the adjacent reflective surface of the combined reflective surface by using optical principles, in order to more effectively prevent the camera device from receiving the combination thereof. The light reflected by the adjacent reflective surface of the reflective surface, the common optical center camera may further include: a spacer, a fixed connection with the outer casing of the common optical camera or a structure integrally formed with the outer casing of the common optical camera a polarized reflected light for blocking the output of one reflective surface of the prism enters another corresponding reflective surface, wherein the one reflective surface and the other reflective surface are adjacent to each other a reflective surface, wherein the partition is coplanar with a boundary line between the two adjacent reflective surfaces. Specifically, the reflective surface of the prism may face upward or downward, and when the reflective surface of the prism faces upward, the partition is located directly above the boundary line of the adjacent two reflective surfaces; when the reflective surface of the prism faces downward, the partition is located Immediately below the boundary line between two adjacent reflective surfaces. As shown in FIG. 7, PI is a prism having three reflecting surfaces of M1, M2 and M3, the three reflecting surfaces are facing upward, and Cl, C2 and C3 are respectively corresponding to the three reflecting surfaces M1, M2 and M3. In order to prevent the reflected light of M1 and M3 from entering the lens of C2, a thin spacer B12 is placed on the boundary line S12 between the two adjacent reflective surfaces M1 and M2, at the boundary of two adjacent reflective surfaces of M3 and M2. A thin partition B23 is placed on the line S23. Wherein, the thin baffle B12 and S12 are coplanar, the projection of the bottom surface D12 of the thin baffle B12 on the bottom surface of the prism P1 coincides with the projection of S12 on the bottom surface of the prism P1; the thin baffles B23 and S23 are coplanar, and the bottom surface D23 of the thin baffle B23 The projection on the bottom surface of the prism P1 coincides with the projection of S23 on the bottom surface of the prism P1. Thus, B12 and B23 divide the space inside the common optical camera into three parts, each part corresponding to a reflective surface and a camera device, and the thin partition plate blocks the reflected light of the adjacent reflective surface, so that the imaging device in the partial space The reflected light from the adjacent reflective surface will not be received.

Referring to FIG. 8, an embodiment of an image processing method is provided. The method embodiment includes:

801. Acquire a scene image captured by the camera.

802. Obtain a brightness value of each pixel in an image of an edge portion of the scene image, where an edge portion image of the scene image is an image captured by the camera device, that is, a reflective surface combined with the camera device. An image formed by light rays of a scene reflected by an area bordered by the reflective surface adjacent to the reflective surface.

The method is applicable to the common center camera provided by the above embodiments, and is also applicable to the common center camera provided by the prior art. As shown in FIG. 7 , since the reflective surface M2 is adjacent to M1 and M3 respectively, the image of the edge portion in the scene image captured by the camera corresponding to M2 includes: the light of the scene reflected by the area where the reflective surface M2 and M1 meet The formed image, and the image formed by the light of the scene reflected by the area where the reflective surface M2 and M3 meet. The image of the edge portion of the scene image captured by the camera corresponding to M1 includes: an image formed by the light of the scene reflected by the region where the reflective surface M2 and M1 meet.

803, according to the brightness value of each pixel in the edge portion image of the scene image and the preset reflective surface combined with the imaging device and the reflective surface adjacent to the reflective surface to reflect the light formed by the image formed by the light The brightness compensation coefficient of each pixel compensates for the brightness of each pixel in the edge portion image of the scene image.

Before this step, in order to obtain a reflective surface combined with the camera device, the reflective surface adjacent thereto The area of the face intersection reflects the brightness compensation coefficient of each pixel in the image formed by the light, the method further comprising: acquiring an edge part image and a non-edge part image of the monochrome image captured by the camera device, the edge part of the monochrome image The image is a non-edge portion image of the reflective monochrome image combined with the camera device captured by the camera device, except for the edge portion (the width of the edge portion and the aperture size of the camera, the size of the prism) And a quality of the edge of the mirror, generally less than 5% of the width of the image; a portion other than the image; obtaining an average luminance value of the pixel in the non-edge portion image of the monochrome image, and an image of the edge portion of the monochrome image a ratio of a luminance value of each pixel to the average luminance value as a luminance attenuation coefficient of each pixel in an edge portion image of the monochrome image; determining a luminance attenuation coefficient of each pixel in an edge portion image of the monochrome image The reciprocal is opposite to the area where the reflective surface corresponding to the imaging device is in contact with the adjacent reflective surface The brightness compensation coefficient of the corresponding pixel in the image formed by the light. The monochrome object may be a monochrome template, and the template is a white template or a grayscale template; correspondingly, the R, G, and B values of the pixels in the monochrome image are equal or approximately equal.

The process of compensating the brightness of each pixel in the image of the edge portion of the scene image may be processed frame by frame. To speed up the processing, a graphics processing unit (GPU) and a digital signal processor may be used. Devices such as Digital Signal Processing, DSP) are processed.

In the embodiment of the present invention, each pixel in the image of the edge portion of the captured image is obtained by using a preset brightness attenuation coefficient of each pixel in the image formed by the reflected surface corresponding to the imaging device and the reflective surface adjacent to the adjacent reflective surface. The brightness is compensated to eliminate the dark band caused by the boundary area of the two reflective surfaces.

The process of obtaining the brightness compensation coefficient of each pixel in the image formed by the reflected light corresponding to the image pickup device and the reflected light surface of the region corresponding to the image pickup device provided by the embodiment of the present invention is as follows: First, refer to FIG. 9 , which specifically includes:

901. Acquire an edge portion image and a non-edge portion image of the monochrome image captured by the camera device.

902. Acquire an average luminance value of a pixel in a non-edge portion image of the monochrome image.

Specifically, the sum of the luminance values of the pixels in the non-edge portion image is obtained, and then the sum is divided by the non- The number of pixels in the edge portion of the image gives an average luminance value.

903. Dividing a luminance value of each pixel in a certain row of the edge portion image in the monochrome image by the average luminance value to obtain a luminance attenuation coefficient of each pixel in the row.

Specifically, as shown in FIG. 10, it is assumed that the width of the edge portion image in the monochrome image is w, and the coordinates of a certain pixel in the image are (X, y). When y is determined as a certain value in this step, different X corresponds to The luminance attenuation coefficient of the pixel, where ^XG [ ^Q , ^W ] is assumed to be the luminance value of the pixel, and the luminance value ranges from 0 to ^55, then the luminance attenuation coefficient of the pixel is:

χ _ Β

Wherein, it is the average brightness value of the pixels in the non-edge part image of the monochrome image, and its value ranges from 0 to 255, and the range of values is ^{e (()} , ^1] , that is, ^{0 < ≤1} .

The manner of determining the image width w of the edge portion in the monochrome image is as follows:

Specifically, it is determined whether the brightness value of each pixel in a certain line of the monochrome image is lower than a threshold, and a pixel below the threshold closest to the center of the image is found, and the distance from the pixel to the boundary of the monochrome image is w.

904. Determine a luminance attenuation coefficient of each pixel in another row of the edge portion image of the monochrome image, wherein the other rows have the same luminance attenuation coefficient of the pixel having the same abscissa as the certain row.

905. Determine a reciprocal of a luminance attenuation coefficient of each pixel in an edge portion image of the monochrome image as a brightness of a corresponding pixel in an image formed by the reflected light surface corresponding to the imaging device and the reflective surface adjacent to the adjacent reflective surface. Compensation coefficient.

The second way: Refer to Figure 11, which specifically includes:

1101. Acquire an edge portion image and a non-edge portion image of the monochrome image captured by the camera device.

1102. Acquire an average brightness value of a pixel in a non-edge portion image of the monochrome image.

1103. Dividing a luminance value of each pixel of the edge portion image in the monochrome image by the average luminance value to obtain a luminance attenuation coefficient of each pixel.

1104. Determine a reciprocal of a luminance attenuation coefficient of each pixel in an edge portion image of the monochrome image as a brightness compensation of a corresponding pixel in an image formed by the reflected light surface corresponding to the imaging device and the reflective surface adjacent to the adjacent reflective surface. coefficient. It should be noted that, for each imaging device, if the imaging condition of the imaging device is not changed, only the luminance attenuation coefficient of the pixel in the edge portion image of the monochrome image may be obtained once, if the imaging condition of the imaging device changes. For example, if the aperture value is changed, the boundary area of the corresponding two reflecting surfaces will also change, and the brightness attenuation coefficient of the image of the edge portion of the monochrome image needs to be newly obtained. In general, when the aperture value is increased, the boundary area between the two reflecting surfaces is also increased, and when the aperture value is decreased, the boundary area between the two reflecting surfaces is also reduced.

Optionally, after the brightness of each pixel in the image of the edge portion of the scene image captured by each camera device is compensated to obtain the compensated scene image, in order to obtain the panoramic image, the method further includes: The scene images are stitched together to obtain a panoramic image.

Referring to FIG. 12A, an embodiment of the present invention provides an image processing apparatus, which mainly includes: a to-be-compensated image acquiring unit 1201, configured to acquire a scene image captured by an imaging device;

The brightness value obtaining unit 1202 is configured to acquire a brightness value of each pixel in the image of the edge portion of the scene image, where the edge portion image of the scene image is a reflective surface captured by the camera device and combined with the camera device An image formed by light rays of a scene reflected by an area bordering the adjacent reflective surface;

The compensation unit 1203 is configured to: according to the brightness value of each pixel in the edge portion image of the scene image and the preset reflection surface combined with the reflective surface of the imaging device and the reflective surface of the adjacent reflective surface The brightness compensation coefficient of each pixel compensates for the brightness of each pixel in the edge portion image of the scene image.

The brightness compensation coefficient of each pixel in the image formed by the light reflecting surface combined with the reflective surface of the imaging device and the adjacent reflective surface may be pre-arranged on the imaging device, or may be imaged. The device is calculated using the luminance values of the pixels in the monochrome image.

In order to calculate the brightness compensation coefficient of each pixel in the image formed by the light reflected from the reflective surface combined with the adjacent reflective surface, the image pickup apparatus further includes:

The single color image acquiring unit 1204 is configured to acquire an edge portion image and a non-edge portion image of the monochrome image captured by the imaging device, where the edge portion image of the monochrome image is captured by the camera device An image formed by the light of the monochromatic object reflected by the reflective surface combined with the imaging device and the region adjacent to the adjacent reflective surface; the non-edge portion image of the monochrome image is in the monochrome image a portion other than the edge portion image; a luminance attenuation coefficient determining unit 1205, configured to acquire an average luminance value of a pixel in the non-edge portion image of the monochrome image, and to use each pixel in the edge portion image of the monochrome image The ratio of the luminance value to the average luminance value is used as the luminance attenuation coefficient of each pixel in the edge portion image of the monochrome image, and can be specifically used for the luminance of each pixel in a certain line of the edge portion image of the monochrome image. Dividing the value by the average luminance value, obtaining a luminance attenuation coefficient of each pixel in the certain row, determining a luminance attenuation coefficient of each pixel in another row of the edge portion image of the monochrome image, where the other row and The pixels having the same abscissa in a certain row have the same luminance attenuation coefficient. For the specific attenuation coefficient determination method, refer to the descriptions of steps 903-904 and step 1103 in the method embodiment, and details are not described herein again. The brightness compensation coefficient determining unit 1206 is configured to determine a reciprocal of the brightness attenuation coefficient of each pixel in the edge portion image of the monochrome image as the reflected light of the area corresponding to the reflective surface corresponding to the imaging device and the adjacent reflective surface The brightness compensation coefficient of each pixel in the formed image.

In the embodiment of the present invention, the brightness of each pixel in the image of the edge portion of the captured image is compensated by using the brightness attenuation coefficient of each pixel in the image formed by the reflected light at the boundary between the two reflective surfaces, and the two reflective surfaces are eliminated. The dark band caused by the border area.

A person skilled in the art can understand that all or part of the steps of implementing the above embodiments may be performed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium, such as a read only memory. Disk or disc, etc.

The description of the above embodiments of the common center camera, image processing method and apparatus provided by the embodiments of the present invention is only for helping to understand the method of the present invention and its core idea; meanwhile, for those skilled in the art, The present invention is not limited by the scope of the present invention.

Claims

Claim

A common optical center camera, comprising:

a plurality of imaging devices, each of the plurality of imaging devices being combined with each of the reflective surfaces of the prism, the lens of each of the imaging devices facing a reflective surface of the prism, and each of the imaging devices A polarizing plate is disposed in front of the lens, and each of the plurality of imaging devices is configured to acquire light of the polarized light that is polarized by the polarized light, wherein each camera is in front of the lens The polarization direction of the polarizer is the same as the polarization direction of the polarizing film on the reflective surface of the prism to which it is combined.

2. A common center camera according to claim 1, wherein

The polarization direction of the polarizing film on each of the reflecting surfaces of the prism is perpendicular to the polarization direction of the polarizing film on the adjacent reflecting surface.

3. The common-mode optical camera according to claim 1, further comprising: a spacer for blocking polarized reflected light outputted by a reflective surface of the prism from entering the reflective surface In another imaging device corresponding to the reflective surface, the boundary between the spacer and the adjacent two reflective surfaces is coplanar.

The common mode optical camera according to claim 3, wherein the spacer is fixedly coupled to the outer casing of the common optical camera or integrally formed with the outer casing of the common optical camera.

5. An image processing method, comprising:

Obtaining a scene image captured by the camera device;

Acquiring a brightness value of each pixel in the image of the edge portion of the scene image; wherein the edge portion image of the scene image is an image captured by the camera device, that is, a reflective surface combined with the camera device An image formed by light rays of a scene reflected by an area bordered by a reflective surface adjacent to the reflective surface; And according to the brightness value of each pixel in the edge part image of the scene image, and the preset reflection surface combined with the imaging device and the reflective surface adjacent to the reflective surface, the image formed by the reflected light forms each of the images The brightness compensation coefficient of the pixel compensates for the brightness of each pixel in the edge portion image of the scene image.

The method according to claim 5, wherein before the compensation of the brightness of each pixel in the image of the edge portion of the scene image, the method further comprises:

Obtaining an edge portion image and a non-edge portion image of the monochrome image captured by the camera device, wherein the edge portion image of the monochrome image is a reverse-reported monochrome image captured by the camera device and combined with the camera device The non-edge portion image is a portion of the monochrome image other than the edge portion image;

Obtaining an average luminance value of a pixel in the non-edge portion image of the monochrome image, and using a ratio of a luminance value of each pixel in the edge portion image of the monochrome image to the average luminance value as the monochrome image The brightness attenuation coefficient of each pixel in the edge portion image;

Determining, by the reciprocal of the luminance attenuation coefficient of each pixel in the edge portion image of the monochrome image as the brightness of the corresponding pixel in the image formed by the reflected light surface combined with the reflective surface of the imaging device and the adjacent reflective surface Compensation coefficient.

7. The method of claim 6 wherein:

The ratio of the luminance value of each pixel in the edge portion image of the monochrome image to the average luminance value as the luminance attenuation coefficient of each pixel in the edge portion image of the monochrome image includes:

Dividing the luminance value of each pixel in a certain line of the edge portion image of the monochrome image by the average luminance value to obtain a luminance attenuation coefficient of each pixel in the certain row;

A luminance attenuation coefficient of each pixel in another row of the edge portion image of the monochrome image is determined, wherein the other row has the same luminance attenuation coefficient as the pixel having the same abscissa as the certain row.

8. An image processing apparatus, comprising:

a brightness value acquiring unit, configured to acquire brightness of each pixel in an image of an edge portion of the scene image The image of the edge portion of the scene image is an image captured by the image capturing device, that is, a scene reflected by an area combined with a reflective surface of the image pickup device and a reflective surface adjacent to the reflective surface. An image formed by light;

The device according to claim 8, wherein the image processing device further comprises: a single color image acquiring unit, configured to acquire an edge portion image and a non-edge portion image of the monochrome image captured by the camera device An edge portion image of the monochrome image is an image formed by a light of a monochrome object reflected by an area of the reflective surface combined with the imaging device captured by the imaging device and the reflective surface adjacent thereto; The non-edge portion image of the monochrome image is a portion of the monochrome image other than the edge portion image;

a luminance attenuation coefficient determining unit, configured to acquire an average luminance value of a pixel in a non-edge portion image of the monochrome image, and compare a luminance value of each pixel in an edge portion image of the monochrome image with respect to the average luminance value The ratio is used as a luminance attenuation coefficient of each pixel in the edge portion image of the monochrome image;

a brightness compensation coefficient determining unit, configured to determine a reciprocal of a brightness attenuation coefficient of each pixel in the edge portion image of the monochrome image as the area reflected light corresponding to the reflective surface corresponding to the imaging device and the adjacent reflective surface Forming a brightness compensation coefficient of each pixel in the image;

The compensation unit is configured to: according to the brightness value of each pixel in the edge part image of the scene image and the brightness compensation coefficient of the corresponding pixel determined by the brightness compensation coefficient determining unit, in the edge part image of the scene image The brightness of each pixel is compensated.

10. Apparatus according to claim 9 wherein:

The attenuation coefficient determining unit is configured to divide a luminance value of each pixel in a certain row of the edge portion image of the monochrome image by the average luminance value to obtain a luminance attenuation coefficient of each pixel in the certain row; The luminance attenuation coefficient of each pixel in the other lines of the image of the edge portion of the monochrome image, where The pixels of the other row having the same abscissa as the one row have the same luminance attenuation coefficient.