JP2011029903A - Digital camera system with attached polarizer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital camera system with an attached polarizer by which an image capable of visually recognizing unevenness, ups and downs, a curved surface on the surface of an object is obtained. <P>SOLUTION: The digital camera system with the attached polarizer is provided with: a digital camera; and a polarizer unit arranged in front of an optical system lens of the digital camera, wherein the polarizer unit has a plurality of polarizers with changed transmission axes, and the digital camera has: a means for extracting polarization information and luminance information by unit of pixel from a plurality of images which penetrate the polarizer unit; a means for reconstructing polarization data and luminance data from the polarization information and the luminance information; and a means for displaying the polarization data and the luminance data which are reconstructed. In addition, when a digital camera is newly manufactured, the polarization unit may be arranged at a poststage of the optical system lens. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a digital camera system provided with a polarizer, which generates an image that can visually recognize irregularities, undulations, and curved surfaces on a surface of a subject.

  The digital camera system provided with the polarizer according to the present invention is referred to as “undulation” in which, for example, a golfer is portable and the golf course green and the fairway (subject) undulate like a wave. ) Is used as a camera system that generates an image that can be visually recognized. In addition, it is also used as a surface roughness display device and a curved surface display device.

  An image obtained by photographing a subject with a digital camera is expressed in three dimensions. However, depending on the subject, even if it is expressed in three dimensions, the unevenness, undulation, and curved surface of the subject surface may not be clear.

  For example, when a bowling black ball is photographed using a digital camera, some images may not be clearly represented as a sphere. Alternatively, when two objects that appear to overlap with each other are photographed using a digital camera, the boundary may not be clearly expressed if there is no luminance difference between the overlapping parts of the objects.

  Alternatively, it is generally very difficult for golfers to read through the undulations on the golf course green.

  The present inventor is unaware of the existence of prior art documents that disclose or suggest a camera system that reconstructs an image that can visually recognize the undulations of the surface of a subject using a polarization action as described later.

  Accordingly, there has been a demand for the development of a digital camera system that can obtain an image capable of visually recognizing irregularities, undulations, and curved surfaces on the surface of a subject. If such a digital camera can be realized, a spherical object can be immediately recognized as a sphere, and the boundary between two objects having no luminance difference can be recognized.

  Alternatively, if such a digital camera can be realized, the golfer can visually recognize the green undulation during the practice of putting, and thus can be used as a golf practice support camera.

  Digital cameras are already very popular in the world. Furthermore, the digital camera is incorporated as a component in a mobile phone, a personal computer, or the like. Therefore, it is possible to remove irregularities, undulations, and curved surfaces on the surface of a subject simply by attaching accessories (attachments) to existing digital cameras and digital camera parts or by rewriting the program recorded in the internal memory. Development of a technique for changing to a camera system capable of obtaining a visually recognizable image has also been desired.

  In view of such circumstances, an object of the present invention is to provide a digital camera system provided with a polarizer, which can obtain an image capable of visually recognizing irregularities, undulations, and curved surfaces on the surface of a subject.

  Furthermore, the present invention is provided with a polarizer that can obtain an image that can visually recognize the irregularities, undulations, and curved surfaces of the surface of the subject without significantly modifying existing digital cameras and digital camera components. It aims to be realized as a digital camera system.

  In view of the above object, a digital camera system provided with a polarizer according to the present invention includes a digital camera and a polarizer unit disposed in front of an optical lens of the digital camera, and the polarizer unit includes: A plurality of polarizers having different transmission axes, wherein the digital camera extracts polarization information and luminance information in units of pixels from a plurality of images transmitted through the polarizer unit; and the polarization information and luminance information To reconstructing the polarization data and the luminance data, and displaying the reconstructed polarization data and the luminance data.

  Furthermore, the digital camera system provided with the polarizer according to the present invention includes a polarizer unit arranged at the rear stage of the optical system lens, and the polarizer unit has a plurality of polarizers whose transmission axes are changed, Means for extracting polarization information and luminance information in pixel units from a plurality of images transmitted through the polarizer unit; means for reconstructing polarization data and luminance data from the polarization information and luminance information; Means for displaying the polarization data and the luminance data.

  Furthermore, in the digital camera system provided with the polarizer, the digital camera may include a digital camera unit incorporated in a mobile phone, a personal computer, or the like.

  Furthermore, in the digital camera system provided with the polarizer, the polarizer unit has a disk-shaped polarizer plate, and the polarizer plate has a plurality of polarized lights whose transmission axes are changed along the circumferential direction. A polarizer may be formed, the polarizer unit may include a rotation driving unit, and the digital camera may include a unit that sequentially captures an image transmitted through each polarizer.

  Furthermore, in the digital camera system provided with the polarizer, the polarizer unit includes a disc-shaped polarizer plate, and a polarizer having a transmission axis in one direction is formed on the polarizer plate. The polarizer unit may include a rotation driving unit, and the digital camera may include a unit that sequentially captures an image transmitted through the polarizer at every predetermined angle of the polarizer.

  Further, in the digital camera system provided with the polarizer, the means for reconstructing the polarization data and the brightness data is determined by determining the polarization data in a certain pixel block unit in addition to the means for determining the brightness data in the pixel unit. However, it may have means for displaying it as a normal vector.

  Further, in the digital camera system provided with the polarizer, the means for reconstructing the polarization data and the luminance data corresponds to the visible light spectrum corresponding to the polarization angle for each pixel in addition to the means for determining the luminance data for each pixel. In this case, the polarization data may be classified by different colors.

  Furthermore, in the digital camera system provided with the polarizer, the camera system may be used as a surface roughness display device for visualizing the surface roughness of the subject.

  Furthermore, in the digital camera system provided with the polarizer, the camera system may be used as a curved display device that visualizes the curved surface of the surface of the subject.

  ADVANTAGE OF THE INVENTION According to this invention, the digital camera system which attached the polarizer which can obtain the image which can recognize the unevenness | corrugation of the surface of a to-be-photographed object, undulation, and a curved surface visually can be provided.

  Furthermore, according to the present invention, an existing digital camera and digital camera components can be obtained without remodeling them, and an image that can visually recognize the surface irregularities, undulations, and curved surfaces of the subject can be obtained. It can be realized as a digital camera system with a child attached.

FIG. 1 is a diagram showing an external appearance of a camera system in which a polarizer unit is retrofitted to an existing mobile phone with a digital camera. FIG. 2 is a diagram illustrating a polarizer plate built in the polarizer unit of FIG. Here, FIG. 2A shows a polarizer plate in which four types of polarizers having different transmission axes are combined, and FIG. 2B is a diagram for explaining each polarizer. FIG. 3 is a diagram illustrating another polarizer plate of FIG. FIG. 4 is a schematic block diagram of a camera system provided with the polarizer of FIG. FIG. 5 is a diagram for explaining a portion connecting the polarizer plate and the camera body in the block diagram of the camera system of FIG. FIG. 6 is a diagram for explaining processing executed by the luminance and polarization component detection unit of the camera system provided with the polarizer of FIG. FIG. 7 is a diagram for explaining an image processed by the first method for reconstructing an image. FIG. 7A shows a round object (subject), FIG. 7B shows an image obtained by photographing this object with a conventional camera, and FIG. 7C shows a camera system provided with this polarizer. It is a figure which shows the image which overlapped and displayed the normal vector on the luminance information processed by. FIG. 8 is a diagram illustrating an image processed by the second method for reconstructing an image. FIG. 8A shows an image obtained by photographing two objects having no luminance difference in the overlapping portion with a conventional camera, and FIG. 8B shows luminance information processed by a camera system provided with this polarizer. In addition, it is a figure which shows the image which displays polarization information by a different color. FIG. 9 is a diagram for explaining an image obtained by reconstructing an image by the first method of additionally displaying a normal vector on a golf green video.

  Hereinafter, embodiments of a camera system provided with a polarizer according to the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are assigned to the same elements, and duplicate descriptions are omitted.

  FIG. 1 is a diagram illustrating an external appearance of a camera system 1 in which a polarizer unit 12 is retrofitted to an existing mobile phone 20 with a digital camera.

  The mobile phone 20 with a digital camera includes a shutter 20s, a lens 21, and the like. The polarizer unit 12 is attached to the front of the lens 21 as a retrofit. The polarizer unit 12 typically has a disk shape (disk shape), and the internal polarizer plate is driven to rotate.

  The target to which the polarizer unit 12 is attached is not limited to the mobile phone 20 with a digital camera. It may be a personal computer with a built-in digital camera function or the digital camera itself.

  Furthermore, the present embodiment is not limited to the case where a polarizer is attached later to an existing digital camera, personal computer, or the like. It also covers camera systems with polarizers produced from the beginning. In this case, the polarizer unit 12 may be arranged at the rear stage of the optical system lens.

  FIG. 2 is a diagram illustrating the polarizer unit 12 of FIG. Here, FIG. 2 (A) shows a polarizer plate 12p that is a combination of four types of polarizers with different transmission axes built in the polarizer unit 12, and FIG. 2 (B) explains each polarizer. FIG.

  As shown in FIG. 2A, the polarizer plate 12p is typically formed in a disk shape (disk shape). For example, the polarizer plate 12p is divided into four along the circumferential direction, and each region has four types of polarizers 12-1 to 12-4 having different transmission axes. The polarizer plate 12p is rotationally driven around the central axis 12s.

  As shown in FIG. 2B, the transmission axis of the first polarizer 12-1 is zero with respect to the vertical line. The second polarizer 12-2 has a transmission axis at an angle of 45 degrees with respect to the vertical line. The third polarizer 12-3 has a transmission axis at an angle of 90 degrees with respect to the vertical line. The fourth polarizer 12-4 has a transmission axis at an angle of 135 degrees with respect to the vertical line.

  The polarizer unit 12 includes, in addition to the polarizer plate 12p, a motor that rotationally drives the polarizer plate and a controller that controls the rotation of this motor, which will be described later.

  FIG. 3 is a diagram for explaining another polarizer plate 12p-1 shown in FIG. This polarizer plate 12p-1 uses any one of the four types of polarizers shown in FIG. 2B (for example, the first polarizer 12-1), and is provided with a ring without providing a central axis. It is rotationally driven using a member (annular member) 12r.

  FIG. 4 is a schematic block diagram of the camera system 1 provided with the polarizer of FIG. The camera system 1 includes a polarizer unit 12 and a mobile phone 20 with a digital camera function, for example. The mobile phone 20 includes an optical system lens 21, a CMOS / CCD 22, a preprocessing unit 24, a luminance and polarization component detection unit 26, an image processing unit 28, a display unit 30, and an input / output unit as camera function parts. It has an interface 32, a CPU 34, a program memory 36, an image memory 38, and a battery 40.

  The CPU 34 controls the overall operation, and the program recorded in the program memory 36 has been rewritten so as to be able to process the polarization data and luminance data described in the present embodiment in addition to the existing camera photographing operation. The battery 40 supplies power to each element.

  A portion connecting the polarizer unit 12 and the camera body 20 in the block diagram of the camera system in FIG. 4 will be described. As shown in FIG. 5, the polarizer unit 12 includes a polarizer plate 12 p, a rotating shaft 12 s thereof, a motor 16, and a controller 18.

  When the polarizer plate 12p shown in FIG. 2 is used, it is connected to a motor 16 that rotationally drives its rotating shaft 12s, and the motor 18 is connected to a controller 18 that controls its rotation. When the polarizer plate 12p-1 shown in FIG. 3 is used, it is rotationally driven using the ring member 12r.

  As the motor 16, a small-sized stepping motor or micro motor can be used. The connection 19 between the controller 18 and the input / output interface 32 (see FIG. 4) of the camera body 20 is wired or wireless. For example, USB or the like can be used for wired connection, and Bluetooth or the like can be used for wireless connection.

  Referring back to FIG. 4, the CMOS / CCD 22 may be a CMOS image sensor or a CCD image sensor. The CCD image sensor is called a charge-coupled device, and is a device that converts incident light into a signal charge by a light receiving unit that is a photodiode and transfers the signal charge by the CCD. The CMOS image sensor selects a signal from each pixel arranged in a matrix by a switching signal from a Y address circuit that selects a horizontal line, and sequentially outputs a signal from the pixel one pixel at a time by the X address circuit. It is a device that reads and detects the output signal.

  The preprocessing unit 24 mainly A / D converts luminance information and polarization information for each pixel from the CMOS / CCD 22.

  The luminance and polarization component detection unit 26 extracts polarization components in addition to the digital luminance data sensed by the CCD or CMOS 22, and generates polarization data.

  A case where the polarizer plate 12p including the four types of polarizers described in FIG. 2 is employed will be described. According to the program procedure of the program memory 36 of FIG. 4, a rotation control signal is sent from the CPU 34 to the controller 18 via the input / output interface 32 and the connection 19 (FIG. 5). In synchronization with the rotation of the polarizer plate 12p, an image passing through the first polarizer 12-1 is captured, an image passing through the second polarizer 12-2 is captured, and then a third An image that has passed through the polarizer 12-3 is captured, and then an image that has passed through the fourth polarizer 12-4 is captured.

  As shown in FIG. 6, five frame memory areas are prepared in the image memory 38 (see FIG. 4). A frame memory 14-1 to 14-4 for each polarization information transmitted through the first to fourth polarizers, and a frame memory 15 for polarization information and luminance information.

  A method for generating polarization data is as follows. The angle zero polarization image transmitted through the first polarizer 12-1 is stored in the first polarization information frame memory 14-1, and the angle 45 degree polarization image transmitted through the second polarizer 12-2 is the first polarization information. The 90-degree polarized light image transmitted through the third polarizer 12-3 to the information frame memory 14-2 was transmitted through the fourth polarizer 12-4 to the third polarization information frame memory 14-3. The 135-degree angle polarization image is recorded in the fourth polarization information frame memory 14-4.

  From these four frame memory images, an image of polarization data and luminance data is generated in the frame memory 15. Specifically, the polarization images of the first pixels (1, 1) of each of the four frame memories are compared, the maximum value is selected, and the first pixel position (in the frame memory 15 of polarization and luminance information ( 1, 1) is recorded with polarization data (transmission axis information, vibration direction) and luminance data (amplitude value). Next, the same process is performed for the second pixel (1, 2), and this process is performed for all the pixels. As a result, an image of polarization data and luminance data is generated in the frame memory 15.

  Next, the case where the polarizer plate which consists of one type of polarizer demonstrated in FIG. 3 is demonstrated. Similarly, a rotation control signal is sent from the CPU 34 to the controller 18 via the input / output interface 32 and the connection 19 (FIG. 5) according to the procedure of the program memory 36 of FIG. In synchronization with the rotation of the polarizer plate 12p, images at predetermined angles (for example, 0 degree, 30 degrees, 60 degrees, 90 degrees, 120 degrees, and 150 degrees) are captured, respectively. For example, when an image is captured every 30 degrees, the first to sixth polarization information frame memories 14-1 to 14-6 are prepared and the same processing is performed.

  The image processing unit 28 reconstructs an image using the luminance data and polarization data recorded in the frame memory 15. There are two ways to reconstruct an image.

  The first method is a method of displaying polarization data as a normal vector in addition to luminance information in pixel units. For example, neighborhood processing is performed for each certain pixel block such as 2 × 2 pixels, 3 × 3 pixels, 4 × 4 pixels, and the normal vector is determined. In this neighborhood processing, the transmission axis (vibration direction) of the strongest polarization data is displayed as an arrow (vector display) for each pixel block.

  In the second method, the visible light spectrum is made to correspond to the polarization angle for each pixel, and a specific color is defined so that one color (visible light) is determined, and the color is classified according to the polarization angle. This is a method of reconstructing each pixel. The correspondence between the visible light spectrum and the polarization angle is prepared as a table in the image processing unit or memory so that the color (RGB value) for a specific polarization angle can be determined.

  The luminance data and polarization data are output at a predetermined timing by an output controller (not shown), converted to analog data by a DA converter (not shown), and displayed on the display unit 30.

  It should be noted that each block of the camera body 20 varies depending on the specifications of, for example, a camera unit of a mobile phone, a camera unit of a personal computer, and a digital camera.

  Further, when producing a digital camera system with a polarizer attached from the beginning, the polarizer unit 12 may be disposed at the subsequent stage of the optical system lens 21.

  Next, an example of imaging with the camera system 1 provided with the polarizer according to the present embodiment will be described.

  As an example of image reconstruction in the first method, when a round object (subject) 42 in FIG. 7A is processed by a conventional digital camera, the object 42 has luminance information 44 as shown in FIG. 7B. Only displayed. However, as shown in FIG. 7C, when processing is performed by the camera system 1 provided with this polarizer, in addition to the luminance information, the polarization vector information is displayed by superimposing and displaying the normal vector determined in units of pixel blocks. Can also be displayed as an image 46.

  As an example of the image reconstruction of the second method, two objects having a small luminance difference at the overlapping boundary portion in FIG. 8A become an image 48 when photographed with a conventional camera, and this polarizer is attached. When the camera system 1 performs shooting processing, as shown in FIG. 8B, in addition to luminance information, an image 50 that displays polarization information due to a color difference (color difference) can be obtained. (Note that the application drawings are limited to monochrome, so here they are displayed in monochrome.) Since the polarization direction of the reflected light changes depending on the direction of the object surface, an image 50 that can clearly identify the boundary between the two objects by different colors is obtained.

  FIG. 9 is an example in which an image of the golf green 52 is reconstructed by the first method of additionally displaying normal vectors. In the green undulation, the reflected light of the sun changes with the inclination, and the polarization direction also changes. By adding polarization information in addition to the green luminance information, an image that can clearly recognize the green undulation can be reconstructed.

  The embodiment of the camera system provided with the polarizer described above is an exemplification, and the present invention is not limited to this.

  The camera system 1 provided with a polarizer has various uses. For example, the camera system 1 provided with this polarizer can also be used as a surface roughness display device for visualizing the surface roughness. For example, the surface roughness of a machined industrial product, the roughness of human skin, and the like can be visualized.

  Alternatively, the camera system 1 provided with this polarizer can also be used as a curved surface display device for visualizing a curved surface. For example, it can be used for evaluation of accuracy of curved surface processing of industrial products for machining, evaluation of curved surface processing finishing of optical lenses, and the like.

  Additions, deletions, modifications, improvements, and the like to this embodiment that can be easily recalled by those skilled in the art are within the scope of the present invention. The technical scope of the present invention is defined by the description of the appended claims.

  1: Camera system with attached polarizer, 12: Polarizer unit, 12p: Polarizer plate, 12-1, 12-2, 12-3, 12-4: Polarizer, 12r: Ring member, 12s: Central axis 14-1, 14-2, 14-3, 14-4, 15: frame memory, 16: motor, 18: controller, 19: connection, 20: mobile phone, camera body, 21: optical system lens, 22: CMOS / CCD 24: Pre-processing unit 26: Luminance and polarization component detection unit 28: Image processing unit 30: Display unit 32: Input / output interface 34: CPU 36: Program memory 38: Image memory 40: Battery, 52: Golf green,

Claims (9)

A digital camera,
A polarizer unit disposed in front of the optical system lens of the digital camera,
The polarizer unit has a plurality of polarizers with different transmission axes,
The digital camera
Means for extracting polarization information and luminance information in units of pixels from a plurality of images transmitted through the polarizer unit;
Means for reconstructing polarization data and brightness data from the polarization information and brightness information;
A digital camera system provided with a polarizer, comprising: means for displaying the reconstructed polarization data and luminance data. It has a polarizer unit arranged at the rear stage of the optical system lens,
The polarizer unit has a plurality of polarizers with different transmission axes,
Means for extracting polarization information and luminance information in units of pixels from a plurality of images transmitted through the polarizer unit;
Means for reconstructing polarization data and brightness data from the polarization information and brightness information;
A digital camera system provided with a polarizer, comprising: means for displaying the reconstructed polarization data and luminance data. In the digital camera system which attached the polarizer of Claim 1 or 2,
The digital camera includes a digital camera unit incorporated in a mobile phone, a personal computer, or the like. In the digital camera system which attached the polarizer of Claim 1 or 2,
The polarizer unit includes a disc-shaped polarizer plate, and a plurality of polarizers whose transmission axes are changed along the circumferential direction are formed on the polarizer plate,
The polarizer unit has rotation driving means,
The digital camera is a digital camera system having means for sequentially capturing an image transmitted through each polarizer. In the digital camera system which attached the polarizer of Claim 1 or 2,
The polarizer unit has a disk-shaped polarizer plate, and a polarizer having a transmission axis in one direction is formed on the polarizer plate,
The polarizer unit has rotation driving means,
The digital camera system includes means for sequentially capturing images transmitted through the polarizer at every predetermined angle of the polarizer. In the digital camera system which attached the polarizer of Claim 1 or 2,
The means for reconstructing the polarization data and the brightness data includes means for determining the polarization data in a certain pixel block unit and displaying it as a normal vector in addition to the means for determining the brightness data in pixel units. A digital camera system. In the digital camera system which attached the polarizer of Claim 1 or 2,
The means for reconstructing the polarization data and the brightness data includes a means for classifying the polarization data by different colors by associating the visible light spectrum with the polarization angle for each pixel, in addition to the means for determining the brightness data for each pixel. Has a digital camera system. In the digital camera system which attached the polarizer of Claim 1 or 2,
The camera system is a digital camera system used as a surface roughness display device for visualizing the surface roughness of a subject. In the digital camera system which attached the polarizer of Claim 1 or 2,
The camera system is a digital camera system used as a curved surface display device for visualizing a curved surface of a surface of a subject.

Images