WO2018042727A1

WO2018042727A1 - Image pickup device, image processing system, image pickup method, and image processing method

Info

Publication number: WO2018042727A1
Application number: PCT/JP2017/010125
Authority: WO
Inventors: 美馬　邦啓; 島崎　浩昭; 田中　義人
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2016-08-31
Filing date: 2017-03-14
Publication date: 2018-03-08
Also published as: JP2019192948A

Abstract

Disclosed is an image pickup device (100) that is provided with: a first image generation unit (10A), which includes a first image pickup unit (131a) capable of picking up an image of a first image pickup region extending in the first direction, and a first illuminating unit (14a) that illuminates the first image pickup region from the first illuminating direction; a second image generation unit (10B), which includes a second image pickup unit (131b) capable of picking up an image of a second image pickup region extending in the second direction that is different from the first direction, and a second illuminating unit (14b) that illuminates the second image pickup region from the second illuminating direction in plan view of the second image pickup region, said second illuminating direction being different from the first illuminating direction; and a drive unit (16) that integrally moves, in the predetermined moving direction, the first image generating unit (10A) and the second image generating unit (10B).

Description

Imaging apparatus, image processing system, imaging method, and image processing method

The present disclosure relates to an imaging device that generates image data of an object, an image processing system that uses the imaging device, an imaging method that generates image data of an object, and an image processing method that generates and processes image data of the object.

Patent Document 1 discloses an image processing apparatus that generates stereoscopic image data by adding height direction information to a planar original image. This image processing apparatus adds shadow information and texture to each region separated based on focus information of original image data by adding height information based on contrast height (brightness or darkness) or based on object contour information. Can be expressed realistically.

JP 2016-63522 A

An imaging apparatus according to an embodiment of the present disclosure includes a first imaging unit capable of imaging a first imaging area extending in a first direction, and a first illuminating the first imaging area from a first illumination direction. A first image generation unit including an illumination unit; a second imaging unit capable of imaging a second imaging region extending in a second direction different from the first direction; and the second imaging. A second illumination unit that illuminates the second imaging region from a second illumination direction different from the first illumination direction when the region is viewed from above, and A drive unit that integrally moves the first image generation unit and the second image generation unit in a predetermined movement direction.

The image processing system according to the present disclosure includes an imaging device and an image processing device. The imaging apparatus includes a first imaging unit capable of imaging a first imaging area extending in a first direction, and a first illumination unit that illuminates the first imaging area from a first illumination direction. , A second imaging unit capable of imaging a second imaging region extending in a second direction different from the first direction, and an upper surface of the second imaging region. A second illumination unit that illuminates the second imaging region from a second illumination direction different from the first illumination direction when viewed, and the first image And a drive unit that integrally moves the generation unit and the second image generation unit in the movement direction. The first image generation unit shoots an object having a convex portion in the first imaging region by illuminating the first illumination unit with the first illumination unit, and shows first shadow information indicating a shadow by the convex portion. The second image generation unit illuminates the object in the second imaging area with the second illumination unit and shoots the second shadow indicating the shadow by the convex part. Generate information.

The imaging method according to the present disclosure illuminates an object in the first imaging area from the first illumination direction while moving in a predetermined movement direction in the first imaging area extending in the first direction. The first image is scanned and the second image area extending in the second direction different from the first direction is moved in the moving direction integrally with the first image area. In this case, the object in the second imaging region is photographed by illuminating from a second illumination direction different from the first illumination direction when the object is viewed from above, and a second image is scanned and imaged. To do.

In the image processing method according to the present disclosure, in a first imaging region extending in a first direction, an object having a convex portion on a surface is photographed by illuminating from a first illumination direction, and the convex portion is used. First shadow information indicating a shadow is generated, and the first object is viewed when the object is viewed from above in a second imaging region extending in a second direction different from the first direction. And illuminating from a second illumination direction different from the illumination direction, generating second shadow information indicating a shadow by the convex portion, an angle formed by the first illumination direction and the main surface of the object, and Height information indicating the height of the surface of the object based on the first shadow information, an angle formed by the second illumination direction and the main surface of the object, and the second shadow information. Is generated.

The imaging apparatus, image processing system, imaging method, and image processing method according to the present disclosure can generate object image data with high accuracy.

FIG. 1 is a block diagram illustrating a configuration of an image processing system and a printing apparatus connected to the image processing system according to the first embodiment. FIG. 2 is a diagram for explaining imaging of a picture by the imaging apparatus according to the first embodiment. FIG. 3 is a diagram for explaining a drive unit of the imaging apparatus according to the first embodiment. FIG. 4 is a diagram for explaining the positional relationship between the first image generation unit and the second image generation unit of the imaging apparatus according to the first embodiment. FIG. 5 is a diagram for explaining the illumination angle of the imaging apparatus according to the first embodiment. FIG. 6 is a diagram for explaining a moving direction during imaging of the imaging apparatus according to the first embodiment. FIG. 7 is a flowchart for explaining the operation of the imaging apparatus according to the first embodiment. FIG. 8A is a diagram for explaining a relationship between an illumination angle and a shadow at the time of imaging in the first embodiment. FIG. 8B is a diagram for explaining a relationship between an illumination angle and a shadow at the time of imaging in the first embodiment. FIG. 9 is a flowchart for explaining the operation of the image processing apparatus according to the first embodiment. FIG. 10 is a diagram for explaining an allowable angle between imaging regions. FIG. 11 is a diagram for describing the positional relationship between the first image generation unit and the second image generation unit of an imaging apparatus according to another embodiment. FIG. 12 is a diagram for explaining a positional relationship among a first image generation unit, a second image generation unit, and a third image generation unit of an imaging apparatus according to another embodiment. FIG. 13 is a diagram for explaining the problem.

Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. In addition, the inventors provide the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims. Absent.

(Task)
For example, a painting such as an oil painting is an object having a convex portion such as the thickness of a paint or the trace of a brush. By imaging such an object (subject) by illuminating it with light, image data including the shadow of the object can be generated. Here, when the object 410 (painting) includes a convex portion 412 having a low height in the vicinity of the convex portion 411 having a high height, as shown in FIG. There is a case where it is hidden by the shadow of the part 411. In such a case, the image data does not indicate the shadow information of the convex portion 412. In order to generate image data indicating the shadow information of the convex portion 412, it is necessary to rotate the object 410 as shown in the lower part of the drawing of FIG. 13B and again capture the shadows of the convex portion 411 and the convex portion 412. There is. In this case, it is necessary to rotate the object 410 with high accuracy. If the accuracy of the rotation is inaccurate, a convex portion is formed when combining (a) image data captured in the state above the paper surface in FIG. 13 and (b) image data captured in the state below the paper surface in FIG. 411 and the convex part 412 are displaced. Due to the misalignment, image data including accurate shadows of the convex portions 411 and the convex portions 412 cannot be generated.

The imaging device of the present disclosure can capture an object and generate highly accurate image data. In particular, when the object is a painting such as an oil painting, that is, when the object has a plurality of convex portions, the heights of these convex portions are different from each other, and these convex portions are adjacent to each other or in the vicinity thereof. Even in some cases, the imaging device generates image data including the shadow of the convex portion with high accuracy. Specifically, in the imaging device of the present disclosure, an object having a convex portion (for example, a painting such as an oil painting) is captured while simultaneously moving a plurality of image generation units in a state where the positional relationship is fixed. To do. At this time, each of the plurality of image generation units illuminates an object from each of a plurality of directions and images it. That is, the direction in which one image generation unit illuminates the object and the direction in which the other image generation unit illuminates the object are different when the object is viewed from above. Accordingly, in the imaging device of the present disclosure, the shadows of the convex portions that overlap when captured by one image generation unit do not overlap when captured by another image generation unit. That is, the imaging apparatus acquires a plurality of pieces of image data including different shade information. Since these image data are generated in a state where the positional relationship among the plurality of image generation units is fixed, positional deviation is unlikely to occur and the image data is synthesized with high accuracy. The image processing system according to the present disclosure generates highly accurate height data based on the plurality of image data. Hereinafter, details of the present disclosure will be described. Note that the imaging apparatus of the present disclosure can also generate image data of an object without a convex portion with high accuracy. However, in the following embodiment, a picture having a convex portion is described as an example of an object to be image processed.

(Embodiment 1)
1. Configuration FIG. 1 shows a configuration of an image processing system 1 according to the first embodiment. The image processing system 1 according to the first embodiment includes an imaging device 100 that captures the surface of a painting (an example of an object) such as an oil painting and generates image data, and the generated image data to process information on the painting (high Image processing apparatus 200 for outputting color data and color image data). The image processing apparatus 200 is connected to a printing apparatus 300 that duplicates a picture by printing based on output information of the image processing apparatus 200, for example.

The imaging apparatus 100 according to the first embodiment is a scanner using a line scan camera that captures an image of a linear region. The imaging apparatus 100 receives an instruction to start imaging, outputs an input / output unit 11 that outputs image data of a captured picture, a control unit 12 that controls the entire imaging apparatus 100, and a first that illuminates and images a painting. The image generation unit 10A and the second image generation unit 10B, and the drive unit 16 that moves the first image generation unit 10A and the second image generation unit 10B integrally.

The input / output unit 11 includes an input unit 11a and a communication unit 11b. The input unit 11a is a keyboard, a mouse, a touch panel, or the like. The communication unit 11b includes an interface circuit for performing communication with an external device in conformity with a predetermined communication standard (for example, Local Area Network: LAN, WiFi). For example, the imaging apparatus 100 inputs an instruction to start imaging via the input unit 11a or the communication unit 11b, and outputs image data generated by imaging a picture from the communication unit 11b.

Based on the input imaging start instruction, the control unit 12 causes the drive unit 16 to move the first image generation unit 10A and the second image generation unit 10B together while moving the first image generation unit. 10A and the 2nd image generation part 10B are made to image a picture in the state which illuminated the picture. The control unit 12 can be realized by a semiconductor element or the like. The function of the control unit 12 may be configured only by hardware, or may be realized by combining hardware and software. The control unit 12 is, for example, a microcomputer, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field-Programmable Gate Array), and an ASIC (AppliedCritical Indication). The

The first image generation unit 10A includes a camera 13a that captures a picture and generates image data, and a first illumination unit 14a and a third illumination unit 15a that illuminate the painting. In the first image generation unit 10A, the camera 13a includes an imaging unit 131a and a memory 132a. The imaging unit 131a includes, for example, a CCD (Charge Coupled Device) line sensor or a CMOS (Complementary Metal Oxide Semiconductor) line sensor. The imaging unit 131a scans and captures a picture line by line, and captures image data of the picture. The image data captured by the imaging unit 131a is stored in the memory 132a. For example, the camera 13a captures a picture, acquires color information (RGB or CMYK) for each pixel, and stores it in the memory 132a. The memory 132a is realized by, for example, a RAM (Random Access Memory), a DRAM (Dynamic Random Access Memory), a ferroelectric memory, a flash memory, a magnetic disk, or a combination thereof.

The first illumination unit 14a and the third illumination unit 15a are scanning illumination light sources. Specifically, the first illuminating unit 14a and the third illuminating unit 15a are, for example, a high color rendering straight tube fluorescent lamp or a line LED illumination in which high color rendering white light emitting diodes (LEDs) are linearly arranged. is there. When the camera 13a captures a picture in a state where the picture is illuminated by the first lighting unit 14a or the third lighting unit 15a, the camera 13a may generate image data of an image including a shadow of a convex portion of the painting. it can.

The second image generation unit 10B includes a camera 13b that captures a picture and generates image data, and a second illumination unit 14b and a fourth illumination unit 15b that illuminate the painting. The internal configuration of the second image generation unit 10B (that is, the camera 13b, the second illumination unit 14b, and the fourth illumination unit 15b) is the internal configuration of the first image generation unit 10A (except for the arrangement positions thereof) ( That is, it is the same as the camera 13a, the 1st illumination part 14a, and the 3rd illumination part 15a).

The drive unit 16 includes the camera 13a, the first illumination unit 14a, and the third illumination unit 15a of the first image generation unit 10A, and the camera 13b, the second illumination unit 14b, and the fourth of the second image generation unit 10B. It is connected to the illumination unit 15b. The drive unit 16 is controlled by the control unit 12 to move the first image generation unit 10A and the second image generation unit 10B integrally. Thereby, it becomes possible for the camera 13a and the camera 13b to capture the picture one line at a time while moving.

The imaging apparatus 100 generates two-dimensional image data from the image data scanned by the camera 13a for each line and captured in the memory 132a, and also obtained from the image data scanned by the camera 13b for each line and captured in the memory 132b. Two-dimensional image data is generated, and the two image data are output from the communication unit 11b.

The image processing apparatus 200 inputs image data and outputs height information indicating the height of the surface of the object, and controls the entire image processing apparatus 200 and processes two input image data. Then, a control unit 22 that generates height information indicating the height of the surface of the object, and a memory 23 are included. The input / output unit 21 includes an input unit 21a and a communication unit 21b. The input unit 21a is a keyboard, a mouse, a touch panel, or the like. The communication unit 21b includes an interface circuit for performing communication with an external device in compliance with a predetermined communication standard (for example, LAN, WiFi). For example, when the user inputs an instruction for capturing image data via the input unit 21a, the image processing apparatus 200 outputs an image data capture request to the imaging device 100 via the communication unit 21b. The image processing apparatus 200 receives the image data transmitted from the imaging apparatus 100 via the communication unit 21b.

The control unit 22 calculates the height of the surface of the painting (the height of the convex portion) from the length of the shadow included in the image of the received image data, and generates height information indicating the calculated height. Specifically, height data that represents the height of the surface of the painting as a numerical value for each pixel is generated as the height information. For example, height data is generated such that the higher the height of the convex portion, the larger the numerical value. The generated information is stored in the memory 23. Further, the control unit 22 outputs the generated height information to the printing apparatus 300 via the communication unit 21b. The control unit 22 can be realized by a semiconductor element or the like. The function of the control unit 22 may be configured only by hardware, or may be realized by combining hardware and software. The control unit 22 includes, for example, a microcomputer, CPU, MPU, DSP, FPGA, and ASIC. The memory 23 is realized by, for example, a RAM, a DRAM, a ferroelectric memory, a flash memory, a magnetic disk, or a combination thereof.

The printing apparatus 300 prints an image that reproduces the height of the surface of the painting (including the convex portion) based on the height information (height data) received from the image processing apparatus 200. The printing apparatus 300 is, for example, a UV inkjet printer that uses UV ink that is cured by being irradiated with ultraviolet rays. The printing apparatus 300 prints an image including a convex portion by increasing the thickness of the ink as the height value indicated by the height data is larger by multilayer printing.

FIG. 2 shows a state where the imaging apparatus 100 is capturing a picture 400. FIG. 3 shows a schematic side view of the imaging apparatus 100. 2 and 3, the right direction of the painting 400 is defined as a positive X direction, and the left direction of the painting 400 is defined as a negative X direction. The downward direction of the painting 400 is a positive Y direction, and the upward direction of the painting 400 is a negative Y direction. Let the perpendicular direction of the painting be the Z direction. The Y direction is a main scanning direction (so-called scanning direction) for each line of the imaging apparatus 100, and the X direction is a direction (sub scanning direction) orthogonal to the Y direction. The main scanning direction and the sub-scanning direction are moving directions of the imaging apparatus 100. As shown in FIGS. 2 and 3, the drive unit 16 of the imaging device 100 includes a first guide rail 16b extending in the Y direction, a first movable body 16a moving forward and backward along the first guide rail 16b, and X The second guide rail 16c extends in the direction, the second movable body 16d moves forward and backward along the second guide rail 16c, and the frame 16e connected to the first movable body 16a. The first movable body 16a and the second movable body 16d move forward and backward by driving a motor or the like. Both the first image generation unit 10A and the second image generation unit 10B are fixed to the frame 16e. Thereby, the drive unit 16 moves the first image generation unit 10A and the second image generation unit 10B integrally. 10 A of 1st image generation parts image the painting 400 directly under the camera 13a. That is, the first image generation unit 10A images the painting 400 in the imaging region L1 (first imaging region) for one line immediately below the camera 13a. Similarly, the second image generation unit 10B captures the painting 400 directly below the camera 13b. That is, the second image generation unit 10B images the painting 400 in the imaging area L2 (second imaging area) for one line immediately below the camera 13b.

FIG. 4 shows a schematic top view of the imaging apparatus 100. That is, FIG. 4 shows the upper surface of the imaging apparatus 100 viewed from a direction (Z direction) perpendicular to the main surface of the painting 400. The main surface of the painting 400 is the XY plane of the painting 400 and is a plane that ignores the convex portion. The camera 13a of the first image generation unit 10A can capture an imaging region L1 that extends in a first direction that intersects the main scanning direction at an angle of 45 degrees. The first illumination unit 14a and the third illumination unit 15a are arranged on both sides of the camera 13a so that the longitudinal directions of the first illumination unit 14a and the third illumination unit 15a are parallel to the extending direction of the imaging region L1. Is done. The first illumination unit 14a and the third illumination unit 15a illuminate the imaging region L1 from both sides of the camera 13a. The direction in which the first illumination unit 14a illuminates the imaging region L1 is defined as an illumination direction D1 (first illumination direction). The direction in which the third illumination unit 15a illuminates the imaging region L1 is defined as an illumination direction D3 (third illumination direction). The illumination direction D1 and the illumination direction D3 differ by 180 degrees when the painting 400 is viewed from above.

The camera 13b of the second image generation unit 10B can image the imaging region L2 extending in the second direction. The second direction is a different direction on the same plane as the first direction (on the XY plane). The second direction intersects the first direction at a predetermined angle (90 degrees in the first embodiment). The second illumination unit 14b and the fourth illumination unit 15b are arranged on both sides of the camera 13b so that the longitudinal directions of the second illumination unit 14b and the fourth illumination unit 15b are parallel to the extending direction of the imaging region L2. Is done. The second illumination unit 14b and the fourth illumination unit 15b illuminate the imaging region L2 from both sides of the camera 13b. The direction in which the second illumination unit 14b illuminates the imaging region L2 is defined as an illumination direction D2 (second illumination direction). A direction in which the fourth illumination unit 15b illuminates the imaging region L2 is defined as an illumination direction D4. The illumination direction D2 and the illumination direction D4 differ by 180 degrees when the painting 400 is viewed from above.

Here, the relationship between the illumination direction D1 to the illumination direction D4 will be described. The illumination direction D1 is a direction different from the illumination direction D2 and the illumination direction D4 when the object 400 is viewed from above. The illumination direction D1 is a direction that is not parallel to the illumination direction D2 and the illumination direction D4 when the object 400 is viewed from above. In the first embodiment, the illumination direction D1 is a direction that intersects the illumination direction D2 and the illumination direction D4 at an angle of 90 degrees when the object 400 is viewed from above. Similarly, the illumination direction D3 is a direction different from the illumination direction D2 and the illumination direction D4 when the object 400 is viewed from above. The illumination direction D3 is a direction that is not parallel to the illumination direction D2 and the illumination direction D4 when the object 400 is viewed from above. In the first embodiment, the illumination direction D3 is a direction that intersects the illumination direction D2 and the illumination direction D4 at an angle of 90 degrees when the object 400 is viewed from above. Note that the relationship in which a certain direction intersects with another direction includes a relationship in which an arrow indicating a certain direction and an arrow indicating the other direction intersect on the extension lines in the respective positive and negative directions.

In the first embodiment, the imaging area L1 and the imaging area L2 have the same size. The first image generation unit 10A and the second image generation unit 10B are arranged side by side in the main scanning direction (Y direction) during imaging. In addition, an angle formed between the extending direction of the imaging region L1 and the main scanning direction (Y direction) during imaging, and an angle formed between the extending direction of the imaging region L2 and the main scanning direction (Y direction) during imaging. And 45 degrees respectively. With such a configuration, the imaging apparatus 100 generates image data at a time with different shadow directions 90 degrees as shown in (a) above and (b) below in FIG. 13 without rotating the painting 400. it can. That is, the imaging apparatus 100 can generate two pieces of image data whose shadow directions differ by 90 degrees in the top view of the painting 400 depending on the illumination direction D1 and the illumination direction D2 with respect to the object. Similarly, the imaging apparatus 100 can generate two pieces of image data that are 90 degrees different in shadow direction in the top view of the painting 400 depending on the illumination direction D3 and the illumination direction D4 with respect to the object.

The imaging device 100 is configured so that the illumination light of the first illumination unit 14a and the third illumination unit 15a of the first image generation unit 10A does not leak into the imaging region L2 of the second image generation unit 10B and the second image In order to prevent the illumination light of the second illumination unit 14b and the fourth illumination unit 15b of the generation unit 10B from leaking to the imaging region L1 of the first image generation unit 10A, the first image generation unit 10A and the second image generation unit 10B A light shielding member 17 that shields illumination light is further provided between the image generation units 10B.

FIG. 5 schematically shows the first image generation unit 10A and the second image generation unit 10B of the imaging apparatus 100 viewed from the direction of the arrow V1 in FIG. In FIG. 5, the light shielding member 17 is omitted. In the first embodiment, the lighting direction D1 (first lighting direction) to the imaging region L1 (for one line) of the painting 400 directly under the camera 13a by the first lighting unit 14a and the entire surface of the painting 400 placed horizontally. The smaller angle (illumination angle) θ among the angles with respect to the (main surface), the illumination direction D3 (third illumination direction) to the imaging region L1 by the third illumination unit 15a, and the entire surface of the painting 400 The imaging region L1 is illuminated such that the smaller angle (illumination angle) θ among the angles is a constant angle. This constant angle θ is, for example, 30 °. The first illumination unit 14a and the third illumination unit 15a respectively illuminate the imaging region L1 directly below the camera 13a from the diagonally upper right side direction and diagonally lower left side direction of the imaging region L1 (ie, painting). In this way, the first image generation unit 10A can generate shaded image data by illuminating the imaging region L1 with respect to the painting 400 from diagonally upward or diagonally downward. Similarly, the second image generation unit 10B has a smaller angle (illumination) among the angles between the illumination direction D2 (second illumination direction) to the imaging region L2 by the second illumination unit 14b and the entire surface of the painting 400. Angle) θ and the smaller angle (illumination angle) θ among the angles between the illumination direction D4 (fourth illumination direction) to the imaging region L2 by the fourth illumination unit 15b and the entire surface of the painting 400 are constant angles. Thus, the imaging region L2 is illuminated. This constant angle θ is, for example, 30 °. The illumination angle θ of the first illuminating unit 14a to the fourth illuminating unit 15b may be an angle at which a shadow appears due to illumination, and is not limited to 30 °, but 20 ° to 45 ° is particularly suitable.

In the first image generation unit 10A, the camera 13a, the first illumination unit 14a, and the third illumination unit 15a are fixed to the frame 16e. In addition, the drive part 16 can also have the 3rd movable body 16f which makes the 1st illumination part 14a and the 3rd illumination part 15a raise / lower. The camera 13b, the second illumination unit 14b, and the fourth illumination unit 15b of the second image generation unit 10B are fixed to the frame 16e, similarly to the first image generation unit 10A. When the camera 13a and the camera 13b scan and capture the painting 400, the control unit 12 controls the drive unit 16, and the camera 13a and the camera 13b, the first illumination unit 14a, the second illumination unit 14b, and the third illumination unit 15a. , And the fourth illuminating unit 15b are integrally translated in the main scanning direction at a constant speed.

2. Operation 2.1 Operation of Imaging Device FIG. 6 shows a moving direction (main scanning direction) of the imaging device 100 during imaging. The imaging device 100 captures an image of the painting 400 while moving in the vertical direction (Y direction) of the painting 400 while the painting 400 is fixed. When the imaging apparatus 100 captures an image in the positive Y direction from the upper end to the lower end of the painting 400, the imaging apparatus 100 moves slightly in the positive X direction and captures an image in the negative Y direction from the lower end to the upper end of the painting 400. This is repeated from the start position to the end position, and the entire painting 400 is imaged. The main scanning direction is not limited to the vertical direction of the painting 400, and may be any direction. For example, the main scanning direction may be a vertical direction, a horizontal direction, or an oblique direction depending on the arrangement or orientation of the painting 400.

FIG. 7 shows a picture imaging process performed by the imaging apparatus 100. First, the painting 400 imaged by the imaging device 100 is fixed directly below the imaging device 100 as shown in FIG. 2, for example.

The imaging device 100 illuminates the imaging region L1 and the imaging region L2 from one direction in each of the first image generation unit 10A and the second image generation unit 10B, and includes image data (shadow image) including the shadow of the convex portion. Data) is generated (S701). Specifically, the imaging apparatus 100 captures the painting 400 by moving the first image generation unit 10A and the second image generation unit 10B from the start position to the end position in FIG. . At this time, in the first image generation unit 10A, the imaging device 100 scans and captures the painting 400 with the camera 13a in a state where the imaging region L1 is illuminated only by the first illumination unit 14a, and the first image data ( Shadow image data) is generated. Furthermore, when the imaging device 100 generates the first image data, at the same time, in the second image generation unit 10B, the imaging region L2 is illuminated only by the second illumination unit 14b, and the painting 400 is created by the camera 13b. Scan imaging is performed to generate second image data (shadow image data). The first image data and the second image data are two-dimensional image data including shadows of the convex portions of the painting 400.

Next, the imaging device 100 illuminates the imaging region L1 and the imaging region L2 from other directions in each of the first image generation unit 10A and the second image generation unit 10B, and includes an image including a shadow of the convex portion. Data is generated (S702). Specifically, the imaging apparatus 100 causes the drive unit 16 to again perform the first image generation unit 10A and the first image generation unit 10A and the first image generation unit 10A in the reverse direction from the start position to the end position in FIG. The painting 400 is imaged while moving the second image generation unit 10B. At this time, in the first image generation unit 10A, the imaging apparatus 100 scans and captures the painting 400 with the camera 13a in a state where the imaging region L1 is illuminated only by the third illumination unit 15a, and obtains third image data ( Shadow image data) and the second image generator 10B scans and images the painting 400 with the camera 13b in a state where the imaging region L2 is illuminated only by the fourth illumination unit 15b. Shadow image data) is generated. The third image data and the fourth image data are two-dimensional image data including the shadow of the convex portion of the painting 400.

Thereafter, the imaging apparatus 100 illuminates the imaging region L1 or the imaging region L2 from both directions in at least one of the first image generation unit 10A and the second image generation unit 10B, and includes the shadow of the convex portion. No image data is generated (S703). Specifically, the imaging device 100 uses the drive unit 16 to perform the first image generation unit 10A and the second image generation unit 10B from the start position to the end position in FIG. 6 or from the end position to the start position in FIG. The image 400 is picked up again while moving. At this time, the imaging apparatus 100 scans and images the painting 400 in one or both of the first image generation unit 10A and the second image generation unit 10B, and generates fifth image data (color image data). . For example, in the first image generation unit 10A, the camera 13a is illuminated by the first illumination unit 14a and the third illumination unit 15a simultaneously from the upper and lower sides of the imaging region L1 to the imaging region L1 at the illumination angle θ. The painting 400 is scanned and imaged to generate fifth image data (color image data). Alternatively, in the second image generation unit 10B, the camera 13b is illuminated by the second illumination unit 14b and the fourth illumination unit 15b simultaneously from the upper and lower sides of the imaging region L2 to the imaging region L2 at the illumination angle θ. The painting 400 may be scanned and imaged to generate fifth image data. Further, both the first image generation unit 10A and the second image generation unit 10B may generate the fifth image data, respectively. The fifth image data is two-dimensional image data (color image data) that includes the color information (RGB or CMYK) of each pixel of the painting 400 and does not include the shadow of the convex portion. When both the first illumination unit 14a and the third illumination unit 15a, or both the second illumination unit 14b and the fourth illumination unit 15b illuminate the painting 400 at the same time, image data that does not include the shadow of the convex portion is obtained. .

The imaging apparatus 100 outputs the generated first image data to fifth image data from the communication unit 11b (S704).

FIG. 8A shows a shadow generated when the first illumination unit 14a of the first image generation unit 10A illuminates the painting 400 from the diagonal upper right side. FIG. 8B shows a shadow generated when the third illumination unit 15a of the first image generation unit 10A illuminates the painting 400 from the diagonally lower left side. The painting 400 may include, for example, a convex portion (thickness portion of the paint) 401 formed by repeatedly painting colors such as an oil painting. By the first illumination unit 14a and the third illumination unit 15a of the first image generation unit 10A, the shadow S1 and the shadow S2 on the two direction sides (for example, the upper right side and the lower left side) of the convex portion 401 are obtained. Similarly, the second illumination unit 14b and the fourth illumination unit 15b of the second image generation unit 10B are 90 degrees with the shadow S1 and the shadow S2 of the first image generation unit 10A on the main surface (XY plane) of the painting 400. Shadows on two directions of different convex portions 401 (for example, upper left and lower right) are obtained. That is, according to the first embodiment, shadows in four directions are obtained with respect to the convex portion 401.

2.2 Operation of Image Processing Device The image processing device 200 calculates the height of the convex portion 401 of the painting as follows.

FIG. 9 shows height data generation processing by the control unit 22 of the image processing apparatus 200. The image processing apparatus 200 receives the first to fourth image data (shadow image data) and the fifth image data (color image data) output from the imaging apparatus 100 (S901).

The image processing apparatus 200 calculates the shade length of the convex portion 401 from the first image data and the third image data generated by the first image generation unit 10A (S902). As illustrated in FIG. 8A, when the painting 400 is illuminated obliquely from the upper right side by the first lighting unit 14a, a shadow S1 of the convex portion 401 appears in one direction of the convex portion 401 (for example, the lower left side of the convex portion 401). For example, the image processing apparatus 200 calculates the length (for example, the number of pixels) of the shade S1 of the convex portion 401 based on the difference in luminance value or the color difference between the pixels of the first image data and the fifth image data. . Further, as shown in FIG. 8B, when the painting 400 is illuminated obliquely from the lower left side by the third illumination unit 15a, the shadow S2 of the convex portion 401 is formed in the other direction of the convex portion 401 (for example, the upper right side of the convex portion 401). appear. For example, the image processing apparatus 200 calculates the length (for example, the number of pixels) of the shade S2 of the convex portion 401 based on the difference in luminance value or the color difference between the pixels of the third image data and the fifth image data. .

The image processing apparatus 200 calculates the height H3 of the convex portion 401 based on the calculated lengths of the shadow S1 and the shadow S2 and the illumination angle θ of the first illumination unit 14a and the third illumination unit 15a (S903). . Specifically, the image processing apparatus 200 determines one direction (for example, the lower left side) of the convex portion 401 based on the calculated length (number of pixels) of the shadow S1 and the illumination angle θ of the first illumination unit 14a. The height H1 is calculated [H1 = the length of the shadow S1 × tan (θ)]. Similarly, the image processing apparatus 200 determines the height in the other direction (for example, the upper right side) of the convex portion 401 based on the calculated length (number of pixels) of the shadow S2 and the illumination angle θ of the third illumination unit 15a. H2 is calculated [H2 = length of shadow S2 × tan (θ)]. The image processing apparatus 200 interpolates the height H3 between the height H1 and the height H2 of the convex portion 401 in the two directions (upper right side and lower left side).

Next, the image processing apparatus 200 has a direction that is 90 degrees different from the first image generation unit 10A from the second image data, the fourth image data, and the fifth image data generated by the second image generation unit 10B ( For example, the length of the shadow of the convex portion 401 on the upper left side and the lower right side of the convex portion 401 is calculated (S904). Then, the image processing apparatus 200 calculates the height H3 of the convex portion 401 based on the calculated shadow length and the illumination angle θ of the second illumination portion 14b and the fourth illumination portion 15b (S905). Here, the first image generation unit 10A and the first image generation unit 10A 90 degrees from the length of the shadow of the projection 401 in a direction 90 degrees different from the first image generation unit 10A (for example, the upper left side and the lower right side of the projection 401). The heights of the convex portions 401 in different directions (for example, the upper left side and the lower right side of the convex portion 401) are calculated, and the height H3 between them is interpolated.

The image processing apparatus 200 combines the height information of the first image generation unit 10A and the second image generation unit 10B, calculates the height of the entire convex portion 401, and generates height data (S906). ). That is, the height H3 of the convex portion 401 calculated based on the image data of the first image generation unit 10A (result of S903) and the convex portion 401 calculated based on the image data of the second image generation unit 10B. From the height H3 (result of S905), the height of the entire convex portion 401 is calculated. For example, for each pixel of the painting 400, the height H3 (result of S903) obtained by interpolation based on the height of the upper right side and the lower left side of the convex portion 401, the upper left side and the lower right side of the convex portion 401 The total height of the convex 401 is calculated by comparing the height H3 (result of S905) obtained by interpolation based on the height of H, and selecting the higher value.

According to the first embodiment, the shadow image data (first image data, third image data) generated by the first image generation unit 10A is a high convex portion 411 as shown in FIG. The shadow image data (second image data and fourth image data) generated by the second image generation unit 10B is generated even in a state where the shadow of the low convex portion 412 overlaps the shadow of As shown in FIG. 13B, the shadow of the high convex portion 411 and the shadow of the low convex portion 412 are generated so as not to overlap. Therefore, by using both the shadow image data generated by the first image generation unit 10A and the shadow image data generated by the second image generation unit 10B, the overall height of the convex portion 401 is accurately calculated. be able to. The image processing apparatus 200 calculates the height of the entire image (all pixels constituting the image) of the painting 400 by calculating the height of all the convex portions 401 included in the painting 400, and the height of the entire image. Generate height data as information. For example, height data representing the height of each pixel in the image as a numerical value is generated.

Thereafter, the image processing apparatus 200 outputs the color image data and the height data to the printing apparatus 300 (S907).

2.3 Operation of Printing Device Based on the height data output from the image processing device 200, the printing device 300 increases the discharge amount of the transparent ink, for example, for the pixels with the larger numerical value of the height data. Is printed on a substrate (paper, cloth, plastic, etc.). As a result, pixels with a large amount of transparent ink discharged rise higher, and thus the convex portion 401 can be represented. The printing apparatus 300 prints an image using color ink on the upper surface of the transparent ink based on the color image data output from the image processing apparatus 200. Thereby, the painting 400 which reproduced the convex part 401 can be duplicated.

3. Effects As described above, the imaging apparatus 100 according to the first embodiment includes the first imaging unit (imaging unit 131a) capable of imaging the first imaging region L1 extending in the first direction, and the first imaging. A first image generation unit 10A including a first illumination unit 14a that illuminates the region L1 from the first illumination direction D1, and a second imaging region L2 that extends in a second direction different from the first direction. And a second illumination direction D2 different from the first illumination direction D1 when the second imaging region L2 is viewed from above the second imaging region L2. The second image generation unit 10B including the second illumination unit 14b that illuminates the first image generation unit 10B, and the first image generation unit 10A and the second image generation unit 10B in predetermined moving directions (main scanning direction and sub-operation direction). And a drive unit 16 that moves the body integrally. Thereby, the imaging device 100 can perform imaging in a state where illumination is performed from a plurality of different directions by the first illumination unit 14a and the second illumination unit 14b. That is, the imaging apparatus 100 can capture images in different illumination directions D1 and D2 as shown in (a) above and (b) below in FIG. 13 without rotating an object (for example, a picture). become. Thereby, image data can be synthesized with high accuracy based on a plurality of image data. In particular, even when the object has a plurality of convex portions and there are convex portions having different heights in the vicinity, image data including a shadow can be generated with high accuracy based on the plurality of image data. Further, since the positional relationship between the first image generation unit 10A and the second image generation unit 10B is fixed, the image data generated by the first image generation unit 10A and the second image generation unit 10B is synthesized. In this case, it is difficult for image displacement to occur. Therefore, the imaging apparatus 100 can generate image data including a shadow with higher accuracy. If the illumination direction D1 and the illumination direction D2 are different directions when the object is viewed from above, it is possible to avoid the shadows of the convex portions from overlapping. In particular, if the illumination direction D1 and the illumination direction D2 are non-parallel directions when the object is viewed from the top, it is possible to further avoid the shadows of the convex portions from overlapping.

The first image generation unit 10A shoots an object having a convex portion in the first imaging region L1 by illuminating with the first illumination unit 14a, and generates first shadow information indicating a shadow by the convex portion. To do. The second image generation unit 10B shoots an object in the second imaging region L2 by illuminating with the second illumination unit 14b, and generates second shadow information indicating a shadow by the convex portion. As a result, even when there are convex portions having different heights in the vicinity, image data including shadows can be generated with high accuracy without causing image positional deviation.

The first image generation unit 10A is arranged on the opposite side of the first illumination unit 14a via the imaging unit 131a, and illuminates the first imaging region L1 from the third illumination direction D3. 15a is further included. The first image generation unit 10A shoots an object in the first imaging region L1 by illuminating with the third illumination unit 15a, and generates third shadow information indicating a shadow by the convex portion. The second image generation unit 10B is disposed on the opposite side of the second illumination unit 14b via the imaging unit 131b, and includes a fourth illumination unit 15b that illuminates the second imaging region L2 from the fourth illumination direction D4. In addition. The second image generation unit 10B shoots an object in the second imaging region L2 by illuminating with the fourth illumination unit 15b, and generates fourth shadow information indicating a shadow by the convex portion. Thereby, it can image by illuminating from two different directions (illumination direction D1 and illumination direction D3) with respect to the first imaging region L1. Moreover, it can image by illuminating from two different directions (illumination direction D2, illumination direction D4) with respect to the second imaging region L2. That is, more shadow information (first shadow information to fourth shadow information) can be generated. Therefore, image data can be generated with higher accuracy.

The imaging apparatus 100 according to the first embodiment simultaneously performs imaging of the first imaging area L1 by the first image generation unit 10A and imaging of the second imaging area L2 by the second image generation unit 10B. Thereby, a plurality of image data can be generated in a short time.

The first direction (the direction in which the imaging region L1 extends) and the longitudinal directions of the first illumination unit 14a and the third illumination unit 15a are parallel to each other. The second direction (the direction in which the imaging region L2 extends) and the longitudinal directions of the second illumination unit 14b and the fourth illumination unit 15b are parallel to each other. That is, in the entire imaging region L1, the distance from the first illumination unit 14a to each pixel in the imaging region L1 is the same. Similarly, in the entire imaging region L1, the distance from the third illumination unit 15a to each pixel in the imaging region L1 is the same. Furthermore, in the entire imaging region L2, the distance from the second illumination unit 14b to each pixel in the imaging region L2 is the same. Similarly, in the entire imaging region L2, the distance from the fourth illumination unit 15b to each pixel in the imaging region L2 is the same. Therefore, all the pixels in the imaging region L1 and the imaging region L2 can be illuminated with a uniform angle and light amount. As a result, accurate shadow image data can be obtained.

The angle at which the first direction (the direction in which the imaging region L1 extends) and the second direction (the direction in which the imaging region L2 extends) intersects is 90 degrees. Therefore, according to the imaging apparatus 100 of Embodiment 1, it is possible to acquire image data in a state where the painting is illuminated from a direction different by 90 degrees without rotating the painting.

The first direction (the direction in which the imaging region L1 extends) and the second direction (the direction in which the imaging region L2 extends), and during the imaging of the first image generation unit 10A and the second image generation unit 10B The angle formed by the moving direction (main scanning direction) is 45 degrees. As described above, in the imaging apparatus 100 according to the first embodiment, the direction in which the imaging region L1 and the imaging region L2 extend intersects with the moving direction (main scanning direction) at the time of imaging at 45 degrees. The size of the imaging region L2 in the X direction is the same. The sizes of the imaging area L1 and the imaging area L2 in the Y direction are also the same. Therefore, the image processing apparatus 200 can easily combine the height information of the image data obtained by imaging in each of the imaging region L1 and the imaging region L2.

The first image generation unit 10A and the second image generation unit 10B of the first embodiment are arranged side by side in the main scanning direction. Thereby, height information can be easily synthesized.

The imaging apparatus 100 includes illuminations of a first illumination unit 14a, a second illumination unit 14b, a third illumination unit 15a, and a fourth illumination unit 15b) between the first image generation unit 10A and the second image generation unit 10B. A light shielding member 17 for shielding light is provided. The shielding member 17 can prevent the illumination light for illuminating the other imaging area from leaking into one imaging area, thereby reducing the shadow or changing the direction of the shadow. Therefore, it is possible to generate shadow image data with higher accuracy.

The image processing system 1 according to the first embodiment includes an imaging device 100, an angle formed by the illumination direction D1 of the first illumination unit 14a and the main surface of the object, first shadow information (first image data), and second illumination. The height information (height data) indicating the height of the surface of the object is generated based on the angle formed by the illumination direction D2 of the part 14b and the main surface of the object and the second shadow information (second image data). And an image processing apparatus 200. Furthermore, the image processing apparatus 200 in the image processing system 1 according to the first embodiment includes an angle formed by the illumination direction D3 of the third illumination unit 15a and the main surface of the object, third shadow information (third image data), and fourth. Height information (height data) is generated using both the angle formed by the illumination direction D4 of the illumination unit 15b and the main surface of the object and the fourth shadow information (fourth image data). According to the imaging apparatus 100 of the first embodiment, it is possible to accurately generate image data including a shadow. Therefore, according to the image processing system 1 of the first embodiment using the imaging apparatus 100, the height of the entire convex portion can be accurately calculated from the length of the shadow.

The image processing method according to the first embodiment illuminates and captures an object having a convex portion on the surface from the first illumination direction D1 in the first imaging region L1 extending in the first direction. 1st shadow information which shows the shadow by is produced | generated. In the image processing method, in the second imaging region L2 extending in a second direction different from the first direction, the second illumination different from the first illumination direction D1 when the object is viewed from above. Illumination is taken from the direction D2, and second shadow information indicating a shadow by the convex portion is generated. In this image processing method, the angle and first shadow information formed by the first illumination direction D1 and the main surface of the object, and the angle and second shadow information formed by the second illumination direction D2 and the main surface of the object. Based on the above, height information indicating the height of the surface of the object is generated. In this image processing method, the angle and first shadow information formed by the first illumination direction D1 and the main surface of the object, and the angle and second shadow information formed by the second illumination direction D2 and the main surface of the object. Based on the above, height information indicating the height of the surface of the object is generated. Furthermore, the image processing method according to the first embodiment shoots an object by illuminating an object from the third illumination direction D3 in the first imaging region L1, and generates third shadow information indicating a shadow due to the convex portion. Further, in this image processing method, in the second imaging region L2, when an object is viewed from the top, the object is illuminated and photographed from a fourth illumination direction D4 that is different from the third illumination direction D3. 4th shadow information which shows a shadow is produced | generated. In this image processing method, the angle and third shadow information formed by the third illumination direction D3 and the main surface of the object, and the angle and fourth shadow information formed by the fourth illumination direction D4 and the main surface of the object. Based on the above, height information indicating the height of the surface of the object is generated. In the image processing method according to the first embodiment, since image data including a shadow can be generated with high accuracy, the height of the entire convex portion can be accurately calculated from the length of the shadow.

Also, the first embodiment provides a duplication system including an imaging device 100, an image processing device 200, and a printing device 300. According to this duplication system, when duplicating a picture, the convex part (height of the picture surface) of the picture can be accurately reproduced. This makes it possible to generate a reproduction of a painting that is closer to the real thing.

In the first embodiment, illumination is performed from a plurality of different illumination directions to capture a plurality of shadow images including shadows of the convex portions of the painting. However, illumination from a plurality of different illumination directions is performed to shade the convex portions of the painting. A plurality of color images not including the image may be captured. For example, in the case of a painting using paints that have different colors depending on the illumination direction, a plurality of color images can be captured at once by using the imaging device 100 according to the first embodiment.

(Other embodiments)
As described above, the first embodiment has been described as an example of the technique disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments in which changes, substitutions, additions, omissions, and the like are appropriately performed. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1, and it can also be set as a new embodiment. Accordingly, other embodiments will be exemplified below.

In the first embodiment, as shown in Steps S701 to S703 of FIG. 7, the movement from the start position of the scan to the end position (or from the end position to the start position) is performed three times, thereby illuminating from four directions. Shadow image data (first image to fourth image data) and color image data (fifth image data) were obtained. However, the number of movements need not be three. Shadow image data (first to fourth image data) and color image data (first image data) from four directions (for example, upper right side and lower left side, upper left side and lower right side) that differ by 90 degrees with respect to the painting 400 (5 image data) can be acquired, the number of movements may be set arbitrarily. For example, every time it moves in the main scanning direction, the imaging region L1 and the imaging region L2 are illuminated with three types of illumination states (a state in which only the first illumination unit 14a and the second illumination unit 14b are illuminated, the third illumination unit 15a and the fourth illumination unit). By photographing in the state illuminated only by the illumination unit 15b and in the state illuminated by both the first illumination unit 14a and the third illumination unit 15a (or the state illuminated by both the second illumination unit 14b and the fourth illumination unit 15b), respectively. The shadow image data (first to fourth image data) and color image data (fifth image data) may be acquired by one movement from the start position to the end position of the scan.

In the first embodiment, an example of reproducing the color of a painting has been described. However, when only the three-dimensional shape of an object is reproduced without reproducing the color of an object having a convex portion, processing related to generation of color image data (steps) S703) can be omitted.

In the first embodiment, the intersection angle in the extending direction of the imaging region L1 and the imaging region L2 is 90 degrees. However, the intersection angle may not be just 90 degrees and may be substantially 90 degrees. . FIG. 10 shows an allowable range of the crossing angle according to the number of pixels of the imaging unit 131a and the imaging unit 131b. This allowable range indicates an angle range that can be said to be substantially 90 degrees. FIG. 10 shows an imaging when the error of the position of the convex portion on the XY plane can be tolerated to 1 mm when the image data captured by the imaging unit 131a and the imaging unit 131b is captured at a resolution of 1000 dpi. The tolerance | permissible_range of the intersection angle of the area | region L1 and the imaging area L2 is shown. In this case, the error in the position of the convex portion can be calculated by dividing the number of pixels of the imaging unit by the value of resolution of image data 1000 dpi × number of pixels of the imaging unit × tan (intersection angle error), for example, the imaging unit 131a. If the number of pixels of the imaging unit 131b is 7000, the allowable range of the crossing angle is 89.5 ° to 90.5 °. The intersection angle between the imaging regions L1 and L2 may be determined within a range of allowable angles according to the number of pixels of the imaging unit 131a and the imaging unit 131b as illustrated in FIG.

In the first embodiment, the first image generation unit 10A and the second image generation unit 10B are arranged side by side with respect to the main scanning direction (along the Y direction) as shown in FIG. These may be arranged in other positional relationships. FIG. 11 shows different positional relationships between the first image generation unit 10A and the second image generation unit 10B. As shown in FIG. 11, the first image generation unit 10A and the second image generation unit 10B may be arranged side by side (along the X direction) with respect to the main scanning direction. At this time, if the direction in which the imaging region L1 and the imaging region L2 extend and the main scanning direction intersect with each other at 45 degrees, the size in the X direction and the size in the Y direction of the imaging region L1 and the imaging region L2 are the same. become. Therefore, it becomes possible to easily combine the height information of the image data obtained by imaging in each of the imaging area L1 and the imaging area L2.

As shown in FIG. 11, the arrangement in which the first image generation unit 10A and the second image generation unit 10B are arranged on the left and right in the main scanning direction is the first image generation unit 10A and the second image generation unit 10A in the arrangement shown in FIG. This can be realized by changing the main scanning direction of the second image generator 10B to the X direction instead of the Y direction. The first image generation unit 10A and the second image generation unit 10B are arranged in the front and rear direction with respect to the main scanning direction as shown in FIG. 4, or are arranged in the right and left direction with respect to the main scanning direction as shown in FIG. This may be determined according to the aspect ratio of the picture to be captured. For example, when capturing a vertically long picture, it may be arranged in the front-rear direction with respect to the main scanning direction.

In the first embodiment, the example in which the imaging apparatus 100 includes the two image generation units of the first image generation unit 10A and the second image generation unit 10B has been described. However, the number of image generation units is not limited to two. . For example, the imaging apparatus 100 may include three or more image generation units. FIG. 12 illustrates a positional relationship when the imaging apparatus 100 includes three image generation units (a first image generation unit 10A, a second image generation unit 10B, and a third image generation unit 10C). The third image generation unit 10C includes an imaging unit (third imaging unit), an illumination unit 14c (fifth illumination unit), and an illumination unit 15c (sixth illumination unit). The imaging unit (third imaging unit) images the third imaging region L3 extending in the third direction. The illumination unit 14c and the illumination unit 15c illuminate the third imaging region L3. The directions in which the imaging regions L1 to L3 extend are different. As shown in FIG. 12, the imaging apparatus 100 causes three image generation units (first image generation unit 10A to third image generation unit 10C) to extend in the respective imaging regions L1 to L3. May be arranged so as to intersect at 60 degrees. Thereby, it becomes possible to calculate the height of the convex portion with higher accuracy.

In Embodiment 1, a painting is described as an example of an imaging target of the imaging device 100 of the present disclosure, but the imaging target is not limited to a painting. The idea of the imaging apparatus 100 of the present disclosure can be applied particularly when imaging a planar object having a convex portion. For example, examples of the object include art objects such as sculpture, wallpaper, floor and ceiling crosses, and the like. In the first embodiment, a picture is described as an example of an image processing target of the image processing system 1 of the present disclosure, but the image processing target is not limited to a picture. The idea of the image processing system 1 of the present disclosure can be applied when generating height information of the surface of a planar object having a convex portion.

The replication system of the present disclosure can be realized by cooperation with hardware resources such as a processor, a memory, and a program.

Among the components described in the attached drawings and the detailed description, not only the components essential for solving the problem, but also the components not essential for solving the problem in order to exemplify the above technique are included. Can be. Therefore, it should not be immediately recognized that these non-essential components are essential as those non-essential components are described in the accompanying drawings and detailed description.

In addition, since the above-described embodiment is for exemplifying the technique in the present disclosure, various modifications, replacements, additions, omissions, and the like can be performed within the scope of the claims or an equivalent scope thereof.

The present disclosure can be applied to an imaging device that generates image data including a shadow of an object having a convex portion (for example, a painting) and an image processing system that generates height data of an object having a convex portion from the image data including the shadow. It is.

DESCRIPTION OF SYMBOLS 1 Image processing system 10A 1st image generation part 10B 2nd image generation part 10C 3rd image generation part 11 Input / output part

11a Input part

11b Communication part 12

Control part

13a, 13b Camera 131a, 131b Imaging part 132a, 132b Memory 14a 1st illumination part 14b 2nd illumination part 14c 5th illumination part 15a 3rd illumination part 15b 4th illumination part 15c 6th illumination part 16 drive part 17 light shielding member 21 input / output part 21a input part 21b communication part 22 control part 23 Memory 100 Imaging Device 200 Image Processing Device 300 Printing Device

Claims

A first imaging unit including a first imaging unit capable of imaging a first imaging region extending in a first direction, and a first illumination unit that illuminates the first imaging region from a first illumination direction. An image generation unit of
A second imaging unit capable of imaging a second imaging area extending in a second direction different from the first direction, and the first illumination direction when the second imaging area is viewed from above. A second image generation unit including a second illumination unit that illuminates the second imaging region from a second illumination direction different from the second illumination direction;
A drive unit that integrally moves the first image generation unit and the second image generation unit in a predetermined movement direction;
An imaging apparatus comprising:
The first image generation unit shoots an object having a convex portion in the first imaging region by illuminating the first illumination unit with the first illumination unit, and shows first shadow information indicating a shadow by the convex portion. Produces
The second image generation unit is configured to illuminate and photograph the object in the second imaging region with the second illumination unit, and generate second shadow information indicating a shadow by the convex portion. ,
The imaging device according to claim 1.
The first image generation unit includes:
A third illumination unit disposed on the opposite side of the first illumination unit via the first imaging unit and illuminating the first imaging region from a third illumination direction;
The object in the first imaging area is photographed by illuminating with the third illumination unit, and third shadow information indicating a shadow by the convex part is generated,
The second image generation unit includes:
A fourth illumination unit disposed on the opposite side of the second illumination unit via the second imaging unit and illuminating the second imaging region from a fourth illumination direction;
The object in the second imaging area is photographed by illuminating with the fourth illumination unit, and fourth shadow information indicating a shadow by the convex part is generated.
The imaging device according to claim 2.
The imaging apparatus according to claim 2, wherein the first imaging region is captured by the first image generation unit and the second imaging region is captured by the second image generation unit at the same time.
The first direction and the longitudinal direction of the first illumination unit are parallel,
The longitudinal direction of the second direction and the second illumination unit is parallel,
The imaging device according to claim 1.
The imaging apparatus according to claim 1, wherein an angle at which the first direction intersects the second direction is 90 degrees.
The imaging apparatus according to claim 6, wherein an angle formed by the first direction and the moving direction and an angle formed by the second direction and the moving direction are both 45 degrees.
The imaging apparatus according to claim 1, wherein the first image generation unit and the second image generation unit are arranged side by side in the movement direction.
The light-shielding member which shields the illumination light of a said 1st illumination part and a said 2nd illumination part between the said 1st image generation part and the said 2nd image generation part is further provided. Imaging device.
A third imaging unit capable of imaging a third imaging region extending in a third direction different from both the first direction and the second direction; and the third imaging region, A fifth illumination unit that illuminates the third imaging region from a fifth illumination direction different from the first illumination direction and the second illumination direction when the imaging region is viewed from above. The imaging device according to claim 1, further comprising three image generation units.
The imaging apparatus according to claim 10, wherein an angle formed by the first direction, the second direction, and the third direction is 60 degrees.
Illuminating and photographing the object simultaneously with at least one of both the first illumination unit and the third illumination unit, and both the second illumination unit and the fourth illumination unit, The imaging apparatus according to claim 3, wherein image data including color information is generated.
An imaging device according to claim 2;
An angle formed by the first illumination direction and the main surface of the object, a shadow length of the convex portion included in the first shadow information, and the second illumination direction and the main surface of the object. An image processing device that generates height information indicating a height of the surface of the object based on an angle formed and a length of a shadow of the convex portion included in the second shadow information;
Including an image processing system.
While moving the first imaging area extending in the first direction in a predetermined moving direction, the object in the first imaging area is illuminated and photographed from the first illumination direction, and the first image Scan images,
While moving the second imaging region extending in the second direction different from the first direction in the movement direction integrally with the first imaging region, the object in the second imaging region is moved. Illuminating from a second illumination direction different from the first illumination direction when the object is viewed from above, and scanning the second image;
Imaging method.
In the first imaging region extending in the first direction, an object having a convex portion on the surface is photographed by illuminating from the first illumination direction, and first shadow information indicating a shadow by the convex portion is obtained. Generate
In a second imaging region extending in a second direction different from the first direction, the object is illuminated from a second illumination direction different from the first illumination direction when the object is viewed from above. And generating second shadow information indicating a shadow by the convex portion,
An angle formed by the first illumination direction and the main surface of the object, a shadow length of the convex portion included in the first shadow information, and the second illumination direction and the main surface of the object. Generating height information indicating the height of the surface of the object based on the angle formed and the length of the shadow of the convex portion included in the second shadow information;
Image processing method.