JP7013922B2 - Shooting system, shooting method and program - Google Patents

Description

The present invention relates to a photographing system, an imaging method and a program.

One of the devices for taking pictures is a stand-type image scanner. The stand-type image scanner is provided with an image sensor (image sensor) and a lens above the mounting surface, and photographs an object to be photographed mounted on the mounting surface. Since the stand-type image scanner usually shoots by using the light from the ambient light source, it is easily affected by the light from the ambient light source.
Regarding the influence of light from an ambient light source in a stand-type image scanner, Patent Document 1 refers to a phenomenon in which a reflected portion becomes pure white due to reflected light from an object to be photographed, and indicates a scanner device for dealing with halation. ing. The scanner device described in Patent Document 1 specifies pixels having a gradation value of a predetermined brightness or higher as a halation portion from an image taken with a reflective medium placed on a pedestal portion. Then, the scanner device described in Patent Document 1 detects and displays a place where a photographing target having a predetermined shape can be placed in a place other than the halation portion.

Japanese Unexamined Patent Publication No. 2012-09512

When considering the influence of light from an ambient light source on photography as in the stand-type image scanner described in Patent Document 1, it is preferable to be able to grasp such influence with high accuracy. If it is determined that shooting is not possible when shooting is possible, it is conceivable to give up shooting even though it is possible to shoot the object to be shot. On the other hand, if it is determined that shooting is possible when the case is not suitable for shooting, it is conceivable that an appropriate image cannot be obtained and the shooting is repeated, and further, the shooting timing is missed and the image of the shooting target cannot be obtained.

An object of the present invention is to provide a photographing system, an imaging method and a program capable of solving the above-mentioned problems.

According to the first aspect of the present invention, the photographing system is placed on a mounting surface and moves on the previously described mounting surface in each of a plurality of states in which the positions of the photographing objects are different. On the imaging unit to be photographed, a reflection detection unit that detects the relationship between the position of the object to be photographed and the presence or absence of halation in the image of the object to be photographed based on the image captured by the image-taking unit, and the above- mentioned mounting surface. It is a projection unit that performs projection, and includes a projection unit that indicates a position where the object to be photographed should be placed by projection different from projection to other portions .

According to the second aspect of the present invention, in the photographing method, an imaging object placed on a mounting surface and moving on the above-mentioned mounting surface is placed in each of a plurality of states in which the positions of the imaging objects are different. Based on the step of taking a picture and the image taken in the step of taking a picture, the relationship between the position of the object to be photographed and the presence or absence of halation in the image of the object to be photographed is detected , and the above description is made based on the detected relationship. A step of determining a position on which the object to be photographed should be placed on the mounting surface, and a step of projecting on the above-mentioned mounting surface to indicate the position on which the object to be photographed should be placed by a projection different from the projection to other parts. , Including.

According to the third aspect of the present invention, the program has a computer in a plurality of states in which an image pickup object placed on a mounting surface and moving on the previously described mounting surface is placed in a plurality of states in which the positions of the photographing objects are different. Based on the step of taking a picture in each and the image taken in the step of taking a picture, the relationship between the position of the object to be photographed and the presence or absence of halation in the image of the object to be photographed is detected , and based on the detected relationship, The step of determining the position where the object to be photographed should be placed on the above-mentioned placing surface and the position where the object to be photographed should be placed by projecting on the above-mentioned place surface are shown by projection different from the projection to other parts. It is a program to execute the process .

According to the present invention, the influence of light from an ambient light source on photography can be grasped with relatively high accuracy.

It is a schematic outline drawing which shows the example of the outer shape of the photographing apparatus which concerns on embodiment of this invention. It is a figure which shows the example of the plurality of positions where the photographing part of the photographing system which concerns on the same embodiment takes an image of an object to be photographed. It is a figure which shows the example of the mode of the photographing system which concerns on the same embodiment. It is a schematic block diagram which shows the functional structure of the photographing system which concerns on the same embodiment. It is a flowchart which shows the example of the procedure of the process which the photographing system which concerns on the same embodiment performs in a positioning mode. It is a flowchart which shows the example of the procedure of the process which the photography system which concerns on the same embodiment performs in the photography mode. It is a flowchart which shows the example of the procedure of the process which the photography system which concerns on the same embodiment performs in a composition mode. It is a figure which shows the example of the minimum structure of the photographing system which concerns on this invention.

Hereinafter, embodiments of the present invention will be described, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential to the means of solving the invention.
FIG. 1 is a schematic outline view showing an example of the outer shape of the photographing apparatus according to the embodiment of the present invention. As shown in FIG. 1, the photographing system 100 includes an photographing unit 110, a projection unit 120, and a processing unit 170.

The photographing unit 110, the projection unit 120, and the processing unit 170 may be configured as an integrated device. Alternatively, the photographing unit 110, the projection unit 120, and the processing unit 170 may be configured as two or more devices. For example, the photographing unit 110, the projection unit 120, and the processing unit 170 may be configured as separate devices such as an imaging device, a projection device, and a processing device, respectively.

Further, in FIG. 1, the mounting surface F11 is shown. The mounting surface referred to here is a surface on which an object to be photographed is placed for photographing by the photographing system 100. As the mounting surface F11, a surface of an existing object such as an upper surface of a desk may be used. Alternatively, the mounting surface F11 may be provided exclusively for the photographing system 100, for example, the photographing system 100 may be provided with a mounting table for mounting an object to be photographed.
When the surface of an existing object is used as the mounting surface F11, the photographing system 100 has a compact configuration in that it does not need to be provided with a mounting table or the like, and the photographing system 100 becomes relatively easy to carry.

The photographing system 100 photographs an object to be photographed.
As shown in FIG. 1, the photographing unit 110 of the photographing system 100 is configured as a stand-type image scanner, and the photographing unit 110 photographs an object to be photographed.
The projection unit 120 is configured as a stand-type projector, and projects an image on the mounting surface F11.

The processing unit 170 controls the photographing unit 110 and the projection unit 120. Further, the processing unit 170 performs various processing such as analysis of an image captured by the photographing unit 110. The processing unit 170 is configured by using a computer such as a personal computer (PC) or a personal computer (PC).
The area A11 in FIG. 1 shows an example of an area of the mounting surface F11 where the photographing unit 110 can photograph. In FIG. 1, the region A11 is also a region on which the projection unit 120 can project an image. However, the area where the photographing unit 110 can take an image and the area where the projection unit 120 can project an image do not have to be the same.

The photographing unit 110 photographs an object to be photographed by using the light from an ambient light source. Therefore, depending on conditions such as the installation location of the photographing unit 110, the position of the object to be photographed, and the brightness of the illumination as the light source, the reflected light on the object to be photographed may be excessive.
The term “excessive reflected light from the object to be photographed” as used herein means that the photoelectric element of the photographing unit 110 is saturated by the light reflected by the object to be photographed from a light source such as illumination light. When the amount of reflected light on the object to be photographed is excessive, a pure white portion is generated in the image of the object to be photographed. The original color of the object to be photographed in this pure white part is not reflected in the image, or the characters described in the part cannot be read from the image, so that the image of the original appearance of the object to be photographed cannot be obtained.

In the following, excessive reflected light from the object to be photographed is referred to as overexposure, and an excessive amount of reflected light from the object to be photographed is referred to as overexposure.
For example, when the surface of the object to be photographed is processed, or when the object to be photographed is a card or a document in a plastic case, and the surface of the object to be photographed easily reflects light. Overexposure is likely to occur.
As a countermeasure against overexposure, the photographing system 100 photographs an object to be photographed placed at each of a plurality of positions on the mounting surface, and reflects the position of the object to be photographed and the light reflected by the object to be photographed. Detect the relationship with.

FIG. 2 is a diagram showing an example of a plurality of positions where the photographing unit 110 of the photographing system 100 photographs an object to be photographed. In the example of FIG. 2, the object to be photographed 810 is placed on the mounting surface F11. The object to be photographed 810 is manually operated by the user and moves in the area A11 on the mounting surface F11 in the trajectory indicated by the arrow.
However, the trajectory of the object to be photographed 810 moving on the mounting surface F11 is not limited to the trajectory of a specific pattern.
Further, the method of moving the photographing system 100 on the mounting surface F11 is not limited to the method of manually moving the photographing system 100. For example, the photographing system 100 may be provided with a movable mounting table, and the imaged object 810 may move on the mounting surface F11 by moving the mounting surface F11 itself.

The photographing unit 110 generates photographed image data of the area A11 at regular time intervals, for example. As a result, the photographing unit 110 photographs the imaged object placed on the mounting surface F11 and moving on the mounting surface F11 in each of a plurality of states in which the positions of the photographing objects are different. That is, the photographing unit 110 photographs the imaging object 810 at each of the plurality of positions on the mounting surface F11.

In FIG. 2, regions A21, A22, and A23 are shown among a plurality of positions of the photographing object 810 in which the photographing unit 110 has photographed the photographing object 810. In both the regions A21 and A22, the reflection of light from the ceiling lighting equipment 910 is excessive in a part of the object to be photographed 810, and the image of the object to be photographed 810 is overexposed. The ceiling lighting equipment 910 corresponds to an example of an ambient light source.

On the other hand, in the area A23, overexposure does not occur in the image of the object to be photographed 810. Therefore, the processing unit 170 may acquire the image of the photographing object 810 by cutting out the image of the photographing object 810 located in the region A23 from the image taken by the photographing unit 110.
Alternatively, the projection unit 120 may indicate the position of the area A23 to urge the user to place the object to be photographed 810 in the area A23. Then, the photographing unit 110 may photograph the image of the photographing object 810 while the user places the photographing object 810 in the area A23.

The projection unit 120 may display the trajectory on which the object to be photographed 810 should be moved on the mounting surface F11 as shown by the arrow in FIG. Alternatively, the projection unit 120 may display the position on which the object to be photographed 810 should be placed on the mounting surface F11 for each image taken by the photographing unit 110.
The object to be photographed 810 is typically smaller than the area A11, but the object to be photographed 810 may be the same size as the area A11 or larger than the area A11.

FIG. 3 is a diagram showing an example of the mode of the photographing system 100. In the example of FIG. 3, three modes are shown as the mode of the photographing system 100, that is, the positioning mode, the photographing mode, and the compositing mode.
The positioning mode is a mode in which a position to be placed on the object to be photographed 810 is determined, and the object to be photographed 810 is photographed with the object to be photographed 810 placed at the determined position. As described with reference to FIG. 2, the processing unit 170 determines the position where the object to be photographed 810 should be placed, and the projection unit 120 notifies the user of the determined position. With the shooting object 810 placed at the position where the shooting target 810 should be placed, the shooting unit 110 shoots the shooting target 810. As a result, the photographing system 100 acquires an image of the object to be photographed 810.

The projection unit 120 makes the projection at the position where the object to be photographed 810 should be placed different from the projection to other parts. For example, the projection unit 120 may project light brighter than other positions with respect to the position where the object to be photographed 810 should be placed. The area A12 in FIG. 1 corresponds to an example of a position where the object to be photographed 810 should be placed. The projection unit 120 projects light brighter than other positions on the region A12.
However, the method in which the projection unit 120 notifies the user of the position where the object to be photographed 810 should be placed is not limited to a specific method. For example, the projection unit 120 may display the outer circumference of the position where the object to be photographed 810 should be placed by a line.

The shooting mode is a mode in which the image of the shooting target 810 is cut out from the image shot by the shooting unit 110 of the shooting target 810 moving on the mounting surface F11.
As in the example described with reference to FIG. 2, the processing unit 170 determines whether or not the image of the photographing object 810 has whiteout at each of the plurality of positions of the photographing object 810. When there is an image in which overexposure does not occur, the processing unit 170 cuts out an image of the object to be photographed 810 from the image. As a result, the photographing system 100 acquires an image of the imaged object 810 in which overexposure does not occur.

The compositing mode is a mode in which a partial image of a portion not overexposed is cut out from each of a plurality of images of the object to be photographed 810, and the obtained partial image is combined to generate an image of the object to be photographed 810.
Even if a part of the image of the object to be photographed 810 is overexposed in any image taken by the photographing unit 110 while the user moves the object to be photographed 810, the image of the part not overexposed can be combined. There is a possibility that an image of the object to be photographed 810 can be obtained.
The mode switching is performed by, for example, the user.

FIG. 4 is a schematic block diagram showing a functional configuration of the photographing system 100. As shown in FIG. 4, the photographing system 100 includes an photographing unit 110, a projection unit 120, and a processing unit 170. The processing unit 170 includes a storage unit 180 and a control unit 190. The control unit 190 includes a reflection detection unit 191 and an image generation unit 192.
Of the parts of FIG. 4, the parts already shown in FIG. 1 will be described with the same reference numerals (100, 110, 120, 170).

The storage unit 180 stores various data. The storage unit 180 is configured by using the storage device included in the photographing system 100.
The control unit 190 controls each unit of the processing unit 170 to execute various processes. The control unit 190 is configured by a CPU (Central Processing Unit) included in the photographing system 100 reading a program from the storage unit 180 and executing the program.

The reflection detection unit 191 detects the relationship between the position of the image-taking object 810 and the reflection of light on the image-taking object 810 based on the image taken by the image-taking unit 110. In particular, the reflection detection unit 191 is a portion in which the reflected light from the image to be photographed 810 is not excessive from each of the images of the object to be photographed 810 taken by the image to be photographed in each of the plurality of states in which the position of the object to be photographed is different. Detects (the part where overexposure does not occur).

In the positioning mode, the reflection detection unit 191 determines the position where the whiteout does not occur in any part of the image of the image pickup object 810 at the position where the image pickup object 810 should be placed.
In the shooting mode, the reflection detection unit 191 determines an image in which no overexposure occurs in any part of the image of the shooting target object 810 as an image to be cut out from the image of the shooting target object 810.
In the compositing mode, the image of the portion detected by the reflection detection unit 191 is used as a partial image for compositing the image of the object to be photographed 810.

When a specific part of the object to be photographed 810 is important, the reflection detection unit 191 may determine whether or not the reflected light in the specific part of the object to be photographed 810 is excessive.
For example, when character recognition is performed on a document, the part where the characters are written is important for character recognition. Therefore, the photographing object 810 may determine whether or not whiteout occurs in the specific portion of the document, with the portion in which the characters are written as a specific portion. If there is no overexposure in the part where the characters are written, even if there is overexposure in other parts, character recognition can be performed using the image.

Alternatively, when performing personal authentication using an image of a driver's license, perform personal authentication using one of the description of the driver's license number, face photo, address and name and date of birth, or a combination of these. Is possible. Therefore, the photographed object 810 may determine whether or not whiteout occurs in the specific portion of the driver's license, with the portion used for person authentication as the specific portion. If there is no overexposure in the part used for person authentication, even if there is overexposure in other parts, person authentication can be performed using the information obtained from the image.

The image generation unit 192 generates an image of the object to be photographed 810.
In the positioning mode, the image generation unit 192 uses the image of the entire area A11 captured by the imaging unit 110 with the imaging object 810 placed at the designated position (the position where the imaging object 810 should be placed) to capture the imaging object 810. Cut out the image of the part where is reflected.
In the shooting mode, the image generation unit 192 cuts out the image of the shooting target object 810 from the image to be cut out from the image of the shooting target object 810 determined by the reflection detection unit 191. The image determined by the reflection detection unit 191 is an image of the entire region A11, and the image generation unit 192 cuts out an image of a portion in which the object to be photographed 810 is captured from the image of the entire region A11.

In the compositing mode, the image generation unit 192 synthesizes a partial image of a portion where the reflected light of the object to be photographed 810 is not excessive to generate an image of the object to be photographed 810. Specifically, the image generation unit 192 uses an image of a portion of the image capture object 810 detected by the reflection detection unit 191 as a portion of each of the images captured by the imaging unit 110 in which overexposure does not occur. The image generation unit 192 selects a combination of these partial images from which an image of the entire image to be photographed 810 can be obtained, and synthesizes an image of the entire object to be photographed 810.

Next, the operation of the photographing system 100 will be described with reference to FIGS. 5 to 7.
FIG. 5 is a flowchart showing an example of a procedure of processing performed by the photographing system 100 in the positioning mode.
In the process of FIG. 5, while the user places the object to be photographed on the mounting surface F11 (step S111), the photographing unit 110 photographs the photographable range (area A11) (step S112).

Then, the control unit 190 extracts the image of the image to be photographed 810 from the image photographed by the photographing unit 110 (step S113). Specifically, the control unit 190 detects the position of the image portion of the image capture object 810 in the image captured by the photographing unit 110. As a method for the control unit 190 to detect the position of the image portion of the image pickup object 810, a known method such as image matching can be used.

Next, the reflection detection unit 191 detects a region of the image of the object to be photographed 810 where the reflected light is excessive (step S114). For example, the reflection detection unit 191 determines whether or not the brightness of each pixel in the region detected by the control unit 190 in step S113 is brighter than a predetermined threshold value. When the pixel value indicates brightness, the reflection detection unit 191 determines whether or not the pixel value of each pixel is equal to or greater than the threshold value. The reflection detection unit 191 detects a pixel determined to be brighter than the threshold value as a pixel in a region where the reflected light is excessive.
Alternatively, the reflection detection unit 191 may detect a region where the reflected light is excessive in a unit other than the pixel, such as comparing the average of the pixel values in the plurality of pixels with the threshold value.

Next, the control unit 190 determines whether or not all the scheduled shootings have been completed (step S115). For example, as in the example of FIG. 2, when the moving object 810 is started to move from the left back when viewed from the user in the area A11, the control unit 190 tells the control unit 190 that the object 810 to be photographed is in a predetermined area in front of the right side of the area A11. When it is detected that it has reached, it is determined that all the scheduled shootings have been completed.
Alternatively, the user may perform a user operation to notify that all the scheduled shootings have been completed. In this case, when the control unit 190 detects the user operation, it is determined that all the scheduled shootings have been completed. Alternatively, the control unit 190 may determine that all the scheduled shootings have been completed when a predetermined time or more has elapsed from the start of the process of FIG.

If it is determined in step S115 that there is a shooting that has not been completed yet (step S115: NO), the user moves the shooting target (step S121), and the process returns to step S112.
On the other hand, when it is determined in step S115 that all the scheduled shootings have been completed (step S115: YES), the projection unit 120 displays the shooting possible position (step S131). For example, the reflection detection unit 191 determines the image pickup object 810 to be a photographable position when the image of the image capture object 810 does not cause overexposure. Then, the projection unit 120 indicates the shootable position to the user by making the projection to the shootable position different from the projection to the other portion as described above.

When there are a plurality of shootable positions, the projection unit 120 may indicate all the shootable positions. Alternatively, the reflection detection unit 191 may select any one of the plurality of imageable positions.
Even if the image of the object to be photographed 810 is overexposed in all the photographs, the projection unit 120 notifies the user that the filming has failed and displays a message prompting the user to change the shooting conditions. good. Alternatively, the reflection detection unit 191 may determine any of the positions of the object to be photographed 810, such as the position where the area of the overexposed portion is the smallest, as the photographable position.

While the user places the shooting object 810 at the shootable position indicated by the projection unit 120 (step S132), the shooting unit 110 shoots, and the image generation unit 192 acquires the image of the shooting target 810 (step S132). Step S133).
Specifically, the photographing unit 110 photographs the entire photographable range (region A11). Then, the image generation unit 192 cuts out an image of a portion of the image captured by the photographing unit 110 in which the imaged object 810 is captured. Alternatively, the photographing unit 110 may acquire an image that does not require cutting out of the image of the portion in which the object to be photographed 810 is captured, by changing the angle of view or the like.
After step S133, the photographing system 100 ends the process of FIG.

FIG. 6 is a flowchart showing an example of a procedure of processing performed by the photographing system 100 in the photographing mode.
Steps S211 to S214 of FIG. 6 are the same as steps S111 to S114 of FIG.
After step S214, the reflection detection unit 191 determines whether or not it is possible to acquire an image of the entire imaged object 810 from the image captured by the photographing unit 110 (step S215). Specifically, the reflection detection unit 191 determines in step S214 whether or not a region having an excessive amount of reflected light is detected in the image of the object to be photographed 810. The reflection detection unit 191 determines that the entire image of the object to be photographed 810 can be acquired by determining that there is no region where the reflected light is excessive. Further, the reflection detection unit 191 determines that the entire image of the object to be photographed 810 cannot be acquired by determining that there is a region where the reflected light is excessive.

When it is determined in step S215 that the image of the entire image to be photographed 810 can be acquired (step S215: YES), the image generation unit 192 acquires the image of the object to be photographed 810 (step S221). Specifically, the image generation unit 192 acquires an image of the entire image capture object 810 without overexposure by cutting out a portion in which the image capture object 810 is captured from the image captured by the image capture unit 110.
After step S221, the photographing system 100 ends the process of FIG.

On the other hand, if it is determined in step S215 that the image of the entire object to be photographed 810 cannot be acquired (step S215: NO), the process proceeds to step S231. Step S231 is the same as step S115 in FIG.
If it is determined in step S231 that there is a shooting that has not been completed yet (step S231: NO), the user moves the shooting target (step S241), and the process returns to step S212.
On the other hand, when it is determined in step S231 that all the scheduled shootings have been completed (step S231: YES), the projection unit 120 notifies the user that the shooting has failed and prompts the user to change the shooting conditions. Display (step S251).
After step S251, the photographing system 100 ends the process of FIG.

FIG. 7 is a flowchart showing an example of a procedure of processing performed by the photographing system 100 in the composite mode.
Steps S311 to S315 in FIG. 7 are the same as steps S211 to S215 in FIG.

If it is determined in step S315 that the image of the entire object to be photographed 810 can be acquired (step S315: YES), the process proceeds to step 321. Step S321 is the same as step S221 in FIG.
After step S321, the photographing system 100 ends the process of FIG. 7.

On the other hand, when it is determined in step S315 that the image of the entire image to be photographed 810 cannot be acquired (step S315: NO), the image generation unit 192 generates a partial image of the object to be photographed 810 and stores it in the storage unit 180. (Step S331). Specifically, the image generation unit 192 is further described in step S314 from the portion of the image captured by the imaging unit 110 in which the imaging object 810 detected by the control unit 190 in step S313 is reflected. Excludes the portion where the reflected light detected by the reflection detection unit 191 is excessive. Then, the image generation unit 192 generates an image of the remaining portion as image data and stores it in the storage unit 180.

After step S331, processing proceeds to step S332. Step S332 is the same as step S231 in FIG.
If it is determined in step S332 that there is a shooting that has not been completed yet (step S332: NO), the user moves the shooting target (step S341), and the process returns to step S312.

On the other hand, when it is determined in step S332 that all the scheduled shootings have been completed (step S332: YES), the image generation unit 192 uses a combination of the partial images stored in the storage unit 180 to capture an image of the entire image of the entire object to be imaged 810. Attempt to synthesize (step S351).
Then, the image generation unit 192 determines whether or not an image of the entire object to be photographed 810 has been obtained (step S352). That is, the image generation unit 192 determines whether or not the image of the entire image to be photographed 810 has been successfully combined.

When it is determined that the image of the entire shooting object 810 has been obtained (step S352: YES), the shooting system 100 ends the process of FIG. 7.
On the other hand, when it is determined that the image of the entire object to be photographed 810 cannot be obtained (step S352: NO), the process proceeds to step S361. Step S361 is the same as step S251 in FIG.
After step S361, the process of FIG. 7 is terminated.

As described above, the photographing unit 110 photographs the photographing object 810 placed on the mounting surface F11 and moving on the mounting surface F11 in each of a plurality of states in which the positions of the photographing objects 810 are different. The reflection detection unit 191 detects the relationship between the position of the image-taking object 810 and the reflection of light on the image-taking object 810 based on the image taken by the image-taking unit 110.
According to the photographing system 100, the influence of the light from the surrounding light source on the photographing can be grasped by using the photographing object 810 itself. In this respect, according to the photographing system 100, the influence of the light from the surrounding light source on the photographing can be grasped with high accuracy.

Here, as one of the methods for grasping the influence of the light from the surrounding light source on the shooting, a reflective sheet is placed on the mounting surface F11 so as to cover the entire region A11, and the light is applied to each position on the mounting surface F11. A method of grasping the reflection situation of is conceivable. However, in this method, it is considered that the accuracy of grasping the influence of the light from the surrounding light source on the photographing is lowered due to the difference between the photographing object 810 and the reflective sheet.

For example, when the object to be photographed 810 is a passport in which the inside page is opened, it is conceivable that the object to be photographed 810 has irregularities. In this case, it is conceivable that the light reflection angle differs from that of the reflective sheet due to the unevenness of the passport, and the whiteout situation differs.
Further, it is conceivable that the state of light reflection differs depending on the material and color of the object to be photographed 810 and the reflective sheet. When the amount of light reflected is grasped more than the actual object to be photographed 810 by using the reflection sheet, it is determined that the image of the object to be photographed 810 without overexposure can be photographed, but the image cannot be photographed. It is conceivable that it will be done. This reduces the possibility of obtaining an image of the object to be photographed 810.

On the other hand, when the amount of light reflected is smaller than that of the actual object to be photographed 810 by using the reflective sheet, it is conceivable that overexposure may occur in the actual photography using the object to be photographed 810. In this case, it becomes necessary to redo the shooting, which is a burden on the user. Furthermore, if you notice overexposure in the absence of the object to be photographed, such as after the customer has already brought back the object to be photographed 810, you cannot start shooting again, and the image of the object to be photographed without overexposure 810 is displayed. I can't get it.
On the other hand, as described above, in the shooting system 100, the influence of the light from the surrounding light source on the shooting is high in that the influence of the light from the surrounding light source on the shooting is grasped by using the shooting object 810 itself. It can be grasped accurately.

Further, the reflection detection unit 191 determines whether or not the reflected light in a specific portion of the object to be photographed 810 is excessive.
As described above, when a specific portion of the object to be photographed 810 is important for processing, according to the photographing system 100, processing can be performed even if whiteout occurs in a portion other than the specific portion. In this respect, according to the photographing system 100, the possibility of performing a desired process can be improved.

Further, the reflection detection unit 191 determines the position of the mounting surface F11 on which the photographing object 810 should be placed, based on the relationship between the position of the photographing object 810 and the reflection of light on the photographing object 810. The projection unit 120 makes the projection at the position where the object to be photographed 810 should be placed different from the projection to other parts.
As a result, the object to be photographed 810 can directly display the position where the object to be photographed 810 should be placed. The user can easily grasp the position where the photographing object 810 should be placed, and can reduce the possibility that the position where the photographing object 810 is placed is mistaken.

Further, the image generation unit 192 generates an image of the object to be photographed 810.
The reflection detection unit 191 detects a portion where the reflected light of the image pickup object 810 is not excessive from the images photographed by the image pickup unit 110 in each of the plurality of states in which the position of the image pickup object 810 is different. The image generation unit 192 generates an image of the object to be photographed 810 by synthesizing a partial image of a portion where the reflected light of the object to be photographed 810 is not excessive.
As a result, in the photographing system 100, even if there is no position in the region A11 on the mounting surface F11 where an image of the photographing object 810 without overexposure can be obtained, the entire photographing object 810 without overexposure can be obtained by combining the images. It is expected that you can get the image of. In this respect, according to the photographing system 100, it is possible to improve the possibility of obtaining an image of the entire imaged object 810 without overexposure.

Next, the minimum configuration of the present invention will be described with reference to FIG.
FIG. 8 is a diagram showing an example of the minimum configuration of the photographing system according to the present invention. The photographing system 10 shown in FIG. 8 includes an photographing unit 11 and a reflection detecting unit 12.
With this configuration, the photographing unit 11 photographs the imaged object placed on the mounting surface and moving on the mounting surface in each of a plurality of states in which the positions of the imaging objects are different. The reflection detection unit 12 detects the relationship between the position of the object to be photographed and the reflection of light on the object to be photographed based on the image captured by the image-taking unit 11.
According to the photographing system 10, the influence of the light from the surrounding light source on the photographing can be grasped by using the photographing object itself. In this respect, according to the photographing system 10, the influence of the light from the surrounding light source on the photographing can be grasped with high accuracy.

A program for realizing all or part of the functions of the photographing systems 10 and 100 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into the computer system and executed. May be processed for each part. The term "computer system" as used herein includes hardware such as an OS and peripheral devices.
Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, and a storage device such as a hard disk built in a computer system. Further, the above program may be for realizing a part of the above-mentioned functions, and may be further realized for realizing the above-mentioned functions in combination with a program already recorded in the computer system.

Although the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and includes designs and the like within a range that does not deviate from the gist of the present invention.

10,100 Imaging system 11,110 Imaging unit 12,191 Reflection detection unit 120 Projection unit 170 Processing unit 180 Storage unit 190 Control unit 192 Image generation unit

Claims (5)

An imaging unit that photographs an object to be photographed, which is placed on the mounting surface and moves on the above-mentioned mounting surface, in each of a plurality of states in which the positions of the objects to be photographed are different.
Based on the image taken by the photographing unit, the relationship between the position of the imaged object and the presence or absence of halation in the image of the imaged object is detected , and based on the detected relationship, the imaged surface of the above-mentioned mounting surface is photographed. A reflection detector that determines the position where the object should be placed ,
A projection unit that projects onto the above-mentioned mounting surface, and a projection unit that indicates the position where the object to be photographed should be placed by a projection different from the projection onto other parts.
A shooting system equipped with. The imaging system according to claim 1, wherein the reflection detection unit determines the presence or absence of halation in an image of a specific portion of the imaging object. Further, an image generation unit for generating an image of the object to be photographed is provided.
The reflection detection unit detects a portion of the image of the image to be photographed in which halation does not occur from the images photographed by the image to be photographed in each of a plurality of states in which the position of the object to be photographed is different.
The image generation unit generates an image of the object to be photographed by synthesizing a partial image of a portion of the image of the object to be photographed in which halation does not occur .
The photographing system according to claim 1 or 2 . A process of photographing an object to be photographed, which is placed on the mounting surface and moves on the above-mentioned surface, in each of a plurality of states in which the positions of the objects to be photographed are different.
Based on the image taken in the step of taking a picture, the relationship between the position of the object to be photographed and the presence or absence of halation in the image of the object to be photographed is detected , and based on the detected relationship, the above-mentioned mounting surface described above. The process of determining the position where the object to be photographed should be placed ,
A process of projecting onto the above-mentioned mounting surface and indicating the position where the object to be photographed should be placed by a projection different from the projection to other parts.
Shooting methods including. On the computer
A process of photographing an object to be photographed, which is placed on the mounting surface and moves on the above-mentioned surface, in each of a plurality of states in which the positions of the objects to be photographed are different.
Based on the image taken in the step of taking a picture, the relationship between the position of the object to be photographed and the presence or absence of halation in the image of the object to be photographed is detected , and based on the detected relationship, the above-mentioned mounting surface described above. The process of determining the position where the object to be photographed should be placed ,
A process of projecting onto the above-mentioned mounting surface and indicating the position where the object to be photographed should be placed by a projection different from the projection to other parts.
A program to execute.

Images