JP2002213921A - Auxiliary device for photographing - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make easily findable the actual dimension of each part of a subject, by conducting effectively processing for calculation of the actual dimension based on a photographed image of the subject. SOLUTION: The boundary between the image of a subject 5 and an image of a background is detected, and the coordinates in vertical-directional and lateral-directional ends of the subject image are stored, in the front photographed image of the subject 5 provided by photographing the subject 5 using a digital camera 20. A pixel number corresponding to 1 mm is calculated based on a photographing magnification found from a zoom value of the digital camera 20 in the photographing, a photographing distance and photographing resolution found from a focus value, and a preliminarily stored coefficient, a pixel number is calculated based on the coordinates of the end parts of the subject image, the actual dimension of the subject 5 is calculated based on the pixel number and the pixel number per 1 mm, and the found actual dimension is corrected based on an upper face image of the subject 5 reflected on a top face mirror 61 positioned in an upper face of the subject 5.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a photographing assisting device for realizing photographing conditions for photographing an object with a photographing device and processing a photographed image obtained by the photographing device.

[0002]

2. Description of the Related Art In recent years, with the spread of digital cameras, scanners, and the like, it has become possible to easily convert an image into digital data, load the image into a computer, and perform image processing. For example, it is possible to use an image editing application program or the like to cut out a part of an image taken into a computer or to combine the cut-out image with another photograph.

[0003] In addition, if an image captured by a computer is used, a desired image can be obtained by editing as described above, and the size and the like of a photographed subject can be obtained from the photographed image.

For example, a photographed image and a grid are simultaneously displayed on a display screen, and the size of a subject is compared with grid cells. Then, there has been a method of obtaining an actual size corresponding to one grid of a grid in a photographed image and calculating an actual size of the subject from the actual size.

[0005]

However, the actual size obtained by the above-described conventional method is the actual size of the subject on the photographed surface. Therefore, for example, when it is desired to calculate the size of the front and the side of the subject, it is necessary to prepare an image of the subject taken from the front and an image of the subject taken from the side, and obtain the actual size of each part of the subject from each image. was there.

However, most of the subjects are three-dimensional,
There are few cases where it is sufficient to obtain the actual size of the front by simply photographing only the front, and it is more useful to obtain the actual size of as many parts of the subject as possible. in this way,
When obtaining the actual size of many parts of the subject, it is necessary to repeat the process of calculating the actual size many times using many captured images. Therefore, a method for efficiently calculating the actual size of each part of the subject has been desired.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems by increasing the efficiency of the process of calculating the actual size of a subject based on a photographed image of the subject by a photographing device, thereby reducing the actual size of each part of the subject. It is to be easily requested.

[0008]

The present invention has the following features in order to solve such a problem. In the following description of the means, a configuration corresponding to the embodiment is shown by parentheses as an example. Reference numerals and the like are reference numerals and the like in the drawings described later.

According to the first aspect of the present invention, a photographing device (for example, a digital camera shown in FIG. 2) is mounted on a housing (for example, a case 401 shown in FIG. 2) for accommodating a photographing object (for example, a subject 5 shown in FIG. 2). In a photographing assistance device to which the camera 20) is attached, by moving the photographing device,
Position control means for changing the position of the photographing device with respect to the photographing target housed in the housing (for example, the CPU 101 performing the processing shown in step S102 in FIG. 9);
A mirror (for example, a top mirror 6 shown in FIG. 2) disposed in the housing so that an image of a predetermined surface of the object to be photographed other than the front surface facing the photographing device is projected toward the photographing device.
1) and photographing control means for simultaneously photographing the front of the photographing object and the image reflected on the mirror by the photographing device (for example, C which performs the processing shown in step S103 of FIG. 9)
PU101) and, based on a plurality of images captured by the image capturing device under the control of the image capturing control means, the actual size of the image capturing object on the front and the actual size of the image capturing object on the predetermined surface. (For example, the CPU 101 which performs the processing shown in steps S104 to S112 in FIG. 9).

[0010] Here, the above-mentioned mirror projects, for example, an image of a top surface, a right side surface, a left side surface, or a bottom surface or a back surface of a photographing object as a predetermined surface other than the front surface toward the photographing device.

According to the first aspect of the present invention, in a photographing assisting device in which a photographing device is attached to a housing for accommodating a photographing object, the photographing device is moved by the position control means so that the photographing device is moved to the housing. The position of the photographing device with respect to the accommodated photographing object is changed, and the photographing object is disposed in the housing so as to project an image of a predetermined surface other than the front surface facing the photographing device toward the photographing device. Equipped with a mirror,
Under the control of the photographing control means, the photographing device causes the front of the photographing object and the image reflected on the mirror to be photographed at the same time, and based on a plurality of photographed images photographed by the photographing device, photographing in the front by the actual size calculating means. Since the actual size of the object and the actual size of the object to be photographed on a predetermined surface are obtained, images of the front surface, the upper surface, the right side surface, the left side surface, and the like of the photographing object are simultaneously photographed by the photographing device, and are obtained. From the photographed image, the actual size of the photographing object such as “width”, “height”, and “depth” can be obtained. This makes it possible to easily obtain the actual size of each part by photographing the photographing target only once with the photographing device. In addition, since the actual size is calculated using only the captured images of the front surface of the object to be photographed and a predetermined surface other than the front surface, the number of images to be processed is reduced to a minimum necessary number as compared with the case of processing a plurality of images. It is possible to reduce the processing by suppressing it and reduce the load on hardware. For this reason, the processing performance of the necessary hardware can be reduced to reduce the cost, or the work load can be reduced by speeding up the processing.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below with reference to FIGS.

FIG. 1 is a schematic perspective view showing the configuration of a photographing system 1 according to an embodiment of the present invention. As shown in FIG. 1, the imaging system 1 includes an image processing device 10, an approximately box-shaped case 401, an imaging box 40 that accommodates a subject 5 inside the case 401, and an imaging box 4.
The digital camera 20 attached to the photographing box 40 and photographs the subject 5 housed in the photographing box 40, and the photographing control device 30 installed on the side surface of the photographing box 40 and controlling each unit provided in the photographing box 40 The image processing apparatus 10 and the digital camera 20 are connected to each other, and the image processing apparatus 10 and the imaging control apparatus 30 are connected to each other.

The image processing apparatus 10 includes a digital camera 20
And a computer system capable of executing various application programs for executing image editing processing on an image captured by the digital camera 20.
The display 12, the keyboard 13, and the mouse 14 include a keyboard 13 and a mouse 14.
Each is connected to each unit stored in the main body 11.

The photographing box 40 has a substantially box-shaped case 401 having an open front and one side, and a substantially quadrangular pyramid having a bottom surface connected to the case 401 so as to cover the front opening of the case 401. Hood 402 and hood 402
And a case 40 connected to the top of the
A side door 406 attached to an opening provided on the side surface of the first side so as to be openable and closable, and a case 401 having the side door 406.
An emergency stop button 404 provided at the end of the side surface and a subject pedestal 405 provided inside the case 401 are provided. Further, below the emergency stop button 404, the imaging control device 30 is provided. The digital camera 20 is fixed to the tilt table 403.

A motor 409 (FIG. 6) and a potentiometer 412 (FIG. 6) are attached to a connecting portion between the case 401 and the hood 402. Similarly, a motor 409 (FIG. 6) is connected to the connecting portion between the hood 402 and the tilt base 403. 4
07 (FIG. 6) and a potentiometer 410 (FIG. 6).
8 (FIG. 6) and a potentiometer 411 (FIG. 6) are attached.

The front surface of the case 401 is open almost entirely, and further has an opening on the side surface. A side door 406 is attached to the opening on the side surface so as to be openable and closable. Is covered with a surface corresponding to the bottom surface of the hood 402 connected to the hood 402. Therefore, in a state where the side door 406 is closed, external light to the inside of the case 401 is blocked.

The hood 402 is a substantially quadrangular pyramid-shaped hood having an opening at a surface corresponding to the bottom surface. It is connected to 401.
The hood 402 is rotatable up and down about the above-mentioned connection shaft by the operation of the motor 409 attached to the connection portion. That is, the motor 409
By rotating, the mounting angle of the hood 402 with respect to the case 401 can be changed. In the substantially quadrangular pyramid-shaped hood 402, a tilt base 403 is attached to a portion corresponding to the apex of the pyramid.

The tilt base 403 is a pedestal having a connecting part connected to the hood 402 and a flat part for fixing the digital camera 20, and a fixing mechanism (fixing mechanism) for fixing the digital camera 20 on the flat part. (Not shown), and an opening is provided from the plane portion toward the inside of the case 401. So that the lens faces this opening,
By mounting and fixing the digital camera 20 on the above-mentioned flat part, the case 40
The subject 5 placed on the subject pedestal 405 in 1 can be photographed. Note that the digital camera 20 can be fixed to the flat portion of the tilt base 403 with the bottom face down.
It can also be placed vertically with its side down.

This tilt base 403 has a hood 4 at one end.
02, and a motor 407 (FIG. 6) and a potentiometer 410 (FIG. 6) are attached to the connecting portion. When the motor 407 rotates, the motor 407 rotates up and down around the connecting portion. The tilt angle of the tilt base 403 with respect to the hood 402 can be changed. Therefore, potentiometer 41
By rotating the motor 407 based on the detection value of 0, the mounting angle of the tilt base 403 can be adjusted to an arbitrary angle.

Further, inside the case 401, an object pedestal 405 is installed on the bottom surface, and the details will be described later.

The case 40 to which the side door 406 is attached
On one side, an emergency stop button 404 is provided. The emergency stop button 404 is a stop switch 3 described later.
02 (FIG. 6), the stop switch 302 is turned on by pressing the emergency stop button 404,
Motor 40 attached to each part of shooting box 40
7, 408 and 409 (FIG. 6) can all be stopped. Therefore, if an abnormality occurs in the shooting box 40 while each unit is moving by the operation of the motors 407, 408, and 409, the emergency stop button 404 is pressed to stop all the operations. Danger can be avoided.

Below the emergency stop button 404, the photographing control device 30 is installed. The photographing control device 30 is connected to the image processing device 10, and motors 407, 408, 409 and potentiometers 410, 411, 412 installed in each part of the photographing box 40.
The detection values input from the potentiometers 410, 411, and 412 are output to the CPU 101.
In accordance with the instruction signal input from 101, the motor 40
7, 408 and 409 are controlled. This photographing control device 30
Will be described later.

FIG. 2 shows a case 401 of the photographing box 40.
3 is a plan view of a main part showing a configuration inside a case 401 of the photographing box 40. FIG. As shown in FIGS. 2 and 3, the inside of the case 401 is a substantially rectangular parallelepiped space. It should be noted that, for convenience of description, the illustration of the right side mirror 62 is omitted in FIG.

In FIG. 2, a symbol α indicates an angle formed by a top mirror 61, which will be described later, and a ceiling in the case 401. In FIG. 3, a symbol γ indicates an angle formed by a right side mirror 62 and a left side mirror 63 described later with respect to the wall surface of the case 401. That is, digital camera 2
The right side mirror 62 and the left side mirror 63 are perpendicular to a virtual straight line connecting the point obtained by projecting the position of the subject 5 and the position of the subject 5 on the horizontal plane and perpendicular to the bottom surface of the case 401.
Each form an angle represented by the symbol γ.

In this embodiment, it is assumed that the angle represented by the symbol α in FIGS. 2 and 3 is 45 degrees, and the angle represented by the symbol γ is 45 degrees.

Referring to FIG. 2, an illumination device 421 is disposed on the ceiling portion of hood 402 inside case 401. The lighting device 421 is supported by a lighting fixing base 422 fixed to the ceiling surface of the case 401.

The lighting device 421 includes an incandescent lamp, a fluorescent lamp,
Or krypton ball, LED (Light Emitting Diode)
The light source is turned on / off according to the control of the illumination control unit 307 described later, and the inside of the case 401 is appropriately illuminated.

The illumination device 421 and the illumination fixing base 4
Although there is no particular limitation on the location of the hood 22, as shown in FIG. 2, when the hood 402 is installed closer to the digital camera 20 than the opening of the hood 402, the illumination device 421 may be reflected when the digital camera 20 takes a picture. No trouble at the time of shooting can be avoided.

An object pedestal 405 is installed on the bottom inside the case 401. The subject pedestal 405 is arranged inside the case 401 so as to face the digital camera 20. Further, the subject pedestal 405 is located near the wall surface facing the hood 402 and at a position not in contact with the wall surface.

The subject pedestal 405 includes a top plate 405a for mounting the subject 5 to be photographed, and a top plate 405a.
, A motor 408, a potentiometer 411 (FIG. 6), and the like.

The top plate 405a of the subject pedestal 405 is a flat plate made of, for example, a relatively hard material such as resin, glass, metal, or wood. When photographing with the digital camera 20, the subject is placed on the top plate 405a. 5 is placed. The legs 405b,... Are telescopic legs fixed to the four corners of the top plate 405a, and the legs 405b,.
8 are assembled, and the legs 405b,.
It expands and contracts with the operation of 8.

When the motor 408 operates on the subject pedestal 405, the legs 405b,.
Can be raised and lowered. Thus, when photographing the subject 5 with the digital camera 20, the photographing can be performed under optimum conditions by changing the height of the subject 5.

Although FIG. 3 shows a configuration provided with a plurality of motors 408, the number of motors 408 is not particularly limited, and if only one motor 408 is used, the cost of the photographing system 1 can be reduced. If a plurality of motors 408 are used, heavier subjects 5 can be handled.

Hereinafter, the side of the object pedestal 405 near the digital camera 20 will be referred to as the front side, and the side remote from the digital camera 20 will be referred to as the rear side.

Above the subject pedestal 405, an upper mirror 61 straddling the ceiling surface and the inner wall surface of the case 401 is disposed with the reflection surface facing the hood 402. Top mirror 6
Reference numeral 1 denotes a mirror that projects an image of the upper surface of the subject 5 toward the digital camera 20. The digital camera 20 can capture an image of the upper surface of the subject 5 that is reflected on the upper mirror 61.

As described above, the angle indicated by the symbol α in FIG. 2 is 45 degrees. That is, the upper mirror 61 is
Is mounted at an angle of 45 degrees with respect to the ceiling surface.
For this reason, the same image as when the subject 5 is viewed from directly above is projected toward the digital camera 20 by the upper mirror 61.

As shown in FIG. 3, a right side mirror 62 and a left side mirror 63 are provided on the side surface of the top plate 405a so as to straddle the wall surface located on the side of the subject pedestal 405. Both the right side mirror 62 and the left side mirror 63 face the digital camera 20. Each of the right side mirror 62 and the left side mirror 63 is erected vertically on the bottom surface of the case 401, and the mirror surfaces of the left side mirror 64 and the right side mirror 65 face the digital camera 20 side. As described above, the mounting angle of the right side mirror 62 and the left side mirror 63 with respect to the inner side surface of the case 401 is the angle indicated by the symbol γ in FIG. 3, that is, 45 degrees.

The left side mirror 64 and the right side mirror 6
5 may be fixed to the legs 405b,... Of the subject pedestal 405, or may be fixed to the wall surface of the case 401 and the bottom surface of the case 401.

The right side mirror 62 is located on the right side of the subject pedestal 405 when viewed from the digital camera 20, and projects the right side of the subject 5 toward the digital camera 20. Left side mirror 63
Is located on the left side of the subject pedestal 405 when viewed from the digital camera 20, and is located on the top plate 405a.
Is projected toward the digital camera 20.

Therefore, by photographing the images reflected by the right side mirror 62 and the left side mirror 63 by the digital camera 20, the side of the subject 5 can be photographed. Since the angle indicated by the symbol γ in FIG. 3 is 45 degrees, the image projected onto the digital camera 20 by the right side mirror 62 and the left side mirror 63 is the same image as when the subject 5 is viewed from right beside. It is.

Next, the configuration of the image processing apparatus 10 will be described. FIG. 4 is a block diagram illustrating an internal configuration of the image processing apparatus 10. As shown in FIG.
Are a CPU 101, an input unit 102, a RAM 103, a transmission control unit 104, a display unit 105, a storage device 106, a storage medium 107 included in the storage device 106, and an I / F unit 10.
8 are connected to the bus 109 except for the storage medium 107. Further, the image processing device 10
The I / F unit 108 is connected to an I / F unit 301 in the imaging control device 30 described later.

CPU (Central Processing Unit) 10
1 reads an application program stored in the storage device 106 in accordance with various instructions input from the keyboard 13 of the input unit 102,
In response to an instruction input by the keyboard 13 or the mouse 14 of the input unit 102, the image processing apparatus reads an imaging condition table file (not shown) stored in the storage device 106 and executes the processing. The photographing condition corresponding to the condition table file is referred to.
In addition, when an instruction regarding an imaging condition is input from the input unit 102, the CPU 101 acquires the input condition.

The CPU 101 determines the state of each part of the photographing box 40 when photographing is performed by the digital camera 20, that is, the tilt angle of the tilt base 403, the angle of the hood 402, the height of the top plate of the subject pedestal 405, the case An instruction signal for adjusting the illuminance or the like of the illumination device 421 provided in the 401 to the above-described imaging conditions is output to the imaging control device 30, and the control of the imaging control device 30 is executed, and each part of the imaging box 40 is controlled. The shooting conditions are adapted. When a response from the imaging control device 30 is detected,
An instruction signal is output to the digital camera 20 to adjust the shooting magnification, focus position, and exposure amount during shooting to the shooting conditions set in the shooting condition table file, thereby realizing the shooting conditions. When the response is detected, a photographing instruction signal for instructing the digital camera 20 to execute photographing is output to execute photographing. When image data indicating a captured image is input from the digital camera 20 after shooting is completed, the CPU 101 determines a captured image file based on the image data and the file name input from the input unit 102. Generated and stored in the storage device 106.

The CPU 101 generates display information for displaying a monitor image output from the digital camera 20 according to various instructions input from the input unit 102, outputs the display information to the display unit 105, and displays the display information on the display screen. Display the monitor image.

The CPU 101 generates display information for displaying an instruction selection screen for requesting the user to execute an instruction input using the keyboard 13 and the mouse 14 of the input unit 102, and outputs the display information to the display unit 105. In addition to displaying the instruction selection screen on the display screen of the display 12, an image or the like obtained by various processes executed by the CPU 101 is displayed on the display screen of the display 12.

The CPU 101 executes a photographing process, which will be described later, in response to an instruction input from the user, and the digital camera 20 causes the front image of the subject 5 and the right side mirror 6 to be displayed.
2 and the side image reflected on the left side mirror 63 and the top side mirror 61
The image of the upper surface reflected in is taken.

The input unit 102 has a keyboard 13 having numeric keys, character keys, various function keys, and the like. When detecting that any key is pressed on the keyboard 13, the input unit 102 presses a key corresponding to the pressed key. A signal is generated and output to the CPU 101. The input unit 102 includes a mouse 14 as a pointing device that specifies a specific position on the display screen of the display 12. When a click operation is performed on the mouse 14, a click signal is generated and output to the CPU 101. At the same time, it outputs relative position coordinate data indicating a position on the display screen to the CPU 101.

RAM (Random Access Memory) 103
Are various programs processed by the CPU 101,
A memory area for temporarily storing data relating to the processing is formed.

The transmission control unit 104 has a modem (MODE)
M: MOdulator / DEModulator) or a terminal adapter (TA), etc., and controls communication with an external device via a communication line such as a dedicated line, a wireless communication line, a telephone line, an ISDN line, or the like. Do. The modem modulates the digital data processed by the CPU 101 into an analog signal suitable for the frequency band of the telephone line in order to communicate with an external device such as a personal computer via the telephone line. A terminal adapter is a device that demodulates an analog signal input into a digital signal, and converts an existing interface into an interface corresponding to ISDN in order to communicate with an external device such as a personal computer through an ISDN line or the like. It is a device to convert.

The display unit 105 is a CRT (Cathode Ray Tub).
e) and a display 12 having a display screen constituted by an LCD (Liquid Crystal Display) or the like.
In accordance with the display information input from the PU 101, a window such as a predetermined monitor window is displayed on the display screen of the display 12, and a captured image taken by the digital camera 20 or a monitor image An image or the like generated by various processes to be executed is displayed.

The storage device 106 has a storage medium 107 in which programs, data and the like are stored in advance, and this storage medium 107 is constituted by a magnetic or optical recording medium or a semiconductor memory. The storage medium 107 is fixedly provided in the storage device 106 or is detachably mounted. The storage medium 107 includes a photographing application program for causing the digital camera 20 to photograph the subject 5, a digital camera, When taking a photographed image file in which data of an image photographed by the camera 20 or an image generated by the image editing process, an actual size of the image, photographing conditions at the time of photographing are stored in association with a file name, In addition to various files such as a photographing condition table file in which various conditions are set, an actual size calculation coefficient table 106a and the like which are referred to when calculating the actual size ratio of the subject 5 are stored.

The program, data, and the like stored in the storage medium 107 are partially or wholly received from the transmission control unit 104 from another device such as a server or a client via a transmission medium such as a network line. The storage medium may be configured to be stored, and the storage medium may be a storage medium of a server constructed on a network. Furthermore, the program may be configured to be transmitted to a server or a client via a transmission medium such as a network line and installed in these devices.

FIG. 5 is a diagram schematically showing the configuration of the actual size calculation formula coefficient table 106a stored in the storage device 106. In the actual size calculation formula coefficient table 106a shown in FIG. 5, the resolution at which the subject 5 is photographed by the digital camera 20 and the coefficients a, b, and c corresponding to each resolution are set.

The photographing system 1 can photograph with the digital camera 20 at a resolution of 1280 × 960 pixels, 640 × 480 pixels, or the like. In the automatic measuring process described later, the actual size of the subject 5 is calculated based on the number of pixels on the captured image, and therefore, it is necessary to consider the resolution of the captured image. Therefore, coefficients a, b, and c are set for each resolution in the actual size calculation coefficient table 106a shown in FIG.

In the photographing system 1, a photographing magnification value and a focus value at the time of photographing by the digital camera 20 can be set according to a user's request. Accordingly, in the actual size calculation formula coefficient table 106a, a coefficient a relating to the photographing magnification value, a coefficient b relating to the focus value, and c as a constant for correction are set.

The storage device 106 stores various data for measuring the actual dimensions of the subject 5 from the image of the subject 5 displayed on the display screen, in addition to the actual size calculation formula coefficient table 106a shown in FIG. May be stored. The data and the like stored in the storage medium 107 may be received from another device connected via the communication line or the like from the transmission control unit 104 and stored. It is also possible to provide a storage device having the above storage medium on another device side connected thereto via an interface, and to use programs and data stored in this storage medium via a communication line.

The I / F section 108 is an interface for inputting / outputting various instruction signals, position information, and the like from the image processing apparatus 10 to the digital camera 20 and the photographing control apparatus 30, and conforms to, for example, the IEEE 1394 standard. Connection terminal, serial input / output terminal including USB (Universal Serial Bus) port and RS-232C terminal, parallel input / output terminal, SCSI interface,
An infrared communication device or the like conforming to the IrDA (Infrared Data Association) standard is provided, and can be connected to the digital camera 20 and the imaging control device 30 by wire or wireless communication means.

The digital camera 20 has a CCD (Ch
arge Coupled Device: CMOS (Co)
In addition to a light receiving unit having a light receiving element such as a sensor, a lens, an aperture, and a motor for adjusting a photographing magnification and an exposure amount, a tilt table 403 included in the photographing box 40 includes a case 40.
The camera is fixed with the lens facing the direction of the subject 5 placed in the camera 1. The digital camera 20 is connected to the image processing apparatus 10, captures an image of the subject 5 in accordance with a capturing instruction signal input from the CPU 101 of the image processing apparatus 10, and outputs image data indicating an image obtained by capturing the image to the image processing apparatus 10. Output to

Further, the digital camera 20 can output an image received by the light receiving unit as a monitor image in a state where the light receiving unit including the light receiving element is operable, even when the photographing is not performed. This monitor image is different from a captured image in that the image received by the light receiving unit is output as it is via the I / F unit 201 without being stored in the image memory 203.
By receiving and displaying the monitor image, the image processing apparatus 10 can know the approximate state of the range to be photographed before photographing, as in the case of a normal camera viewfinder.

FIG. 6 is a block diagram showing the internal configuration of the digital camera 20 and the photographing control device 30. As shown in the figure, the digital camera 20 includes an I / F unit 201.
And a camera control unit 202 connected to the I / F unit 201
And an image memory 203 connected to the camera control unit 202
And the motors 2 connected to the camera control unit 202, respectively.
04, 205, and 206; a zoom adjustment unit 207 connected to the motor 204; a focus adjustment unit 208 connected to the motor 205; an aperture adjustment unit 209 connected to the motor 206; The adjusting unit 208 includes potentiometers 210, 211, and 212 connected to the iris adjusting unit 209.

Although the digital camera 20 includes a light receiving unit, a lens, and the like in addition to the components shown in FIG. 6, illustration and description are omitted here.

The I / F unit 201 is connected to the I / F unit 108 of the image processing apparatus 10 via the I / F unit 301 of the photographing control device 30, and an instruction signal input from the CPU 101 (FIG. 4). And an input / output interface for inputting / outputting various signals and data such as image data stored in the image memory 203, in addition to a shooting instruction signal, such as an IEEE 1394 terminal, a USB port, an RS-232C terminal, and the like. It has a serial input / output terminal, a parallel terminal, a SCSI interface, an infrared port conforming to the IrDA standard, and the like.

The camera control unit 202 controls the digital camera 2
0 is a control unit for controlling each unit of the I / F unit 20.
1 and the image memory 203. The camera control unit 202 is provided with the CPU 101 in the image processing apparatus 10.
Control unit 204 according to the instruction signal input from
The motor 204 connected to the motor 204, the motor 205 connected to the focus adjustment unit 205, and the motor 206 connected to the aperture adjustment unit 206 are operated by outputting a predetermined current.
When a detection value is output from the control unit 12, based on the detection value,
By changing the current output to the motors 204, 205, and 206, the magnification, the focal length (focus), and the exposure amount for photographing the subject 5 are adapted to predetermined photographing conditions.

Further, the camera control unit 202
Executes shooting according to a shooting instruction signal input from 1,
After generating image data indicating an image received by the light receiving unit including the above-described CCD or the like as data of a resolution designated by a signal input from the CPU 101, and temporarily storing the image data in the image memory 203, I /
The image is output to the image processing apparatus 10 via the F unit 201.

The image memory 203 is constituted by a magnetic recording medium, a semiconductor memory, or the like.
02, and temporarily stores image data indicating an image obtained by executing photographing in the digital camera 20.

The zoom adjustment unit 207 is a digital camera 2
At 0, an adjusting mechanism for adjusting the photographing magnification at the time of photographing is operated by rotating the motor 204 to change the photographing magnification. The motor 204 includes a zoom adjustment unit 207
Together with the camera control unit 202 and the potentiometer 2
10 and is rotated by the input of current from the camera control unit 202 to operate the zoom adjustment unit 207. The potentiometer 210 is connected to the motor 20.
4 and the I / F unit 201, which detects the rotation amount of the motor 204 as needed, and outputs a detection value corresponding to the rotation amount to the I / F unit 2.
Output to 01.

The focus adjustment section 208 is an adjustment mechanism for adjusting the focus at the time of photographing in the digital camera 20, operates by rotating the motor 205, and changes the focal length and the like. The motor 205 is connected to the camera control unit 20
2, focus adjustment unit 208, potentiometer 2
11 and is rotated by input of a current from the camera control unit 202 to operate the focus adjustment unit 208. The potentiometer 211 is connected to the motor 205 and the I / F unit 201, detects the rotation amount of the motor 205 as needed, and outputs a detection value according to the rotation amount to the I / F.
Output to the unit 201.

The aperture adjustment unit 209 is provided for the digital camera 20.
Is an adjustment mechanism for adjusting the exposure amount at the time of shooting, and operates by rotating the motor 206 to change the exposure amount. The motor 206 is connected to the camera control unit 202, the aperture adjustment unit 209, and the potentiometer 212, and is rotated by receiving a current from the camera control unit 202 to operate the aperture adjustment unit 209 to adjust the exposure amount. Execute The potentiometer 212 is connected to the motor 206 and the I / F unit 201, and
Is detected at any time, and a detection value corresponding to the rotation amount is calculated as I /
Output to F section 201.

As shown in FIG. 6, the photographing control device 30
An I / F unit 301 connected to the image processing apparatus 10 and the digital camera 20, a stop switch 302, a camera direction detection switch 303, a tilt base drive control unit 304 connected to a motor 407, and a motor 408. An object pedestal drive control unit 305, a hood drive control unit 306 connected to a motor 409, and an illumination control unit 307 are connected to each other by a bus. FIG. 6 shows a photographing box 4 for convenience of understanding.
Motors 407, 408, 409 and potentiometers 410, 411, 412 attached to the photographing control device 30 are illustrated together with the components of the imaging control device 30.

In the photographing control device 30, the I / F unit 30
1 is connected to the I / F unit 108 of the image processing apparatus 10 and the I / F unit 201 of the digital camera 20, and various signals and signals are transmitted between the I / F unit 108 and the I / F unit 201. An input / output interface for inputting / outputting data, for example, an IEEE1394 terminal, a USB
Serial input / output terminals including ports and RS232-C terminals, parallel terminals, SCSI interface,
It has an infrared port and the like according to the IrDA standard.

The stop switch 302 is connected to the shooting box 40
The emergency stop button 404 provided on the side of the case 401 shown in FIG. 1 is connected to the emergency stop button 404. When the user presses the emergency stop button 404, the emergency stop button 404 is turned on.
This is a switch for stopping all the motors 407, 408, 409 connected to 0.

The camera orientation detection switch 303 is a switch for detecting whether the orientation of the digital camera 20 fixed to the tilt table 403 of the shooting box 40 is horizontal or not, and is connected to the I / F unit 301. I have. Normally, when the bottom surface of the digital camera 20 is fixed to the flat portion of the tilt base 403, the captured image is a horizontally long image. If this state is assumed to be horizontal, the vertical installation is a method of fixing the side surface of the digital camera 20 to the flat portion of the tilt table 403, and the image captured by the vertically placed digital camera 20 is vertically long. Camera direction detection switch 303
The CPU 101 detects when the digital camera 20 is placed vertically, generates a vertical placement detection signal, and outputs the signal to the I / F unit 301.
0 can be detected as being placed vertically.

The tilt base drive control section 304 is a control section for controlling the position and movement of the tilt base 403 of the photographing box 40, and is connected to the I / F section 301 and the motor 407. The tilt table drive control unit 304 includes an I / F unit 3
01 to output the current to the motor 407 based on the instruction signal input from the CPU 101 through the CPU 101 to rotate the motor 407, and output the current to the motor 407 based on the detection value output from the potentiometer 410. Is changed to adjust the mounting angle of the tilt base 403 with respect to the hood 402 to a predetermined tilt angle suitable for shooting conditions.

The subject pedestal drive control unit 305 is a control unit for controlling the height of the subject pedestal 405 installed on the bottom surface of the case 401 of the photographing box 40.
/ F section 301 and motor 408. Subject pedestal drive control section 305 outputs a current to motor 408 to rotate motor 408 based on an instruction signal input from CPU 101 via I / F section 301, and detects a detection value output from potentiometer 411. The height of the subject 5 placed on the subject pedestal 405 is changed by changing the height of the top plate of the subject pedestal 405 by changing the current output to the motor 408 based on To fit.

A hood drive control unit 306 is a control unit for controlling the mounting angle of the hood 402 with respect to the case 401 at a connection portion between the hood 402 and the case 401 of the photographing box 40, and an I / F unit 301.
And the motor 409. The hood drive control unit 306 outputs a current to the motor 409 to rotate the motor 409 based on the instruction signal input from the CPU 101 via the I / F unit 301, and detects a detection value output from the potentiometer 412. Originally, the current output to the motor 409 is changed to change the mounting angle of the hood 402 with respect to the case 401 so as to conform to a predetermined photographing condition.

The illumination control section 307 is a control section for controlling the illuminance of the illumination device 421 provided inside the case 401 of the photographing box 40, and is connected to the I / F section 301. The lighting device 421 includes a light source such as a light bulb or a strobe, and the lighting control unit 307 controls the CPU 101
By controlling the amount of current flowing through the light bulb of the lighting device 421, the number of light bulbs to be lit, and the like in accordance with the instruction signal input via the / F section 301, illumination with illuminance suitable for predetermined shooting conditions is executed. .

FIG. 7 is a diagram showing an example of a photographed image photographed by the photographing system 1 configured as described above. As shown in the figure, when the subject 5 is photographed by the digital camera 20, the photographed image includes, in addition to the front image 504, which is the front image of the subject 5, an upper surface image 501 reflected on the upper mirror 61 (FIG. 2). The right side image 502 shown on the right side mirror 62 (FIG. 3) and the left side image 503 shown on the left side mirror 63 (FIG. 3) are shown.

Here, as described above, the top mirror 61, the right side mirror 62 and the left side mirror 63 are all case 401
Are mounted at an angle of 45 degrees with respect to the inner surface of the object 5, the top image 501 is the same image as when the subject 5 is viewed from directly above, and the right side image 502 and the left side image 503 are 5 is the same image as seen from the side.

For example, when a subject 51 having a triangular prism shape as shown in FIG.
The result is as shown in FIG. In the photographed image shown in FIG. 8B, the image photographing the side surface of the subject 51 is the same image on the right side surface and the left side surface.

The operation of the photographing system 1 configured as described above will be described. 9 to 11 are general flows showing the operation of the imaging system 1. A program for realizing each function described in all the flowcharts described below is stored in the form of a readable program code on the recording medium 107, and the CPU 1 follows the program code. Execute the operation sequentially. The CPU 1 also includes a transmission control unit 10
The operation according to the above-described program code transmitted through the communication device 4 can be sequentially performed. That is,
In addition to the recording medium 107, an operation unique to this embodiment can be executed using a program / data transmitted and supplied from the outside.

In step S101 shown in FIG. 9, the user sets the digital camera 20 and the shooting box 40
Are designated, or various photographing conditions are designated.

Subsequently, in step S103, the CPU 101
Outputs an instruction signal to the tilt base drive control unit 304, the subject base drive control unit 305, and the hood drive control unit 306 in accordance with the designation input in step S101, and outputs the detection values output from the potentiometers 410, 411, and 412. , Control of the motors 407, 408, and 409 is executed, and the mounting angle of the hood 402 and the tilt base 403 and the height of the top surface of the subject pedestal 405 are moved so as to conform to the shooting conditions. Also, the CPU 101
Outputs an instruction signal to the lighting control unit 307, and outputs
The illumination device 421 provided on the inner upper surface of the camera 01 is controlled to execute illumination with an illuminance suitable for shooting conditions. Further, the CPU 101 outputs an instruction signal to the camera control unit 202 in the digital camera 20, and operates the motors 204, 205, 206 based on the detection values output from the potentiometers 210, 211, 212. , Zoom adjustment unit 207, focus adjustment unit 20
8. The control of the aperture adjusting unit 209 is executed to adjust the photographing magnification, focus, and exposure amount of the digital camera 20 during photographing to match the photographing conditions.

In step S101, an input screen for moving each movable device in the photographing system 1 is displayed on the display screen of the display 12.
An input operation from the input unit 102 may be received. In the image processing apparatus 10, the photographing conditions corresponding to each photographing surface are stored in advance in a photographing condition table file in the storage device 106, and the photographing conditions specified by the input operation on the input unit 102 are read out to automatically The configuration may be such that each device is moved to the next location.

In step S 102, when it is confirmed that the devices of each part of the photographing system 1 have moved so as to meet the photographing conditions, the CPU 101 proceeds to step S 103 and outputs a photographing instruction signal to the camera control unit 202. , And execute shooting. Here, image data indicating an image obtained by shooting is stored in the image memory 203 by the camera control unit 202. The image captured in step S103 is, for example, an image as shown in FIG.

In the following step S104, CPU 1
01 executes a process of cutting out only images of the upper surface and the front surface of the subject 5 from the image captured by the digital camera 20, and proceeds to step S105. For example, FIG.
When the processing in step S104 is performed on the captured image illustrated in FIG.
A range including the fourth region is cut out as a front image, and a range including the top image 501 is cut as a top image.

In step S105 of FIG.
1 determines whether or not the shape of the subject 5 is a special shape. Here, the special shape is, for example, a shape such as a bottle in which the upper portion and the lower portion have different thicknesses and side shapes, a shape having a surface having a different shape such as a spherical surface and a flat surface, and other shapes such as a box shape and a cylinder. It refers to a shape that is clearly different from a simple simple solid. The determination in step S105 is performed, for example, by processing an image captured by the digital camera 20. Then, the CPU 101 determines that the subject 5
Is determined to have a special shape (step S10).
6; Yes), the process moves to step S121 (FIG. 10) described later.

If it is determined that the subject 5 does not have a special shape (step S106; No), the CPU 101
Shifts to step S107, and determines whether or not the shape of the subject 5 is a box shape. If the subject 5 is not box-shaped, the process directly proceeds to step S109, and if the subject 5 is box-shaped, the process proceeds to step S108.

If it is determined in step S107 that the subject 5 has a box shape, the CPU 101 proceeds to step S108 to determine whether or not the installation angle of the subject 5 is within the first allowable range. I do. Here, the installation angle of the subject 5 refers to an angle at which the subject 5 is inclined in the horizontal direction from a position where the front of the subject 5 and the imaging surface of the digital camera 20 face each other directly in front.

FIG. 14 is a diagram illustrating the relationship between the installation angle of the box-shaped subject 52 and the photographed image. The image shown in the figure is an image cut out by the processing shown in step S104 of FIG.

In the upper image of the subject 52 shown in the upper part of the image shown in FIG. 14, the angle of the subject 52 with respect to the front side can be confirmed as indicated by the arrow in the figure. Step S10
The installation angle in FIG. 8 (FIG. 9) is the angle indicated by the symbol Θ in FIG. As shown in FIG. 14, when the subject 52 is inclined with respect to the front surface, that is, the imaging surface of the digital camera 20, the image of the front of the subject 52 shown in the lower part of FIG. Two lines indicated by reference signs A and B appear. In this case, the process of calculating the actual size of the subject 52 in the later-described subject image detection process (FIG. 15), the automatic measurement process (FIG. 16), and the actual size calculation process (FIG. 17) may be hindered.

For this reason, in the processing shown in step S108 of FIG. 9, if the installation angle is within the first allowable range, the CPU 101 corrects the installation angle and proceeds to step S108.
Move to 109. If the setting angle of the subject is outside the first allowable range, step S131 in FIG.
Move to.

In the following step S109, CPU 101
Executes the subject image detection process (FIG. 15) described later on the image cut out in step S104, and determines the row and column including the upper end, lower end, right end, and left end of the image of the subject 5 in the captured image. .

For example, when the subject detection processing in step S109 is performed on the upper surface image 501 shown in FIG.
As shown by reference numerals a, b, c, and d in FIG. 13, the positions of the upper end, the lower end, the right end, and the left end of the upper surface image 501 are determined.

The CPU 101 proceeds to step S110, and obtains the ratio between the depth and the width of the subject 5 based on the determined end of the image of the subject 5. For example, the CPU 10
1 is based on the number of pixels between the upper and lower ends, that is, the number of pixels indicating the depth of the subject 5, and the number of pixels between the left and right ends, that is, the number of pixels indicating the width of the subject 5. ) Is performed. (Ratio of depth to width) = (number of pixels in depth) / (number of pixels in width) ... (1)

Thereafter, the CPU 101 executes an automatic measuring process (FIG. 16) to be described later (step S111) to obtain the actual width and height of the subject 5. And CPU
101 shifts to step S112, and step S11
0, the ratio of the depth and the width of the subject 5 obtained in step S
The actual size of the depth of the subject 5 is obtained based on the actual size of the width obtained in step 111.

When the front image is used, the actual size of the “width” of the subject 5 can be obtained without error. However, the actual size of the “depth” of the subject 5 can be obtained by using the upper mirror 61 of the upper surface of the subject 5. When obtained from an image, a value smaller than the actual actual size is obtained. Therefore, in step S112, the CPU 101 performs an arithmetic process represented by the following equation (2), and obtains the actual size of the “depth” of the subject 5 using the ratio of the depth to the width in the image of the upper surface of the subject 5. (Depth) = (width) x (ratio of depth to width) ... (2)

Thereafter, the CPU 101 proceeds to step S113.
Then, a file name is added to the image data of the captured image cut out in step S104 to generate a captured image file, the captured image file is stored in the storage device 106, and the captured image file is Step S
111 and the subject 5 obtained in the processing of step S112
The actual size data (height, width, depth) is stored.

Thereafter, the CPU 101 clears the photographed image data stored in the work area of the RAM 103 and clears the image data temporarily stored in the image memory 203 (step S114), and proceeds to step S115. I do.

In step S115, the CPU 101 determines whether or not to end the processing, and returns to step S101 if the processing has not been ended or if an instruction to continue the processing has been input. If not, the process ends.

Here, the subject detection processing executed in step S109 will be described in detail. FIG. 15 is a flowchart showing in detail the subject detection process executed in step S109 (FIG. 9).

Prior to the subject image detecting process shown in FIG. 15, the CPU 101 sets an XY coordinate axis having the origin at the upper left corner of the image on the photographed image to be processed. Therefore, a point on the right side of the image has a larger X coordinate, and a lower point on the image has a larger Y coordinate. Thereby, the position coordinates of an arbitrary point on the image can be specified.

In the subject image detection process shown in FIG. 15, first, the CPU 101 scans the lower half of the photographed image in the row direction (horizontal direction) from the uppermost row thereof (step S151). Is detected (step S152). That is, first, the display color of each pixel is sequentially acquired in the horizontal direction of the captured image, with the point at the upper left corner of the captured image as a start position. Then, when a portion that produces a color difference of a predetermined value or more between adjacent pixels is detected, it is determined to be a boundary between the background image and the image of the subject 5.

Therefore, if scanning in the row direction is performed in step S151 and there is no place where a color difference exceeding a predetermined value is found, it is determined in step S152 that all images in the row are background images and no image is captured. Then, step S15
Move to 3. In step S153, the line to be scanned is shifted to the next line, and the process returns to step S151.

In step S152, if a color difference equal to or more than a predetermined value is detected between adjacent pixels, the image is the image of the subject 5 detected in the uppermost row. (Step S154).

Furthermore, the CPU 101 determines in step S15
The position coordinates stored as the top end of the image of the subject 52 in 4 are temporarily stored as the coordinates of the left end and the right end of the image of the subject 5 (step S155).

Subsequently, the CPU 101 moves to the next line in the photographed image and performs scanning (step S156).
Then, when the boundary between the background image and the image is detected at the pixel on the left side of the left end coordinates temporarily stored in step S155, that is, the pixel at the position where the X coordinate is small, the coordinates of the newly detected boundary are set to the left end. Store as information (step S15
8). Similarly, when the boundary between the image and the background image is detected at the right side of the coordinates at the right end stored in step S155, that is, at a pixel at a position where the X coordinate is large, the coordinates of the newly detected boundary are stored as right end information. Yes (step S15
9).

Thereafter, the CPU 101 determines whether or not to continue scanning by determining whether or not scanning of the lowermost row of the captured image has been completed (step S).
160). If it is determined in this step S160 that there are still rows to be scanned, the process returns to step S156. If the scan has been executed to the lowermost end, the process proceeds to step S161.

In step S161, step S154
The coordinates stored in are determined as the top coordinates,
The row where the image was detected last, that is, the row above the row determined to have no image in step S157 is determined as the lower end (step S161).

Then, the CPU 101 determines in step S15
8 and the left end information and the right end information stored in step S159 are determined, the subject detection processing ends, and the process returns to step S110 in FIG.

Next, the automatic measuring process shown in step S111 of FIG. 9 will be described in detail. FIG. 16 is a flowchart showing the automatic measuring process shown in step S111 in more detail.

In the automatic measuring process shown in FIG.
The CPU 101 determines in step S103 (FIG. 9) that the subject 5
Acquires the shooting conditions at the time of shooting. The photographing conditions acquired here are the resolution of the photographed image data, the photographing magnification, and the photographing distance. The photographing magnification value is stored as a constant Z, the photographing distance is stored as a constant R, and the resolution is stored.
Note that the CPU 101 acquires the constant Z from the zoom value of the digital camera 20 and
Obtained from the focus value at 0.

Subsequently, the CPU 101 executes a subject image detection process (step S172) to determine a row and a column including the upper end, the lower end, the right end, and the left end of the image of the subject 5. Here, the subject image detection processing in step S172 will be described in detail.

First, the CPU 101 operates the display 12
The image data of the photographed image displayed on the display screen is read, and scanning in the row direction (horizontal direction) is performed. here,
The CPU 101 determines the scan start point at the pixel at the upper left corner of the image, and sequentially acquires the display color displayed on each pixel while moving horizontally to the right. Then, when a location where the display color is significantly different is detected in the adjacent pixels, this location is stored as a boundary between the background image and the image of the subject 5.

In the photographing box 40 shown in FIG.
Since the background of the subject 5 placed on the subject pedestal 405 in the case 401 is the wall surface of the case 401, there is no particular pattern on the background, and the background has a substantially uniform color. Therefore, if there is a portion in the captured image where the display color changes greatly between adjacent pixels, it can be determined that the portion is a boundary between the background and the subject 5.

Then, the CPU 101 stores the position where the boundary between the background image and the image of the subject 5 is first detected as the uppermost end, and stores the position where the image of the subject 5 was last detected as the lowermost end. .

The CPU 101 stores the leftmost position in the boundary between the background image and the image of the subject 5 as the left end of the subject 5, and similarly stores the rightmost position as the rightmost end.

At step S172, CPU 101
Performs the series of processes described above to detect the upper, lower, left, and right ends of the image of the subject 5 in the captured image, and proceeds to step S173 to execute the actual size calculation process (to be described later) (FIG. 1).
7) is executed (step S173), and step S of FIG.
Return to 112 (FIG. 9).

FIG. 17 is a flowchart showing the actual size calculation processing shown in step S173 of FIG. 15 in more detail. In the processing shown in FIG.
First, referring to the actual size calculation formula coefficient table 106a (FIG. 5) in the storage device 106 (FIG. 4), the actual size calculation formula coefficients a,
b and c are acquired (step S181).

Subsequently, the CPU 101 proceeds to step S18.
The calculation is performed using the actual size calculation formula coefficients a, b, and c obtained in step 1 to calculate the number of pixels per unit length (step S182). As an example of the calculation performed in step S182, in the present embodiment, a case where the number of pixels per 1 mm (millimeter) is obtained is expressed by the following equation (3). Number of pixels per mm = a × Z + b × R + c (3)

In the above equation, Z and R are constants corresponding to the photographing magnification and the photographing distance, respectively, and a, b, and c are:
These are predetermined coefficients and constants obtained from the actual size calculation formula coefficient table 106a in FIG.

Then, the CPU 101 determines in step S12
The number of pixels per unit length calculated in step 2 and step S1
The actual size of the subject 5 is calculated by performing calculations based on the information on the upper, lower, left, and right ends of the subject image stored in the subject image detection processing of 72 (FIG. 16). An example of the calculation performed here is shown in the following equation (4). Actual size of shooting target = Number of pixels of shooting target / Number of pixels per 1 mm ... (4)

Here, in the arithmetic processing shown in the above formulas (3) and (4), the calculation is based on “1 mm” as the unit length, but it may be changed as appropriate according to the size of the subject 5. Good.

With the above processing, in the photographing system 1, the digital camera 20 can be used to control the front of the subject 5,
The upper surface, the right side surface, and the left side surface are photographed simultaneously, and only the upper surface image and the front image of the subject 5 are cut out from the obtained photographed image. Then, the actual dimensions of the “width”, “height”, and “depth” of the subject 5 can be obtained based on only the image of the top surface and the front image of the subject 5 which are cut out. Thus, the actual size of each part of the subject 5 can be obtained only by photographing the subject 5 once with the digital camera 20. Further, since the actual size is calculated using only the image of the upper surface and the image of the front of the subject 5, the processing can be reduced by suppressing the number of images to be processed to the minimum required number, and the load on hardware can be reduced. For this reason, the processing performance of the necessary hardware can be reduced and cost can be reduced, or the work load can be reduced by speeding up the processing.

In the process shown in FIG. 9, in step S104, the object 5 is displayed together with the image of the front of the object 5.
Has been shown, the actual depth of the subject 5 is determined based on the image of the top surface of the subject 5.
The present invention is not limited to this, and an image of the right side or the left side of the subject 5 may be cut out to obtain the actual size of the “depth” of the subject 5. Further, in order to facilitate the processing when detecting the image of the subject 5 in the captured image, the rear side of the subject base 405 and the top mirror 61
Below, a single color paper or cloth serving as a background of the subject 5 may be arranged.

On the other hand, if the shape of the subject 5 is special in step S106 in FIG. 9, the CPU 101 proceeds to step S121 shown in FIG. In step S121,
The CPU 101 determines an image of the upper surface of the subject 5, for example, FIG.
The above-described subject detection processing (FIG. 15) is executed for the upper surface image 501 shown in FIG. As a result, as shown by reference numerals a, b, c, and d in FIG.
Position coordinates of the lower end, the left end, and the right end are respectively determined and acquired.

Next, the CPU 101 obtains the number of pixels having the width m of the upper surface image 501 from the difference between the determined right and left coordinates (step S122). further,
The CPU 101 determines whether the top end image 501 acquired in step S121 is at the left end (reference numeral c in FIG. 13) or the right end (FIG.
The difference between the Y coordinate of the reference symbol d) in the middle and the Y coordinate of the upper end (reference symbol a in FIG. 13) is obtained.
, The distance n from the front surface indicated by the symbol A in FIG.
Is obtained by the number of pixels (step S123).

Next, the CPU 101 executes the above-described automatic measuring process (FIG. 16) on the image of the front of the subject 5 (step S124), and acquires the actual width and height of the subject 5.

Then, the CPU 101 calculates the depth indicated by the symbol n in the figure by the calculation represented by the following equation (5) (step S125). (Actual size of n) = (actual size of width) × (number of pixels of n) ÷ (number of pixels of width m) (5)

The value of the width m calculated in step S124 is calculated as the distance from the imaging surface of the digital camera 20 to the subject 5, based on the distance from the front of the subject 5. That is, the distance from the position indicated by the symbol A in FIG. 13 to the digital camera 20 is set as the shooting distance. However, in practice, the position having the width m is the position shown in FIG.
This is the position indicated by reference symbol B in the middle, and the width needs to be corrected.

Therefore, the CPU 101 proceeds to step S12
Then, the process proceeds to step S6, and after taking into account the value of n calculated in step S125 to the photographing distance, the same process as step S124, that is, the automatic measuring process (FIG. 16) is performed again to calculate the value of the width m. I do.

Then, the CPU 101 proceeds to step S127.
Then, a file name is added to the image data of the photographed image of the front or upper surface of the subject 5 to generate a photographed image file, the photographed image file is stored in the storage device 106, and the photographed image file is The actual size data (height, width, depth) of the obtained subject 5 is stored.

Thereafter, the CPU 101 clears the photographed image data stored in the work area of the RAM 103 and clears the image data temporarily stored in the image memory 203 (step S128), and proceeds to step S129. I do.

In step S129, the CPU 101 determines whether or not to end the processing. If the processing has not been ended or if an instruction to continue the processing has been input, the CPU 101 proceeds to step S101 (FIG. 9). Otherwise, the process ends.

With the above processing, in the photographing system 1, the front, top, right and left sides of the subject 5 are simultaneously photographed by the digital camera 20, and the top and bottom images of the subject 5 are obtained from the obtained photographed image. Only the image of is cut out. Then, the actual dimensions of the “width”, “height”, and “depth” of the subject 5 can be obtained based on only the image of the top surface and the front image of the subject 5 which are cut out. Further, the position of the right end and the left end when viewed from the front is such that the subject 5 has a columnar shape or a columnar shape having an elliptical cross section, for example.
Even if the shape is irregular compared to the box shape, such as being lower than the foremost part of the subject 5, the width of the subject 5 is calculated and the width is calculated again. The exact size can be obtained.

For example, when the photographing system 1 photographs a subject 53 having a different width at the upper part and the lower part as shown in FIG. 18A, the photographed image is as shown in FIG. 18B. . The difference in the horizontal width between the upper part and the lower part of the subject 53 is the difference indicated by reference numeral δ in FIG. Here, the upper part of the subject 53 is located behind the lower part by the amount indicated by the symbol δ. For this reason, it is far from the imaging surface of the digital camera 20 by the distance indicated by the reference numeral δ, and the captured image is smaller than the lower portion of the subject 53. However, in the above process, since the correction is performed in the process in step S126 in FIG. 10, an accurate actual size can be obtained.

As a result, the subject 5 is moved to the digital camera 2
By photographing only once with 0, the actual size of each part can be more accurately obtained even for the subject 5 having an irregular shape. Therefore, even when the shape of the subject 5 is irregular, the user does not need to perform any special processing or setting operation, so that the work load on the user is reduced, and the work is performed more easily and efficiently. be able to.

In the above-described processing, the actual size of the “width” of the subject 5 is corrected based on the image of the top surface of the subject 5 to obtain the same. The actual height of the subject 5 can be corrected and obtained. In this case, even if the subject 5 has a shape like a bin having different thicknesses at the upper part and the lower part, the actual size can be obtained more accurately. In addition, the positions of the right end and the left end in the image in front of the subject 5 are used as the position where the subject 5 is maximized, but the Y coordinate of the right end and the Y coordinate of the left end are used.
If the coordinates are different, the processing may be performed after calculating the average value of the Y coordinates at both ends. When the subject 5 has a box shape, there may be a plurality of right and left ends in the front image. In this case, when the image of the subject 5 is detected and the right and left ends are determined, X is used. A position where the Y coordinate coincides may be selected from a coordinate position where the coordinates are relatively large and a coordinate position where the X coordinate is relatively small, and may be determined as the right end and the left end.

Further, in step S126 in FIG.
Execute the automatic measuring process (FIG. 16) to execute the "width" of the subject 5.
Although the actual size of the object 5 has been acquired again, the actual size of the “width” of the subject 5 may be obtained by a calculation process represented by the following equation (6). (Actual size of width correction) = (actual size of width) × (photographing distance of photographing condition + actual size of n) ÷ (photographing distance of photographing condition) (6)

On the other hand, if the installation angle of the subject 5 exceeds the first allowable range in step S108 of FIG.
101 moves to step S131 of FIG. In step S131, the CPU 101 executes the above-described subject detection processing (FIG. 15) on the image of the upper surface of the subject 5, for example, the upper surface image 501 shown in FIG. This allows
As shown by reference numerals a, b, c, and d in FIG. 14, the position coordinates of the upper, lower, left, and right ends of the upper surface image 501 are determined, respectively.
Is obtained. Note that the position coordinates indicated by reference numerals a, b, c, and d in FIG. 14 indicate the upper end, the left end, the lower end, and the right end of the upper surface image 501, respectively.

Here, since the subject 5 is inclined with respect to the imaging surface of the digital camera 20 by the angle indicated by the symbol Θ in FIG. 14, the CPU 101 acquires the value of the angle Θ (step S132). ).

For example, the CPU 101 determines in step S13
Based on the coordinates of the ends indicated by reference numerals a, b, c, and d in FIG. 14 obtained by the processing of No. 1, the calculation represented by the following equation (7) is performed. tan Θ = (Y coordinate of d−Y coordinate of a) ÷ (X coordinate of d−X coordinate of a) (7)

The number of pixels on the side ad in FIG.
It is obtained by the calculation represented by the following equation (8). In addition,
In the following equation (8), sqrt indicates a positive square root for the value in parentheses. ad = sqrt {(ad ') ² + (dd') ² } = sqrt {(X coordinate of d-X coordinate of a) ² + (Y coordinate of d-Y coordinate of a) ² } (8)

Further, the pixel ratio between the side ad in FIG. 14 and the side ad ′ in FIG. 14 is obtained by the calculation represented by the following equation (9). Pixel ratio between ad and ad '= ad ÷ (X coordinate of d−X coordinate of a) (9)

With the above processing, the size of the angle indicated by the symbol Θ in FIG. 14 is obtained. Then, the CPU 101 proceeds to step S133, and determines whether or not the size of the angle Θ obtained in step S132 is within the second allowable range. If it exceeds the second allowable range (step S133;
No), the correction is difficult because the inclination of the subject 5 is very large, so the CPU 101 proceeds to step S134 and causes the display unit 105 to display and output warning information addressed to the user. Then, when it is confirmed again that the subject 5 has been placed on the subject base 405, step S101 is performed.
Return to (FIG. 9).

If the value of the angle Θ is within the second allowable range, the inclination of the subject 5 is within the correctable range.
The PU 101 executes the above-described automatic measuring process (FIG. 16) on the front image of the subject 5 (Step S136),
The actual size of the width and height of the subject 5 is obtained. In the automatic measuring process in step S136, the process is performed with the side indicated by reference numeral A in FIG. In this case, the required width is represented by a symbol a in FIG.
This corresponds to the side indicated by d '.

The CPU 101 corrects the value of the width obtained in step S136 based on the pixel ratio between ad and ad 'obtained by the calculation represented by the above equation (9). For example, the CPU 101 performs an operation represented by the following equation (10). (Actual size of width correction) = (actual size of width) × (pixel ratio between ad and ad ′) (10)

Then, the CPU 101 proceeds to step S138.
Then, a file name is given to the image data of the photographed image of the front or upper surface of the subject 5 to generate a photographed image file, the photographed image file is stored in the storage device 106, and the photographed image file is The actual size data (height, width, depth) of the obtained subject 5 is stored.

Thereafter, the CPU 101 clears the photographed image data stored in the work area of the RAM 103 and clears the image data temporarily stored in the image memory 203 (step S139), and proceeds to step S140. I do.

In step S140, CPU 101 determines whether or not to terminate the processing. If the processing has not been terminated, or if an instruction to continue the processing has been input, step S101 (FIG. 9) Otherwise, the process ends.

With the above processing, in the photographing system 1, the front, top, right side, and left side of the subject 5 are simultaneously photographed by the digital camera 20, and the image of the top of the subject 5 and the front Only the image of is cut out. Then, the actual dimensions of the “width”, “height”, and “depth” of the subject 5 can be obtained based on only the image of the top surface and the front image of the subject 5 which are cut out. Further, the subject 5 placed on the subject pedestal 405
Is oblique to the imaging surface of the digital camera 20, even if the subject 5 is tilted based on the width of the subject 5 viewed from the digital camera 20 and the tilt angle of the subject 5. Since the actual size of the width is obtained, even if the subject 5 is placed diagonally, the actual size of the subject 5 remains unchanged.
It can be obtained more accurately.

As a result, the subject 5 can be
Even if the subject 5 is placed obliquely with respect to the imaging surface of the digital camera 20, the actual size of each part can be obtained more accurately by taking only one image with 0. Therefore,
Even if the user places the subject 5 obliquely with respect to the imaging surface of the digital camera 20, there is no need to correct the position of the subject 5, so that the work load on the user can be reduced,
Work can be performed efficiently.

If the angle indicated by the symbol Θ in FIG. 14 exceeds the second allowable range, that is, if the subject 5 is extremely inclined with respect to the imaging surface of the digital camera 20, Since a warning is issued to the user in step S134 of FIG. 11, it is possible to avoid a situation in which the captured image does not look good.

In the processing shown in step S107 in FIG. 9, the determination of the installation angle on the object pedestal 405 is limited to the box-shaped object 5 because, for example, the object 54 and the object 55 having a shape as shown in FIG. Is performed without considering the installation angle.

FIGS. 19A and 19B are perspective views showing examples of another subject photographed by the photographing system 1. FIG. 19A shows the subject 54, and FIG. 19B shows the subject 55. FIG. 19 (a)
Is a solid having a diamond-shaped plane and a very small height. The subject 55 shown in FIG. 19B is a solid having a substantially star-shaped plane and a very small height.

For the three-dimensional object such as the subject 54 or the subject 55, it is more useful to calculate the apparent actual size in the state shown in FIGS. 19A and 19B. I do. Therefore, if processing similar to that of the box-shaped subject 5 is performed on a three-dimensional object such as the subject 54 or the subject 55, the processing in step S107 may not be performed.

In the above-described embodiment, it goes without saying that the detailed configuration and the like of the photographing system 1 can be appropriately changed without departing from the spirit of the present invention.

[0158]

According to the first aspect of the present invention, the image of the front surface, the upper surface, the right side surface, the left side surface, and the like of the object to be photographed is simultaneously photographed by the photographing device, and a plurality of photographed images are obtained. The actual dimensions such as “width”, “height”, and “depth” of the photographing target can be obtained. This makes it possible to easily obtain the actual size of each part by photographing the photographing target only once with the photographing device. In addition, since the actual size is calculated using only the captured images of the front surface of the object to be photographed and a predetermined surface other than the front surface, the number of images to be processed is reduced to a minimum necessary number as compared with the case of processing a plurality of images. It is possible to reduce the processing by suppressing it and reduce the load on hardware. For this reason, the processing performance of the necessary hardware can be reduced to reduce the cost, or the work load can be reduced by speeding up the processing.

According to the second aspect of the present invention, the shape of a photographing object having an irregular shape as compared with a box shape, such as a columnar shape or a columnar shape having an elliptical cross section, can be changed. Since the acquired actual size is corrected based on the shape, a more accurate actual size can be obtained. Thus, the actual size of each part can be more accurately obtained even for an irregularly shaped photographing object by photographing the photographing object only once with the photographing device. Therefore, even if the shape of the object to be photographed is irregular, the user does not need to perform any special processing or setting operation, so that the work load on the user is reduced, and the work can be performed more easily and efficiently. It can be carried out.

According to the third aspect of the present invention, even if the installation state deviates from the ideal state, for example, when the object to be photographed is placed obliquely with respect to the imaging surface of the photographing apparatus,
Since the actual size is corrected based on the installation state, the actual size of the photographing target can be accurately obtained as it is. Therefore, even if the user cannot place the shooting target in an ideal state,
Since it is not necessary to correct the position of the photographing target, the work burden on the user can be reduced, and the work can be performed more easily and efficiently.

According to the fourth aspect of the present invention, the warning information is output when the installation state of the photographing object is inappropriate, so that the user is notified of the abnormality in the installation state of the photographing object. Can be. As a result, an actual size with a large error is calculated based on a clearly abnormal photographed image,
It is possible to avoid a situation in which the user does not notice and leaves a poor-looking photographed image.

[Brief description of the drawings]

FIG. 1 is a schematic perspective view showing a configuration of a photographing system 1 according to an embodiment of the present invention.

FIG. 2 is a cross-sectional view of a main part showing an internal configuration of a case 401 shown in FIG.

FIG. 3 is a cross-sectional view of a main part showing an internal configuration of a case 401 shown in FIG.

FIG. 4 is a block diagram showing a configuration of the image processing apparatus 10 shown in FIG.

5 is a diagram schematically showing a configuration of an actual size calculation formula coefficient table 106a stored in a storage device 106 shown in FIG.

FIG. 6 is a block diagram showing an internal configuration of the digital camera 20 and the photographing control device 30 shown in FIG.

7 is a diagram showing an example of a photographed image photographed by the photographing system 1 shown in FIG.

8A and 8B are diagrams illustrating another example of a photographed image photographed by the photographing system 1 illustrated in FIG. 1, wherein FIG. 8A is a perspective view illustrating a subject 51, and FIG. It is a figure showing an image.

FIG. 9 is a general flow showing an operation of the imaging system 1 according to the embodiment of the present invention.

FIG. 10 is a photographing system 1 according to an embodiment of the present invention.
It is a general flow showing the operation of.

FIG. 11 is a photographing system 1 according to an embodiment of the present invention.
It is a general flow showing the operation of.

FIG. 12 is a diagram showing an example of an image cut out by the process shown in step S104 of FIG. 9;

FIG. 13 is an explanatory diagram showing a state of processing shown in steps S121 to S126 of FIG. 10;

FIG. 14 is an explanatory diagram showing a state of processing shown in steps S131 to S137 of FIG. 11;

FIG. 15 is a flowchart showing details of a subject detection process shown in step S109 of FIG. 9;

FIG. 16 is a flowchart showing details of the automatic measuring process shown in step S111 of FIG. 9;

FIG. 17 is a flowchart showing the actual size calculation processing shown in step S173 of FIG. 15 in detail.

FIG. 18 is a photographing system 1 according to an embodiment of the present invention.
It is a perspective view showing an example of another subject photographed by,
(A) is a perspective view showing the subject 53, and (b) is a view showing a captured image of the subject 53.

FIG. 19 is a photographing system 1 according to an embodiment of the present invention.
It is a perspective view showing an example of another subject photographed by,
(A) shows the subject 54, and (b) shows the subject 55.

[Explanation of symbols]

 Reference Signs List 1 imaging system 10 image processing device 101 CPU 102 input unit 103 RAM 104 transmission control unit 105 display unit 106 storage device 106a actual size calculation formula coefficient table 107 storage medium 108 I / F unit 109 bus 20 digital camera 201 I / F unit 202 camera Control unit 203 Image memory 204, 205, 206 Motor 207 Zoom adjustment unit 208 Focus adjustment unit 209 Aperture adjustment unit 210, 211, 212 Potentiometer 30 Imaging control device 301 I / F unit 302 Stop switch 303 Camera direction detection switch 304 Tilt table drive Control unit 305 Subject pedestal drive control unit 306 Hood drive control unit 307 Lighting unit 40 Shooting box 401 Case 402 Hood 403 Tilt table 404 Emergency stop button 405 Subject pedestal 405 a Top plate 405b Leg 406 Side door 407, 408, 409 Motor 410, 411, 412 Potentiometer 421 Illumination device 422 Illumination fixing base 61 Top mirror 62 Right side mirror 63 Left side mirror 5, 51, 52, 53, 54, 55 Subject

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/222 H04N 5/222 Z // H04N 101: 00 101: 00 F term (Reference) 2F065 AA21 DD06 FF04 FF65 JJ03 JJ26 LL06 LL12 LL30 NN03 PP11 QQ23 QQ24 QQ25 QQ31 SS02 SS13 5B047 AA07 BA02 BC09 BC14 CA12 CB12 CB25 DC20 5C022 AA13 AC21 AC27 CA02 5L096 AA09 BA08 CA04 CA18 CA25 DA03 EA35 FA09 FA64

Claims (4)

[Claims] 1. A photographing assisting device in which a photographing device is attached to a housing for housing a photographing object, wherein the photographing device moves the photographing device so as to move the photographing object contained in the housing. Position control means for changing the position of the object, and a mirror disposed in the housing so as to project an image of a predetermined surface of the object to be photographed other than the front surface facing the photographing device toward the photographing device. A photographing control means for simultaneously photographing the front of the photographing object and the image reflected on the mirror by the photographing device; and a plurality of photographed images photographed by the photographing device under the control of the photographing control means. And an actual size calculating means for obtaining an actual size of the object to be photographed on the front surface and an actual size of the object to be photographed on the predetermined surface. 2. An actual size calculating means for obtaining an actual size of the object at the front based on an image of the front of the object included in the image, wherein the actual size calculating means comprises: Based on an image of the predetermined surface of the imaging target, a shape obtaining unit that obtains a shape of the imaging target, based on the shape of the imaging target obtained by the shape obtaining unit, The photographing assistance device according to claim 1, further comprising: a shape reference correction unit that corrects the actual size obtained by the front actual size calculation unit. 3. An actual size calculating means for obtaining an actual size of the object at the front based on an image of the front of the object included in the image, wherein the actual size calculating means comprises: An installation state acquisition unit that acquires an installation state of the imaging target in the housing based on an image of the predetermined surface of the imaging target; and the imaging target that is acquired by the installation state acquisition unit. 2. The photographing assistance device according to claim 1, further comprising: an installation state reference correction unit that corrects an actual size obtained by the front actual size calculation unit based on an installation state of an object. 4. An installation of the object to be photographed in the housing based on an image of the predetermined surface of the object to be photographed in a photographed image photographed by the photographing device under the control of the photographing control means. Installation state determination means for determining the appropriateness of the state, and further comprising warning information output means for outputting warning information when the installation state determination means determines that the installation state in the housing is inappropriate. The photographing assistance device according to any one of claims 1 to 3.