JPH09294224A - Automatic magnification image pickup device and automatic magnification image pickup device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire an object image with highest image quality by automatically finding a magnification at which an image with optimum resolution is obtained for each object. SOLUTION: A magnification of an object is adjusted to an i-th image pickup magnification (ST1), a signal for image pickup is outputted while focusing to the object automatically (ST2), the image signal is quantized and a spatial waveform is outputted (ST3). Then, the spatial waveform is frequency-analyzed (ST4), and whether or not the obtained frequency band is within a spatial frequency element acceptable area of the image pickup device is evaluated (ST5), and when the frequency band is within the band, its magnification is used to pick up the image of the object (ST6) so as to obtain an optimum resolution of the object is acquired. When not within the element acceptable area, the magnification is changed from the i-th to the (i+1)th magnification and the processing in the steps ST1-ST6 is repeated.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the field of automation technology in the field of television cameras and video cameras, and more particularly to the field of automatic magnification imaging technology for automating the operation of imaging an object by changing the magnification. is there. Conventionally,
It has been considered that the adjustment of the magnification is manually operated by a human according to the purpose of imaging or the artistic intention. However, such a human-like adjustment of magnification is actually possible only within the spatial frequency range in which the image pickup device can faithfully capture the target image formed on the image pickup surface.
It has been found that a physically accurate target image cannot be obtained if it deviates from the spatial frequency band.

The present invention is based on this unified understanding that the relative resolution with magnification depends on the spatial frequency of the image sensor and the target image, and the relative resolution of the image sensor is captured from the target spatial frequency acceptance band of the element. The present invention relates to a technical field in which a range of magnifications for obtaining a target image of sufficient image quality is automatically found as an optimum magnification, and the magnification is varied to capture an image. When the range is known in advance, the size of the target image to be obtained is taught in advance, the target image is extracted and automatically measured, the magnification is changed, and the image is taken to obtain the target image of the taught size. Regarding the field.

The present invention also relates to the field of automatic magnification imaging device technology for imaging an object at a magnification scaled by an imaging device.

[0004]

2. Description of the Related Art Conventional television cameras, video cameras, and film cameras have many automatic technical achievements such as an automatic focusing function, an automatic sensitivity adjustment function, an automatic iris function, and an automatic exposure time adjustment function. But,
It did not have an automatic magnification adjustment function. Magnification adjustment has been regarded as a very human area selected according to the photographer's arbitrary intentions.

However, as automatic cameras have become popular,
It has been found that the automatic magnification adjustment function is a necessary function. For example, a criminal image captured by a security camera cannot be used for investigation because the image quality for identifying a person is very insufficient in many cases. This is because the resolution of the image is too low due to insufficient magnification and the facial features of the individual cannot be identified. It goes without saying that the function of automatically selecting an appropriate imaging magnification is an essential function for an automatic camera.

[0006]

SUMMARY OF THE INVENTION According to the present invention, a target image of the highest image quality is obtained by automatically finding a magnification for obtaining an image of an optimum resolution for each object, and automatically scaling the magnification to image the object. The present invention relates to an imaging technique for acquiring
If you describe the problem to be solved stepwise,
It is as follows.

A solution to the technical problem of adopting a measurement index corresponding to the image quality that changes according to the magnification. Solution of the technical problem to find the optimum resolution image capturing magnification using the measurement index. A solution to the technical problem of capturing an image with the composition according to the teaching data. Solving technical problems for taking pictures with optimum resolution.

[0008]

An automatic magnification image pickup device according to claim 1 of the present application forms an image of a target image on an image pickup device by changing the magnification, and an image of the formed target image. An image pickup means for picking up and outputting an image signal, an image processing means for quantizing the image signal and outputting it as a spatial wave, a calculation means for frequency-analyzing the spatial waveform, and an image evaluation means for evaluating the spatial waveform, It is an automatic magnification imaging device that analyzes a target image and changes the magnification.

In this automatic magnification image pickup device, the image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification so that the target image spatial frequency band is within the element spatial frequency acceptance band of the image pickup means. Is an automatic magnification imaging apparatus that finds an optimum resolution image of a target by finding a magnification that falls within the range, the image forming unit magnifies the magnification, and the imaging unit images the target.

According to a second aspect of the present invention, there is provided an automatic magnification image pickup device which forms an object image on an image pickup means by changing the magnification, and an image pickup means which picks up the formed object image and outputs an image signal. Means, image processing means for quantizing the image signal and outputting it as a spatial wave, arithmetic means for frequency-analyzing the spatial waveform,
An automatic magnification imaging apparatus, which comprises an image evaluation unit for evaluating a spatial waveform and analyzes a target image to change the magnification.

In this automatic magnification image pickup apparatus, the image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification, and the spatial frequency band required for the target image is the element spatial frequency of the image pickup means. It is an automatic magnification image pickup apparatus for finding an optimum resolution image of a target by finding a magnification within a reception band, varying the magnification by the imaging unit, and imaging the target by the imaging unit.

According to another aspect of the present invention, there is provided an automatic magnification image pickup device comprising a visual angle determining means for optically positioning an image pickup visual field, and an image forming means for changing the magnification to form a scene image or a target image on the image pickup means. An image pickup means for picking up a scene image or an object image, an image processing means for quantizing the scene image signal to extract a target area and outputting position data thereof, and an image signal in the area as a spatial wave, and a spatial waveform Is an automatic magnification imaging apparatus that includes a calculation means for frequency analysis and an image evaluation means for evaluating a spatial waveform, determines the viewing angle in the direction of the target, analyzes the target image, and scales the magnification.

In this automatic magnification imaging apparatus, the viewing angle determining means determines the viewing angle of the object according to the target area position data,
The image evaluation means evaluates a spatial waveform of a target image captured by changing the magnification, and finds a magnification at which a spatial frequency band required for the target image falls within an element spatial frequency acceptance band of the imaging means, and This is an automatic magnification imaging device in which the image forming means changes the magnification to that magnification and the image pickup means picks up an image of the object to obtain an optimum resolution image of the object.

According to another aspect of the present invention, there is provided an automatic magnification image pickup device, which comprises a visual angle determining means for optically positioning an image pickup field, and an image forming means for changing the magnification to form a scene image or a target image on the image pickup means. Image pickup means for picking up a scene image or a target image, image processing means for quantizing a scene image signal to extract a target area, teaching size data for measuring the position and size of the target area, and measurement data for the target area size It is an automatic magnification image pickup apparatus including a calculation means for calculating a scaling ratio from

In this automatic magnification imaging apparatus, the viewing angle determining means determines the viewing angle of the object according to the object area position data,
By the scaling means scaling the magnification with the scaling ratio calculated by the computing means and the imaging means capturing an image of the object,
It is an automatic magnification imaging device that acquires a target image of a teaching size. An automatic magnification imaging apparatus according to claim 5 detects a target and outputs a detection signal, a signal conversion unit that converts the detection signal into a target direction signal, and an imaging field of view in the target direction according to the target direction signal. Angle determining means for positionally positioning, an image forming means for forming a scene image or a target image on the image capturing means by changing the magnification, an image capturing means for capturing the scene image or the target image, and a scene image signal An automatic magnification imaging apparatus comprising: an image processing unit that converts the target region into an image; and an arithmetic unit that measures the position and size of the target region and calculates a scaling factor from teaching size data and measurement data of the target region size. .

In this automatic magnification imaging apparatus, the viewing angle determining means determines the viewing angle of the object according to the target area position data,
By the scaling means scaling the magnification with the scaling ratio calculated by the computing means and the imaging means capturing an image of the object,
It is an automatic magnification imaging device that acquires a target image of a teaching size. An automatic magnification imaging device according to claim 6 has the same visual field as a visual angle determining means for optically positioning an imaging visual field, and an imaging means capable of varying a magnification to form a scene image or a target image on the imaging means. Image capturing means for capturing a visible light image and an infrared image of a target image or a scene image, image processing means for extracting a high temperature region by quantizing a thermal image signal, and visible light obtained by the image processing means quantizing a visible light image signal. It is an automatic magnification imaging device provided with a calculation means for mapping a high temperature region onto an image.

In this automatic magnification imaging apparatus, the image processing means extracts a target area from the visible light image mapping area, and the computing means measures the position and size of the target area to measure the teaching size data and the target area size. The scaling factor is calculated from the data, the viewing angle determining unit determines the viewing angle of the target according to the target region position data, the imaging unit scales the scaling factor calculated by the computing unit, and the imaging unit visualizes the target. It is an automatic magnification imaging device that acquires a target image of a taught size by optical imaging.

According to the seventh aspect of the present invention, there is provided an automatic magnification photographing device capable of forming a view angle or a target image on the photographing means and the photographing means by changing the magnification and a visual angle determining means for optically positioning the photographing visual field. Image means, image pickup means for picking up a scene image or a target image, shooting means for picking up a target image, image processing means for quantizing a scene image signal to extract a target area, and measuring the position and size of the target area Then, the automatic magnification photographing apparatus is provided with the arithmetic means for calculating the scaling factor from the teaching size data and the measurement data of the target area size.

In this automatic magnification photographing device, the viewing angle determining means determines the viewing angle of the object according to the target area position data,
By the magnification of the image forming means being varied by the magnification calculated by the computing means and the photographing means photographing the object,
It is an automatic magnification photographing device for acquiring a target photograph of a teaching size.

[0020]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in more detail with reference to embodiments. The device of the first embodiment is:
When a target image is captured and the image is acquired, the spatial waveform of the quantized target image is subjected to frequency analysis, and the target is captured at a magnification of the range that maximizes the frequency band. It is an automatic magnification imaging device that acquires The apparatus of this embodiment will be described below with reference to the drawings. FIG. 1 shows an overall configuration of a first embodiment in which an automatic magnification imaging device according to the present invention is embodied, and FIG. 2 is a flow chart showing its operation steps. FIG. 3 illustrates the relationship between the effective size of the image sensor and the image size of the target image that varies depending on the magnification, and FIG. 4 illustrates the relationship between the spatial frequency of the target image that changes according to the magnification and the effective band of the image sensor spatial frequency. 3 is a conceptual diagram (note that the magnifications shown in FIGS. 3 and 4 are independent of each other).

The principle of the automatic zooming operation of the apparatus of this embodiment is that the spatial frequency of the target image formed on the image sensor changes as the magnification is changed so that the resolving power of the image sensor relative to the target image becomes relatively large. In order to change to, the relationship that the amount of acquired image information changes is used. The relationship between the magnification and the resolution of the image sensor will be described with reference to FIG. Since the actual resolution of the image sensor varies greatly depending on the technical conditions of the element manufacturer such as design and manufacturing, in this description, the pixel density of the image sensor is taken for a more general description, and the sampling spatial frequency with respect to the spatial frequency of the target image is taken. Are treated as A 1/2 inch CCD (charge coupled device) having an image size of 6.4 mm × 4.8 mm and an effective pixel count of 768 × 494 will be described as an example.

FIG. 3 shows how the size and spatial frequency of the target image formed on the image pickup surface change with respect to the effective size and pixel density of the image pickup element when the magnification is changed.
The effective size of the image sensor is 6.4 mm on the long side in this CCD (for convenience, the horizontal scanning is described here, but it goes without saying that the same applies to the vertical scanning. If the directional frequency is included, the diagonal length of the image sensor may be used as the apparent sampling frequency.In the example CCD, the element size along the diagonal is 8 mm, and the pixel size is 12. .8 μm).

The resolution of the image pickup device can be considered as a sampling spatial frequency (wave number per mm) according to the pixel density per mm. According to the sampling theorem, if the period of the sampling impulse is 1 / (highest frequency component × 2) or less, the original waveform can be restored. When this theorem is applied to the spatial frequency, the pixel size of this CCD is 8.3 μm at the base of the rectangular pixel, so the sampling frequency of the horizontal scanning line is 120 / mm, and the sampling frequency of 60 / mm or more of the image waveform is It is understood that high frequency components cannot be imaged.

As shown in FIG. 3, the spatial frequency of the output waveform of the target image formed with a wide angle at a low magnification has a pixel density of the image pickup element higher than that of a high magnification image (magnification is × 8 or × 16). There is a high possibility that high frequency components that exceed will be included. Magnification is ×
Above 8, for example, x16, the spatial waveform of the image contains many low frequency components in inverse proportion. Therefore, this time, it becomes impossible to sense a component having a wavelength longer than the size of the image sensor. In FIG. 3, the reciprocal of the element size is displayed as “element spatial frequency”. From the bottom length of the illustrated element, the sampling frequency of the element is 0.156 / mm, so a low frequency component of 0.078 / mm or less cannot be detected.

On the other hand, if the spatial frequency of the pixel is named "pixel spatial frequency", the image pickup device is a kind of band-pass filter in which the spatial frequency band sandwiched between the pixel spatial frequency and the element spatial frequency is the pass band. It can be considered as a sensor with a built-in sensor (This concept is similar to the concept of the audible frequency of the human ear, and it is the "visible spatial frequency" of the image sensor.
[Visible spatial frequency] can be called). Here, the upper limit of the pass band is shown in FIG.
Corresponds to 1/2 of the pixel spatial frequency, and the lower limit corresponds to 1/2 of the element spatial frequency. In the exemplary CCD, the spatial frequency acceptance band is 0.078 / mm-60 / mm. The relationship between the distribution of the target image brightness histogram for each magnification with respect to the spatial frequency and the reception spatial frequency band of the image sensor is as conceptually shown in FIG.

In FIG. 4A, the image sensor has a function of a spatial frequency filter, and the spatial frequency band of the target image is entirely within the reception spatial frequency band of the filter, that is, FIG.
In the example of (A), it is shown that if the image is picked up at × 4, the picked-up image can be obtained with good image quality, that is, with sufficient resolution. For this purpose, the spatial frequency of the target image is frequency-analyzed, and if the frequency band is found to be within the spatial frequency acceptance band of the element, the magnification becomes the optimum magnification (the optimum magnification is usually the only value. In many cases, it takes a value over a certain range, which depends on the spatial frequency component configuration of the target image). Therefore, the apparatus according to the embodiment of the present invention images an object at various magnifications, frequency-analyzes the spatial frequency of the image waveform by Fourier transform, finds the magnification that gives the optimum resolution image, and images the object at that magnification. I am trying.

The image spatial wave according to the present invention is an output signal of any image sensor such as a visible light television camera or a video camera, an infrared light camera, a one-dimensional CCD or an X-ray photographing device. It goes without saying that the image signal may be not only the grayscale signal but also the color signal. The operation of the present embodiment will be described below with reference to the overall configuration of FIG. 1 along the flow chart of FIG. This embodiment is an automatic magnification imaging apparatus that images a target while varying the magnification, finds the optimum magnification, and captures an optimum resolution image of the target. In FIG. 1, 1 is the object, 2 is the field of view at the first imaging magnification,
The automatic magnification image pickup apparatus according to the embodiment is an image pickup unit 3 including an image forming optical system 3a having a variable magnification function and an image pickup apparatus 3b.
A control / arithmetic unit 4, an imaging control unit 5, a magnification control unit 6, a focusing unit 7, a system control unit 8 for controlling the overall system operation of the present embodiment, and a spatial waveform by quantizing an image. Image processing unit 9 for outputting
An arithmetic unit 10 for frequency-analyzing the spatial waveform; an image evaluation unit 11 for evaluating the frequency components obtained by the frequency analysis with reference to the spatial frequency element acceptance band of the image pickup device 3b; a data storage unit 12; An output unit 13, a communication unit 14, a display unit 15,
And a bus 16.

First, in the first step (ST1: in FIG. 2, hereinafter, step is represented by ST), the magnification control unit 6 in FIG. 1 sets the magnification of the imaging optical system 3a of the image pickup unit 3 to the first magnification.
The second magnification is adjusted (ST1), the automatic focusing unit 7 automatically focuses, and the imaging control unit 5 controls the imaging device 3b to image the target 1 and output the image signal of the field of view 2. (ST2).

Therefore, the image processing unit 9 quantizes the image and outputs a spatial wave (ST3), and the arithmetic unit 10 performs Fourier transform to frequency analyze the spatial waveform (ST).
4). The image evaluation unit 11 evaluates whether or not the obtained frequency band is in the spatial frequency element reception band of the imaging device 3b, and if it is within the band, ST5 becomes YES,
The target is imaged at the magnification (ST6), and the optimum resolution image of the target is acquired.

If it is evaluated that the spatial frequency band of the target image has a frequency component outside the element reception band of the image pickup device 3b, ST5 becomes NO and ST is set.
Returning to 1, the magnification control unit 6 adjusts the magnification of the imaging device 3a of the imaging unit 3 to the second magnification (ST1),
The automatic focusing unit 7 automatically focuses, and the imaging control unit 5 controls the imaging device 3b to image the target 1 and output an image signal of the next visual field 2 '(not shown) (ST.
2) After that, the same image pickup and image analysis operations as in the case of the first magnification are performed, and the frequency band of the obtained target image is
Whether the spatial frequency element reception band of the image pickup device 3b is in the band is evaluated, and if it is in the band, ST5 becomes YES and the second
The image captured at the magnification of is determined as the target optimum resolution image (ST6). Hereinafter, ST1 to S until the optimum magnification is found
The operation of T5 is repeated.

Next, an apparatus according to the second embodiment of the present invention will be described. The apparatus of the second embodiment frequency-analyzes the spatial waveform of the quantized target image when capturing the target image and acquiring the image, and at a magnification that provides a spatial frequency band necessary for the target image by teaching. It is an automatic magnification imaging device that acquires a high-resolution target image by imaging the target. This form device will be described below with reference to the drawings. FIG. 5 shows an overall configuration of a second embodiment in which the automatic magnification imaging device according to the present invention is embodied, and FIG. 6 is a flow chart showing its operation steps.

First, the eleventh step (ST11 in FIG. 6:
Hereinafter, the step is represented by ST) is a step of teaching the apparatus, and teaches the necessary spatial frequency band of the target image to be obtained by imaging (or, conversely, teaches the exclusion of unnecessary spatial frequency band). Good). The necessary spatial frequency band is a case where the spatial frequency band of the target image extends over a wide range of frequency bands, for example, as shown in the distribution a of FIG. 4B. When such an object is imaged to obtain an image of a desired image quality, even if the magnification is changed, if the ultra-low frequency band remains as in the b distribution of FIG. The ultra-high frequency band may remain as it is, as in the c distribution of FIG.

For example, in the field of view 2 of FIG. 5, there are tree trunks in the low frequency band and fine branches in the high frequency band. In particular, the vertical frequency of the tree trunk is a very low frequency component which is close to zero for this field of view. Since it contains, it is practically meaningless to obtain the magnification including this band. Since the band in such a case takes the form of the b distribution in FIG. 4B, the apparatus of the present embodiment excludes the ultra-low frequency components appearing as a result of the frequency distribution from the target of image evaluation. The required evaluation band can be input in advance by teaching.

The same applies to the ultra-high frequency band, for example, a newspaper attached to a wall when an indoor scene is imaged. For the purpose of obtaining a resolution capable of reading the type of newspaper, the magnification may be changed by the apparatus of the first embodiment so that the spatial frequency band of the target image falls within the effective band of the image sensor. However, when capturing an indoor scene including newspaper, there is no need to read the type,
It is only necessary to capture an image of the room scene at a magnification that provides good resolution. Since this corresponds to the c distribution in FIG. 4B, the apparatus according to the present embodiment requires in advance the teaching so that the super-high frequency component appearing as a result of the frequency analysis is excluded from the object of image evaluation. You can enter the evaluation band.

Next, in the apparatus, the magnification control unit 6 of FIG. 5 adjusts the magnification of the imaging optical system 3a of the image pickup unit 3 to the first magnification according to the teaching data (ST12), and the automatic focusing unit 7 automatically. Focus on the imaging control unit 5
Controls the image pickup device 3b to pick up an image of the target 1 and to view its field of view 2
The image signal of is output (ST13). Therefore, the image processing unit 9 quantizes the image and outputs a spatial wave (ST1
4), the arithmetic unit 10 performs Fourier transform to frequency analyze the spatial waveform (ST15). Image evaluation unit 1
1 evaluates whether or not the obtained frequency band is in the required frequency band taught in ST1 in the spatial frequency element reception band of the imaging device 3b, and if it is within the band, ST16 becomes YES and the The target is imaged at a magnification (ST1
7) Obtain the optimal resolution image of the target.

Further, if it is evaluated that the spatial frequency band of the target image is out of the required frequency band taught in ST11 in the element reception band of the image pickup device 3b, ST16 becomes NO and the process returns to ST12. The magnification control unit 6 adjusts the magnification of the imaging device 3a of the imaging unit 3 to the second magnification (ST12), the automatic focusing unit 7 automatically focuses, and the imaging control unit 5 sets the imaging device 3b. The target 1 to capture the next field of view 2 '.
An image signal (not shown) is output (ST13).
The same image pickup and image analysis operations as in the case of the first magnification are performed, and the obtained frequency band of the target image is the image pickup device 3b.
It is evaluated whether or not the spatial frequency element reception band is in the required frequency band taught in ST11, and if it is within the band, ST16 becomes YES, and the image captured at the second magnification is the target optimum resolution image. (ST17). Hereinafter, the operations of ST12 to ST16 are repeated until the optimum magnification is found.

Next, an automatic magnification image pickup device according to a third embodiment of the present invention will be described. The device of the third embodiment is
When the target image is included in the scene image, the viewing angle is determined for the taught scene to capture the scene image, the scene image signal is quantized to extract the target area, and the position data of the area is output. At the same time, the spatial waveform of the quantized image in the target area is frequency-analyzed, the viewing angle of the target is determined and the image is picked up until the magnification reaches the range that maximizes the frequency band. It is a magnification imaging device. FIG. 7 shows the overall configuration of the device of the third embodiment, and FIG. 8 shows the operational steps in a flow chart.

In FIG. 7, 1 is the target image at the first imaging magnification, 2 is the view scene image at the first imaging magnification, and in the target image 1, G (Xg, Yg) is the center of gravity coordinates of the target area. , In the view scene image 2, C (Xc, Y
c) is the visual field center coordinates. Further, 1'is a target image of the optimum magnification determined by the viewing angle according to the teaching composition, 2'is a view scene image in that case, and in the target image 1'of the optimum magnification, G '(Xg', Yg ') is Target area barycentric coordinates, 2 '
In, C ′ (Xc ′, Yc ′) is the visual field center coordinate.

In FIG. 7, the automatic magnification image pickup apparatus of the third embodiment is an image pickup unit 3 including an image forming optical system 3a having a variable magnification function, an image pickup apparatus 3b, and a viewing angle deflection mirror 3c.
A control / arithmetic unit 4, a viewing angle control unit 5, an imaging control unit 6, a magnification control / focus unit 7, a system control unit 8 for controlling the entire system operation of the present embodiment, and an image quantizer. Image processing unit 9 for extracting a target region and outputting the spatial waveform in the region, an arithmetic unit 10 for calculating target region position data and performing a frequency analysis of the spatial waveform in the region, and a frequency component obtained by the frequency analysis. An image evaluation unit 11 for evaluating with reference to a spatial frequency element reception band of an image pickup device, and a data storage unit 12
1, an input / output unit 13, a communication unit 14, a display unit 15, and a bus 16.

Further, the viewing angle determining actuator of the image pickup unit of the apparatus of the present embodiment is not necessarily limited to the mirror deflection type, and the viewing angle may be determined by another type of actuator without any problem. As an example thereof, FIG. 7 also shows an imaging unit 3'in another form shown by a dotted line. This is because the automatic camera platform 3c 'receives the control signal from the viewing angle control unit 5 and the imaging optical system 3a
And the imaging device 3b are integrally rotated and tilted to determine a viewing angle. However, since the mirror deflection method and the automatic pan head method are essentially the same in view of the operation of the present invention, the following description will be given taking the mirror deflection method as an example.

First, the twenty-first step (ST21 in FIG. 8)
Is a step of teaching the device, and inputs teaching data for instructing a direction of a scene to be imaged by the device and a screen composition at the time of final imaging. As shown in FIG. 7, the composition instruction data includes the screen center coordinates C ′ (X
c ′, Yc ′) and the barycentric coordinates G ′ (X
g ', Yg').

Next, in the apparatus, the viewing angle control unit 5 of FIG. 7 controls the deflection angle of the deflection mirror 3c in accordance with the teaching data to determine the imaging viewing angle in the direction of the scene 2 including the object 1, and the magnification control / focusing. The unit 7 adjusts the magnification of the imaging optical system 3a to the first magnification (ST22), the magnification control / focus unit 7 automatically focuses on the scene, and the imaging control unit 6 controls the imaging device 3b. The image is captured and the image signal of the scene 2 is output (ST23).

Therefore, the image processing unit 9 quantizes the scene image to extract the target area, and calculates the barycentric coordinates of the target area (ST24). Here, since the apparatus of the third embodiment extracts the face area using the human skin color as the characteristic parameter using the color image data, the target area is the human face part. If there is a possibility that the extraction of the face area may be erroneous with the color feature parameters alone due to the situation of the background portion of the scene screen, the area of the target person 1 is specified in advance by the difference image generated by the movement of the person, and the preliminary image area is obtained. If the skin color area is extracted within, the extraction reliability is further improved.

Next, the image processing unit 9 outputs the image spatial wave in the target area (ST25), and the arithmetic unit 10 performs the Fourier transform to frequency analyze the spatial waveform (ST26). The image evaluation unit 11 evaluates whether or not the frequency band of the obtained target image is in the spatial frequency element reception band of the imaging device 3b, and if it is within the band, ST27 becomes YES and the route (A) is taken. The deflection mirror 3c determines the viewing angle again according to the control signal of the viewing angle control unit 5 according to the teaching composition data, and the target is imaged at the magnification (ST28) to obtain the optimum resolution image of the target.

If the image evaluation unit 11 evaluates whether or not the obtained frequency band of the target image is in the spatial frequency element reception band of the image pickup device 3b, if the frequency band is out of the band, ST27 returns NO. Then, via the route (B), the viewing angle control unit 5 controls the deflection mirror 3c to change the viewing angle so that the target area barycentric coordinate G is located at the visual field center coordinate C (ST29), and the magnification control / combination is performed. The focusing unit 7 controls the imaging optical system 3a to change the magnification to the second taught magnification (ST30), automatically focuses on the target area, and the image pickup apparatus 3b is controlled by the control signal of the image pickup control unit 6. The image is picked up and an image signal is output (ST31).

Next, the image processing unit 9 quantizes and extracts the target area image, outputs the image spatial wave in the target area (ST32), and the arithmetic unit 10 performs Fourier transform to frequency-convert the spatial waveform. Analyze (ST33). The image evaluation unit 11 evaluates whether or not the frequency band of the obtained target image is in the spatial frequency element reception band of the imaging device 3b, and if it is within the band, ST34 becomes YES and the route (C) is selected. Then, the deflection mirror 3c determines the viewing angle again by the control signal of the viewing angle control unit 5 according to the teaching composition data, and the imaging device 3b images the target by the control signal of the imaging control unit 6 at the magnification (ST35), and the optimum resolution of the target. Get an image.

If the image evaluation unit 11 evaluates whether or not the obtained frequency band of the target image is in the spatial frequency element reception band of the image pickup device 3b, if the frequency band is out of the band, ST34 is NO. Then, via the route (D), the magnification control / focus unit 7 controls the imaging optical system 3a to change the magnification to the third taught magnification (ST30),
The target area is automatically focused, and the image pickup apparatus 3b picks up an image by a control signal of the image pickup control unit 6 and outputs an image signal (ST31). Following the same steps as in the flow of imaging with the second magnification, n scaling is repeated until the spatial wave band of the target image falls within the image sensor reception band, and the optimum resolution image of the target is obtained. To earn.

Next explained is an automatic magnification image pickup apparatus according to the fourth embodiment of the invention. The device of the fourth embodiment is
Determine the viewing angle to the taught scene, capture the scene image, quantize the scene image signal to extract the target area, measure the area position data and size data, determine the viewing angle according to the taught composition data, and change the magnification. It is an automatic magnification image pickup device that multiplies an object by main image pickup. FIG. 9 shows the overall configuration of the fourth embodiment device.
The operation steps are shown in the flowchart of FIG.

In FIG. 9, 1 is a target image captured at a magnification for searching a target, 2 is a view scene image at a magnification for searching a target, and in the target image 1, Fr is a target area mask and G (Xg , Yg) is the coordinate of the center of gravity of the target area, Fh is the length of the target area on the X-axis, and C
(Xc, Yc) are visual field center coordinates. Further, 1'is a target image of the optimum magnification determined by the viewing angle according to the teaching composition,
2'is a view scene image in that case, and in the target image 1'of the optimum magnification, Fr 'is a target area mask and G' (X
g ', Yg') is the center of gravity coordinates of the target area, Fh 'is the X-axis length of the target area, and C' (Xc ', Yc') is the center coordinates of the field of view in the view scene image 2'at the optimum magnification.

In FIG. 9, the automatic magnification image pickup apparatus of the fourth embodiment has an image pickup unit 3 including an image forming optical system 3a having a variable magnification function, an image pickup apparatus 3b, and a viewing angle deflection mirror 3c.
A control / arithmetic unit 4, a viewing angle control unit 5, an imaging control unit 6, a focusing unit 7, a magnification control unit 8, an image processing unit 9 for quantizing an image to extract a target area, and a target. An arithmetic unit 10 for calculating the main imaging magnification by calculating the position data and size data of the area, a data storage unit 11, a system control unit 12 for controlling the entire system operation of the present embodiment, an input / output unit 13, The communication unit 14, the display unit 15, and the bus 16 are provided.

Further, the viewing angle determining actuator of the image pickup unit of the apparatus of the present embodiment is not necessarily limited to the mirror deflection type, and there is no problem even if the viewing angle is determined by an actuator of another form. As an example thereof, FIG. 9 also shows an imaging unit 3'in another form shown by a dotted line. This is because the automatic camera platform 3c 'receives the control signal from the viewing angle control unit 5 and the imaging optical system 3a
And the imaging device 3b are integrally rotated and tilted to determine a viewing angle. However, since the mirror deflection method and the automatic pan head method are essentially the same in view of the operation of the present invention, the following description will be given taking the mirror deflection method as an example.

First, the 41st step (ST4 of FIG. 10)
1) is a step of teaching the device, in which the device inputs a teaching data for instructing a direction to be searched by imaging, an image composition of main imaging, and a target image size. As shown in FIG. 9, the composition instruction data is data for designating the barycentric coordinates G '(Xg', Yg ') of the target area with respect to the image center coordinates C' (Xc ', Yc') of the main imaging visual field 2 '. . If the target image size teaching data is the target (face) area mask Fr ′ size data of the main imaging target image 1 ′ in FIG. 9 and can be represented by the X-axis length of the target area Fh ′, Teach Fh '.

Next, in the apparatus, the magnification control unit 8 in FIG. 9 adjusts the magnification of the imaging optical system 3a to the search magnification according to the teaching data, and the viewing angle control unit 5 controls the deflection angle of the deflection mirror 3c to perform the search. The imaging viewing angle is determined according to the direction (the search direction may be plural directions if necessary) (ST42), the focusing unit 7 automatically focuses on the scene, and the imaging control unit 6 controls the imaging device 3b to perform imaging. The image signal of the search scene 2 is output (ST43). The image processing unit 9 quantizes the scene image and searches the scene image for the presence or absence of the target area using the target feature parameter (ST44). The apparatus according to the fourth embodiment searches for a face area using color image data with human skin color as a characteristic parameter.

Then, when the image processing unit 9 detects the face area of the target image 1, ST45 becomes YES and the face area Fr is extracted by tracing the route (A).
0 calculates its size and barycentric coordinates (ST46). The arithmetic unit 10 calculates the Fr area size and the teaching image size F.
Calculate the scaling ratio from r'to the main imaging magnification (ST47),
Further, the visual angle correction data to bring the measured barycentric coordinate G to the enlarged face area barycenter G ′ of the screen 2 ′ of the teaching composition data is calculated (ST48).

Using the above main imaging data, the viewing angle control unit 5 controls the deflection angle of the deflecting mirror 3c to determine the viewing angle, and the magnification control unit 8 changes the magnification of the imaging optical system 3a to obtain an image. The control unit 6 controls the image pickup device 3b to pick up an image of the face area of the image pickup target, and obtains the target image 2'according to the taught composition (ST49). Also, if ST45 is N
If it is O, the route (B) is followed, the process returns to ST42, the teaching direction is imaged to search the target, and the route (B) is repeated until the target is detected.

Next explained is an automatic magnification image pickup apparatus according to the fifth embodiment of the invention. The device of the fifth embodiment is
Determine the viewing angle according to the signal from the target detection sensor, capture the scene image including the target image, quantize the scene image signal to extract the target area, measure the position data and size data of the area, and view angle according to the teaching composition data. It is an automatic magnification imaging device that determines a target, magnifies the magnification, and performs main imaging of an object. The overall configuration of the fifth embodiment device is shown in FIG. 11, and its operation steps are shown in the flowchart of FIG.

In FIG. 11, 1 is a target image captured at a magnification for searching a target, 2 is a view scene image at a magnification for searching a target, and in the target image 1, Fr is a target area mask and G (Xg , Yg) is the center of gravity coordinates of the target area, Fh
Is the length of the X-axis of the target area, and in the view scene image 2, C
(Xc, Yc) are visual field center coordinates. Further, 1'is a target image of the optimum magnification determined by the viewing angle according to the teaching composition,
2'is a view scene image in that case, and in the target image 1'of the optimum magnification, Fr 'is a target area mask and G' (X
g ′, Yg ′) is the target area barycentric coordinate, Fh ′ is the target area X-axis length, and C ′ (Xc ′, Yc ′) is the visual field center coordinate in the visual field scene image 2 ′ at the optimum magnification. .

In FIG. 11, the automatic magnification image pickup apparatus of the fifth embodiment is an image pickup unit 3 including an image forming optical system 3a having a variable magnification function, an image pickup apparatus 3b, and a viewing angle deflection mirror 3c.
A control / arithmetic unit 4, a viewing angle control unit 5, an imaging control unit 6, a focusing unit 7, a magnification control unit 8, an image processing unit 9 for quantizing an image to extract a target area, and a target. An arithmetic unit 10 for calculating the main imaging magnification by calculating the position data and size data of the area, a data storage unit 11, a system control unit 12 for controlling the entire system operation of the present embodiment, an input / output unit 13, The communication unit 14, the display unit 15, the bus 16, and the sensor device 17 are provided.

Further, the viewing angle determining actuator of the image pickup unit of the apparatus of the present embodiment is not necessarily limited to the mirror deflection type, and there is no problem even if the viewing angle is determined by an actuator of another form. As an example thereof, FIG. 11 also shows an imaging unit 3'in another form shown by a dotted line. This is because the automatic camera platform 3c ′ receives the control signal from the viewing angle control unit 5 and the imaging optical system 3
This is a method of determining a viewing angle in which a and the image pickup device 3b are integrally rotated and tilted. However, since the mirror deflection method and the automatic pan head method are essentially the same in view of the operation of the present invention, the following description will be given taking the mirror deflection method as an example.

First, the 51st step (ST5 of FIG. 12)
Step 1) is a step of teaching the apparatus, in which a magnification when the apparatus searches for an image, an image composition at the time of actual imaging, and teaching data for instructing a target image size are input. As shown in FIG. 11, the composition instruction data is data that specifies the barycentric coordinates G ′ (Xg ′, Yg ′) of the target area with respect to the image center coordinates C ′ (Xc ′, Yc ′) of the main imaging visual field 2 ′. is there. Further, if the target image size teaching data is the target (face) area mask Fr ′ size data of the main imaging target image 1 ′ in FIG. 11 and can be represented by the X-axis length of the target area Fh ′, Teach Fh '.

The device is always in a standby state, and when the sensor device 17 of FIG. 11 detects an object and outputs a signal (ST5
2) The arithmetic unit 10 refers to the lookup table of the sensor output pair direction stored in the data storage unit 11 and converts it into a target direction signal (ST5).
3). The sensor device 17 includes a target detection sensor, and outputs a signal to the control calculation unit 4 when a target is detected. The output transmission method may be a direct connection method (solid line) or a wireless method (dotted line) depending on the usage environment. When the sensor device 17 includes a sensor such as a stereo microphone that can indicate the direction of the sound source, the sensor device 17 uses the signal.

However, the automatic magnification image pickup apparatus of the fifth embodiment is provided with a look-up table for finding the target direction from the relationship between the sensor and the installation location of the apparatus of the present embodiment. The sensor device that outputs the directional information itself is not always necessary because the sensor device outputs the directional information itself.
Therefore, any sensor can be used depending on the purpose and situation.

The viewing angle control unit 5 determines the imaging viewing angle in the target direction by controlling the deflection angle of the deflection mirror 3c according to the direction signal, and the magnification control unit 8 adjusts the magnification of the imaging optical system 3a to the search magnification (ST54). ), The focusing unit 7 automatically focuses on the scene, the imaging control unit 6 controls the imaging device 3b to capture an image, and outputs the image signal of the search scene 2 (ST.
55). The image processing unit 9 quantizes the scene image, extracts the target area in the scene image using the target feature parameter, and the arithmetic unit 10 calculates the size and the barycentric coordinates (ST56).

The apparatus of the fifth embodiment extracts the face area using the color image data with the human skin color as a characteristic parameter. The arithmetic unit 10 calculates a magnification ratio from the Fr area size and the teaching image size Fr ′ to the main imaging magnification (ST57), and further, the measured and measured barycentric coordinate G is used to display the teaching composition data screen 2 ′ center of gravity of the enlarged face area. Visual angle correction data to be brought to G ′ is calculated (ST58).

Using the above main imaging data, the viewing angle control unit 5 controls the deflection angle of the deflection mirror 3c to determine the viewing angle, and the magnification control unit 8 scales the magnification of the imaging optical system 3a to capture an image. The control unit 6 controls the imaging device 3b to image the face area of the imaging target, and obtains the target image 2'according to the taught composition (ST59). Next, an automatic magnification imaging device according to a sixth embodiment of the present invention will be described. The apparatus according to the sixth embodiment includes an infrared imaging unit that shares a viewing angle determining unit and an imaging optical system with a visible light imaging unit, and determines the viewing angle of a taught scene to capture an infrared / visible light image of the scene. Then, the thermal / visible light image signal is quantized to map the high temperature area of the thermal image to the visible light image, and the target area is extracted from the mapped area,
This is an automatic magnification image pickup apparatus in which the visible light image pickup unit picks up an image of an object after measuring the position data and size data of the area, determining the viewing angle according to the teaching composition data, and changing the magnification. The overall configuration of the sixth embodiment device is shown in FIG. 13, and its operation steps are shown in the flowchart of FIG.

In FIG. 13, 1 is a target image captured at a magnification for searching a target, 2 is a view scene image at a magnification for searching a target, and in the target image 1, Fr is a target area mask and G (Xg , Yg) is the center of gravity coordinates of the target area, Fh
Is the X-axis length of the target area, and in the view scene image 2,
C (Xc, Yc) is the visual field center coordinate. Further, 1'is a target image of the optimum magnification determined by the viewing angle according to the teaching composition, 2'is a view scene image in that case, and in the target image 1'of the optimum magnification, Fr 'is a target area mask and G'.
(Xg ', Yg') is the center of gravity coordinates of the target area, Fh 'is the X-axis length of the target area, and the view field image 2'at the optimum magnification.
In, C ′ (Xc ′, Yc ′) is the center coordinate of the visual field.

In FIG. 13, the automatic magnification image pickup apparatus of the sixth embodiment has an image forming optical system 3a having a variable magnification function, a visible light image pickup apparatus 3v, an infrared image pickup apparatus 3i, and a viewing angle deflection mirror 3.
visible light / infrared image pickup unit 3, control / calculation unit 4, viewing angle control unit 5, visible light / infrared image pickup control unit 6, focusing unit 7, and magnification control unit 8
An image processing unit 9 that quantizes the image to extract the thermal image high temperature region and the visible light image target region, maps the thermal image high temperature region to the visible light image, and outputs position data and size data of the target region from the mapped region. An arithmetic unit 10 for calculating and calculating a main imaging magnification, a data storage unit 11, a system control unit 12 for controlling the entire system operation of the present embodiment, an input / output unit 13, a communication unit 14,
The display unit 15 and the bus 16 are provided.

Here, the infrared image pickup device 3i shares the visible light image pickup device 3v, the image forming optical system 3a and the viewing angle deflection mirror 3c, and the mirror system (visible light transmission infrared reflection mirror and infrared reflection mirror) is used. Since the optical path is branched by a combination mirror system 3a 'of mirrors and the infrared imaging device 3i is provided with its own optical system (not shown), the field of view projected to the visible light imaging device 3v and the infrared imaging. The field of view projected to the device 3i is the same (note that an infrared reflecting prism is used instead of the mirror system 3a ', and straight visible light is received by the visible light imaging device 3v, and the reflected infrared light is red. Even if the light is received by the outer imaging device 3i,
The same effect as the above-mentioned mirror system 3a 'can be obtained).

Further, the viewing angle determining actuator of the visible / infrared imaging unit of the apparatus of this embodiment is not necessarily limited to the mirror deflection type, and the viewing angle may be determined by another type of actuator. There is no. As an example thereof, FIG. 13 also shows an imaging / imaging unit 3 ′ of another form shown by a dotted line. This receives the control signal from the viewing angle control unit 5 and receives the control signal from the automatic platform 3
Reference numeral c'denotes a visual angle determining method for integrally rotating and tilting the imaging optical system 3a, the visible light image pickup device 3v, and the infrared image pickup device 3i. However, both the mirror deflection method and the automatic pan head method
Since there is essentially no difference from the viewpoint of the operation of the present invention, the following description will be given taking the mirror deflection method as an example.

First, the 61st step (ST6 of FIG. 14)
1) is a step of teaching the device, in which the device inputs a teaching data for instructing a direction to be searched by imaging, an image composition at the time of imaging, and a target image size. As shown in FIG. 13, the composition instruction data is data for designating the barycentric coordinates G ′ (Xg ′, Yg ′) of the target area with respect to the screen center coordinates C ′ (Xc ′, Yc ′) of the main imaging visual field 2 ′. . When the target image size teaching data is the target (face) area mask Fr ′ size data of the main imaging target image 1 ′ in FIG. 13 and can be represented by the X-axis length of the target area Fh ′, Teach Fh '.

Next, the apparatus follows the teaching data and the data shown in FIG.
The magnification control unit 8 adjusts the magnification of the imaging optical system 3a to the search magnification, and the viewing angle control unit 5 controls the deflection angle of the deflecting mirror 3c to determine the imaging viewing angle in the search direction. (ST62), the focusing unit 7 automatically focuses on the scene, and the visible light / infrared image pickup control unit 6 controls both image pickup devices 3i and 3v so that the infrared ray
Visible light is imaged and the thermal image signal and the visible light image signal of the search scene 2 are output (ST63). The image processing unit 9 quantizes both images and extracts high temperature regions in the thermal image. The arithmetic unit 10 maps the high temperature area of the thermal image to a visible light image (ST65), the image processing unit 9 extracts the target area from the mapped area using the target feature parameter, and the arithmetic unit 10 calculates the size and the center of gravity thereof. Calculate coordinates (ST
66). The apparatus according to the sixth embodiment extracts the face area from the thermal image mapping area using the human skin color as a feature parameter using color image data.

Then, the arithmetic unit 10 calculates a scaling ratio from the Fr area size and the teaching image size Fr 'to the imaging magnification (ST67), and further, the measured barycentric coordinate G is used as an enlarged face of the teaching composition data screen 2'. Visual angle correction data to be brought to the area center of gravity G'is calculated (ST68). Using the above main imaging data, the viewing angle control unit 5 controls the deflection angle of the deflection mirror 3c to determine the viewing angle, and the magnification control unit 8 scales the magnification of the imaging optical system 3a so that visible light / red The outer image pickup control unit 6 controls the visible light image pickup device 3v to pick up an image of the face area of the target, and obtains the target image 2'according to the taught composition (ST69).

Next, an automatic magnification photographing device according to a seventh embodiment of the present invention will be described. The device of the seventh embodiment is
Equipped with a photographing unit that shares a view angle determining unit and an image forming optical system with an image capturing unit, the view angle is determined for the taught scene to capture a scene image, the scene image signal is quantized to extract the target area, and the position of the area is determined. Measure data and size data,
This is an automatic magnification photographing apparatus in which the photographing unit photographs a target after the viewing angle is determined according to the teaching composition data and the magnification is changed. The overall configuration of the seventh embodiment device is shown in FIG. 15, and its operation steps are shown in the flow chart of FIG.

In FIG. 15, 1 is a target image captured at a magnification for searching a target, 2 is a view scene image at a magnification for searching a target, and in the target image 1, Fr is a target area mask and G (Xg, Yg) is the coordinate of the center of gravity of the target area, Fh is the length of the X axis of the target area, and in the view scene image 2, C
(Xc, Yc) are visual field center coordinates. Further, 1'is a target image of the optimum magnification determined by the viewing angle according to the teaching composition,
2'is a view scene image in that case, and in the target image 1'of the optimum magnification, Fr 'is a target area mask and G' (X
g ′, Yg ′) is the target area barycentric coordinate, Fh ′ is the target area X-axis length, and C ′ (Xc ′, Yc ′) is the visual field center coordinate in the visual field scene image 2 ′ at the optimum magnification. .

In FIG. 15, the automatic magnification photographing apparatus of the seventh embodiment includes an imaging optical system 3a having a variable magnification function, an image pickup apparatus 3b, an image pickup / photographing unit 3 including a viewing angle deflection mirror 3c and a photographing unit 3d. A control / calculation unit 4, a viewing angle control unit 5, an imaging / imaging control unit 6, a focusing unit 7, a magnification control unit 8, and an image processing unit 9 for quantizing an image to extract a target area, An arithmetic unit 10 which calculates position data and size data of the target area to calculate an imaging magnification; a data storage unit 11;
A system control unit 12 for controlling the entire system operation of the present embodiment, an input / output unit 13, and a communication unit 1
4, a display unit 15, and a bus 16.

Here, the photographing unit 3d is the image pickup device 3b.
, The imaging optical system 3a and the viewing-angle deflecting mirror 3c are shared, the optical path is branched by a mirror system (a combination mirror system of a half mirror and a mirror) 3a ′, and the photographing unit 3d further includes its own optical system (see FIG. (Not shown), the visual field projected on the image pickup device 3b and the visual field projected on the film surface (usually 35 mm) of the photographing unit 3 for photographing are the same.

Further, the viewing angle determining actuator of the imaging / photographing unit of the apparatus of this embodiment is not necessarily limited to the mirror deflection type, and the viewing angle may be determined by another type of actuator without any problem.
As an example thereof, FIG. 15 also shows another form of imaging / imaging unit 3'shown by a dotted line. This is a method of determining the viewing angle in which the automatic camera platform 3c ′ integrally rotates and tilts the imaging optical system 3a, the imaging device 3b, and the imaging unit 3d in response to a control signal from the viewing angle control unit 5. However, since the mirror deflection method and the automatic pan head method are essentially the same in view of the operation of the present invention, the following description will be given taking the mirror deflection method as an example.

First, the 71st step (ST7 of FIG. 16)
1) is a step of teaching the device, in which the device inputs the teaching data for instructing the direction to be searched by imaging, the image composition at the time of imaging, and the target image size. As shown in FIG. 15, the composition instruction data is data for designating the barycentric coordinates G ′ (Xg ′, Yg ′) of the target area with respect to the image center coordinates C ′ (Xc ′, Yc ′) of the imaging visual field 2 ′. When the target image size teaching data is the target (face) area mask Fr ′ size data of the main imaging target image 1 ′ in FIG. 15 and can be represented by the X-axis length of the target area Fh ′, Teach Fh '.

Next, the apparatus follows the teaching data, as shown in FIG.
The magnification control unit 8 adjusts the magnification of the imaging optical system 3a to the search magnification, and the viewing angle control unit 5 controls the deflection angle of the deflecting mirror 3c to determine the imaging viewing angle in the search direction. (ST72), the focusing unit 7 automatically focuses on the scene, and the image capturing / capturing unit 6 controls the image capturing device 3b to capture an image, and outputs the image signal of the search scene 2 (ST73). . The image processing unit 9 quantizes both images and searches for the presence or absence of the target area in the scene image using the target feature parameters (ST74). The apparatus of the seventh embodiment extracts the face area using the color image data with the human skin color as a characteristic parameter.

Therefore, when the image processing unit 9 detects the face area of the target image 1, ST75 becomes YES and the route area (A) is traced to extract the face area Fr.
0 calculates its size and barycentric coordinates (ST76). The arithmetic unit 10 calculates a scaling ratio from the Fr area size and the teaching size Fr ′ to the imaging magnification (ST77), and further, the measured barycentric coordinate G is used as the enlarged face area barycenter G ′ of the screen 2 ′ of the teaching composition data. The viewing angle correction data to be brought in is calculated (ST78).

Using the above photographing data, the viewing angle control unit 5 controls the deflection angle of the deflection mirror 3c to determine the viewing angle, and the magnification control unit 8 scales the magnification of the imaging optical system 3a for imaging. The imaging control unit 6 is the imaging / imaging unit 3
By controlling the photographing unit 3d to photograph the target face area,
Acquire the target photograph 2'according to the taught composition (ST7
9).

[0082]

According to the present invention, the relative resolution of the image sensor, which changes depending on the magnification, is detected from the relative relationship between the spatial frequency of the target image and the target spatial frequency acceptance band of the element, and the spatial frequency of the target image is measured and evaluated. By doing so, the technology for automatically finding the optimum magnification and varying the magnification and capturing an image is realized, so that an automatic camera does not capture an image with inappropriate resolution, and a target image with sufficient image quality can be obtained. It became so. Further, according to the present invention, if the size of the target image to be obtained is taught in advance, the technique of extracting the target image, automatically measuring it, and changing the magnification to pick up the image to obtain the target image of the taught size is also realized. Further, according to the present invention, since the technology for photographing an object at a magnification scaled by the image pickup apparatus has been realized, it becomes possible to take an object photograph of the taught size.

The effects of the present invention will be described below with reference to the claims. According to the first aspect of the invention, the image forming unit can change the magnification to form the target image on the image capturing unit, the image forming unit captures the formed target image, outputs an image signal, and outputs the image. The processing unit quantizes the image signal and outputs it as a spatial wave, the arithmetic unit frequency-analyzes the spatial waveform, the image evaluation unit evaluates the spatial waveform, analyzes the target image, and magnifies the magnification automatically. Was realized. According to this automatic magnification imaging device, the image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification, and the target image spatial frequency band falls within the element spatial frequency acceptance band of the imaging means. The optimum resolution image of the target can be obtained by finding a magnification that can be accommodated, the image forming unit varying the magnification, and the image capturing unit capturing the image of the target.

According to the second aspect of the present invention, the image forming means can change the magnification to form the target image on the image pickup means, and the image pickup means picks up the target image and outputs the image signal. Then, the image processing means quantizes the image signal and outputs it as a spatial wave, the arithmetic means frequency-analyzes the spatial waveform, the image evaluation means evaluates the spatial waveform, analyzes the target image, and scales the magnification automatically. A magnification imaging device was realized. According to this automatic magnification imaging device, the image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification so that the spatial frequency band required for the target image is the element spatial frequency reception of the imaging means. The optimum resolution image of the target can be obtained by finding the magnification that falls within the band, changing the magnification by the imaging unit, and imaging the target by the imaging unit.

According to the third aspect of the present invention, the viewing angle determining means optically positions the image pickup field, and the image forming means changes the magnification to form a scene image or a target image on the image pickup means. The image capturing means captures the scene image or the target image,
The image processing means quantizes the scene image signal to extract the target area, outputs its position data, outputs the image signal in the area as a spatial wave, the arithmetic means frequency-analyzes the spatial waveform, and the image evaluation means spatially It was possible to realize an automatic magnification imaging device that evaluates the waveform, analyzes the target image, and changes the magnification. According to this automatic magnification imaging device, the viewing angle determining unit determines the viewing angle of the target according to the target region position data, and the image evaluation unit evaluates the spatial waveform of the target image captured by changing the magnification, Optimizing the target by finding a magnification within which the spatial frequency band required for the target image falls within the element spatial frequency acceptance band of the image pickup means, the image forming means scaling the magnification, and the image pickup means picking up the image of the target. A resolution image can be acquired.

According to the invention of claim 4, the viewing angle determining means optically positions the image pickup field, and the image forming means changes the magnification to form a scene image or a target image on the image pickup means. The image capturing means captures the scene image or the target image,
The image processing unit quantizes the scene image signal to extract the target region, and the calculation unit measures the position and size of the target region and calculates the scaling factor from the teaching size data and the measurement data of the target region size. Was realized. According to this automatic magnification imaging device, the viewing angle determining unit determines the viewing angle of the target according to the target region position data, and the imaging unit scales the magnification with the scaling ratio calculated by the computing unit. By capturing an image of the target, a target size target image can be obtained.

According to the invention of claim 5, the detecting means detects the object and outputs the detection signal, the signal converting means converts the detection signal into the object direction signal, and the viewing angle determining means changes the imaging visual field according to the object direction signal. Optically positioned in the target direction, the image forming means can change the magnification to form a scene image or a target image on the image pickup means, the image pickup means picks up the scene image or the target image, and the image processing means. Realizes an automatic magnification imaging device in which a scene image signal is quantized to extract a target area, a calculating unit measures a position and a size of the target area, and a scaling ratio is calculated from teaching size data and measurement data of the target area size. It was According to this automatic magnification imaging device, the viewing angle determining unit determines the viewing angle of the target according to the target region position data, and the imaging unit scales the magnification with the scaling ratio calculated by the computing unit. By capturing an image of the target, a target size target image can be obtained.

According to the invention of claim 6, the viewing angle determining means optically positions the image pickup field, and the image forming means changes the magnification to form a scene image or a target image on the image pickup means. The image pickup means picks up a visible light image and an infrared image of the scene image or the target image in the same field of view, the image processing means quantizes the thermal image signal to extract a high temperature region, and the image processing means quantizes the visible light image signal. It was possible to realize an automatic magnification photographing device in which the calculation means maps a high temperature region onto a visible light image. According to this automatic magnification imaging device, the image processing means extracts a target area from the visible light image mapping area, and the computing means measures the position and size of the target area to measure the teaching size data and the measurement data of the target area size. Then, the viewing angle determining means determines the viewing angle of the target according to the target area position data, and the imaging means scales the magnification with the scaling ratio calculated by the computing means, and the imaging means targets the target. By capturing visible light, a target image of the teaching size can be obtained.

According to the invention of claim 7, the viewing angle determining means optically positions the imaging visual field, and the imaging means magnifies the magnification to form a scene image or a target image on the imaging means and the imaging means. The imaging means captures the scene image or the target image, the imaging means captures the target image, the image processing means quantizes the scene image signal to extract the target area, and the computing means positions and size of the target area. It has been possible to realize an automatic magnification photographing device which measures and calculates the scaling factor from the teaching size data and the measurement data of the target area size. According to this automatic magnification photographing device, the visual angle determining means determines the visual angle of the target according to the target area position data, and the image forming means scales the magnification by the scaling ratio calculated by the calculating means, and the photographing means operates. By photographing the target, it is possible to obtain a target size target photograph.

[Brief description of drawings]

FIG. 1 is a diagram showing an overall configuration of an automatic magnification imaging device according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing operation steps of the automatic magnification imaging device according to the first embodiment.

FIG. 3 is a diagram showing a relationship between a target image size that varies according to a magnification and an image pickup element and a pixel size according to a spatial frequency according to the present invention.

FIG. 4 is a diagram showing a relationship between a lightness histogram spatial frequency distribution of a target image that changes according to a magnification and an image sensor spatial frequency acceptance band.

FIG. 5 is a diagram showing an overall configuration of an automatic magnification imaging device according to a second embodiment of the present invention.

FIG. 6 is a flowchart showing operation steps of the automatic magnification imaging device according to the second embodiment.

FIG. 7 is a diagram showing an overall configuration of an automatic magnification imaging device according to a third embodiment of the present invention.

FIG. 8 is a flowchart showing operation steps of the automatic magnification imaging device according to the third embodiment.

FIG. 9 is a diagram showing an overall configuration of an automatic magnification imaging device according to a fourth embodiment of the present invention.

FIG. 10 is a flowchart showing operation steps of the automatic magnification imaging device according to the fourth embodiment.

FIG. 11 is a diagram showing an overall configuration of an automatic magnification imaging device according to a fifth embodiment of the present invention.

FIG. 12 is a flowchart showing operation steps of the automatic magnification imaging device according to the fifth embodiment.

FIG. 13 is a diagram showing an overall configuration of an automatic magnification imaging device according to a sixth embodiment of the present invention.

FIG. 14 is a flowchart showing operational steps of the automatic magnification imaging device according to the sixth embodiment.

FIG. 15 is a diagram showing an overall configuration of an automatic magnification photographing device according to a seventh embodiment of the present invention.

FIG. 16 is a flowchart showing operational steps of the automatic magnification photographing device according to the seventh embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Target 2 Field of view at imaging magnification 3 Imaging unit 3a Imaging optical system 3b Imaging device 5 Imaging control unit 6 Magnification control unit 7 Focusing unit 9 Image processing unit 10 Arithmetic unit 11 Image evaluation unit

Claims (7)

[Claims] 1. An image forming means capable of forming a target image on an image pickup means by changing the magnification, an image pickup means for picking up the formed target image and outputting an image signal, and quantizing the image signal. What is claimed is: 1. An automatic magnification imaging apparatus, comprising: an image processing means for outputting as a spatial wave; a computing means for frequency-analyzing a spatial waveform; and an image evaluation means for evaluating a spatial waveform, which analyzes a target image to change the magnification. The image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification, finds a magnification within which the target image spatial frequency band falls within the element spatial frequency acceptance band of the imaging means, and forms the image. An automatic magnification image pickup device, characterized in that the means obtains an optimum resolution image of the object by changing the magnification to that and the image pickup means picks up an image of the object. 2. An image forming means capable of forming a target image on an image pickup means by changing the magnification, an image pickup means for picking up the formed target image and outputting an image signal, and quantizing the image signal. What is claimed is: 1. An automatic magnification imaging apparatus, comprising: an image processing means for outputting as a spatial wave; a computing means for frequency-analyzing a spatial waveform; and an image evaluation means for evaluating a spatial waveform, which analyzes a target image to change the magnification. The image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification, and finds a magnification in which the spatial frequency band required for the target image falls within the element spatial frequency acceptance band of the imaging means, An automatic magnification imaging apparatus, characterized in that the image forming means scales the magnification and the image pickup means picks up an image of an object to obtain an optimum resolution image of the object. 3. A view angle determining means for optically positioning an image pickup field, an image forming means for changing a magnification to form a scene image or a target image on the image pickup means, and a scene image or a target image. Imaging means, image processing means for quantizing a scene image signal to extract a target area, outputting position data thereof, and outputting an image signal in the area as a spatial wave, arithmetic means for frequency-analyzing the spatial waveform, and space. An automatic magnification imaging device comprising: an image evaluation unit that evaluates a waveform; the viewing angle is determined in the direction of the target; and the target image is analyzed to change the magnification, wherein the viewing angle determination unit is the target region position data. The viewing angle is determined, and the image evaluation means evaluates the spatial waveform of the target image captured by changing the magnification, and the spatial frequency band required for the target image is within the element spatial frequency acceptance band of the imaging means. An automatic magnification imaging apparatus, which finds a magnification within a range, the imaging unit magnifies the magnification, and the imaging unit captures an image of the object to obtain an optimum resolution image of the object. 4. A view angle determining means for optically positioning an image pickup field, an image forming means for changing the magnification to form a scene image or a target image on the image pickup means, and a scene image or a target image. Image pickup means, image processing means for quantizing the scene image signal to extract the target area, and computing means for measuring the position and size of the target area and calculating the scaling factor from the teaching size data and the measured data of the target area size. In the automatic magnification imaging device, the viewing angle determining unit determines the viewing angle of the target according to the target area position data, and the imaging unit scales the magnification with the scaling ratio calculated by the computing unit. An automatic magnification imaging device, characterized in that a target image of a taught size is acquired by the means capturing an image of the object. 5. A detection means for detecting a target and outputting a detection signal, a signal conversion means for converting the detection signal into a target direction signal, and a visual angle determination for optically positioning the imaging field of view in the target direction according to the target direction signal. Means, an image forming means capable of forming a scene image or a target image on the image pickup means by changing the magnification, an image pickup means for picking up the scene image or the target image, and a scene image signal being quantized to extract a target area. An automatic magnification image pickup apparatus comprising: an image processing unit for performing a measurement, a calculation unit that measures a position and a size of a target region, and calculates a scaling factor from teaching size data and measurement data of the target region size. Determines the viewing angle of the target according to the target region position data, the imaging unit scales the magnification with the scaling ratio calculated by the calculation unit, and the imaging unit images the target to determine the teaching size. An automatic magnification imaging device characterized by acquiring a target image. 6. A view angle determining means for optically positioning an image pickup field, an image forming means for changing a magnification to form a scene image or a target image on the image pickup means, and a scene image or a target image in the same field of view. Image pickup means for picking up visible light and infrared rays, image processing means for quantizing a thermal image signal to extract a high temperature region, and image processing means for mapping the high temperature region onto a visible light image obtained by quantizing the visible light image signal. The image processing means extracts a target area from the visible light image mapping area, and the calculating means measures the position and size of the target area to obtain teaching size data. The scaling factor is calculated from the measurement data of the target region size, the viewing angle determining unit determines the viewing angle of the target according to the target region position data, and the imaging unit scales the scaling factor with the scaling factor calculated by the computing unit. The imaging hand An automatic magnification imaging device, wherein a stage captures an object image of a taught size by imaging the object with visible light. 7. A view angle determining means for optically positioning an image pickup field, an image forming means capable of forming a scene image or an object image on the image pickup means and the image pickup means by changing the magnification, and the scene image or the object image. Image capturing means for capturing the target image, image capturing means for capturing the target image, image processing means for quantizing the scene image signal to extract the target area, teaching position data and target area size by measuring the position and size of the target area. An automatic magnification photographing apparatus comprising: a calculation unit that calculates a scaling factor from the measurement data of 1., wherein the viewing angle determining unit determines the viewing angle of the target according to the target area position data, and the scaling factor calculated by the calculating unit is used. An automatic magnification photographing apparatus characterized in that an image-forming means changes the magnification and the photographing means photographs a target to obtain a target photograph of a teaching size.