JPH07283990A - Image pickup device - Google Patents

Abstract

PURPOSE:To provide an image pickup device capable of selecting an executing position and a magnification ratio on the screen of magnification processing by an electronic zoom function and an electronic close-up function, etc., by a photographer by an easy method by selecting the executing positon and the magnification ratio of the magnification processing in which the magnification processing is applied to a video signal outputted from an image pickup element. CONSTITUTION:A magnifying position input device 20 is a device to input position information representing a position (magnification executing position) where the magnification processing is executed by a magnification processing circuit 5 by the photographer. A magnification ratio setting device 21 is a device to set the magnification ratio when the magnification processing is performed by a magnification processing circuit 5 by the photographer. A magnifying position display circuit 22 is a circuit to display the position information inputted from the magnifying position input device 20 on the screen of an EVF 23. The executing position of the magnification processing by the magnification processing means 5 can be selected by operating the executing position selection means 20 by the photographer, and also, the magnification ratio of the magnification processing by the magnification processing means 5 can be selected by operating the magnification ratio setting means 21.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus such as a video camera having an enlargement processing function for electronically enlarging an image pickup screen.

[0002]

2. Description of the Related Art Conventionally, in an image pickup apparatus capable of digitally processing an image signal, a so-called electronic zoom function for electronically zooming up a subject such as an optical zoom, or a part of an image obtained from an image pickup element is previously stored. There has been proposed an electronic image magnification enlarging means such as an electronic close-up function for instantaneously enlarging to a set magnification (for example, 2 times or 3 times).

Hereinafter, such a conventional electronic image magnification enlarging means will be described with reference to FIG. FIG. 10 is a block diagram showing a configuration of a video camera for explaining a conventional electronic image magnification enlarging means. In FIG. 10, 1 is a lens for forming a subject image (not shown), and 2 is incident from the lens 1. An image sensor 3 for converting the converted optical signal into an electric signal (photoelectric conversion), and an analog-digital converter 3 for converting an analog signal photoelectrically converted by the image sensor 2 into a digital signal (hereinafter referred to as an A / D converter). ) 4 is a first process for subjecting the signal A / D converted by the A / D converter 3 to a predetermined process, for example, a color signal and a luminance signal, and subjecting each signal to a γ process or the like. A camera signal processing circuit 5 is an enlargement processing circuit (electronic image magnification enlargement means) 6 which enlarges the video signal output from the first camera signal processing circuit 4.
Is a second camera signal processing circuit for subjecting the video signal output from the enlargement processing circuit 5 to predetermined processing, for example, synchronization signal addition processing, and 7 is a digital signal output from the second camera signal processing circuit 6. A digital-analog converter (hereinafter, referred to as a D / A converter) for converting the image into an analog signal, and 8 is an enlargement process for the photographer to input an execution command signal for the enlargement process of the video signal by the enlargement processing circuit 5. The execution switch 9 is a microcomputer (hereinafter, referred to as a microcomputer) that controls the entire video camera.

In the thus constructed video camera, light from a subject is imaged on the image sensor 2 through the lens 1 and a diaphragm mechanism (not shown), converted into an electric signal and output. The output electric signal is input to the A / D converter 3 through a circuit (not shown) such as correlated double sampling (CDS) and converted into a digital signal. The converted digital signal is input to the first camera signal processing circuit 4 and subjected to predetermined processing, and then input to the second camera signal processing circuit 6 as it is, or the enlargement processing circuit 5
Is input to the second camera signal processing circuit 6 and enlarged. Then, the signal subjected to the predetermined processing in the second camera signal processing circuit 6 is D / A
After being input to the converter 7 and converted into an analog signal, it is output to a VTR (video tape recorder) or the like (not shown).

The enlargement processing by the enlargement processing circuit 5 is executed by the photographer operating the enlargement processing execution switch 8 to input an enlargement processing execution command signal, and the microcomputer 9 receiving the input signal.

An example of image enlargement processing by linear interpolation will be described below with reference to FIG. FIG. 11 (a)
When the original image (hatched portion) is enlarged and displayed as shown in (b), the relationship between the scanning lines of the original image (a) and the enlarged image (b) is as shown in FIGS. 11C and 11D, respectively. become. Further, in order to convert the enlarged image (b) into a standard television signal, the broken scan lines 1 to 7 must be created from the solid scan lines AF in FIG. At this time, the scanning line of a broken line can be calculated | required by multiplying the scanning line of a solid line by the weight according to the distance, and adding it. By performing such a linear interpolation process in each of the vertical direction and the horizontal direction, the original image can be enlarged at an arbitrary enlargement ratio.

FIG. 12 is a block diagram showing an example of the configuration of the enlargement processing circuit 5, in which 10 is a memory circuit.
The signal of the scanning line "n" line which stores the video signal input from the first camera signal processing circuit 4 (see FIG. 10) and is designated by the memory read control signal and the scanning line "n-1" delayed by 1H. Output the line signal and. A memory control signal generation circuit 11 generates a memory control signal for controlling writing and reading of data with respect to the memory circuit 10. Reference numeral 12 denotes an enlargement ratio determination circuit, which determines the enlargement ratio and the enlargement position during the enlargement processing by the enlargement processing circuit 5. An interpolation coefficient generation circuit 13 generates an interpolation coefficient according to the enlargement ratio determined by the enlargement ratio determination circuit 12. A first multiplier 14 multiplies the signal of the scanning line “n” line output from the memory circuit 10 by the interpolation coefficient output from the interpolation coefficient generation circuit 13. 15 is a second multiplier, which is the memory circuit 1
The signal of the scanning line “n−1” line output from 0 is multiplied by the interpolation coefficient output from the interpolation coefficient generating circuit 13. 16 is an adder, which is the output signal of the first multiplier 14 and
The output signal of the second multiplier 15 is added. Reference numeral 17 is a microcomputer interface circuit, which is a microcomputer 9 (see FIG. 10).
The enlargement ratio and the enlargement position information output from are received.

From the memory circuit 10 in which the input video signal is stored, the signal of the scanning line "n" line and the scanning line "n-1" line are generated by the memory control signal generated from the memory control signal generating circuit 11. Signal and are read out. At the same time, the interpolation coefficient generating circuit 13 outputs an interpolation signal and an interpolation coefficient corresponding to the distance between the scanning line “n” line and the scanning line “n−1” line. Then, in the first and second multipliers 14 and 15, after multiplying the interpolation coefficient by the signal of the scanning line “n” line and the signal of the scanning line “n−1” line, the respective multiplication values are added by the adder. By adding by 16, a linear addition signal is obtained.

By performing the linear interpolation processing as described above, an enlarged video signal can be obtained.

[0010]

However, in the above-mentioned conventional example, the position where the image obtained from the image pickup device is enlarged is a predetermined position, and the photographer can freely set the enlargement center position and the angle of view of the image. Therefore, there is a problem in that the range of the screen to be enlarged cannot be known in advance.

The present invention has been made in view of the above-mentioned problems of the above-mentioned conventional technique, and an object of the present invention is to display on a screen for enlarging processing by an electronic zoom function, an electronic close-up function, or the like. It is an object of the present invention to provide an imaging device that allows a photographer to select the execution position and the enlargement ratio by a simple method.

[0012]

In order to achieve the above object, an image pickup apparatus according to a first aspect of the present invention (claim 1) is an image pickup apparatus having an enlargement processing means for enlarging a video signal output from an image pickup device. The apparatus is provided with an execution position selection means for selecting an execution position of the enlargement processing by the enlargement processing means, and an enlargement ratio selection means for selecting an enlargement ratio of the enlargement processing by the enlargement processing means. is there.

In order to achieve the same object, an image pickup apparatus according to a second aspect of the present invention (claim 6) is an image pickup apparatus having an enlargement processing means for enlarging a video signal output from an image pickup element. The execution position selecting means for selecting the execution position of the enlargement processing by the means, the enlargement ratio selecting means for selecting the enlargement ratio of the enlargement processing by the enlargement processing means, and the selection status of the execution position selecting means and the enlargement ratio selecting means. A display means for displaying is provided.

In order to achieve the same purpose, the execution position selecting means may be constituted by a gazing point position detecting means for detecting a gazing point position of the photographer at the time of photographing, or the execution position selecting means may be a track. It is desirable that the display means is a ball, a joystick, a touch panel, or the like, and the display means is an electronic viewfinder.

[0015]

In the image pickup apparatus of the first invention (claim 1), the photographer operates the execution position selection means to select the execution position of the enlargement processing by the enlargement processing means and also operates the enlargement ratio selection means. By doing so, the enlargement ratio of the enlargement processing by the enlargement processing means is selected.

In the image pickup apparatus of the second invention (claim 6), the photographer operates the execution position selecting means to select the execution position of the enlargement processing by the enlargement processing means and also operates the enlargement ratio selecting means. By doing so, the enlargement ratio of the enlargement processing by the enlargement processing means is selected, and the selection statuses of the execution position selection means and the enlargement ratio selection means are displayed on the display means.

[0017]

Embodiments of the present invention will be described below with reference to FIGS.

(First Embodiment) First, a first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing a configuration of an image pickup apparatus according to the first embodiment of the present invention. In FIG. 1, the same parts as those in FIG. 10 of the conventional example described above are denoted by the same reference numerals. In FIG.
The difference from 0 is that an enlarged position input device (enlarged position input means) 20, an enlargement ratio setting device 21, an enlarged position display circuit 22 and an electronic viewfinder (hereinafter, referred to as EVF) which is a display means in the configuration of FIG. 23 is added respectively.

The enlargement position input device 20 includes an enlargement processing circuit 5
Is a device for a photographer to input position information indicating a position for executing the enlargement process (enlargement execution position). The enlargement ratio setting device 21 is a device for the photographer to set the enlargement ratio when performing enlargement processing by the enlargement processing circuit 5. The enlarged position display circuit 22 is a circuit for displaying the position information input from the enlarged position input device 20 on the screen of the EVF 23. The EVF 23 is a monitor means for the photographer to monitor the video output signal output from the D / A converter 7 and the planned expansion position signal output from the expansion position display circuit 22.

FIG. 2 is a screen (EVF screen) of the EVF 23 when the enlargement execution position is input using the enlargement position input device 20 and the enlargement ratio is input using the enlargement ratio setting device 21.
It is a figure which shows the example of a display of. In the figure, 24 is an EVF
On the screen, the original images 25 and 26 and the planned enlarged view angle frame 27 are displayed, respectively.

FIG. 3 shows the EVF screen 2 during the enlargement process.
It is a figure which shows the example of a display of No. 4. In the figure, 27a, 2
8a is an enlarged image displayed on the EVF screen 24 after being enlarged, and 29a is also enlarged and displayed on the EVF screen 24.
It is the angle of view frame displayed above.

Next, the control operation of the microcomputer 9 for executing the actual enlargement processing in response to the operation of the photographer described above will be described with reference to FIGS. 1 and 4. FIG. 4 is a flowchart showing the control operation of the microcomputer 9.

First, when the power is turned on in step S401 of FIG. 4, the microcomputer 9 starts operating. Then, after the initial value data of the predetermined enlargement position is stored in the enlargement position memory and the enlargement ratio memory in the microcomputer 9 respectively in step S402, the process proceeds to step S403 and waits for a predetermined time. When a predetermined waiting time has elapsed, step S4
In 04, it is determined whether or not a signal for executing the enlargement process is input from the enlargement process execution switch 8. If it is input, the process proceeds to step S405, and if it is not input, step S40 is performed.
Go to 7 respectively.

In step S405, the step S4 is executed.
In 02, the enlargement position information and the enlargement ratio information respectively stored in the enlargement position memory and the enlargement ratio memory are sent to the enlargement processing circuit 5. Then, the process proceeds to step S406 and E
After the images for which the enlarging process is being executed are continuously output and displayed on the VF screen 24, the process returns to step S403. FIG. 4 shows a display example of the EVF screen 24 at the time of this output. Figure 4
(A) shows the enlargement initial state, (b) shows the original images 25 and 26 enlarged, and (c) shows the enlargement end state.

On the other hand, in step S407, the enlargement position data and the enlargement ratio data are created based on the signals input from the enlargement position input device 20 and the enlargement ratio setting device 21, respectively, and are stored in the enlargement position memory and the enlargement ratio memory, respectively. Store. Next, the process proceeds to step S 408 to create a planned enlargement angle-of-view frame signal based on the enlargement position data and enlargement ratio data stored in the enlargement position memory and enlargement ratio memory, and sends the signal to the enlargement position display circuit 22. 2, the planned enlarged view angle frame 27 is displayed on the EVF screen 24, and then the process returns to step S403.

It goes without saying that any device can be used as the enlargement position input device 20 as long as the photographer can specify a two-dimensional position. For example, a conventionally known trackball. , Joysticks, touch panels, etc. can be mentioned as application examples.

(Second Embodiment) Next, a second embodiment of the present invention will be described with reference to FIGS. In the present embodiment, as the enlarged position input device 20 in the above-described first embodiment, the position of the point of gaze when the photographer observes the EVF 23 at the time of shooting is detected, and the detection signal is used as the enlarged position input information. It is the one. In the present embodiment, the parallel light velocity from the light source is projected onto the anterior segment of the eyeball of the observer (photographer), and the corneal reflection image due to the reflected light from the cornea and the imaging position of the pupil are used to measure the gazing point axis. Are seeking.

An example of the gazing point position detecting method will be described below with reference to FIGS. 5 and 6.

FIG. 5 is a conceptual diagram showing an optical system of a gazing point position detecting device (gazing point position detecting means) T for detecting the gazing point position. In FIG. 5, 32 is a half mirror and 33 is a projection lens. , 34 is a light receiving lens, and 35 is a light source such as a light emitting diode, which is arranged on the focal plane of the light projecting lens 33 and emits infrared light insensitive to the observer. 36 is a photoelectric element array, 3
7 is a gazing point position processing circuit, 38 is an observer's eyeball, 39 is a cornea, and 40 is an iris.

FIG. 6 is a diagram showing the intensity of the output signal from the photoelectric element array 36.

In FIG. 5, the infrared light emitted from the light source 35 becomes parallel light by the light projecting lens 33, is reflected by the half mirror 32, and illuminates the cornea 39 of the eyeball 38.
At this time, the corneal reflection image due to a part of the infrared light reflected on the surface of the cornea 39 is passed through the half mirror 32 and the light receiving lens 34 to the positions Za ′, Zb ′ on the photoelectric element array 36 and the iris 40.
The images of the ends a and b are formed. When the rotation angle θ of the optical axis a of the eyeball 38 with respect to the optical axis a of the light receiving lens 34 is small and the Z coordinates of the ends a and b of the iris 40 are Za and Zb, the coordinate Zc of the center c of the iris 40 is It is represented by the following formula (1).

Zc = (Za + Zb) / 2 (1) Further, the Z coordinate of the generation position d of the corneal reflection image is Zd, and the cornea 3
The distance from the center of curvature o of 9 to the center c of the iris 40 is oc
Then, the rotation angle θ of the optical axis a of the eyeball 38 is given by the following (2)
Almost satisfied the formula.

Oc × sin θ = Zc−Zd (2) Here, the Z coordinate Zd of the generation position d of the corneal reflection image and the cornea 3
The Z coordinate Z of the center of curvature o of 9 coincides with each other.
Therefore, in the gazing point position processing circuit 37, by detecting the position of each singular point (corneal reflection image and ends a and b of the iris 40) projected on the photoelectric element array 36 as shown in FIG. The rotation angle θ of the optical axis a of the eyeball 38 can be obtained. At this time, the equation (1) is rewritten as the following equation (3).

Β × oc × sin θ = (Za′−Zb ′) / 2−Zd ′ (3) where β is the distance L 1 between the Z coordinate Zd of the cornea reflection image generation position d and the light receiving lens 34. Is a magnification determined by the distance L0 between the light receiving lens 34 and the photoelectric element array 36, and is usually a substantially constant value.

Next, the detection operation of the gazing point position detecting device T will be described with reference to FIGS. 7 and 8. 7 is a flowchart showing the gazing point position detection operation, and FIG. 8 is a photoelectric element array 36.
It is a figure which shows the upper cornea reflection image. In FIG. 8, 40,
Za ', Zb' and Zd 'are as described above, and c'
Is the center of the pupil, Yb 'and Ya' are the upper and lower end coordinates on the pupil circle, and Yd 'is the Y coordinate of the corneal reflection image.

In step S701 of FIG. 7, the coordinates Zd 'of the corneal reflection image in FIG. 8 are detected. Next in step S70
2, the coordinates Zb ', Za' of the boundary point between the iris 40 and the pupil,
Yb 'and Ya' are detected. Next, in step S703, the pupil center c'is calculated based on the data detected in step S702. Next, step S
In step 704, the rotation angle θ of the optical axis a of the eyeball 38 is calculated based on the data calculated in step S703. Here, two types of rotation angles θ in the Z-X plane (horizontal direction) and in the XY plane (vertical direction) are respectively calculated.
Next, in step S705, the gazing point position is calculated based on the value of the rotation angle θ calculated in step S704.

FIG. 9 is a block diagram showing the arrangement of an image pickup device in which the above-mentioned gazing point position detection device T is applied to an enlarged position input device. In FIG. 9, the same parts as those of FIG. Are denoted by the same reference numerals. Figure 9
1 is different from FIG. 1 in the configuration of the enlarged position input device. That is, in the enlarged position input device 20 'of this embodiment, an eyepiece 41 and a second half mirror 42 for projecting infrared light are added to the configuration of the optical system of the gazing point position detecting device T shown in FIG. This is a gaze point position detecting device T '.
In FIG. 9, 43 is an EVF screen. Other configurations of the enlarged position input device 20 'of the present embodiment are the same as those of the optical system of the gazing point position detection device T shown in FIG. To do.

In FIG. 9, the infrared light projected from the light source 35 passes through the light projecting lens 33, is reflected by the second half mirror 42 and the first half mirror 32, and reaches the eyeball 38. Then, the reflected light from the eyeball 38 is reflected by the first half mirror 32 and reaches the photoelectric element array 36 via the light receiving lens 34. On the other hand, the photographed image displayed on the EVF screen 43 reaches the eyeball 38 via the first half mirror 32 and the eyepiece lens 41. Thereby, while the photographer is checking the image on the EVF screen 43, the position of the point of gaze is detected on the one hand. Gazing point position processing circuit 3
Reference numeral 7 calculates an output signal from the photoelectric element array 36 by using the above-mentioned gazing point position detecting method, and sends it to the microcomputer 9 as an enlarged position input signal desired by the photographer. This microcomputer 9
However, by controlling in the same manner as in the first embodiment described above,
The image position on the screen desired by the photographer can be enlarged. In addition, in FIG. 9, E is an optical axis.

[0039]

As described in detail above, according to the image pickup apparatus of the present invention, the execution position on the screen and the enlargement ratio of the enlargement processing by the electronic zoom function, the electronic close-up function, etc.
There is an effect that the photographer can select by a simple method, and thus can surely know the range of the screen to be enlarged in advance. Since the execution position of the enlarging process can be selectively set by detecting the line of sight, the operator can set the enlarging process executing position while looking at the screen, and does not require any other troublesome operation, resulting in extremely high operability. It will be good.

Also, when a joystick or a trackball is used, the operability can be similarly improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an image pickup apparatus according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a display example of an EVF screen while the image pickup apparatus is on standby for enlargement processing.

FIG. 3 is a diagram showing a display example of an EVF screen during execution of enlargement processing of the imaging apparatus.

FIG. 4 is a flowchart showing an operation of the image pickup apparatus.

FIG. 5 is a conceptual diagram of an optical system of a gazing point position detection device in an image pickup device according to a second embodiment of the present invention.

6 is a diagram showing the intensity of an output signal of a photoelectric element array in the optical system of the gazing point position detection device of FIG.

FIG. 7 is a flowchart showing an operation of the image pickup apparatus.

FIG. 8 is a diagram showing a corneal reflection image on a photoelectric element array in the imaging device.

FIG. 9 is a block diagram showing a configuration of the image pickup apparatus.

FIG. 10 is a block diagram showing a configuration of a conventional imaging device.

FIG. 11 is a diagram showing an electronic image magnification enlargement processing operation.

12 is a block diagram showing a configuration of an enlargement processing circuit in the image pickup apparatus of FIG.

[Explanation of symbols]

 2 image pickup element 5 enlargement processing circuit (enlargement processing means) 8 enlargement execution switch (first switching means) 9 microcomputer (storage means) 20 enlargement position input device (execution position selection means) 21 enlargement ratio setting device (enlargement ratio selection means) 23 EVF (display means) T gazing point position detecting device (gazing point position detecting means) T'gazing point position detecting device (gazing point position detecting means)

Claims (11)

[Claims] 1. An image pickup apparatus having an enlargement processing means for enlarging a video signal outputted from an image pickup device, wherein the execution position selecting means selects an execution position of the enlargement processing by the enlargement processing means, and the enlargement processing means. An image pickup apparatus, comprising: an enlargement ratio selecting unit that selects an enlargement ratio of an enlargement process. 2. The image pickup apparatus according to claim 1, wherein the execution position selecting means is a gazing point position detecting means for detecting a gazing point position of the photographer at the time of photographing. 3. The image pickup apparatus according to claim 1, wherein the execution position selecting means is a trackball. 4. The image pickup apparatus according to claim 1, wherein the execution position selecting means is a joystick. 5. The image pickup apparatus according to claim 1, wherein the execution position selection unit is a touch panel. 6. An image pickup apparatus having an enlargement processing unit for enlarging a video signal output from an image pickup element, wherein the execution position selecting unit selects an execution position of the enlargement processing by the enlargement processing unit, and the enlargement processing unit. An image pickup apparatus comprising: an enlargement ratio selecting means for selecting an enlargement ratio of enlargement processing; and a display means for displaying a selection status of the execution position selecting means and the enlargement ratio selecting means. 7. The image pickup apparatus according to claim 6, wherein the execution position selecting means is a gazing point position detecting means for detecting a gazing point position of the photographer at the time of photographing. 8. The image pickup apparatus according to claim 6, wherein the execution position selecting means is a trackball. 9. The image pickup apparatus according to claim 6, wherein the execution position selection means is a joystick. 10. The image pickup apparatus according to claim 6, wherein the execution position selection unit is a touch panel. 11. The image pickup apparatus according to claim 6, wherein the display unit is an electronic viewfinder.