JPH09163212A - Image pickup unit - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily and surely adjust the balance of an image even concering adjustment matters with a low adjustment frequency without preventing the smooth movement of a camera and without disturbing the balance of the image by executing adjustment work concerning an adjustment item corresponding to the facing direction of a cameraman. SOLUTION: CPU 13 display a stipulated menu on the display screen of a view finder 6 with a TV camera part 14. The face of the cameraman is image-picked-up by the camera 7 for the cameraman, which is arranged in the upper part of the view finder 6. CPU 13 refers to personal information of the cameraman, which is registered in a memory 15 and detects the facing direction of the cameraman. CPU 13 detects the menu selected by the cameraman by the detected facing direction and outputs control data D. Thus, a TV camera part 14 and the view finder 6 are adjusted concerning the adjustment item selected by the cameraman from the adjustment items with the low adjustment frequency.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging device,
For example, by applying it to a television camera for a studio and forming a menu so that the operation can be switched according to the orientation of the face, the smooth movement of the camera and the adjustment frequency can be maintained without disturbing the balance. Make adjustments easy and sure even for low adjustment items.

[0002]

2. Description of the Related Art Conventionally, in a television camera for a studio, while being fixed to a tripod, an operation rod extending from the upper part of the tripod is operated to track the movement of an object and is attached to the operation rod. The focus is adjusted by operating the operator.

That is, in a television camera for a studio, a zoom, focus, iris operator and a return image changeover switch, which are frequently operated, are arranged on this operation rod, whereby these operators are tracked while tracking the movement of a subject. Is formed so that it can be operated.

On the other hand, the operator for image quality adjustment (that is, brightness adjustment, contour adjustment, etc.) of the viewfinder, which is infrequently operated, and the operator for switching Genie, etc., are operation panels formed on the rear surface of the television camera. Above, so that you do not need to divert your eyes more than the viewfinder,
It was arranged close to the display screen of the viewfinder, and it was possible to operate these controls by releasing the hand from the operating rod as needed.

[0005]

By the way, in the actual shooting scene, the light quantity of the subject may change during the shooting. In this case, the cameraman can adjust the brightness and contour correction of the viewfinder to facilitate focus adjustment. However, in practice, this adjustment work needs to be performed by moving the line of sight from the viewfinder while taking a picture or using a short time during which an on-air image is switched between other television cameras. .
Therefore, in the conventional television camera, when this kind of adjustment work is executed, there are problems that the smooth movement of the camera is disturbed and the balance of the image as the image pickup result is disturbed.

As one method of solving these problems, by arranging these operators with low adjustment frequency on the operating rod, the operators can be operated without moving the line of sight from the viewfinder. There are possible ways to do this. However, in this case, in the end, the cameraman has to perform various adjustment works by manipulating these operating elements by groping, which causes a problem that erroneous operation cannot be avoided.

The present invention has been made in consideration of the above points, and can easily and surely adjust even adjustment items that are infrequently adjusted without hindering the smooth movement of the camera and without disturbing the balance. The present invention intends to propose an image pickup apparatus that can be used.

[0008]

In order to solve such a problem, the present invention is applied to an image pickup apparatus for picking up an image of a desired subject and outputting an image pickup result of the subject. In this image pickup device, a display means for displaying a menu screen in which adjustment items are sequentially arranged together with an image pickup result of a subject, a cameraman image pickup means for picking up a cameraman's face observing the display screen of the display means, and a cameraman's Based on the image pickup result of the image pickup means, the direction of the face of the previous photographer is detected,
A menu detection unit for detecting adjustment items arranged on the menu screen corresponding to the face direction is provided,
Regarding the adjustment items detected by this image processing means,
Make sure to perform the adjustment work.

At this time, the above menu detecting means performs image processing on the image pickup result of the cameraman output from the above cameraman image pickup means to detect the orientation of the cameraman's face.

Alternatively, the menu detecting means detects the orientation of the cameraman's face with reference to the image pickup result obtained by changing the focus of the cameraman's image pickup means.

Further alternatively, the cameraman image pickup means is formed by a plurality of image pickup devices which are arranged apart from each other and output an image pickup result obtained by stereoscopically viewing the face of the previous cameraman. However, among the image pickup results obtained by the plurality of image pickup devices, the characteristic part of the face is collated to detect the face direction.

At this time, the above-mentioned image pickup device has a lighting means for emitting infrared rays intermittently in synchronism with the operation of the cameraman's image pickup means to illuminate the cameraman with the infrared rays, and the preceding menu detection means has this. Image processing the result of comparison between the image pickup result of the cameraman illuminated by infrared rays and the image pickup result of the cameraman not illuminated by this infrared ray,
Try to detect the orientation of the photographer's face.

With these means, in the viewfinder, a menu screen relating to the adjustment items is displayed together with the imaging result of the subject, and the cameraman's imaging means images the face of the cameraman who observes the display screen of the viewfinder, and the cameraman If the adjustment item corresponding to the orientation of the cameraman's face is detected from the imaging result of the image capturing means, the cameraman can select the adjustment item only by changing the orientation of the face and visually observing the menu. As a result, the adjustment work can be executed for the adjustment item detected by the menu detection means, and the desired adjustment item can be adjusted hands-free.

More specifically, the menu detecting means detects the distance from the nose to the contours on both sides of the face by image-processing the image pickup result of the cameraman outputted from the image pickup means for the cameraman, The orientation of the cameraman's face can be detected.

Alternatively, the menu detecting means may detect the difference in the distance from the nose to the cheeks on both sides based on the image pickup result obtained by changing the focus of the image pickup means for the cameraman. , The direction of the photographer's face can be detected.

Further, instead of this, the cameraman's image pickup means is formed by a plurality of image pickup devices which are arranged apart from each other and which outputs an image pickup result obtained by stereoscopically viewing the face of the previous cameraman, and the previous menu detection means. However, the characteristic parts of the face are collated among the image pickup results obtained by the plurality of image pickup devices, and for example, the face orientation is detected by detecting the difference in the positions of the nose, eyes, etc. between the plurality of image pickup results. can do.

At this time, the previous image pickup device irradiates the cameraman by emitting infrared rays intermittently in synchronization with the operation of the image pickup means for the cameraman, and the previous menu detecting means is illuminated by the infrared ray. Image processing of the comparison result between the image pickup result of No. 1 and the image pickup result of the cameraman who is not illuminated by infrared rays, and the orientation of the cameraman's face is detected, for example, effectively avoiding the mixing of noise due to visible light It can be processed and the orientation of the cameraman's face can be detected correctly.

[0018]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 2 is a side view showing a television camera for a studio according to the embodiment of the present invention. The television camera 1 is held by a tripod 2, and the tripod 2
It is formed so that the direction can be changed by operating the operating rod 3 extending from the upper part of the above, so that the television camera 1 is formed so that the operating rod 3 can be grasped and the movement of the subject can be tracked.

The operation stick 3 is arranged such that a zoom, focus, iris operator and return image changeover switch, which are frequently operated, are arranged on the hand side of the cameraman 4 together with the trigger switch 5 for confirming the menu. There is. As a result, the television camera 1 is formed so as to follow the change of the subject by operating the zoom, focus and iris operators, and the on-air image can be confirmed by operating the return image changeover switch. ing. Also, by operating the trigger switch 5 for confirming the menu, adjustment items with low adjustment frequency
It can be adjusted easily.

Further, the television camera 1 has a viewfinder 6 arranged on the cameraman 4 side, and a cameraman camera 7 arranged above the viewfinder 6 captures an image of the face of the cameraman 4. The cameraman's camera 7 is formed for black and white, and is arranged near the display screen of the viewfinder 6 and in the upper center of the display screen.
Further, in this cameraman camera 7, the focus position and the depth of field are manually set so that the face of the cameraman is in focus, and the angle of view is set so that the face of the cameraman 4 can be sufficiently captured. Has been done.

To do this, the cameraman 4
By observing the display screen of the viewfinder 6 and operating the television camera 1 without changing the position of the face so much, in this embodiment, in the vicinity of the display screen and in the upper center of the display screen in this way. By disposing the cameraman's camera 7 and fixing the focus and the like, the face of the cameraman 4 can be stably imaged from the front with a simple configuration. The cameraman's camera 7 controls the diaphragm with an auto iris.

Further, in the television camera 1, the image pickup result of the cameraman camera 7 is processed by the built-in image processing section 8, and the processing result of the image processing section 8 is fetched in response to the operation of the trigger switch 5. Also, adjustment items that are adjusted less frequently can be adjusted easily.

FIG. 3 is a rear view showing the viewfinder 6 of the television camera 1 from the cameraman side. In the television camera 1, the cameraman camera 7 is used.
The infrared illuminating device 9 is arranged on the side of the cameraman camera 7 in close proximity to, and as shown in FIG. 4, the infrared illuminating device 9 intermittently operates at a timing synchronized with the field cycle of the cameraman camera 7. Infrared rays are emitted to illuminate the cameraman 4. As a result, in the television camera 1, the face of the cameraman illuminated by the display screen of the viewfinder 6 and the face of the cameraman illuminated by infrared rays in addition to these lights are displayed through the camera 7 for the cameraman. Images can be taken alternately in the field cycle.

FIG. 5 is a block diagram showing the overall structure of the television camera 1. In this television camera 1, the field pulse FD of the cameraman camera 7 is used.
The infrared illuminating device 9 is driven on the basis of, and thereby the infrared illuminating device 9 intermittently emits infrared rays. The cameraman camera 7 is 512 pixels × 5 in this embodiment.
An image of the face of the cameraman 4 is picked up with a resolution of 12 pixels, and a video signal SV1 obtained as an interlaced image pickup result is output to the image processing unit 8 and the viewfinder (VF) 6.

The image processing unit 8 extracts a luminance signal from the video signal SV1 in an analog-digital conversion circuit (A / D) 11, and performs an analog-digital conversion process on the luminance signal to convert it into an 8-bit digital luminance signal. .
The image processing unit 8 outputs this digital luminance signal to the frame memory 12. The frame memory 12 is controlled by the central processing unit (CPU) 13 and fetches this digital luminance signal at a prescribed timing,
The imaging result of the cameraman camera 7 illuminated by the display screen of the viewfinder 6 and the imaging result of the cameraman camera 7 illuminated by infrared light in addition to this illumination are recorded. Further, the frame memory 12 is controlled by the central processing unit 13 to output the recorded imaging result at a specified timing.

The central processing unit 13 superimposes and displays a prescribed menu on the display screen of the viewfinder 6 via the television camera section 14. Further, the central processing unit 13 executes the processing procedure described later in response to the operation of the trigger switch 5 to sequentially image-process the output data of the frame memory 12, and then the personal information of the cameraman 4 registered in the memory 15. The orientation of the face of the cameraman 4 is detected with reference to. Further, the central processing unit 13 detects the menu selected by the cameraman 4 based on the detected face orientation, and outputs the control data DC to the television camera unit 14 or the viewfinder 6 according to the detection result, thereby adjusting the adjustment frequency. The television camera unit 14 and the viewfinder 6 are adjusted for the adjustment item selected by the cameraman 4 from the low adjustment items. Thus, the television camera 1 is formed so that adjustment items that are adjusted less frequently can be adjusted easily and reliably with the operating rod 3 still held.

Similarly, the central processing unit 13 sequentially processes the output data of the frame memory 12 by executing the processing procedure described later in response to the operation of the trigger switch 5, and the different images are taken by each cameraman. Correlation data between the processing result and the face orientation is detected, and this correlation data is stored in the memory 15. As a result, the television camera 1 is formed so that the adjustment items intended by the cameraman can be reliably adjusted even when the cameraman is replaced.

Further, the central processing unit 13 makes a display screen of the viewfinder 6 when the cameraman 4 operates a prescribed operator as an initial setting for adjusting various items based on the orientation of the cameraman's face in this way. The video signal S output from the camera 7 for the cameraman.
V1 is displayed on the viewfinder 6. As a result, the television camera 1 is formed so that the viewfinder 6 can confirm whether or not the entire face is imaged by the cameraman camera 7, and if necessary, the height of the tripod 2,
The tilt, magnification, focus, etc. of the cameraman's camera 7 are operated to adjust the cameraman's camera 7 so that the entire face can be imaged, and the adjustment items intended by the cameraman can be surely adjusted.

The memory 15 is controlled by the central processing unit 13 to update the contents, and stores the correlation data between the image processing result and the face direction for each cameraman. The television camera unit 14 switches the iris and the like in response to the operation of the operation element arranged on the operation rod 3, and outputs the imaging result of the object intended by the cameraman 4. At this time, the television camera unit 14 superimposes and displays a menu of adjustment items on the image pickup result displayed on the viewfinder 6 according to the control data DC output from the central processing unit 13, and switches the display. .

Further, the television camera section 14 similarly controls the control data DC output from the central processing unit 13.
The operation is switched in response to the adjustment, and thereby the corresponding signal processing circuit or the like is adjusted for the adjustment item selected by the cameraman. Further, the television camera unit 14 receives the video signal SV3 of the return image from the external camera control unit, and when the cameraman operates the return image changeover switch arranged on the operation stick 3, the video signal SV3 is replaced with the image pickup result. Is output to the viewfinder 6.

The viewfinder 6 displays the video signal SV2 output from the television camera section 14.
In the display of the video signal SV2, the viewfinder 6 changes the brightness level and the contour correction level of the display screen according to the control data DC. As a result, the viewfinder 6 outputs the control data DC from the image processing unit 8 so that adjustment can be performed for adjustment items having low adjustment frequency during shooting.

FIG. 6 is a block diagram showing the television camera section 14 in detail. In the television camera unit 14, the lens 20 collects incident light from a subject, and then decomposes the incident light into red, green, and blue incident light by a dichroic prism (not shown), and the incident light is continued by a CCD solid-state image sensor. The light is focused on the image pickup surface of the (CCD) 21. At this time, the lens 20 responds to the operation of the focus, zoom, and iris operators arranged on the operation rod 3,
Change the focus, magnification and aperture. Lens 20
When the television camera 1 is set to the autofocus operation mode by operating the cameraman 4, in response to a control signal output from the autofocus circuit (AF) 22, instead of operating the focus operator. And change the focus.

The CCD solid-state image pickup device 21 receives incident light of red, green and blue by the image pickup devices for red, green and blue, respectively, and the timing generator (TG) 2
By operating in accordance with the drive pulse output from 3, the incident light is photoelectrically converted and output. CCD at this time
The solid-state imaging device 21 switches the charge accumulation time in response to this drive pulse, and thereby switches the shutter speed.

That is, in the television camera section 14, the sync signal generation circuit 24 generates reference signals such as a horizontal sync signal and a system clock in synchronization with the return image input from the camera control unit, and these reference signals are used as respective signals. Output to the processing circuit. The timing generator 23 generates a drive signal for the CCD solid-state image sensor 21 from these reference signals and outputs it. At this time, the timing generator 23 changes the timing of the drive signal in accordance with the control data output from the system control circuit 25, thereby controlling the charge accumulation time of the CCD solid-state image sensor 21.

Subsequent correlated double sampling circuit (CDS)
26 applies the method of correlated double sampling to each CC
The output signals of the D solid-state image sensor 21 are respectively red, green, and
It is converted into a blue color signal and output.

The subsequent AGC circuit 27 amplifies each color signal output from the correlated double sampling circuit 26 with a specified gain and outputs it. At this time, the AGC circuit 27 switches the gain according to the control data output from the system control circuit 25, so that the television camera 1 can switch the gain as necessary.

The color separation circuit 28 receives the color signals output from the AGC circuit 27, extracts the high frequency components of the red and blue color signals and adds them to the green color signal, thereby improving the resolution of the luminance signal. To do.

The white balance circuit (WB) 29 corrects the signal levels of the red and blue color signals output from the color separation circuit 28 and outputs them, thereby adjusting the white balance of these color signals. In this process, the white balance circuit 29 causes the system control circuit 2
The operation is switched to the white balance adjustment mode in accordance with the control data output from No. 5, and the gain is changed so that the signal level of each color signal converges to a specified ratio, whereby the automatic white balance adjustment processing is executed. .

The gamma correction circuit (gamma) 30 corrects the gamma of each color signal by correcting the signal level of each color signal non-linearly and outputting it. In this process, the gamma correction circuit 30 switches the non-linear characteristic according to the control data output from the system control circuit 25, and thereby switches the gamma characteristic. In addition to this gamma correction processing, the gamma correction circuit 30 suppresses the signal level and outputs it when the signal level of each color signal rises above the knee point of the prescribed signal level,
Thereby, the knee process is executed. In this knee process, the gamma correction circuit 30 similarly operates the system control circuit 2
The knee point signal level and the input / output characteristic with the knee point as a boundary are switched according to the control data output from the switch 5, and the characteristics of this knee processing are switched.

The matrix circuit 31 performs a matrix calculation process on each color signal output from the gamma correction circuit 30 to generate and output a luminance signal and a color difference signal. The encoder 32 synthesizes the luminance signal and the color difference signal output from the matrix circuit 31 to synthesize the video signal SV.
4 is generated and this video signal SV4 is output to the camera control unit. Thereby, the television camera unit 14 is formed so as to be able to output the imaging result of the subject.

The autofocus circuit 22 takes in the luminance signal output from the matrix circuit 31 for a prescribed period, and inputs the luminance signal for the focus area determined by the prescribed period. Furthermore, the autofocus circuit 22 detects the captured luminance signal
The so-called hill-climbing method is applied to vary the focus of the lens 20 so that the signal level in the high frequency range is maintained at the peak value, whereby the auto-focus process is executed. At this time, the autofocus circuit 22 changes the period for taking in the luminance signal in accordance with the control data output from the system control circuit 25, thereby changing the focus area according to the intention of the cameraman 4.

The selection circuit 34 responds to the operation of the changeover switch arranged on the operation rod 3 to selectively select the video signal SV4 output from the encoder 32 and the video signal SV3 of the return image input from the camera control unit. To the viewfinder 6. Thus, in the television camera 1, the display screen of the viewfinder 6 can be switched by operating the changeover switch while holding the operation rod 3.

Further, in the initial setting state, when the prescribed operator is operated, the selection circuit 34 selectively outputs the video signal SV1 output from the cameraman camera 7, and the cameraman 4 imaged by the cameraman camera 7 is selected. Display a face image. As a result, in the television camera 1, the result of the image picked up by the cameraman camera 7 can be confirmed by the viewfinder 7.

The image synthesizing circuit 35 is the system control circuit 2.
A prescribed menu screen or adjustment screen is formed in response to the control data output from the control circuit 5, and this menu screen is superimposed on the video signal output from the selection circuit 34 and output. As a result, in the television camera 1,
A menu screen or an adjustment screen can be displayed on the display screen of the viewfinder 6 together with the imaging result or the return image as required.

The system control circuit 25 is formed by a microcomputer that controls the operation of the entire television camera section 14, and controls each corresponding signal processing circuit according to the control data DC output from the image processing section 8. Data is output, whereby the entire operation is switched according to this control data DC. That is, the system control circuit 25
Controls the shutter speed by switching the operation of the timing generator 23 according to the control data DC, and switches the operation of the autofocus circuit 22 to set the operation mode of the television camera section 14 to the autofocus mode. Further, in this autofocus mode, the system control circuit 25 outputs control data to the autofocus circuit 22 according to the control data DC to change the focus area.

Further, the system control circuit 25 switches the operation of the AGC circuit 27 in accordance with the control data DC to switch the operation, and similarly, the white balance circuit 2
Switch the operation of 9 to adjust the white balance. Further, the system control circuit 25 switches the operation of the gamma correction circuit 30 according to the control data DC, and thereby switches the gamma characteristic and the knee characteristic. This control data DC
Then, the operation of the image synthesizing circuit 35 is controlled in accordance with the above, whereby a menu screen and an adjustment screen are formed and further displayed.

Under the control of the system control circuit 25, the television camera section 14 outputs the control data DC from the central processing unit 13 of the image processing section 8 so that adjustment items and the like that are adjusted less frequently can be adjusted. Has been done.

FIG. 7 is a flowchart showing the processing procedure of the central processing unit 13 in the image processing section 8. The central processing unit 13 executes this processing procedure when a prescribed operator arranged on the operation panel of the television camera unit 14 is operated. That is, the central processing unit 13
Moves from step SP1 to step SP2, where the menu screen is displayed on the viewfinder 6 by superimposing.

Here, this menu screen is formed by displaying an adjustment mode menu and a calibration menu. When the central processing unit 13 displays this menu screen, it moves to step SP3 and waits for the operation of the trigger switch 5. When this trigger switch 5 is single-clicked, it moves to step SP4 and is designated by the adjustment mode menu. The control data output process is executed. Here, in this control data output processing, the image pickup result of the cameraman camera 7 is subjected to image processing to detect the orientation of the face, and adjustment items and adjustment contents corresponding to this orientation are selected, and corresponding control data DC is required. This is a process for outputting the corresponding data. By this processing, the television camera 1 can easily and surely adjust the adjustment item having a low adjustment frequency while holding the operation rod 3.

When the central processing unit 13 executes this control data output processing, it moves to step SP5 and waits for the operation of the trigger switch 5, and when the trigger switch 5 is single-clicked, it returns to step SP4 and again the control data output processing. To execute. As a result, the central processing unit 13 repeats the control data output process as necessary to sequentially select the menu, select final adjustment items and adjustment contents, and control data DC according to the selected adjustment items and adjustment contents. Is output.

On the other hand, in this way, the control data D
When C is output and the adjustment is completed, the central processing unit 13
Returns to step SP3 by double-clicking the trigger switch 5 in step SP5.

On the other hand, when the trigger switch 5 is double-clicked in step SP3, the central processing unit 13 moves to step SP6, executes the calibration process corresponding to the calibration menu, and then moves to step SP4. . Here, this calibration process is a process of detecting the correlation between the image processing result and the face direction that differ depending on the cameraman and storing it in the memory 15. In the television camera 1, even when the cameraman is replaced by this process. Various adjustment items can be adjusted easily and surely based on the face orientation.

FIG. 1 is a flow chart showing the control data output process. When the trigger switch 5 is single-clicked in the state where the menu screen is displayed as described above, or when the trigger switch 5 is single-clicked after executing this control data output processing, the central processing unit 13 performs this control. The data output process is executed, and the process moves from step SP10 to step SP11.

In step SP11, the central processing unit 13 displays the adjustment items and the adjustment contents on the viewfinder 6. Here, these adjustment items and the like are executed by sequentially displaying five selectable adjustment items and five adjustment contents in the horizontal direction of the display screen, as indicated by numerals 1 to 5 in FIG. Further, this display is formed in a hierarchical structure, and in response to the selection operation of the cameraman, this control data output process is repeated to sequentially switch the screens, and the adjustment items selectable by the control data DC,
It is formed so that all the adjustment contents corresponding to each adjustment item can be displayed.

The central processing unit 13 then proceeds to step SP12, where it waits for the operation of the trigger switch 5, and when the trigger switch 5 is clicked, it proceeds to step SP13 to output from the analog-digital conversion circuit 11. Digital luminance signal is stored in frame memory 12
2 fields are taken into. Then the central processing unit 1
In step 3, the process proceeds to step SP14, where the captured digital luminance signal is subjected to image processing, and the position of the nose of the cameraman 4 is detected based on the pixel of the image pickup result.

In this processing, the central processing unit 13
8 scans the imaged result stored in the frame memory 12 at a rough pitch in both upper and lower directions as indicated by arrows a and b in FIG. 8, and detects a region having a higher brightness level in both upper and lower directions. Subsequently, as shown by arrows c and d in FIG. 9, the central processing unit 13 scans the imaging result stored in the frame memory 12 from both left and right directions at a rough pitch, and detects a region having a higher brightness level than both left and right directions. To do.

That is, when the cameraman 4 is looking through the viewfinder, the tip of the nose is projected higher than the rest of the face so that the tip is kept at high brightness and the mouth,
Compared to the eyes, there is a feature that there are few individual differences in shape among photographers. As a result, in this embodiment, the face direction is detected with reference to the position of the nose, so that the face direction can be reliably detected. Further, at this time, in this embodiment, by detecting a high-brightness level region at a rough pitch from both the up and down directions and the left and right directions,
It is designed so that the position of the nose can be roughly detected in a short time.

When the high-luminance level area is detected in this way, the central processing unit 13 similarly scans the imaging result stored in the frame memory 12 at a fine pitch in both the up and down directions and the left and right directions. Then, the high brightness level portion is detected in detail.
Thus, in this embodiment, after roughly scanning to detect a high-brightness level region and then finely scanning the detected region to detect a high-brightness level region in detail, it is possible to reliably and quickly. The position of the nose can be detected.

In the rough scan and the fine scan, the central processing unit 13, as shown in FIG.
A region of high brightness level is detected by determining the signal level of the sequentially input digital brightness signals with reference to the threshold value KL having the specified brightness level stored in the memory 15. The central processing unit 13 refers to the reference shape stored in the memory 15 to determine whether or not it is a nose based on the shape and size of this high-brightness level area, and also detects the peak of the brightness level from the high-brightness level area. The nose position.

Thus, when detecting the position of the nose,
The central processing unit 13 executes subtraction processing between corresponding image data in the digital luminance signal of two fields loaded in the frame memory 12, and executes the above-mentioned nose detection processing on the imaging result which is the subtraction result.
As a result, the central processing unit 13 uses the infrared light from the imaging result of the cameraman camera 7 illuminated by the display screen of the viewfinder 6 and the imaging result of the cameraman camera 7 illuminated by infrared light in addition to this illumination. An image pickup result of the cameraman camera 7 illuminated by only the image pickup result is obtained, and the nose position is detected from the image pickup result.

That is, at a shooting site where this type of television camera 1 is used, it may be used in a dark place in a studio. In this case, the image pickup result of a cameraman illuminated only by infrared rays is subjected to image processing. If the position of the nose is detected by the camera, the position of the nose can be detected easily and reliably without hindering the camera operation. Also, at the shooting site, the face of the cameraman may be illuminated by other lighting equipment, and in this case as well, by detecting the position of the nose by image processing the imaged result of the cameraman illuminated only by infrared rays, The position of the nose can be reliably detected by effectively avoiding the influence of noise due to this type of illumination.

When the position of the nose is detected in this way, the central processing unit 13 proceeds to step SP15 and detects the orientation of the face. Here, the central processing unit 13 first detects a change in the brightness level of the imaging result from the position of the nose detected in step SP14 to the left and right sides (FIG. 10), and detects a position at which the brightness level greatly changes. Detects the contour of the face. Subsequently, the central processing unit 13
The distance from the position of the nose to the contours on the left and right sides is detected to obtain two distance data on the left and right sides, and the other distance data is divided by one of the two distance data. As a result, the central processing unit 13 normalizes the distance from the position of the nose to the contours on the left and right sides, and effectively avoids erroneous detection due to the size of the face. Subsequently, the central processing unit 13 operates the memory 1
This detection result is assigned to the correlation data stored in 5, and the orientation of the face is detected from the contour of the face based on the position of the nose.

That is, as shown in FIG. 11, according to various examination results, the left-right direction of the face viewed from the front is represented by an angle, and even this direction and the contour of the face based on the position of the nose are used as a reference. It was found that there is a correlation represented by a straight line between the distance and the distance (in this case, the normalized distance). As a result, the orientation of the face can be detected from the contour of the face based on the position of the nose, and further, from the detection result, it is possible to detect which part of the display screen of the viewfinder 6 the cameraman 4 is viewing. I knew I could do it.

In this way, the memory 15 stores the distance data from the nose to the contour of the face when the left end of the display screen is viewed as the data of the correlation line showing the relationship between the distance from the nose to the contour of the face and the direction of the face. D1, distance data D2 from the nose to the contour of the face when looking at the right end of the display screen is held for each cameraman as correlation data between the image processing result and the face direction, and the central processing unit 13 performs interpolation processing. Apply the method to assign the detected distance to the data of this correlation line,
Thereby, the orientation of the face is detected.

When the face processing is detected in this way, the central processing unit 13 moves to step SP16 and, for the adjustment item and the adjustment content displayed on the display screen of the viewfinder 6, a menu corresponding to the face direction. Select to switch the display of this menu to blinking. Subsequently, the central processing unit 13 moves to step SP17,
If this blinking menu is a menu that indicates the contents of direct adjustment, that is, the auto focus mode on / off menu, shutter speed selection menu, white balance adjustment on / off menu, switching
In the case of a menu for selecting gamma characteristics, knee characteristics, a menu for selecting a focus area, a menu for selecting the brightness level of the viewfinder 6, etc., when the cameraman 4 clicks the trigger switch 5, the corresponding control data DC is displayed on the TV. After the output to the John camera unit 14, the process proceeds to step SP18, and this processing procedure ends.

As a result, the central processing unit 13 outputs the control data DC corresponding to the adjustment item and the adjustment content selected by the cameraman 4 by changing the face direction. Note that, for example, in the case of a menu for turning on / off the electronic shutter, a lower layer adjustment item defined in a hierarchical structure, and a menu for selecting the adjustment content, the central processing unit 13 terminates the control data output processing, and then the above-described FIG. Step SP5
When the trigger switch 5 is single-clicked in, the control data output process is repeated, and the menu of the lower layer that follows is displayed. As a result, the central processing unit 13 repeats this control data output processing to sequentially select the menu, and regarding the final adjustment content,
The control data DC is output in step SP17.

On the other hand, FIG. 12 is a flowchart showing the calibration process. When the trigger switch 5 is double-clicked in the state where the menu screen is displayed as described above, the central processing unit 13 executes this calibration processing, and moves from step SP20 to step SP21. In this step SP21, the central processing unit 13 has the left end of the display screen of the viewfinder 6 (at the position indicated by numeral 1 in FIG. 3).
The prescribed marker is displayed on.

The central processing unit 13 then proceeds to step SP22, where it waits for the operation of the trigger switch 5, and when the trigger switch 5 is clicked, it proceeds to step SP23 to output from the analog-digital conversion circuit 11. Digital luminance signal is stored in frame memory 12
2 fields are taken into.

Subsequently, the central processing unit 13 proceeds to step SP24 to image-process the digital luminance signal thus taken in to detect the face orientation. Here, this face orientation detection processing is performed from the above-mentioned steps SP14 to SP.
The central processing unit 13 detects the distance from the nose to the contour of the face when the cameraman 4 selects the menu at the left end of the display screen by this processing.

Subsequently, the central processing unit 13 switches the display screen of the viewfinder 6 and displays a prescribed marker at the right end of this display screen (at the position indicated by numeral 5 in FIG. 3).

The central processing unit 13 then proceeds to step SP26, where it waits for the operation of the trigger switch 5, and when the trigger switch 5 is clicked, the digital luminance signal output from the analog-digital conversion circuit 11 is sent to the frame memory. 2 fields are taken into 12.

Subsequently, the central processing unit 13 proceeds to step SP27 to image-process the digital luminance signal thus taken in to detect the face orientation. Here, this face orientation detection processing is performed from the above-mentioned steps SP14 to SP.
It is formed by the same processing as the processing up to 15, and the central processing unit 13 detects the distance from the nose to the contour of the face when the cameraman 4 selects the menu at the right end of the display screen by this processing.

By these processes, the central processing unit 13
Detects the distance from the nose to the contour of the face when the cameraman 4 selects the menu at the left end and the right end of the display screen, and updates the correlation data in the memory 15 with the detection result. Here, this correlation data update processing is repeated calibration processing by correcting the correlation data stored in the memory 15 up to that point on the basis of the distance from the nose to the contour of the face detected by the above-described processing. Is executed by superimposing the calibration results on each other, and a so-called learning method is applied to generate highly accurate personal information.

Specifically, the correlation defined by the straight line described above with reference to FIG.

[Equation 1] It is represented by the relationship. Here, θ represents the orientation of the face, x represents the distance from the nose to the contour of the face which is normalized, and a and b represent constants.

The central processing unit 13 averages the distance data D1 and D2 stored in the memory 15 and the detected distance from the nose to the contour of the face to update the contents of the memory 15 by the following equation. As shown, the linear correlation represented by this equation (1) is corrected.

(Equation 2) Here, θOLD and xOLD are the direction data of the face and the distance from the nose to the contour of the face corresponding to the distance data D1 and D2 stored in the memory 15, and θNEW and xNEW are the distance data detected in this calibration process. The direction of the face corresponding to D1 and D2 and the distance from the nose to the contour of the face are shown. As a result, in the television camera 1,
The desired adjustment processing can be surely executed.

Subsequently, the central processing unit 13 shifts to step SP28 to sequentially change the threshold value KL with respect to the digital luminance signal stored in the frame memory 12 and execute the processing of step SP14 described above. A threshold value K capable of detecting a nose shape most similar to the reference nose shape stored in 15.
L is detected. The central processing unit 13 uses the detected threshold value KL to store the threshold value KL stored in the memory 15.
To update.

After executing these processes, the central processing unit 13 displays a message to the effect that the calibration process has been completed on the display screen of the viewfinder 6 for a specified time in step SP29, and then executes step SP3.
Moving to 0, this processing procedure is completed. As a result, the television camera 1 can surely execute the adjustment process intended by the cameraman even when the cameraman is replaced.

In the above-described structure, the television camera 1 (FIG. 2) monitors the image pickup result displayed on the viewfinder 6 and grasps the operating rod 3 to change the direction, thereby changing the movement of the subject. It traces and outputs the imaging result of this subject. Further, the television camera 1 changes the magnification, focus, and diaphragm (FIG. 6) of the lens 20 when the zoom, focus, and iris operators arranged on the operation rod 3 that are frequently operated are operated. ,
As a result, the imaging result is output following the change of the subject. Similarly, when the return image changeover switch frequently arranged on the operation rod 3 is operated, the video signal SV4 which is the image pickup result is changed to the video signal SV3 of the return image output from the camera control unit. Is displayed on the viewfinder 6 to display an on-air image.

On the other hand, when the cameraman 4 operates the prescribed operator, a menu screen is displayed on the viewfinder 6, and in this state, when the cameraman 4 single-clicks the trigger switch 5 arranged on the operation rod 3, The central processing unit 13 executes control data output processing.

In this process, the television camera 1
Is a face of the cameraman illuminated by the display screen of the viewfinder 6 and the like, and in addition to these illuminations, infrared light from the infrared illumination device 9 is illuminated while the prescribed menu is displayed on the display screen of the viewfinder 6. The cameraman's face is alternately imaged in one field cycle by the cameraman camera 7, and the imaging result is subtracted to detect the imaging result of the face of the cameraman 4 illuminated by only infrared rays. As a result, the television camera 1 effectively avoids the influence of noise and effectively avoids the disturbance of the camera operation, and executes the control data output process.

Further, the television camera 1 has a memory 1
After referring to the threshold value KL stored in FIG. 5 (FIG. 10), the imaging result illuminated by only the infrared rays is roughly scanned from the upper and lower sides and the left and right sides to detect a high brightness level portion, and then this detection is performed. Similarly, the above portion is finely scanned to detect a high brightness level region, and the position of the nose is detected from the shape of this region. As a result, the television camera 1 detects the position of the nose easily and in a short time.

Further, the television camera 1 detects the position where the brightness level changes abruptly on the left and right sides from the detected position of the nose, thereby detecting the contours on both sides of the face. Further, the television camera 1 normalizes the distance from the nose to the contour and refers to the correlation data (FIG. 11) registered in the memory 15. Thereby, the television camera 1 detects the orientation of the face of the cameraman 4, and detects the menu corresponding to this orientation of the face.

Further, the television camera 1 outputs the control data DC corresponding to this menu to the television camera section 14, thereby adjusting each adjustment content corresponding to this menu. That is, the television camera 1
The operation of the timing generator 23 is switched to change the shutter speed, and the operation of the autofocus circuit 22 is switched to set the operation mode of the television camera unit 14 to the autofocus mode. Further, in this autofocus mode, the focus area is changed according to the orientation of the cameraman's face.

Similarly, the operations of the AGC circuit 27 and the gamma correction circuit 30 are switched to switch between the genie, gamma characteristic, and knee characteristics, and the operation of the white balance circuit 29 is switched to perform automatic white balance adjustment. Further, regarding the viewfinder 6, the brightness level of the display screen and the contour correction are adjusted.

As a result, in the television camera 1, with a simple operation of changing the face direction and clicking the trigger switch 5 while the operation rod 3 is being held, so-called adjustment items with low adjustment frequency are called. It can be adjusted easily and reliably in a hands-free state.

On the other hand, in the television camera 1, when the cameraman 4 operates the prescribed operator and then double-clicks the trigger switch 5 arranged on the operation rod 3, the central processing unit 13 executes the calibration processing. To do.

In the calibration process, the television camera 1 sequentially displays markers on the left and right ends of the display screen of the viewfinder 6, and the cameraman camera 7 images the face of the cameraman 4 who sees the markers. Furthermore, an imaging result illuminated by only infrared rays is generated from the imaging result, and after detecting the position of the nose from the imaging result, the distances from the position of the nose to the contours on both sides of the face are detected. This allows the television camera 1
Is the distance from the nose to the contours on both sides of the face when the markers displayed at the left and right ends of the view screen of the viewfinder 6 are visually detected, and the correlation data of each cameraman 4 stored in the memory 15 based on the detection result. To update. This allows the television camera 1 to reliably detect the menu selected by the cameraman.

Further, at this time, the television camera 1
A so-called learning method is applied to update the correlation data so that the menu selected by the cameraman can be reliably detected.

According to the above configuration, the viewfinder 6
With various menus displayed on the screen, the cameraman's camera 7 images the face of the cameraman from almost the front, and the image processing result is subjected to image processing to detect the direction of the face. John camera section 1
4. By switching and adjusting the operation of the viewfinder 6, it is possible to easily and surely adjust in a so-called hands-free state. As a result, it is possible to easily and surely adjust even adjustment items that are adjusted less frequently without disturbing the smooth movement and balance of the camera.

Further, at this time, the position of the nose is detected, and the distance from this nose to the left and right contours of the face is detected.
By detecting the orientation of the face according to the correlation data of each cameraman stored in, various adjustment items can be adjusted easily and reliably even when the cameraman is replaced.

Further, this correlation data is detected by a calibration process by detecting and updating the distance from the nose to the left and right contours of the face, which corresponds to the marker displayed on the viewfinder 6, and a so-called learning method is used. By applying and updating the correlation data, it is possible to reliably detect the menu selected by the cameraman.

Further, in the image pickup result of the face of the cameraman, which is the premise of these processes, the infrared illuminator 9 is intermittently driven and the image pickup result illuminated by the display screen of the viewfinder 6 and these illuminations. In addition to the above, the image pickup result illuminated by infrared rays from the infrared illuminating device 9 is subtracted to obtain an image pickup result illuminated by only infrared rays, and the image pickup result is processed to thereby reduce the influence of noise due to external light. The desired adjustment item can be adjusted surely by avoiding effectively and obstructing the camera operation effectively.

In the above embodiment, the case where the image pickup result is subjected to image processing to detect the face direction is described. However, the present invention is not limited to this, and the focus position is detected to detect the face direction. It may be detected. In this case, a cameraman camera having an autofocus function is applied, and the autofocus function focuses on the center of the face. In this state, for example, the nose position is detected in the same manner as in the above-described embodiment, and the nose position is focused on the basis of the high frequency component of the luminance signal. Further, after recording the focus position, the focus is gradually shifted from the nose position, and similarly, the high frequency component of the luminance signal is used as a reference to sequentially focus on both sides of the nose and both cheeks. As a result, the distances from the focus position of the nose recorded to the focus positions of both cheeks obtained previously are obtained, and the orientation of the face is detected from the subtraction result of this distance. Even if the orientation of the face is detected in this way, the same effect as that of the above-described embodiment can be obtained.

Alternatively, the orientation of the face may be detected by applying a so-called stereoscopic technique. In this case, for example, two television cameras are arranged in the direction of the face to be detected, and these two television cameras stereoscopically view the cameraman's face. Furthermore, from the image pickup results obtained by these two television cameras, characteristic parts of the face common to the two image pickup results, such as eyes,
The nose, mouth, etc. are collated, and the direction of the face is detected by detecting the parallax from the amount of shift between the two image pickup results. Even with this method, the same effect as that of the above-described embodiment can be obtained.

Further, in the above-mentioned embodiment, when the cameraman operates the trigger switch, the case where the face direction is detected and the control data is output correspondingly is described, but the present invention is not limited to this. Instead, for example, when the focus area is changed, the face direction may be always detected and the control data may be output.

In the above embodiment, the case where the control data is output when the camera operator operates the trigger switch has been described. However, the present invention is not limited to this, and for example, the camera operator opens his mouth depending on the image processing result. The control data may be output by detecting a case such as a case.

Further, in the above-described embodiment, the case where the image pickup result by the illumination of only infrared rays is detected by taking in the image pickup result at the 1/60 second cycle to subtract between the even field and the odd field has been described. However, the present invention is not limited to this, and for example, the infrared illuminating device may be intermittently driven at a cycle of 1/30 second, and subtraction between frames may be performed to detect an imaging result by illumination of only infrared rays.

In the above embodiment, the case where the orientation of the face is detected in the lateral direction has been described. However, the present invention is not limited to this, and when the orientation is detected and adjusted in the vertical direction, the lateral direction is further detected. It can be widely applied to the case of detecting and adjusting the direction of the face both in the vertical direction and in the vertical direction.

[0100]

As described above, according to the present invention, the orientation of the face of the cameraman is detected based on the image pickup result of the image pickup means for the cameraman, and the adjustment item corresponding to the detected face orientation is adjusted. In the so-called hands-free state, various adjustment items can be adjusted easily and reliably. As a result, it is possible to easily and surely adjust even adjustment items that are infrequently adjusted without disturbing the smooth movement of the camera and without disturbing the balance.

[Brief description of the drawings]

FIG. 1 is a flowchart for explaining the operation of an image processing unit according to an embodiment of the present invention.

FIG. 2 is a side view showing a television camera to which the image processing section of FIG. 1 is applied.

FIG. 3 is a rear view showing the periphery of a viewfinder of the television camera shown in FIG.

FIG. 4 is a signal waveform diagram for explaining the operation of the infrared lighting device of FIG.

5 is a block diagram showing an overall configuration of the television camera of FIG.

6 is a block diagram showing the television camera unit of FIG.

FIG. 7 is a flowchart showing the entire processing procedure of FIG.

FIG. 8 is a schematic diagram for explaining a nose search.

FIG. 9 is a schematic diagram showing a case where the scan direction is switched following the processing of FIG.

FIG. 10 is a characteristic curve diagram used for explaining nose and face contour detection.

FIG. 11 is a characteristic curve diagram showing the relationship between the distance from the nose to the contour of the face and the direction of the face.

FIG. 12 is a flowchart for explaining the calibration process of FIG. 7.

[Explanation of symbols]

 1 television camera 2 tripod 3 operating rod 5 trigger switch 6 viewfinder 7 cameraman's camera 8 image processing unit 9 infrared illumination device 12 frame memory 13 central processing unit 14 television camera unit 15 memory

Claims (5)

[Claims] 1. An image pickup apparatus for picking up an image of a desired subject and outputting the image pickup result of the subject, and a display unit for displaying a menu screen in which adjustment items are sequentially arranged together with the image pickup result of the subject; A cameraman image pickup means for picking up an image of a cameraman's face observing the display screen, and based on an image pickup result of the cameraman image pickup means, detects the orientation of the cameraman's face, and displays the menu screen corresponding to the face direction. An image pickup apparatus, comprising: a menu detection unit that detects arranged adjustment items; and performing an adjustment operation on the adjustment items detected by the menu detection unit. 2. The menu detecting means detects the orientation of the cameraman's face by image-processing the imaged result of the cameraman output from the cameraman's imaging means. Imaging device. 3. The menu detecting means detects the orientation of the cameraman's face on the basis of an imaging result obtained by changing the focus of the cameraman's imaging means. Imaging device. 4. The cameraman image pickup means is formed by a plurality of image pickup devices which are arranged apart from each other and output an image pickup result obtained by stereoscopically viewing the face of the cameraman, and the menu detection means is a plurality of image pickup means. The image pickup apparatus according to claim 1, wherein a characteristic portion of a face is collated between image pickup results obtained from the apparatus to detect the direction of the face. 5. The image pickup device includes an illumination unit that emits infrared rays intermittently in synchronization with the operation of the image pickup unit for the cameraman to illuminate the cameraman with the infrared rays, and the menu detection unit includes: An image processing is performed on a comparison result between an image pickup result of the cameraman illuminated by infrared rays and an image pickup result of the cameraman not illuminated by the infrared rays, and the orientation of the face of the cameraman is detected. The imaging device according to 1.