JP2010028501A - Television camera system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a television camera system capable of calculating the direction of an image capturing camera which is going to subsequently capture an image from an image obtained by a television camera, and presenting the calculated direction to a subject of photographing. <P>SOLUTION: The television camera system 200 has: a plurality of television cameras 103-105 each for capturing images of a subject of photographing; position detecting sensors 103c-105c and auxiliary display devices 103b-105b attached to the television cameras respectively; a switcher 208 for switching the television cameras 103-105; and an image processing apparatus 211. In the television camera system, when the television camera is switched by the switcher 208, the image processing apparatus 211 detects the face of the subject of photographing to determine the direction of visual line of the subject of photographing, and causes the auxiliary display devices 103b-105b to display the direction of the switched television camera viewed from the television camera positioned in the direction of the visual line. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a television camera system.

When recording in the studio, a device to inform the photographer, such as an announcer, that the image of the photographer himself is on air, and a device to inform which television camera the film is being shot Has been made. Conventionally, a human assistant or the like has given instructions to the subject in order to obtain the subject's view of the camera. Thus, when a human gives an instruction, the direction of the television camera being photographed is mistakenly designated, and the photographed person cannot smoothly focus on the camera being photographed. There was a problem that the person who issued the instruction was reflected in the image on the air. In view of this, a device has been devised to provide a device that reliably informs the subject to be photographed with a simple method of alerting the subject to be photographed (see, for example, Patent Document 1).
JP 2004-044488 A

  However, since the conventional method always involves manpower, there has been a problem that it is necessary to master the instruction operation to the photographed person in order to respond to the occasion.

  The present invention has been made in view of such a problem, and based on images obtained from a plurality of television cameras, the subject's eyes are quickly directed toward the television camera to be photographed next. An object of the present invention is to provide a television camera system capable of displaying an instruction for assisting the user so that the user can perform the operation.

  In order to solve the above problems, a television camera system according to the present invention includes a plurality of television cameras for photographing a person to be photographed, and the plurality of television cameras, and each of the plurality of television cameras. A position detection sensor for detecting a position, a display unit that is attached to a plurality of television cameras, displays a television camera to be photographed next among the plurality of television cameras, and presents it to the subject; It comprises a switcher that selects and switches one of the television cameras, and an image processing device that controls display on the display unit. Then, the image processing device uses an image captured by each of the television cameras when the switcher switches from any one of the plurality of television cameras to one of the remaining television cameras. The face of the subject is detected by detecting the face of the subject, the position of each of the plurality of television cameras is acquired from the position detection sensor, and the direction of the eye is located based on the position. The direction of the switched television camera viewed from the television camera is calculated, and the calculated direction of the switched television camera is displayed on the display unit of the television camera located in the direction of the line of sight Is done.

  Such a television camera system has an image detection parameter storage unit that stores image data including the faces of a plurality of subjects, and the image processing apparatus detects a subject to be detected detected from an image captured by the television camera. It is determined whether or not the person's face matches any of the plurality of image data stored in the image detection parameter storage unit, and if they match, the direction of the switched television camera is displayed on the display unit. Preferably it is comprised.

  In such a television camera system, the image processing apparatus designates one image data from a plurality of image data stored in the image detection parameter storage unit, and takes an image that matches the designated image data. When the person's face is included in an image photographed by the television camera, the direction of the television camera switched to the display unit is preferably displayed.

  When the television camera system according to the present invention is configured as described above, for example, when a subject such as a performer in a recording in a studio is gazing at a television camera that is not currently photographed, the current photographing is performed. By displaying the direction of the television camera being displayed on the display unit and presenting it to the person to be imaged, it is possible to assist the person to be photographed in quickly recognizing the television camera, and it is easy to obtain the camera eye of the person to be photographed can do.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. First, the configuration of the television camera system 200 according to the present embodiment will be described with reference to FIGS. In the present embodiment, the television camera system 200 will be described as a system configuration used for a television camera in a studio (hereinafter, also simply referred to as a camera in the drawings). First, as shown in FIG. 1, a plurality of television cameras are installed in the studio (here, an example in which three standard television cameras are installed) is shown. The photographers 101 and 102 are photographed by the three television cameras 103 to 105. Each of the three television cameras includes a television camera A103, a television camera B104, and a television camera C105, which are separated from each other by a certain distance in the studio. 102 is arranged at a position where it is easy to photograph. Each of the television camera A103 to the television camera C105 includes position detection sensors 103c to 105c that determine a predetermined position in the studio as an origin and detect the position from the origin as an absolute position. The positions detected by the position detection sensors 103c to 105c are notified to a system control unit described later. For example, each of the pedestals of the television camera A103 to the television camera C105 has a built-in rotary encoder as the position detection sensors 103c to 105c, and stores a predetermined position in the studio as the origin and stores it as the initial position. The absolute positions of the television camera A103 to the television camera C105 can be detected by managing the positions of the television camera A103 to the television camera C105 with X and Y coordinates when viewed from the ceiling. Yes. Then, the absolute positions of the television cameras A103 to C105 detected in this way are notified to a system control unit described later.

  In the television camera system 200 shown in FIG. 2, the CCU input A202, the CCU input B203, and the CCU input C204 are connected to the television camera A103 to the television camera C105 of FIG. A CCU input B203 and a CCU input C204 are video outputs of the television camera A103 to the television camera C105. Each of the CCU input A202 to CCU input C204 is connected to a CCU (camera control unit) 205, 206, and 207, and performs various correction processes on the RGB signals from the television camera A103 to the television camera C105. And a function for remotely adjusting the camera head end.

  The switcher 208 is for performing the production of the program by sequentially switching the images taken by the television camera A103 to the television camera C105 by the operation of the operator. The switcher output 209, which is an output signal from the switcher 208, is a video program output signal of an image in which the director puts an effect on the image or performs camera switching, and image processing is performed simultaneously with connection to a device such as a VTR. It is configured to be output also to the device 211.

  The tally output 210 is output to the image processing apparatus 211 as a signal indicating the video system currently selected by the switcher 208. The image processing apparatus 211 performs image processing on the video signals obtained from the outputs of the CCUs 205 to CU207, detects the face of the subject, and uses the television camera used immediately before and the next television to be used. The relative position with respect to the John camera is calculated, and the calculation result is used as the tally control signal 214 to the tally lamps 103a to 105a and the auxiliary display devices 103b to 105b which are display units attached to the television camera A103 to the television camera C105. It is configured to output.

  The control panel 212 can operate the image processing device 211 to allow or disable the tally lamp to be turned on and off as necessary, and the auxiliary table for each of the television cameras A103 to C105. It is prepared for manually operating the devices 103b to 105b. The operation monitor 213 is configured to display information such as the operation result of the control panel 212 and the current state of the image processing apparatus 211.

  The image processing unit 211 in the television camera system 200 has a configuration as shown in FIG. 3, and a video (also referred to as an image) taken by the television camera A103 to the television camera C105 shown in FIG. Are input to the A camera video input processing unit 411, the B camera video input processing unit 412, and the C camera video input processing unit 413 as video input signals 401, 402, and 403, respectively. The program output video input processing unit 414 receives a program and a video output signal 404 from each device. The A camera video input processing unit 411, the B camera video input processing unit 412, the C camera video input processing unit 413, and the program output video input processing unit 414 convert the video signal into a format suitable for each processing described later. It is configured. For example, in the case of an analog video input signal, it is digitally encoded by A / D conversion or the like and converted into a format suitable for a data format in subsequent processing.

  The A camera face detection unit 421, the B camera face detection unit 422, the C camera face detection unit 423, and the program output face detection unit 424 each perform face detection processing to be described later, and the A camera image located on the preprocessing side A process for detecting information of video signals input from the input processing unit 411, the B camera video input processing unit 412, the C camera video input processing unit 413, and the program output video input processing unit 414 is performed. Here, many methods have been proposed as a method of performing image processing and detecting a face from an image. In the present embodiment, although not particularly limited, for example, as shown in FIG. Parameters for face detection are stored in the image detection parameter storage unit 425 for storing the parameters, and the other parameter storage unit 435 for storing other parameter tables. The face can be detected from the image by a predetermined detection processing method with reference to this parameter by the processing performed by the unit.

  4 and 5 show the contents of a parameter table for showing an example of a face detection method, and the image detection parameter table 425 has its contents corresponding to each data name in the data name column 425a. Is stored in the content column 425b. The content column 425b includes, for example, the number of detected human faces (the number of detected faces), and rectangle diagonal coordinates (detected X position (1)) indicating the position of each person's face in the detected image. , Detection Y position (1), etc.), information indicating whether the line of sight is in the imaging direction (presence / absence of “detection of the camera” of the detected face), presence / absence of presence / absence detection of a registered person (presence / absence of registrant) ing. Corresponding to these, information on the data type corresponding to each content is stored in the type column 425c. Further, the other parameter table 435 stores data indicating parameters set at the time of installation of the system and values reflecting changes due to camera switching, and includes a parameter name column 435a and a set value column. 435b and a data type column 435c.

  The system control unit 415 controls the entire television camera system 200. The switcher selection tally input signal 405, the video input processing units 411 to 414, the face detection units 421 to 424, camera tally output / auxiliary display output control. Unit 426, operation monitor control unit 416, and operation panel I / F 406 are controlled. The switcher selection tally input signal 405 is configured to obtain a tally output corresponding to the input program selected by the switcher 208. The camera tally output / auxiliary display output control unit 426 performs bypass display from the switcher selection tally input signal 405 and auxiliary display output according to the contents determined by the system control unit 415, and performs television camera A103, television It is configured to obtain tally output / auxiliary display output signals 407, 417, and 427 to each of the camera B104 and the television camera C105. In addition, based on the tally output / auxiliary display output signals 407, 417, and 427, the displays of the auxiliary display devices 103b to 105b (see FIG. 8) provided in each of the television camera A103, the television camera B104, and the television camera C105 are displayed. Although the display of the auxiliary display devices 103b to 105b is changed based on the result detected for each frame, the display is frequently changed, and the assist display that appears as visual flicker is changed. Since it becomes an unstable state, it is set so as to be insensitive to a period change of a certain time or less and to output the previous state. The operation monitor control unit 416 is configured to control a display operated by the operator. On the display, the status of the currently tracked face and the status of each camera are displayed, and processing such as on / off of the tracking mode and registration of the tracking target person are performed interactively, and the operation monitor output 437 It is output to the display as a video signal. Further, the operation panel interface 406 is an operation switch group corresponding to an interactive operation with the operation monitor control unit 416.

  As the signals input to the system control unit 415, position information detected by position detection sensors 103a to 105a such as rotary encoders mounted on the television camera A103, the television camera B104, and the television camera C105, respectively. Are position input signals 441, 442, and 443. Here, the initial positions of the television camera A103 to the television camera C105 are separately adjusted on the television camera side, and the system control unit 415 determines the positions of the television camera A103 to the television camera C105 in the studio. The absolute position from the set origin is always held.

  The configuration of the television camera system 200 according to the present embodiment is as described above. Next, the processing procedure in the television camera system 200 will be described with reference to FIGS. This will be described with reference to FIGS.

(Image capture system processing)
6 and 7 are flowcharts showing a processing procedure in the television camera system 200. When the television camera system 200 is started, initialization is performed in step S100. That is, the system control unit 415 of the image processing apparatus 211 performs initial settings necessary for system operation. Next, in step S101, it is confirmed whether a video signal exists. In other words, the system control unit 415 determines whether or not photographing of the photographed persons 101 and 102 (see FIG. 1) is currently started by the television camera A103 to the television camera C105. If an abnormality such as the absence of an input video signal is detected in step S101, an error notification is given in step S102, and an error is displayed on the operation monitor 213 via the operation monitor control unit 416. On the other hand, if it is determined that a video signal is input, the process proceeds to step S103, and the statuses of the currently selected television camera A103 to television camera C105 are set as the tally output signal 210 via the switcher 208. The image is output to the image processing apparatus 211. For example, FIG. 8 shows tally lamps 103a to 105a and auxiliary display devices 103b to 105b included in the television cameras A103 to C105. Here, the tally lamp 103a of the television camera A103 is lit, indicating that the television camera selected by the switcher 208 is the television camera A103. Here, the contents acquired by the system control unit 415 of the image processing apparatus 211 are the current number of cameras, the position of the cameras, and the state of the tally signal selected by the switcher 208.

  In step S104, face detection processing (see FIG. 12) described later is performed. This face detection process is a process for detecting the face of a person from the images of the respective cameras, and is configured to simultaneously process the images of the photographed person taken by the respective television cameras 103 to 105. That is, as described above, the image processing unit 211 uses the video input processing units 411 to 413 to which the images from the television camera A103 to the television camera C105 are input, and the input signals of the images. The face detection units 421 to 423 that perform face detection can simultaneously perform face detection processing. In step S105, it is determined whether or not a person's face has been detected. If detected, the process proceeds to the next step S106 to acquire the feature amount of the detected face. On the other hand, if a human face is not detected, an undetected timer process described later is performed in step S115 (FIG. 14). When the facial feature amount detected in step S106 is acquired, the image detection parameter table 425 in FIG. 4 is referred to, and the face position is determined from the feature amount. Therefore, the process proceeds to the next step S107, and the operation monitor 213 is displayed. Displays the face position. In step S108, the image detection parameter table 425 shown in FIG. 4 is referred to, and it is determined whether the detected face is data of a registered person.

  If it is determined in step S108 that the data does not match the registered person data, that is, if the person is not registered, the process proceeds to step S112, and the operator detects the detected face person via the operation monitor 213. If it is determined whether or not the registration of the detected person is instructed, the process proceeds to step S113. In step S113, as will be described later, a process of selecting an arbitrary detected person is performed (see FIG. 13). In step S114, the selected face information is registered, the process returns to step S101, and the above-described processing is continued. The face information registered in step S114 is registered in the image detection parameter storage unit (image detection parameter table) 425, and the registered person's face data can be used thereafter. As described above, since the face information of an arbitrary person can be registered, the image capturing system 200 can easily cope with changes in the subjects 101 and 102.

  If it is determined in step S112 that the operator has not instructed registration of the detected face person via the operation monitor 213, as described above, in step S105, the face of the person If it is determined that the undetected timer is not detected, the process proceeds to step S115 to perform a process of undetected timer processing described later, and then proceeds to step S116 to determine whether the undetected timer is 0 or not. Return to step S101. Here, when the registration is not instructed in step 112, the process proceeds to step S115, and the undetected timer process is performed. If the registration process is not instructed in step S112, the undetected period is up to a certain time. Is for maintaining the states of the auxiliary display devices 103b to 105b. This is executed for the purpose of reducing factors that cause confusion for the person to be photographed because the person to be photographed will be confused if the state of the auxiliary display devices 103b to 105b frequently changes. Is. An undetected timer is used to count the undetected standby time. An outline of processing of the undetected timer will be described later. Then, the undetected timer process is started, the undetected timer confirmation process is performed, and when the undetected timer reaches 0 (step S116), the process proceeds to step S117 to clear the states of the auxiliary display devices 103b to 105b, In step S118, the display states of the auxiliary display devices 103b to 105b are updated, and the process returns to step S101.

  On the other hand, if the data matches the registered person data in step S108, that is, if the detected face is a registered person, the process proceeds to step S109. In step S109, it is determined whether or not the detected person's face is facing the selected television camera, here the television camera A103 (see FIG. 8). That is, here, it is determined whether or not the eye of the person whose face is detected is directed to the selected camera. If it is determined that the line of sight is not directed to the selected camera, the process proceeds to step S110, the state of the auxiliary display devices 103b to 105b is cleared, and the display state of the auxiliary display devices 103b to 105b is changed in step S111. Update. That is, the assist display on the auxiliary display devices 103b to 105b is stopped. Here, the assist display of the auxiliary display devices 103b to 105b is, for example, a direction display such as an arrow displayed on the auxiliary display device 103b of the television camera A103 as shown in FIG. This direction indication is the position where the television camera C105 is arranged from the position of the previously selected television camera A103 when the tally lamp 105a of the television camera C105 to be selected next is lit. It is displayed to indicate the direction. When the display state of the auxiliary display devices 103b to 105b is updated in step S111, the process returns to step S101 and the above processing is continued.

  On the other hand, in step S109 described above, the face of the person detected is not suitable for the selected television camera (here, the television camera A103 (see FIG. 8)), that is, the selected television. If it is detected that the line of sight of the subjects 101 and 102 is not directed to the camera, the process proceeds to step S119 in FIG. In step S119, it is determined whether there is a camera selected immediately before. That is, the system control unit 415 confirms whether there is a television camera selected by the switcher 208 immediately before. If it is determined that the camera selected immediately before is present, the process advances to step S120 to determine whether the camera is suitable for the television camera selected immediately before, that is, the television selected immediately before. It is determined whether or not the eyes of the subjects 101 and 102 are still facing the video from the camera.

  If it is determined in step S120 that the photographed persons 101 and 102 are suitable for the television camera selected immediately before, the process proceeds to step S123, and the target person (photographed persons 101 and 102) is directed to the television. The calculation process of the relative position between the John camera and the selected camera is performed (see FIG. 15). Although a specific processing method will be described later, here, the direction of the television camera currently selected by the switcher 208 is calculated for the television camera facing the target person. In calculating this direction, position detection sensors 103c to 105c such as rotary encoders provided in the pedestal portions of the television cameras A103 to C105 have a predetermined position set in the studio as an origin. The result of detecting the position of each television camera is used. Then, the television camera A103 to the television camera C105 can display the direction of the position where another television camera is arranged from its own position. The management of these arrangements and the result of the position detection sensor are managed by the system control unit 415. Then, the system control unit 415 can obtain the relative position between the television camera facing the target person and the selected camera based on the position information of each of the television cameras 103 to 105 by calculation. ing. Then, the process proceeds to step S124, the display on the auxiliary display devices 103b to 105b and the display on the operation monitor 213 are updated, the process returns to step S101, and the above-described processes are performed.

  On the other hand, when it is determined in step S119 that the television camera selected immediately before does not exist, and in step S120, the face of the subject (the subjects 101 and 102) is displayed on the television camera selected immediately before. If it is determined that it is not suitable, the process proceeds to step S121. In step S121, it is determined whether or not the face of the target person (photographed person 101 or 102) is facing another television camera. That is, it is detected whether or not the faces of the subjects 101 and 102 are displayed in an image from a camera other than the television camera selected by the switcher 208. As described above, image data signals from the television cameras 103 to 105 are input to the camera face detection units 421 to 423 and processed. Since these are performed at the same time, the determination in step S121 can be easily determined automatically from each image.

  If it is determined that the face is facing the other television camera, the process proceeds to step S122 to determine whether or not the tracking mode is set. In the tracking mode, information on television cameras that are sequentially photographed is displayed on the subjects 101 and 102 to be tracked, and the on-air images of the subjects 101 and 102 are photographed. It is to make it match with a television camera. Therefore, if it is in the tracking mode, the process proceeds to step S123, and the relative position between the camera facing the subjects 101 and 102 and the television camera selected by the switcher 218 is calculated. The state of the auxiliary device of the camera in which the lines of sight 101 and 102 are detected and the display on the operation monitor are updated (step S124). For example, as shown in FIG. 9, assuming that the person to be photographed 101, 102 who is the tracking target is facing the television camera A103, and the television camera selected by the switcher 218 is the television camera C105. Will be explained. The tally lamp 105a of the television camera C105 selected by the switcher 218 is turned on, and an arrow is displayed on the auxiliary display device 103b of the television camera A103. At this time, the arrow of the auxiliary display device 103b is set to indicate the direction of the television camera C105. In this way, the subjects 101 and 102 can easily grasp the position of the television camera C105 to be lined up according to the display of the auxiliary display device 103b. At this time, since the tally lamp 104a of the television camera B104 in the same direction is not lit, the subjects 101 and 102 can smoothly capture the television camera C105.

  On the other hand, if it is determined in step S122 that the mode is not the tracking mode, the process proceeds to step S124, and the auxiliary display is not displayed in particular, and the faces of the subjects 101 and 102 are simply displayed on the other television cameras. The display on the operation monitor 213 is updated so as to indicate only that it has been detected.

  On the other hand, if it is determined in step S121 that the subjects 101 and 102 are not suitable for other television cameras, the process proceeds to step S125. In other words, as a result of analyzing the images captured by the television cameras 103 to 105, the faces of the subjects 101 and 102 as the subjects cannot be obtained. In step S125, as in step S122, it is determined whether or not the tracking mode is set. If not in the tracking mode, the process proceeds to step S124 described above. If it is in the tracking mode, the process proceeds to step S126, and a process for selecting an arbitrary detected person is executed. The process of step S126 is the same as that of step S113 described above, and details will be described later as a process for selecting an arbitrary detected person (see FIG. 13). In step S127, the selected face information is registered, the face position is displayed on the operation monitor 213 in step S128, the process returns to step S101, and the above-described steps are repeated. If an error is notified in step S102 described above, the television camera system 200 of this embodiment may be terminated.

  Here, the display of the tally lamps 103a to 105a of the television camera A103 to the television camera C105 of the television camera system 200 of the present embodiment and the auxiliary display devices 103b to 105b, which are examples of the display unit, are shown in FIGS. Use to supplement. FIG. 10 shows an example in which the television camera selected immediately before is the television camera A103, the television camera C105 is currently switched by the switcher 208, and the tally lamp 105a is turned on. At this time, since the person to be tracked is directed to the television camera A103 selected immediately before, the tally lamp 103a of the television camera A103 is turned off, and the television camera C105 is disposed on the auxiliary display device 103b. The direction that is being displayed is displayed. At this time, if the display indicating the direction of the television camera C105 is displayed on the auxiliary display device 104b of the television camera B104, the person to be tracked can quickly catch the television camera C105. FIG. 14 shows a display example when the television camera C105 or the television camera A103 is selected by the switcher 208 immediately before, the television camera B104 is currently selected, and the tally lamp 104a is lit. . According to this example, a display indicating the direction of the selected television camera B104 is displayed on the auxiliary display device 105b of the television camera C105 and the auxiliary display device 103b of the television camera A103. Accordingly, it is possible to easily determine that the person to be tracked is neither the television camera C105 nor the television camera A103 when facing a place other than the television camera B104. The above is the outline of the television camera system 200 of this embodiment. Next, each process of the television camera system 200 will be described individually with reference to FIGS.

(Face detection process)
The face detection process in step S114 described above will be described with reference to FIG. When the face detection process is started in step S114, the detection parameters are initialized (step S200). Here, in these face detection processes, the camera face detection units 421 to 423 of the television cameras 103 to 105 perform the face detection process on images taken by the television cameras 103 to 105, respectively. (Step S201). This face detection process can be performed using an existing image processing technique. Next, it is determined whether or not a human face exists in the screen (step S202). If it is determined that a person's face exists, the process proceeds to step S203, where the face position, size, and number of the person are acquired, and in step S204, a face that matches the registration is detected among the detected persons. Is determined. In making this determination, the face detection parameter table 425 in FIG. 4 is referred to. If they match, the process proceeds to step S206, and True is set in the variable face_person. If they do not match, the process proceeds to step S205, and False is set in the variable face_person, and the process ends. On the other hand, if it is determined in step S202 that no human face exists, the process proceeds to step S207, where 0 is set in the variable face_num, and the process ends. The above is the face detection process.

(Any person selection process)
Next, the processes in steps S113 and S126 described above will be described with reference to FIG. When the process is started in step S113 or step S126, initialization is performed in step S300, and then the face detection result of each camera is acquired (step S310). Further, in step S302, the operation monitor 213 is acquired. The frame of the detection device is displayed on the screen, and is arranged so as to surround the detected face. In step S303, a selection is made as to whether to register or cancel the face surrounded by the frame. Next, in step S304, when the use or non-use of the tracking mode is selected, the process ends. The above is the process of selecting a person.

(Undetected timer processing)
Here, the non-detection timer process in step S115 will be described with reference to FIG. When the process of the undetected timer is started in step S115, it is determined whether or not the value set in the variable det_expire is 0 in step S400. If it is determined that the value is 0, the process proceeds to step S404. The detection timer is stopped, 1 is set in the variable det_expire (step S405), and the process ends. If it is determined in step S400 that it is not 0, the process proceeds to step S401, and it is determined whether or not the undetected timer is operating. If it is determined that it is operating, the process proceeds to step S403. If it is determined that it is not operating, the process proceeds to step S402, and an undetected timer is started. Then, the process proceeds to step S403, the value of the variable det_expire is decremented, and the process ends. The above is the process of the undetected timer.

(Relative position calculation process)
Next, the process of calculating the relative position between the camera facing the target person and the selected camera in step S123 will be described with reference to FIG. When the process of step S123 is started, each television camera position is acquired in step S500, and then the process proceeds to step S501, where the position X from the selected television camera is a positive value (> 0). It is determined whether or not. This position is detected as a coordinate on the XY plane when viewed from above the room in which the television camera is installed with the predetermined position as the origin (here, the horizontal direction with respect to the front of the subject) Will be described with respect to the X axis). If the position X is positive (> 0), it is determined from the selected television camera that the relative position of the television camera to which the target person is facing is the right (step S503). If the position X is not positive (> 0) in step S501, the process proceeds to step S502, where it is determined whether the position X is negative (<0). If the position X is negative (<0) The relative position is determined to be on the left (step S502), and the process ends. The above is the process of the relative position calculation process.

  The television camera system 200 of the present embodiment is configured to include the above processing steps. Since it is configured as described above, when the subjects 101 and 102 are photographed by the television camera A103 to the television camera C105, the face information of the subjects 101 and 102 is registered. Based on the registered information, the face orientation and line of sight of the subjects 101 and 102 can be determined from the captured images. Therefore, the direction of the television camera to be used next can be instructed immediately to the photographed persons 101 and 102, and this instruction is automatically performed using an image processing technique without a person. Therefore, according to the television camera system 200, an instruction can be surely issued.

  The above is one of typical examples and does not necessarily limit the implementation method. For example, if there is a means capable of obtaining the same effect, the shape of the tally lamp and the display of the auxiliary display device can be given functions not only by the direction indication by arrows but also by characters and corresponding figures. For example, auxiliary display may be realized using a prompter. In this embodiment, only one person is detected and tracked at the same time. However, if an interface on the operation panel or an improvement in processing capability in the image processing unit or a means for increasing display information on the auxiliary display device is added, a plurality of persons can be detected. Needless to say, a similar instruction can be given.

In the television camera system which concerns on this invention, it is explanatory drawing for demonstrating the relationship between the television camera in a studio, and a to-be-photographed person. It is a block diagram which shows the whole structure of the said television camera system. It is a block diagram which shows the internal structure of an image processing apparatus. It is a data structure figure of the image detection parameter table memorize | stored in the image detection parameter memory | storage part. It is a data structure figure of the other parameter table memorized by the other parameter storage part. It is a flowchart which shows the process of the first half among the processes of a television camera system. It is a flowchart which shows the process of the latter half side among the processes of a television camera system. It is explanatory drawing which shows the operation example of the tally lamp and auxiliary display apparatus which are mounted in the television camera, Comprising: It is a case where the television camera A is selected. FIG. 11 is an explanatory diagram showing an operation example of a tally lamp and an auxiliary display device mounted on a television camera, and is a case where the television camera C is switched to. It is a figure which shows the other operation example of the tally lamp and auxiliary display apparatus which are mounted in the television camera. It is a figure which shows the other operation example of the tally lamp and auxiliary display apparatus which are mounted in the television camera. It is a flowchart of the face detection process which detects a person's face from the image of each television camera. It is a flowchart of the selection process which selects the detected arbitrary person. It is a flowchart of an undetected timer process. It is a flowchart of the relative position calculation process of the camera to which the target person is facing, and the selected camera.

Explanation of symbols

103 to 105 Television cameras A to C
103a to 105a Tally lamp (display unit)
103b to 105b Auxiliary display device (display unit)
103c to 105c Position detection sensor 200 Television camera system 208 Switcher 211 Image processing apparatus

Claims (3)

A plurality of television cameras for photographing the subject;
A position detection sensor that is attached to the plurality of television cameras and detects the position of each of the plurality of television cameras;
A display unit attached to the plurality of television cameras and displaying a television camera to be photographed next among the plurality of television cameras and presenting to the subject; and
A switcher for selecting and switching one of the plurality of television cameras;
An image processing device that controls display of the display unit,
The image processing apparatus includes:
When the switcher switches from any one of the plurality of television cameras to one of the remaining television cameras,
Detecting the face of the subject from the images taken by each of the television cameras to determine the direction of the subject's line of sight;
The position of each of the plurality of television cameras is acquired from the position detection sensor, and the direction of the switched television camera viewed from the television camera located in the direction of the line of sight is determined based on the position. Calculate
A television camera system configured to display a direction of the switched television camera on the display unit of the television camera positioned in the direction of the line of sight. An image detection parameter storage unit that stores image data including a plurality of faces of the subject,
The image processing apparatus determines whether the face of the subject detected from the image captured by the television camera matches any of the plurality of image data stored in the image detection parameter storage unit. The television camera system according to claim 1, wherein the direction of the switched television camera is displayed on the display unit when the two match.   The image processing device designates one image data from a plurality of the image data stored in the image detection parameter storage unit, and the face of the subject to be matched with the designated image data is: 3. The television camera system according to claim 1, wherein when the image captured by the television camera is included in the image, the direction of the switched television camera is displayed on the display unit. 4. .

Images