JP2005286419A - Image pickup device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image pickup device capable of outputting the video image of a camera which the front or the face of a subject faces by photographing the same subject from a plurality of directions. <P>SOLUTION: For the one subject 11, cameras 1, 2 for photographing the subject from a plurality of different directions, and a direction/position arithmetic operation section 14 calculates (detects) the position and direction of the subject 11 by using transmitters 12R, 12L and receivers 13A, 13B, 13C, thereby automatically switching a camera into any one of the cameras 1 and 2 for photographing the subject 11 who facing the front. This enables always preferable photographing (e.g. photographing the front or the face). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a photographing method and apparatus for photographing a specific subject. In particular, the present invention relates to an imaging apparatus having means for detecting the position of a subject using a transceiver.

  Conventionally, in Patent Document 1, for example, a plurality of cameras are installed in a golf course, and when a player with an ID tag advances play, the positions of the players are detected by a plurality of receivers, and a nearby camera is selected. It has been proposed to zoom and take a shot.

  Patent Document 2 proposes that a specific person can be easily photographed from a plurality of people wearing the same clothes by carrying an infrared transmitter with a specific subject and photographing with a video camera equipped with a receiver. Has been described.

Patent Document 3 proposes a video switching system that selects and displays an optimal camera based on conditions such as a short distance from a plurality of cameras.
Japanese Patent No. 3379067 JP-A-9-74505 Japanese Patent Laid-Open No. 2001-45468

  However, in the conventional example, the position of the subject is detected, the position is notified to the imaging device, or shooting is performed with an appropriate one from a plurality of fixed imaging devices, and the orientation of the subject is particularly considered. There wasn't. Therefore, there is a problem that even if the position of the subject is specified, it is not always possible to perform preferable shooting (front, face, etc.).

  The present invention has been made in view of the above problems, and is capable of shooting the same subject from a plurality of directions and outputting the image of the camera facing the front or face when the subject is a person. An object of the present invention is to provide an imaging device.

An imaging apparatus according to the invention of claim 1 is provided.
A plurality of imaging means provided at different positions and oriented in different directions;
Position and direction information transmitting means for transmitting position information and direction information of a subject imaged by the imaging means;
Receiving means for receiving position information and direction information from the position / direction information transmitting means;
Subject position / direction calculation means for calculating the position and direction of the subject from the position information and direction information of the subject received by the receiving means;
From the position and direction of the subject calculated by the subject position / direction calculating means, an imaging means for photographing the subject is selected from the plurality of imaging means, and an image of the subject is photographed.

  According to the first aspect of the present invention, a plurality of image pickup means for picking up the same subject from different directions by detecting the direction facing the position of the subject based on the relative positional relationship between the transmitter and the receiver by carrying the transmitter with the subject. By selecting an optimal imaging means from among the above, it is possible to always perform preferable photography (for example, taking a front view, a face, etc.).

The invention according to claim 12 is the imaging apparatus according to claim 1,
Image cutout means for cutting out a part of the image of the subject imaged by the imaging means selected from the plurality of imaging means so as to include the subject based on the calculation result of the subject position direction calculation means;
Display means for displaying the image cut out by the image cutting means;
Resolution conversion means for converting the resolution of the image cut out by the image cutout means in accordance with the resolution of the display means.

  According to the twelfth aspect of the present invention, it is possible to capture an up image of the subject by further providing an image cutting means in the configuration of the first aspect and cutting out a part of the image of the optimum image pickup means.

The image cut-out portion is detected by calculating camera shooting position information from the position information of the subject. The cutting size may be arbitrarily set by the user, or may be determined in advance, such as cutting out a number m around the transmitter.

The invention according to claim 15 is the imaging apparatus according to claim 12,
The imaging means has an imaging device having a plurality of pixels,
A cutout position instruction means for instructing a position to cut out a part of an image of a subject imaged by the image pickup means selected from the plurality of image pickup means so as to include a subject based on a calculation result of the subject position direction calculation means; ,
Based on a cutout position instruction from the image cutout position instruction means, further comprising a cutout area designation means for designating a cutout area in the image sensor,
A subject image photographed by the image sensor is cut out by the cut-out area designating means.

  The invention described in claim 15 is characterized in that the subject cutting means is performed by the image pickup device of each image pickup means. It is possible to take a picture with a multi-pixel imaging device (for example, 8 million pixels) from the number of pixels of a standard moving image (for example, HDTV is 2 million pixels), and cut out a part of the image to display the subject up. . The number of extracted pixels may be output from the imaging means in accordance with the number of pixels of the standard moving image, or it may be extracted with an arbitrary number of pixels, and a scan converter will be provided at the subsequent stage, where it is converted to the number of pixels of the standard moving image. May be.

An imaging device according to the invention of claim 16 is provided.
A plurality of imaging means provided at different positions and directions on the field and obtaining image information including a subject;
Subject position direction transmitting means for transmitting position information and direction information of the subject existing on the field;
Receiving means for receiving position information and direction information from the subject position direction transmitting means;
Subject position / direction calculation means for calculating the position and direction of the subject on the field from the subject position information and direction information received by the receiving means;
The position and direction of the subject on the field calculated by the subject position / direction calculation means, the camera coordinates based on the direction and / or angle of view taken by the imaging means, or the imaging element plane coordinates taken by the imaging means Coordinate conversion means for converting to
From the coordinates and orientation of the subject converted by the coordinate conversion means, an imaging means for photographing the subject is selected from the plurality of imaging means, and an image of the subject is photographed.

  According to the sixteenth aspect of the present invention, the information on the position and orientation of the subject obtained by the transmission / reception device is converted into camera coordinates or imaging element plane coordinates, so that an imaging means for photographing the subject is selected and the optimum subject is selected. The image is cut out and photographed.

  According to the imaging apparatus of the present invention, the orientation of the subject is detected based on the relationship between the transmitter and the receiver attached to the subject, the same subject is photographed from a plurality of directions, and when the subject is a person, the front or face is detected. It is possible to output the video of the camera that is facing.

  Embodiments of the invention will be described with reference to the drawings.

FIG. 1 is a block diagram of an imaging apparatus according to Embodiment 1 of the present invention.
The imaging apparatus shown in FIG. 1 includes a plurality of (two in the figure) wireless transmitters 12R and 12L as position / direction information transmitting means mounted on the right shoulder and the left shoulder of a subject 11 on a stage 10 and having different frequencies, and a stage. The object position / direction calculation for calculating the direction and position of the object 11 from the time difference or strength ratio of the signals of the radio receivers 13A, 13B, and 13C as receiving means located in the three directions 10 and the two transmitters 12R and 12L. A direction / position calculation unit 14 as a means, two cameras 1 and 2 as imaging means for photographing the subject 11 from different directions (the two cameras are preferably in vertical synchronization), and two cameras A camera selection unit 15 that is an imaging unit selection unit that selects the outputs of the cameras 1 and 2 and a monitor 16 as a display unit that displays a selected image are provided. Each of the cameras 1 and 2 as the image pickup means includes an image pickup device, and each camera has a function of obtaining an image information including the subject by imaging with the image pickup device after the subject is imaged by the optical system. .

Next, the operation of FIG. 1 will be described.
The subject 11 on the stage 10 is photographed by the two cameras 1 and 2 from different directions. Around the stage 10, there are three radio receivers 13A, 13B, 13C capable of receiving radio waves from the transmitters 12R, 12L attached to the subject 11 on the stage.

  A human being who is the subject 11 has radio transmitters 12R and 12L attached to the right shoulder and the left shoulder, and the time difference or intensity of the radio waves in the three receivers 13A, 13B, and 13C changes depending on the position and the direction facing the person. The position and orientation of the subject 11 can be specified by the direction / position calculation unit 14.

  For example, when the face (or front) of the subject 11 faces the camera 2, the camera selection unit 15 selects the output of the camera 2 according to an instruction from the direction / position calculation unit 14 and outputs it to the monitor 16.

  Here, each of the receivers 13A, 13B, and 13C detects signals by switching the signals from the two right shoulder and left shoulder transmitters 12R and 12L at a certain time, but each of the receivers in the three directions. The direction receiver may be configured with two receivers for the right shoulder and the left shoulder (the total number is six).

  In addition, it is also possible to record a photographed image by connecting a recorder such as a DVD recorder instead of the monitor 16.

Next, a method for detecting the position and orientation of the subject will be described with reference to FIGS.
Receivers 13A, 13B, and 13C are provided at three locations around the stage 10. The distances between the receivers 13A, 13B, and 13C are assumed to be known.

  Further, the absolute values (latitude and longitude) of the positions of the receivers 13A, 13B, and 13C are known by GPS (Global Positioning System). The subject 11 has omnidirectional transmitters 12R and 12L having different frequencies.

  When the right shoulder is positioned at the position X on the stage 10, the distance (Ra, Rb) between the receivers 13A, 13B and the position X is determined from the time difference between the radio waves from the transmitter 12R as shown in FIG. Since it understands, the position of X and X 'is known as a position candidate of the transmitter 12R.

  Next, as shown in FIG. 2 (b), the distance (Rb, Rc) between the receivers 13B, 13C and the position X is known from the time difference between the radio waves from the transmitter R. The position of X ″ is known. Since the common candidate is X by comparing FIG. 2A and FIG. 2B, X is determined as the position of the transmitter 12R.

  Similarly, the position Y of the left shoulder can be obtained using the transmitter 12L and the receivers 13A, 13B, and 13C as shown in FIG. That is, since the distances (La, Lb) between the receivers 13A and 13B and the position Y are known, the positions of Y and Y 'are known as candidates for the position of the transmitter 12L. Further, the distances (Lb, Lc) between the receivers 13B and 13C and the position Y are known, and the positions of Y and Y ″ are known as candidates for the position of the transmitter 12L. However, Y ′ and Y ″ are not shown. Since the common candidate is Y, Y is determined as the position of the transmitter 12L.

  Thus, when the positions X and Y of the right shoulder R and the left shoulder L are determined, the center of the line connecting the right shoulder R and the left shoulder L as shown in FIG. The direction rotated 90 degrees clockwise is the front direction of the subject 11.

  If the face is the direction of the subject, transmitters 12R and 12L may be mounted near both ears.

  3 and 4 show an example in which the direction of a subject is detected using a transmitter having directivity. The direction of the subject is obtained from a vector of the distance between the transmitter and the receiver and the intensity of the radio wave.

  FIG. 3 shows a case of a transmitter H1 of a type that emits radio waves having directivity with a strong electric field distribution in the direction of the subject (for example, the front) around the subject 11, for example, the above-mentioned head X on the subject 11 A type transmitter H1 is installed.

  As shown in FIG. 3, the intensity of the radio wave varies depending on the direction of the subject. The receiver 13A has the intensity Ka, the receiver 13B has the intensity Kb, and the receiver 13C has the intensity Kc. (Indicated by a thick arrow) is the front direction of the subject 11.

  FIG. 4 shows a transmitter H2 of a type that transmits a radio wave having directivity with a strong electric field distribution in one direction of the subject 11. For example, the transmitter H2 is attached to the chest of the subject 11 and the subject 11 is directed in the front direction. Send radio waves. The radio wave has a distribution of intensity 0 in the back direction of the subject 11. The direction of the subject 11 is calculated from the vector sum (indicated by a thick arrow) of the electric field strength and distance, as in FIG. However, the directivity of radio waves is set so that radio waves can reach one or more receivers regardless of where the subject is facing.

  Further, the mounting position of the transmitter H2 is not limited to the chest. For example, the direction in which the mounting signal is weak on the back may be determined to be the front, and the positions of the receivers 13A, 13B, and 13C are the subject 11 on the stage 10. It can be installed anywhere as long as the position and direction of the can be understood.

  FIG. 5 is a diagram showing an example of which one of a plurality of cameras is selected and photographed by direction detection.

  In FIG. 5, when the camera 1 is set to 0 degree and the camera 2 is set to 90 degrees with respect to the subject 11, the camera 1 is photographed when the front of the camera 1 is directed from 225 degrees to 0 degrees to 45 degrees. Shooting is performed when the front of the subject 11 faces 45 degrees to 180 degrees to 225 degrees. When the subject 11 faces 45 ° or 225 ° of the boundary, for example, it may be decided to shoot with the camera 1, or shoot with the camera selected until immediately before.

  Note that the position and direction are not limited to the radio wave transmitter / receiver, but are also an infrared transmitter / receiver, a position detection system using a wireless LAN and a PDA (personal digital information terminal: Personal Digital Assistance), laser, GPS For example, a position detection means such as a pressure sensor may be arranged in advance on the floor of the stage, and calculation may be performed from the position where the subject stands.

  Further, a plurality of types of transceivers for detecting the direction and position may be used. For example, a radio wave transmitter / receiver is used for position detection, and an infrared transmitter / receiver is used for direction detection.

  Further, the subject 11 is not limited to a single subject, and a plurality of subjects may carry transmitters having different transmission frequencies, and the subject may be switched according to instructions from the photographer.

  FIG. 6 is a block diagram of an image pickup apparatus according to Embodiment 2 of the present invention. FIG. 7 shows a portion cut out from the image of the camera 2.

  6 differs from the first embodiment of FIG. 1 in that an image cutout unit 17 and a resolution conversion unit 18 are further provided in the first embodiment, and the direction / position calculation unit 14A includes receivers 13A, 13B, and 13C. While calculating the position and orientation of the subject 11 from the information on the position and orientation of the subject 11 received in step S1, the coordinate position of the subject viewed from the camera position (camera space coordinates and imaging) is calculated. This is a point having a function of converting coordinates into element plane coordinates). The direction / position calculation unit 14A has a function of performing coordinate conversion from the camera position to the coordinate position of the subject as viewed, so that, for example, the portion (coordinate) of the imaging area of the camera 2 is the subject portion photographed by the camera 2 The image cutout unit 17 can accurately cut the subject portion in the captured image.

  In the second embodiment of FIG. 6, for example, a front-facing subject portion in the output image of the camera 2 is cut out from the imaging area of the camera 2 as shown in FIG. 7. The resolution of the image is converted by the resolution conversion unit 18 and the number of pixels suitable for the display device is output to the monitor 16. In addition, it is also possible to record a photographed image by connecting a recorder such as a DVD recorder instead of the monitor 16.

  In order to determine a region to cut out the image, the coordinate position of the subject 11 in the field space is specified by the receivers 13A, 13B, and 13C, and the coordinate position of the subject viewed from the camera position (the camera space coordinates and the image sensor). Coordinate conversion to plane coordinates) is performed, and an image of the subject portion is cut out.

  Here, the image extraction in Japanese Patent Application No. 2003-402275 filed on December 1, 2003 by the present applicant will be described. In this existing application, the field coordinates are coordinate-converted to the coordinates of the camera space and the image sensor plane coordinates expressed by the information regardless of the position where the imaging means is present. It is described that if the field coordinate position of the subject can be calculated (detected), the subject position on the imaging region by the imaging means can be obtained and the portion can be cut out. Hereinafter, FIGS. 1, 6, and 12 in Japanese Patent Application No. 2003-402275 will be described as FIGS. 8, 9, and 10. FIG.

First, terms related to FIGS. 8 to 10 will be described.
Point of interest: A point that is included in or near the target of interest and indicates a detection target such as a sensor attached to the subject.

  Field: A measurable space (region) that includes a target of interest, and refers to one coordinate system in which the relative position of the target point with respect to a predetermined reference position in this space can be calculated as position information. The coordinate system expressed by longitude and latitude on the earth is also a field. Alternatively, when the target of attention is a soccer player, the soccer field can be treated as a field, and when the target of attention is a performer on the stage, the stage can be treated as a field.

  Imaging area: Indicates an imaging area for each camera. Further, it is within the field of view of the camera, and further indicates a region where the degree of focus adjustment in the camera optical system is equal to or higher than a predetermined level. In principle, the field is imaged.

  Camera space: Refers to a coordinate system in which the intersection of lines defining the angle of view of the entire imaging area of the camera is the origin and the imaging direction is one of the axes (k). This is the space of i, j, k in FIG. Here, the line that defines the angle of view indicates a line that three-dimensionally forms an imaging region that forms an image on a pixel at the end of an imaging element such as a CCD, as shown in FIG. In FIG. 9, the coordinate system is expressed by three axes: an axis i parallel to the horizontal direction of the imaging element plane, an axis j parallel to the vertical direction of the imaging element plane, and an axis k indicating the imaging direction.

  Image sensor plane coordinates: A coordinate system (see FIG. 10) having the center of the image sensor as the origin on two axes, the axis Xc related to the horizontal direction of the image data output from the image sensor such as a CCD and the axis Yc related to the vertical direction. Point to. However, the position of the origin is not limited to the center of the image sensor. It may be the pixel position at the upper left.

  The imaging apparatus shown in FIG. 8 includes an imaging unit 31 that captures a field space and outputs a moving image signal and imaging region information, an attention point detection unit 32 that detects a position of an attention point in an attention target, and an imaging unit 31. Based on the imaging area information and the detection result of the target point position from the target point detection unit 32, the extraction position determination unit 33 that determines the extraction position of the target object, and the moving image signal from the imaging unit 31 are input, and the extraction position Based on the cut-out position information from the determining means 33, the image cut-out means 34 having a predetermined image size for cutting out a predetermined image size from the moving image signal, and the cut-out moving image signal of the predetermined image size cut out to a predetermined signal level. And a cut-out image output means 35 for outputting.

  The imaging means 31 is, for example, an imaging lens unit that condenses a subject image on an imaging surface, and an imaging element that performs photoelectric conversion on all areas on the imaging surface and outputs as a moving image signal for each pixel. A sensor; an A / D conversion circuit that converts a moving image signal captured by the image sensor into a digital signal and outputs the digital signal; and a drive circuit 1 that drives the image sensor with a timing pulse including a synchronization signal. It is configured.

  The attention point detection means 32 is a means for detecting position information of a sensor by a sensor attached to the attention object, such as GPS, or a means for detecting a position without attaching a sensor or the like to the attention object. The detection result of the attention point detection means 32 is position information of the attention point in the field coordinates (sometimes size information may be included). However, the point-of-interest detection means 32 does not include one that detects the target object by performing image processing on the video signal of the imaging means 31 itself. That is, the detection means does not include the imaging means 31.

  In addition, in order for the point of interest detection means 32 to detect the point of interest with the above-described sensor, it is necessary to configure a receiver or transmitter that is expressed as a base station in addition to the sensor of interest point detection means 32. When the base station is a transmitter, the sensor serves as a receiver to detect a sensor position corresponding to the position of the base station. When the base station is a receiver, the sensor serves as a transmitter to detect a sensor position corresponding to the position of the base station.

  The cut-out position determining unit 33 is a unit that designates the position of a cut-out image that is a part when the image cut-out unit 34 cuts out and outputs a part of all the picked-up images of the whole pick-up area from the image pickup unit 31 And a relationship information generation unit 331 that is a relationship information generation unit, a target size information storage unit 332, and an image cut-out position calculation unit 333.

  The relationship information generation unit 331 generates the relationship information between each position in the three-dimensional space of the field and the camera space, or each position in the three-dimensional space of the field, and the image sensor plane coordinates in the two-dimensional space. Generating means for generating the relationship information.

  The relationship information is table information using a correspondence relationship when converting field coordinates to camera coordinates or imaging element plane coordinates as a table, a coordinate conversion expression indicating the relationship, or a parameter representing the expression.

  The target size information storage unit 332 may be actual size information of the target object in the field, or may be size information of the target object in the captured image.

  The image cut-out position calculation unit 333 is configured according to the detection result from the attention point detection unit 32, the relationship information from the relationship information generation unit 331, and the size information of the target of interest from the target size information storage unit 332. It is means for determining the position to cut out the image.

  Note that the cutout position determination means 33 including the relationship information generation unit 331 and the image cutout position calculation unit 333 in FIG. 8 is configured in the direction / position calculation unit 14A in the embodiment of FIG. A reading address (information indicating where to read the photographing data) is output from the cutting position determination means in 14A, and is given to the image cutting unit 17 as cutting information. The image cutout unit 17 is composed of a memory for storing the shooting data of the selected one of the cameras 1 and 2, and the read address is given as cutout position information to cut out the image. Will be done.

  FIG. 9 shows the correlation between the field space and the imaging area of the camera when the soccer field is a field space. The imaging area of the camera indicates a spatial area surrounded by four lines that define the angle of view. The intersection of the four lines that define the angle of view is the origin O of the camera space. Players A, B, and C exist in the imaging area of the camera. The i, j, and k axes indicate camera coordinates based on the direction and / or the angle of view captured by the camera that is the imaging unit 31. The position of the point of interest in the shooting area of the camera can be calculated from the coordinates of the point of interest in the field detected by the point-of-interest detection means 32 and the relationship information described above.

  FIG. 10 shows a coordinate system of the imaging element plane. At the point of interest in the camera coordinate system of FIG. 9 (which exists on a plane orthogonal to the k-axis), it is at a position on the imaging element plane coordinate plane represented by (Xc, Yc) as shown in FIG. Can be converted. In FIG. 10, the image sensor is shown as three vertical pixels and three horizontal pixels, but of course, the present invention is not limited to this.

  In order to determine a region to cut out an image in the direction / position calculation unit 14A of FIG. 6, the field coordinate position (or coordinate position on the stage) of the subject 11 is specified by the receivers 13A, 13B, and 13C, and then the camera Coordinate conversion is performed from the position to the coordinate position viewed, and further converted into a coordinate system viewed from the image sensor in the camera 1 or 2, and a region corresponding to the subject 11 is determined as an image cut-out region. The selection of the camera 1 or 2 is performed based on information on the direction of the subject from the direction / position calculation unit 14A, and the camera on which the subject is photographed in the front direction is selected by the camera selection unit 15. Then, when the image data of the selected camera is captured by the image cutout unit 17, the image is cut out based on the information of the cutout area determined by the direction / position calculation unit 14A.

Next, a recording / reproducing method will be described with reference to FIGS. 1, 6, and 11 to 15. FIG.
When there is one target subject, for example, a recorder such as an HDD server or a DVD recorder may be connected to the monitor input unit shown in FIG. 1 (only camera switching) or FIG. 6 (with image cutout). FIGS. 11 to 15 show a method of creating cut data individually for each subject when there are a plurality of target subjects.

  FIG. 11 is a block diagram of an image pickup apparatus according to Embodiment 3 of the present invention, and shows a recording system that leaves records of a plurality of subjects together with the IDs of the subjects.

  11 differs from FIG. 6 in that the cameras 1 and 2 shoot a plurality (two people in the figure) of the subjects 11 and 11 ′, and the plurality (two people in the figure) of the subjects 11 and 11 ′. Transmitters (12R, 12L) and (12′R, 12′L) configured to be able to transmit not only information that can identify each right shoulder and left shoulder but also an identification number (ID) that can identify each subject. And the direction / position calculation unit 14B calculates the positions and orientations of the subjects 11, 11 ′ from the information on the positions and orientations of the subjects 11, 11 ′ received by the receivers 13A, 13B, 13C. On the other hand, a point having a function of coordinate-converting the calculated positions of the subjects 11 and 11 ′ on the field to the coordinate positions (camera space coordinates and imaging element plane coordinates) of the subject viewed from the camera position, and a camera selection unit There is no equivalent to a camera , 2 does not select only one of the imaging data, and records all the imaging data for each camera from the cameras 1 and 2 in association with the positions and orientations of the photographed subjects 11 and 11 ′. And the server 19 as a point. The server 19 may be an HDD server or a DVD recorder, but the HDD server can be configured with a larger storage capacity, and is therefore advantageous for recording a plurality of subject data. .

  In FIG. 11, at the time of recording, all the images of all the cameras 1 and 2 and information on the subject position and orientation are linked and recorded.

  At the time of reproduction, the subject information may be extracted from the image data based on the subject position and orientation information and output.

  FIG. 12 shows a playback system for playing back video data recorded by the recording system of FIG.

  In FIG. 12, the server 19 stores imaging data recorded together with the IDs of the plurality of subjects 11, 11 ′, data indicating the position and orientation of the subject for each ID, and imaging of each recorded ID. Coordinate data indicating the cutout position corresponding to the direction of the subject is recorded from the data.

  By operating a read ID selection unit 20 provided in the operation unit, it is possible to specify imaging data of a subject to be read from imaging data recorded together with the subject ID in the server 19.

  The resolution conversion unit 18 cuts out and reads out the imaging data of the subject with the ID from the memory in the server 19, converts it to a resolution suitable for the display device, and outputs it to the monitor 16.

FIG. 13 shows a flowchart at the time of reproduction in FIG.
As shown in FIG. 13, when the user designates the ID of a subject (step S1), the subject in which the subject with the designated ID is reflected in the front direction from the memory in which the image data in the server 19 is recorded. In accordance with the address of the position / orientation data (step S2), the image data of the subject with the ID is cut out and read out (step S3), and converted into a resolution suitable for the display device by the resolution converter 18 (step S4). The information is displayed on the monitor 16 (step S5).

  In addition to the above description, at the time of recording, the server 19 records at least all the image data captured by the camera 1 and the camera 2 and the direction and position data calculated by the direction / position calculation unit 14B. Therefore, if ID01 is designated during reproduction, the data of the camera facing the front of ID01 is selected from the data of cameras 1 and 2 as reproduction data of ID01 and reproduced.

  As shown in FIG. 14, ID01 is in the direction of camera 1 at time t1, and ID01 is in the direction of camera 2 at times t2 and t3, while ID02 is in camera 1 at times t1 and t2. It is assumed that ID02 is also in the direction of camera 2 at time t3.

  Assuming that the orientations of the two subjects ID01 and ID02 according to the passage of time are as shown in FIG. 14, when ID01 is designated at the time of reproduction, ID01 is photographed in the front direction as reproduction data of ID01 at time t1. The data of the cameras 1 and 2 is selected and reproduced, and the data of the camera 2 is selected and reproduced at times t2 and t3. Similarly, when ID02 is designated, the data of camera 1 is reproduced at times t1 and t2, and the data of camera 2 is reproduced at time t3.

  Note that when the pixels of the camera 1 and the camera 2 are selected and reproduced and displayed, for example, when the ID 01 is selected and the pixels of the camera 1 are reproduced, the subject ID 01 that is simply captured by the camera 1 is faced forward. The entire image may be reproduced and displayed, or a cut-out image (for example, an up image) facing ID01 may be reproduced and displayed. Similarly, when ID02 is selected, the entire image obtained by photographing ID02 with the camera 1 or 2 in the front direction may be reproduced and displayed, or a cut-out image (for example, an up image) of ID02 may be reproduced and displayed. Good.

  Although not shown, for example, when there are four subjects, four IDs are specified, the monitor is divided into four, and four cut-out images are displayed as a single image on one monitor at the same time. May be.

  FIG. 15 is a diagram in which a recorder 21 such as a DVD is connected instead of the monitor in FIG. 12, and the cut-out data of the designated ID read from the server 19 according to the instruction of the read ID selection unit 20 is displayed as the resolution of the display device. After the resolution is converted by the resolution converter 18 so as to meet the above requirements, for example, the DVD recorder 21 can record it on a DVD-R as a secondary recording medium. In this way, for example, when recording is performed by specifying ID01 from the HDD server, a DVD in which only data for ID01 is recorded can be obtained, and when recording is performed by specifying ID02, only data for ID02 is recorded. A recorded DVD can be obtained, and individual ID data can be recorded on a secondary recording medium for distribution or sale.

  FIG. 16 is a block diagram of an image pickup apparatus according to Embodiment 4 of the present invention. FIG. 17 shows the configuration of only the image pickup means (camera 1A or camera 2A) in FIG. 16. Image extraction is performed within the image sensor, and when it is output from the camera 1A or 2A, the already cut out image is output. It has come to be.

  16, the stage 10, the subject 11, the transmitters 12R and 12L, the receivers 13A, 13B, and 13C, the camera selection unit 15, and the monitor 16 are the same as those in FIG. In addition, it is also possible to record a photographed image by connecting a recorder such as a DVD recorder instead of the monitor 16.

  The cameras 1A and 2A and the direction / position calculation unit 14C are different from those in FIG. The camera 1A (or 2A) is configured as shown in FIG.

  The direction / position calculation unit 14C calculates the position and orientation of the subject 11 from the position and orientation information of the subject 11 received by the receivers 13A, 13B, and 13C, and calculates the calculated position of the subject 11 on the field. In addition, it has a function of performing coordinate conversion to the coordinate position (camera space coordinates and imaging element plane coordinates) of the subject viewed from the camera position, and also has a function of instructing a cutting position to select a cutting position. The direction / position calculation unit 14C also has a function of outputting a selection signal for switching the camera selection unit 15 depending on the calculated orientation of the subject 11 (whether the orientation of the camera 1A or the orientation of the camera 2A).

  As shown in FIG. 17, the camera 1 </ b> A (or 2 </ b> A) receives a cut-out position instruction from the image sensor 41 and the direction / position calculation unit 14 </ b> C and performs control such as image cut-out on the image sensor 41. A microcomputer 42, a charge-voltage converter 43 that converts charges read from the image sensor 41 into a voltage, a camera signal processor 44 that performs CDS processing, gain adjustment, digital signal conversion, and the like, and the resolution of the display device. As described above, a resolution conversion unit 45 that performs resolution conversion and a D / A converter 46 that performs analog signal conversion are included.

  Further, the image sensor 41 includes a large number of photodiodes (for example, 8 million pixels) as light receiving elements, and is generated in the photoelectric conversion unit based on a photoelectric conversion unit 411 that performs photoelectric conversion and a cutout position instruction from the system control microcomputer 42. A cut-out area specifying unit 412 for specifying a cut-out area of the image to be processed, a horizontal read-out position specifying unit 413 for specifying a read-out range of the number of images in the vertical direction by the cut-out area specifying unit 412, and a horizontal scan line And a scanning line reading unit 414 for designating an image number reading range.

  The image sensor 41 may be a C-MOS sensor or a CCD. In any case, the image sensor 41 may be a sensor having a function of reading an arbitrary part of the photoelectric conversion unit (pixel region). is necessary.

  In the above configuration, the cutout area of the image sensor 41 is determined by the direction / position calculation unit 14C, and the area designation data is sent to the microcomputer 42 of the camera 1A (or 2A). By addressing which part in the image sensor 41 is cut out from the microcomputer 42, only a necessary part can be cut out. Thereafter, the resolution conversion unit 45 performs a predetermined resolution conversion, and outputs in a state where it can be displayed on a normal television monitor 16.

  In order to designate the cut-out area by the horizontal readout position designation unit 413 and the scanning line readout unit 414, first, the horizontal readout position designation unit 413 designates the horizontal readout position, and the unnecessary upper and lower scanning lines are skipped, and the scanning line readout unit 414 is read out. By the way, the left and right parts in the horizontal direction are discarded, so that the extraction area can be designated.

  In order to determine the area to be cut out, the direction / position calculation unit 14C specifies the field coordinate position (or the coordinate position on the stage) of the subject 11 by the receivers 13A, 13B, and 13C, and then looks from the camera position. The coordinates are converted to the coordinate positions, and further converted into a coordinate system viewed from the image sensor, and the area corresponding to the subject 11 is determined as an image cut-out area.

  Without using image processing, it is possible to detect not only the position of the subject but also the orientation of the subject using the transmitter and the receiver, so that the state where the subject is facing the front or face is automatically detected. Therefore, it is possible to shoot and to improve the convenience of the camera. It can be widely used in image processing apparatuses in an imaging system that cuts out an image following a target of interest.

1 is a block diagram of an imaging apparatus according to Embodiment 1 of the present invention. The figure explaining the detection method of a to-be-photographed object's position. The figure explaining an example which detects the direction of a to-be-photographed object using a transmitter with directivity. The figure explaining the other example which detects the direction of a to-be-photographed object using a transmitter with directivity. The figure which shows the imaging | photography area | region of a camera. FIG. 6 is a block diagram of an imaging apparatus according to Embodiment 2 of the present invention. The figure which shows the image of a camera, and the part cut out from the image. The block diagram explaining the image cutting-out in the apparatus of an existing application. The figure which shows the coordinate of camera space. The figure which shows the coordinate of an image pick-up element plane. FIG. 6 is a block diagram illustrating a recording system of an imaging apparatus according to a third embodiment of the invention. The figure which shows the reproduction | regeneration system which reproduces | regenerates the video data recorded with the recording system of FIG. The flowchart at the time of reproduction | regeneration of FIG. The figure which shows as an example whether the direction of two subject ID01 and ID02 is the direction of the cameras 1 and 2 according to progress of time. FIG. 13 is a diagram for explaining recording of the output data of FIG. 12 on a secondary recording medium. FIG. 6 is a block diagram of an imaging apparatus according to Embodiment 4 of the present invention. FIG. 17 is a block diagram illustrating a configuration of a camera used in the imaging apparatus in FIG. 16.

Explanation of symbols

1, 2, 1A, 2A ... photographing means (camera)
11: Subject 12R, 12L: Transmitter (Position / Direction Information Transmitting Unit)
13A, 13B, 13C ... Receiver (receiving means)
14, 14A, 14B, 14C ... direction / position calculation unit (subject position / direction calculation means)
15 ... Camera selection unit 16 ... Monitor (display means)
Agent Patent Attorney Susumu Ito

Claims (16)

A plurality of imaging means provided at different positions and oriented in different directions;
Position and direction information transmitting means for transmitting position information and direction information of a subject imaged by the imaging means;
Receiving means for receiving position information and direction information from the position / direction information transmitting means;
Subject position / direction calculation means for calculating the position and direction of the subject from the position information and direction information of the subject received by the receiving means;
An image pickup apparatus for picking up an image of a subject by selecting an image pickup means for photographing a subject from the plurality of image pickup means based on the position and direction of the subject calculated by the subject position direction calculation means.   The imaging apparatus according to claim 1, wherein the position / direction information transmission unit is attached to a subject photographed by the imaging unit, and the reception unit is disposed around the subject.   2. The imaging apparatus according to claim 1, wherein the means for transmitting the position information of the position / direction information transmitting means is a wireless transmitter having no directivity.   2. The image pickup apparatus according to claim 1, wherein the means for transmitting the direction information of the position / direction information transmitting means includes a wireless transmitter having no directivity attached to a plurality of subjects.   2. The imaging apparatus according to claim 1, wherein the means for transmitting the direction information of the position / direction information transmitting means is a directional radio transmitter.   The imaging apparatus according to claim 1, wherein the position / direction information transmission unit transmits position information and direction information by infrared rays.   The imaging apparatus according to claim 1, wherein the position / direction information transmitting unit transmits the position information and the direction information by sound waves.   The imaging apparatus according to claim 1, wherein the position / direction information transmission unit is a pressure-sensitive sensor provided on a floor on which a subject is arranged.   The imaging apparatus according to claim 1, wherein the subject position / direction calculating unit calculates the position and direction of the subject from a time difference or intensity difference of signals received by the plurality of receiving units. An imaging means selection unit connected to the plurality of imaging means and selecting an imaging means according to information from the subject position direction calculation means;
A recording unit for recording an image captured by the selected imaging unit;
The imaging apparatus according to claim 1, further comprising:   The imaging apparatus according to claim 10, wherein the recording unit records a subject recognition signal transmitted from the position / direction information transmission unit. Image cutting means for cutting out a part of the image of the subject imaged by the imaging means selected from the plurality of imaging means so as to include the subject based on the calculation result of the subject position direction calculation means;
Display means for displaying the image cut out by the image cutting means;
Resolution conversion means for converting the resolution of the image cut out by the image cutting means in accordance with the resolution of the display means;
The imaging apparatus according to claim 1, further comprising:   The imaging apparatus according to claim 12, further comprising a recording unit that records an image of the subject cut out by the image cutout unit. The recording unit records a subject recognition signal transmitted from the position / direction information transmitting unit,
The image cutting means outputs an image signal cut out so as to include a subject from an image recorded in the recording unit based on a subject recognition signal recorded in the recording unit. The imaging device described. The imaging means has an imaging device having a plurality of pixels,
A cutout position instruction means for instructing a position to cut out a part of an image of a subject imaged by the image pickup means selected from the plurality of image pickup means so as to include a subject based on a calculation result of the subject position direction calculation means; ,
Based on a cutout position instruction from the image cutout position instruction means, further comprising a cutout area designation means for designating a cutout area in the image sensor,
The imaging apparatus according to claim 1, wherein a subject image photographed by the imaging device is cut out by the cut-out area specifying unit. A plurality of imaging means provided at different positions and directions on the field and obtaining image information including a subject;
Subject position direction transmitting means for transmitting position information and direction information of the subject existing on the field;
Receiving means for receiving position information and direction information from the subject position direction transmitting means;
Subject position / direction calculation means for calculating the position and direction of the subject on the field from the subject position information and direction information received by the receiving means;
The position and direction of the subject on the field calculated by the subject position / direction calculating means are the camera coordinates based on the direction and / or the angle of view taken by the imaging means, or the imaging element plane coordinates taken by the imaging means. Coordinate conversion means for converting to
An image pickup apparatus for picking up an image of a subject by selecting an image pickup means for photographing an object from the plurality of image pickup means based on the coordinates and orientation of the subject converted by the coordinate conversion means.

Images