JP2009004873A - Camera control system and method, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a camera control system capable of photographing a video image of an entire group configured by a plurality of aggregated subjects or a video image of only combined subjects in a group. <P>SOLUTION: The camera control system is provided with a photographing section 101 for photographing subjects; a photographing control section 102 for controlling the operation of the photographing section 101; and a target position specifying section 108 for recognizing each of the subjects and specifying the position of each of the subjects. Further, the camera control system is provided with a point DB 110 for storing points indicating the photographing state of each subject; a point management section 109 for reading/writing the point of each subject from/to the point DB 110; and a uniform selection control section 103 for transmitting the information about a photographing target to the photographing control section 102. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a camera control system and method, a program, and a storage medium, and more particularly, to a camera control system and method, a program, and a storage medium that are characterized by techniques for photographing a plurality of subjects in a balanced manner.

  In a network camera system that distributes video captured by a camera via a network, for example, there is a system disclosed in Patent Document 1 as a conventional technique for a video receiver to view a video of a specific subject.

  As shown in FIG. 1 corresponding to the first embodiment, this system includes a plurality of photographing means, camera selection means, camera designation means, photographing target designation means, photographing target location correspondence means, and photographing location camera. It consists of information sending means composed of corresponding means. In this system, when a specific subject to be viewed is designated by the photographing target designating means, the location of the subject is associated by the photographing target location corresponding means, and a camera capable of photographing the whereabouts is further provided by the photographing location camera corresponding means. It is associated.

  Then, a camera capable of photographing the designated subject is transmitted to the camera selection means as a camera designation signal. Of the images captured by a plurality of imaging means (cameras), the video of the camera selected by the camera selection means is sent to the information sending means and further sent to the network, so that the video receiver is designated. A camera image corresponding to a specific subject can be viewed.

  Further, in Patent Document 1, as a second embodiment, a system for photographing a specific subject by controlling the direction, zoom, focus, etc. of the camera after detecting the location of the specific subject is also disclosed. Yes.

  In the system of Patent Document 1, the photographing target location correspondence means has photographing target position detection means, as shown in FIG. 6 of Patent Document 1, and the wireless tag attached to the subject is detected by the receiver. To detect the position of the subject. In this connection, in Table 1 of Non-Patent Document 1, active wireless tags, passive wireless tags, PHS, and GPS are listed as subject position specifying means, and their advantages and disadvantages are described. Yes.

  The above-described conventional technology is a system for photographing or monitoring a specific subject. However, as a method of using a network camera system, it may be required to photograph a plurality of subjects in a balanced manner.

  For example, when it is desired to shoot a plurality of participants making up a group at a party venue uniformly, there are the following situations in addition to shooting and monitoring a specific subject. That is, there is a situation where it is desired to shoot a video of the entire group composed of a plurality of subjects or a combination of only subjects within the group and to shoot or monitor a plurality of groups in a balanced manner in time series.

  As a conventional technique of a network camera system for photographing a plurality of subjects in a balanced manner, for example, there is an automatic photographing device disclosed in Patent Document 2, and this device can photograph images of a plurality of subjects at an equal time.

  As shown in FIG. 1 of Patent Document 2, the automatic photographing apparatus includes a camera unit, a personal identification unit, a moving image storage unit, an image selection unit, and a camera control unit. In this automatic photographing apparatus, for a subject whose face data is registered in advance in the face data registration unit in the personal identification unit, a template comparison between the image photographed by the camera unit and the face data is performed, and the subject appearing in the image being photographed is detected. Perform detection.

  The detected subject information is stored in the moving image storage unit, and the identification information of the subject is sent to the image selection unit. The image selection unit uses the number of recording frames of each subject in the identification information, and instructs the camera control unit to perform camera control for capturing the subject with the smallest number of recording frames, and The camera control unit is instructed to search.

  As described above, in Patent Document 2, by detecting a subject and performing camera control so as to more actively shoot a subject with the smallest number of recording frames, each subject is evenly distributed in a situation where there are a plurality of subjects. Realizes time shooting.

  Further, as a conventional technique of a network camera system that simultaneously tracks and photographs a plurality of subjects, for example, there is an automatic photographing device disclosed in Patent Document 3, and this device can track and photograph a plurality of subjects.

As shown in FIG. 1 of Patent Document 3, the automatic photographing apparatus includes a photometry unit, a group creation unit, a tracking frame setting unit, a subject tracking unit, an exposure calculation unit, an exposure control unit, and a display unit. In this automatic photographing device, the size of the subject group is measured by performing photometry of the subject by dividing it in a matrix-like photometric region, and the tracking of the center of gravity position of the subject is performed, thereby obtaining the subject group. Tracking photography is realized.
Japanese Patent No. 3561490 JP 2004-363775 A (page 18, FIG. 1) JP-A-7-92248 NTT Technical Journal 20033.8 (pp. 34-36, Table 1)

  As a network camera system for photographing or monitoring a plurality of subjects in a balanced manner, the automatic photographing apparatus disclosed in Patent Document 2 realizes photographing at equal time by selectively photographing a set having a short photographing time from a plurality of subjects. ing. However, if control is performed to capture only a subject with a short photographing time, there is a problem that an expected video cannot be obtained in the following cases.

  For example, if you are shooting a room with a camera and there is a subject in or out of the room, that is, if the number of subjects in the camera's shooting range increases or decreases, control the shooting time for each subject to be equal. The following problems arise when doing this.

  That is, for a subject that has newly entered the shooting range, since the shooting time is zero, the new subject is concentrated for a while until the shooting time of the subject becomes comparable to the shooting time of other subjects. Will be filmed. In this case, although the shooting time of the subject is equal, when viewed in a certain time range, only a new subject is shot intensively, and a well-balanced shooting is not necessarily performed. I can't say that.

  Another problem arises in photographing a plurality of subjects at equal time. In other words, it does not take into account what size the subject is shot, so even if a subject shot only with a small size and a subject shot with only a large size are shot at the same time, they are shot in a balanced manner. I can't say that.

  Also, when considering camera control so that multiple subjects can be photographed in a balanced manner, it is necessary to narrow down the subjects to be photographed according to the shooting conditions. Subject other than the subject may appear.

  For example, it is a case where the subject that is to be photographed coincidentally is frequently present. In such a case, there is a possibility that a specific subject will be photographed too much. However, in order to shoot with good balance, it is necessary to prevent the specific subject from being photographed too much in such a case.

  Also, for example, if you are shooting a room with a camera and the subject is in a group, and the subject is in or out of the group, the shooting time of each subject will be equal. When control is performed, the following problems occur.

  That is, since only subjects with a short shooting time do not necessarily form a group, it is not always possible to take a video of the entire group or only a subject within the same group. In particular, when the subject moves back and forth between multiple groups, or when the number of groups increases or decreases, there are subjects with different shooting times in the same group. It is impossible to obtain a video reflecting the group structure.

  Further, as a conventional technique of a network camera for tracking and shooting a plurality of subjects at the same time, the automatic shooting device of Patent Document 3 performs tracking shooting of a subject based on a photometric result. However, when tracking shooting is performed using the photometric result, there is a problem that an expected image cannot be obtained in the following cases.

  This is a case where a subject with a long shooting time and a subject with a short shooting time are nearby. When tracking is performed using only the photometric result, the two subjects cannot be distinguished, and there is a possibility that both will be tracked. In the worst case, the subject to be imaged is not tracked.

  An object of the present invention is to provide a camera control system and method, a program, and a storage medium capable of shooting a video of an entire group composed of a plurality of subjects or a combination of only subjects within the group. There is. It is another object of the present invention to provide a camera control system and method, a program, and a storage medium capable of photographing or monitoring a plurality of groups in a time series with a good balance.

  In order to achieve the above object, a camera control system according to claim 1 is characterized in that an imaging unit for imaging an object, an imaging control unit for controlling the operation of the imaging unit, and identifying the position of each object by identifying the object. Target position specifying means, point accumulating means for accumulating points indicating the shooting situation of each subject, point management means for reading / writing points of each subject with respect to the point accumulating means, and accumulated in the point accumulating means And an equal selection control means for transmitting information of the photographing target to the photographing control means based on the point and predetermined group information composed of the subjects.

  A camera control method according to claim 23, wherein a shooting step of shooting a subject, a shooting control step of controlling the operation of the shooting step, a target position specifying step of identifying a subject and specifying the position of each subject, A point accumulating step for accumulating points indicating the shooting status of the subject; a point management step for reading and writing the points of each subject with respect to the point accumulating step; and a predetermined group comprising the accumulated points and the subjects And an equal selection control step of transmitting information to be photographed to the photographing control step based on the information.

  The program according to claim 23 is a program for causing a computer to execute a camera control method, wherein the camera control method identifies a subject, a photographing step for photographing a subject, a photographing control step for controlling an operation of the photographing step, and a subject. A target position identifying step for identifying the position of each subject, a point accumulating step for accumulating points indicating the shooting status of each subject, a point management step for reading and writing the points of each subject with respect to the point accumulating step, And an equal selection control step of transmitting information of the photographing target to the photographing control step based on the accumulated points and predetermined group information composed of the respective subjects.

  A computer-readable storage medium according to a twenty-fourth aspect stores the program according to the twenty-third aspect.

  According to the present invention, it is possible to shoot a video of an entire group composed of a plurality of subjects or a combination of only subjects within a group. In addition, a plurality of groups can be photographed or monitored in a balanced manner in time series.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  Here, the entire drawing will be described first.

  FIG. 1 is a diagram schematically showing a configuration of a camera control system according to the first embodiment of the present invention. FIG. 2 is a diagram schematically showing a main configuration of a camera control system according to the second embodiment of the present invention. FIG. 3 is a flowchart showing a procedure of camera control processing executed by the camera control system of FIG. FIG. 4 is a flowchart showing a procedure of camera control processing executed by the camera control system of FIG.

  FIG. 5 is a diagram illustrating an example of data transmitted from the target position specifying unit in FIG. 1 to the equal selection control unit. FIG. 6 is a diagram illustrating an example of data stored in the point DB in FIG. FIG. 7 is a diagram illustrating an example of a point update formula applied to a selected subject in the point update unit in FIG.

  FIG. 8 is a diagram illustrating an example of a control message transmitted to the imaging control unit in FIG. FIG. 9 is a diagram illustrating an example of a subject whose points are updated in the point update unit in FIG. 1. FIG. 10 is a diagram illustrating an example of numerical values when the point update unit in FIG. 1 adjusts the update amount of points between a plurality of subjects.

  FIG. 11 is a diagram illustrating an example of an update formula of the point update unit in FIG. FIG. 12 is an explanatory diagram of the definition of the position of the group of subjects. FIG. 13 is an explanatory diagram of the definition of the subject size. FIG. 14 is a diagram for explaining an algorithm for creating a group of subjects. FIG. 15 is a diagram for explaining an algorithm for selecting a subject from the points of the subject.

  FIG. 16 is a diagram illustrating an example of a point update formula applied to all subjects in the point update unit in FIG. 1. FIG. 17 is a flowchart showing an algorithm for creating a group from subjects. FIG. 18 is a diagram illustrating a general formula of the update formula for the subject selected as the photographing target.

  FIG. 19 is a diagram showing a general formula of the update formula for the subject selected as the point update target. FIG. 20 is a diagram showing constants of the camera control system of FIG. FIG. 21 is a diagram showing variables of the camera control system of FIG.

  FIG. 22 is a diagram schematically showing a configuration of a camera control system according to the third embodiment of the present invention. FIG. 23 is a diagram illustrating a wide angle of the photographing apparatus required for photographing so that a subject is photographed.

  FIG. 24 is a diagram illustrating an example of a wide angle of a minimum necessary size when tracking the average position of a plurality of subjects. FIG. 25 is a diagram illustrating an example of a wide angle of a minimum necessary size when tracking the central portion of the subject group.

  FIG. 26 is a diagram illustrating an example of an image obtained when tracking the central portion of the subject group. FIG. 27 is a diagram illustrating an example of an image obtained when tracking the central portion of the subject group. However, margins are added to the left and right of the video.

  FIG. 28 is a diagram illustrating an example of an image obtained when tracking tracking is performed on the center of gravity of the subject group. FIG. 29 is a diagram illustrating an example of an image obtained when the tracking center of the subject group is captured. However, margins are added to the left and right of the video.

(First embodiment)
As shown in FIG. 1, the camera control system includes a photographing unit 101, a photographing control unit (photographing control unit) 102, an equal selection control unit 103, a point management unit 109, a point DB (point storage unit) 110, and a target position specifying unit. 108. The equal selection control unit 103 includes a shooting group configuration unit 104, a shooting target selection unit 105, a group point calculation unit 106, and a point update unit 107.

  The photographing unit 101 is a device that photographs a subject. The imaging control unit 102 is a device that sends a control signal to the imaging unit 101 to control the operation of the imaging unit 101. The equal selection control unit 103 is an apparatus that transmits information on an imaging target to the imaging control unit based on the points accumulated in the point accumulation unit and predetermined group information including each subject.

  The point updating unit 107 selects a subject whose points are to be updated, and updates the shooting size in the video of the shot subject, one shooting time for the subject, and the total shooting time or number of times of the camera control system. It is. Similarly, the point update unit 107 updates the point of the selected subject using the total shooting time or number of times of each subject, the elapsed time since entering the place where the subject can be shot, the past points of each subject, and the like. Device.

  In order to explain the definition of the subject size, FIG. 13 shows an example of the subject size. As shown in FIG. 13, the height of the subject in the images 1301 and 1302 is referred to as the subject size. The size of the subject is calculated from the pan, tilt, and zoom amounts of the photographing unit 101, subject position information, height, and the like. Regarding the handling of height, in the present embodiment, a method of using average height is used, but a method of registering the height of each subject in a database may be used.

  The shooting group configuration unit 104 is a device that creates a group by searching for pairs of subjects that are closer to each other than the position information obtained from the target position specifying unit 108 and grouping them sequentially. In addition, the photographing group configuration unit 104 creates a group including a large number of subjects while repeating group reconfiguration as necessary. In addition, the shooting group configuration unit 104 recalculates the group at the timing when the number of subjects included in the shootable area increases or decreases or when the movement of a certain amount or more of the subjects is detected.

  The group point calculation unit 106 is a device that calculates group points using points of subjects belonging to the group configured by the shooting group configuration unit 104.

  The shooting target selection unit 105 is a device that determines a shooting target using the magnitude relationship between the points of each group calculated by the group point calculation unit 106 as a criterion.

  The point management unit 109 is a device that reads and writes points of each subject with respect to the point DB 110.

  The point DB 110 is a device that accumulates points of each subject. Also, the point DB 110 performs an update process that reduces all points according to the elapsed time.

  The target position specifying unit 108 is a device that uses a position specifying unit such as RFID, PHS, or GPS to search for a subject that exists at a position where the photographing unit 101 can shoot and acquire the coordinates of the found subject.

  FIG. 3 shows an operation flow of the first embodiment of the present invention.

  In step S301, the point management unit 109 is activated to initialize the point data in the point DB 110. 6 and 21 show an example of data stored in the point DB 110 in a table format.

  FIG. 6 is a list for accumulating point information of each subject, and shows a column 601 representing the identifier of each subject, a column 602 representing the point of each subject, and a column 603 representing the total number of times each subject has been shot.

  FIG. 21 is table data representing variables in the system, and shows the total number of times 2101 of shooting in the system up to the present time and the number of people 2102 at places where shooting is possible in the system. It should be noted that the number of people 2102 at a place where photographing can be performed in the system is a parameter used when adjusting the points to be added according to the number of people, and is not used in this embodiment.

  The point management unit 109 is necessary when calculating the point or point corresponding to the requested subject identifier from the database described in the format of FIG. 6 or FIG. It has a function to acquire information and a function to set. At initialization, the point is set to 0.

  In step S302, the target position specifying unit 108 is activated to specify a subject existing at a position where photographing can be performed, and the coordinates of the subject are acquired. The acquired identifier and position of the subject are notified to the equal selection control unit 103 in the format shown in FIG.

  FIG. 5 shows an example of data to be transmitted from the target position specifying unit 108 to the equal selection control unit 103 in a table format. A column 501 representing the subject identifier and a column 502 representing the subject coordinates are shown.

  In step S303, the point management unit 109 is activated, and the subject list existing at the position where photographing is possible acquired in step S302 is passed to acquire the point list of the subject.

  In step S <b> 304, the equal selection control unit 103 that has been notified of the shootable subject activates the shooting group configuration unit 104. The activated photographing group configuration unit 104 configures a group of subjects that can be photographed using the position information of the subject that exists at the photographable position obtained from the target position specifying unit 108.

  FIG. 12 shows the position of the group calculated by the average value of the positions of the subjects in the group. The subjects 1201, 1202 and 1203 in the group, and the average value 1204 of the subject positions are shown. The position of the group is a value that can be obtained by calculating the average of the position vectors of the subjects 1201, 1202, and 1203.

  FIG. 8 shows an example of a control message transmitted to the imaging control unit 102. A target coordinate 801 for focusing the camera, a length of time 802 for photographing, and a zoom amount 803 are shown. An average value of the position of the subject is set as the target coordinates, and a result calculated from the position of the subject and the position of the camera is set as the zoom amount.

  FIG. 17 shows an algorithm for grouping subjects. This algorithm is executed inside the photographing group configuration unit 104.

  In step S <b> 1701, the position of the subject is acquired from the target position specifying unit 108. Also, it is initialized that all subjects do not belong to the group.

  In step S1702, a search is made for a pair having the shortest distance between a group and subjects not belonging to the group.

  In step S1703, it is determined whether the distance of the searched pair is equal to or less than a certain distance. If it is below a certain value, the process proceeds to S1704, and if it exceeds a certain value, the process is terminated.

  In step S1704, the subject or group pairs obtained in step S1703 are combined into one group, and the process returns to step S1702.

  FIG. 14 shows a grouping state when the algorithm of FIG. 17 is used. Since the grouping is performed in order from the pair with the shortest distance, the subjects 1401 and 1402, the subjects 1404 and 1405, and the subjects 1406 and 1407 are grouped in this order. Eventually, they are grouped into two groups 1408 and 1409.

  The group 1408 includes subjects 1401, 1402, and 1403, and the group 1409 includes subjects 1404, 1405, 1406, and 1407. This description is an example of a grouping algorithm, and the present invention is valid even if this method is not used.

  Returning again to FIG. 3, in step S <b> 305, the equal selection control unit 103 activates the group point calculation unit 106. Group points are calculated using the subject information of the subjects in the group obtained in step S304 and the point list of each subject obtained in step S303.

  In step S <b> 306, the equal selection control unit 103 activates the shooting target selection unit 105. The activated shooting target selection unit 105 selects a group having the smallest point among the points of each group obtained in step S303 as a shooting target.

  If necessary, activate the point management unit 109 to acquire the points of the subject in the selected group, and if there is a subject whose point is lower than a certain point by a certain point compared to the point in the group, Select as.

  FIG. 15 shows an example of subject selection. A subject 1501 with 20 acquisition points, a subject 1502 with 20 acquisition points, a subject 1503 with 0 acquisition points, a subject 1505 with 50 acquisition points, and a subject 1506 with 60 acquisition points are shown.

  A subject 1501, a subject 1502, and a subject 1503 belong to a group 1504, and a subject 1505 and a subject 1506 belong to a group 1507. The points of the group 1504 are an average of 13.33 points of the subjects 1501, 1502 and 1503, and the points of the group 1507 are an average of 55 points of the subjects 1505 and 1506.

  That is, since the group 1504 has smaller points than the group 1507, the photographing target selection unit 105 selects the group 1504. Also, if the point of the subject 1503 is low at 0 points and 13.33 points compared to the 13.33 point that is the point of the group 1504, and this number is smaller than a predetermined threshold value, the subject 1503 is selected. However, the present invention can be realized even if there is no processing for selecting only a subject, not a group.

  In step S307, the shooting control unit 102 is activated, and the shooting unit (camera) 101 is controlled toward the position of the group selected in step S304, and shooting is performed for a certain period of time. For example, shooting is performed for 10 seconds. The method for calculating the position of the group is an average value of the positions of the subjects in the group.

  As for the zoom amount control method, a method for controlling all the subjects in the group to be within the viewing angle, a method for controlling the size of the selected subject according to the distance from the subject, and the zoom amount are not changed. There are a method and a method of changing the zoom amount according to the shooting time. There is also a method for allowing the user to specify. Here, a method of controlling so that all the subjects in the group are just within the viewing angle is adopted.

  In step S308, first, the identification information of the subject selected by the shooting target selection unit 105 is notified to the point management unit 109, and the point of the subject selected by the shooting target selection unit 105 is acquired from the point management unit 109. . Next, the acquired point of the specific subject is updated using a pre-defined update formula as shown in FIG.

  Next, the updated point is notified to the point management unit 109 and the point is written in the point DB 110. Finally, a request is issued to the point management unit 109 to update the points of all subjects using the update formula as shown in FIG.

  FIG. 18 shows a general formula of a point update formula applied to the subject selected by the point update unit 107. The update formula 1801 is an expression in which the current point of the subject, the size of the subject, the total number of times of shooting of the subject, and the total number of times of shooting of the system are input. Even if other input values are included or some of these input values are not specified, the present invention is established.

  FIG. 7 shows a specific example of the point update formula 1801. An update formula 701, which is a specific example of the update formula 1801, is an expression in which the current point of the subject, the size of the subject, the total number of shots of the subject, the total number of shots of the system, the newly acquired points, and the reference size are input. . The newly acquired points and the reference size are constants defined in advance in the system. A term 702 for increasing the point addition amount in proportion to the size and shooting time of the subject is shown.

  The point update formula 1801 has a linear correlation such that when the subject size is doubled, the added points are also doubled. Due to this characteristic, the amount of score addition becomes larger and the shooting time becomes shorter when the image is photographed larger than when it is photographed smaller.

  Further, when the number of times of photographing is doubled, the update formula is executed as many times as the number of times of photographing, so that the total points to be added have a linear correlation such that the total points are doubled. Due to this characteristic, there is a feature that as the number of times of photographing increases, it becomes difficult to photograph next time.

  FIG. 16 shows a specific example of the point update formula. A point update formula 1601 and a term 1602 for reducing past points are shown. According to the item 1602, the point does not become large and it is easy to shoot even if the photographic subject has been photographed intensively in the past if it has not been photographed at all after that because the majority of the subjects are not within the shootable range.

  The point update formula 1601 is a formula that halves the points when the number of times of shooting is reduced by half the number of points, and the constant number of half-points represents the number of shootings required to halve the points.

  When the point update formula 1601 is executed for the total number of times of photography, the constant “0.5 ^ (1 / point half number of times)” is accumulated for the total number of times of photography, and the points decrease exponentially.

  If the number of shots from an arbitrary time is equal to the number of half-points, the number of points is halved. The subject in the room from the front has more points than the newly entered subject, so the number of subjects in the room from the front is reduced, and only the newly entered subject is photographed intensively. It is difficult to create a situation that would

  An example will be described in which there is only the subject A in the room, and the subject B enters the room after the subject A enters the room and the photographing is finished three times. However, 10 points are awarded for each shooting.

  In this case, if there is no point updating formula 1601 that has the effect of attenuating the point, the subject B is photographed three times in succession, but there is a point updating formula 1601 that attenuates the point in half for each photographing. Are taken in the order of subject B → subject A → subject B.

  Thus, only the new subject is not photographed by the effect of the point update formula 1601. Also, the shorter the number of halves, the higher the pace at which points are reduced, and the effect of alleviating the prevention of concentration of shooting on some subjects.

  In order to make it easy to grasp the image of the camera control system, FIG. 20 shows examples of values of constants used in the camera control system. In the shooting time 2001 per shot, the shooting time per shot is assumed to be 60 seconds. In the new acquisition points 2002 per time, the new acquisition points per time was 10 points.

  Further, in the time 2003 in which the points acquired in the past are halved, the time in which the points acquired in the past are halved is 600 seconds. In the reference subject size 2004, the reference subject size is 300 pixels. The values shown in FIG. 20 are examples, and the present invention is established regardless of these units and values.

  In the first embodiment, a subject that moves in and out of the space is photographed in a space in which the presence / absence and position of the subject can be specified. At the time of shooting, a group including a plurality of subjects is selected, and shooting is performed with a good balance while updating only the points of the subjects in the selected group. A suitable example is to take a picture of a participant who is moving or talking while creating an appropriate group at a party venue.

  In the present embodiment, it is assumed that a place within the viewing angle of the indoor photographing unit 101 is a place where photographing is possible, and a subject existing at the place where photographing is possible is selected and photographed. Further, the points are calculated using the shooting size in the video of the shot subject, the shooting time for one subject, the total shooting time or the number of times of the camera control system, and the like.

  Similarly, the points are calculated using the total shooting time or number of times of each subject, the elapsed time after entering the place where the subject can be shot, the past points of each subject, and the like.

  This prevents shooting irregularities such as shooting objects that have not existed for a long time in places where they can be photographed, intensively after entering the place where they can be photographed, or if only some subjects are photographed in a large size. It becomes possible to do.

(Second Embodiment)
Since the only difference in structure between the camera control system of the second embodiment and the camera control system of the first embodiment is the point update unit 107, the point update unit 107 will be described below.

  FIG. 2 shows a detailed structural diagram of the point update unit 107.

  In FIG. 2, the point update unit 107 adjusts the amount of points to be updated among a plurality of subjects when an update target selection unit 201 that selects a target for updating points and a plurality of targets to be updated are found. An update amount adjustment unit 202 is provided. However, if the points to be updated are limited to the subjects in the group selected by the imaging target selection unit 105, the update target selection unit 201 is not necessary.

  FIG. 9 shows an example of a subject selected by the update target selection unit 201. An imaging apparatus (corresponding to the imaging unit 101 in FIG. 1) 901 is an apparatus for imaging a subject. A subject 902, a subject 903, and a subject 904 are subjects belonging to the selected group.

  A subject 905 is a subject outside the selected group and not included in the viewing angle of the photographing apparatus 901. A subject 906 is a subject that is outside the selected group but is within the viewing angle of the photographing apparatus 901.

  In this case, since the subject 902, the subject 903, and the subject 904 are points to be updated, the update target selection unit 201 selects them. In addition, the subject 906 is photographed although not intended, and is selected by the update target selection unit 201 because it is a point update target.

  When the update amount adjustment unit 202 finds a plurality of points to be updated, the update amount adjustment unit 202 adjusts the point addition amount between the plurality of subjects. Adjustment is performed using one of the following two types of point distribution methods.

  The first is a distribution method in which points are added to all the subjects in the group in the same manner regardless of the number of subjects included in the group selected by the photographing target selection unit 105, and a plurality of subjects are photographed simultaneously. This distribution method is effective when the degree of satisfaction of the image viewer for the image is high.

  A second distribution method distributes points to each subject according to the number of subjects included in the group selected by the photographing target selection unit 105, the number of subjects selected by the update target selection unit, and the like. This distribution method is effective when the degree of satisfaction of the image viewer is low with respect to images in which a plurality of subjects are photographed simultaneously.

  In the present embodiment, the second distribution method is adopted. FIG. 10 is a diagram showing “weights of points to be added” when four subjects are photographed at the same time when each distribution method is used. Rows 1001 and 1002 represent the specific gravity of the addition points in each distribution method.

  This is a case where the row 1001 is a distribution method in which points are added in the same manner when only one person is selected by the update target selection unit 201 or when a plurality of persons are selected. A row 1002 is a distribution method in which points divided by the number of subjects selected by the update target selection unit 201 are distributed to each subject.

  On the other hand, columns 1003, 1004, 1005, and 1006 represent subjects selected as shooting targets. The column 1003 is the subject A selected as the shooting target, the column 1004 is the subject B selected as the shooting target, the column 1005 is the subject C selected as the shooting target, and the column 1005 is selected as the point update target. Subject E.

  FIG. 19 shows a general formula of the point update formula when a weight is added to the point addition amount. In the point update formula 1901, the points before the update, the size of the subject, the total number of times of shooting of the subject, the total number of times of shooting of the entire system, and the weight of the points to be added are input. Compared to the update formula 1801 without weight, it is characterized in that an input of weight representing the importance of the subject is added. The present invention is established even if any of these is not included, or even an expression including an additional input.

  FIG. 11 is an example of an update formula in the point update unit 107. In the update formula 1101 for the subject selected by the update target selection unit 201, the point before the update of the outer subject, the new acquisition point, the size of the subject, the reference size, the total number of times of photographing of the subject, and the total number of times of photographing of the entire system are obtained. It is an expression for input.

  Newly acquired points and reference sizes are constants defined in the camera control system. In this embodiment, the point update unit 107 internally holds these constants, but is managed by the point DB 110. It is also good. In the point update amount 1102, the updated point is obtained by substituting the weight of the added point obtained by the update amount adjustment unit 202 into the point update formula 1101.

  FIG. 4 shows an operation flow of the second embodiment of the present invention. As in the first embodiment, the values shown in FIG. 20 are used in the second embodiment as well, but the values shown in FIG. Instead, the present invention is established.

  In step S401, the point management unit 109 is activated and the point data in the point DB 110 is initialized. 6 and 21 show an example of data stored in the point DB 110 in a table format. 6 and 21 have been described in the section of the first embodiment.

  The point management unit 109 has a function of acquiring a point corresponding to the identifier of the requested subject and a function of setting the point from the database described in the format of FIG. At initialization, the point is set to 0.

  In step S <b> 402, the target position specifying unit 108 is activated to specify a subject that exists at a position where photographing is possible, and acquire the coordinates of the subject. The acquired subject identifier and position are notified to the equal selection control unit 103 in the format shown in FIG. FIG. 5 has been described in the section of the first embodiment.

  In step S403, the point management unit 109 is activated, and the subject list existing at the position where photographing is possible acquired in step S402 is passed to acquire the point list of the subject.

  In step S <b> 404, the equal selection control unit 103 that has been notified of the subject that can be photographed activates the photographing group configuration unit 104. The activated photographing group configuration unit 104 configures a group of subjects that can be photographed using the position information of the subject that exists at the photographable position obtained from the target position specifying unit 108.

  In step S <b> 405, the equal selection control unit 103 activates the group point calculation unit 106. A group point is calculated (calculated) using the subject information of the subject in the group obtained in step S404 and the point list of each subject obtained in step S403.

  In step S <b> 406, the equal selection control unit 103 activates the shooting target selection unit 105. The activated shooting target selection unit 105 selects a group having the smallest point among the points of each group obtained in step S403 as a shooting target.

Also, the point management unit 109 is activated to acquire the points of the subject in the selected group, and if there is a subject whose point is extremely low compared to the point of the group, the subject with the lower point is selected as the subject to be photographed There may be processing to do.
The point corresponding to the identifier of the subject existing in the shootable range obtained from the target position specifying unit 108 is acquired. The shooting target selection unit 105 that has acquired the points selects a subject having the smallest point from the acquired points.

  In step S407, the shooting control unit 102 is activated, and the shooting unit (camera) 101 is controlled toward the position of the group selected in step S404, and shooting is performed for a certain period of time. For example, shooting is performed for 10 seconds. The method for calculating the position of the group is an average value of the positions of the subjects in the group.

  As for the zoom amount control method, a method for controlling all the subjects in the group to be within the viewing angle, a method for controlling the size of the selected subject according to the distance from the subject, and the zoom amount are not changed. There are a method and a method of changing the zoom amount according to the shooting time. There is also a method for allowing the user to specify. Here, a method of controlling so that all the subjects in the group are just within the viewing angle is adopted.

  FIG. 12 shows the position of the group calculated by the average value of the positions of the subjects in the group. FIG. 12 has been described in the first embodiment.

  FIG. 8 has been described in the first embodiment. An average value of the position of the subject is set as the target coordinates, and a result calculated from the position of the subject and the position of the camera is set as the zoom amount.

  In step S <b> 408, the update target selection unit 201 is activated to specify a target whose points are to be updated. As described above, the update target selection unit 201 selects not only subjects in the selected group but also other subjects within the viewing angle of the photographing unit 101.

  In step S409, first, the identification information of the subject selected by the imaging target selection unit 105 is notified to the point management unit 109, and the point of the subject selected by the update target selection unit 201 is acquired from the point management unit 109. .

  Next, the acquired points are updated using the update formula shown in FIG. The weight of the points to be added in the update formula is 1/3 when only three people included in the group are photographed. Next, the updated point is notified to the point management unit 109 and the point is written in the point DB 110. Finally, a request is issued to the point management unit 109 to update the points of all subjects using the update formula as shown in FIG.

  In step S410, it is determined whether or not to continue shooting. If it is not necessary to stop shooting in response to a request from the user or the like, the process returns to step S402. If a cancellation request has been received, the process is terminated.

  The second embodiment shows an example of adjusting the point of a subject that happens to be captured instead of updating the point of only one subject selected as a target to be photographed. By adding the points of the subject that happened to be captured, it is possible to set points according to the actual shooting situation, and to shoot more evenly than in the first embodiment.

  In addition, it often happens that the target subject is poorly reflected due to the subject that happens to be captured, or that the subject that is accidentally captured is not good. In consideration of these characteristics, we will shoot more evenly by incorporating a mechanism that reduces the number of points given to one subject in a video in which multiple people are shown at the same time rather than a video in which one person is shown. Enable.

(Third embodiment)
As shown in FIG. 22, the camera control system includes a photographing unit 101, a photographing control unit 102, an equal selection control unit 103, a point management unit 109, a point DB 110, a communication unit 112, and a target position specifying unit 108. The equal selection control unit 103 includes a shooting group configuration unit 104, a shooting target selection unit 105, a group point calculation unit 106, a point update unit 107, and a subject tracking unit 111. The communication unit 112 is connected to an external display unit 115 via the network 114. However, the present invention is established without the communication unit 112.

  Only portions different from the first embodiment shown in FIG. 1 will be described.

  The subject tracking unit 111 is a device that calculates parameters to be passed to the imaging control unit 102, such as extracting characteristic positions and sizes of groups. The subject tracking unit 111 calculates a tracking position and a wide angle from the position of each subject selected by the imaging target selection unit 105, and performs control so that the entire subject in the group is captured. The subject tracking unit 111 uses the position of the subject selected by the shooting target selection unit 105 to calculate the minimum wide angle required for shooting all of the subjects. In addition, the subject tracking unit 111 calculates a wide angle so that the right end and left end subjects among the subjects selected by the imaging target selection unit 105 are displayed with a certain margin or more from the video frame.

  The communication unit 112 is a device for distributing the video obtained from the imaging unit 101 to the client via the network 114.

  The display unit 115 is a device for displaying the video distributed from the communication unit 112.

  The operation flow of the third embodiment shown in FIG. 22 is the same as the operation flow of the first embodiment shown in FIG.

  FIG. 23 shows the minimum wide angle required for photographing a specific subject. A photographing device 2301 (the photographing unit 101 in FIG. 22), a subject 2302 to be photographed, and a wide angle 2303 that is minimum required when photographing the subject 2302 with the photographing device 2301 are shown. In addition, the orientation 2304 of the imaging device 2301 is shown.

  As can be seen from the figure, the wide angle 2303 is a value that can be calculated from the position and orientation of the photographing device 2301 and the position and size of the subject 2302. Accordingly, the wide angle 2303 sets the orientation of the subject to be imaged and sets a general value such as 50 cm for the size of the subject. From the position information of the imaging device 2301 and the subject 2302 known in this system, It can be calculated.

  As a method for setting the orientation of the photographing apparatus when tracking a plurality of subjects, there are a method for setting the focus to the average position of the subjects, a method for setting the right and left subjects so that they are arranged in symmetrical positions, etc. . The former method has a good balance of appearance, and the latter method has a feature that the size of the subject can be photographed larger than the former.

  FIG. 24 shows the minimum wide angle required when determining the shooting direction so as to track the average position of the subject. The wide-angle left side 2406 and the wide-angle right side 2407 in which the imaging device 2401, the subjects 2402, 2403, and 2404 to be photographed, the average position 2405 of the in-group subject, the wide-angle left side 2406, and the wide-angle right side 2407 are shown have the same value.

  In the figure, the subject 2402 is present at the left end and the subject 2404 is present at the right end, and the subject 2404 is in a position that requires a larger wide angle than the subject 2402, so that the subject 2404 is captured in order to capture all the subjects. A wide angle is set according to the position. This wide angle is a value that can be calculated from the position and size of the subject to be tracked and the position and orientation of the photographing apparatus.

  FIG. 28 shows an example of an image shot in the case of FIG. An image frame 2801, subjects 2802, 2803, and 2804, and an average position 2805 of the subject are shown. The subject 2802 corresponds to the subject 2402, the subject 2803 corresponds to the subject 2403, and the subject 2804 corresponds to the subject 2404. All the subjects being tracked are photographed, and it can be said that the subjects are arranged in a well-balanced manner.

  Although FIG. 28 shows a well-balanced image, there is no right-side margin, but there is some left-side margin, so it is expected that some people seem to have a bad left-right balance. In order to satisfy such a requirement, it is conceivable to add a margin to the left and right.

  FIG. 29 shows an example of an image obtained by shooting with margins set on the left and right in addition to the case of FIG. An image frame 2901, subjects 2902, 2903, and 2904, an average position 2905 of the subject, a margin 2906 added to the left side, and a margin 2907 added to the right side are shown.

  The subject 2902 corresponds to the subject 2402, the subject 2903 corresponds to the subject 2403, the subject 2904 corresponds to the subject 2404, and the left margin 2906 and the right margin 2907 are given in advance as user setting parameters.

  FIG. 25 shows the minimum wide angle required when the photographing direction is determined so that the right and left subjects are photographed at symmetrical positions. An imaging device 2501, subjects to be photographed 2502, 2503, and 2504, a wide-angle left side 2505, and a wide-angle right side 2506 are shown.

  As shown in the figure, the subject 2502 exists at the left end and the subject 2504 exists at the right end, and the orientation of the photographing apparatus 2501 is set so that these subjects are left-right symmetric, and these subjects are all in a wide-angle range. A wide angle is set so as to be within the range. This wide angle is also a value that can be calculated from the position and size of the subject to be tracked and the position and orientation of the photographing apparatus.

  FIG. 26 shows an example of an image shot in the case of FIG. An image frame 2601 and subjects 2602, 2603, and 2604 are shown. The subject 2602 corresponds to the subject 2502, the subject 2603 corresponds to the subject 2503, and the subject 2604 corresponds to the subject 2504. The feature is that all the subjects being tracked are shot at the maximum size.

  In FIG. 26, since the margin amount is zero on both the left and right sides, it is expected that some people would be cramped. However, in order to satisfy such a requirement, it is conceivable to add a margin as in FIG.

  FIG. 27 shows an example of an image obtained by shooting with margins set on the left and right in addition to the case of FIG. An image frame 2701, subjects 2702, 2703, and 2704, a margin 2705 added on the left side, and a margin 2706 added on the right side are shown.

The subject 2702 corresponds to the subject 2502, the subject 2703 corresponds to the subject 2503, the subject 2704 corresponds to the subject 2504, and the left margin 2705 and the right margin 2706 are given in advance as user setting parameters.
(Fourth embodiment)
The only difference in structure between the camera control system of the fourth embodiment and the camera control system of the third embodiment is only the point update unit 107. The configuration of the point update unit 107 is the same as that of the second embodiment shown in FIG.

  In addition, the operation flow will be described only with a difference from the operation of the second embodiment with reference to FIG.

  In FIG. 4, in step S <b> 407, the subject tracking unit 111 is activated, and appropriate control parameters for photographing the subject group selected by the photographing target selection unit 105 are calculated. The parameters calculated here are basic parameters used when controlling the photographing apparatus such as the orientation or photographing position of the photographing apparatus, wide angle, or zoom amount.

  The orientation of the photographing device (camera) is set so as to pass through a representative position of the subject group such as the average of the subject positions and the center position. That is, the orientation of the photographing apparatus is calculated from the position of the subject. The wide angle is a wide angle at which all the subjects to be photographed are photographed, and this is also calculated from the position of the subject. However, there are variations in the control method of the photographing apparatus after selecting the subject, such as making the zoom amount constant, and the present invention can be realized without the processing of the subject tracking unit 111.

  Next, the imaging control unit 102 is activated, and the imaging unit 101 is controlled toward the position of the group selected in step S404 to start imaging. When performing tracking shooting, the subject tracking unit 111 continues to transmit parameters to the shooting control unit 102 until a tracking shooting end notification signal is received.

  The imaging unit 101 receives the parameters and performs imaging, and the video obtained by the imaging unit 101 is transmitted to the display unit 115 via the network using the communication unit 112 and displayed.

  It should be noted that the present invention can be realized without the processing of the subject tracking unit 111, such as not tracking after the start of shooting. The tracking shooting end notification signal is generated after a certain time, for example, 5 seconds, or when the amount of movement of the subject exceeds the threshold after starting shooting if necessary.

  8, 23, 24, 25, 26, 27, 28, and 29 have been described in the first to third embodiments.

  As a method for setting the orientation of the photographing apparatus when tracking a plurality of subjects, there are a method for setting the focus to the average position of the subjects, a method for setting the right and left subjects so that they are arranged in symmetrical positions, etc. . The former method has a good balance of appearance, and the latter method has a feature that the size of the subject can be photographed larger than the former.

  As a method of further improving the balance of appearance, there is a method of setting left and right margins as shown in FIGS.

  The object of the present invention is achieved by executing the following processing. That is, a storage medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is the process of reading the code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above-described embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on an instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, a case where the functions of the above-described embodiment are realized by the following processing is also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

It is a figure which shows roughly the structure of the camera control system which concerns on the 1st Embodiment of this invention. It is a figure which shows roughly the principal part structure of the camera control system which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the procedure of the camera control process performed by the camera control system of FIG. It is a flowchart which shows the procedure of the camera control process performed by the camera control system of FIG. It is a figure which shows an example of the data transmitted to the equal selection control part from the target position specific | specification part in FIG. It is a figure which shows an example of the data accumulate | stored in point DB in FIG. It is a figure which shows the example of the point update type | formula applied to the selected to-be-photographed object in the point update part in FIG. It is a figure which shows an example of the message for control transmitted to the imaging | photography control part in FIG. It is a figure which shows an example of the to-be-photographed object which updates a point in the point update part in FIG. It is a figure which shows an example of the numerical value at the time of adjusting the update amount of a point between several subjects in the point update part in FIG. It is a figure which shows an example of the update type | formula of the point update part in FIG. It is explanatory drawing of the definition of the position of a group. It is explanatory drawing of the definition of a to-be-photographed object size. It is explanatory drawing of the flow of subject grouping. It is explanatory drawing of selection of a group. It is a figure which shows an example of the point update type | formula applied to all the subjects in the point update part in FIG. This is an algorithm for grouping subjects. It is a figure which shows the general formula of the update type with respect to the to-be-photographed object selected as imaging | photography object. It is a figure which shows the general formula of the update type with respect to the to-be-photographed object selected as point update object. It is a figure which shows the constant of the camera control system of FIG. It is a figure which shows the variable of the camera control system of FIG. It is a figure which shows schematically the structure of the camera control system which concerns on the 3rd Embodiment of this invention. It is a figure which shows the wide angle of the magnitude | size minimum required when image | photographing a to-be-photographed object. It is a figure which shows an example of the wide angle of the minimum required magnitude | size when carrying out tracking imaging | photography of the average position of several to-be-photographed objects. It is a figure which shows an example of the wide angle of the minimum required magnitude | size when carrying out tracking imaging | photography of the center part of a to-be-photographed object group. It is a figure which shows an example of the image | video obtained when tracking imaging | photography of the center part of a to-be-photographed group. It is a figure which shows an example of the image | video obtained when tracking imaging | photography of the center part of a to-be-photographed group. However, margins are added to the left and right of the video. It is a figure which shows an example of the image | video obtained when tracking imaging | photography of the gravity center part of a to-be-photographed group. It is a figure which shows an example of the image | video obtained when tracking imaging | photography of the gravity center part of a to-be-photographed group.

Explanation of symbols

101 photographing unit 102 photographing control unit 103 equal selection control unit 104 photographing group configuration unit 105 photographing target selection unit 106 group point calculation unit 107 point update unit 108 target position identification unit 109 point management unit 110 point DB
111 Subject Tracking Unit 112 Communication Unit 113 Camera Control Device 114 Network 115 Display Unit 201 Update Target Selection Unit 202 Update Amount Adjustment Unit

Claims (25)

Photographing means for photographing the subject;
Photographing control means for controlling the operation of the photographing means;
Target position specifying means for identifying a subject and specifying the position of each subject;
Point accumulation means for accumulating points indicating the shooting status of each subject;
Point management means for reading and writing points of each subject with respect to the point accumulation means;
An equal selection control means for transmitting information of the photographing target to the photographing control means based on the points accumulated in the point accumulating means and predetermined group information composed of the respective subjects;
A camera control system comprising: The equal selection control means includes:
Shooting group configuration means for calculating a group of subjects according to the distance between each subject;
Group point calculation means for calculating points of the entire group from the points of each subject obtained from the point management means;
A shooting target selection means for determining a shooting group based on the size relationship of the points obtained from the group point calculation means and the position information obtained from the target position specifying means;
Point updating means for updating the point of the subject selected by the photographing target selecting means;
The camera control system according to claim 1, further comprising:   The photographing group forming unit forms a group by grouping subjects and groups that are close to each other, and creates a group including a large number of subjects while repeating group reconfiguration as necessary. The camera control system according to claim 2.   4. The camera control system according to claim 3, wherein the photographing group constituting unit calculates the distance between the subject and the group, and the distance between the group and the group, regarding the average position of the subject within the group as the group position. .   3. The camera control system according to claim 2, wherein the group point calculation means uses an average value of points of all subjects in the group as a group point.   The camera control system according to claim 2, wherein the photographing target selecting unit selects a group having the smallest point among the group points obtained from the group point calculating unit.   3. The camera control system according to claim 2, wherein the photographing target selecting unit selects a subject when there is a subject having extremely few points in the group having the smallest point.   The point update means includes a shooting size in the video of the photographed subject, a single photographing time for the subject, a total photographing time or number of times of the photographing means, a total photographing time or number of times of each subject, and a place where the subject can be photographed. 3. The camera control system according to claim 2, wherein a point is calculated from an elapsed time since entering and some of past points of each subject.   The camera control system according to claim 2, wherein the point accumulating unit performs an update process so as to reduce all points according to an elapsed time.   9. The camera according to claim 8, wherein the point update means includes update amount adjustment means for adjusting a weight for a point to be added to each subject according to the number of subjects selected by the photographing target selection means. Control system.   The point update unit is an update target selection unit that selects a subject that falls within the viewing angle of the photographing unit among other subjects existing at a distance similar to the target position obtained by the target position specifying unit. The camera control system according to claim 2, further comprising: updating a point of the subject selected by the update target selection unit.   12. The camera according to claim 11, wherein the point update unit includes an update amount adjustment unit that adjusts a weight for a point to be added to each subject according to the number of subjects selected by the update target selection unit. Control system.   The camera control system according to claim 12, wherein the update amount adjustment unit adds points to all the subjects selected by the update target selection unit.   13. The camera control system according to claim 12, wherein the update amount adjusting means adjusts a point to be added according to the number of photographed subjects.   The update amount adjustment unit distributes points by providing a constant weight between the subject selected by the imaging target selection unit and the non-selected subject among the subjects selected by the update target selection unit. The camera control system according to claim 12, wherein the camera control system is adjusted.   3. The group according to claim 2, wherein the photographing group constituting unit recalculates the group at a timing when the number of subjects included in the photographable region increases or decreases or when a certain amount of movement of the subject is detected. Camera control system.   The equal selection control means includes subject tracking means for extracting the characteristic size and position of the group using the position of each subject obtained from the photographing target selection means and tracking the subject group as a group. The camera control system according to claim 2, wherein:   18. The subject tracking unit calculates a tracking position and a wide angle from the position of each subject selected by the photographing target selection unit, and controls so that the entire subject in the group is photographed. Camera control system.   The camera control system according to claim 17, wherein the subject tracking unit sets a position of the center of gravity calculated from the position of each subject selected by the photographing target selection unit.   18. The camera control system according to claim 17, wherein the subject tracking unit is configured to track the center position of the right end and left end subjects among the subjects selected by the photographing target selection unit.   18. The subject tracking unit calculates a minimum wide angle required for photographing all of the subject using the position of the subject selected by the photographing target selecting unit. Camera control system.   18. The subject tracking unit calculates a wide angle so that a right end subject and a left end subject among the subjects selected by the photographing target selecting unit are displayed with a certain margin or more from the video frame. Camera control system. A shooting step for shooting the subject;
A shooting control step for controlling the operation of the shooting step;
A target position specifying step for identifying a subject and specifying the position of each subject;
A point accumulation step for accumulating points indicating the shooting status of each subject;
A point management step of reading and writing points of each subject with respect to the point accumulation step;
Based on the accumulated points and predetermined group information composed of each of the subjects, an equal selection control step of transmitting information on the shooting target to the shooting control step;
A camera control method comprising: In a program for causing a computer to execute a camera control method,
The camera control method includes:
A shooting step for shooting the subject;
A shooting control step for controlling the operation of the shooting step;
A target position specifying step for identifying a subject and specifying the position of each subject;
A point accumulation step for accumulating points indicating the shooting status of each subject;
A point management step of reading and writing points of each subject with respect to the point accumulation step;
Based on the accumulated points and predetermined group information composed of each of the subjects, an equal selection control step of transmitting information on the shooting target to the shooting control step;
A program comprising:   A computer-readable storage medium storing the program according to claim 26.

Images