JP2004363775A - Photographing system and method for supplying image distribution - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing system which can provide inexpensive photographing service with which photographing time can almost uniformly be distributed to respective photographing objects and to provide a supplying method of distribution. <P>SOLUTION: In an automatic photographing device 10, a camera 12a mounting a wide angle lens and a camera 12b mounting a telephoto lens photographing a narrow angle of view are arranged in a camera part 12. Dynamic image data 12c obtained by photographing a person being the object is set to an individual specification part 14. The individual specification part 14 collates identification information which is previously registered with image data on the obtained object, and the image data and identification information, which are matched in collation, are made into a group. It is supplied to a dynamic image accumulation part 16 so as to record it. A camera control part 20 is controlled so that the group of recorded image data with less accumulation time is accumulated by an image selection part 18. The camera 12b is controlled by the camera control part 20 so as to photograph it. Accumulation time as image files of the respective groups is accumulated in an almost same degree. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a photographing system and a method of providing an image distribution service thereof, and the present invention is suitably applied to an automatic photographing apparatus that performs tracking and photographing while editing a photographing target while also performing editing. The present invention relates to a method for providing a purchaser with a moving image photographed by an automatic photographing device, for example.
[0002]
[Prior art]
In recent years, portable video devices such as video cameras and digital cameras have become widespread at home. This spread depends not only on the fact that these video devices have become affordable prices, but also on the growing demand for keeping a record of their own relatives' lives. For example, many parents take home video cameras purchased by individuals and photograph their children at the entrance ceremony, graduation ceremony, athletic meet, excursion event, etc. of their child's kindergarten and nursery school.
[0003]
However, there are several problems with personal photography. First, during the shooting period, the photographer cannot see events and the like live. This implies that there are conflicting demands for photographers, such as a desire to photograph and record their children at sports days and the like, and a desire to support them by watching their children's competition scenes live. Second, it is difficult to obtain high-quality images. This is because most photographers do not have advanced photographing techniques. Third, cases of worsening of the manners of photography have become remarkable. As a result of such cases increasing with the number of individual photographers, in kindergartens and nursery schools, events have begun to regulate photography. Fourth, there is a case where it is impossible to take a picture due to restrictions on a place where a picture can be taken and a time limit. In kindergartens and nursery schools, it is difficult for parents to take pictures of their children's daily living attitudes, excursions or outdoor classes without parents.
[0004]
In recent years, services for taking pictures have increased. This service includes a specific personal photographing service and a general photographing service. The former service is, for example, a service for selling a video edited by photographing an individual at a wedding or a presentation. This photographing service has an advantage that the photographing is performed mainly by a person to be photographed since a so-called professional photographer performs photographing, so that there is little out-of-focus image and good quality. On the other hand, since the sales quantity is small due to the feature of this service, the price of the service is set to be as high as, for example, about 50,000 yen.
[0005]
In addition, the latter shooting service is a service that shoots children at kindergarten and nursery school events such as athletic meet, entrance ceremony, graduation ceremony, etc., edits it in units of classes, etc., and sells it to parents etc. . This photographing service is the same as the former photographing service in that a professional photographer performs photographing. However, since it is possible to expect a sales volume of several to several tens in one edit, it can be set to, for example, about 5,000 yen. Also, there are many places related to the garden that permit photographing in the garden because there are requests to preserve the life records of the children and to use them to appeal to attracting children. Thus, a personal video capture system has been proposed to create a personal videotape at a position selected in advance (see Patent Document 2).
[0006]
[Patent Document 1]
JP-A-11-96376
[Patent Document 2]
Japanese Patent No. 3108101.
[0007]
[Problems to be solved by the invention]
As described above, the price of a specific personal photographing service is high. In general shooting services, the recording time differs for each individual. For example, a video of a kindergarten athletic meet was purchased, but during the one hour recording time, the recording times of A and B may be taken, for example, 20 minutes and 1 minute, respectively. For this reason, each purchaser has his or her satisfaction. This problem can be solved simply by increasing the video recording time and performing individual editing. However, this solution is time consuming and labor intensive, which increases the selling price of the video and is not practical. Since it is difficult to check the contents before purchasing the product, it is desirable to hold a video screening to check the contents.
[0008]
Another problem common to both photographing services is that the user cannot immediately view a video photographed video. During the period from video shooting to sale, edits are made to improve the quality of the product, which takes time.
[0009]
An object of the present invention is to solve the drawbacks of the prior art and to provide a photographing system and a distribution method for the photographing system, which enable an inexpensive photographing service capable of distributing photographing time almost equally to each photographing object. .
[0010]
[Means for Solving the Problems]
SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention provides a first photographing means for producing image data by photographing a field of view showing a photographing range of an object field wider than a reference, and a photographing means of the first photographing means. A photographing adjustment mechanism that at least moves the photographing object moving in the field of view and enlarges / reduces the angle of view for photographing the photographing object within the range, and performs photographing at an angle of view with a narrower photographing range than the reference. A second photographing means for generating image data by controlling the photographing of the first and second photographing means, and also controlling the operation of the photographing adjustment mechanism; and a second photographing means. Target specifying means for associating the target image data with the identification information for identifying the target; information storage means for storing the identification information and the target image data as a set in association with each other; Out of the set Characterized in that it comprises a uniform selection control means for selectively controlling the to the second imaging means to increase the image data of the corresponding object relative to the small set of cumulative time.
[0011]
In the photographing system of the present invention, photographing is controlled so that the field of the second photographing means is handled in a nested state with respect to the field of the first photographing means, and the obtained image data is specified. The identification information registered in advance by the target identification means is compared with the obtained image data of the target, and the image data of the target and the identification information matched with the comparison are supplied as a set to the information storage means. The image capturing control means controls the image capturing control means to capture a set having a short storage time out of the image data stored and recorded by the equal selection control means, and controls the second image capturing means in accordance with this control. It is possible to shoot the images under the control of the means, and to accumulate the accumulation time of each set at substantially the same level.
[0012]
Further, in order to solve the above-described problem, the present invention provides a first photographing unit and a first photographing unit that generate image data by photographing with a wider angle of view indicating a photographing range of a scene than a reference. In the photographing range, the photographing apparatus includes a photographing adjustment mechanism for moving at least the photographing object moving in the field and enlarging / reducing the angle of view for photographing the photographing object. A second photographing means for photographing and generating image data; a photographing control means for controlling photographing of the first and second photographing means and also controlling an operation for a photographing adjusting mechanism; and a photographing means for photographing by the second photographing means. Target specifying means for associating the image data of the target with the identification information for identifying the target, information storage means for storing the identification information and the target image data in a set, and storing in the information storage means Of the set A photographing system including an equal selection control means for selectively controlling a second photographing means for increasing image data of a target corresponding to a set having a small accumulated time, and collecting files from an information storage means. In response to the request for the file, the delivery storage means for delivering the file to the request destination and the face image corresponding to the specified target are displayed and confirmed, and in response to the confirmation, the encoded file is transmitted from the delivery storage means. A first step of registering recognition information to be specified in advance by using an information terminal device having a function of decoding and displaying the contents of the file, and confirming the contents of the file and purchasing desired image data; A second step of photographing the photographed object and storing the photographed image data in the photographing system; and storing the accumulated image data in the photographing system as a file for each object. A third step of collecting and storing the information in the communication storage means, a fourth step of sending a request for viewing the collected file from the information terminal device to a desired target, and a step of sending the face image registered in response to the viewing request to the request destination. Distribution and display to the information terminal device for confirmation, in response to this confirmation, the encoded file from the information storage means is decoded and displayed, and the fifth content instructing the purchase of this file by confirming the contents of this file. And a sixth step of transferring the file to a transfer destination and recording the file in accordance with the confirmation of the billing process accompanying the purchase.
[0013]
In the method of providing image distribution in the imaging system of the present invention, recognition information of an object to be specified is registered in advance, image data obtained by imaging the object (individual) corresponding to the registration by the imaging system is stored as a file for each object. Collected and stored in the distribution storage means, send a request to browse the collected file of the desired target from the information terminal device, confirm the face image at the information terminal device of the browse request destination, and accumulate information according to this confirmation. The file encoded by the means is decoded and displayed by the information terminal device, the contents of the file are confirmed, the purchase of the file is instructed, and the desired image data is obtained, so that each of the registered users is satisfied. You can buy images.
[0014]
BEST MODE FOR CARRYING OUT THE INVENTION
Next, an embodiment of a photographing system according to the present invention will be described in detail with reference to the accompanying drawings.
[0015]
The present embodiment is a case where the photographing system of the present invention is applied to the automatic photographing apparatus 10. Illustrations and descriptions of parts not directly related to the present invention are omitted. In the following description, signals are indicated by the reference numbers of the connecting lines in which they appear.
[0016]
As shown in FIG. 1, the automatic photographing apparatus 10 includes a camera unit 12, a personal identification unit 14, a moving image storage unit 16, a photographed image selection unit 18, and a camera control unit 20. As shown in FIG. 2, the camera unit 12 includes two cameras 12a and 12b and a shooting adjustment mechanism. Each of the cameras 12a and 12b is a moving image capturing camera that obtains a moving image of a color image by condensing incident light taken in as a scene image via a lens onto an imaging device arranged two-dimensionally and performing photoelectric conversion. . For example, a CCD (Charge Coupled Device) or a C-MOS (Complementary-Metal Oxide Semiconductor) type device is used as the imaging device. The camera 12a is a W camera equipped with a wide-angle lens (Wide lenses). The camera 12b is a T camera equipped with a telescopic lens having a zoom function. The cameras 12a and 12b output a frame having a gradation of 24 bits per pixel of 640 dots in the horizontal direction by 480 dots in the vertical direction at a rate of 30 frames per second. It is needless to say that the cameras 12a and 12b have undergone AF adjustment (Automatic Focus control) and AE adjustment (Automatic Exposure control), not shown.
[0017]
As shown in FIG. 2, the camera 12b is controlled so that an arbitrary position can be photographed in the angle of view range 122 of the camera 12b within the angle of view range 120 of the camera 12a. In performing this control, a photographing adjustment mechanism is used. The cameras 12a and 12b can be operated by a shooting adjustment mechanism (not shown) so as to rotate in the horizontal direction and the vertical direction, that is, in the pan / tilt directions, respectively. In particular, the camera 12b is installed such that the optical axis of the camera 12b is, for example, in a horizontal plane with respect to the optical axis of the camera 12a, and rotates in a pan / tilt direction with respect to the optical axis of the camera 12b. Mirrors 124a and 124b as components are provided. The camera 12b is controlled as a slave under the control of the camera control unit 20 so as to follow the angle-of-view range 122 in accordance with the movement of the camera 12a. The camera unit 12 outputs the moving images 12c of the cameras 12a and 12b to the individual identification unit 14 in real time.
[0018]
Returning to FIG. 1, the individual identification unit 14 includes a face data registration unit 14a and an individual tracking unit 14b. The face data registration unit 14a has a registration function of reading a face photograph taken in advance and connecting the face image data and personal data taken by a digital camera and registering them as a set of data. It includes a memory for storing sets of data. The registration function includes a function of detecting a position of a face in image data and creating a template from the detected image. Note that a scanner is used to read a face photograph, and in reading with a digital camera or the like, a face region is directly cut out from an obtained image and input.
[0019]
The individual tracking unit 14b has a distance measurement calculation function, a function of matching a moving image 12c from the camera unit 12 with a template corresponding to the face image data registered in the face data registration unit 14a, and a function of matching and distance measurement. And a function of tracking the object in accordance with the movement in response to the movement.
[0020]
The distance measurement calculation function measures the distance between the camera 12a and a target person using a distance measurement sensor. Although not shown, two W cameras are installed at a fixed interval d in the horizontal direction, and the distance between the W cameras and the person is obtained from the parallax of the images obtained from the two W cameras and the interval d. You may do so. The distance measurement calculation function calculates a pan / tilt angle control amount to the photographing adjustment mechanism from the distance obtained by the distance measurement and the positional relationship between the cameras 12a and 12b.
[0021]
The matching function detects a face position for all the persons included in the moving image 12c, creates a template corresponding to the face image, and matches the template with the registered face image data template 14c. The collation will be described later. The tracking function may employ, for example, a moving object tracking method (see Japanese Patent Application Laid-Open No. H11-096376 of Patent Document 1).
[0022]
Further, the personal tracking unit 14b sets the pan / tilt angle control amount 14d corresponding to the target within the angle of view of the camera 12b so that the person photographed by the camera 12a is photographed at the center position of the angle of view of the camera 12b. This is supplied to the camera control unit 20. Then, the individual tracking unit 14b may track and photograph each person at the center position described above for each time Tl. Here, it is desirable that the time T1 is set to an appropriate value in advance by an experiment or a statistical method. Further, it becomes possible to automatically track and photograph only the designated target person. The individual identification unit 14 outputs the captured moving image 14 e to the moving image storage unit 16.
[0023]
As shown in FIG. 3, the moving image accumulation unit 16 includes at least an input / output interface unit 16a and a storage 16b, and may further include a personal extraction unit 16c and an information association unit 16d. The input / output interface unit 16a receives input of image data 14e from the personal identification unit 14, input of target selection information 16e, output of image data 16f corresponding to the selection information 16e, and output of identification information (ID: Identification) 16g. Has the function of performing The input / output interface unit 16a may be a device for reproducing / recording image data via a recording medium such as a video tape or a DVD (Digital Versatile Disk). In this embodiment, the ID information 16g includes not only an identification number, an identification symbol, and an ID number but also template data, a recording frame number, a total number of recording frames, a file name, a label information name, a date, and an address, as described later. Is also used as a generic term for information that can be associated.
[0024]
For the storage 16b, a hard disk device or an optical disk device capable of handling a large amount of moving images is used. The storage 16b also has an image storage server function. A plurality of these devices may be provided to ensure a sufficient recording capacity. The storage 16b writes the supplied moving image data 14e as a file 16h with an appropriate file name, and reads the written file 16h in response to a read request.
[0025]
The individual extraction unit 16c reads the set data 14c of the face data (of the template) corresponding to the selection information 16e of the person to be edited and the corresponding label information from the pre-registered data from the face data registration unit 14a. Keep it. The label information will be further described later. In addition, the individual extracting unit 16c reads the moving image file 16h stored in the storage 16b, and performs authentication using the template. In addition to the file whose authentication has been matched, an object in several consecutive frames is tracked, and information other than the object is obtained, that is, information 16i of the file name and the label of the object person is output to the information associating unit 16d.
[0026]
The information associating unit 16d has a function of storing the information 16i supplied from the individual extracting unit 16c, and accesses the storage 16b from the information 16i corresponding to the requested person selection information 16e, and stores the desired image data. It has a reading function. The moving image accumulating unit 16 reads the moving image thus accumulated from the input / output interface unit 16a as image data 16f.
[0027]
Returning to FIG. 1 again, the moving image storage unit 16 outputs the ID information 16g from the storage 16b to the image selection unit 18 at predetermined time intervals.
[0028]
The image selection unit 18 has a minimum ID selection function of selecting an ID having the minimum number of frames included in the supplied ID information 16g. Further, the image selection unit 18 has a control function of comparing the latest recording frame of the ID selected by the minimum ID selection function with the currently stored frame, and performing control corresponding to each comparison result. The control function determines that a person with the minimum ID is included in the frame in accordance with the comparison result, and sends a control signal to the camera control unit 20 so that the position of the person is located at the center of the angle of view of the camera 12b. 18a is output. In addition, the control function determines that the person with the minimum ID is not included in the frame in accordance with the mismatch of the comparison result, and outputs a control signal 18a for searching for the corresponding person to the camera control unit 20. At this time, the tracking shooting time is set to T2. Here, it is desirable that an appropriate value is set in advance for the time T2 by an experiment or a statistical method as in the case of the time T1.
[0029]
The camera control unit 20 outputs a control signal 20a to a photographing adjustment mechanism and a zoom function of each of the cameras 12a and 12b of the camera unit 12 according to at least one of the individual specifying unit 14 and the image selecting unit 18. When the above-described search control is performed from the image selecting unit 18, the camera control unit 20 creates a template by zooming up the persons within the operating range so that the target of the minimum ID can be checked for collation by the template. A collation process is performed, and tracking photography is performed according to the identity verification.
[0030]
With this configuration, substantially uniform image data can be automatically created for a registered object. In addition, when the photographing target is designated, image data of a desired target can be easily obtained. By reading out the image data in accordance with the information of the range including the image data for each of the photographing targets, the editing work time can be greatly reduced.
[0031]
Next, the operation of the automatic photographing apparatus 10 will be described. In this description, each process will be described by taking, as an example, shooting of a scene of commuting to school. In the automatic photographing apparatus 10, registration of face image data to be photographed is performed in advance as user registration. At the time of this registration, the user also stores information such as the user registrant name, target name, ID number, and registration date in association with the face image data. The face image data is digitized by a scanner or the like from image data or a photograph taken by a digital camera, and is taken into the face data registration unit 14a of the automatic photographing apparatus 10. It is desirable to perform registration in advance, but this registration may be performed after shooting if it is certain that the shooting target is at the shooting site.
[0032]
Registration of face image data is performed in the following procedure. First, an image including a face is shot (face image shooting). Second, from the image of the area including the face, the contour of the face is detected, the area showing the characteristic of the face such as the eyes, the nose and the mouth is detected, and the relative positional relationship thereof is detected (face position detection). Third, template data is created by normalizing feature points and the like characterizing each part of the face from the face image data by image processing (creating a template). Finally, the created template data and label information for linking the registrant are stored as a set (registration of template). As the label information, the registrant name, ID number, date and the like are used as described above.
[0033]
As shown in FIG. 2, the camera control unit 20 controls the photographing adjustment mechanism and the zoom function of the camera 12 b so as to maintain the angle of view 122 of a narrow area within the angle of view 120 of the scene captured by the camera 12 a. I have.
[0034]
Here, it is assumed that a total of nine frames have been photographed by the automatic photographing apparatus 10 as shown in FIGS. The individual identification unit 14 starts detection of persons in order from the first frame 1 image. In this example, three persons are cut out as indicated by an area surrounded by a dotted line. The individual identification unit 14 assigns identification numbers 001, 002, and 003 to the three persons as shown in the figure. With respect to the next frame, frame 2, the movement position of the person in the previous frame, frame 1, is detected using the person tracking technique, and the identification numbers 001, 002, 003 assigned in the previous frame are made to correspond. The movement position of the person is detected from the previous frame in the same manner as in the frame 2 for the frames 3 and thereafter, and is associated with each identification number. However, as shown in frames 6 and 7, when a person not present in the previous frame is detected, a new identification number is assigned so as not to overlap. In this embodiment, the frames 6 and 7 are given identification numbers 004 and 005, respectively.
[0035]
The individual specifying unit 14 specifies a person by face recognition (collation). In authentication in face recognition, face image capturing, face position detection, and template creation are sequentially performed in the same manner as in the above-described registration. Then, the similarity (R) between the created template and the template at the time of registration is calculated.
[0036]
Here, for the similarity (R), for example, a distance scale or the like is used, and the value α is set to an appropriate value in advance by an experiment or a statistical method. The conditional expression for the determination is R <α. If the similarity (R) is smaller than the value α, it is determined that the two compared templates are the same person, that is, the person. If the similarity (R) is equal to or more than the value α, it is determined that the two templates indicate other persons.
[0037]
Here, the detection of the face position and the creation of the template performed prior to the matching will be specifically described. Here, description will be made using the previous nine frames. Of the nine frames, frames 3 to 7 in FIGS. 6 and 7 are surrounded by a two-dot chain line to indicate that a face position has been detected, and a template is created for each face region. On the other hand, four frames 1, 2, 8, and 9 are frames for which face position detection or template creation could not be performed. In this way, even if the face image can be confirmed visually, the automatic imaging device 10 cannot detect the face position because the face is small and the face is tilted too much up, down, left and right, etc. In some cases, templates cannot be created.
[0038]
As shown in FIGS. 6 and 7, an identification symbol is assigned to each frame for which a template has been created. In the frame 3, since templates of three faces have been created, identification symbols 00A, 00B, and 00C are respectively added. In the next frame 4, the created templates of the two faces are compared with the previously created templates 00A, 00B, and 00C. FIG. 8 shows the comparison result. The individual identification unit 14 determines that the person on the left side of the frame 4 is the same person as the identification code 00A of the frame 3 and the person on the right side of the frame 4 is the same person as the identification code 00B of the frame 3 based on the collation result. . Therefore, the individual identifying unit 14 gives 00A to the template of the person located on the left side of the frame 4 in FIG. 6, and 00B to the template of the person located on the right side.
[0039]
In addition, in the same manner, identification symbols are assigned to frames 5, 6, and 7 in the same manner, and the assigned identification information is collected. As shown in FIG. 9, the identification symbols are assigned to the identification numbers used in each frame. It will be possible to correspond. From the results in FIG. 9, it can be seen that the identification numbers 001 and 005, and the identification numbers 003 and 004, which are assigned the same identification symbol, are the same person. This collation processing means that recognition of each of the persons to be tracked is possible.
[0040]
By the way, a new non-overlapping identification symbol is given to a template that has not been authenticated as the same person in the comparison with the template created so far.
[0041]
Further, based on this result, as shown in FIGS. 10 and 11, a new ID number is assigned to each person in each frame. Further, at the time when the ID is specified, as shown in FIG. 12, the individual specifying unit 14 sets template information, recorded frame number (recorded frame), total number of recorded frames, and latest frame as ID information as ID information. Is generated. The individual specifying unit 14 sends the moving image data 14e output from the camera unit 12 to the moving image storage unit 16 in real time via the individual tracking unit 14b. Further, it transmits the ID information 14f to the image selection unit 18. In particular, when the ID information 14f is updated after the start of the information supply, the ID information 14f is transmitted to the moving image storage unit 16 as difference data from the ID information 14f transmitted so far out of the transmitted ID information 14f.
[0042]
More specifically, the template data in the ID information is to correspond to the highest quality template data among the template data calculated for each frame, which corresponds to the number of pixels or dots occupying inside the face outline. Corresponds to the most frequently used template. The position of the person in the latest frame is represented by specifying the center position of the person corresponding to the ID number, which is photographed in the frame of the latest number in the recording frame, by using x and y coordinate values. Here, the center position is represented by coordinates of an intermediate position between the maximum value and the minimum value of the coordinates indicated by the top, bottom, left, and right of the contour portion of the face image.
[0043]
In the personal tracking section 14b of the personal identification section 14 of the automatic photographing apparatus 10, the photographed moving image data 14e including the ID information is supplied to the moving image storage section 16 and stored. The image selection unit 18 is supplied with ID information 14f from the individual identification unit 14 and ID information 16g from the moving image storage unit 16. The image selection unit selects the ID number with the smallest total number of recorded frames included in the ID information 16g. When this selection is made in FIG. 12, ID1 and ID3 whose total number of recorded frames is 7 are selected. When a plurality is selected as described above, the smaller ID number is selected.
[0044]
Further, the image selecting unit 18 acquires the latest recorded frame stored in the moving image storage unit 16 from the moving image storage unit 16. In the example described above, the frame 9 corresponds. When the number of the latest accumulation frame is the same as the latest recording frame number of ID1, the person of ID1 is included in the latest accumulation frame, and when the number is different, the person of ID1 is not photographed in the latest accumulation frame. In the former case, the person position of ID1 is acquired from the ID information 16g. In the present embodiment, (X, Y) = (230, 130). The image selection unit 18 controls the camera control unit 20 to adjust the shooting area so that this position is always at the center of the angle of view of the camera 12b.
[0045]
In the latter case, the image selection unit 18 controls the camera control unit 20 to change the field of view of the T camera, that is, the camera 12b, within the pan / tilt operation range. The camera control unit 20 zooms up to the extent that a face template can be created for each of the persons photographed under the control of the image selection unit 18. A template is created based on the image data captured by the individual identification unit 14, and the template is compared with the template of ID1, and the person determined to be the person is tracked for the capturing time T2 and captured.
[0046]
As described above, the ID number having the minimum total number of recorded frames is obtained from the ID information 16g, and the photographing is performed so as to increase the total number of recorded frames. This series of processing may be repeated F times in which an appropriate value is set in advance by an experiment or a statistical method.
[0047]
By operating in this way, it is possible to automatically control the camera so that the time of photographing a person within the photographing range becomes even, thereby reducing the labor cost required for photographing and the variation in photographing time. Can be eliminated to contribute to an increase in sales volume. The problem of manners can be solved because of automatic shooting.
[0048]
In addition, the individual specifying unit 14 can collectively photograph a specific individual by applying the function of the individual tracking unit 14b according to individual needs. It goes without saying that image data can be reliably obtained because the photographing is performed while performing authentication. In this case, since the intensive shooting is performed, the image selecting unit 18 for equalizing the individual shooting times is unnecessary. When the mode for performing such intensive photographing is selected, the automatic photographing apparatus 10 may control the operation of the image selecting unit 18 to be prohibited. Thereby, the camera control unit 20 is controlled by the control signal 14d from the individual specifying unit 14.
[0049]
Therefore, the camera control unit 20 causes the position of the specific individual designated according to this control to be tracked based on the moving image from the camera 12a, and controls the shooting adjustment mechanism for the camera 12b using the obtained position information. . The moving image captured by the camera 12b is stored in the moving image storage unit 16.
[0050]
Next, the operation of the moving image storage unit 16, particularly the editing process for the saved moving image file, will be further described. The input / output interface unit 16a performs digitization in accordance with the supplied moving image signal. The input / output interface unit 16a may be supplied with a moving image signal directly or indirectly stored in a recording medium and provided. In response to the latter case, the input / output interface unit 16a includes a reading function for reproducing a moving image from a recording medium and a writing function for recording a moving image on a recording medium. The moving image accumulating unit 16 digitizes and supplies the supplied moving image by the input / output interface unit 16a. The acquired moving image data is stored in the storage 16b with an appropriate file name given as a moving image file.
[0051]
In the automatic image capturing apparatus 10, the moving image storage unit 16 performs a personal extraction process at predetermined time intervals. The individual extraction process performs a process of extracting and specifying a designated person included in an image region photographed with respect to the image data stored in the storage 16b. Since the individual extraction unit 16c performs the processing at predetermined time intervals, the individual extraction unit 16c targets unprocessed moving image files stored from the time when the previous individual extraction processing was completed to the current time. In the individual extraction unit 16c, a person to be edited is selected in advance from the face data registration unit 14a of the individual identification unit 14 for individual identification, and the templated face data and the corresponding label information (registrant name, ID number, date, etc.).
[0052]
Next, the individual extracting unit 16c reads the moving image file from the storage 16b by designating the file name of the moving image to be edited. FIG. 13A shows a moving image of the read moving image file. The individual extraction unit 16c detects the face position of each person photographed in each frame of the read moving image, and calculates template data as face data. The individual extraction unit 16c collates the calculated template data with the template data to be edited beforehand to authenticate. The frame in which the face area is surrounded by a broken line in FIG. 13B indicates a frame registered as a person to be edited and a person registered in advance.
[0053]
Next, a person to be edited is tracked before and after this frame from the read moving image file, and a shooting range is automatically selected. The range of this selection is shown in FIG. The range indicated by the dashed arrow in FIG. 13C indicates the range of selection. Thus, a plurality of frames are selected. The tracking of the person uses the method of the individual tracking unit 14b described above. The individual extracting unit 16c supplies the information associating unit 16d with information 16i that summarizes the number of the selected frame, the name of the moving image file to be edited, and the label information of the person to be edited. The frame number is a serial number given from the top of the selected frame. The label information includes the registrant name, ID number, date, and the like described above. If there is another unprocessed moving image file in which the video of the person to be edited has been captured, the information 16i is output by repeating the reading and matching processing of the moving image file.
[0054]
Accordingly, when not only the editing target but also the information of the date and time at which editing is started is specified for a plurality of supplied moving image data, the moving image file recorded in the storage 16b is traced back based on the information. A person to be edited can be searched for, and the number of selected frames that have been shot can be increased. Furthermore, when another person is designated and edited from the saved moving image file, the above-described processing according to the designation is performed for another person to be edited.
[0055]
As described above, the information 16i corresponding to each editing is stored in the information associating unit 16d. The stored data uses a format as shown in FIG. The information associating unit 16d selects, for example, a person to be edited from the labels of all the photographing subjects based on selection information 16e from a system control unit (not shown). The selection is made using the name and ID number of the label. Then, the information associating unit 16d combines the file name of the moving image corresponding to the selected person and the number of the selected frame as read information 16j. The information associating unit 16d supplies the read information 16j to the storage 16b as a read request signal.
[0056]
The storage 16b extracts only the frame of the selected frame number from the moving image file corresponding to the file name included in the read information 16j, assigns an appropriate file name as a moving image file for individuals, and stores it. When the target person to be edited is photographed in a plurality of moving image files as shown in FIG. 14, a plurality of created personal moving image files are merged and stored as one personal moving image file. The saved personal moving image file is read out as a personal moving image file 16f by a registered user who has made a request through the input / output interface unit 16a as shown in FIG. Is written and delivered to the registered user.
[0057]
In such a reading process, if the created personal moving image file is a file format that runs on an OS (Operating System) of a personal computer (PC), the file can be viewed on a PC monitor. Become. Further, the input / output interface unit 16a is provided with a video board that encodes into MPEG2 (Moving Picture Experts Group-2) and records it on a DVD, and encodes and outputs NTSC (National Television System Committee) in an expansion slot of a PC. Is desirable. The moving image storage unit 16 is connected to an input terminal of a VHS (Video Home System) video recorder, and is recorded on a video tape, thereby using a home VTR (Video Tape Recorder) and using a home TV (TeleVision). set).
[0058]
By utilizing the moving image storage unit 16 in this way, if an editing object is registered in advance, it is possible to automatically select and edit a range where a specific person is photographed from an existing photographing recording medium. Editing time that had to be done manually by hand can be reduced. As a result, a video edited for each individual can be provided at low cost.
[0059]
Next, a method for providing moving image distribution using the automatic photographing apparatus 10 will be described. For this moving image distribution, a moving image distribution system 30 is constructed. As shown in FIG. 15, the building components of the moving image distribution system 30 include the automatic photographing device 10, the distribution server 40, the terminal devices 50 and 52, and the billing system 60. The automatic photographing device 10, the distribution server 40, the terminal devices 50 and 52, and the billing system 60 are connected to the Internet 100, respectively, and each component has a transmission / reception function. Thus, the building elements can each exchange information by communication.
[0060]
The automatic photographing apparatus 10 has been described in the above-described embodiment, and a description thereof will be omitted to avoid complication of description. The moving image storage unit 16 has a server function (not shown), and stores a captured moving image file and ID information. The moving image storage unit 16 creates a distribution moving image file, which is a general video streaming file, using only the frame corresponding to the frame number of the ID information from the moving image file for each ID number of the ID information. I have. The automatic photographing apparatus 10 stores the moving image file and the ID information stored in the moving image storage unit 16 in a linked state, and supplies the linked moving image file and the ID information to the distribution server 40 in response to, for example, an end of photographing or a distribution storage request.
[0061]
The distribution server 40 has a function of storing the supplied moving image file and ID information, performing information processing, and supplying a file corresponding to the request stage to the other party.
[0062]
Terminal devices 50 and 52 shown in FIG. 15 are a dedicated terminal device and a general terminal device, respectively. The terminal device 50 is a so-called kiosk terminal type used exclusively for this system. The terminal device 50 includes a PC 50a, a CRT (Cathode-Ray Tube) 50b with a touch panel sensor function, a DVD 50c, and a deposit mechanism 50d. The PC 50a is a personal computer that controls and processes the terminal device 50. The CRT 50b has a display function of displaying a supplied image and displaying data supplied from the PC 50a and a communication partner, and a sensor function of detecting a request / selection of the displayed data. . The DVD 50c is a recording device having a function of writing and recording a supplied desired moving image file on a DVD recording medium. The depositing mechanism 50d is a mechanism that accepts coins and bills and pays out change.
[0063]
The terminal device 52 is a general personal computer system, and the PC 52a is a personal computer that performs control and processing in the terminal system. The LCD (Liquid Crystal Display) 52b is a relatively inexpensive liquid crystal display as compared with a CRT, and generally does not have a touch sensor. Therefore, the terminal device 52 is provided with peripheral devices so that selection from the data displayed on the LCD 52b can be made by using either the keyboard 52c or a pointing device such as a mouse (not shown). In the case of the terminal device 52, the payment system 60 is accessed instead of the depositing mechanism to make a payment.
[0064]
The terminal devices 50 and 52 have a function of capturing a face image. Therefore, although not shown, the terminal devices 50 and 52 have at least a camera function, a scanner function, a reading function from a recording medium such as a semiconductor memory, and a transfer reading function from a digital device via, for example, a USB (Universal Serial Bus) cable. It is preferable to have one of them. The terminal devices 50 and 52 transmit the captured face image data to the distribution server 40 as a still image file. In addition, the terminal devices 50 and 52 may register a password and an address along with the registration and send the password and the address to the distribution server 40.
[0065]
The distribution server 40 has a function of creating face template data from the face image files provided by the purchasers from the terminal devices 50 and 52 by the method described above. Further, a function is provided for collating the template data with all the template data of the ID information which has been photographed by the automatic photographing apparatus 10 and already stored. Then, the distribution server 40 distributes the distribution moving image file stored in link with the confirmed ID information to the terminal device that has requested it, and also distributes the ID number in the ID information. There is a function to do. The stream distribution function is a function of distributing by a general video streaming method.
[0066]
The billing system 60 is an electronic payment system provided at a financial institution. The billing system 60 has a function of correlating the information displayed on the terminal device with the information of the deposit and withdrawing it from a deposit account or the like, and notifying the user of the accounting system of the completion of the charge collection.
[0067]
It is desirable that the settlement method be determined in advance between the purchaser and the seller.
[0068]
A procedure of purchasing a desired moving image file by a user photographed using the image distribution system 30 will be briefly described with reference to FIG. In this embodiment, the exchange with the terminal device 50 is mainly shown. As shown in FIG. 16, the terminal device 50 checks at time T10 whether or not the face image of the desired person to be imaged has already been registered. When the user has already been registered, the name included in the label information is supplied to the distribution server 40 as the instruction information signal 70. If not registered, the face image of the person to be photographed is converted into digital data, and an instruction information signal 70 including label information is generated and supplied to the distribution server 40.
[0069]
The distribution server 40 receives the instruction information signal 70, creates template data corresponding to the unregistered state, and stores the template data linked to the label information. Although not shown, it is preferable that the registered template data corresponding to the registered template data is searched, read out, sent to the terminal device 50, displayed on the CRT 50b, and confirmed by the user.
[0070]
At time T12, distribution server 40 transmits instruction information signal 72 to automatic image capturing apparatus 10. The instruction information signal 72 includes template data and label information corresponding to the person to be photographed. The automatic image capturing apparatus 10 stores the supplied instruction information signal 72 in the storage 16b of the moving image storage unit 16.
[0071]
The automatic photographing apparatus 10 performs tracking and photographing for a predetermined time while confirming the identity of the person to be photographed during the event period, for example. Upon completion of the image capturing, the automatic image capturing apparatus 10 transmits an image capturing end signal 74 to the distribution server 40. The distribution server 40 sends a captured moving image file (not shown) to the automatic image capturing apparatus 10. In response, the automatic photographing device 10 sends the moving image file and the ID information to the distribution server 40. The distribution server 40 stores the supplied moving image file and ID information.
[0072]
At time T16, after the user sets the label information on the screen of the CRT 50b, the terminal device 50 displays a “browsing display” key 500 shown in FIG. 17A, and requests browsing. In this case, the viewing request signal 76 is transmitted to the distribution server 40. The browsing request signal 76 includes label information for specifying a desired person to be photographed. Upon receiving the browsing request signal 76, the distribution server 40 immediately generates a corresponding distribution moving image file based on the stored moving image file and ID information. At time T18, the distribution server 40 performs stream distribution 78 of the generated moving image file for distribution to the terminal device 50 of the transmission destination.
[0073]
The terminal device 50 displays the distributed stream data in the display area 502 of the CRT 50b as shown in FIG. Immediately below the display area 502, a plurality of key areas 504 indicating an operation instruction for displaying stream data, a “purchase” key 506, and an “end” key 508 are displayed. The user (purchase applicant) browses the moving image displayed on the CRT 50b of the terminal device 50 and presses the “purchase” key 506 when he / she wants to purchase the moving image. If the user does not want to purchase, the user presses the “end” key 508. When the “end” key 508 is selected, the screen returns to the initial screen of FIG. That is, the process returns to time T16.
[0074]
On the other hand, when the “purchase” key 506 is selected, a purchase request signal 80 is transmitted to the distribution server 40 at time T20. The terminal device 50 updates the screen of the CTR 50b with the transmission of the purchase request signal 80 to FIG. On the screen, while displaying a moving image or a representative still image in which the display area 502 is reduced as a thumbnail display, data relating to items of a shooting time, a purchase price, and a recording medium are displayed. Then, the terminal device 50 displays the current deposit amount via the deposit request message of the purchase price and the deposit mechanism. When the deposit amount is lower than the purchase price, the terminal device 50 controls the “purchase” key 506 to be in a selection prohibited state so that the “purchase” key 506 cannot be operated. In addition, a “cancel” key 510 is provided to correspond to a selection when not purchasing or when interrupting the purchase procedure. The operation procedure is returned to time T16 by operating the “cancel” key 510. Upon receiving the purchase request signal 80, the distribution server 40 prepares to transmit the requested moving image file and ID information. The preparation here means that all the frames indicated by the frame number corresponding to the requested ID number are encoded into, for example, one MPEG2 standard moving image file.
[0075]
At time T22 when the price becomes equal to or more than the purchase price in the terminal device 50, the "Purchase" key 506 is made operable, and the screen display is switched to the screen display of FIG. Here, when the purchase applicant selects the "purchase" key 506, the terminal device 50 transmits the ID number currently supplied to this device to the distribution server 40.
[0076]
Upon receiving the payment confirmation signal 82, the distribution server 40 immediately transmits one MPEG2 standard moving image file corresponding to the prepared ID number to the terminal device 50 (time T24). At time T26, the terminal device 50 writes the DVD 50c to the DVD medium while writing the moving image file 84 transmitted from the distribution server 40 to the buffer of the terminal device 50. After the writing is completed, the purchaser can obtain the DVD media on the spot.
[0077]
The terminal device 52 is a general terminal unlike the terminal device 50 and does not have a deposit mechanism. In response to this, the terminal device 52 is made to download application software in software, for example, at the time of user registration. The purchaser performs a withdrawal process for the purchase price from the deposit account already opened by operating the screen of the application software executed on the terminal device 52, and transmits a transfer instruction signal 86 to the charging system 60. Here, the terminal device 52 may be provided with a card reader such as a cash card in order to support confirmation of a deposit account in the electronic financial service.
[0078]
The billing system 60 receives the transfer instruction signal 86, performs a direct debit, and transmits a payment confirmation signal 88 to the distribution server 40 (time T28). The distribution server 40 searches for the name of the label information based on, for example, the name of the payer, and transmits the moving image file 84 of the corresponding ID number (and password) to the terminal device 52 together with such information.
[0079]
When a recording device such as a DVD is not provided in the terminal device 52, the distribution server 40 sends the moving image file 84 from the terminal device 52 in a delivery format specified in advance. That is, a server such as a VTR device or a DVD device built in the server sends the data to a recording device selected in advance by the purchaser to perform writing, and distributes the written recording medium to the purchaser.
[0080]
However, these recording devices are not limited to the arrangement of the distribution server 40, and may be distributed as video recording devices connected to the Internet 100.
[0081]
By performing the operation as described above, the photographing that satisfies the customer's request is performed, and the photographed moving image can be browsed before purchase, so that the content of the moving image can be easily confirmed. In addition, purchase according to the purchase format can be performed, and the time from shooting to purchase can be shortened.
[0082]
With the above-described configuration, the automatic photographing apparatus 10 can reduce the labor cost by automating the photographing, increase the number of users having the same sense of the photographing time, and increase the purchaser in accordance with the increase. Is expected to increase, so that the photographing cost per person can be reduced.
[0083]
In addition, tracking of a specific person can be easily performed by changing the setting. By collecting the related frame numbers including the target corresponding to each designated target in the moving image storage unit 16 and storing the collected frame numbers as one moving image file, the editing operation after shooting can be performed efficiently. It is possible to reduce the production cost for each moving image and provide the purchaser with an inexpensive video even by this efficiency improvement.
[0084]
By constructing the image distribution system 30 via the Internet, it is possible to easily check the contents by browsing the moving image taken before the purchase, and after this confirmation, a desired moving image according to the functions of the terminal device. You can purchase image files. In the case of transfer, the time from purchase request to purchase is the shortest.
[0085]
Furthermore, according to the method of providing image distribution in the image distribution system including the automatic photographing device, the photographing target can be registered remotely from the terminal devices 50 and 52. This can reduce the labor of the person who wants to purchase), so that even if a plurality of target persons are photographed, the photographing can be performed almost uniformly in time. When the purchaser issues a browsing request, the purchaser can easily browse the moving image taken before the purchase and check the contents, and after this check, purchases a desired moving image file according to the functions of the terminal device. can do. The moving image file can be provided to the purchaser through optimal distribution according to the request of the purchaser.
[0086]
【The invention's effect】
As described above, according to the photographing system of the present invention, the photographing is controlled so that the field of the second photographing means is handled in a nested state with respect to the field of the first photographing means. The image data is supplied to the target specifying means, the identification information registered in advance by the target specifying means is collated with the obtained target image data, and the image data matched with the collation and the identification information are supplied to the information storage means. The photographing control means is controlled by the equal selection control means so as to photograph a set having a short accumulation time, and the second photographing means is controlled by the photographing control means in accordance with this control. By controlling and photographing, and accumulating the accumulation time of each set to approximately the same level, it is possible to automate the photographing, reduce the labor cost required for production, and increase the number of users who have the same value for the photographing time. Can this Since the increase of the purchaser in accordance with the pressure is expected, it is possible to suppress also taking cost per person.
[0087]
According to the method for providing image distribution in the imaging system of the present invention, recognition information of an object to be specified is registered in advance, image data obtained by imaging the object corresponding to the registration by the imaging system is stored, and a file for each object is stored. Is collected and stored in the distribution storage means, and a request for browsing the collected file of the desired target is sent from the information terminal device, and the face image is confirmed by the information terminal device of the browse request destination, and the information is stored in response to the confirmation. The file encoded from the storage means is decoded and displayed on the information terminal device, the contents of the file are confirmed, the purchase of the file is instructed, and the desired image data is obtained, thereby capturing the desired subject. Is reliably performed, and after the images that are satisfied by each of the registered users are captured, the images can be purchased in a short time upon request.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a schematic configuration of an automatic photographing apparatus to which a photographing system of the present invention is applied.
FIG. 2 is a diagram for explaining a photographing relationship of a camera used in the camera unit of FIG. 1;
FIG. 3 is a block diagram illustrating a schematic configuration of a moving image storage unit in FIG. 1;
FIG. 4 is a diagram showing an example in which an identification number is assigned to a shooting target of each frame by the automatic shooting device of FIG. 1;
FIG. 5 is a view showing a continuation of FIG. 4;
FIG. 6 is a diagram exemplifying creation of a template and assignment of an identification symbol to the template in the automatic photographing apparatus of FIG. 1;
FIG. 7 is a view showing a continuation of FIG. 6;
FIG. 8 is a diagram showing a result of collation of a person to be imaged by an identification symbol in frames 3 and 4 in FIG. 6;
FIG. 9 is a diagram illustrating a correspondence relationship between an identification number and an identification symbol by the automatic photographing apparatus in FIG. 1;
FIG. 10 is a diagram showing an example of an ID number assigned to each frame photographed by the automatic photographing apparatus of FIG. 1;
FIG. 11 is a view showing a continuation of FIG. 10;
FIG. 12 is a diagram showing the correspondence between the ID numbers given in FIGS. 10 and 11 and recording information.
13 is a diagram illustrating an example of editing a moving image file photographed by the automatic photographing device of FIG. 1;
FIG. 14 is a diagram showing a format of data stored in an information associating unit of FIG. 3;
FIG. 15 is a system block diagram showing a schematic configuration of an image distribution system using the imaging system of the present invention.
16 is a sequence chart in the image distribution system of FIG.
17 is a diagram showing an example of an initial screen and a browsing screen in a screen display of the terminal device used in FIG.
18 is a diagram showing an example of a payment request screen and a purchase confirmation screen in a screen display of the terminal device used in FIG.
[Explanation of symbols]
10. Automatic photographing device
12 Camera section
12a, 12b camera
14 Individual Identification Department
14a Face data registration unit
14b Individual tracking unit
16 Moving image storage
18 Image selection section
20 Camera control unit

Claims (8)

First photographing means for producing image data by photographing with an angle of view indicating a photographing range of the object field wider than a reference,
A photographing adjustment mechanism for moving at least the photographing object moving in the object scene and enlarging / reducing the angle of view for photographing the photographing object within the photographing range of the first photographing means; Second photographing means for photographing at a narrow angle of view of the photographing range to generate image data;
A photographing control unit that controls photographing of the first and second photographing units and also controls an operation of the photographing adjustment mechanism;
A target specifying unit that associates image data of the target captured by the second capturing unit with identification information for identifying the target;
Information storage means for storing the identification information and the target image data as a set in association with each other,
Equalization control means for selectively controlling the second photographing means for increasing the target image data corresponding to the set having the shortest accumulated time among the sets stored in the information storage means. An imaging system characterized by including: 2. The image capturing system according to claim 1, wherein the target specifying unit captures a face of a target to be captured in advance, and registers face data of the captured face;
An object for comparing the registered face data with the image data obtained by the second photographing means, and controlling the photographing control means to track the photographing object in accordance with the recognition result obtained by the comparison. An imaging system comprising: a tracking control unit. 3. The photographing system according to claim 1, wherein the information storage unit records at least image data photographed by the first and second photographing units, and
Personal extraction means for extracting a photographing range including the target specified by the target specifying means, from the recorded image data;
A photographing system, further comprising: a related storage unit that also stores information regarding a photographing range of image data including another object other than the object specified by the extraction in the another object. 4. The photographing system according to claim 1, wherein the face registration unit performs registration of performing direct photographing of the face of the photographing target and indirect reading scanning of a photograph in which the face of the photographing target is photographed. And at least one of registration of capture by a camera. 5. The imaging system according to claim 1, wherein the information storage unit has a function of recording the specified image data of each target as one file, encoding the file, and transmitting the encoded file. And connected to the network,
Further, the network includes a distribution storage unit that collects the file from the information storage unit and distributes the file in response to a request for the file;
The face image corresponding to the specified object is displayed and confirmed, and the file encoded from the delivery storage means is decoded and displayed in accordance with the confirmation, and the content of the file is confirmed and the desired image data is displayed. An image distribution system connected to an information terminal device having a purchase function. 6. The image distribution system according to claim 5, wherein the network is the Internet, and the system includes an accounting system corresponding to the purchase. A first image capturing unit that generates an image data by capturing an image with an angle of view indicating a capturing range of the object field wider than a reference,
A photographing adjustment mechanism for moving at least the photographing object moving in the object scene and enlarging / reducing the angle of view for photographing the photographing object within the photographing range of the first photographing means; Second photographing means for photographing at a narrow angle of view of the photographing range to generate image data;
A photographing control unit that controls photographing of the first and second photographing units and also controls an operation of the photographing adjustment mechanism;
A target specifying unit that associates image data of the target captured by the second capturing unit with identification information for identifying the target;
Information storage means for storing the identification information and the target image data as a set in association with each other,
And an equal selection control means for selectively controlling the second photographing means for increasing the target image data corresponding to the set having the shortest accumulated time among the sets stored in the information storage means. A shooting system,
A delivery storage unit that collects the file from the information storage unit and delivers the file to a request destination in response to a request for the file;
The face image corresponding to the specified object is displayed and confirmed, and the file encoded from the delivery storage means is decoded and displayed in accordance with the confirmation, and the content of the file is confirmed and the desired image data is displayed. A first step of registering recognition information of a target to be specified in advance by using an information terminal device having a purchase function;
A second step of photographing the registered object and storing the photographed image data in the photographing system;
A third step of collecting and storing the stored image data in a delivery storage unit as a file for each object in the photographing system;
A fourth step of transmitting a request to view a collected file to a desired target from the information terminal device;
In response to the browsing request, the registered face image is distributed to the requesting information terminal device for display and confirmation, and in response to the confirmation, a file encoded from the information storage means is decoded and displayed. A fifth step of instructing the purchase of the file by confirming the contents of the file;
And a sixth step of transferring and recording the file to a transfer destination in response to the confirmation of the charging process accompanying the purchase. 8. The method according to claim 7, wherein the first step comprises registering the face of the subject by direct photographing and registering the capture of the photograph of the face of the subject by indirect reading scanning. A method of providing image distribution in a photographing system, characterized in that at least one of the above is registered.

Images