JP2002027313A - Image selecting device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problems that a photographic film is wasted or a memory capacity for recording images is wasted due to photographing objects not suitably by photographing, even when the object is not suitably secured in a frame of the image if photographing timing merely follows the predetermined interval when the object is automatically photographed by a camera without operation by a user. SOLUTION: An image selecting device comprises the camera 40 for photographing the object in a specific range, the same image selecting means 308 for selecting the image of the same object imaged by the camera 40, and an image selection processor 310 for selecting the images of a predetermined number from images of the same selected object.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for reducing the number of images captured by a camera.

[0002]

2. Description of the Related Art In a place such as a sightseeing spot or an amusement park, an image is taken by a camera for the purpose of taking a snap shot of an object. There are two types of image capturing by the camera: a case where the image is captured by a user, and a case where the image is automatically captured at an appropriate interval regardless of the user's operation. In addition, imaging is performed at predetermined intervals, and imaging is performed at random imaging intervals.

[0003]

Normally, when an image is taken by a camera, all the taken images are not treated as images to be stored in an album or the like, but are appropriately selected from the taken images. The selected image becomes the image for storage.
However, when the image is taken by the camera by the user's operation, it is not known whether the subject is properly imaged.
More images are taken than the required number. In addition, in the case where the subject is automatically imaged by the camera without the user's operation, if the imaging timing is only in accordance with a predetermined imaging interval, the object is properly contained in the frame of the image. Imaging is performed even when there is no image. An image in which the subject is not properly included in the frame is treated as an image for which imaging has failed. like this,
Unnecessary images or images for which imaging has failed may waste photographic film or reduce the memory capacity for image recording.

Accordingly, an object of the present invention is to provide an image selecting device capable of solving the above-mentioned problems.
This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous embodiments of the present invention.

[0005]

According to a first aspect of the present invention, there is provided a system for providing an image, comprising: a camera for picking up an image in a specific area, and an image of the same subject picked up by the camera. The image processing apparatus includes an identical image selecting unit for selecting, and an image selection processing unit for selecting a predetermined number of images from among the selected images of the same subject.

The present invention further comprises a subject image recognizing section for recognizing an image of the subject in an image picked up by the camera, wherein the same image selecting means is provided based on the image of the subject recognized by the subject image recognizing section. Alternatively, an image of the same subject may be recognized.

The image recognizing section recognizes the facial expression of the subject in the image captured by the camera, and the image selection processing section recognizes the image having the predetermined facial expression of the subject recognized by the image recognizing section. Alternatively, a predetermined number of images may be used.

According to the present invention, there is provided a camera, wherein a subject to be imaged has a transmitter for transmitting radio waves, and a camera for imaging the subject,
By detecting a radio wave transmitted from the transmitter, a subject position obtaining unit for specifying the position of the subject, and capturing an image by the camera when the position of the subject obtained by the position information obtaining unit reaches a predetermined position. And a camera control unit for performing the operation.

The present invention may further include a voice sensor for detecting a voice emitted from the subject, and the camera control unit may cause the camera to perform an imaging operation when a specific voice is acquired by the voice sensor. .

According to the present invention, there is provided a gate for recording entry of a subject, a camera provided at a position where the subject passes through the gate to capture an image of the subject, and a predetermined time after the gate records entry of the subject. A camera control unit that causes the camera to take an image after the elapse.

The above summary of the invention does not enumerate all of the necessary features of the present invention, and a sub-combination of these features can also be an invention.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described through embodiments of the present invention. However, the following embodiments do not limit the claimed invention and have the features described in the embodiments. Not all combinations are essential to the solution of the invention.

FIG. 1 is a personal image providing system 1 according to the present invention.
An example in which the embodiment of FIG. In this embodiment, the personal image providing system 10 sets a person who is playing in an amusement park as a subject.

First, a system provided by the personal image providing system 10, which is realized by the image management server 20, the personal information acquiring device 30, the personal information updating device 32, the camera 40, the image search terminal 50, and the output device 60, will be described. . How to use the subject position information acquisition unit 210 will be described later.

The person information acquiring device 30 acquires person information representing features such as a face and a body of a user who uses the personal image providing system 10. The personal information acquisition device 30 is, for example, a camera for capturing personal information. 2. Description of the Related Art A camera for capturing personal information captures images from various angles, such as a photograph of the front of a person and a photograph of a profile. Another example of the person information acquisition device 30 is a scanner that can read an image. In this case, the photograph attached to the license or the like is read by the scanner. Also, when the personal information has already been acquired and the acquired personal information is recorded on an ID card or the like,
As the person information acquisition device 30, an ID card reader that can read information recorded on an ID card is used.

The person information acquisition device 30 includes a transmission unit for transmitting the acquired data. The transmission means is, for example, a LAN provided in the personal image providing system 10. This LAN has wireless communication means. Person information acquisition device 3
The personal information acquired at 0 is transmitted to the image management server 20 using the LAN.

Some users do not like to have their images taken into the hands of others. For such a person, it is possible to make settings so that an image of each person after personal information registration is not passed on to another person. In this way, when another person searches for an image, the image of that person is excluded from image search targets. Information on such a restriction on the search image is also included in the person information.

The person information updating device 32 registers the person information again for the person who has already registered the person information. The person information updating device 32 includes a camera for re-registering person information, and reacquires person information by capturing an image of a person. The personal information updating device 32 is mainly used when the appearance changes while playing in an amusement park. For example, there is a case where a hat is purchased on the way and worn on the head, or a case where a T-shirt is purchased and changed clothes. In such a case, the image search may not be properly performed only with the first registered personal information. Therefore, the personal information updating device 32 updates the personal information. The personal information acquired by the personal information updating device 32 is transmitted to the image management server 20,
The person information in the person DB 110 is updated.

One or more cameras 40 are installed in the amusement park. By setting the installed camera and the color and pattern around the camera to be similar, the user may be less likely to notice the camera. As a result, the user does not need to be conscious of the fact that the image is taken by the camera, so that the image is taken while maintaining the usual natural behavior and expression. The image captured by the camera 40 is transmitted to the image management server 20 by the above-described transmission unit.

Among the cameras 40 installed in the amusement park, there is a camera installed on a movable costume doll or the like, which is one of the amusement in the amusement park. In this case, the camera is installed so as not to be seen from the outside of the costume doll, and an image is taken around (especially in front of) the costume doll.
Thereby, it is possible to image a natural expression of a person who comes close to the costume doll with interest. In this case, the camera 40 can transmit the image captured by the wireless communication unit to the image management server 20.

Further, some of the cameras 40 keep track of a specific movable object, for example, a costume doll as described above. With this camera, an image of a person playing with the costume doll is captured together with the costume doll.

The images captured by the camera 40 include:
Still images and moving images are included. Since a series of motions of people playing in the amusement park are recorded by video shooting,
The state at that time can be provided in a more impressive form as compared with a still image.

The camera 40 may include a person identification camera used only for identification of a person playing in the facility. For example, a person identification camera is installed at a gate 390 or the like passing by using an ID card capable of identifying a person. When a person passes through the gate 390 using the ID card, an image of the person passing through the gate 390 is captured by the person identification camera. Accordingly, the latest person information of each person can be obtained without using the person information updating device 32. Further, it is possible to confirm the position where each person is located, and the like.

The area imaged by the camera 40 is
When the installation location is fixed, it is obtained from the direction of the camera 40 and the field of view. When the camera 40 is installed so as to be movable, the position of the camera 40 may be specified by providing the camera 40 with a GPS device. Further, when the installation location of the camera 40 is fixed and when the camera 40 is installed so as to be movable, image recognition is performed by recognizing where the image is captured from the image captured by the camera 40. The region may be specified.

The image management server 20 stores the person information transmitted from the person information acquisition device 30. On the other hand, the image management server 20 stores the image transmitted from the camera 40. At this time, the image management server 20 also stores information accompanying the transmitted image, for example, information such as the imaging time and the location where the image was captured.

The image search terminal 50 is connected to the image management server 20
The conditions for searching for a desired image from the images stored in the. This image search condition can be specified by the user. Further, after the search is executed, an image to be output is specified from the searched images, and an output medium to be output is specified.

The output device 60 outputs an image specified to be output by the image search terminal 50 to a specified output medium.

Here, a description will be given from the viewpoint of the user using the personal image providing system 10.

The user first registers personal information in the personal information acquisition device 30. The registered person information is
It is transmitted to the image management server 20. After registering the personal information, the user plays in the amusement park without being conscious of the camera. The user is imaged by the camera 40 while playing. The user goes to the image search corner provided with the image search terminal 50 when he / she likes, and searches for an image in which he / she is captured from the images taken so far. The image search is performed based on the registered personal information. The user can output a favorite image from a searched image to a predetermined output medium. In this way, the user can obtain an image of himself or herself while playing just by playing.

The registration of the personal information may be performed during playing at the amusement park facility or after playing at the amusement park facility. Also in this case, the user can search the image captured by the camera 40 for an image of each user with the image search terminal 50 and output the searched image.

FIG. 2 shows the configuration of the image management server 20. The image management server 20 includes a person information writing unit 70, an image writing unit 80, an image search unit 90, a person information acquisition device 30,
Person DB 110, image DB 120, and image set D
B130.

In addition, the image management server 20 includes a position information writing unit 220, a position information DB 230, a subject speed detection unit 240, a destination prediction unit 250, and an image selection device 3.
00, which will be described later.

The person information writing unit 70 receives the person information acquired by the person information acquiring device 30, and
A process for writing to 110 is performed.

The image writing section 80 performs processing for receiving an image captured by the camera 40 and writing the image in the image DB 120. At this time, the place and time when each image was captured are also
It is written to the image DB 120.

The image search unit 90 receives search conditions for searching for an image from the images stored in the database from the image search terminal 50. The image search unit 90 performs an image search according to the received search conditions. At the time of image search, the person information stored in the person DB 110 is used. After the search, the image search unit 90 transmits the result of the image search to the image search terminal 50.

The output processing section 100 outputs the search image specified by the image search terminal 50 to the specified output medium.
For example, when paper is specified as the output medium, a process of printing the specified image on paper is executed. In this case, the output device 60 is a printer.

FIG. 3 shows an example of the person DB 110. The person DB 110 describes a person ID assigned to each user who uses the image providing system. Each person ID
, The person ID assigned to each friend of the friend is also recorded. The friend's person ID is used later when searching for an image taken together with the desired friend.

Further, in the person DB 110, person information obtained by the person information acquisition device 30 is recorded for each person. The person information is information that can identify each person by image recognition or the like. For example, person information includes face outline, size,
Alternatively, the shape, size, and the like of the eyes, nose, mouth, and the like are represented by numerical face parameters. In addition, the person information also includes information such as height, physique, clothes, glasses, and ornaments of each person. The personal information includes input personal information as initial data and updated personal information that is updated later.

Further, the time when each person enters the facility (or the time when the use of the image system is started) is recorded.

When the location of each person is specified by, for example, specifying that each person is captured in an image captured by an arbitrary camera, the location of each person and the time at that time are determined. Is recorded as a movement history.

Each person will be asked when others search for images.
It is possible to restrict an image including oneself from being searched and output. Whether or not the search is restricted is also recorded in the person DB 110.

FIG. 4 shows an example of the image DB 120. In the image DB 120, images captured by one or more cameras 40 and transmitted to the image management server 20 are stored. An image ID for specifying an image is assigned to each stored image. Each image has an imaging property related to imaging, such as a camera ID assigned to each imaged camera, an imaged location, and an imaging time.
Furthermore, when a person specified by the image search unit 90 is included in each image, a person ID of the specified person is recorded.

With the image DB 120, each image can be specified, and information such as the imaging location of each image and the person appearing in each image can be referred to.

FIG. 5 shows an example of the image set DB 130. The image set DB 130 is a database relating to a plurality of images captured of a common person. This is advantageous when it is better to manage a set of specific images than to manage each image independently. There are, for example, two cases for a particular set of images. One is an angle set. In the angle set, a plurality of images obtained by photographing a common subject with a camera from a plurality of different angles at the same time are defined as one set. The other is a temporal set. In the elapse set, a plurality of images obtained by shooting a common subject with the camera 40 according to the elapse of time are represented by one.
One set. A plurality of cameras for imaging the subject may be provided.

By the image set DB 130, a plurality of images showing a common person can be managed collectively. The image set DB 130 is used for searching for an image and specifying a person appearing in the image.

FIG. 6 shows the configuration of the image search terminal 50.
The image search terminal 50 includes a search condition setting unit 150, a search result presentation unit 160, an output image setting unit 170, and an output format setting unit 180.

The search condition setting section 150 sets search conditions for searching for a desired image from the images stored in the image management server 20. The search condition is, for example, that a smiling self is shown, or that the user has a specific expression.

When going to an amusement park with a friend, it is desirable to take a picture with the friend as a commemorative image. In order to respond to this request, the search condition setting unit 150 can use, as a search condition, an image in which a plurality of people appear at the same time when searching for an image. For example, if "photographs of yourself and A together" are set as the search condition, an image in which both you and A are captured is searched based on personal information of yourself and A.

The search conditions set by the search condition setting section 150 can be transmitted to the image management server 20.

The search result presenting section 160 stores a list of images searched according to the above search conditions in the image management server 20.
And displays the received result on a monitor screen and presents it to the user.

The output image setting section 170 sets an image designated by the user among the images presented by the search result presentation section 160 as an image to be output.

The output format setting section 180 sets a medium designated by the user as a medium for outputting an image. Examples of a medium for outputting an image include paper and CD-R.

The output image set by the output image setting section 170 and the type of output medium used for image output set by the output format setting section 180 are transmitted to the image management server 20.

One of the characteristic functions of the image management server 20 is to identify a person in a set image. The person identification of the set image is processed by the person identification unit 190.
With this function, when there are multiple images including a common person, if a person is specified for one of them,
Common persons included in other images are also specified collectively. The set image includes a case where a common person is included in a plurality of images taken at a plurality of angles at the same time (angle set), and a plurality of images taken of a common person within a predetermined time from a certain time. (Set over time). In each case, a method of identifying a person will be described with reference to FIGS.

FIG. 7 shows an outline of the process performed by the person specifying unit for the angle set. An angle set A1 is
It is assumed that images including image IDs 11, 12, 13, 14, and 15 are included, and a common person X (unspecified person) is shown in each of the images. Image ID for this angle set
If the person X in the image 11 is identified as the person ID 19, the person X in the image IDs 12 to 15 is also the person ID 19.

As a result, it is not necessary to specify a person in each image, and the person can be specified efficiently.

FIG. 8 shows an outline of the processing performed by the person specifying unit for the aging set. It is assumed that a certain angle set T1 includes images of image IDs 21, 22, 23, 24, and 25, each of which includes a common person Y (unspecified person). About this angle set, image ID2
If the person Y in the image ID 22 is identified as the person ID 29, the person Y in the image IDs 22 to 25 is also the person I.
D19 is assumed.

As a result, it is not necessary to specify the person who appears in each image, and the person can be specified efficiently.

The camera 40 automatically captures images at predetermined intervals, for example. In this case, a person may not be photographed, or a person whose personal information is not registered may be photographed. Therefore, the image selection device 300 performs a process of selecting an image captured by the camera 40.

FIG. 9 shows that the image selecting device 300
6 is a flowchart when discarding an image captured in step S <b> 1. First, an image is captured by the camera 40 (S10).
The captured image is transmitted to the image management server 20 (S20). The image search unit recognizes the transmitted image, and compares the image with the person information registered in the person DB 110 in the image (S30). As a result of the collation, it is determined whether or not a person matching the personal information registered in the image is included (S40). If the registered person is included in the image, a process of storing image data in a DB or the like is executed (S50). On the other hand, the image which does not include the registered person is discarded (S60). By this processing, it is not necessary to store an image in which an unregistered person is captured in the image DB 120, so that the burden on later image search can be reduced. However, in the person matching, it is not necessary to assume that the matching degree indicating the degree of matching between the registered person and the person shown in the image is 100%. For example, even if the collation degree is 50%, it is stored in the image DB 120 or the like as a registered person candidate. In this case, the number of images to be stored increases, but omission of retrieval can be reduced.

The above example is suitable for a case where the personal information is registered in advance. On the other hand, person information is
If performed after image capturing, the image selecting device 300
Confirms whether an arbitrary person is included in the image transmitted from the camera 40. If an arbitrary person appears in the image, the image is stored. This allows
Even if the person information is not registered in advance and the person information is registered after the image is picked up, from among the images obtained by capturing an arbitrary person,
Images matching the registered personal information can be retrieved and obtained.

If the image pickup by the camera 40 is simply performed at a predetermined interval, for example, the expression of the subject is not taken into consideration, so that many of the picked-up photos are inappropriate for the image pickup timing. In this case, the number of photos to be searched increases, so that not only does it take much time to search, but also photos taken at a timing not desired by the user are provided. Therefore, camera 4
0 is more preferably provided with a configuration for automatically capturing an image at a predetermined imaging timing.

FIG. 10 shows an example of specifying the position of a subject. The subject has a transmitter 192 for transmitting radio waves and the like. Receiver 194 receives a radio wave transmitted from transmitter 192. The distance between the subject and the camera 40 is calculated based on the strength of the received radio wave or the like. When the timing detection unit 140 detects that the calculated distance has reached a predetermined distance, the camera 40 performs imaging.

At least one of the radio wave transmitted from the transmitter 192 and the area where the receiver 194 receives the radio wave may have directivity. This makes it possible to know the position of the subject more accurately,
The imaging timing also becomes more appropriate.

The radio wave transmitted from the transmitter 192 may include personal information for specifying the subject having the transmitter 192. Thus, by detecting a radio wave, when an image is captured by the camera 40, it is possible to identify a subject shown in the captured image data based on personal information included in the radio wave. When the subject is specified in this way, the person information or the person ID of the subject appearing in each image is described in the image DB 120. When the image search unit 90 searches for a subject to be searched, the image DB 120 is used. If the image DB 120 is searched based on the person information or the person ID of the subject to be searched, image data of the subject can be found reliably and quickly.

FIG. 11 shows a state in which the fact that a specific object and a subject have a specific positional relationship is set as an imaging timing. When the object A is in a specific imaging area, the camera 40 performs imaging. The fact that the object A is in the specific imaging region may be performed by the above-described transceiver. Thereby, the facial expression when the subject A is surprised or pleased with the object A is appropriately imaged.

FIG. 12 is a sequence chart showing the exchange of data among the image management server 20, the person information acquiring device 30, and the camera 40. First, the person information acquisition device 30 acquires the person information of each person (S100). Here, an image for identifying each person is captured, and parameters obtained by quantifying features of the body, face, and the like of each person are acquired. The acquired person information is sent to the image management server 20 (S110). The person DB 110 is updated according to the transmitted person information (S1).
20). Here, the person ID assigned to each person
May be transmitted to each person, or may be recorded on an ID card owned by each person. As a result, each person has its person ID
Thus, identification becomes possible. On the other hand, the camera 40 captures a person at any time (S130). The imaging may be performed at predetermined intervals, at random intervals, or automatically at predetermined timing. When the image is captured by the camera 40, the captured image is sent to the image management server 20 (S140). The sent image is stored in a database (S150). An image ID for specifying the image is assigned to each image, and the image DB 120 is updated. If the transmitted image is included in the set image, the set image DB
Is also updated (S160).

On the other hand, when new person information is obtained for a person whose personal information has already been obtained (S170), the person information obtaining apparatus 30 transmits the personal information to the image management server 20 (S180). ). The person DB is updated based on the transmitted person information (S190). This makes it possible to deal with a case where the personal information of a certain person changes in the middle. For example, there are cases in which the face is changed by removing the contact and wearing glasses on the way, or when information about the body is changed by buying and wearing a hat.

FIG. 13 shows a sequence chart when an image search is executed between the image management server 20 and the image search terminal 50. First, search conditions for searching for an image are set in the image search terminal 50 (S200).
The search condition is that a specified plurality of people are shown,
There is a certain expression. The set search conditions are transmitted to the image management server 20 (S21).
0). The image search unit 90 of the image management server 20 performs a search on the images stored in the database according to the transmitted search conditions (S220). Image search is performed based on personal information. When the search is completed, the result is transmitted to the image search terminal 50 (S230). The search results are displayed in a list on the image search terminal 50 (S24).
0). The user selects a desired image from the images displayed in the list (S250). In addition, a medium for outputting images (paper,
CD-R, etc.) (S260). Information such as images and output media determined by the user is transmitted to the image management server 20 (S270). The image management server 20 outputs the specified image to a predetermined medium (S280).

FIG. 14 shows an example of an image search setting screen displayed on the image search terminal 50. This screen is an example of a screen displayed when a person using the personal image providing system searches for an image of himself or herself and a predetermined person.
First, a person ID registered in the system is input. next,
A search condition that determines what image is searched is set. The search condition includes, for example, searching for an image in which only oneself is captured, or searching for an image in which oneself and a specific person are captured. Furthermore, the expression of the face in the image can be set as a search condition. For example, the image is that the eyes are properly opened and the image is a smile. The user can obtain an image that matches his or her taste.

Note that the user may set a lower limit of the degree of collation between the registered personal information and the person included in the image to be searched. For example, if the lower limit of the collation degree is set to 50%, images having a collation degree of 50% or more can be searched and extracted. When presenting the searched result to the user, if the images are arranged and presented in descending order of the degree of matching, the user can easily select a desired image from the presented images.

FIG. 15 shows an example of a search result list and an output setting screen displayed on the image search terminal 50. First, a list of images obtained as a result of searching for images based on search conditions specified by the user is shown. It is desirable to display the listed images in a thumbnail format in which the original image is reduced so that the image of each image can be understood. This allows the user to know what the image is. The user selects an image to be output from the listed images.

Further, a medium used when outputting an image is selected. Examples of media used for providing images include paper (printing an image on paper), CD-R (writing an image on a CD-R), MD (writing an image on an MD), and Web (Web).
b, the image data is presented to a predetermined URL, and the user accesses the predetermined URL to download the presented image data), attaches to an e-mail (attachs an image to an E-Mail address designated by the user), etc. And the user can select according to his / her preference. Further, the user can select the size of the output image, the image quality of the image,
An output mode such as the brightness of an image can be determined.

If the cost required for image output is displayed according to the image or output medium selected by the user, the user can change the number of images to be selected according to the budget for image output. Will be a more friendly system.

After confirming the settings relating to the image output, the user can press the output execution button to output a predetermined image.

The output medium (except for presentation on the Web and attachment to e-mail) can be delivered to the user on the spot or sent to a destination specified by the user. The delivery of the image on the spot is most suitable when the user wants to see the image immediately, and the delivery of the image is preferable when the user does not want to increase the luggage or wants to look carefully later. The user can select a preferred delivery method.

Next, an image search system having advantages in the image search method according to the present embodiment will be described. In this image search system, the subject position information acquisition unit 210 described in FIG. 1 and the position information writing unit 220, the subject speed detection unit 240, the arrival point prediction unit 250, and the position information DB 230 described in FIG. You.

The subject position information obtaining section 210 specifies the subject and obtains position information on the position where the subject was and the time at that time. Subject position information acquisition unit 21
0 and the image management server 20 are communicably connected to each other. The acquired information on the position of the subject is transmitted to the image management server 20. When there are a plurality of subjects, the subject position information acquiring unit 210 acquires not only the position of each subject but also the order of each subject. An example of the subject position information acquisition unit 210 will be described later.

The position information writing section 220 obtains the position information of each subject obtained by the subject position information obtaining section 210 and writes the obtained information into the position information DB 230.

The location information DB 230 accumulates the locations where each subject has been obtained by the subject location information obtaining unit 210, the locations where each subject has been, and the time at that time. An example of the position information DB 230 will be described later.

The subject speed detecting section 240 has a position information DB
Reference is made to the time stored in 230 when each subject passes through two points along a predetermined route. The traveling speed of each subject is determined from the distance between the two points and the time required to pass between the two points. In addition,
The subject position information acquisition unit 210 may include a speed sensor. In this case, the subject speed detection unit 240 directly obtains the traveling speed of each subject from the subject position information acquisition unit 210.

Based on the traveling speed of each subject detected by the subject speed detecting unit 240, the arrival point estimating unit 250 determines the location of a specific subject after a predetermined time has passed after passing through the certain location. Anticipate.

Here, examples of the subject position information acquisition section 210 and the position information DB 230 will be described. After this description, the position information DB 23
An example of a subject image search using 0 will be described.

FIG. 16 shows an example in which the subject position information acquisition section 210 acquires position information. The subject has wireless communication means 362 (for example, a mobile phone, PHS). The subject position information acquisition unit 210 has a receiver 364 that receives radio waves transmitted from a mobile phone or the like, and the position of the subject is specified from the radio waves received by the receiver.

FIG. 17 is another example of the subject position information acquisition section 210. The subject has an ID card on which ID information for identifying the subject is recorded. The subject is at the gate 390
When an ID card is inserted into an ID card insertion slot provided in the like, the ID information recorded on the ID card is read by an ID information reading device. When the ID information is read, the ID information specifying the location of the gate 390 and the subject recorded on the ID card is transmitted to the position information DB 230 and stored.

FIG. 18 shows an example of the position information DB 230. FIG. 18 is an example of the position information DB 230 for a certain subject (the subject ID for specifying the subject is 1). In this table, the position information acquired by the subject position information acquisition unit 210 for the subject ID1 is described.

When the image search unit 90 searches for a specific subject from the image DB, the position information recorded in the position information DB 230 is used. The image search unit 90 refers to the position information DB 230 and obtains position information on a specific subject. With this position information, it is possible to narrow down images that may have a specific subject. That is, when there is position information that the subject of the subject ID1 was at the point A at a certain time, the subject ID1 is an image captured by the camera that captures the point A among the images captured at that time. It is a possible image candidate. An image captured by a camera provided so as to capture an image other than the point A at that time is excluded from a search target of an image including the subject ID1. Accordingly, when searching for an image in which a specific subject is captured from an image in which a plurality of arbitrary subjects are captured, the search time is reduced.

FIG. 19 shows an example of searching for an image in which a subject has passed a predetermined point. If it can be confirmed that the subject has passed the predetermined point, the place where the subject may be present within a predetermined time before and after the predetermined point is naturally limited. Therefore, the subject position information acquisition unit 210
The fact that the subject has passed a predetermined point is acquired and recorded in the position information DB. The image search unit 90 sets the camera 4 within an action range determined based on a predetermined time including a time when a subject to search for an image has passed a predetermined point within a predetermined time.
The image captured by 0 is a search target. For example, 2 pm
When there is an object that sometimes passes a predetermined point, the time from 1:45 pm to 2:15 pm is set as the search target time. In this case, an action range in which it is estimated that the subject has acted between 1:45 pm and 2:15 pm (FIG. 1)
The image captured by the camera 40 during that time is a search target for an image in which the subject is captured. In addition,
The action range of the subject is determined from the route near the predetermined point and the speed at which the subject normally moves. Therefore, the shorter the search target time, the narrower the action range of the subject determined based on the time.

FIG. 20 shows an example of searching for an image in which a subject has passed two different points. The route between the predetermined point A and another predetermined point B may have several ways. The subject position information acquisition unit 210
It is detected that a certain subject has passed a predetermined point A and another predetermined point B has been passed. Image search unit 9
0 is an action range determined based on the time of passing through the point A and the point B, and an image captured by the camera 40 within the time is a search target of an image including the subject. For example, it is assumed that the subject position information acquisition unit 210 detects that the subject A has passed another predetermined point B at 1:15 pm after passing the predetermined point A at 13:00. In this case, the image search unit 90 sets the action range (hatched portion in FIG. 20) determined based on the time from 1:00 pm to 1:15 pm to the image captured by the camera 40 during that time. To search for an image of the subject A. The range of the subject is that the subject is at a predetermined point A.
Is determined so as to cover an action range that can be usually taken by the subject from the time when the subject has passed and the time when the user has passed another predetermined point B.

Further, the image search section 90 includes means for searching for an image of the subject when the subject travels on a predetermined route.

FIG. 21 shows an example in which the position of a subject within a predetermined route is specified. The subject travels along a predetermined route. The predetermined route is, for example, an attraction passage provided in an amusement park, a forward route provided in an aquarium, or the like. When there are a plurality of subjects, the subjects travel in a line along a predetermined route.

(In the case of one subject) By providing the subject position information acquisition section 210 at a predetermined point A, the position information of a specific subject is acquired. With this location information,
It can be seen that the specific subject is at some point before and after point A in the predetermined route before and after the time when passing through point A. Therefore, among the images in the image DB, images obtained by capturing the points before and after the point A in the predetermined route before and after the passing time of the point A are set as image candidates that may have a specific subject.

Further, by providing the subject position information acquisition unit 210 at the point B ahead of the point A, it is possible to specify the time within the point B from the point A. A certain image can be further narrowed down.

On the other hand, by detecting the speed at which the specific subject passes through the point A or the speed at which the specific subject travels along the specific route by the subject speed detector 240, the accuracy of narrowing down the image can be further improved. it can. That is, from the time when the subject passes through the point A and the traveling speed of the subject, an approximate point and time at which the subject may be present after passing the point A can be estimated. Based on the predicted point and the predicted time, an image that may have captured a specific subject is further narrowed down.

(When there are a plurality of subjects) When a subject travels along a route, the context of the subjects may not change much. In this case, the subject can be specified by grasping the context of the subject. FIG.
, The subject B is passing through the point A. The subject B is moving between the subject A and the subject C. At this time, the position information on the subject B includes information on the subject before and after the subject. As a result, if the context of the subject is maintained, the context of the subject after the point A can also be predicted. If the subject B is specified in the images captured after the point A, the subject before and after the subject B can be specified by the position information of the subject B when passing through the point A.

[0096] When the image retrieval system as described above is used to retrieve an image in which a subject may be captured from images captured in various places, it is possible that the subject is captured based on positional information of the subject. Since images having higher qualities are set as search targets, images can be searched efficiently.

The description of the image retrieval system has been completed. Finally, an image selection device 30 provided in the image management server 20 for limiting the number of images captured by the camera 40
Another configuration of 0 will be described. FIG. 22 shows the configuration of the image selection device 300. The image selection device 300 includes an identical image selection unit 308, an image selection processing unit 310, a subject image recognition unit 320, a subject detection unit 330, and a camera control unit 340.

The same image selection unit 308 performs a process of selecting an image of the same subject from a plurality of images captured by the camera 40 that captures a specific area.

The image selection processing section 310 performs processing for limiting the number of images of each subject to a predetermined number of images selected by the same image selection section 308 according to predetermined conditions.

The subject image recognizing section 320 recognizes the expression of each subject in the image picked up by the camera 40.

When the same image selecting unit 308 recognizes that the same subject is present in a plurality of images picked up in a specific area, the image selection processing unit 310 selects the same subject according to a predetermined condition. A process for reducing the number of captured images is performed. The processing here is to store, for example, the first image of the same subject and delete the remaining images. Thereby, when there are a plurality of images that do not change much in terms of image for the same subject,
The number of images can be reduced.

FIG. 23 shows an example of processing performed by the subject image recognition section 320. In this example, conditions for an image to be removed from a plurality of images of the same person are set.
Conditions for removing the image include, for example, "closed eyes" and "angry expression".
The subject image recognition unit 320 extracts an image according to the set conditions. In the example of FIG. 23, the images 1 and 3 are extracted, but the images 2 and 4 are not extracted. This makes it possible to efficiently acquire an image of a subject having an expression that matches the set conditions.

[0103] As a condition for image extraction, a condition of an image to be stored, for example, "laughing" may be set for a plurality of images of the same person.

The above description relates to the case where the image selecting device 300 narrows down the number of images based on predetermined conditions from images that have already been captured. Next, a description will be given of how the image selection device 300 controls the number of times of imaging by the camera 40.

FIG. 24 shows an example in which the object detecting section 330 detects the position of the object. In this case, the subject has a radio wave transmitter 360 for transmitting radio waves. The radio wave transmitter 360 may be a wireless communication unit such as a mobile phone and a PHS. The electric wave transmitted from the electric wave transmitter 360 is received by the electric wave detector 370. The position of the subject having the transmitter is specified based on the strength of the received radio wave or the like. This allows
When it is detected that the subject has come to the predetermined position, the camera control unit 340 causes the camera 40 to image the subject at the predetermined position.

FIG. 25 shows another example in which the object detecting section 330 detects the position of the object. In this case, the subject has an ID card necessary to pass through the gate 390. The subject detection unit 330 detects the entry of the subject by inserting the ID card into the ID card insertion slot. When the entry of the subject is grasped, the camera control unit 340 causes the camera 40 to take an image after a predetermined time has elapsed.

FIG. 26 shows an example of image pickup by the voice sensor 380. The voice sensor 380 detects voices such as cheers emitted by the subject. When a cheering or the like is detected, the image pickup by the camera 40 is automatically performed. Thereby, while the subject is surprised at a predetermined playground or the like at the amusement park facility, it is possible to accurately capture the facial expression when he / she is pleased,
It is not necessary to capture an image having little feature in the expressions before and after that.

The image selection device 300 can reduce the number of images to be searched and store images captured only at appropriate timing.

[0109] The personal image providing system 10 described above captures a natural expression of a person when playing in an amusement park facility, and retrieves and provides an image of a specific person from the captured image. Can be.

Although the present invention has been described with reference to the embodiment, the technical scope of the present invention is not limited to the scope described in the above embodiment. Various changes or improvements can be added to the above embodiment. It should be noted that such modified or improved embodiments may be included in the technical scope of the present invention.
It is clear from the description of the claims.

[0111]

As is apparent from the above description, according to the present invention, an image in which a subject is appropriately captured can be selectively left among images captured by a camera.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example in which an embodiment of a personal image providing system 10 of the present invention is used in an amusement park.

FIG. 2 is a diagram showing a configuration of an image management server 20.

FIG. 3 is a diagram illustrating an example of a person DB 110;

FIG. 4 is a diagram showing an example of an image DB 120.

FIG. 5 is a diagram showing an example of an image set DB 130.

FIG. 6 is a diagram showing a configuration of an image search terminal 50.

FIG. 7 is a diagram illustrating an outline of a process performed by a person specifying unit on an angle set;

FIG. 8 is a diagram illustrating an outline of a process performed by a person specifying unit 190 with respect to a temporal set.

FIG. 9 is a diagram showing a flowchart when the image selection device 300 discards an image captured by the camera 40.

FIG. 10 is a diagram illustrating an example of specifying a position of a subject.

FIG. 11 is a diagram illustrating a state in which a specific object and a subject have a specific positional relationship as an imaging timing.

FIG. 12 shows an image management server 20, a person information device 30,
FIG. 3 is a diagram showing a sequence chart representing exchange of data between the camera and a camera.

FIG. 13 is a diagram showing a sequence chart when executing an image search between the image management server 20 and the image search terminal 50.

14 is a diagram illustrating an example of an image search setting screen displayed on the image search terminal 50. FIG.

FIG. 15 is a diagram showing an example of a search result list and an output setting screen displayed on the image search terminal 50.

FIG. 16 is a diagram illustrating an example in which a subject position information acquisition unit 210 acquires position information.

FIG. 17 is a diagram illustrating another example when the subject position information acquisition unit 210 acquires position information.

FIG. 18 is a diagram illustrating an example of a position information DB 230.

FIG. 19 is a diagram illustrating an example of searching for an image in which a subject that has passed a predetermined point is captured.

FIG. 20 is a diagram illustrating an example of searching for an image in which a subject has passed two different points.

FIG. 21 is a diagram illustrating an example of specifying a position of a subject in a predetermined route.

FIG. 22 is a diagram showing a configuration of an image selection device 300.

FIG. 23 is a diagram illustrating an example of processing performed by a subject image recognition unit 320.

FIG. 24 is a diagram illustrating an example when a subject detection unit 330 detects the position of a subject.

FIG. 25 is a diagram showing another example when the subject detection unit 330 detects the position of a subject.

FIG. 26 is a diagram illustrating an example of image pickup by a sound sensor 380.

[Explanation of symbols]

 Reference Signs List 10 personal image providing system 20 image management server 30 person information acquisition device 40 camera 50 image retrieval terminal 60 output device 90 image retrieval unit 210 subject position information acquisition unit 300 image selection device 330 subject detection unit 340 camera control unit

Claims (9)

[Claims] A camera for picking up an image in a specific area; an image selecting means for selecting an image of the same subject imaged by the camera; and a predetermined number of images of the selected image of the same object. An image selection device comprising: an image selection processing unit that selects an image. 2. The image processing apparatus according to claim 1, further comprising: a subject image recognizing unit that recognizes an image of the subject in the image captured by the camera; The apparatus according to claim 1, wherein an image of the same subject is recognized. 3. The image recognition unit recognizes a facial expression of a subject in an image captured by the camera, and the image selection processing unit determines that the facial expression of the subject recognized by the image recognition unit is a predetermined facial expression. 3. The image selection device according to claim 2, wherein the image having the predetermined number is the predetermined number of images. 4. An object to be imaged has a transmitter for transmitting radio waves, and a camera for imaging the object, and detecting a radio wave transmitted from the transmitter,
A subject position obtaining unit that specifies the position of the subject; and a camera control unit that performs imaging by the camera when the position of the subject obtained by the position information obtaining unit has reached a predetermined position. An image selection device characterized by the above-mentioned. 5. An audio sensor for detecting a sound emitted from a subject, wherein the camera control unit further causes the camera to perform an imaging operation when a specific sound is acquired by the sound sensor. The image selection device according to claim 4, characterized in that: 6. A gate for recording an entry of a subject, a camera provided at a position where the subject passing through the gate passes, and a camera for capturing an image of the subject; An image selection device, comprising: a camera control unit that causes the camera to take an image after a lapse of time. 7. An image, wherein an image of the same subject captured by a camera in a specific area is selected, and a predetermined number of images are selected from the selected images of the same subject. Selection method. 8. An object to be imaged has a transmitter for transmitting a radio wave, and by detecting a radio wave transmitted from the transmitter,
An image selection method comprising: specifying a position of the subject; and causing a camera to perform imaging when the specified position of the subject becomes a predetermined position. 9. A gate for recording entry of a subject, and a camera provided at a position where the subject passing through the gate passes and which captures an image of the subject. After the gate records entry of the subject, An image selection method, characterized in that an image is taken by the camera after a lapse of a predetermined time.