JP4522344B2 - Imaging apparatus, control method thereof, and program thereof - Google Patents

Description

The present invention relates to an imaging apparatus such as a digital camera, a control method thereof, and a program thereof .

With the widespread use of digital cameras and mobile phones with photo functions, there is an increasing demand for sharing a captured image taken by one person with another person or a plurality of persons. For example, in the case of a mobile phone with a photo function, a person who wants to send the photographed image is specified by an e-mail address or a telephone number, and the image is sent to the specified destination so that a plurality of people can be communicated. A specific photographed image can be shared.
JP 2004-62868 A

  However, in the above conventional technique, each photographed image taken by the operator is examined, it is determined whether or not a specific person is included in the captured image, and if a specific person is included, the address of that person is set. The operation is troublesome because it is necessary to search, specify the image and send it.

  Patent Document 1 describes a technique for automatically recognizing a person's face included in a captured image and recording the person's name. If such a technique is used, it can be automatically determined whether or not a specific person is included in the captured image. However, the technique of Patent Document 1 writes information indicating a person name in metadata of a photographed image, and does not focus on the above-described problem.

  The object of the present invention is to solve the above-described conventional problems.

Feature of the present invention, the destination of the images that contain the particular face, queries to a plurality of terminals in the network, by automatically transmitted to the destination, eliminates the trouble of the operator plurality there imaging apparatus and a control method thereof by a plurality of terminals can exchange the captured image and to provide the program.

An imaging device according to one embodiment of the present invention includes the following configuration. That is,
An imaging device to which a storage medium on which an image is recorded can be connected,
Against the plurality of terminals in the network, the inquiry means for inquiring the destination information of each terminal associated with the face information and the face information of the user,
Determining means for determining whether or not the image recorded in the storage medium includes a face corresponding to the face information of the user inquired by the inquiry means;
By the determining means, when it is determined to contain a corresponding face on the face information in the image, a transmitting means for transmitting the image, the delivery destination based on the destination information corresponding to the user,
It is characterized by having.

An imaging device control method according to an aspect of the present invention includes the following steps. That is,
A method for controlling an imaging apparatus to which a storage medium on which an image is recorded can be connected,
Against the plurality of terminals in the network, the inquiry step of inquiring the destination information associated with the face information and the face information of the user,
A determination step of determining whether or not the image recorded in the storage medium includes a face corresponding to the face information of the user inquired by the inquiry step;
By the determination step, when it is determined that contains the corresponding face to the face information in the image, a transmission step of transmitting the image, the delivery destination based on the destination information corresponding to the user,
It is characterized by having.

According to the present invention, the destination of the images that contain the particular face, queries to a plurality of terminals in the network, by automatically transmitted to the destination, eliminates the trouble of the operator plurality There is an effect that a photographed image can be exchanged with the terminal .

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The following embodiments do not limit the invention according to the claims, and all the combinations of features described in the embodiments are not necessarily essential to the solution means of the invention. .

[Embodiment 1]
First, Embodiment 1 of the present application will be described. In the first embodiment, when a plurality of persons and their distribution destination information are registered in a specific camera, it is determined whether or not the registered person is included in an image captured by the camera. If the person is included, the case where the image is transmitted to the camera of the user will be described.

  FIG. 1 is a block diagram showing a configuration of a digital camera 10 according to the present embodiment.

  The camera control unit 11 controls the overall operation of the camera 10 and physically controls the CPU, a ROM storing a control program executed by the CPU, and execution of control processing by the CPU. Sometimes, it is constituted by a RAM or the like for temporarily storing various data. The control target in the control unit 11 is image capturing in the image capturing unit 12 based on a trigger such as a shutter from the input unit 13, output of the captured image data via wire or wireless, power supply monitoring, and a face described later. For example, identification information and distribution destination registration.

  The imaging unit 12 includes an imaging device (CCD), an image buffer memory, and the like. After the captured image is stored in the temporary buffer memory, it is stored in the storage medium 20 such as a memory card under the control of the camera control unit 11. Or can be transmitted to the outside of the camera 10 via a wired or wireless control unit. The input unit 13 includes switches, buttons, and the like operated by the user, and is used to perform operations such as operation using a UI, power supply, shutter, and camera zoom. The battery 14 supplies power for the entire camera 10. Depending on the case, it may be supplied to the outside via the connector 17 or may be supplied with power from the outside. The power monitoring unit 15 measures the battery capacity of the battery 14 and notifies the camera control unit 11 of it.

  The wired communication unit 16 serves as a controller for the connector 17, monitors the connection status of the connector, and notifies the camera control unit 11 of the monitoring result. The connector 17 is configured by a plurality of connection terminals, and transmits and receives image data to and from other terminals (for example, a PC or a printer). The connector 17 includes a power line and the like.

  The wireless communication unit 18 has a function related to wireless communication, receives a signal received from the camera control unit 11, modulates the signal into an RF signal, and transmits the RF signal to the antenna 19. Further, the RF signal received from the antenna 19 is demodulated and passed to the camera control unit 11. The antenna 19 is responsible for transmitting and receiving RF signals.

  The registration unit 21 registers face identification information of the user of this camera, face identification information of a person photographed using this camera, and distribution destination information corresponding thereto. Here, the delivery destination information may be IP, for example, and may be each person's mobile phone number, mail address, or the like. The display unit 20 displays a photographed image, a photographed image, and a message and menu for UI.

  FIG. 2 is a diagram illustrating face identification information registered in the registration unit 21 and distribution destination information corresponding to the face identification information.

  In the figure, A indicates the face identification information of the user of the camera 10. B to D indicate face identification information of a person registered as a photo delivery destination and corresponding delivery destination information, and here, the delivery destination information is indicated by an IP address of a digital camera owned by the person. Has been.

  FIG. 3 is a flowchart for explaining the registration process of face information and distribution destination information in the digital camera 10 according to the present embodiment. This process is executed by the camera control unit 11.

  First, in step S1, a person to be registered is photographed, and the photographed image information is input. Next, in step S2, feature information of the face of the person being photographed is extracted. In step S3, identification information of the face is generated. Next, in step S4, it is determined whether or not the generation of the face identification information has been successful. If not, the display unit 22 displays a message for instructing the user to perform an operation for registration again. .

  When the face identification information is generated in this way, the process proceeds to step S6, and a screen for inputting the user name and distribution destination information is displayed on the display unit 22. When these are input using the input unit 13, the process proceeds to step S7. Then, the face identification information and the delivery destination information are registered in the registration unit 21.

  FIG. 4 is a diagram illustrating an example of a UI screen for registering face identification information and distribution destination information.

  FIG. 4A shows an example of a screen displayed on the display unit 22 at the start of the mode for registering face identification information at the time of step S1 in FIG. FIG. 4B shows an example of a screen for prompting input of distribution destination information (here, an IP address) after extraction of face identification information is completed in step S6 of FIG. Here, first, whether to distribute to a camera that is currently registered or to set an arbitrary IP address, move the cursor 402 in FIG. 4B using the user interface in the input unit 13. decide. For example, when registering the distribution of the owner A, the distribution destination can be automatically registered by setting the cursor 402 to the own camera. On the other hand, when specifying distribution to another camera, the cursor 402 is moved to set an arbitrary IP address.

  In this embodiment, a case where another distribution destination is set will be described. In the case of arbitrary IP address setting, the IP address of the user's camera is input in the column 400 and the OK button 401 is designated. Thereby, the delivery destination information is registered in association with the face identification information. The distribution destination information is not limited to the IP address of the registered camera. For example, the IP address of a storage that stores images that are always taken by the user who owns the camera may be designated. Even if the camera is owned by the user, another storage or the like may be registered as a distribution destination of the captured image.

  Next, based on the flowchart of FIG. 3 described above, it is determined whether or not a registered person is included in the image captured by the camera. This will be described in the case of transmission to the camera.

  FIG. 5 is a flowchart for explaining processing in the camera 10 according to Embodiment 1 of the present invention.

  First, in step S11, a captured image is input. This may be an image taken by the image pickup unit 12 of the own device, or may be an image inputted by attaching a memory card storing an image taken by another camera. Next, in step S12, the face of a person included in the image is recognized, and feature information of the face is extracted to obtain face identification information. Next, in step S13, it is determined whether or not face identification information corresponding to the face identification information extracted in step S12 is registered in the registration unit 21. If it is not registered, the process proceeds to step S16. If it is registered, the process proceeds to step S14, and distribution destination information corresponding to the face identification information is read. In step S15, the image information is transmitted wirelessly from the wireless communication unit 17 based on the distribution destination information. In step S16, it is checked whether identification of all the faces included in the image is completed. If an unprocessed face is still included, the process returns to step S12 to execute the above-described processing. In this way, when the recognition and transmission processing of all human faces included in the image is completed, this processing ends. In this embodiment, the image is transmitted every time it is identified from step S12 to step S14. However, it is also possible to transmit the image at a time after all the images have been identified.

  Further, in this embodiment, registration processing of face identification information and distribution destination information of a plurality of cameras is performed by one camera. However, the present invention is not limited to this mode, and registration may be performed by transmitting a combination of face identification information and distribution destination information associated with each camera to the registration unit 21 of one camera serving as a distribution source. good.

  Further, in the present embodiment, the holding of the registration information of the identification information and the delivery destination information is limited to an apparatus that can acquire or calculate the original data of the identification information. That is, the registration destination of the face identification information is an imaging device such as a camera. However, registration information registered by a device that can acquire or calculate the original data of the identification information may be transmitted to a data processing device that cannot acquire the original data of the identification information, such as a printer. Further, a storage medium may be inserted into a slot of a removable storage medium attached to the data processing apparatus, and an image stored in the storage medium may be automatically distributed.

[Embodiment 2]
Next, a second embodiment of the present invention will be described. In the second embodiment, grouping (registration as a friend) is performed between a plurality of digital cameras, and the face identification information of the user of the camera and the distribution destination from the camera that has taken an image in the group to the other camera Query information. Based on the face identification information of the camera user transmitted from each camera in response to this inquiry, it is determined whether or not the person is included in the image. If it is included, the image is transmitted to a transmission destination designated by the user's camera. The configuration of the camera according to the second embodiment is the same as the configuration of the camera according to the first embodiment, and a description thereof will be omitted.

  FIG. 6 is a diagram best showing the characteristics of the second embodiment of the present invention.

  Here, each of the users A to E has their own camera, and the cameras of the users A to E are grouped as being included in one group. Further, it is assumed that the face identification information and IP address of the user are registered in each camera. Here, the difference from the first embodiment described above is that the user's face identification information and IP address registration information are not managed centrally by the registration unit 21 of the distribution source camera, but registration of each camera. It is stored in the unit 21. Therefore, it is necessary to communicate with a distribution candidate destination terminal before distribution. Hereinafter, the identification procedure in this case will be described. First, when the user A's camera is used to capture an image including persons A, D, and E, the camera is registered in each camera with respect to each of the other cameras grouped in advance. Requesting the user's face identification information and IP address. Each camera that has received this request responds by transmitting face identification information and distribution destination information. Receiving this, the camera A identifies the person included in the photographed image 600 based on the received face identification information, and transmits the photographed image to the distribution destination corresponding to the identified person.

  FIG. 7 is a flowchart for describing processing performed by each camera when grouping is performed between a plurality of cameras.

  First, in step S31, a camera existing in the wireless network is searched. When a camera is detected in step S32, the process proceeds to step S33, the camera identification information is requested from the camera, and the camera identification information responding to the request is stored in the memory of the control unit 11 as a network registration list. . As a result, identification information of each camera grouped in the network can be acquired and registered. In this step S33, the priority order of the cameras registered as one group is set as the registration order, so that the camera priority order in the subsequent inquiry and image transmission conforms to this registration order. Also good.

  FIG. 8 is a flowchart illustrating transfer processing within a group of captured images in the camera according to Embodiment 2 of the present invention.

  In step S41, a photographed image is input. This may be an image taken by the image pickup unit 12 of the own device, or may be an image inputted by attaching a memory card storing an image taken by another camera. In step S42, each camera grouped is inquired about face identification information and distribution destination information registered in each camera. The inquiry order in this case may be, for example, the registration order described above. Next, in step S43, it is checked whether or not there is a response from the inquired camera. If there is no response, the process proceeds to step S47. If there is no response, the process proceeds to step S44 to check whether the inquiry has been made a predetermined number of times. If not, in step S45, the inquiry is retransmitted and the process returns to step S43. On the other hand, if retransmission has been performed a predetermined number of times in step S44, the process proceeds to step S46, where it is determined that the camera does not exist in the network or the power is off, and the inquiry to the camera is abandoned. Proceed to step S49.

  On the other hand, when there is a response from the inquired camera in step S43, the face identification information and the distribution destination information are transmitted. In step S47, the received face identification information and distribution destination information are stored. Then, it is determined whether or not the photographed image includes a face corresponding to the received face identification information. If included, the process proceeds to step S48, and the captured image is transmitted to the camera corresponding to the distribution destination information corresponding to the face identification information. In step S49, it is checked whether or not an inquiry has been made to all the cameras in the group. If an inquiry has been made to all the cameras, the process is terminated. If not, the process returns to step S42, and Execute the process.

  In this way, the captured images can be exchanged between cameras registered in a certain group.

  In the second embodiment, the case where image information is exchanged within a certain group has been described with reference to the case where each camera can perform transmission on an equal basis, but the present invention is not limited to this. For example, the camera that starts grouping first may have the same function as the server, and the other cameras may function as clients. In this way, contention for image transmission between cameras may be adjusted by the server.

  FIG. 9 is a flowchart for describing processing for determining the order of image transmission between cameras according to the second embodiment. Here, the server is a camera that has started grouping, and the client is a camera participating in this group. Steps S51 to S54 in FIG. 9 show processing in the client, and steps S61 to S66 in FIG. 9 show processing in the server. This process may be executed in step S15 in FIG. 5 and step S48 in FIG.

  First, in step S51, the client requests image transmission (distribution). As a result, the server receives the transmission request in step S61. In step S62, the transmission request is added to the transmission waiting list. In step S63, it is checked whether there is a camera that is transmitting data in this group. If there is a camera that is transmitting, the process waits in step S63. If there is no camera that is transmitting, the process proceeds to step S64 to notify the first registered camera included in the transmission waiting list of transmission permission. . In step S65, the transmission request is deleted from the transmission waiting list. In step S66, the server confirms whether or not the transmission waiting list is empty. If it is not empty, that is, if there is a client waiting for transmission, the server returns to step S63 and executes the above-described processing. When the transmission waiting list becomes empty, this process is terminated.

  The client that has received the transmission permission thus issued proceeds from step S52 to step S53, and transmits image information to the transmission target camera. When the transmission is completed, the transmission completion is notified to the server.

  FIGS. 10A and 10B are diagrams illustrating the recovery process when the destination camera is moving out of the service area.

  In FIG. 10A, when transmission of image information is instructed, the process proceeds to step S71 to check whether transmission is possible. If transmission is possible, the process proceeds to step S72, and the process proceeds to the image information transmission process shown in step S15 or step S48 described above.

  On the other hand, if transmission is impossible in step S71, the process proceeds to step S73 to determine whether or not to make a transmission reservation. If not, the transmission request is canceled in step S74. On the other hand, if a transmission reservation is made in step S73, the process proceeds to step S75, and the transmission request is added to the transmission waiting list. Next, in step S76, it is determined whether transmission is possible. If it is possible, the process proceeds to step S78, the transmission request is deleted from the transmission waiting list, and the process proceeds to step S72. If transmission is not possible in step S76, the process proceeds to step S77, waits for a predetermined time, and repeats step S76.

  FIG. 10B is a diagram showing an example of a UI screen displayed on the display unit 22 when inquiring of the user whether or not to make a transmission reservation in step S73.

  Here, if transmission is impossible in step S71, the process proceeds to step S73, where “transmission is not possible” is displayed, and a message “destination terminal is out of service area. Do you reserve transmission?” Is displayed. When “YES” is selected and the OK button is designated, the process proceeds to step S75, and the transmission request is additionally registered in the transmission reservation list.

  In this way, even when the other party's camera is out of the service area, it can be automatically transmitted to the other party when it returns to the service area.

  In addition, it is possible to prevent transmission contention due to simultaneous transmission of image information among a plurality of cameras.

  It should be noted that a specific mark (icon) indicating an image in the group may be added to the images exchanged in the group and distributed.

  Further, the inquiry to each camera in step S42 in FIG. 8 has been described for each camera. However, the present invention is not limited to this, and may be transmitted by broadcast to the cameras in the group. .

  In this embodiment, it is determined whether or not the person is included in the photograph based on the face identification information. However, the present invention is not limited to this. Can be any other identifiable information. In particular, when registering the characteristics of clothes, there is no problem as long as it is a grouping for a short period, such as during a trip, or registration of person and distribution information. Similarly, if the resolution of the captured image is sufficient, it is possible to use biometric information captured in an image such as iris information.

  In the present embodiment, the method of automatic distribution for still images has been described. However, the processing described above can be applied to still images of unit time constituting moving images for moving images.

  Further, in the present embodiment, the holding of the registration information of the identification information and the delivery destination information is limited to an apparatus that can acquire or calculate the original data of the identification information. That is, the registration destination of the face identification information is an imaging device such as a camera. However, the registration information registered by a device that can acquire or calculate the original data of the identification information is transmitted to a data processing device that cannot acquire the original data of the identification information, such as a printer, or attached to the data processing device. A storage medium may be inserted into a removable storage medium slot, and an image contained therein may be automatically distributed.

[Embodiment 3]
In the first and second embodiments described above, when the face identification information and the distribution information are registered in association with each other, the user is requested to capture a face image necessary for the face identification information. On the other hand, in the third embodiment, an image captured in advance is reproduced, face identification information is extracted from the reproduced image, and is registered in association with distribution information. The configuration of the camera according to the third embodiment is the same as the configuration of the camera according to the first embodiment, and a description thereof will be omitted.

  FIG. 11 is a flowchart showing registration processing of face identification information and distribution information from a reproduced image in the camera according to Embodiment 3 of the present invention.

  First, an image including a face image to be registered is reproduced in the reproduction mode, and the mode is changed to the registration mode. At this time, the transition to the registration mode can be arbitrarily performed by the user via the user interface included in the input unit 13. When the mode transitions to the registration mode in this way, it is determined in step S111 whether or not a face image exists in the image being reproduced at that time. If no face image exists, the fact is displayed on the GUI and the registration mode is terminated.

  FIG. 12A is a diagram illustrating an example of a GUI screen when a transition is made from a reproduced image having no face image to a registration mode.

  The GUI screen is displayed by the display unit 22 as in the case of the first embodiment. In this case, the user instructs the OK button 1201 using the GUI using the input unit 13, and the process ends.

  In step S111, if a face image exists in the image, the process proceeds to step S112, and a face is detected from the image. Here, it is assumed that the face of a plurality of persons is shown in the image, and the subsequent processing is performed according to the recognition order of the recognition algorithm of the face image. However, in the third embodiment, details of the face image recognition algorithm and the order of face image recognition depending on the algorithm are not mentioned.

  When a face is detected from the image in this way, the process proceeds to step S113, and a screen for inquiring whether or not the face image is a person to be registered is displayed.

  FIG. 12B is a diagram illustrating an example of a GUI screen when the mode is changed to the registration mode in a state where an image including the face images of three people is reproduced.

  Here, the face image 1202 of the person A is detected by the face image recognition program, and the user is inquired whether to register with this image. If the user designates the OK button 1203, the process proceeds from step S113 to step S115, and face identification information is generated from the face image 1202. In step S116, if it is confirmed that the face identification information can be generated from the face image 1202 and processed normally, the process proceeds to step S117, and a GUI screen that prompts the user to set a delivery destination is displayed. The GUI screen at that time is the same as that shown in FIG. When the delivery destination is set in this way, the registration work is completed.

  On the other hand, if a skip button 1204 indicating that the face image is not a registration target face image is instructed in step S113, the process proceeds to step S114 to determine whether or not all face images in the target screen have been detected by the face recognition algorithm. If all face images have been detected, the process is terminated as is. If there is a face image that has not been detected yet, the process proceeds to step S112, and the above-described operation is repeated.

In the third embodiment, once the facial image registration process is successful, the registration operation is completed. This is because it is assumed that only one registration information is registered in one camera, but the present invention is not limited to this processing. Even in the case of co-registering the images of plurality of persons, it is also possible that after the process is completed in step S117 to continue the re-registration process transfers control to step S114 to register the plurality of images.

  As described above, according to the third embodiment, face image registration processing can be performed from the playback mode of the camera. Then, the present invention can be implemented by performing the distribution process of the captured image in the same manner as in the method of any one of the first and second embodiments.

  In the third embodiment, the registration of face identification information and distribution destination information is limited to devices that can acquire or calculate original data of identification information. That is, the registration destination of the face identification information is an imaging device such as a camera. However, the original data of the identification information cannot be acquired, but can be reproduced only. For example, the storage medium is inserted into the removable storage medium slot attached to the data processing apparatus such as a printer with a viewer, and is included in the storage medium. The same applies to the case of registering an image to be registered through a viewer.

  Furthermore, the acquired registration information can be transferred to another data processing apparatus and registered in the data processing apparatus.

[Embodiment 4]
In the fourth embodiment, a case will be described in which voice identification information is extracted from moving picture information and a shot moving picture is distributed to a predetermined data processing device based on the voice identification information. The configuration of the camera according to the fourth embodiment is the same as the configuration of the camera according to the first embodiment, and a description thereof will be omitted.

  FIG. 13 is a flowchart for describing registration processing of voice identification information and distribution destination information in the digital camera 10 according to Embodiment 4 of the present invention. This processing is executed by the camera control unit 11.

  When the registration mode is selected, voice is first recorded in step S1301. Next, in step S1302, identification information of the voice is generated. In step S1303, it is determined whether the voice identification information has been successfully generated. If not, the process proceeds to step S1305, and the user is prompted to perform another registration operation on the display unit 22. Display a message to instruct. When the voice identification information is generated in step S1303, the process proceeds to step S1304, and a screen for inputting the user name and distribution destination information is displayed on the display unit 22. When the user name and the delivery destination information are input using the input unit 13 with reference to this screen, the voice identification information and the delivery destination information are registered in the registration unit 21.

  Here, details of the voice identification information and a generation algorithm are not particularly mentioned. Therefore, the voice identification specific algorithm described later is not mentioned. For example, frequency analysis is performed on voice information acquired as voice identification information, and histogram data composed of frequency and amplitude is held. At the time of identification, the algorithm calculates the absolute value of the difference in amplitude for each sampling frequency and makes the sum equal to or less than a certain threshold value, but the algorithm is limited to this method. is not.

  14A to 14C are diagrams showing examples of UI screens for registering voice identification identification information and distribution destination information according to the fourth embodiment.

  FIG. 14A shows an example of a screen displayed on the display unit 22 at the start of a mode for registering voice identification information in step S1301 of FIG. Here, a “recording start” and “cancel” buttons are displayed together with a message “Please record the voice of the person to be registered”. Here, recording is started when the user instructs a “recording start” button 1401. On the other hand, when the “cancel” button 1402 is instructed, the voice identification registration mode is terminated.

  FIG. 14B is a diagram showing an example of a screen immediately after the recording start button 1401 is instructed in FIG. 14A, and a message “Recording” is displayed. During this time, the person to be registered utters and inputs voice from an input device such as a microphone of the input unit 13. When the voice input is thus completed, the “recording end” button 1403 is instructed to end the recording. If a “cancel” button 1404 is instructed here, the state returns to the state of FIG.

  When the “recording end” button 1403 is instructed in FIG. 14B, a transition is made to the screen shown in FIG. In FIG. 14C, a message “The extraction of the voice identification information has been completed. Please set the registered delivery destination.” Is displayed to prompt the input of the delivery destination information (here, the IP address). Here, it is set using the user interface of the input unit 13 whether to perform distribution to the camera currently performing the registration work or to set an arbitrary IP address. For example, when registering distribution to the owner A, the cursor 1405 is set to the own camera, that is, “this camera”.

  On the other hand, when specifying another camera as a delivery destination, an arbitrary IP address is set. In this case, the IP address of the camera is entered in the field 1406 and an “OK” button 1407 is designated. Thereby, the delivery destination information input in the column 1406 is registered in association with the voice identification information registered in FIG. On the other hand, when a “cancel” button 1408 is instructed, the registration process is stopped.

  Note that the distribution destination information is not limited to the IP address of the camera that has registered, and for example, an IP address of a storage that stores images that are always taken by a user who owns the camera may be designated. Moreover, even if it is a camera owned by itself, the captured image may be registered as another storage destination.

  Next, a method for distributing a captured moving image to terminals in the network based on the voice identification information thus registered will be described. In the fourth embodiment, as in the second embodiment described above, each of the users A to E has their own camera, and these users A to E are grouped on the assumption that they are included in one group. It is assumed that Also, it is assumed that the voice identification information and IP address of the user are registered in each camera. The system configuration in the fourth embodiment is the same as that in FIG.

  Here, it is assumed that the voice identification information of the user and the registration information of the IP address are not centrally managed by the registration unit 21 of the distribution source camera but are stored in the registration unit 21 of each camera. Therefore, it is necessary to communicate with a distribution candidate destination terminal before distribution. Hereinafter, the identification procedure in this case will be described.

  When the cameras A to E are grouped, a moving image including the voices of the persons A, D, and E is shot using the camera of the user A. The camera A requests the voice identification information and IP address of the user registered in each camera to each of the other cameras B to E grouped in advance. Each of the cameras B to E that has received this request responds by transmitting voice identification information and distribution destination information to the camera A. Receiving this, the camera A analyzes the voice included in the captured image based on the received voice identification information. Then, a person is identified from the analyzed voice information, and the captured image is transmitted to a delivery destination corresponding to the identified person.

  Here, a method of grouping a plurality of cameras that distribute photographed images is the same as that in the second embodiment, and can be described with reference to the flowchart of FIG.

  FIG. 15 is a flowchart illustrating transfer processing within a group of captured images in the camera according to Embodiment 4 of the present invention.

  In step S1501, a captured image is input. This may be an image taken by the image pickup unit 12 of the own device, or an image may be input by attaching a memory card storing an image taken by another camera. In step S1502, the grouped cameras are inquired about voice identification information and distribution destination information registered in each camera. The inquiry order in this case may be, for example, the registration order described above. Next, in step S1503, it is checked whether or not there is a response from the inquired camera. If there is no response, the process proceeds to step S1507. If there is no response, the process proceeds to step S1504 to check whether the inquiry has been performed a predetermined number of times. If not, the inquiry is retransmitted in step S1505, and the process returns to step S1503. On the other hand, if retransmission is performed a predetermined number of times in step S1504, the process proceeds to step S1506, where it is determined that the camera does not exist in the network or the power is off, and the inquiry to the camera is abandoned. The process proceeds to step S1509.

  On the other hand, if there is a response from the inquired camera in step S1503, since the voice identification information and the distribution destination information are transmitted, the process proceeds to step S1507, and the received voice identification information and distribution destination information are stored. Then, it is determined whether or not the photographed image includes sound corresponding to the received sound identification information. In the fourth embodiment, determination is made on a moving image including sound, but sound data is extracted from moving image data according to the image format information before performing the determination. The present invention is not limited to the image format, and any moving image format may be used. The extracted voice data is then matched with voice identification information to determine whether the same person's voice is included. As described above, the audio data identification algorithm is not limited to a specific one. If it is determined in step S1507 that the captured image includes sound corresponding to the received voice identification information, the process proceeds to step S1508, and the captured image is transferred to the camera corresponding to the delivery destination information corresponding to the voice identification information. Send. In step S1509, it is checked whether or not an inquiry has been made to all the cameras in the group. If an inquiry has been made to all cameras, the process ends. If not, the process returns to step S1502, and the above-described process is performed. Execute the process.

  In this manner, captured images can be exchanged between cameras registered in a certain group.

  In the fourth embodiment, when image information is exchanged within a certain group, each camera can transmit the same information, but the present invention is not limited to this. For example, the grouping is performed first. The camera that started the process may have the same function as the server, and the other cameras may function as clients. By doing so, the server may be able to arbitrate contention for transmission of image data between cameras. The method is the same as in the second embodiment, and can be processed in the same manner as in FIG.

  Alternatively, the recovery process when the destination camera is moving out of the service area is the same as in the second embodiment, and in this case, the same process as in FIGS. 10A and 10B can be performed.

  As described above, according to the fourth embodiment, audio data can be extracted from video information, the audio can be identified, and the image can be transmitted to a delivery destination corresponding to the audio. In the fourth embodiment, the automatic distribution of moving images has been described focusing on the sound data of moving images, but the present invention is not limited to this. For example, a still image including a voice memo can be similarly handled as a form of another format file including voice data.

  In the fourth embodiment, the holding of the registration information of the identification information and the delivery destination information is limited to an apparatus that can acquire or calculate the original data of the identification information. In other words, the registration destination of the voice identification information is a data processing device including a voice input device such as a microphone. However, registration information registered by a device that can acquire original data of identification information or that can be calculated may be transmitted to a data processing device that cannot acquire original data of identification information, such as a printer. Further, a storage medium may be inserted into a removable storage medium slot attached to the data processing apparatus, and an image contained therein may be automatically distributed.

[Embodiment 5]
In the fifth embodiment, a method will be described in which voice identification information and face image information are registered in advance and a captured image is distributed to a predetermined data processing apparatus based on both identification information. The configuration of the camera according to the fifth embodiment is the same as the configuration of the camera according to the first embodiment, and a description thereof will be omitted.

  Registration processing of face identification information, voice identification information, and distribution destination information is the same as the method described in the first to fourth embodiments. This process is executed by the camera control unit 11. However, the difference from the above-described embodiment is that there are a plurality of pieces of identification information associated with the delivery destination information.

  FIGS. 16A and 16B are diagrams for explaining the difference in the data structure of identification information registered in the registration unit 21 in the fifth embodiment.

  In the first embodiment described above, the registered delivery destination information is assigned to each member of the same data structure shown in FIG. Thereby, the association between the face identification information and the delivery destination information can be realized. However, voice identification information cannot be registered. Similarly, in Embodiment 4 described above, the voice identification information and the distribution destination information are associated with each other, but the face identification information cannot be registered. That is, since each system has a specific type of identification information, it is not necessary for the registration process and the determination process to be aware of whether the identification information is face identification information or voice identification information.

  However, in the fifth embodiment, since the registration process and the determination process need to be aware of a plurality of types of identification information as face identification information and voice identification information, some information for distinguishing these is newly required.

  FIG. 16B is a diagram for explaining the data structure of registration information according to the fifth embodiment.

  This data structure has an identification information flag, identification information, and distribution destination information as members. Therefore, these identification information can be stored in association with the delivery destination information at the same time. In the fifth embodiment, the face identification information and the voice identification information are targeted, and an identification information flag for distinguishing between them can secure at least one bit. However, the present invention is not limited to this method, and other identification information may be used, three or more types of identification information may be targeted, and other identification information flags may be defined. Further, instead of including the identification information flag in the data structure, a management area in the registration unit 21 may be prepared for each identification information. Here, the registration process of each identification information is the same as the method shown in the first and fourth embodiments, and the description thereof will be omitted.

  Next, a method for distributing a captured image to terminals in the network based on the registered face identification information and voice identification information will be described. In the fifth embodiment, as in the second and fourth embodiments, each of the users A to E has their own cameras A to E, and the cameras A to E of these users A to E are Grouped as being included in one group. Each camera is registered with either the face identification information or the voice identification information of the user and the IP address. The system configuration according to the fifth embodiment is the same as that shown in FIG. Here, either the user's face identification information or the voice identification information and the registration information of the IP address are not centrally managed by the registration unit 21 of the distribution source camera, but are registered in the registration unit 21 of each camera. Stored. Therefore, it is necessary to communicate with a distribution candidate destination terminal before distribution. Hereinafter, the identification procedure in this case will be described.

  First, when an image including the voices of the persons A, D, and E is captured using the camera of the user A, the camera is connected to each of the other cameras A to E grouped in advance. Requesting either the face identification information or the voice identification information of the user registered in the IP address, and the IP address. Each camera that has received this request responds to camera A by transmitting either face identification information or voice identification information and distribution destination information. Upon receipt of this, the camera A identifies the person by analyzing the face image or the voice included in the photographed image based on either the received face identification information or voice identification information. The captured image is transmitted to the corresponding delivery destination.

  Here, a grouping method between a plurality of cameras that distribute photographed images is the same as in the second embodiment described above, and can be performed in the same manner as the flowchart of FIG.

  FIG. 17 is a flowchart illustrating transfer processing within a group of captured images in the camera according to Embodiment 5 of the present invention.

  In step S1701, an image is input. This may be an image taken by the image pickup unit 12 of the own device, or may be inputted by attaching a memory card storing an image taken by another camera. In step S1702, each of the grouped cameras is inquired about either face identification information or voice identification information registered in each camera and distribution destination information. The inquiry order in this case may be, for example, the registration order described above. Next, in step S1703, it is checked whether or not there is a response from the inquired camera. If there is a response, the process proceeds to step S1707. If there is no response, the process proceeds to step S1704 to check whether the inquiry has been made a predetermined number of times. If the predetermined number of times has not been reached, the inquiry is retransmitted in step S1705, and the process returns to step S1703. On the other hand, if retransmission has been performed a predetermined number of times in step S1704, the process proceeds to step S1706, where it is determined that the camera does not exist in the network or the power is off, and the inquiry to the camera is abandoned. The process proceeds to step S1710.

  On the other hand, if there is a response from the inquiry camera in step S1703, either the face identification information or the voice identification information and the distribution destination information are transmitted, so the process proceeds to step S1707, and the received face identification information or voice is sent. One of the identification information and the delivery destination information are stored. First, it is determined whether or not the photographed image includes a face corresponding to the received face identification information. If it is included here, the process advances to step S1709, and the captured image is transmitted to the camera corresponding to the distribution destination information corresponding to the face identification information.

  On the other hand, if it is determined in step S1707 that the face corresponding to the face identification information is not included, the process proceeds to step S1708, and it is determined whether the captured image includes sound corresponding to the received voice identification information. If the voice is included, the process proceeds to step S1709, and the captured image is transmitted to the camera corresponding to the delivery destination information corresponding to the voice identification information. If it is determined in step S1708 that the image does not contain sound, or if step S1706 or step S1709 is executed, the process proceeds to step S1710 to check whether all cameras in the group have been queried. If the inquiry is made, the process ends. If not, the process returns to step S1702 to execute the above-described process.

  In this manner, captured images can be exchanged between cameras registered in a certain group.

  In the fifth embodiment, when image information is exchanged within a certain group, each camera can perform transmission on an equal basis. However, the present invention is not limited to this. For example, the camera that starts grouping first may have the same function as the server, and the other cameras may function as clients. By doing so, the server may be able to arbitrate contention for image transmission between the cameras. The method is the same as that of the second embodiment, and can be executed in the same manner as the flowchart of FIG.

  The recovery process when the destination camera is moving out of the service area is the same as that in the second embodiment described above, and can be executed in the same manner as in FIGS.

  As described above, according to the fifth embodiment, a plurality of types of identification information can be registered from captured images, and automatic distribution based on each identification information can be realized. In the fifth embodiment, identification and automatic distribution using face identification information and voice identification information have been described. However, the type and number of identification information are not limited to this. For example, it may be anything as long as it is a person's clothes or other identifiable information. In particular, when registering the characteristics of clothes, there is no problem as long as it is a grouping for a short period, such as during a trip, or registration of person and distribution information. Similarly, if the resolution of the captured image is sufficient, it is possible to use biometric information captured in an image such as iris information. The fifth embodiment can be applied regardless of the presence or absence of still images, moving images, and audio information.

  Further, according to the fifth embodiment, the holding of the registration information of the identification information and the delivery destination information is limited to an apparatus that can acquire or calculate the original data of the identification information. That is, the registration destination of the face identification information is an imaging device such as a camera, and the registration destination of the voice identification information is a data processing device including a voice input device such as a microphone. However, registration information registered by a device that can acquire or calculate the original data of the identification information may be transmitted to a data processing device that cannot acquire the original data of the identification information, such as a printer. Alternatively, a storage medium may be inserted into a removable storage medium slot attached to the data processing apparatus, and an image contained therein may be automatically distributed.

[Other Embodiments]
The embodiment of the present invention has been described in detail above. However, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of one device. In addition, the application is not necessarily limited to a camera of consumer specifications, and the same applies to a monitoring camera for the purpose of printer, security, and management.

  In the present invention, a software program that realizes the functions of the above-described embodiments is supplied directly or remotely to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. In some cases, it can be achieved by In that case, as long as it has the function of a program, the form does not need to be a program. Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. That is, the present invention includes a computer program itself for realizing the functional processing of the present invention. In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  As a storage medium for supplying the program, for example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card ROM, DVD (DVD-ROM, DVD-R) and the like. As another program supply method, a client computer browser is used to connect to an Internet homepage, and the computer program of the present invention itself or a compressed file including an automatic installation function is downloaded from the homepage to a storage medium such as a hard disk. Can also be supplied. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the claims of the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who satisfy predetermined conditions. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  In addition to the functions of the above-described embodiments being realized by the computer executing the read program, the OS running on the computer based on the instruction of the program may be part of the actual processing or The functions of the above-described embodiment can also be realized by performing all of the above processing.

  Furthermore, after the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board or The CPU or the like provided in the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

It is a block diagram which shows the structure of the digital camera which concerns on this Embodiment. It is a figure explaining the face identification information registered into the registration part of the digital camera which concerns on this Embodiment, and the delivery destination information corresponding to it. It is a flowchart explaining the registration process of the face information and delivery destination information from the imaging | photography mode in the digital camera which concerns on this Embodiment. It is a figure which shows the example of UI screen for registering face identification information and delivery destination information. It is a flowchart explaining the process in the camera which concerns on Embodiment 1 of this invention. It is a figure which shows the characteristic of Embodiment 2 of this invention best. 10 is a flowchart illustrating processing performed by each camera when grouping between a plurality of cameras in the second embodiment. It is a flowchart explaining the transfer process based on the face identification information in the group of the picked-up image in the camera which concerns on Embodiment 2 of this invention. 10 is a flowchart for describing processing for determining the order of image transmission between cameras according to the second embodiment. It is a figure explaining the recovery process in case the transmission destination camera is moving out of service area. It is a flowchart which shows the registration process of the face identification information and the delivery information from the reproduction | regeneration image in the camera which concerns on Embodiment 3 of this invention. FIG. 4A shows an example of a GUI screen when a reproduction image without a face image transitions to a registration mode, and an example of a GUI screen when a transition is made to the registration mode while reproducing an image including three face images. It is a figure (B) shown. It is a flowchart explaining the registration processing of the audio | voice identification information and delivery destination information in the digital camera which concerns on Embodiment 4 of this invention. It is a figure which shows the example of UI screen for registering the audio | voice identification identification information and delivery destination information which concern on this Embodiment 4. FIG. It is a flowchart explaining the transfer process within the group of the picked-up image in the camera which concerns on Embodiment 4 of this invention. In Embodiment 5, it is a figure explaining the difference in the data structure of the identification information registered into a registration part. It is a flowchart explaining the transfer process within the group of the picked-up image in the camera which concerns on Embodiment 5 of this invention.

Claims (5)

An imaging device to which a storage medium on which an image is recorded can be connected,
Against the plurality of terminals in the network, the inquiry means for inquiring the destination information of each terminal associated with the face information and the face information of the user,
Determining means for determining whether or not the image recorded in the storage medium includes a face corresponding to the face information of the user inquired by the inquiry means;
By the determining means, when it is determined to contain a corresponding face on the face information in the image, a transmitting means for transmitting the image, the delivery destination based on the destination information corresponding to the user,
An imaging device comprising: The imaging apparatus according to claim 1 , wherein the captured image is a moving image having audio data. The transmission unit, an imaging apparatus according to claim 1 or 2, characterized in that wirelessly transmits to the distribution destination corresponding to the destination information. A method for controlling an imaging apparatus to which a storage medium on which an image is recorded can be connected,
Against the plurality of terminals in the network, the inquiry step of inquiring the destination information associated with the face information and the face information of the user,
A determination step of determining whether or not the image recorded in the storage medium includes a face corresponding to the face information of the user inquired by the inquiry step;
By the determination step, when it is determined that contains the corresponding face to the face information in the image, a transmission step of transmitting the image, the delivery destination based on the destination information corresponding to the user,
A method for controlling an imaging apparatus, comprising: The program for functioning a computer as an imaging device of any one of Claims 1 thru | or 3 .

Images