JP6379424B2 - Image recording device - Google Patents

Description

  The present invention relates to an image recording apparatus.

  2. Description of the Related Art Conventionally, techniques for recording various types of information in association with captured images have been proposed. For example, Patent Literature 1 describes a camera including an environment information sensor that acquires environment information around the camera. An image recording apparatus is described in which an environmental information sensor outputs environmental information to a CPU in conjunction with a half-press operation of a shutter button, and the CPU records environmental information in a header portion in conjunction with release of a full-press operation of the shutter button. ing. With this configuration, an object is to remind the photographer of the situation at the time of photographing with reference to the content corresponding to the recorded environment information. Patent Document 1 also describes a camera including a photographer information sensor that acquires biometric information of a photographer, instead of the environment information sensor. Examples of photographer information sensors include body temperature sensors, pulse sensors, blood pressure sensors, and the like.

JP 2006-86823 A

  However, even when a photographer holding the camera performs photographing, there is no guarantee that there is a relationship with an image photographed only by the photographer. Rather, the person represented in the image photographed as the subject may be more relevant to the image. Also, the owner who owns the camera is not always a photographer. For example, when the owner requests the person who is present at the spot to take a picture, the holder may appear in the photographed image. In such a case, the photographer related to the biometric information acquired by the camera described in Patent Document 1 does not match the person shown in the image or the owner. Therefore, the situation at the time of shooting may not be recalled.

  The present invention has been made in order to solve the above-described problems, and provides an image recording apparatus capable of recalling a situation at the time of shooting regardless of a photographer.

  The present invention has been made to solve the above problems, and one aspect of the present invention includes a communication unit that receives biological information from a biological information acquisition unit, a face image, and device information of the biological information acquisition unit. A storage unit that stores associated registration information for each person, and a face recognition range that represents a person's face from an image captured by the image capturing unit is determined, and an image within the determined face recognition range and the storage unit are stored A recognition unit that identifies a person based on a face image, a biometric information acquisition unit of the person identified by the recognition unit based on device information stored in the storage unit, and an image captured by the photographing unit, And a recording control unit that stores the biometric information received from the specified biometric information acquisition unit in the storage unit in association with the face recognition range determined by the recognition unit.

  According to the present invention, the situation at the time of shooting can be recalled irrespective of the photographer.

1 is a conceptual diagram illustrating an image recording system according to a first embodiment. 1 is a block diagram illustrating a configuration of an image recording apparatus according to a first embodiment. It is a sequence diagram which shows the image recording process which concerns on 1st Embodiment. It is a figure which shows the example of the imaging | photography information produced | generated based on image data. It is a figure which shows the example of the image displayed in 1st Embodiment. It is a block diagram which shows the structure of the image recording device which concerns on 2nd Embodiment. It is a flowchart which shows an example of the registration information generation process which concerns on 2nd Embodiment. It is a figure which shows an example of the registration screen which concerns on 2nd Embodiment. It is a flowchart which shows the other example of the registration information generation process which concerns on 2nd Embodiment. It is a flowchart which shows the image data recording process which concerns on 2nd Embodiment. It is a table | surface which shows the example of biometric information. It is a figure which shows the example of the image displayed in 2nd Embodiment. It is a block diagram which shows the structure of the image recording device which concerns on 3rd Embodiment. It is a flowchart which shows the display control process which concerns on 3rd Embodiment. It is a figure which shows the example of the image displayed in 3rd Embodiment. It is a block diagram which shows the structure of the image recording device which concerns on 4th Embodiment. It is a table | surface which shows the example of the biometric information to which the order | rank was added. It is a figure which shows the example of the image displayed in 4th Embodiment.

(First embodiment)
A first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a conceptual diagram showing an image recording system 1 according to this embodiment.
The image recording system 1 includes an image recording device 10 and biological information acquisition units 20-1 and 20-2.

  The image recording apparatus 10 acquires image data indicating an image of a subject in a predetermined surrounding visual field. Further, the image recording apparatus 10 acquires environment information indicating the state of the surrounding environment. The image recording apparatus 10 receives the biological information of a person from the biological information acquisition units 20-1 and 20-2. The image recording apparatus 10 may be an electronic device having a function of acquiring and recording an image. The image recording apparatus 10 is, for example, a multi-function mobile phone (including a so-called smartphone) having a camera, a tablet terminal, or a digital camera that captures a still image.

  The biological information acquisition units 20-1 and 20-2 measure biological information that can be physically measured for each person to be measured, and transmit the measured biological information to the image recording apparatus 10. The biometric information acquisition units 20-1 and 20-2 may be wearable devices that can be worn by the person. The biological information acquisition unit 20-1 includes, for example, an activity meter 21-1, a heart rate monitor 22-1, and a pedometer 23-1. The biological information acquisition unit 20-2 includes, for example, an activity meter 21-2, a heart rate monitor 22-2, and a pedometer 23-2.

The activity meter 21-1 and 21-2 can be worn on the upper limbs of a person, for example, and measures the calorie consumption within a day of the person who is wearing it. The heart rate monitors 22-1 and 22-2 can be attached to, for example, a person's chest, and measure the heart rate per minute of the person who is attached. The pedometers 23-1 and 23-2 can be attached to the lower limbs of a person, for example, and measure the number of steps in a day and the walking distance of the attached person. The activity meters 21-1 and 21-2, the heart rate monitors 22-1 and 22-2, and the pedometers 23-1 and 23-2 each include a communication unit that wirelessly transmits the measured biological information. The communication unit transmits and receives data between the image recording apparatus 10 and the biometric information acquisition units 20-1 and 20-2 with a predetermined wireless communication standard, for example, IEEE (Institut of Electrical and Electronics Engineers) 802.15. 1, IEEE802.11 etc. are used.
In the following description, biological information acquisition units 20-1, 20-2, activity meters 21-1, 21-2, heart rate monitors 22-1, 22-2, and pedometers 23-1, 23-2. May be collectively referred to as “device 20”. Information acquired by the device 20 may be simply referred to as “biological information”.

(Configuration of image recording device)
Next, the configuration of the image recording apparatus 10 according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a configuration of the image recording apparatus 10 according to the present embodiment.
The image recording apparatus 10 includes a control unit 100, a storage unit 110, a display unit 120, an input unit 130, a camera function unit 140, an environment information sensor 150, a GPS sensor 160, a network communication unit 170, a camera 14, and an antenna 17. Composed.

  The control unit 100 controls the operation of each unit of the image recording apparatus 10 by executing a program stored in the storage unit 110. The control unit 100 includes, for example, a CPU (Central Processing Unit). The control unit 100 realizes the functions of the recording control unit 101 and the display control unit 102 when the CPU executes a program.

  The recording control unit 101 specifies the registration information 112 related to the person recognized by the face recognition unit 142 of the camera function unit 140 from the registration information 112 stored in advance in the storage unit 110, and is included in the specified registration information 112. The device 20 indicated by the device information is specified. The registration information 112 is information generated for each person, and is information including face information, device information, and name information of the person. The face information is information for specifying face image data indicating the face of the person, for example, a file name. The name information is information for identifying the person, for example, name, nickname, and the like. The recording control unit 101 associates the biological information 113 received from the identified device 20 with the face recognition range indicated by the photographing information 114 input from the face recognition unit 142 of the camera function unit 140. The recording control unit 101 stores the image data 111 input from the camera function unit 140 in the storage unit 110, and records the biological information 113 associated with the face recognition range indicated by the imaging information 114 in association with the storage unit 110. .

When an operation signal is input from the input unit 130, the display control unit 102 generates display image data to be displayed on the display unit 120 from the image data 111 stored in the storage unit 110 and the biological information 113. Processing performed by the display control unit 102 will be described later.
The storage unit 110 stores various programs executed by the control unit 100, data necessary for the operation of each unit of the image recording apparatus 10, and data acquired by each unit of the image recording apparatus 10. The storage unit 110 stores, for example, image data 111, registration information 112, biological information 113, and imaging information 114. The storage unit 110 is, for example, any one of HDD (Hard-disk Drive), flash memory, ROM (Read-only Memory), RAM (Random Access Memory), or any combination thereof.

The display unit 120 displays an image based on various data input from the control unit 100. The display unit 120 is, for example, a liquid crystal display (LCD: Liquid Crystal Display) or an organic EL (Electroluminescence) display.
The input unit 130 receives an operation input from the user and outputs an operation signal for controlling the operation of the image recording apparatus 10 to the control unit 100 based on the received operation input. The input unit 130 is, for example, a touch sensor. The input unit 130 may be configured as a touch panel integrated with the display unit 120.

The camera 14 captures an image of a subject in a surrounding predetermined visual field, and generates image data indicating the captured image. The camera 14 outputs the generated image data to the camera function unit 140. The camera 14 is, for example, a digital still camera.
The camera function unit 140 controls the function of the camera 14 based on an operation input by a user or a control signal input from the control unit 100. For example, the camera function unit 140 activates the camera 14, causes the camera 14 to capture an image, and ends the operation of the camera 14. The camera function unit 140 stores image data 111 indicating an image captured by the camera 14 in the storage unit 110. The camera function unit 140 includes a shutter detection unit 141 and a face recognition unit 142.

The shutter detection unit 141 detects pressing of a shutter button (not shown). The shutter button is a button for instructing the camera 14 to take a picture when pressed.
The face recognition unit 142 identifies a face region (face recognition range) indicated by the image data by performing image recognition processing on the image data 111 input from the camera 14 with reference to the face information included in the registration information 112. To do. Thereby, the person of the specified face is recognized. In specifying the face recognition range and recognizing a person, the face recognition unit 142 may use an image recognition technique such as, for example, the Viola Jones method. The face recognition unit 142 generates shooting information indicating the number of persons recognized from one image data, the face recognition range of each person, the center coordinates of the face recognition range, and the size of the face recognition range. The face recognition unit 142 associates the generated shooting information 114 with the image data 111 and outputs the image information 111 to the recording control unit 101.

The environmental information sensor 150 acquires environmental information indicating the environment around the image recording apparatus 10. The environmental information sensor 150 is, for example, any one of a thermometer that measures the temperature, a humidity sensor that measures the humidity, a wind direction and wind speed sensor that measures the wind direction and the wind speed, a weather meter that determines the weather, and a combination of some of them. Or any combination. The environmental information sensor 150 stores the acquired environmental information in the storage unit 110.
A GPS (Global Positioning System) sensor 160 calculates its own latitude and longitude based on the arrival time difference of received signals received from a plurality of GPS satellites. The GPS sensor 160 may specify a facility name or a place name corresponding to the calculated latitude and longitude by referring to map information stored in the storage unit 110 in advance. The map information is information indicating a facility name or a place name for each latitude and longitude. The GPS sensor 160 stores position information indicating the latitude and longitude, facility name, or place name calculated as its position in the storage unit 110. The location information may be included in the environment information.

  The network communication unit 170 transmits and receives data to and from other devices wirelessly via the antenna 17. The network communication unit 170 receives the biological information 113 from the biological information acquisition units 20-1 and 20-2, respectively. The network communication unit 170 outputs the received biological information to the recording control unit 101.

(Image recording process)
Next, the image recording process according to the present embodiment will be described. FIG. 3 is a sequence diagram showing image recording processing according to the present embodiment.
In the example illustrated in FIG. 3, an example in which the photographer ac1 who is a user operates the image recording apparatus 10 and shoots an image including one subject ac2 which is a person different from the photographer ac1. The process which the recording apparatus 10 and the device 20 perform is shown. The device 20 is attached to the body of the subject ac2. Note that the device 20 may be attached to the body of the photographer ac1. Note that a case where communication between the image recording apparatus 10 and the device 20 is executed in accordance with a predetermined wireless communication standard IEEE 802.15.1 is taken as an example.

(Step S0) The input unit 130 of the image recording apparatus 10 generates an operation signal instructing device search based on an operation input by the photographer ac1, and outputs the generated operation signal to the control unit 100. In response to the operation signal input from the input unit 130, the control unit 100 starts searching for a device that can be connected to the image recording apparatus 10.
(Step S1) The device 20 starts an operation in the advertisement mode. The advertisement mode is an operation mode in which broadcast information (advertisement) indicating that the device is connectable is transmitted at a predetermined interval (for example, every 30 seconds).
(Step S2) The device 20 transmits broadcast information at a predetermined interval. The broadcast information includes device information (address) for identifying each device 20.

(Step S3) The network communication unit 170 of the image recording apparatus 10 receives the notification information from the device 20, and determines that the device 20 indicated by the address included in the received notification information has been found as a communicable device. The network communication unit 170 outputs the received notification information to the control unit 100. The control unit 100 generates device list screen data representing a list of devices indicated by the device information included in the notification information. The control unit 100 outputs the generated device list screen data to the display unit 120. The display unit 120 displays a device list screen based on the device list screen data input from the control unit 100.

(Step S4) Based on the operation input by the photographer ac1, the input unit 130 of the image recording apparatus 10 generates an operation signal that indicates a device that is permitted to be connected from the device list displayed on the display unit 120. The network communication unit 170 generates a connection setting signal indicating that the device indicated by the operation signal generated by the input unit 130 is set as a connectable device (pairing setting instruction).
(Step S5) The network communication unit 170 of the image recording apparatus 10 transmits the connection setting signal generated by the control unit 100 to the device 20 indicated by the connection setting signal (pairing).
(Step S <b> 6) When the device 20 receives the connection setting signal from the image recording apparatus 10, the device 20 transmits an acknowledgment signal (OK) to the image recording apparatus 10 that is the transmission source. The network communication unit 170 of the image recording apparatus 10 sets the device 20 that is the transmission source of the received acknowledgment signal (OK) as a connectable device. Therefore, the user can select the device 20 worn by a desired person.

(Step S7) When the camera function unit 140 of the image recording apparatus 10 is instructed to start the camera 14 based on an operation input by the photographer ac1, the camera 14 is started.
(Step S <b> 8) The network communication unit 170 of the image recording apparatus 10 transmits a connection request signal (Connect Request) indicating a connection request to the device 20 to the device 20.

(Step S9) When the device 20 receives the connection request signal from the image recording apparatus 10, the device 20 transmits an acknowledgment signal (OK) to the image recording apparatus 10 that is the transmission source.
(Step S <b> 10) When receiving the confirmation response signal (OK) from the device 20, the network communication unit 170 of the image recording apparatus 10 transmits a connection start signal indicating the start of connection to the device 20 to the device 20.
(Step S11) When the device 20 receives the connection start signal from the image recording apparatus 10, the device 20 transmits an acknowledgment signal (OK) to the image recording apparatus 10 that is the transmission source. As a result, the image recording apparatus 10 enters a connection state in which data can be transmitted and received with the device 20.
(Step S12) The device 20 measures the biological information every predetermined time (for example, 1 minute).

(Step S13) The face recognition unit 142 of the image recording apparatus 10 performs image recognition processing on the image data 111 input from the camera 14, and specifies a face recognition range indicated by the image data 111. The face recognition unit 142 recognizes the person represented in the specified face recognition range. Here, when the person can be recognized, the shutter detection unit 141 may start waiting for an operation to the shutter button. Therefore, when the person is not recognized, it is possible to avoid the processing related to the generation of the shooting information 114.
(Step S14) When the shutter detection unit 141 of the image recording apparatus 10 detects that the photographer ac1 has pressed the shutter button, the image data 111 input from the camera 14 is stored in the storage unit 110. The face recognition unit 142 generates photographing information 114 including image data indicating the face recognition range of each identified person, the center coordinates of the face recognition range, and the size of the face recognition range. The face recognition unit 142 stores the generated shooting information 114 and the image data 111 in the storage unit 110 in association with each other.

(Step S15) The network communication unit 170 of the image recording apparatus 10 transmits to the device 20 a biometric information request signal indicating that biometric information is requested.
(Step S16) When the device 20 receives the biological information request signal from the image recording device 10, the device 20 transmits the measured biological information to the image recording device 10 that is the transmission source. The network communication unit 170 of the image recording apparatus 10 receives biological information from the device 20.

(Step S17) The network communication unit 170 receives the biological information 113 from the biological information acquisition units 20-1 and 20-2, respectively.
The face recognition unit 142 counts the number of face recognition ranges of the subject ac2, which is a person recognized from the image data 111, the center coordinates of the face recognition range, the size of the face recognition range, and the face image indicated by the face recognition range. Shooting information 114 indicating data is generated.
The recording control unit 101 associates the biological information 113 received from the device 20 indicated by the device information included in the registration information 112 recognized by the face recognition unit 142 with the face recognition range indicated by the imaging information 114. The recording control unit 101 records the image data 111, shooting information 114, and biometric information 113 associated with the face recognition range indicated by the shooting information 114 in association with each other and records them in the storage unit 110 (writes a shot image).

(Step S18) The display control unit 102 outputs the image data 111 stored in the storage unit 110 to the display unit 120, and causes the display unit 120 to display an image based on the image data 111. When the position within the face recognition range of the subject ac2 is instructed from the input unit 130, the display control unit 102 reads the biological information 113 associated with the face recognition range from the storage unit 110. The display control unit 102 displays the read biological information 113 on the display unit 120 (displays a captured image). Then, the process shown in FIG. 3 is complete | finished.

In addition, after the device 20 starts measurement of biological information (step S12), the processing of step S15 and step S16 may be repeated at a predetermined cycle (for example, 3 minutes), or step S13 and step S14. , It may be repeatedly executable. The predetermined period may be equal to or longer than the biological information measurement period in the device 20. Therefore, the photographer ac1 can record the image data 111 and the shooting information 114 in the image recording device 11 by pressing the shutter button at an arbitrary time with reference to the passage of time of the biological information.
Note that the device 20 may also be worn on the body of the photographer ac1. The image recording apparatus 10 may perform the process with the device 20 attached to the body of the photographer ac1 in the same manner as the process with the device 20 attached to the body of the subject ac2.

(Example of shooting information)
FIG. 4 is a diagram illustrating an example of the shooting information 114 generated based on the image data 111. The shooting information is information indicating the presence or absence of face recognition in the image data, the number of recognized persons, the center coordinates of the face recognition range, and the size of the face recognition range. In the example illustrated in FIG. 4, the shooting information 114 includes face recognition, the number of recognized persons is one, the center coordinates of the face recognition range are 300 (horizontal coordinates), and 200 (vertical coordinates). It shows that the size of the recognition range is 100 (width) and 100 (height). The unit of these coordinate values is the number of pixels.

(Display example)
Next, an example of an image displayed on the display unit 120 in step S18 will be described.
FIG. 5 is a diagram illustrating an example of an image displayed in the present embodiment.
FIG. 5A is an example of an image based on the image data 111. A human face fc1 is shown in the lower right of the image shown in FIG. A broken-line rectangle circumscribing the face fc1 indicates the face recognition range bx01.
In FIG. 5B, a pointer pt01 and biological information bi01 are further displayed on the image shown in FIG. The pointer pt01 is an image indicating a position indicated by an operation signal input from the input unit 130. The biometric information bi01 is biometric information measured for a person related to the face fc1. In the example shown in FIG. 5B, the biometric information bi01 indicates “heart rate 90 times / minute, no stress, activity 2000 kcal, step count 4000 steps, distance 2000 m”. The biometric information bi01 is displayed when the position indicated by the operation signal is within the face recognition range bx01. By this display, the relationship between the recognized person and the displayed biological information is expressed, so that the user who viewed the displayed image can recall the situation at the time of shooting. In the following description, an input of an operation signal indicating a position within the display range of the displayed image or information from the input unit 130 is referred to as “pressing” the image or information related to the display range. Sometimes.

  Here, the display control unit 102 generates pointer image data representing a predetermined pointer image at a position indicated by the operation signal. The display control unit 102 reads the face recognition range bx01 with reference to the shooting information 114 stored in the storage unit 110 and associated with the image data 111. In order to determine that the position indicated by the operation signal is included in the read face recognition range bx01, the display control unit 102 superimposes the biological information and the pointer image data corresponding to the face recognition range bx01 on the image data 111 and displays the display image. Generate data. The display control unit 102 can display the image shown in FIG. 5B based on the generated display image data. Note that the display control unit 102 determines the display position of the shooting information 114 at a position where the display area does not overlap the face recognition range bx01. As a result, the user can see both the image of the face fc01 of the instructed person and the biological information bi01 of the person at the same time, thereby satisfying the interest in the person.

Note that the display control unit 102 may superimpose a predetermined display indicating that operation is possible within a predetermined range from the face recognition range bx01 or the face recognition range bx01 and cause the display unit 120 to display the superimposed display. For example, the display control unit 102 generates face recognition range image data indicating an outer frame line of the face recognition range bx01 read with reference to the shooting information 114. The display control unit 102 superimposes the generated face recognition range image data and the image data 111 and causes the display unit 120 to display an image based on the superimposed image data.
Accordingly, the user can notice that the face recognition range bx01 is operable, and thus can easily access the biometric information bi01 related to the recognized person fc1. Note that the predetermined display indicating that the operation is possible is not limited to the outer frame line, and may be a mode different from other display areas, for example, color, saturation, and the like.

As described above, the image recording apparatus 10 according to the present embodiment provides the network communication unit 170 that receives biometric information from the device 20 and the registration information that associates the facial image and the device information of the device 20 for each person. And a storage unit 110 for storing. Further, the image recording apparatus 10 determines a face recognition range representing a person's face from an image captured by the camera 14, and selects a person based on the image within the determined face recognition range and the face image stored in the storage unit 110. A face recognition unit 142 to be identified is provided. In addition, the image recording apparatus 10 identifies the person device 20 identified by the face recognition unit 142 based on the device information stored in the storage unit 110, and received the image captured by the camera 14 from the identified device 20. A recording control unit 101 that stores biometric information in the storage unit 110 in association with the face recognition range determined by the face recognition unit 142 is provided.
With this configuration, the storage unit 110 records the face recognition range indicating the face of the person represented by the captured image and the biometric information of the person in association with each other. Since the user can easily touch the biometric information of the person based on the face of the person, the user can recall the situation at the time of shooting regardless of the photographer.

The image recording apparatus 10 according to the present embodiment includes an input unit 130 that instructs information displayed on the display unit 120. Further, the image recording apparatus 10 displays the image stored in the storage unit 110 on the display unit 120, and when the input unit 130 indicates a position within the face recognition range of the displayed image, the image recording apparatus 10 associates the image with the face recognition range. The display control unit 102 is configured to display the stored biological information on the display unit 120.
With this configuration, the user can view the biometric information of the person by instructing a face recognition range that represents the face of the person by an operation. Therefore, the user can recall the situation at the time of shooting and satisfy the interest in the person who has designated the face recognition range.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. About the same structure as embodiment mentioned above, the same code | symbol is attached | subjected and description is used.
An image recording system 1a (not shown) according to the present embodiment includes an image recording device 10a and biological information acquisition units 20-1 and 20-2. Next, the configuration of the image recording apparatus 10a will be described.
FIG. 6 is a block diagram showing the configuration of the image recording apparatus 10a according to this embodiment.
As shown in FIG. 6, the image recording apparatus 10a includes a recording control unit 101a instead of the recording control unit 101 (FIG. 2) in the control unit 100, and further includes a registration information generation unit 103a.

The recording control unit 101a captures biometric information received from the face recognition unit 142 via the network communication unit 170 from the device 20 indicated by the device information included in the registration information related to the person specified by the face recognition unit 142. Correlate with the face recognition range indicated by the information. The recording control unit 101 a records the image data input from the face recognition unit 142, shooting information, and biological information associated with the face recognition range indicated by the shooting information in the storage unit 110 in association with each other.
As described above, the face recognition unit 142 is a face image in the image captured by the camera 14, that is, a face image within the face recognition range recognized by the own unit and the face image included in the registration information 112 stored in the storage unit 110. The face image indicated by the data is compared for each person. The face recognition unit 142 identifies a person related to the registration information 112 indicating a face image determined to be the same as or most similar to the face image within the face recognition range.

  The registration information generation unit 103a newly generates registration information 112 based on the operation signal input from the input unit 130 for the instructed device in the above-described pairing process (step S4, FIG. 3), and the generated registration Information 112 is stored in the storage unit 110. Then, the network communication unit 170 generates a connection setting signal indicating that the instructed device is set as a connectable device, and transmits the generated connection setting signal to the device.

(Registration information generation process)
Next, registration information generation processing performed by the registration information generation unit 103a will be described.
FIG. 7 is a flowchart illustrating an example of registration information generation processing according to the present embodiment.
(Step F1) The registration information generation unit 103a causes the display unit 120 to display a registration availability confirmation screen for determining whether registration information can be manually registered. The registration information generation unit 103a determines whether the operation signal input from the input unit 130 indicates that manual registration is possible. When the registration information generation unit 103a determines that registration is possible (YES in step F1), the process proceeds to step F2. When it is determined that the registration information generation unit 103a indicates that registration cannot be performed (NO in step F1), the process proceeds to step F3.

(Step F2) The registration information generation unit 103a causes the display unit 120 to display a registration screen (not shown) for prompting the user to input registration information. The registration information generation unit 103a includes the face image within the face image range specified by the face recognition unit 142 and the device information received from the device 20 on the registration screen.
The registration information generation unit 103 a waits for face information and name information indicated by the operation signal input from the input unit 130. When an operation signal instructing registration of registration information is input from the input unit 130, the registration information generation unit 103a generates registration information for each person by integrating the waiting device information and face image data. The registration information generation unit 103a stores the generated registration information in the storage unit 110.
(Step F3) The registration information generation unit 103a causes the display unit 120 to display a registration completion confirmation screen (not shown) for confirming whether or not registration of registration information is completed for the user. The registration information generation unit 103a determines whether an operation signal indicating completion of registration is input from the input unit 130. When it is determined that an operation signal indicating the completion of registration has been input (YES in step F3), the process proceeds to step S5 (FIG. 3). When an operation signal indicating continuation of registration is input (NO in step F3), the process proceeds to step F1.

Next, an example of a registration screen will be described. FIG. 8 is a diagram illustrating an example of a registration screen according to the present embodiment. The registration screen illustrated in FIG. 8 includes a title ri01, a name information input field ri02, a face information input field ri03, a device information list ri04, a face image ri05, and a registration button ri06.
The title ri01 indicates a title composed of a character string “registration screen”. The name information input field ri02 includes a region where a character “name:” indicating the item and a character string indicating name information can be input based on an operation signal input from the input unit 130. The face information input field ri03 includes a region where a character “face information:” indicating the item and a character string indicating face information can be input based on an operation signal input from the input unit 130.

The device information list ri04 displays device information received from each of the devices 20. In the device information list ri04, the device information for each device indicates its type (device), device name, and obtainable value in each row. The “+” mark attached to each line is a symbol indicating that the device information is to be registered. The registration information generation unit 103a repeats displaying and erasing the “+” mark every time the position of the “+” mark is indicated by the operation signal. The registration information generation unit 103a selects the device information on the row where the “+” mark is displayed as the device information to be registered, and excludes the device information on the row where the “+” mark is deleted from the device information to be registered. .
The face image ri05 indicates a face image recognized by the face recognition unit 142. When the image data input from the camera 14 includes a plurality of face recognition ranges, the registration information generation unit 103a is based on the operation signal input from the input unit 130, and is included in the plurality of face recognition ranges. One face recognition range may be selected.

  The registration button ri06 represents a character string “registration”. When the position indicated by the operation signal input from the input unit 130 is included in the display area of the registration button ri06, the registration information generation unit 103a is input. Registration information including name information, face information, selected device information, and face image data is generated. If the registration information includes device information and face image data, the name information and face information can be omitted.

  In order to generate registration information by the registration information generation process shown in FIG. 7, the user needs to confirm which person 20 is wearing which device 20 and manually designate the device 20 for each person. Therefore, as illustrated in FIG. 9, the registration information generation unit 103 a compares a part of the biological information currently received from the device 20 with a part of the biological information received in the past, and determines whether or not they match or approximate. Determine whether. The registered information generation unit 103a may specify the device 20 that has transmitted a part of the biological information determined to be coincident or approximate. However, when storing the received biological information in the storage unit 110, the recording control unit 101a associates and stores the device information of the device 20 that transmitted the biological information.

FIG. 9 is a flowchart illustrating another example of the registration information generation process according to the present embodiment.
The registration information generation process shown in FIG. 9 further includes steps H1 to H3 in the registration information generation process shown in FIG.
(Step H1) The registration information generation unit 103a determines whether or not the image recording apparatus 10a has acquired biometric information. Here, the registration information generation unit 103a determines whether or not biometric information and device information are stored in the storage unit 110 in association with each other. If it is determined that biometric information has been acquired (step H1 YES), the process proceeds to step H2. If it is determined that biometric information has not been acquired (NO in step H1), the process proceeds to step S5 (FIG. 3).

(Step H2) The registration information generation unit 103a compares a part of the biological information acquired most recently in Step S3 (FIG. 3) with a part of the biological information received last time and stored in the storage unit 110. Here, the registration information generation unit 103a counts the period from the start to the end of connection of the image recording apparatus 10a as one time. Therefore, the previous time means a period during which the connection between the image recording apparatus 10a and the device 20 made at the present time is started before the connection is started. At the time of comparison, for example, the registration information generation unit 103a calculates a difference value between a part of the biological information acquired most recently and a part of the biological information stored in the storage unit 110. A part of the biological information used for comparison is preferably information that has a difference between persons and little time variation. A part of the biological information is, for example, one of the length of a fixing part (such as a band), a stride, a foot size, a weight, and the like for wrapping and fixing the device 20 around the upper limb part or the lower limb part of a human body, or A combination thereof may also be used. The device 20 measures the elements of the biological information and transmits them to the image recording apparatus 10 as a part of the biological information.

(Step H3) The registration information generation unit 103a determines whether or not there is a part of the biological information stored in the storage unit 110 that matches or approximates the part of the biological information acquired most recently. At the time of determination, for example, when the absolute value of the calculated difference value is smaller than a predetermined difference value threshold, the registration information generation unit 103a determines that they match or approximate. When it is determined that there is a part of the biological information (step H3 YES), the device information associated with a part of the biological information determined to be coincident or approximate is read from the storage unit 110, and the process proceeds to step F2. In step F <b> 2, the registration information generation unit 103 a displays the device information read on the display unit 120 on the registration screen in association with the device information received from the device 20. If it is determined that there is not (NO in step H3), the process proceeds to step S5 (FIG. 3).

As a result of this process, the device information of the device 20 that recently transmitted the biological information and the device information of the device 20 that transmitted the previous biological information are displayed in association with each other as candidates for the device information included in the registration information. Therefore, when the device 20 worn by the person is changed, the user notices the presence of the device 20 used last time, and is prompted to update the registration information related to the device 20.
In step F2, the registration information generating unit 103a reads registration information including the read device information from the storage unit 110, and displays a registration screen including name information, face information, and face image data included in the read registration information. You may display on the display part 120. FIG. The registration information generation unit 103a includes name information, face information, and face image data associated with the device 20 used last time in the updated registration information, thereby inputting or selecting these pieces of information. Work is reduced.

  Note that part of the biological information to be determined as to whether or not they are coincident or approximate is not limited to the part of the biological information received last time. For example, the biological information received last time, the biological information received before a predetermined time. It may be part of the information. In addition, the device information read by the registration information generation unit 103a is associated with the biological information received within a predetermined time (for example, 10 seconds) from the time when a part of the biological information determined to match or approximate is received. It may be the device information. Thereby, even if the kind of biometric information differs between devices 20, the device 20 which is transmitting biometric information at the same time can be specified without omission by the same person starting or resuming wearing.

  Also, the device 20 recognizes the face image of the wearer that is the subject by performing image recognition processing on the image capturing unit that captures the surrounding image, and image data indicating the captured image, and the recognized wearer selects a predetermined image. You may provide the face recognition part which identifies that it is a wearer. The face recognition unit extracts face image data indicating a recognized face image from image data indicating a photographed image. Then, the device 20 measures the biological information when identifying the predetermined wearer. In that case, the registration information generation unit 103a may receive face image data associated with the biological information from the device 20 and generate registration information including the received face image data. Further, the registration information generation unit 103a may receive the wearer's name information specified in association with the biological information from the device 20, and may generate the registration information including the received name information. Thereby, the work of the user related to the operation of the registration information is reduced.

(Image data storage processing)
Next, the image data recording process will be described.
FIG. 10 is a flowchart showing image data recording processing according to the present embodiment.
(Step G1) The face recognition unit 142 determines whether or not the image indicated by the image data input from the camera 14 has a face recognition range representing a person's face. When it determines with having a face recognition range (step G1 YES), it progresses to step G2. If it is determined that the face recognition range is not included (step G1 NO), the process shown in FIG. 10 is terminated, and the process proceeds to step S18 (FIG. 3).
(Step G <b> 2) The face recognition unit 142 determines whether there is registration information stored in the storage unit 110. If it is determined that there is registered information (YES in step G2), the process proceeds to step G3. If it is determined that there is no registration information (NO in step G2), the face recognition unit 142 determines that identification of the person has failed, ends the processing shown in FIG. 10, and proceeds to step S18 (FIG. 3). .

(Step G3) The face recognition unit 142 compares the face image in the image captured by the camera 14 with the face image indicated by the face image data included in the registration information related to a certain person. Here, the face recognition unit 142 calculates a score indicating the similarity between two face images. Thereafter, the process proceeds to Step G4.
(Step G4) The face recognition unit 142 determines whether or not the face image in the image captured by the camera 14 matches the face image indicated by the face image data included in the registration information related to a certain person. Here, the face recognition unit 142 determines that the two face images match when the calculated score is higher than a predetermined score threshold, and the two faces when the calculated score is equal to or less than the predetermined score threshold. It is determined that the images do not match. If it is determined that the two face images match (YES in step G4), the face recognition unit 142 identifies a person related to the registration information used for the comparison, and proceeds to step G6. If it is determined that the two face images do not match (NO in step G4), the process proceeds to step G5.

(Step G5) The face recognition unit 142 determines whether or not the comparison between the face image in the image captured by the camera 14 and the face image indicated by the face image data included in the registration information has been completed. That is, the face recognition unit 142 determines the presence / absence of registration information relating to an unprocessed person. If it is determined that the comparison is complete (YES in step G5), it is determined that identification of the person has failed, the process shown in FIG. 8 is terminated, and the process proceeds to step S18 (FIG. 3). If it is determined that the comparison has not been completed (NO in step G5), the registration information to be processed is changed to registration information relating to another unprocessed person, and the process returns to step G3.

(Step G6) The recording control unit 101a specifies the device 20 indicated by the device information included in the registration information related to the specified person. The recording control unit 101a associates the biometric information acquired from the identified device 20 with the face recognition range of the person indicated by the shooting information input from the face recognition unit 142.
(Step G7) The recording control unit 101a stores the biometric information associated with the face recognition range of the person in the storage unit 110 in association with the image data input from the face recognition unit 142. Thereafter, the process shown in FIG. 8 is terminated, and the process proceeds to step S18 (FIG. 3).

When a plurality of face recognition ranges are included in an image indicated by one piece of image data, the face recognition unit 142 and the recording control unit 101a perform steps G3-G7 for each face recognition range.
If the face recognition unit 142 determines that identification of a person has failed (YES in step G5), the recording control unit 101a causes the display unit 120 to display a message for prompting the user to register registration information. May be. In this case, the recording control unit 101a may cause the display unit 120 to display to prompt the user to take another picture.
Even when the face recognition unit 142 determines that identification of a person has failed, the recording control unit 101a may store the received biological information in the storage unit 110 in association with image data. There is a possibility that the received biometric information may be biometric information of a person who is located outside the field of view not appearing in the image, for example, a photographer. The display control unit 102 may display the biological information on the display unit 120 based on the instruction of the operation signal input from the input unit 130.

  In the above description, the recording control unit 101a has exemplified the case where the biometric information received from the device 20 is stored in the storage unit 110, but is not limited thereto. The recording control unit 101a associates the received biometric information with the person's name information and user information for identifying the user of the image recording apparatus 10a, and stores them in a server device (for example, a web server) that can be connected via a network. May be. The server device stores biometric information in association with user information and name information. In this case, the registration information generation unit 103a transmits a request signal for requesting biometric information corresponding to a part of biometric information acquired most recently to the server device. The server device selects biometric information that matches or approximates a part of the request signal received from the image recording device 10a from biometric information stored in advance. The server device transmits user information and name information associated with the selected biological information to the image recording device 10a. Then, the registration information generation unit 103a may generate registration information including user information and name information received from the server device, and biometric information acquired most recently. Therefore, even if the storage unit 110 does not hold biometric information, the biometric information stored in the server device is used for generating registration information.

(Example of biological information)
Next, an example of biometric information acquired by the image recording apparatus 10a will be described.
FIG. 11 is a table showing an example of biometric information. FIG. 11 shows biometric information associated with the face recognition range for each person in each row. The biometric information of each row is associated with the person of the face represented in each face recognition range. For example, in the second row of FIG. 11, “Father” is associated with heart rate “90”, stress “none”, activity “AAA”, step count “4000”, and distance “2000”. In the fourth row of FIG. 11, “Child B” is associated with the heart rate “80”, the stress “None”, and the activity amount “DDD”. The reason why the number of steps and the distance for “Child B” are blank is that the “Child B” is not equipped with a pedometer as the device 20.
The display control unit 102 reads the biological information corresponding to the face recognition range including the position indicated by the operation signal input from the input unit 130 from the storage unit 110, and superimposes the read biological information on the image indicated by the image data. Are displayed on the display unit 120.

(Display example)
Next, an example of an image displayed on the display unit 120 in the present embodiment will be described.
FIG. 12 is a diagram illustrating an example of an image displayed in the present embodiment.
In the image shown in FIG. 12A, the faces fc21, fc22, fc23, and fc24 of four persons are represented. Dashed rectangles circumscribing each person's face indicate face recognition ranges bx21, bx22, bx23, and bx24. In addition, environment information pi02 is represented in the image shown in FIG. The environmental information pi02 indicates “temperature: 26 ° C., humidity: 60%, wind speed: 10 m, weather: cloudy and sunny, Tokyo, near the top of the mountain”. Among them, “Tokyo top of mountain” is location information. The display control unit 102 generates display image data by superimposing a character string indicating environment information corresponding to the image data on the captured image data. The display control unit 102 causes the display unit 120 to display an image based on the generated display image data. Note that the display of environment information may be omitted.

  In FIG. 12B, pointers pt21 and pt24 and biological information bi21 and bi24 are further displayed with respect to the image shown in FIG. Pointers pt21 and pt24 are images indicating positions indicated by operation signals input from the input unit 130, respectively. The biometric information bi21 is biometric information measured for a person related to the face fc21. The biometric information bi24 is biometric information measured for a person related to the face fc24. In the example shown in FIG. 12B, the biological information bi21 indicates a heart rate of 60 times / minute, stress, an activity amount CCC, a step count of 8000 steps, and a distance of 2000 m. The biological information bi21 is displayed when the position indicated by the operation signal is within the face recognition range bx21. The biometric information bi24 indicates a heart rate of 90 times / minute, no stress, an activity amount AAA, a step count of 4000 steps, and a distance of 2000 m. The biological information bi24 is displayed when the position indicated by the operation signal is within the face recognition range bx24.

  In the example shown in FIG. 12B, the display control unit 102 is an example in which a plurality of pieces of biological information are simultaneously displayed on the display unit 120. However, one biological information is displayed at a time and another biological information is displayed. Information may not be displayed. In that case, the display control unit 102 causes the display unit 120 to display biometric information corresponding to the face recognition range including the position indicated by the operation signal most recently. By displaying one piece of biological information at a time, the limited display area of the display unit 120 can be used effectively.

As described above, in the image recording apparatus 10 a according to the present embodiment, the network communication unit 170 receives device information of the device 20 from the device 20. Further, the image recording apparatus 10a generates registration information in which a face image within the face recognition range determined by the face recognition unit 142 and at least a part of the device information received by the network communication unit 170 are associated for each person. A registration information generation unit 103a is provided.
With this configuration, registration information corresponding to the face image for each person and the device information of the device 20 is generated, so that the number of persons that can be recorded in the storage unit 110 in association with the face recognition range and the biological information can be increased. . Therefore, it is possible to expand the range of a person who is a subject who can recall the situation at the time of shooting regardless of the photographer.

(Third embodiment)
Next, a third embodiment of the present invention will be described. About the same structure as embodiment mentioned above, the same code | symbol is attached | subjected and description is used.
An image recording system 1b (not shown) according to the present embodiment includes an image recording device 10b and biological information acquisition units 20-1 and 20-2. Next, the configuration of the image recording apparatus 10b will be described.
FIG. 13 is a block diagram showing a configuration of the image recording apparatus 10b according to the present embodiment.
The image recording apparatus 10b includes a display control unit 102b in the control unit 100 instead of the display control unit 102 (FIG. 2).

The display control unit 102b generates display image data in the same manner as the display control unit 102 (FIG. 2).
When the biological information 113 associated with the face recognition area included in the image represented by the image data 111 includes facial expression-related biological information that is a part of the biological information 113, the display control unit 102b indicates the facial expression-related biological information. Determine your physical condition. The facial expression related biological information is biological information related to the facial expression of a person. The display control unit 102b reads facial expression image data associated with the determined body state from the storage unit 110. The display control unit 102b refers to the shooting information 114 and specifies the face recognition range of the person corresponding to the facial expression related biological information. The display control unit 102b superimposes the facial expression image indicated by the read facial expression image data on the face recognition range specified in the display image, and newly generates display image data indicating the superimposed display image. The display control unit 102b outputs the newly generated display image data to the display unit 120, and displays the display image indicated by the display image data.

  In the storage unit 110, facial expression image data is stored in advance in association with physical information indicating the physical state. The expression image data is data indicating an expression image indicating an expression that typically appears in the state of the body. For example, facial expression image data representing “anger” is stored in association with physical information indicating “stress” as the physical state. Expression image data representing “sweat” is stored in association with physical information indicating the number of steps greater than a predetermined threshold as the physical state. It should be noted that different facial expression image data may be stored in association with the degree of the body state indicated by the facial expression related biological information. For example, as the number of steps increases, display image data representing “sweat” that sweats significantly may be associated.

Next, display control processing performed by the display control unit 102b will be described.
FIG. 14 is a flowchart showing display control processing according to the present embodiment.
The display control unit 102b performs the process shown in FIG. 14 when displaying the captured image (step S18, FIG. 3). Further, the process shown in FIG. 14 is an example in which the presence / absence of stress as the biometric information and the necessity of superimposition of facial expression images according to the number of steps are selected, and the facial expression image to be superimposed is selected.

(Step I1) The display control unit 102b determines whether or not the biological information 113 associated with the face recognition range included in the image represented by the image data 111 includes information indicating stress “present”. If it is determined that it is included (YES in step I1), the process proceeds to step I2. If it is determined that it is not included (step I1 NO), the process proceeds to step I3.
(Step I2) The display control unit 102b reads from the storage unit 110 facial expression image data indicating “anger” associated with the stress “present”. The display control unit 102b causes the display unit 120 to display the facial expression image (anger mark) indicated by the read facial expression image data on the corresponding face recognition range.

(Step I3) The display control unit 102b determines whether or not the biological information 113 associated with the face recognition range includes step count information. If it is determined that the number of steps is greater than the threshold NA (eg, 7000 steps) of a predetermined number of steps (step I3 YES, number of steps> NA), the process proceeds to step I4. If it is determined that the number of steps is included and the number of steps is greater than a threshold NB (for example, 4000 steps) of a predetermined number of steps and equal to or less than the threshold NA (step I3 YES, step count> NB), the process proceeds to step I5. In other cases (step I3 NO), the process proceeds to step I6.

(Step I4) The display control unit 102b reads facial expression image data indicating “sweat” associated with the number of steps greater than the threshold NA from the storage unit 110. The display control unit 102b causes the display unit 120 to display the facial expression image (sweat mark A) indicated by the read facial expression image data on the corresponding face recognition range.
(Step I5) The display control unit 102b reads facial expression image data indicating “sweat” associated with the number of steps greater than the threshold NB and less than or equal to the threshold NA from the storage unit 110. The display control unit 102b causes the display unit 120 to display the facial expression image (sweat mark B) indicated by the read facial expression image data by superimposing it on the corresponding face recognition range.

(Step I6) The display control unit 102b determines whether or not processing has been completed for all face recognition ranges included in the image represented by the image data 111. If it is determined that the processing has been completed, the processing illustrated in FIG. If it is not determined that the process has not been completed, the face recognition range to be processed is changed, and the process returns to step I1.

(Display example)
Next, an example of an image displayed on the display unit 120 in the present embodiment will be described.
FIG. 15 is a diagram illustrating an example of an image displayed in the present embodiment.
In the image shown in FIG. 15, three facial expression images mk21a, mk21b, and mk24 are superimposed on the image shown in FIG. The facial expression image mk21a is a facial expression image (sweat mark A) superimposed according to the fact that the number of steps (8000 steps) indicated by the biological information of the person (child A) related to the face fc21 is greater than the number of steps NA (7000 steps). is there. The expression image mk21b is an expression image (anger mark) superimposed according to stress information (with stress) indicated by the biological information of the person (child A) related to the face fc21. The facial expression image mk24 is a facial expression image (sweat mark) superimposed according to the fact that the number of steps (5000 steps) indicated by the biometric information of the person (father) related to the face fc24 is greater than the number of steps NB (4000 steps) and NA or less. B). In the example shown in FIG. 15, the outer frame line of the face recognition range bx01 is omitted unlike the example shown in FIG.

When the display control unit 102b detects pressing of the facial expression image, the display control unit 102b may superimpose and display the biological information associated with the face recognition range on which the detected facial expression image is superimposed on the display unit 120. Since the user can grasp detailed biological information, the user's interest can be satisfied.
Moreover, the biological information used for the determination of the body state may be biological information related to the facial expression of the person, and may be blood pressure and body temperature, for example. The display control unit 102b may be able to set biometric information used for determination of the physical state based on an instruction of an operation signal input from the input unit 130.

As described above, in the image recording apparatus 10b according to the present embodiment, the storage unit 110 stores the physical information indicating the physical state and the facial expression image indicating the facial expression appearing in the physical state in association with each other. In addition, the image recording apparatus 10b determines the physical state from at least a part of the biological information received by the device 20 (for example, presence or absence of stress, the number of steps), and a facial expression image (for example, anger) corresponding to the determined physical state A display control unit 102 b that reads the facial expression image from the storage unit 110 and superimposes the read facial expression image on the face recognition range of the person wearing the device 20.
With this configuration, the user can see the facial expression image represented for each person and grasp the facial expression, so that the state of the body at the time of photographing each person, etc. Can be recalled.

(Fourth embodiment)
Next, a fourth embodiment of the present invention will be described. About the same structure as embodiment mentioned above, the same code | symbol is attached | subjected and description is used.
An image recording system 1c (not shown) according to the present embodiment includes an image recording device 10c and biological information acquisition units 20-1 and 20-2. Next, the configuration of the image recording apparatus 10c will be described.
FIG. 16 is a block diagram showing the configuration of the image recording apparatus 10c according to this embodiment.
The image recording apparatus 10c includes a display control unit 102c instead of the display control unit 102 (FIG. 2) in the control unit 100.

The display control unit 102c generates display image data in the same manner as the display control unit 102 (FIG. 2).
The biological information 113 associated with the face recognition area indicated by the imaging information 114 stored in the storage unit 110 in association with the image data 111 may include quantitative biological information. In that case, the display control unit 102c determines the order of the biological information between the face recognition regions (persons). The display control unit 102c adds rank information indicating the determined rank to the biometric information associated with each face recognition area (person) and stores it in the storage unit 110. Further, the display control unit 102c superimposes the characters indicating the determined rank (rank display characters) on the corresponding face recognition ranges, and newly generates display image data indicating the display image on which the rank display characters are superimposed. The display control unit 102c outputs the newly generated display image data to the display unit 120, and displays the display image indicated by the display image data.

(Example of biological information)
Next, an example of biological information to which a rank is added by the image recording device 10c will be described.
FIG. 17 is a table showing an example of biometric information to which a rank is added. In the table shown in FIG. 17, the order of the number of steps shown in FIG. 11 is added for each person. For example, in the second column of FIG. 17, “Father” and rank “3”, “Mother” and rank “2”, and “Child A” and rank “3” are associated with each other. In the rankings “3”, “2”, and “1”, “Father” has the third most frequent step “4000”, “Mother” has the second most frequent step “5000”, and “Child A” has the most “8000” is the most common. The reason that the rank for “Child B” is blank is that the rank was not determined because the number of steps was not obtained for “Child B”.

(Display example)
Next, an example of an image displayed on the display unit 120 in the present embodiment will be described.
FIG. 18 is a diagram illustrating an example of an image displayed in the present embodiment. In the image shown in FIG. 18, three ranking display characters rk21, rk22, and rk24 are superimposed on the image shown in FIG. The title tl03 “Step Ranking” indicating that the order is related to the number of steps is displayed superimposed on the display image. The rank display character rk21 “1st place” indicates that the number of steps (8000 steps) indicated by the biological information of the person (child A) related to the face fc21 is the highest. The rank display character rk22 “second place” indicates that the number of steps (5000 steps) indicated by the biological information of the person (mother) related to the face fc22 is the second highest. The rank display character rk24 “third place” indicates that the number of steps (4000 steps) indicated by the biological information of the person (father) related to the face fc24 is the third largest.

In the example shown in FIG. 18, the outer frame line of the face recognition range is omitted, unlike the example shown in FIG. Further, unlike the example shown in FIG. 12, the display of environment information is omitted. The display control unit 102c is not limited to this, and the display control unit 102c may display the display unit 120 by adding an outer frame line of the face recognition range, or may display the display unit 120c by adding environment information.
When the display control unit 102c detects pressing of the rank display character, the display control unit 102c displays the biometric information associated with the face recognition range on which the detected rank display character is superimposed on the display image on the display unit 120. You may let them. Since the user can grasp detailed biological information, the user's interest can be satisfied.

  The biological information whose rank should be determined may be biological information that can be compared quantitatively. For example, in addition to the number of steps, the biological information may be a heart rate, an activity amount, or the like. The display control unit 102c may be able to set the type of biological information whose rank should be determined according to the operation signal input from the input unit 130.

As described above, the image recording apparatus 10c according to the present embodiment determines the rank between persons for at least a part (for example, the number of steps) of the biological information received from the device 20, and displays characters indicating the determined rank. And a display control unit 102c that superimposes the face recognition range of the person wearing the device 20 on the display unit 120.
With this configuration, the user can compare the degree of biometric information according to the environment at the time of photographing between the persons by looking at the characters indicating the ranks represented for each person. By this comparison, the user can recall the situation at the time of shooting. For example, the display control unit 102c displays the ranking of the measured heart rate on an image of a person photographed at a recreational facility such as a haunted house or an amusement park, so that the user can change the degree of upset to the effect at the recreational facility. Can be compared. In addition, the display control unit 102c displays the order of the amount of activity measured on the image of the person photographed after the end of the competition such as soccer, so that the user can compare the amount of movement due to the competition between the persons. Can do.

  The present invention is not limited to the above-described embodiments, and various modifications are possible. Embodiments obtained by appropriately combining technical configurations disclosed in different embodiments are also included in the present invention. Included in the technical scope. For example, the image recording devices 10b and 10c may include a registration information generation unit 103a. The image recording apparatus 10c may include a display control unit 102b in addition to the display control unit 102c.

Each component of the present invention can be arbitrarily selected, and an invention having a selected configuration is also included in the present invention.
For example, if the display unit 120, the input unit 130, and some or all of the cameras 14 can transmit and receive various data to and from the image recording devices 10, 10a, 10b, and 10c, the image recording devices 10, 10a, 10b, It may be a separate body from 10c.

In addition, a part of the image recording apparatuses 10, 10a, 10b, and 10c in the above-described embodiment, for example, the control unit 100 may be realized by a computer. In this case, the control program may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by a computer system and executed. Here, the “computer system” is a computer system built in the recognition data transmission apparatus, and includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In this case, a volatile memory inside a computer system that serves as a server or a client may be included that holds a program for a certain period of time. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
Moreover, you may implement | achieve part or all of the recognition data transmission apparatus in embodiment mentioned above as integrated circuits, such as LSI (Large Scale Integration). Each functional block of the recognition data transmission apparatus may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on the technology may be used.

In addition, this invention can be implemented also in the following aspect.
(1) A communication unit that receives biometric information from a biometric information acquisition unit, a storage unit that stores, for each person, registration information that associates facial information and device information of the biometric information acquisition unit, and an image captured by the imaging unit A recognition unit for identifying a person based on an image within the determined face recognition range and a face image stored in the storage unit, and a device stored in the storage unit The face recognition range in which the recognizing unit determines the biometric information received from the identified biometric information acquiring unit by specifying the biometric information acquiring unit of the person specified by the recognizing unit based on the information, and the image captured by the photographing unit And a recording control unit that stores the information in the storage unit in association with each other.

(2) The communication unit receives the device information of the biometric information acquisition unit from the biometric information acquisition unit, the face image within the face recognition range determined by the recognition unit, and the device information received by the communication unit (1) An image recording apparatus comprising: a registration information generation unit that generates registration information in which at least a part is associated with each person.

(3) When an input unit for instructing information displayed on the display unit and an image stored in the storage unit are displayed on the display unit, and the input unit indicates a position within the face recognition range of the displayed image, The image recording apparatus according to (1) or (2), further comprising: a display control unit that causes the display unit to display biometric information stored in association with the face recognition range.

(4) The storage unit stores physical information indicating a physical state in association with a facial expression image indicating a facial expression that appears in the physical state, and from at least a part of the biological information received by the biological information acquisition unit. The body state is determined, a facial expression image corresponding to the determined physical state is read from the storage unit, and the read facial expression image is superimposed on the face recognition range of the person wearing the biological information acquisition unit on the display unit An image recording apparatus according to any one of (1) to (3), comprising: a display control unit for displaying.

(5) The rank between persons is determined for at least a part of the biological information received from the biological information acquisition unit, and characters indicating the determined rank are superimposed on the face recognition range of the person wearing the biological information acquisition unit. An image recording apparatus according to any one of (1) to (4).

(6) An image recording system including a biological information acquisition unit that measures biological information of a person and an image recording device, wherein the biological information acquisition unit transmits the biological information to the image recording device, and The apparatus is a communication unit that receives biometric information from the biometric information acquisition unit, a storage unit that stores registration information that associates facial information and device information of the biometric information acquisition unit for each person, and a photographing unit. A face recognition range representing a person's face is determined from the image, a recognition unit that identifies a person based on the image within the determined face recognition range and the face image stored in the storage unit, and stored in the storage unit Face recognition in which the recognizing unit determines the biometric information acquired from the specified biometric information acquiring unit by identifying the biometric information acquiring unit of the person specified by the recognizing unit based on the device information and the image captured by the imaging unit Previously associated with a range Image recording system and a recording control unit that stored in the storage unit.

(7) A communication process for receiving biometric information from the biometric information acquisition unit, a face recognition range representing a person's face from an image captured by the imaging unit, an image within the determined face recognition range, a face image, and the Based on a recognition process for identifying a person based on a face image stored in a storage unit that stores, for each person, registration information associated with device information of the biometric information acquisition unit, and device information stored in the storage unit The biometric information acquisition unit of the person specified in the recognition process is specified, and the image captured by the imaging unit corresponds to the biometric information received from the specified biometric information acquisition unit and the face recognition range determined in the recognition process And a recording control process for storing the information in the storage unit.

(8) A communication procedure for receiving biometric information from the biometric information acquisition unit in a computer, a face recognition range representing a person's face from an image captured by the imaging unit, an image within the determined face recognition range, and a face image And a recognition procedure for identifying a person based on a face image stored in a storage unit that stores registration information associated with the device information of the biometric information acquisition unit for each person, based on the device information stored in the storage unit The human body information acquisition unit of the person specified in the recognition procedure is specified, and the image captured by the imaging unit is the face recognition range determined in the recognition procedure as the biological information received from the specified biological information acquisition unit. An image recording program for executing a recording control procedure associated with and stored in the storage unit.

DESCRIPTION OF SYMBOLS 1, 1a, 1b, 1c ... Image recording system 10, 10a, 10b, 10c ... Image recording apparatus, 100 ... Control part, 101, 101a ... Recording control part, 102, 102b, 102c ... Display control part, 103a ... Registration Information generating unit, 110 ... storage unit, 120 ... display unit, 130 ... input unit, 140 ... camera function unit, 141 ... shutter detection unit, 142 ... face recognition unit, 150 ... environmental information sensor, 160 ... GPS sensor, 170 ... Network communication unit, 14 ... camera, 17 ... antenna, 20 (20-1, 20-2) ... biometric information acquisition unit (device), 21-1, 21-2 ... activity meter, 22-1, 22-2 ... heart rate monitor, 23-1, 23-2 ... pedometer

Claims (5)

A communication unit that receives biological information from the biological information acquisition unit;
A storage unit that stores, for each person, registration information in which a facial image and device information of the biological information acquisition unit are associated;
A recognition unit that determines a face recognition range representing a person's face from an image captured by the photographing unit, and that identifies a person based on the image within the determined face recognition range and the face image stored in the storage unit;
The biometric information acquisition unit of the person specified by the recognition unit is specified based on the device information stored in the storage unit, and the biometric information received from the specified biometric information acquisition unit is captured by the imaging unit. A recording control unit for storing in the storage unit in association with the face recognition range determined by the recognition unit;
An image recording apparatus comprising: The communication unit receives device information of the biological information acquisition unit from the biological information acquisition unit,
A registration information generation unit that generates registration information in which a face image within the face recognition range determined by the recognition unit and at least a part of the device information received by the communication unit are associated for each person;
An image recording apparatus according to claim 1. An input unit for instructing information to be displayed on the display unit;
The image stored in the storage unit is displayed on the display unit, and when the input unit indicates a position within the face recognition range of the displayed image, the biometric information stored in association with the face recognition range is displayed on the display unit. A display control unit to be displayed on
An image recording apparatus according to claim 1 or 2, further comprising: The storage unit stores physical information indicating a physical condition in association with a facial expression image indicating a facial expression appearing in the physical condition,
The biological information acquisition unit determines a physical state from at least a part of the biological information received, reads a facial expression image corresponding to the determined physical state from the storage unit, and reads the read facial expression image into the biological information acquisition unit A display control unit that superimposes on the face recognition range of the person wearing the
An image recording apparatus according to any one of claims 1 to 3. The display unit determines the rank between persons for at least a part of the biological information received from the biological information acquisition unit, and superimposes characters indicating the determined rank on the face recognition range of the person wearing the biological information acquisition unit. A display control unit to be displayed on
An image recording apparatus according to claim 1, comprising:

Images