JP6283620B2 - Biological information acquisition apparatus, biological information acquisition method, and biological information acquisition program in a predetermined space - Google Patents

Description

  The present invention relates to a biological information acquisition apparatus, acquisition method, and acquisition program in a predetermined space.

  In the sports and entertainment industries, it is important to evaluate the quality of service to know the level of satisfaction with the audience's viewing contents. Usually, a satisfaction evaluation is performed by a questionnaire survey or the like for the audience. However, it is difficult to obtain information from a large number of audiences at once, and a lot of manpower and costs are required.

  Therefore, in recent years, a system has been developed that automatically acquires information such as the spectator's facial expressions and face orientations using face image recognition technology, and mechanically estimates the degree of spectator satisfaction based on the information (non-patent literature). 1).

  In recent years, as an example of visible light communication technology in which communication technology using visible light including near-infrared light communication is widely known, for example, attention is paid to the fast response speed of LED lighting and the ability to be electrically controlled. A technique for providing a signal transmission function to LED lighting has been developed (Non-Patent Document 2). In this signal transmission using LED illumination (illumination light signal transmission), visible light (illumination light) is used as a signal transmission medium. Then, the LED transmits the signal by changing the intensity of the light according to the transmission signal and discriminating the signal based on the intensity of the light on the receiving side. By combining this visible light communication and physiological information measurement technology, it is possible to transmit physiological information by visible light communication.

Toru Matsukawa, Akira Hidaka, Takio Kurita “Automatic Quantitative Evaluation of Audience Satisfaction in Video Based on Face Direction / Expression Recognition of Multiple People” IPSJ Journal vol. 50 No.12 3222-3232 (Dec. 2009) Toshihiko Komine, Yuichi Tanaka, Masao Nakagawa “Fusion system of white LED illumination signal transmission and power line signal transmission” IEICE Tech., IT2001-91, ISEC2001-129, SST2001-207, ITS2001-145 (2002-03)

However, simply combining conventional visible light communication technology and physiological information measurement, it cannot be said that the feature of the visible light signal that measurement is possible even with a normal imaging means is effectively utilized.

  The present invention has been made in view of the above circumstances, and effectively utilizes a visible light signal that transmits physiological information output from devices attached to a plurality of living bodies in a predetermined space, thereby enabling a plurality of lives. It is an object of the present invention to provide a biological information acquisition apparatus, a biological information acquisition method, and a biological information acquisition program that can specify the biological information and position information of a body in association with each other.

According to the first aspect of the present invention, imaging means for imaging a predetermined space in which a plurality of life forms exist, and a visible light signal representing physiological information of the life form for each of the plurality of life forms. A biological information output device is attached, and the position specifying unit specifies the position information of each of the plurality of life forms from the position information of the visible light signal in the image picked up by the image pickup unit or the image of each life form. Means, physiological information acquisition means for acquiring physiological information of each of the plurality of life forms from the visible light signal in the image captured by the imaging means, and each of the plurality of life forms specified by the position specifying means and position information, and biological information specifying means for specifying in association with the physiological information has been of the plurality of organisms are acquired by acquisition means the physiological information, wherein in a video image said imaging means has captured A face for recognizing face images of each of the plurality of life forms from a plurality of life form images and acquiring face image recognition information having at least one of facial expression information and personal identification information of the recognized face images An image recognition information acquisition unit , wherein the biological information specifying unit associates the position of the visible light signal in the image captured by the imaging unit with the closest one of the image of each life object. The biological information acquisition device that specifies the facial image recognition information of each of the plurality of life forms acquired by the face image recognition information acquisition unit in association with the position information and physiological information of each of the plurality of life forms. .

  According to the present invention, the visible light signal that transmits physiological information output from devices attached to a plurality of organisms in a predetermined space is effectively used to associate biological information and position information of a plurality of organisms. Can be specified.

It is a figure which shows the biometric information acquisition apparatus of the several audience in the predetermined space which concerns on this Embodiment. It is a figure which shows the functional block diagram of the face image recognition part. It is a figure which shows the information specified by the biometric information specific | specification part 16. FIG. It is a flowchart for demonstrating operation | movement of the biometric information acquisition apparatus which concerns on this Embodiment. It is a figure which shows the learning part of an event determination apparatus. It is a figure which shows the category determination part of an event determination apparatus. It is a figure for demonstrating the determination base used in the case of the determination in the determination device 51, and the determination device production | generation part 42 produces | generates. It is a figure which shows the flowchart for demonstrating operation | movement of the event determination apparatus which concerns on embodiment of this invention. It is a figure which shows the visible light communication system 600 which concerns on other embodiment of this invention. It is a figure which shows the structure of the transmitter 110 which concerns on the other embodiment.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a diagram showing a biological information acquisition apparatus in a predetermined space according to the present embodiment.

  In the figure, there are a plurality of spectators (life forms) M-1 to M-4 in a predetermined space, and physiological information output devices 1-1 to 1-1 that transmit physiological information by visible light to each spectator. 1-4 is attached.

  Note that a technique for transmitting predetermined information (physiological information in this embodiment) using visible light communication is a known technique and will not be described in detail here (for example, “White” in Non-Patent Document 2). LED lighting signal transmission and power line signal transmission system "Komine et al. IEICE Technical Report SST, Spread Spectrum 101 (730), 99-104, 2002-03-12).

  Here, in the present embodiment, “physiological information” means electrocardiogram, electromyogram, sweating, heart rate, heart sound intensity, blood pressure, respiration (number, depth), voice (height), sweating, skin temperature, etc. It is information sent by visible light communication. In the present embodiment, the physiological information is intended to be information that cannot be acquired from the appearances of the plurality of spectators M-1 to M-4. You may transmit by communication.

  The imaging unit (for example, a video camera) 11 images a predetermined space where a plurality of spectators M-1 to M-4 are present. Therefore, the video imaged by the imaging unit 11 includes a plurality of spectators M-1 to M-4 and physiological information output devices 1-1 to 1-4 attached to the spectators M-1 to M-4. And visible light representing physiological information output from.

  The position information acquisition unit 12 specifies the positions of the plurality of spectators M-1 to M-4 from the positions of the visible light signals in the video imaged by the imaging unit 11, and acquires the position information indicating the specified positions. . The position is identified by, for example, detecting an area in which visible light representing physiological information output from the physiological information output apparatuses 1-1 to 1-4 is reflected from an image constituting the video and corresponding to the detected area. Various methods such as specifying the attached position can be considered. The position information represents the positions of a plurality of spectators M-1 to M-4 existing in a predetermined space by xy coordinates, but is not limited to this.

  The physiological information acquisition unit 13 is visible light representing physiological information output from the physiological information output devices 1-1 to 1-4 attached to the spectators M-1 to M-4 in the image captured by the imaging unit 11. Is acquired, and physiological information of each audience M-1 to M-4 is acquired and output.

  The face image recognition unit 14 recognizes the face images of the spectators M-1 to M-4 in the video imaged by the imaging unit 11, and outputs facial expression information and personal identification (face image) information of the recognized face images. To do. FIG. 2 is a functional block diagram of the face image recognition unit 14.

  As shown in the figure, the face image recognition unit 14 includes a face image extraction unit 21, a facial expression information extraction unit 22, a personal identification (face recognition) information acquisition unit 23, and a face recognition database 24.

  The face image extraction unit 21 extracts the face images of the spectators M-1 to M-4 in the video imaged by the imaging unit 11.

  The facial expression information extraction unit 22 extracts facial expression information from the facial images of the spectators M-1 to M-4 extracted by the facial image extraction unit 21. Note that the technique for acquiring the facial expression information of the audience from the face image is a known technique. For example, Non-Patent Document 1 “Toru Matsukawa, Akira Hidaka, Takio Kurita” video based on facial recognition of multiple persons. "Automatic Quantitative Evaluation of Audience Satisfaction" in Information Processing Society of Japan Vol. 50 No. 12 3222-3232 (Dec. 2009) ".

  For example, “Masori Miyahara, Tetsuya Takiguchi, Yasuo Ariki” “Facial expression recognition based on the combination of facial feature point movement and inter-point distance change” is a method for obtaining facial expressions based on facial features. 2007 IEICE General Conference D-12-80 p.196 "," Hiroki Nomiya, Teruho Takara "Facial expression expression scene in video based on facial expression recognition by feature selection and feature extraction using facial feature points Detection “DEIM Forum 2011 C1-5” and the like.

  Here, facial expression information is, for example, “I am glad”, “I am not glad”, “I am seriously watching”, “I am not seriously watching”, “I am sad”, “I am not sad Information such as “, disgust”, “fear”, “happiness”, “sadness”, “surprise”, “no expression”.

  The personal identification (face recognition) information acquisition unit 23 acquires personal identification (face recognition) information from the face images of the spectators M-1 to M-4 extracted by the face image extraction unit 21 and outputs them. The acquisition of the personal identification information is performed by, for example, using each of the spectators M-1 to M-4 extracted by the face image extraction unit 21 using the face recognition database 24 in which the face image and the personal identification information are stored in association with each other. The face image stored in the face recognition database 24 is collated, and personal identification information corresponding to the matched face image is obtained from the face recognition database 24.

  Instead of the position information indicating the positions of the plurality of spectators M-1 to M-4 acquired by the position information acquisition unit 12, each of the spectators M-1 to M-4 extracted by the face image extraction unit 21 is used. The position of the face image may be used as the position information of the audience.

  The posture recognition unit 15 recognizes the postures of the spectators M-1 to M-4 in the image captured by the imaging unit 11, and outputs posture information indicating the postures of the recognized spectators M-1 to M-4. To do. A technique for estimating the posture of a person from such an image is a well-known technique (for example, “Shingo Ando et al.,“ Person Posture Estimation Technology for Video Monitoring ”NTT Technology Journal 20077.8”). In the present embodiment, the case where the posture recognition unit 15 is used has been described. However, the posture recognition unit 15 is not necessarily required and may be omitted.

  The biometric information specifying unit 16 includes the position information of the plurality of spectators M-1 to M-4 specified by the position information acquiring unit 12 and the plurality of spectators M-1 to M-4 acquired by the physiological information acquiring unit 13. Physiology information, facial image expression information and personal identification (face authentication) information recognized by the face image recognition unit 14, and posture information of a plurality of audiences M-1 to M-4 recognized by the posture recognition unit 15. And identify and store them in association with each other.

  As shown in FIG. 3, this association is performed by adding position information 31 of a plurality of spectators M-1 to M-4 of a video imaged by the imaging unit 11 to physiological information 32, facial expression information 33, personal identification information 34, and posture. Information 35 is associated. The video imaged by the imaging unit 11 is output from a plurality of spectators M-1 to M-4 and physiological information output devices 1-1 to 1-4 attached to the spectators M-1 to M-4. Since visible light representing physiological information is included, the physiological information 32, facial expression information 33, personal identification information 34, and posture information 35 can be associated by associating the position of this visible light with the positional information.

  In this association, for example, the positions of the audiences M-1 to M-4 (faces, postures) and the positions of the visible light are associated with each other. As a result, the position information 31 of visible light is associated with the physiological information 32, facial expression information 33, personal identification information 34, and posture information 35 of the audience closest to the position of visible light.

  In the present embodiment, the case where physiological information 32, facial expression information 33, personal identification information 34, and posture information 35 are associated with position information 31 has been described, but facial expression information 33, personal identification information 34, and posture information 35 are Not necessarily required. Other biological information may be associated with the position information 31 and the physiological information 32.

  When the facial expression information 33 and the personal identification information 34 are not used, the face image recognition unit 14 may be omitted. Further, when the posture information 35 is not used, the posture recognition unit 15 may be omitted. In this case, the biometric information specifying unit 16 uses the positional information of the plurality of spectators M-1 to M-4 specified by the position information acquiring unit 12 and the spectators M-1 to M-1 acquired by the physiological information acquiring unit 13. The physiological information of M-4 is associated.

  FIG. 4 is a flowchart for explaining the operation of the biometric information acquisition apparatus according to this embodiment.

  First, the imaging unit 11 images a predetermined space where a plurality of spectators M-1 to M-4 are present (S1). Next, the position information acquisition unit 12 includes position information of a plurality of audiences M-1 to M-4, the physiological information acquisition unit 13 includes a plurality of physiological information of the audiences M-1 to M-4, and a plurality of face image recognition units 14 exist. Face recognition information including facial expression information and personal identification (face image) information of the spectators M-1 to M-4 and the posture recognition unit 15 obtain posture information of a plurality of spectators M-1 to M-4 (S2).

  Next, the positional information, physiological information, face image recognition information, and posture information of the plurality of spectators M-1 to M-4 acquired in S2 are specified in association with each other (S3).

  Therefore, according to the present embodiment, based on the video imaged by the imaging unit 11, the biological information specifying unit 16 performs position information 31, physiological information 32, facial expression information 33, personal identification as shown in FIG. By associating the information 34 and the posture information 35, data from a large number of measurement points can be collected at one place.

Further, as compared with the case where the physiological information 32 is simply acquired, other information related to the position information 31 and the physiological information 32 (expression information 33, personal identification information 34, and posture information 35) can also be acquired. Therefore, it is possible to improve the estimation accuracy of information related to events in a predetermined space using biological information.
<Application example>
In the above-described embodiment, the position information 31, the physiological information 32, the facial expression information 33, the personal identification information 34, and the posture information 35 are output in association with each other from the biological information identification unit 16 based on the video imaged by the imaging unit 11. Explained the case.

  Here, a case where these pieces of information are used in an event determination apparatus for determining an event in a predetermined space will be described. These data are not limited to this application example, but can be used for other purposes.

  In this application example, the location information and biometric information of the audience in the concert hall are acquired, and using the determiner from the acquired location information and biometric information, such as rock, classic, enka, etc. performed in the concert hall Although the case where the event category is determined will be described, the present invention is not limited to this.

  The event determination device includes a learning unit and a category determination unit for generating a determiner. FIG. 5 is a diagram illustrating a learning unit of the event determination device.

  As shown in the figure, the learning unit includes an imaging unit 11, a position information acquisition unit 12, a physiological information acquisition unit 13, a face image recognition unit 14, a posture recognition unit 15, a biological information identification unit 16, an event category input unit 41, It has a determiner generator 42.

  Since the imaging unit 11, the position information acquisition unit 12, the physiological information acquisition unit 13, the face image recognition unit 14, the posture recognition unit 15, and the biological information identification unit 16 have been described in the above-described embodiment, description thereof is omitted here. .

  The event category input unit 41 inputs an event category (rock, classic, enka, etc.) being performed in the concert hall (being correct).

  The determiner generation unit 42 includes position information, physiological information, facial expression information, personal identification information, posture information, and event category input unit 41 of the plurality of spectators M-1 to M-4 specified by the biometric information specification unit 16. The determination base of the determination unit 51 is generated by associating the input event category (being correct) (rock, classic, enka, etc.).

  FIG. 7 is a diagram for explaining a determination base that is used in determination by the determiner 51 and is generated by the determiner generator 42.

  As shown in the figure, the determination base used for determination includes position information 31, physiological information 32, facial expression information 33, personal identification information 34, posture information 35, and event category 61.

  A judgment base is created for each event category. Note that the learning method is not limited to once for the same event category, but the position information and the biological information are acquired a plurality of times for the same event category, and the average value of the acquired plurality of position information and biological information is obtained. You may use, and you may employ | adopt another learning method.

  FIG. 6 is a diagram illustrating a category determination unit of the event determination apparatus.

  As shown in the figure, the category determination unit includes an imaging unit 11, a position information acquisition unit 12, a physiological information acquisition unit 13, a face image recognition unit 14, a posture recognition unit 15, a biological information identification unit 16, and a determination unit 51. doing.

  Since the imaging unit 11, the position information acquisition unit 12, the physiological information acquisition unit 13, the face image recognition unit 14, the posture recognition unit 15, and the biological information identification unit 16 have been described in the above-described embodiment, description thereof is omitted here. .

  The determiner 51 is specified by the biological information specifying unit 16 based on the determination base generated for each category by the determiner generating unit 42 at the time of learning, and includes a plurality of audiences M-1 to M-4 to be determined. The event category is determined from the position information 31, physiological information 32, facial expression information 33, personal identification information 34, and posture information 35.

  This determination is performed by comparing the position information and biological information (physiological information 32, facial expression information 33, personal identification information 34, and posture information 35) acquired at the time of determination with the determination base generated by learning. The determination base category with the highest match rate is determined as the event category and output. In addition, the determination method by the determination device 51 is not limited to this.

  FIG. 8 is a diagram illustrating a flowchart for explaining the operation of the event determination apparatus according to the embodiment of the present invention.

  First, the determination unit 51 is generated by learning (learning mode).

  First, the imaging unit 11 images a predetermined space where a plurality of spectators M-1 to M-4 exist (S11). Next, the position information acquisition unit 12 includes position information of a plurality of audiences M-1 to M-4, the physiological information acquisition unit 13 includes a plurality of physiological information of the audiences M-1 to M-4, and a plurality of face image recognition units 14 exist. Face recognition information including facial expression information and personal identification (face image) information of the spectators M-1 to M-4 and the posture recognition unit 15 obtain posture information of a plurality of spectators M-1 to M-4 (S12).

  Next, the positional information, physiological information, face image recognition information, and posture information of the plurality of audiences M-1 to M-4 acquired in S12 are specified in association with each other (S13).

  Then, the determiner generator 42 generates a determination base of the determiner 51 by associating the biological information and position information of each of the spectators M-1 to M-4 with the acquired event category (S14). .

  Next, in accordance with predetermined criteria (for example, the number of categories, the number of times of learning, etc.), it is determined whether or not learning has been completed by the determiner generation unit 42 (S15). If learning is not finished, the process returns to S11 and the learning mode is continued.

  On the other hand, when it is determined that the learning has been completed, the event determination mode by the determiner 51 using the generated determination base can be executed.

  In the event determination mode, position information 31 and biological information (physiological information 32, facial expression information 33, personal identification information 34, posture information 35) to be determined are acquired (S16), and these pieces of information are stored in the biological information specifying unit 16. And is input to the determiner 51.

  The determiner 51 is specified by the biological information specifying unit 16 based on the determination base generated for each category by the determiner generating unit 42 at the time of learning, and includes a plurality of audiences M-1 to M-4 to be determined. The event category of position information 31, physiological information 32, facial expression information 33, personal identification information 34, and posture information 35 is determined (S17).

  Then, the determiner 51 outputs the event category that is the result determined in S17 (S18).

  Therefore, according to the event determination device of the present embodiment, based on the position information and biological information of a plurality of living organisms existing in a predetermined space, an event such as the type of music performed in the space is determined. The biometric information can be effectively used in an unprecedented application.

In the above-described embodiment, the category of songs performed in the concert hall (rock, classic, enka, etc.) has been described as an example. However, the present invention is not limited to this. For example, this embodiment can also be applied to lectures and speech venues (contents, seriousness), rakugo (people), and theater / movies (action, horror, comedy, love).
<Other embodiments>
In the above-described embodiment, the positional information and biological information (physiological information 32, facial expression information 33, personal identification information 34, and posture information 35) of a plurality of spectators M-1 to M-4 are specified in association with each other. Explained when to do.

  In another embodiment, a case will be described in which position information and timing information as an example of biological information are specified in association with each other. The association between the position information and the timing information is specified in association with other biological information (physiological information 32, facial expression information 33, personal identification information 34, posture information 35, etc.) in combination with the above-described embodiment. It goes without saying that it is also good.

FIG. 9 is a diagram showing a visible light communication system 600 according to another embodiment of the present invention. Hereinafter, the visible light communication system 600 will be described. <Visible Light Communication System 600>
In the present embodiment, the visible light communication system 600 includes P transmission devices 110 and one reception device 620. However, FIG. 9 shows the arrangement of the light emitting unit 114, not the transmission device itself. Visible light communication is performed between P transmitting apparatuses 100 and one receiving apparatus 620. P is any integer greater than or equal to 1, and P = 1, 2,.
<Transmitter 110>
FIG. 10 is a diagram illustrating a configuration of the transmission device 110.

  As shown in the figure, the transmission apparatus 110 includes an information acquisition unit 111, an event detection unit 112, an encoding unit 113, and a light emitting unit 114. For example, the transmission device 110 includes a unit in which each unit is integrated. For example, the transmission apparatus 110 is an apparatus in which an information acquisition unit 111 including a heart rate monitor, an event detection unit 112 and encoding unit 113 including a microcomputer, and a light emitting unit 114 including an LED are integrated.

  The information acquisition unit 111 samples and outputs predetermined information at a sampling rate whose time interval is smaller than the transmission rate. Here, the transmission rate time interval is the time interval used to send flashing information once (= 1 / f), and the sampling rate time interval is the time interval used to acquire one sample (= 1 / fs). For example, the information acquisition unit 111 samples an electrical waveform of an electrocardiogram or a waveform of an accelerometer attached to an arm or a leg at a predetermined sampling rate (for example, 500 Hz), and outputs a sample value to the event detection unit 112. Note that an electrocardiograph or an accelerometer that measures information that is a source of an electrocardiogram waveform or an accelerometer waveform may be used as an information acquisition unit, and a sample value before the waveform may be output.

  The event detection unit 112 receives the information sampled by the information acquisition unit 111, detects a predetermined event from this information, and outputs timing information indicating the timing at which the predetermined event is detected.

  For example, in the case of electrocardiogram measurement, an R wave generation event is detected as the heart beat timing, and the generation time is sent to the encoding unit 113. The generation timing of R is performed, for example, by detecting the peak of the electrocardiogram waveform (see Reference 1). Similarly, an event such as “arm is swung” or “walking” is detected as a change point in the direction of acceleration of an accelerometer attached to an arm, a leg, a waist, and the like, and timing information thereof is transmitted to the encoding unit 113. send.

(Reference 1) B.-U. Kohler, C. Hennig, and R. Orlgmeister, “The principles of software QRS detection”, IEEE Engineering in Medicine and Biology Magazine, 2002, vol. 21, no. 1, pp. 42-57.
The encoding unit 113 receives timing information, encodes the timing information, generates a transmission signal, and outputs it.

  In the present embodiment, the encoding unit 113 converts the timing information into an LED blinking pattern signal and sends it to the light emitting unit 114. In this embodiment, after receiving the timing information, a signal for turning on the LED is output for a length of time that can be visually recognized by a human and can be sufficiently spaced from the next event. For example, the timing of occurrence of a pulsation event has an interval of about 300 ms to 1100 ms. At this time, a signal that is lit for 50 ms is sent to the light emitting unit 114. If it does so, the light emission part 114 will have a light extinction state of about 250 ms-1050 ms between a lighting state and a lighting state. The temporal resolution of the human eye is about 50 ms to 100 ms, and blinking of light shorter than this time is perceived as being continuously lit. Therefore, between the lighting state indicating the occurrence of a certain event and the lighting state indicating the occurrence of the next event, a light-off state that allows humans to visually distinguish the two lighting states (for example, 100 ms or more And a blinking pattern signal may be generated. For example, the occurrence of the next event can be visually distinguished by providing at least a quarter or more interval from the signal informing the occurrence of the certain event. The timing of occurrence of pulsation events has an interval of about 300 ms at the shortest, so if you want to have an interval of 1/4 or more, it is sufficient to provide an extinguishing time of 300/4 = 75 ms or more. A signal that is turned on for a short time is sufficient because a blinking pattern signal having a turn-off time of at least 250 ms can be generated.

  The light emitting unit 114 receives the transmission signal and blinks based on this signal. The transmission device 110 transmits an optical signal when the light emitting unit 114 blinks. For example, the light emitting unit 114 is composed of one LED and blinks based on the blink pattern signal. Further, for example, the light emitting unit 114 may be attached to a target to be sampled by the information acquiring unit 111. For example, when sampling the waveform of an electrocardiogram, the light emitting unit 114 is attached to a person who is attached with an electrocardiograph. By adopting such a configuration, it is possible to easily express visually what the blinking pattern signal indicated by the light emitting unit 114 is.

  The transmission device 110 is attached to a living body (for example, a human) with a sensor for acquiring biological information (for example, an electrocardiogram, heart rate, blood pressure, body temperature, etc.), and outputs an output value of the sensor to an information acquisition unit of the transmission device. Input.

  All the light emitting units 114 of the P transmitting apparatuses are arranged so as to exist in a predetermined space. The light emitting unit 114 of each transmission device transmits timing information obtained from living body biological information as an optical signal that can be detected by the reception device 620.

  A sensor for acquiring biological information needs to be attached to a living body, and the P light emitting units 114 are each attached to a P living body that is a sampling target. In FIG. 9, a light-emitting unit 114 is provided on the head of each living organism, and the light emission of the light-emitting unit 114 is expressed in an easy-to-understand manner visually indicating that it is the biological information of the person attached with the light-emitting unit 114. Each transmission device main body may be arranged anywhere.

<Receiving device 620>
The receiving device 620 includes a light receiving unit 621, a position specifying unit 625, a decoding unit 622, and a specific biological information acquisition unit 626. The receiving device 620 receives a plurality of optical signals and outputs the position and timing information for each light emitting unit 114.

<Light receiving unit 621>
The light receiving unit 621 captures a predetermined space in which all of the light emitting units 114 of the P transmission devices are present, and captures P optical signals that flash on the basis of the P transmission signals generated by the P transmission devices. And output. The light receiving unit 621 needs to receive an optical signal as an image in order to receive the optical signal and to specify the position where the light is emitted, and includes, for example, an image sensor.

<Position identifying unit 625>
The position specifying unit 625 receives the image captured by the light receiving unit 621, specifies the position of the living body to which the corresponding light emitting unit 114 is attached, from the positions (light emitting positions) of the P optical signals in the image, and receives position information. Is output. For example, an area in which the light emitting unit 114 is captured is extracted from the image constituting the video, the position thereof is specified, and the position of the living organism is specified from the position of the light emitting unit 114.

<Decoding unit 622>
The decoding unit 622 receives the video imaged by the light receiving unit 621, decodes timing information regarding each life form from P optical signals in the video image, and outputs the decoded timing information.

<Specific biological information acquisition unit 626>
The specific biometric information acquisition unit 626 receives the timing information decoded by the decoding unit 622 and the position information specified by the position specification unit, acquires timing information and position information of at least one organism from these information, Link and output. Further, in the present embodiment, the position information and the identifier of the life form are linked in advance, and the identifier (for example, name) of the life form and the position information are linked and output.

<Effect>
With such a configuration, data from a large number of measurement points can be easily collected at one place, and the position information of the measurement points can be relatively easily restored simultaneously with the collection.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  1-1 to 1-4 Physiological information output device 11 Imaging unit 12 Position information acquisition unit 13 Physiological information acquisition unit 14 Face image recognition unit 15 Posture recognition unit 16 Biometric information identification unit 31 Position information 32 Physiological information 33 Facial information 34 Personal identification Information 35 Posture information

Claims (12)

Imaging means for imaging a predetermined space in which a plurality of living organisms exist, and a living body information output device that outputs a visible light signal representing physiological information of the living organism is attached to each of the plurality of living organisms,
Position specifying means for specifying position information of each of the plurality of life forms from the position of the visible light signal in the image taken by the image pickup means or the image of each life form;
Physiological information acquisition means for acquiring physiological information of each of the plurality of life forms from the visible light signal in the video imaged by the imaging means;
Biological information specifying means for specifying the positional information of each of the plurality of life forms specified by the position specifying means in association with the physiological information of each of the plurality of life forms acquired by the physiological information acquisition means ;
Recognizing each face image of the plurality of life forms from the images of the plurality of life forms in the video imaged by the imaging means, and at least one of facial expression information and personal identification information of the recognized face images comprising the the <br/> face recognition information acquisition means for acquiring a face image recognition information having,
The biological information specifying means includes
The plurality of lives acquired by the face image recognition information acquiring unit by associating the position of the visible light signal in the image captured by the imaging unit with the closest position of the image of each life object. Identifying face image recognition information of each body in association with position information and physiological information of each of the plurality of life forms,
Biological information acquisition device.   Imaging means for imaging a predetermined space in which a plurality of living organisms exist, and a living body information output device that outputs a visible light signal representing physiological information of the living organism is attached to each of the plurality of living organisms,
  Position specifying means for specifying position information of each of the plurality of life forms from the position of the visible light signal in the image taken by the image pickup means or the image of each life form;
  Physiological information acquisition means for acquiring physiological information of each of the plurality of life forms from the visible light signal in the video imaged by the imaging means;
  Biological information specifying means for specifying the positional information of each of the plurality of life forms specified by the position specifying means in association with the physiological information of each of the plurality of life forms acquired by the physiological information acquisition means;
  Posture information recognizing means for recognizing posture information of the plurality of life forms from images of the plurality of life forms in the video imaged by the image pickup means;
Comprising
  The biological information specifying means includes
  Each of the plurality of life forms recognized by the posture information recognition means by associating the position of the visible light signal in the image picked up by the image pickup means with the closest position of the image of each life form. Identifying the posture information in association with the position information and physiological information of each of the plurality of life forms,
Biological information acquisition device.   Recognizing each face image of the plurality of life forms from the images of the plurality of life forms in the video imaged by the imaging means, and at least one of facial expression information and personal identification information of the recognized face images Further comprising face image recognition information acquisition means for acquiring face image recognition information having
  The biological information specifying means includes
  The biometric information acquisition according to claim 2, wherein the face image recognition information of each of the plurality of life forms acquired by the face image recognition information acquisition unit is specified in association with the position information and physiological information of each of the plurality of life forms. apparatus.   Posture information recognition means for recognizing posture information of the plurality of life forms from images of the plurality of life forms in the video imaged by the image pickup means;
  The biological information specifying means includes
  The biological information acquisition apparatus according to claim 1, wherein posture information of each of the plurality of life forms recognized by the posture information recognition unit is specified in association with position information and physiological information of each of the plurality of life forms.   3. The physiological information is information including at least one of electrocardiogram, electromyogram, sweating, heart rate, heart sound intensity, blood pressure, breathing, voice, sweating, and skin temperature information. The biological information acquisition device described.   Imaging means for imaging a predetermined space in which a plurality of living organisms exist, and a living body information output device that outputs a visible light signal representing physiological information of the living organism is attached to each of the plurality of living organisms,
  Position specifying means for specifying position information of each of the plurality of life forms from the position of the visible light signal in the image taken by the image pickup means or the image of each life form;
  Physiological information acquisition means for acquiring physiological information of each of the plurality of life forms from the visible light signal in the video imaged by the imaging means;
  Biometric information specifying means for specifying the position information of each of the plurality of life forms specified by the position specifying means in association with the physiological information of each of the plurality of life forms acquired by the physiological information acquisition means;
Comprising
  Timing information indicating the timing at which at least one visible light signal representing the physiological information of the living organism output from the biological information output device attached to each of the plurality of living organisms detects a predetermined event of the living organism Including
  The physiological information acquisition means further includes
  Obtaining timing information from the at least one visible light signal among the visible light signals in the image captured by the imaging means;
  The biological information specifying means further includes:
  Timing information acquired from the at least one visible light signal acquired by the physiological information acquisition means is specified in association with position information and physiological information corresponding to the at least one visible light signal;
Biological information acquisition device.   Imaging means for imaging a predetermined space in which a plurality of living organisms exist, and a living body information output device that outputs a visible light signal representing physiological information of the living organism is attached to each of the plurality of living organisms,
  Position specifying means for specifying position information of each of the plurality of life forms from the position of the visible light signal in the image taken by the image pickup means or the image of each life form;
  Physiological information acquisition means for acquiring physiological information of each of the plurality of life forms from the visible light signal in the video imaged by the imaging means;
  Biometric information specifying means for specifying the position information of each of the plurality of life forms specified by the position specifying means in association with the physiological information of each of the plurality of life forms acquired by the physiological information acquisition means;
A biometric information acquisition device comprising:
  Determining means for determining information related to the event in the predetermined space based on position information and physiological information of the plurality of living organisms specified by the biological information specifying means of the biological information acquisition device;
An event determination device comprising:   A biological information output device that captures a predetermined space in which a plurality of life forms exist and outputs a visible light signal representing physiological information of the life forms is attached to each of the plurality of life forms,
  Identifying the position information of each of the plurality of life forms from the position of the visible light signal in the captured image or the image of each life form,
  Obtaining physiological information of each of the plurality of life forms from the visible light signal in the captured image;
  Specifying the positional information of each of the identified plurality of life forms in association with the acquired physiological information of each of the plurality of life forms,
  A face having at least one of facial expression information and personal identification information of the recognized face image is recognized from images of the plurality of life forms in the captured video. Get image recognition information,
  The positional information of each of the plurality of specified life forms and the physiological information of each of the acquired plurality of life forms are associated and specified,
  By associating the position of the visible light signal in the captured image with the closest position of the image of each life object, the facial image recognition information of each of the acquired life forms is obtained as described above. Specify in association with the position information and physiological information of each of multiple life forms,
Biological information acquisition method.   A biological information output device that captures a predetermined space in which a plurality of life forms exist and outputs a visible light signal representing physiological information of the life forms is attached to each of the plurality of life forms,
  Identifying the position information of each of the plurality of life forms from the position of the visible light signal in the captured image or the image of each life form,
  Obtaining physiological information of each of the plurality of life forms from the visible light signal in the captured image;
  Specifying the positional information of each of the identified plurality of life forms in association with the acquired physiological information of each of the plurality of life forms,
  Recognizing posture information of the plurality of life forms from the images of the plurality of life forms in the captured video,
  The positional information of each of the plurality of specified life forms and the physiological information of each of the acquired plurality of life forms are associated and specified,
  By associating the position of the visible light signal in the captured image with the closest position of the image of each life object, the posture information of each of the recognized life objects is obtained as the plurality of life information. Specify in association with the position information and physiological information of each organism.
Biological information acquisition method.   A biological information output device that captures a predetermined space in which a plurality of life forms exist and outputs a visible light signal representing physiological information of the life forms is attached to each of the plurality of life forms,
  Identifying the position information of each of the plurality of life forms from the position of the visible light signal in the captured image or the image of each life form,
  Obtaining physiological information of each of the plurality of life forms from the visible light signal in the captured image;
  Specifying the positional information of each of the identified plurality of life forms in association with the acquired physiological information of each of the plurality of life forms,
  Timing information indicating the timing at which at least one visible light signal representing the physiological information of the living organism output from the biological information output device attached to each of the plurality of living organisms detects a predetermined event of the living organism Including
  Obtaining the physiological information further includes:
  Obtaining timing information from the at least one visible light signal from the visible light signal in the captured image;
  The positional information of each of the plurality of specified life forms and the physiological information of each of the acquired plurality of life forms are associated and specified,
  Timing information acquired from the acquired at least one visible light signal is specified in association with position information and physiological information corresponding to the at least one visible light signal;
Biological information acquisition method.   A biological information output device that captures a predetermined space in which a plurality of life forms exist and outputs a visible light signal representing physiological information of the life forms is attached to each of the plurality of life forms,
  Identifying the position information of each of the plurality of life forms from the position of the visible light signal in the captured image or the image of each life form,
  Obtaining physiological information of each of the plurality of life forms from the visible light signal in the captured image;
  Specifying the positional information of each of the identified plurality of life forms in association with the acquired physiological information of each of the plurality of life forms,
  Information related to the event in the predetermined space is determined based on the positional information and physiological information of the plurality of specified life forms.
Event judgment method.   The program which functions the apparatus of any one of Claims 1 thru | or 7.

Images