JP4604173B2 - Remote conference / education system - Google Patents

Description

  The present invention is a remote conference / conference that facilitates collaboration, conferences, discussions, and decision-making by people working at different times in remote locations, especially people working in different contexts such as between different cultures and business fields. Provide an education system.

Being a ubiquitous society, it is becoming possible to communicate from anywhere at any time, but it is required to economically realize joint work, meetings, and lectures through communication that not only shares place but also time. Yes.
For example, companies that operate globally need a means to facilitate joint work, meetings, discussions, and decision-making for employees working at different times between offices between remote locations with time differences. . In particular, global companies have many employees who work in different contexts, such as work fields and cultural backgrounds, not only in time, but with the information obtained from the language and video, understanding the true intention of the conversation partner and estimating the psychological state. It is important for smooth collaboration, meetings, discussions, and rapid decision making, but it is difficult to achieve economically with current technology.

Collaborative work, conferences, and lectures are held between remote locations using digital audiovisual technology and Internet communication technology. However, information received between remote locations is limited due to limitations in the functions and performance of audiovisual input / output devices. Although there are attempts to realize communication between remote places with a sense of reality using high-quality audiovisual input / output devices and broadband communication lines, there are cases where it is difficult to realize in terms of equipment cost and operation cost, Even in a synchronous teleconference between remote locations with no time difference, it is often difficult to share a place close to face-to-face communication.

  Among these various problems, as a proposal example of means for solving the problem of sharing knowledge among people who do not share time, there is JP-A-10-214022, “Group learning teaching material organizing method and system”. In this example, the group learning teaching material organization method and system which can activate the interaction between learners by discussing and teaching with each other are provided. Based on data obtained from the cooperative behavior of multiple learners with a common learning target, it has a function to record the learning history of the preceding learner and display the procedure to reach the target state for the backward learner. Edit group learning materials, share and use organized group learning materials, display information about learning targets, and update group learning materials while taking learner notes / memos To do.

  However, with this method, it is cumbersome for a busy businessman to write in a notebook shared by everyone. Even if it is possible to store and exchange video and audio information that is easy to input, asynchronous communication that does not exchange interactively in real time breaks the context of the conversation. From the above, it is difficult to understand the true intentions of remote conversation partners, especially those in different cultures and fields, and to estimate the psychological state of the other party.

On the other hand, a method for estimating the psychological state of a user of electronic media has also been proposed. For example, Japanese Patent Laid-Open No. 5-12023 “Emotion Recognition Device” detects a deviation amount between a reference voice signal and a feature signal, and determines an emotional state based on this deviation amount.
Figure 1 shows the statistical trust of the relationship between the maximum power level of the voice spectrum and the frequency change rate of the teleconference user and the psychological state such as “happy”, “angry”, “sad”, “convinced”, “confused”. It is an example of data shown in a section (95% reliability). As can be seen from this data, the variation of the audio data is large. Therefore, it is difficult to appropriately determine the psychological state of the remote conference user only from the voice data.

  Another example of the invention is Japanese Patent Laid-Open No. 9-56703 “Emotion detection device, heart rate data transmitter and emotion display device”. This is because the heart rate signal output from the heart rate sensor is used to calculate the degree of change in heart rate, so that the degree of tension and excitement of the other party or both parties in the conversation can be accurately and quantitatively determined on the spot, and the atmosphere of the field. Is detected without harming, and the detection result is displayed. Figure 2 shows the relationship between the electronic media user's pulse rate and skin temperature change rate and psychological states such as “interesting”, “surprise”, “convinced”, and “confused” in a statistical confidence interval (95% confidence level). It is the example of data shown. FIG. 2 shows that even when skin temperature information is combined with heart rate and pulse rate information, the psychological state of the electronic media user cannot be identified in detail.

  Japanese Patent Laid-Open No. 7-204168 “Biometric Information Automatic Identification Device” is another example of a device that utilizes biometric information. This is the Fourier transform of the digital output signal of the electroencephalogram sensor to obtain the spectral power for each of a plurality of divided frequency bands within the desired frequency band, and to determine the plurality of psychological states or intellectual work contents of the subject to which the sensor is attached. I am aiming for that. Table 1 is an example of data showing the relationship between the electroencephalogram components of electronic media users and psychological states such as “interesting”, “surprise”, “convincing”, and “confusing”. Table 1 shows that it is difficult to appropriately determine the psychological state only from the increase / decrease of the α wave, β wave, δ wave, and θ wave.

JP-A-10-214022 JP 5-12023 A JP-A-9-56703 JP-A-7-204168

  The present invention is an asynchronous remote conference / education system in which information is exchanged between people who do not share time, in addition to video and audio information, various psychology extracted from user's voice, facial expression / motion, and biological information data. A teleconference / education system is provided that enables state estimation information to be displayed to remote conversation partners.

The invention according to claim 1, which solves the above-mentioned problem, is a remote conference / education system in which a server and a plurality of terminals can be connected via a network, and each terminal performs voice information input / output of voice information. Input / output means , video information input / output means for inputting / outputting video information ,
A biological information input means for inputting biometric information, voice, facial expression and operation, a data extracting means for extracting respective data of the biological information in real time, voice, facial expression and operation, psychology of the user from the extracted data of the biological information Psychological state estimating means for estimating the state in real time, in addition to the user's own audiovisual information, the psychological state display data is transmitted to the server in real time, the audiovisual information and the psychological state display data are temporarily stored in the server, a transmission unit that makes it possible to retrieve any time the communication partner via the server, the video-audio information and psychological status data of the terminal of the stored dialogue partner, receiving means for receiving from the server via the network If, then, the psychological status artificial structure display means for displaying the mental status artificial structure of dialogue partner from psychological status data acquired through the receiving means Includes, psychological state estimation means, before starting dialogue between remote locations, the audio for each individual expression and operation, previously measured metric values corresponding to the psychological state of the biological information, the psychological state estimation of the terminal Accumulating and storing in the circuit, estimating the psychological state of "uplifting" or "non-uplifting" from the change of the maximum voice level and the maximum level frequency of the voice inputted through the input and output means of voice and video information , Estimate the psychological state of “surprise”, “convinced”, “interesting”, and “confused” from the relative movement change amount of multiple feature points of the face image input via voice / video information input / output means The distance from the average point of the psychological state determination section is calculated as a coincidence index, and the relative movement changes of the two left and right lips of the user's face image, the two right and left ends of the right eyebrow, and the two left and right ends of the left eyebrow estimated the psychological state of the "surprise", "assent", "fun", "embarrassment" from the amount "Surprise" the distance from the average point of the psychological state determining section calculates a concordance index, pulse rate of the user, skin temperature, the amount of change in respiration rate of the biological information, "satisfied", "fun", " Calculate the distance from the average point of the psychological state determination interval that estimates the psychological state of `` confused '' as a coincidence index, add up each coincidence index calculated for each psychological state, and calculate the psychological state with the largest coincidence index It is characterized by estimating the psychological state at that time.

The invention according to claim 2 that solves the above-mentioned problem is characterized in that in the teleconference / education system according to claim 1, the amount of change of a plurality of feature points of the face image is calculated at intervals of 1 to 3 seconds. .

The invention according to claim 3 for solving the above-mentioned problem is characterized in that in the teleconference / education system according to claim 1, the amount of change of biological information is calculated at intervals of 2 to 10 seconds.

  The above-described present invention enables smooth and quick collaboration, meetings, discussions, and decision-making by people working at different times in remote locations, especially people in different cultures and business fields.

Hereinafter, a remote conference / education system according to the present invention will be described in detail with reference to the drawings.
FIG. 3 shows a configuration of an embodiment of an asynchronous remote conference that performs a conference without sharing time between remote locations. 1 is a headphone, 2 is a microphone, 3 is an image display device, 4 is a camera, 5 is a body-mounted biosensor, 7 is a communication network, 9 is a storage-type remote conference information processing device, 300, Reference numeral 300 ′ denotes a communication terminal, and reference numeral 400 denotes an audiovisual information storage server. Each of the communication terminals 300 and 300 ′ includes a headphone 1, a microphone 2, an image display device 3, a camera 4, a body-mounted biosensor 5, and a storage-type remote conference information processing device 9.

In the above configuration, the user of the teleconference system temporarily stores video information, audio information, and psychological state display data in the video / audio information storage server 400, instead of directly communicating with the other party through a communication line. And when the other party's convenience, it is downloaded and information is transmitted. Also, when information is transmitted from another person, when it is convenient, the video and audio information storage server 400 is accessed, and the stored video information, audio information, and psychological state display data of the sender are downloaded and viewed. To do.
The user of the communication terminal 300 recognizing that there is information addressed to him downloads the information on the conversation partner of the remote communication terminal 300 ′ once stored in the audiovisual information storage server 400, and the sound information is stored in the headphones. 1, the other party's video information and psychological state display data are obtained by the image display device 3.

When there is a message to be sent to another person, the voice information to be spoken to the conversation partner with the microphone 2 is sent to the audiovisual information storage server 400 with a destination label attached. At the same time, the storage type remote conference information processing apparatus 9 is also used for estimating the user 's psychological state by voice analysis.
The camera 4 captures an image of the remote conference user. The video information is sent to the remote audiovisual information storage server 400 with a destination label attached. At the same time, the storage type remote conference information processing apparatus 9 is also used for estimating a user's psychological state by facial image analysis. The body-mounted biological sensor 5 detects biological information such as the pulse rate, skin temperature, and respiratory rate. These data are used by the storage-type remote conference information processing apparatus 9 to estimate the user's psychological state by biometric information analysis. The storage-type remote conference information processing apparatus 9 estimates a user's psychological state by analyzing biometric information, face images, and audio information in real time, and attaches a destination label along with the user's video and audio to the video sound. The information is sent to the information storage server 400.

When receiving the video and audio of the teleconference system user and the psychological state display data of the user, the video / audio information storage server 400 stores the information and notifies the information transmission destination of the arrival of the transmission message.

  The user of the communication terminal 300 that has received notification of the arrival of the transmission message from the audiovisual information storage server 400 accesses the audiovisual information storage server 400 when convenient, and stores the stored video information and audio information of the sender. , Download psychological state display data. The other party's psychological state display data is processed by the storage type remote conference information processing apparatus 9 and displayed on the image display apparatus 3 together with the video information. The transmitted voice information of the other party is processed by the remote conference information processing device 9 and output to the headphones 1.

With the above configuration, the asynchronous remote conference user of voice, facial expression and operation, the psychological state after comprehensive consideration from the data of biological information makes it possible to display a remote location of the dialogue partner, time, beyond the space It is possible to convey subtle changes in mind to the other party.

  FIG. 4 shows the configuration of the remote conference information processing apparatus 9 in the embodiment of the asynchronous remote conference. 21 is an acoustic output interface circuit, 22 is an acoustic input interface circuit, 23 is a video output interface circuit, 24 is a video input interface circuit, 25 is a biological information input interface circuit, 26 is an acoustic data extraction circuit, 27 Is a video data extraction circuit, 28 is a biological information extraction circuit, 29 is a psychological state estimation circuit, 30 is a psychological state data generation circuit, 31 is a video / acoustic multiplexing circuit, 32 is a transmission data multiplexing circuit, 33 is a transmission circuit, 34 is a reception circuit, 35 is a reception data separation circuit, 36 is a video / sound separation circuit, and 37 is a conference video / psychological state data synthesis circuit.

  The sound output interface circuit 21 is connected to the headphone 1 of FIG. The acoustic input interface circuit 22 is connected to the microphone 2. The video output interface circuit 23 is connected to the image display device 3. The video input interface circuit 24 is connected to the camera 4. The biological information input interface circuit 25 is connected to the body-mounted biological sensor 5.

  The sound data extraction circuit 26 extracts the maximum power level of the sound spectrum and its frequency from the signal of the sound input interface circuit 22 as sound data for estimating the psychological state.

  The video data extraction circuit 27 estimates a psychological state from the relative movement change amounts of a plurality of feature points of the face image from the video signal of the video input interface circuit 24. Specifically, the relative movement change amounts of the two left and right end points of the lips of the face image, the two right and left end points of the right eyebrow, and the two left and right end points of the left eyebrow are extracted. The amount of change of the feature points of these face images is calculated at intervals of 1 to 3 seconds.

  The biometric information extraction circuit 28 extracts changes in pulse rate, skin temperature, and respiration rate from the signal from the biometric information input interface circuit 25. The amount of change in the biological information is calculated at intervals of 2 to 10 seconds.

The psychological state estimation circuit 29 performs “surprise”, “consent”, “fun” based on the audio data of the acoustic data extraction circuit 26, the face image data of the video data extraction circuit 27, and the biological data of the biological information extraction circuit 28. It is a circuit that estimates the user's psychological state such as “confused” in real time.
The psychological state data generation circuit 30 is an avatar, two-dimensional or tertiary that allows other users to understand the estimated psychological state of the user at a glance based on the psychological state estimation result of the user that is the output of the psychological state estimation circuit 29. Psychological state display artificial structure data such as original animation is generated.
Digital output signals of the audio input interface circuit 22 and the video input interface circuit 24 are multiplexed by the video / audio multiplexing circuit 31.

The outputs of the video / sound multiplexing circuit 31 and the psychological state data generation circuit 30 are multiplexed by the transmission data multiplexing circuit 32 and sent out from the transmission circuit 33 to the network.
The data sent from the network is received by the receiving circuit 34 and separated by the received data separating circuit 35 into the dialogue partner psychological state display artificial structure data and the dialogue partner video / audio multiplexed data.

  The video / sound separation circuit 36 separates the video / audio multiplexed data into video data and audio data. The separated audio data is sent to the acoustic output interface circuit 21 and converted into analog information.

The conference video / psychological state data synthesis circuit 37 synthesizes the separated video data and psychological state display artificial structure data, and sends them to the video output interface circuit 23 where they are converted into analog information.
Predict the user's psychological state types to “surprise”, “convince”, “interesting”, and “confused” in advance, corresponding to each psychological state for each piece of biometric information and facial image data The judgment reference value is stored and stored, and the coincidence index is calculated from the difference from the judgment reference value of the psychological state for each extracted voice, facial expression / motion, biological information data at each time point, and the biometric information for each psychological state Then, the coincidence indices of the facial expression / motion data are added together, and the psychological state having the maximum coincidence index is estimated as the psychological state at that time.

With voice data, it is difficult to identify a detailed psychological state, so only “high” or “non-high” psychological states are identified. For example, this data can be added when it is necessary to add an “anger” psychological state to the four psychological states.
Judgment standard values are determined by the rate of change of measurement data, and before each conversation between remote locations, the measurement standard values corresponding to each psychological state for each voice, facial expression / motion, and biological information data for each individual. Measure and store it.

  FIG. 5 shows a processing algorithm of the psychological state estimation circuit 29. Face image data 1 (right lip position), face image data 2 (left lip position), face image data 3 (right inner eyebrow position), face image data 4 (left inner eyebrow position), face image data 5 (right outer eyebrow position) Position), face image data 6 (left outer eyebrow position), biometric data 1 (respiration rate), biometric data 2 (heart rate), and biometric data 3 (skin temperature) from the measurement change rate, "surprise" ”,“ Interesting ”, and“ Confusion ”are stored and stored as reference values corresponding to the four psychological states. The coincidence index for each psychological state is calculated from the measurement data at a specific time.

The coincidence indices corresponding to the four psychological states calculated for each of the nine types of measurement data are summed up for each psychological state of “surprise”, “convinced”, “fun”, and “confused”. The psychological state having the maximum coincidence index sum is determined.
Judgment of “uplifted” psychological state / “non-uplifted” psychological state is performed from the voice data. These estimated data are sent to the psychological state data generation circuit 30 to generate psychological state display artificial structure data such as an avatar, two-dimensional or three-dimensional animation so that other users can see the estimated psychological state of the user at a glance. .

Hereinafter, specific examples of the determination reference value will be described for each voice, face screen, and biological information incorporated in the algorithm of FIG.
FIG. 6 shows the relationship between the voice maximum level value and the frequency change rate of the maximum level and the psychological state. It is difficult to deduce a detailed psychological state from the maximum voice power level and the rate of change of its frequency. Only the uplifting psychological state such as anger and other psychological states (non-uplifting psychological state) can be separated. If the measurement data is within the square frame, it is determined as an “uplift” psychological state or a “non-uplift” psychological state.

  In the analysis of the face screen, the relative coordinate system 40 is recalculated using the top-chin line as the reference line 41, so that only the movement of the measurement point is affected, regardless of the head shake or the ratio of the face to the screen. And the psychological state is estimated from the relative movement change amounts of the plurality of feature points of the face image. Specifically, the psychological state is estimated from the relative movement change amounts of the left and right edges of the lips of the face image, the left and right edges of the right eyebrow, and the left and right edges of the left eyebrow.

FIG. 7 is a part of an image in the process of recalculating the relative coordinate system 40 from the data of the face screen using the top-chin line as the reference line 41. The change amounts of the plurality of feature points of the face image are calculated at intervals of 1 to 3 seconds.
FIG. 8 shows the image analysis result (position change rate) of the right lip. The change in the psychological state of “surprise” has spread widely below the y-axis. Changes in the psychological state of “interesting” tend to be raised in the y-axis upward direction. On the contrary, the change in “confused” tends to extend outward in the x-axis direction. FIG. 9 shows the image analysis result of the left lip. It moves in the same way as the right lip.

FIG. 10 shows the image analysis result (position change rate) of the right inner eyebrow. Changes in the psychological state of “surprise” and “confused” tend to be longer in the x-axis direction. Changes in the psychological state of "Consent" and "Interesting" are almost overlapped on both the left and right sides, and it is difficult to judge only from these measurement points.
FIG. 11 shows the image analysis result (position change rate) of the left inner eyebrow. The movement is almost the same as the right inner eyebrow. FIG. 12 shows the image analysis result (position change rate) of the right outer eyebrow. Changes in the psychological state of “surprise” and “confused” tend to be longer in the x-axis direction, and are more likely to overlap (become difficult to identify). The change in the psychological state of “fun” is the least in both the x and y axis directions. Changes in the psychological state of “convinced” often move greatly in the x-axis direction.

  FIG. 13 shows the image analysis result (position change rate) of the left outer eyebrow. It moves in the same way as the right outer eyebrow. FIG. 14 shows an example of biometric information data when the averaging time is set to 5 seconds, FIG. 15 shows biometric information data when the averaging time is set to 10 seconds, and FIG. It is a data example of the biometric information when set to second. When the averaging time becomes longer, the noise component is removed, but at the same time, the abrupt change amount of the biological information is also smoothed and important information is lost. Therefore, in this embodiment, changes in biological information such as pulse rate, skin temperature, and respiratory rate are extracted at 10-second intervals.

FIG. 17 shows psychological state determination criteria for pulse and respiratory rate in the biological information. Psychological states of “Consent” and “Interesting” can be separated from “Puzzled” psychological states, but the range of “Surprised” psychological states is widened and separated from other psychological states. Is impossible.
FIG. 18 illustrates psychological state determination criteria for respiratory rate and skin temperature in the biological information. The psychological state of "Consent" and "Interesting" can be separated from the psychological state of "Confusion".
FIG. 19 shows a method for calculating the coincidence index of the measurement data of the left outer eyebrow. The coincidence index is calculated based on the distance between the measurement points and the average points of the four psychological state determination sections of “surprise”, “convinced”, “confused”, and “interesting”. The coincidence index of the psychological state with the shortest distance was “+1”, the coincidence index of the psychological state with the longest distance was “−1”, and the coincidence index of the other psychological states was “0”.

  With the above configuration, it is possible to comprehensively judge the remote conference user's voice, facial expression / motion, and biological information data, estimate various user psychological states in real time, and display them to the remote conversation partner. It becomes possible, and it becomes possible to convey the subtle change of the mind of the remote conversation partner to the other party.

The statistical confidence interval (reliability level) indicates the relationship between the maximum power level of the voice spectrum and the rate of change of the frequency of the teleconference user and the psychological state such as “happy”, “anger”, “sad”, “convinced”, “confused”. 95%). Data example showing the relationship between the rate of change of heart rate and skin temperature of electronic media users and psychological states such as “interesting”, “surprise”, “convincing”, and “confusing” with a statistical confidence interval (95% confidence) It is. It is the schematic which shows the structure of the Example of the asynchronous type remote conference which performs a conference without sharing time between remote locations. It is a block diagram which shows the structure of the remote conference information processing apparatus 9 of an Example. It is a figure for demonstrating the processing algorithm of the mental state estimation circuit. It is a chart figure which shows the relationship between the change rate of the audio | voice maximum level value and the frequency of a maximum level, and a mental state. It is the schematic for demonstrating a face image analysis reference line. It is a chart figure for demonstrating the psychological state criteria (right lip) by a face image. It is a chart figure for demonstrating the psychological state criteria (left lip) by a face image. It is a chart figure for demonstrating the psychological state criteria (right inner eyebrows) by a face image. It is a chart figure for demonstrating the psychological state criteria (left inner eyebrows) by a face image. It is a chart for demonstrating the psychological state determination standard (right outer eyebrows) by a face image. It is a chart for demonstrating the psychological state criteria (left outer eyebrows) by a face image. It is a chart figure which shows the change rate in the case of the setting (5 second) of the averaging time of biometric information. It is a chart figure which shows the change rate in the case of the setting (10 second) of the averaging time of biometric information. It is a chart figure which shows the change rate in the case of the setting (30 second) of the averaging time of biometric information. It is a chart for demonstrating the psychological state determination criteria (pulse-respiration rate) by biometric information. It is a chart for demonstrating the psychological state determination criteria (respiration rate-skin temperature) by biometric information. It is a chart figure for demonstrating the calculation method (in the case of left outer eyebrows) of a coincidence index.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Headphone 2 Microphone 3 Image display apparatus 4 Camera 5 Body-mounted biosensor 7 Communication network 9 Storage type remote conference information processing apparatus 21 Acoustic output interface circuit 22 Acoustic input interface circuit 23 Video output interface circuit 24 Video input interface circuit 25 Biological information Input interface circuit 26 Acoustic data extraction circuit 27 Video data extraction circuit 28 Biological information extraction circuit 29 Psychological state estimation circuit 30 Psychological state data generation circuit 31 Video / acoustic multiplexing circuit 32 Transmission data multiplexing circuit 33 Transmission circuit 34 Reception circuit 35 Reception data Separation circuit 36 Video / sound separation circuit 37 Conference video / psychological state data synthesis circuit 300, 300 'Communication terminal 400 Video / audio information storage server

Claims (3)

A remote conference / education system in which a server and a plurality of terminals can be connected via a network.
Voice information input / output means for inputting and outputting voice information ;
Video information input / output means for inputting / outputting video information ;
Biometric information input means for inputting biometric information ;
Audio, and data extracting means for extracting respective expression-operation, the data of the biological information in real time,
Psychological state estimating means for estimating a user's psychological state in real time from extracted data of voice, facial expression / motion and biological information;
In addition to the user's own audiovisual information, the psychological state display data is transmitted to the server in real time, the audiovisual information and the psychological state display data are temporarily stored in the server , and the communication partner can communicate at any time via the server. A transmission means that enables retrieval;
Receiving means for receiving the stored audiovisual information and psychological state display data of the conversation partner terminal from a server via a network; and
Psychological state display artificial structure display means for displaying the psychological state display artificial structure of the conversation partner from the psychological state display data acquired via the receiving means ;
Equipped with a,
The psychological state estimating means includes
Before starting the conversation between remote locations, measure the reference value corresponding to each psychological state in advance from voice, facial expression / motion, biometric information for each individual , and store and store in the psychological state estimation circuit of the terminal ,
Estimating the psychological state of “uplifting” or “non-uplifting” from the change in the maximum audio level value and the maximum level frequency of the audio input through the audio and video information input / output means ,
Estimate the psychological state of "surprise", "convincing", "interesting", or "confused" from the relative movement change amount of a plurality of feature points of the face image input through the voice / video information input / output means Calculate the distance from the average point of the psychological state determination interval to be a match index ,
“Surprise”, “Consent”, “Interesting”, “Interest” from the relative movement change amounts of the left and right ends of the lips, the left and right ends of the right eyebrow, and the left and right ends of the left eyebrow of the user's face image. Calculate the distance from the average point of the psychological state determination section that estimates the psychological state of "confused" as a coincidence index,
From the average point of the psychological state determination section that estimates the psychological state of "surprise", "consent", "interesting", "confused" from the amount of change in the biological information of the user's pulse rate, skin temperature, respiratory rate Calculate distance as a match index,
A teleconferencing / education system characterized by summing up the respective coincidence indexes calculated for each psychological state, and estimating a psychological state having the maximum coincidence index as a psychological state at that time. Teleconferencing and education system according to claim 1, wherein the calculating the amount of change of a plurality of feature points of the face image with 1-3 second intervals. 2. The teleconference / education system according to claim 1 , wherein the change amount of the biological information is calculated at intervals of 2 to 10 seconds.

Images