JP2017185072A - Information processing method, information processing device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an objective index of a user's peace of mind using proper parameters and criteria.SOLUTION: The information processing method executed by a computer including a control unit causes the control unit to: acquire strength data representing eyeblink strength measured on the basis of an eye potential of an object person's eye; calculate fluctuation data related to fluctuation in the strength data from the prescribed number of the past strengh data or strength data within a past prescribed time; and calculate a mind evaluation value representing peace of mind of the object person on the basis of the fluctuation data.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an information processing method, an information processing apparatus, and a program.

  Conventionally, when psychological test data is displayed, it is known to display the characteristic or similarity of the answer result of the psychological test as a pattern of shades or shades of color (for example, see Patent Document 1).

JP 2008-148798 A

  However, in the prior art, objectively seeking the calmness of the user has not been studied. In addition, even when trying to determine the calmness of the heart, it is not possible to easily determine the calmness of the heart, such as what parameters should be used and what criteria should be used.

  Therefore, the disclosed technique aims to provide an objective index for the calmness of the user using appropriate parameters and criteria.

  An information processing method according to an aspect of the disclosed technology is an information processing method executed by a computer having a control unit, and the control unit is intensity data indicating blink strength measured based on an electrooculogram of a subject's eye And calculating variation data related to variations in the intensity data from a predetermined number of intensity data in the past, or intensity data within a predetermined time in the past, and showing calmness of the subject's heart based on the variation data Calculate a cardiac assessment value.

  According to the disclosed technology, it is possible to provide an objective index for the calmness of the user using appropriate parameters and criteria.

It is a figure which shows an example of the information processing system in an Example. It is a schematic block diagram which shows the hardware constitutions of the information processing apparatus in an Example. It is a block diagram which shows an example of the hardware constitutions of the processing apparatus in an Example. It is a block diagram which shows an example of a function structure of the information processing apparatus in an Example. It is a block diagram which shows an example of a function structure of the calculation part in an Example. It is a block diagram which shows an example of a function structure of the evaluation part in an Example. It is a block diagram which shows an example of a function structure of the alerting | reporting part in an Example. It is a figure which shows the example of data of multiple types of biological information. It is a figure which shows the example of data of each concentration parameter. It is a figure which shows an example of message information. It is a figure which shows an example of the head evaluation value in the case of the craftsman A, and a mental evaluation value. It is a figure which shows an example of the head evaluation value in the case of the craftsman B, and a mental evaluation value. It is a figure which shows an example of the screen during measurement of a concentration state. It is a figure which shows an example of the measurement result screen of a concentration state It is a figure which shows an example of the presentation screen of a solution. It is a flowchart which shows an example of the whole process of the application in an Example. It is a flowchart which shows an example of the process which calculates the calmness of the heart in an Example. It is a flowchart which shows an example of the display control process in an Example.

  Embodiments of the present invention will be described below with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude various modifications and technical applications that are not explicitly described below. That is, the present invention can be implemented with various modifications without departing from the spirit of the present invention. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not necessarily match actual dimensions and ratios. In some cases, the dimensional relationships and ratios may be different between the drawings.

[Example]
In the embodiment, the eyewear is taken as an example of the target on which the acceleration sensor, the angular velocity sensor, and the biological electrode are mounted, but is not limited thereto. FIG. 1 is a diagram illustrating an example of an information processing system 1 in the embodiment. The information processing system 1 illustrated in FIG. 1 includes an external device 10, an eyewear 30, and a server 40. The external device 10, the eyewear 30, and the server 40 are connected via a network so that data communication is possible.

  The eyewear 30 mounts the processing device 20 on a temple portion, for example. The processing device 20 includes a three-axis acceleration sensor and a three-axis angular velocity sensor (may be a six-axis sensor). The eyewear 30 includes bioelectrodes 31, 33, and 35 at a pair of nose pads and a bridge portion, respectively. An electrooculogram signal acquired from a bioelectrode provided in the eyewear 30 is transmitted to the processing device 20. The biological electrode is provided for detecting blinks, line-of-sight movement, and the like. However, when detecting blinks, line-of-sight movement, and the like by image processing, the biological electrode may not be provided.

  The processing device 20 transmits a sensor signal, an electrooculogram signal, and the like to the external device 10 and the server 40. The installation position of the processing apparatus 20 is not necessarily a temple, but may be positioned in consideration of the balance when the eyewear 30 is attached.

  The external device 10 is an information processing device having a communication function. For example, the external device 10 is a mobile communication terminal such as a mobile phone and a smartphone possessed by the user, a personal computer, a tablet terminal, or the like. The external device 10 displays a predetermined figure formed from a plurality of objects indicating the user's psychological state based on the sensor signal, electrooculogram signal, and the like received from the processing device 20. Hereinafter, the external device 10 will be described as the information processing device 10.

  The server 40 acquires a sensor signal, an electrooculogram signal, and the like from the processing device 20 and stores them. Further, the server 40 transmits a sensor signal, an electrooculogram signal, and the like to the external device 10 in response to a request from the external device 10 as necessary. Further, the server 40 may calculate one or a plurality of types of concentration parameters indicating the concentration state according to a predetermined standard using the sensor signal or the electrooculogram signal.

<Hardware Configuration of Information Processing Apparatus 10>
FIG. 2 is a schematic configuration diagram illustrating a hardware configuration of the information processing apparatus 10 according to the embodiment. A typical example of the information processing apparatus 10 is a mobile phone such as a smartphone or a personal computer (PC). In addition, a mobile terminal that can be connected to a network wirelessly or by wire, or a touch panel such as a tablet terminal is mounted. A general-purpose device that can display a screen while processing data while communicating using a network, such as an electronic device, may correspond to the information processing apparatus 10 in the embodiment.

  The information processing apparatus 10 according to the embodiment includes, for example, a rectangular thin housing (not shown), and a touch panel 102 is configured on one surface of the housing. In the information processing apparatus 10, each component is connected to the main control unit 150. The main control unit 150 is a processor, for example.

  The main control unit 150 includes a mobile communication antenna 112, a mobile communication unit 114, a wireless LAN communication antenna 116, a wireless LAN communication unit 118, a storage unit 120, a speaker 104, a microphone 106, a hard button 108, and a hard key 110. And the 6-axis sensor 111 is connected. The main control unit 150 is further connected with a touch panel 102, a camera 130, and an external interface 140. The external interface 140 includes an audio output terminal 142.

  The touch panel 102 has both functions of a display device and an input device, and includes a display (display screen) 102A that bears a display function and a touch sensor 102B that bears an input function. The display 102A is configured by a general display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The touch sensor 102B includes an element for detecting a contact operation disposed on the upper surface of the display 102A and a transparent operation surface stacked on the element. As a contact detection method of the touch sensor 102B, an arbitrary method among known methods such as a capacitance method, a resistance film method (pressure-sensitive method), and an electromagnetic induction method can be adopted.

  The touch panel 102 as a display device displays an application image generated by the execution of the program 122 by the main control unit 150. The touch panel 102 as an input device detects an action of a contact object (including a player's finger, stylus, and the like. Hereinafter, a case of a “finger” will be described as a representative example). The operation input is received, and information on the contact position is given to the main control unit 150. The movement of the finger is detected as coordinate information indicating the position or area of the contact point, and the coordinate information is represented as coordinate values on two axes of the short side direction and the long side direction of the touch panel 102, for example.

  The storage unit 120 stores a program 122 that executes a process of controlling display of each object for indicating the user's concentration state. The storage unit 120 may be separate from the external device 10, and may be a recording medium such as an SD card or a CD-RAM.

  The information processing apparatus 10 is connected to the network N through the mobile communication antenna 112 and the wireless LAN communication antenna 116, and can perform data communication with the processing apparatus 20 and the server 40.

<Hardware Configuration of Processing Device 20>
FIG. 3 is a block diagram illustrating an example of a hardware configuration of the processing device 20 according to the embodiment. As illustrated in FIG. 3, the processing device 20 includes a processing unit 202, a transmission unit 204, a 6-axis sensor 206, and a power supply unit 208. In addition, each of the bioelectrodes 31, 33, and 35 is connected to the processing unit 202 using an electric wire via an amplification unit, for example. In addition, each part of the processing apparatus 20 may be distributed in a pair of temples instead of being provided in one temple.

  The 6-axis sensor 206 is a 3-axis acceleration sensor and a 3-axis angular velocity sensor. Each of these sensors may be provided separately. The 6-axis sensor 206 outputs the detected sensor signal (also referred to as detection data) to the processing unit 202.

  The processing unit 202 is, for example, a processor, processes a sensor signal obtained from the 6-axis sensor 206 and an electrooculogram signal obtained from the biological electrode as necessary, and outputs the processed signal to the transmission unit 204. For example, the processing unit 202 calculates first biological information related to blinks using an electrooculogram signal.

  The processing unit 202 processes the sensor signal obtained from the 6-axis sensor 206 as necessary, and outputs the processed sensor signal to the transmission unit 204. For example, the processing unit 202 uses the sensor signal from the 6-axis sensor 206 to first data indicating a pitch angle related to body movement, second data indicating a roll angle, and a yaw angle. The third data indicating is generated. The pitch angle indicates, for example, a shake before and after the head, the roll angle indicates, for example, a left-right shake of the head, and the yaw angle indicates, for example, the inclination and size of the body axis. The pitch angle, roll angle, and yaw angle may be calculated using known techniques. Hereinafter, the information regarding the body movement is also referred to as second biological information. Further, the processing unit 202 may only amplify the sensor signal obtained from the 6-axis sensor 206. Hereinafter, the first biological information and / or the second biological information will be described using an example calculated by the processing unit 202, but may be calculated by the information processing apparatus 10 or the server 40.

  The transmission unit 204 transmits each piece of information including the first biological information and / or the second biological information processed by the processing unit 202 to the information processing apparatus 10 and the server 40. For example, the transmission unit 204 transmits the sensor signal or each biological information to the information processing apparatus 10 or the server 40 by wireless communication such as Bluetooth (registered trademark) and wireless LAN, or wired communication. The power supply unit 208 supplies power to the processing unit 202, the transmission unit 204, the 6-axis sensor 206, and the like.

<Functional Configuration of Information Processing Apparatus 10>
Next, the functional configuration of the information processing apparatus 10 will be described. FIG. 4 is a block diagram illustrating an example of a functional configuration of the information processing apparatus 10 according to the embodiment. The information processing apparatus 10 includes a storage unit 302, a communication unit 304, and a control unit 306.

  The storage unit 302 can be realized by, for example, the storage unit 120 shown in FIG. The storage unit 302 is an application that executes a function for evaluating the user's concentration state in consideration of the clarity of the user's head, the calmness of the mind, and the stability of the posture in the embodiment (hereinafter also referred to as a concentration application). The data etc. are stored. The data related to the central application is, for example, data received from the processing device 20 or the server 40, screen information displayed on the screen, and the like.

  Here, the reason for using the clarity of the head, the calmness of the mind, and the stability of the posture (hereinafter collectively referred to as the concentration parameter) as the index indicating the concentration state of the user will be described. First, if the user can concentrate on the clarity of the head, it can be said that the inside of the head is clear and clear. At this time, it can be said that the user's concentration is high. On the other hand, if the user is not focused on something, his head is not clear and clean. At this time, it can be said that the user cannot concentrate. In this embodiment, in order to obtain the clarity of the head, the blink interval is used. In a concentrated state, it is known that the number of blinks within a predetermined time is reduced, that is, the blink interval is widened. Therefore, in this embodiment, an evaluation value indicating the clarity of the head is obtained using the interval between blinks.

  Next, regarding the calmness of the mind, the inventor has found that when the user's mind is calm, the strength of the blink is constant. First, blinks are said to occur due to both psychological and physiological phenomena. For example, if a person is working indoors, changes in physiological phenomena are unlikely to occur. This is because the temperature, humidity, etc. are constant in the room. Then, in a state where blinks are largely caused by psychological phenomena, it is considered that many similar things occur for blinks when the psychological state is calm. If blinks are similar, the intensity of those blinks is considered constant. That is, when the psychological state is calm and in a concentrated state, the blink strength is constant and the variation in blink strength is reduced. Therefore, in this embodiment, an evaluation value indicating the calmness of the heart is obtained using the variation in blink strength.

  Lastly, there is a posture that makes it easy to immerse yourself in work for posture stability, so comparing the most recent predetermined period with the current posture, the smaller the change, the more concentrated the user I can say that. Therefore, in this embodiment, an evaluation value indicating the stability of the posture is obtained using the change between the latest posture and the current posture.

  In addition, the concentration application has a function of visually expressing a user's concentration state using a predetermined deformable figure using each concentration parameter described above. For this reason, the storage unit 302 stores information on a plurality of objects that can be deformed and / or moved that constitute a predetermined graphic indicating the user's concentration state.

  The communication unit 304 can be realized by the mobile communication unit 114, the wireless LAN communication unit 118, and the like, for example. The communication unit 304 receives data from the processing device 20 or the server 40, for example. Further, the communication unit 304 may transmit data processed in the information processing apparatus 10 to the server 40. That is, the communication unit 304 functions as a transmission unit and a reception unit.

  The control unit 306 can be realized by the main control unit 150, for example. The control unit 306 executes a centralized application. The concentration application in the embodiment has a function of evaluating the concentration state described above and a function of displaying the concentration state on a screen using a predetermined figure. The control unit 306 includes an association unit 312, an acquisition unit 314, a calculation unit 316, an evaluation unit 318, and a notification unit 320 in order to realize the functions described above.

  The associating unit 312 associates a concentration parameter that can be expressed using each of the motion parameters with at least two motion parameters for a plurality of objects forming a predetermined deformable figure. The motion parameter includes each motion parameter indicating a change in the size of a plurality of objects forming a predetermined graphic, a change in the positional relationship of each object, and a change in the shape of the object itself.

  Each associated concentration parameter includes a head parameter for head clarity (Clear), a heart parameter for heart calmness (Calm), and a posture parameter for posture (Posture).

  The head parameter is, for example, a parameter indicating the degree of dedication of the user's head, and is calculated based on the first biological information related to blinks. The heart parameter is a parameter indicating, for example, the degree of calmness or calmness of the user, and is calculated based on the first biological information regarding blinks. The posture parameter is a parameter indicating, for example, the posture of the user during work, and is calculated based on the second biological information related to body movement.

  Once the association unit 312 performs the association, the content of the association may be used thereafter, or the content of the association may be changed as appropriate according to the user setting.

  The acquisition unit 314 acquires each concentration parameter associated with the association unit 312. The acquisition unit 314 acquires each concentration parameter calculated and transmitted by the server 40 or the like, or calculates and acquires each concentration parameter based on one or more types of biological information transmitted by the processing device 20 or the like. You may do it.

  For example, the acquisition unit 314 includes at least one of data indicating presence or absence of blinks as a head parameter, data indicating blink strength as a heart parameter, and data indicating pitch angle, roll angle, and yaw angle as posture parameters. One is acquired as posture data.

  The calculation unit 316 calculates, for example, an average of blink intervals within a predetermined number or a predetermined period in order to obtain the clarity of the head. Note that the interval between blinks can be calculated based on the presence or absence of blinks that are periodically acquired. In addition, the calculation unit 316 calculates, for example, a variation in blink strength within a predetermined number or a predetermined period in order to obtain calmness of the heart. In addition, the calculation unit 316 calculates a square error or the like between the pitch angle, roll angle, and yaw angle data related to body movement and a reference value in order to obtain posture stability. The reference value is changed as needed by calibration, so that an appropriate reference value can be obtained each time. Details of the calculation unit 316 will be described later with reference to FIG.

  The evaluation unit 318 calculates the evaluation value of each concentration parameter using the calculation result obtained by the calculation unit 316. The evaluation value is given a score using a predetermined calculation formula or the like. Thereby, an objective evaluation index can be given for each concentration parameter. Details of the evaluation unit 318 will be described later with reference to FIG.

  Each time each concentration parameter is updated by the evaluation unit 318, the notification unit 320 updates each motion parameter based on the variation of each concentration parameter, and controls display of a predetermined figure based on each updated motion parameter on the screen. . For example, the notification unit 320 deforms the entire predetermined figure by displaying, on the screen, an object that moves corresponding to the variation of each concentration parameter or an object that deforms according to the variation. Details of the graphic display of the notification unit 320 will be described later with reference to FIG.

According to the above processing, the user's concentration state can be quantified as objective indices such as the clarity of the head related to the concentration, the calmness of the mind, and the stability of the posture. At this time, it is possible to objectively evaluate the parameters that are difficult to quantify, such as the clarity of the head and the calmness of the mind, by using appropriate parameters and standards.
Further, in this embodiment, since a predetermined figure formed from these objects is displayed so that the size, positional relationship, and shape of the object are changed according to each concentration parameter, the user's own concentration state is displayed. The user can easily and intuitively understand whether the current state is present.

  In addition, the associating unit 312 associates the head parameter with the first motion parameter indicating the change in the size of the plurality of objects, and associates the heart parameter with the second motion parameter indicating the change in the positional relationship between the objects. A posture parameter may be associated with the third motion parameter indicating the change in the shape of the posture.

  Thereby, since the clarity of the head is shown using the variation in the size of each object, it is possible to more intuitively express that the smaller the variation, the higher the clarity, and the greater the variation, the lower the clarity. In addition, the change in the positional relationship of each object, for example, the calmness of the heart is shown using the moving distance of each object from the center of the figure, so the positional relationship changes, and the smaller the moving distance of each object, the calmer It can be expressed more intuitively that the longer the moving distance, the less calm. In addition, in order to show the stability of posture using the shape change of each object, the posture is more stable as the shape change is smaller, and more intuitively the posture is not stable as the shape change is larger Can be expressed. As described above, the user's concentration state can be easily grasped intuitively.

  The storage unit 302 also includes an evaluation value of a head parameter (hereinafter also referred to as a head evaluation value), an evaluation value of a heart parameter (hereinafter also referred to as a heart evaluation value), and an evaluation value of a posture parameter (hereinafter referred to as a posture). The evaluation value may also be stored in association with a message related to the concentration state of the subject.

  At this time, the notification unit 320 may control to acquire a message corresponding to each evaluation value from the storage unit 302 that stores the message and display the message. Moreover, the alerting | reporting part 320 may control so that a message may be output by an audio | voice. This message includes the cause that prevents concentration and a solution that improves concentration.

  This allows the user to identify the cause that hindered his / her concentration, remove the cause, and know what to do to improve his / her concentration.

  Moreover, the evaluation part 318 may calculate the concentration evaluation value which shows a user's concentration state based on each evaluation value. At this time, the notification unit 320 may notify data regarding the concentration evaluation value that is equal to or greater than the threshold value. This data is, for example, the total time during which the concentration evaluation value is equal to or greater than the threshold in the measurement time, time series data that makes it possible to identify the concentration evaluation value that exceeds the threshold, and the like. Thereby, it is possible to cause the user to grasp the time when the concentration is high afterwards.

≪Acquisition department≫
Next, details of the acquisition unit 314 will be described. The acquisition unit 314 acquires one or more types of biological information from the processing device 20 or the server 40. For example, the acquisition unit 314 acquires first biological information based on an electrooculogram signal acquired from a biological electrode provided in the eyewear 30, and uses the sensor signal acquired from the acceleration sensor provided in the eyewear 30. Based on the second biological information, the second biological information may be acquired. Further, the biological information related to the blink may be acquired from an apparatus that processes an image obtained by capturing an eye movement.

  The timing for acquiring the biological information may be regular (20 Hz), or may be when an acquisition request is issued from the information processing apparatus 10 side to the processing apparatus 20 or the server 40. The multiple types of biological information are, for example, first biological information related to blinks and second biological information related to body movements. The first biological information regarding blinks includes blink presence / absence and blink strength. The second biological information related to body movement includes posture data indicating at least one of first data indicating a pitch angle, second data indicating a roll angle, and third data indicating a yaw angle.

≪Calculation section≫
Next, details of the calculation unit 316 will be described. FIG. 5 is a block diagram illustrating an example of a functional configuration of the calculation unit 316. The calculation unit 316 illustrated in FIG. 5 includes a first calculation unit 3162 for head parameters, a second calculation unit 3164 for cardiac parameters, and a third calculation unit 3166 for posture parameters.

  The first calculation unit 3162 calculates the blink interval using the presence or absence of the blink included in the first biological information, and calculates the average value of the blink interval within a predetermined number of times or a predetermined period. The first calculation unit 3162 outputs the calculated average blink interval to the evaluation unit 318.

  The second calculation unit 3164 calculates variation data of blink strength using strength data indicating blink strength included in the first biological information. The blink strength variation data is a standard deviation of the past predetermined number or intensity data within a predetermined period, a difference between the maximum value and the minimum value, and the like. The second calculation unit 3164 outputs the calculated standard deviation of the blink strength and the difference between the maximum value and the minimum value to the evaluation unit 318.

  The 3rd calculation part 3166 calculates the dispersion | variation in each data using each data contained in 2nd biometric information. For example, the third calculation unit 3166 includes a posture data value indicating at least one of the first data indicating the pitch angle, the second data indicating the roll angle, and the third data indicating the yaw angle, and the reference value. Find the difference. As a specific example, the 3rd calculation part 3166 calculates | requires the square error of each present value and a reference value using 1st data and 2nd data. The reference value is updated as needed by calibration, and the average value of each data within the moving time window is used as the reference value. The third calculation unit 3166 outputs the calculated variation of each data to the evaluation unit 318.

≪Evaluation Department≫
Next, details of the evaluation unit 318 will be described. FIG. 6 is a diagram illustrating an example of a functional configuration of the evaluation unit 318. In the example illustrated in FIG. 6, the evaluation unit 318 includes a first evaluation unit 3182 for head parameters, a second evaluation unit 3184 for cardiac parameters, and a third evaluation unit 3186 for posture parameters.

  The first evaluation unit 3182 uses the average value of the blink interval acquired from the first calculation unit 3162 to calculate a head evaluation value indicating the evaluation result of the head parameter. For example, the first evaluation unit 3182 sets the evaluation value so that the higher the score is, the closer the average value of the blink interval is to a preset value.

Moreover, the 1st evaluation part 3182 may obtain | require a head evaluation value with the following procedures.
(A1) Calculate the average value of the last specified blink interval (A2) Compare the average value with the specified value (A3) Score the head evaluation value between 0 and 100 based on the comparison result

Moreover, the 1st evaluation part 3182 may obtain | require a head evaluation value with the following formula | equation using the number of blinks.
Head evaluation value = 50 (number of blinks is less than 75% of the average value) or
75 (number of blinks is 75% or more and less than 85% of the average value) or
100 (number of blinks is 85% or more of the average value)

  Next, the second evaluation unit 3184 uses the blink strength variation data acquired from the second calculation unit 3164 to calculate a heart evaluation value indicating the evaluation result of the heart parameter. First, an example in which a cardiac evaluation value is calculated using standard deviation as variation data will be described.

The second evaluation unit 3184 calculates a cardiac evaluation value using the following procedure.
(B1) Calculate the standard deviation of the blinking intensity of the most recent predetermined time (B2) Score the heart evaluation value between 0 and 100 based on the standard deviation

  Note that the second evaluation unit 3184 scores so that the score decreases as the standard deviation increases (as the variation increases).

  The second evaluation unit 3184 may calculate a heart evaluation value using a difference between the maximum value and the minimum value of the blink strength. For example, the second evaluation unit 3184 may calculate the heart evaluation value using a function that increases the score as the difference decreases.

  The third evaluation unit 3186 calculates a posture evaluation value indicating the evaluation result of the posture parameter using the standard deviation of each data acquired from the third calculation unit 3166. For example, the third evaluation unit 3186 sets the evaluation value such that the smaller the standard deviation of each data, the higher the score.

Further, the third evaluation unit 3186 may obtain the posture evaluation value by the following procedure.
(C1) Acquire standard deviation (first standard deviation) of each data within a predetermined period in the past for calibration (C2) Acquire standard deviation (second standard deviation) of each data within a predetermined period including the present (C3) Calculate the square error between the first standard deviation and the second standard deviation. (C4) Based on the square error, the posture evaluation value is scored between 0 and 100. The above procedure is an example of calculating the posture evaluation value. It is only an indication.

≪Notification Department≫
Next, details of the graphic display of the notification unit 320 will be described. FIG. 7 is a block diagram illustrating an example of a functional configuration of the notification unit 320 in the embodiment. 7 includes a display control unit 3202, and the display control unit 3202 includes an update unit 3204 and a deformation unit 3206.

  The update unit 3204 acquires the evaluation value of each concentration parameter calculated by the evaluation unit 318, and updates each motion parameter based on each evaluation value. The update unit 3204 updates each motion parameter every time each evaluation value is acquired.

  The deforming unit 3206 deforms a predetermined graphic formed from a plurality of objects displayed on the screen based on each motion parameter updated by the updating unit 3204. Thereby, every time the evaluation value of each concentration parameter is acquired, the predetermined figure after deformation based on each updated motion parameter is displayed on the screen, so the user grasps the degree of deformation of the predetermined figure, You can intuitively grasp your concentration state.

<Data example>
Next, examples of various data used for the centralized application in the embodiment will be described. FIG. 8 is a diagram illustrating a data example of a plurality of types of biological information. In the example shown in FIG. 8, blinking presence / absence, blink strength, roll and pitch are set on the horizontal axis, and time-series data in unit time (for example, 1/20 second) is plotted on the vertical axis. Is set. Note that the acquisition unit 314 acquires these data.

  The presence or absence of blinks indicates whether or not blinks have been performed. The blink determination may be performed using a known technique. The blink strength represents the blink strength (for example, the magnitude of fluctuation of electrooculogram during blinking). Roll, pitch, and the like represent data based on sensor signals acquired from the six-axis sensor 206.

  Each data may be calculated by any of the processing device 20, the server 40, and the information processing device 10. Each data may be distributed and calculated by each device. The data illustrated in FIG. 8 is acquired by the acquisition unit 314 and then stored in the storage unit 302, for example.

  FIG. 9 is a diagram illustrating a data example of each concentration parameter. In the example shown in FIG. 9, Clear (head clarity), Calm (heart calmness), and Posture (posture stability) are set on the horizontal axis, and unit time (for example, 1/20 second) is set on the vertical axis. Time-series data at is set.

  For Clear, Calm, and Posture, for example, an evaluation value (hereinafter also referred to as an intermediate value) for each unit time (for example, 1/20 second) is stored by the above-described calculation formula. The evaluation unit 318 obtains an average value (hereinafter also referred to as a final value) by using the most recent past predetermined number of times or an intermediate value of each concentration parameter within a predetermined period. For example, this average value is an evaluation value indicating the concentration state. The data shown in FIG. 9 is stored in the storage unit 302, for example.

FIG. 10 is a diagram illustrating an example of message information in which each concentration parameter is associated with a cause that prevents concentration and a solution that increases concentration. In the example shown in FIG. 10, the evaluation value of each concentration parameter is divided into five stages by the notification unit 320 as follows.
Stage: Evaluation value 1: 80-100
2: 60-79
3: 40-59
4: 20-39
5: 0-19

  After completing the concentration state measurement, the notification unit 320 acquires a cause and a solution corresponding to each step based on the evaluation value step of each concentration parameter. For example, if the evaluation result of the head parameter, the heart parameter, and the posture parameter is 4, 4, and 5, respectively, the notification unit 320 may indicate that “the posture is not particularly good. ”And“ AP3 ”as a solution. The notification unit 320 controls to display these messages on the screen.

  Note that the notification unit 320 may control to acquire a message using the evaluation value of each concentration parameter and display the message in real time even during measurement of the concentration state. In this case, the message displayed during measurement and the message displayed after measurement may be managed in different tables. Thereby, by displaying a message in real time, it is possible to inform the user of a solution having a fast effect.

<Examples of Clear and Calm>
Next, an experiment in which the head parameter and the heart parameter are measured will be described. In this experiment, two craftsmen who need concentration to work are put on the eyewear 30, and the evaluation values of the head parameter and the cardiac parameter are calculated based on the first biological signal related to blinking. .

  FIG. 11 is a diagram illustrating an example of the head evaluation value of the head parameter (Clear) and the heart evaluation value of the heart parameter (Calm) in the case of the craftsman A. Craftsman A is an experienced craftsman with 15 years of experience. As shown in FIG. 11, it can be seen that the cardiac evaluation value gradually increases with time. This shows that craftsman A has been working hard while maintaining peace of mind based on years of experience.

  FIG. 12 is a diagram illustrating an example of the head evaluation value of the head parameter and the heart evaluation value of the heart parameter in the case of the craftsman B. Craftsman B is a 5th year apprentice craftsman. As shown in FIG. 12, it can be seen that the cardiac evaluation value increases for a while with the passage of time, but finally decreases and is not stable. This shows that craftsman B is working without being able to keep calm because of lack of experience.

  From the results shown in FIG. 11 and FIG. 12, it is possible to provide an objective index for the calmness of the heart using the blink strength that is an appropriate parameter and a criterion that considers the variation in blink strength. It can be said that it is made.

<Screen example>
Next, a screen example of the concentrated application in the embodiment will be described. The concentrated application first causes the user to select a time for measuring the concentrated state. When the selection of the measurement time is over, the concentration state measurement starts.

  FIG. 13 is a diagram illustrating an example of a concentration state measurement screen. For example, a message M10, a head evaluation value P10, a heart evaluation value P12, and a posture evaluation value P14 are displayed on the screen shown in FIG. The message M10 is displayed on the screen when the notification unit 320 acquires a message corresponding to each evaluation value from the storage unit 320.

  In addition, time-series data of concentrated evaluation values calculated from each evaluation value is displayed at the bottom of the screen shown in FIG. As a result, the user can change his / her concentration state in real time.

  FIG. 14 is a diagram illustrating an example of a measurement result screen in a concentrated state. The screen shown in FIG. 14 includes a column K20 for displaying the time when the concentration evaluation value is equal to or greater than the threshold, a deformable figure O20 expressed in the concentration state, time series data D20 of the concentration evaluation value, and the concentration state. A message M20, an evaluation value P20 of each concentration parameter, and time series data D22 of an evaluation value of a predetermined concentration parameter are displayed.

For the column K20, for example, the notification unit 320 can measure the time when the concentration evaluation value is equal to or greater than the threshold and notify the user of the measured time as the time when the concentration is high.
The predetermined figure O20 is formed and displayed from a plurality of objects (circular objects in the example shown in FIG. 14). In the example illustrated in FIG. 14, each object is an object whose shape and position arranged in a radial pattern can be changed around 40 pt indicating the concentration evaluation value.

  For example, the predetermined figure O20 is a circular figure formed from each object. Note that in the actual screen, each object performs a circular motion at a predetermined cycle, but the screen shown in FIG. 14 is a screen showing a point in time of the circular motion.

  Here, the size of each object changes. The degree of this change is determined based on the head evaluation value. For example, if the head evaluation value is high, the size of each object will be constant, and if the head evaluation value is low, the size of each object will fluctuate as it becomes smaller or larger, and the size will vary. .

  In addition, the positional relationship between the objects changes. The degree of this change is determined based on the cardiac evaluation value. For example, when each object repeats moving in a radial pattern with the central evaluation value as the center, if the heart evaluation value is high, the movement distance of each object from the center becomes short, and if the heart evaluation value is low, the object moves from the center. The moving distance of each object becomes longer.

  Each object changes its shape. The degree of this change is determined based on the posture evaluation value. For example, when each object changes alternately between a circular shape and a rectangular shape, if the posture evaluation value is high, the time that the circular object remains in the circular shape becomes long, and if the posture evaluation value is low, The speed of changing to a rectangular shape increases. The notification unit 320 controls the deformation of the predetermined figure as described above based on each evaluation value. Accordingly, the user can easily grasp the concentration state by viewing the concentration state visually expressed.

  The time series data D20 of the concentration evaluation value represents the concentration evaluation value from the measurement start to the measurement end of the concentration state in a time series in a line graph. Thus, the user can grasp the transition of the concentrated evaluation value. In addition, when the concentration evaluation value exceeds the threshold value, the notification unit 320 may change the color of the line graph so that the position can be specified.

  The message M20 displays the cause and solution to prevent concentration. Furthermore, when the arrow at the right end of the message M20 is pressed by the user, the notification unit 320 can display an application related to the solution. In the case illustrated in FIG. 14, the Walk application is displayed.

  Each evaluation value column P20 displays an average value as a measurement result for the head (head) evaluation value, the heart (heart) evaluation value, and the posture (body) evaluation value. Each of these evaluation values can be selected. In the example shown in FIG. 14, the head evaluation value is selected.

The time series data D22 of each evaluation value represents each evaluation value from the measurement start to the measurement end of the concentration state in a time series in a line graph. In the example shown in FIG. 14, the head evaluation value is selected. Thus, the user can grasp the transition of each evaluation value.
FIG. 15 is a diagram illustrating an example of a solution presentation screen. On the screen shown in FIG. 15, an application of a solution linked to the central application is displayed. For example, an application for measuring the meditation state, an application for measuring walking, and an application for training the trunk are displayed. Note that these applications can be activated by inter-application cooperation with a centralized application by using a URL scheme.

  By displaying the above screen by the notification unit 320, the user can grasp an objective index indicating the clarity of the head, the calmness of the mind, and the stability of the posture. Also, the user's own concentration state can be easily grasped by the movement of the predetermined figure.

<Operation>
Next, the operation of the information processing apparatus 10 in the embodiment will be described. FIG. 16 is a flowchart illustrating an example of overall processing of the application in the embodiment.

  In step S <b> 102 illustrated in FIG. 16, the acquisition unit 312 acquires biological information transmitted from the eyewear 30 via the communication unit 304. For example, the biological information is first biological information related to blinks and second biological information related to body movements.

  In step S104, the first calculation unit 3162 calculates the value of the head parameter from the presence or absence of blinks included in the first biological information, and the first evaluation unit 3182 calculates the head evaluation value.

  In step S106, the second calculation unit 3164 calculates the value of the heart parameter from the blink strength included in the first biological information, and the second evaluation unit 3184 calculates the heart evaluation value. Details of this processing will be described later with reference to FIG.

  In step S108, the third calculation unit 3166 calculates the value of the posture parameter from the first data indicating the pitch angle, the second data indicating the roll angle, and the third data indicating the yaw angle included in the second biological information. The third evaluation unit 3186 calculates a posture evaluation value.

  In step S110, every time evaluation values of at least two concentration parameters are acquired, the display control unit 3202 controls display on the screen of a predetermined graphic that is deformed based on a change in each evaluation value. This display control process will be described with reference to FIG.

  In step S112, the control unit 306 determines whether or not an instruction to end the application is given. If there is an end instruction (step S112—YES), the process proceeds to step S114, and if there is no end instruction (step S112—NO), the process returns to step S102.

  In step S114, the notification unit 320 controls to display the measurement result of the concentration state on the screen (see, for example, FIG. 14).

  FIG. 17 is a flowchart illustrating an example of processing for calculating the calmness of the heart. In step S202 illustrated in FIG. 17, the second calculation unit 3164 calculates variation data regarding variation in blink strength. This variation data is, for example, a standard deviation of blink intensity data within a predetermined number or a predetermined time, a difference between a maximum value and a minimum value, or the like.

  In step S204, the second evaluation unit 3184 calculates a heart evaluation value indicating the calmness of the user's heart based on the variation data. For example, the second evaluation unit 3184 gives a higher evaluation value as the variation is smaller.

  FIG. 18 is a flowchart illustrating an example of the display control process in the embodiment. In step S302 illustrated in FIG. 18, the update unit 3204 acquires the calculated evaluation value of each concentration parameter, and updates each motion parameter based on the acquired evaluation value.

  In step S304, the deformation unit 3206 determines the size, positional relationship, shape, and the like of each object based on each evaluation value updated by the update unit 3204, and controls display of each determined object. As a result, the predetermined figure is deformed (for example, O20 shown in FIG. 14).

  Each processing step included in the processing flow described with reference to FIGS. 16 to 18 can be executed in an arbitrary order or in parallel as long as the processing contents do not contradict each other. Other steps may be added in between. Further, a step described as one step for convenience can be executed by being divided into a plurality of steps, while a step described as being divided into a plurality of steps for convenience can be grasped as one step.

  As described above, according to the embodiment, an objective index can be provided for the calmness of the heart using appropriate parameters and standards. In addition, according to the embodiment, it is possible to intuitively grasp what state the user's own concentration state is.

  In the embodiment, the case where the eyewear 30 is glasses has been described. However, eyewear is not limited to this. The eyewear may be any device related to the eye, and may be a face wearing device or a head wearing device such as glasses, sunglasses, goggles and a head mounted display and their frames.

  Further, in the embodiment, it has been described that the eyewear 30 provides the biological electrode. However, as described above, the biological electrode may not be provided as long as information about blinks can be acquired using image processing. Good.

  In the embodiment, it has been described that the concentration evaluation value is displayed. However, the speaker 104 or the vibration unit (not illustrated) of the information processing apparatus 10 is calculated when the concentration evaluation value is equal to or less than a predetermined value. The user may be notified of the concentration evaluation value. Thereby, the user can know that concentration is falling.

  In the embodiment, the sensor signal from the six-axis sensor 206 mounted on the eyewear 30 is described. However, the sensor signal from the six-axis sensor 111 mounted on the information processing apparatus 10 is also used. It is possible to execute the application described in the example. That is, the 6-axis sensor may be mounted not only on the head but also on any position of the human body.

  In the embodiments, the blinking and the body movement are used as the biological information, but other biological information such as a heartbeat and a pulse may be used. Moreover, although demonstrated using Clear, Clam, and Posture as a concentration parameter, you may use another concentration state as a parameter. The embodiment can also be applied to the case where the biological information is subjected to frequency analysis and the calmness of the heart is evaluated using the variation in the strength of the biological information.

  As mentioned above, although this invention was demonstrated using the Example, the technical scope of this invention is not limited to the range as described in the said Example. It will be apparent to those skilled in the art that various modifications or improvements can be made to the above-described embodiments. It is apparent from the description of the scope of claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

10 Information processing device 20 Processing device 30 Eyewear 40 Server 302 Storage unit 304 Communication unit 306 Control unit 312 Association unit 314 Acquisition unit 316 Calculation unit 318 Evaluation unit 320 Notification unit

Claims (8)

An information processing method executed by a computer having a control unit,
The controller is
Obtain intensity data indicating blink intensity measured based on the electrooculogram of the subject's eye,
From the past predetermined number of intensity data, or from the intensity data in the past predetermined time, to calculate variation data regarding the variation of the intensity data,
An information processing method for calculating a heart evaluation value indicating calmness of the subject's heart based on the variation data.   The information processing method according to claim 1, wherein the variation data is a standard deviation of the intensity data or a difference between a maximum value and a minimum value. The computer
A storage unit that associates and stores the mental evaluation value, a posture evaluation value indicating an evaluation result for the posture of the subject, and a message related to the concentration state of the subject;
The control unit further includes:
First data indicating blurring before and after the subject based on sensor signals from an acceleration sensor and an angular velocity sensor attached to the subject, second data indicating left and right shaking of the subject, and the body of the subject Obtaining posture data representing at least one of the third data indicating the direction and magnitude of the axis inclination;
Calculate the posture evaluation value based on the posture data,
Based on the heart evaluation value and the posture evaluation value, obtain the message from the storage unit,
The information processing method according to claim 1 or 2, wherein the acquired message is notified.   The information processing method according to claim 3, wherein the message includes a cause that hinders the concentration of the subject or a solution that improves the concentration. The control unit further includes:
Obtaining the presence or absence of blinks based on the electrooculogram,
Based on the presence or absence of the blink, the average value of the blink interval is calculated,
Based on the average value, a head evaluation value indicating the clarity of the head is calculated,
Based on the mind evaluation value, the posture evaluation value, and the head evaluation value, a concentration evaluation value indicating the concentration state of the subject is calculated,
The information processing method according to claim 3, wherein data related to the concentration evaluation value that is equal to or greater than a threshold value is notified. An information processing method executed by a computer having a control unit,
The controller is
Obtain biological signals measured from the subject,
From the past biological signal, calculate variation data regarding the variation of the biological signal,
Based on the variation data, a heart evaluation value indicating calmness of the subject's heart is calculated.
An information processing method for executing processing. An acquisition unit that acquires intensity data indicating blink intensity measured based on the electrooculogram of the subject's eye;
A calculation unit that calculates variation data related to variations in the intensity data from intensity data of a predetermined number of times in the past or intensity data within a predetermined period of time in the past;
An evaluation unit that calculates a heart evaluation value indicating calmness of the subject's heart based on the variation data;
An information processing apparatus comprising: On the computer,
Obtain intensity data indicating blink intensity measured based on the electrooculogram of the subject's eye,
From variation data of a predetermined number of times in the past or intensity data within a predetermined period of time in the past, variation data relating to variations in the intensity data is calculated,
Based on the variation data, a heart evaluation value indicating calmness of the subject's heart is calculated.
A program that executes processing.