JP2012230535A - Electronic apparatus and control program for electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide means for acquiring biological information of plural users and performing various supports according to a result of determination of a situation.SOLUTION: An electronic apparatus such as a server comprises: input units of a CPU 210 and a biosensor 540 that input information on the living bodies of plural persons who perform a task; a comparison unit of a CPU 310 that compares the plural persons on the basis of the information on the living bodies; and output units of the CPU 310 and an external connection interface 213 that output information on a task different from the task on the basis of the comparison result by the comparison unit.

Description

  The present invention relates to an electronic device and a control program for the electronic device.

In recent years, it has been proposed to obtain a user's biometric information and provide various support. For example, it is detected whether the user is concentrated on music. A sound reproducing device for lowering has been proposed.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP-A-2005-34484

  However, the conventional apparatus has not paid any attention to providing various types of support according to the biological information of a plurality of users.

  The electronic device according to the first aspect of the present invention includes an input unit that inputs information related to living bodies of a plurality of persons performing a task, a comparing unit that compares a plurality of persons based on information related to the living bodies, and a comparison result by the comparing unit And an output unit that outputs information related to a task different from the task.

  The electronic device according to the second aspect of the present invention includes an input unit that inputs information related to living bodies of a plurality of persons performing a task, a comparing unit that compares a plurality of persons based on information related to the living bodies, and a comparison result by the comparing unit And an output unit for outputting information related to the change of the task method.

  An electronic device control program according to a third aspect of the present invention includes an input step of inputting information related to the living bodies of a plurality of persons performing a task, a comparing step of comparing a plurality of persons based on the information related to the living bodies, and a comparing step Based on the result of the comparison, the computer is caused to execute an output step for outputting information on a task different from the task.

  An electronic device control program according to a fourth aspect of the present invention includes an input step of inputting information related to the living bodies of a plurality of persons performing a task, a comparing step of comparing a plurality of persons based on the information related to the living bodies, and a comparing step Based on the result of the comparison, the computer is caused to execute an output step for outputting information relating to the change of the task method.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

It is a figure which shows the outline | summary of the condition determination system which concerns on this embodiment. It is a figure which shows the outline | summary of the personal computer 200 in the condition determination system which concerns on this embodiment. It is a block diagram of the situation system concerning this embodiment. It is a flowchart which shows the process of the condition determination system which concerns on this embodiment.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 is a diagram showing an overview of a situation determination system 100 according to the present embodiment. As shown in FIG. 1, the situation determination system 100 includes a plurality of personal computers (personal computers) 200 and a server 300 that is an electronic device connected to the plurality of personal computers 200 via a network 400. In the present embodiment, a plurality of users execute tasks using their personal computers 200.

  FIG. 2 is a diagram showing an outline of the personal computer 200 in the situation determination system 100 according to the present embodiment. As illustrated in FIG. 2, the personal computer 200 includes user input operation members such as a display 201, a keyboard 202, and a touch pad 203. In addition, a mouse 500 is connected to the personal computer 200, and the user can give an instruction to the personal computer 200 by operating the mouse 500.

  The personal computer 200 further includes a built-in camera 204 and an ultrasonic sensor 205. The built-in camera 204 includes a photographing lens and an image sensor. An image sensor such as a CCD sensor or a CMOS sensor is used as the image sensor. Various image processing by an image processing unit (not shown) is performed on the image signal output from the image sensor to generate image data, and the image data is output to the server 300. The built-in camera 204 is disposed on the upper part of the display 201 and has an angle of view capable of simultaneously photographing the operation members such as the keyboard 202 and the touch pad 203 together with the upper body including the user's face, hands, and arms. Instead of the built-in camera 204, for example, a camera module that can be mounted in the vicinity of the display 201 by a clip may be adopted. The ultrasonic sensor 205 is provided in the vicinity of the built-in camera 204, and executes transmission / reception of ultrasonic waves for measuring the distance from the display 201 to the user.

  The personal computer 200 further includes a speaker 206 and a microphone 207. The speaker 206 includes an ultrasonic transducer and is a directional speaker having directivity in a specific direction, and outputs sound to the user. Note that the directivity characteristics (direction, range, etc.) of the speaker 206 may be set so that the user can mainly hear the sound. The microphone 207 is a directional microphone having directivity with respect to a specific direction. For example, a super-directional dynamic microphone or a super-directional condenser microphone can be used. Note that the directivity characteristics (direction, range, etc.) of the microphone 207 may be set so that the sound generated by the user can be collected mainly.

  On the back surface of the keyboard 202, piezoelectric sensors 208 are provided corresponding to the individual keys. The piezoelectric sensor 208 includes a piezo element, and electrically detects vibration by converting an externally applied force into a voltage by a piezoelectric effect. Accordingly, the piezoelectric sensor 208 can detect the strength with which the user strikes the key and the repeated operation.

  A floor sensor 510 is provided at the user's foot. The floor sensor 510 is configured by a piezo element or the like, similar to the piezoelectric sensor 208, and detects the motion of the foot such as the user's stepping or poor sliding. The floor sensor 510 is connected to the personal computer 200 and transmits the detected signal to the personal computer 200.

  A ceiling camera 520 and a ceiling microphone 530 are provided in the ceiling near the user's head. The ceiling camera 520 includes a photographic lens and an image sensor, and is adjusted to an angle of view capable of photographing the user's head. In addition, the ceiling camera 520 may be adjusted to an angle of view that can capture the heads of a plurality of users. Various image processing by an image processing unit (not shown) is performed on the image signal output from the image sensor of the ceiling camera 520 to create image data, and this image data is transmitted to the personal computer 200 by, for example, a wireless LAN. On the other hand, the personal computer 200 transmits control signals such as a start of photographing and a request for photographed image data to the ceiling camera 520.

  The ceiling microphone 530 is an omnidirectional microphone and detects at least sounds around the user. The ceiling microphone 530 may detect sounds around a plurality of users. The ceiling microphone 530 transmits the detected sound signal to the personal computer 200 by, for example, a wireless LAN. On the other hand, the personal computer 200 transmits a sound detection start and end control signal to the ceiling microphone 530.

  The biometric sensor 540 is a sensor that detects biometric information of the user. For example, the biometric sensor 540 emits irradiation light toward the living body with an LED, and detects the pulse by receiving light reflected from the living body with respect to the irradiation light. Including a pulse sensor. The configuration is disclosed in, for example, Japanese Patent Laid-Open No. 2005-270543 (US Pat. No. 7,538,890). In addition to the pulse sensor, the biological sensor 540 can also detect a user's sweating amount by providing a sweating sensor provided with a plurality of electrodes. Furthermore, the biosensor 540 can be provided with a temperature sensor that measures body temperature and a blood pressure sensor that measures blood pressure. The biological sensor 540 senses the user's biological information and transmits the output to the personal computer 200.

  The biosensor 540 is mounted, for example, wrapped around the user's arm. In addition, the biological sensor 540 is not limited to a wristwatch type that is wound around the user's arm, and various forms can be adopted as long as the biological sensor 540 comes into contact with a part of the body such as a user's hand or a finger (ring type biological sensor). In addition, when detecting a body temperature etc. using an infrared sensor, when detecting a user's emotion from the facial expression of the user imaged by the built-in camera 204, or from the amount of movement of the user's head imaged by the ceiling camera 520 When detecting the degree of concentration of the user, it is also possible to detect the user's biological information in a non-contact manner.

  FIG. 3 is a block diagram of the situation determination system according to the present embodiment. In FIG. 3, one of the plurality of personal computers 200 is shown as a representative. As shown in the figure, the personal computer 200 includes elements such as a display 201 and a keyboard 202 described with reference to FIG. 2 with a personal computer CPU 210 that performs overall control as a center.

  The timer 211 has a time measuring function, starts time measurement in response to a start instruction from the personal computer CPU 210, and returns a time measurement result to the personal computer CPU 210 in response to an end instruction.

  The ROM 212 is a non-volatile memory such as a flash memory, for example, and plays a role of storing a program for controlling the personal computer 200, various parameters, and the like.

  The external connection interface 213 is an interface for connecting to an external device. As the interface, various connection standards such as wireless / wired LAN, USB, HDMI, Bluetooth (registered trademark), and the like can be adopted. The external connection interface 213 enables communication with an electronic device such as the server 300 via the network 400. The external connection interface 213 complies with a communication protocol such as the Internet protocol.

  The server 300 is centered on a server CPU 310 that performs overall control, and includes a ROM 312, a recording device 313, an audio analysis unit 314, an image analysis unit 315, a schedule creation unit 316, and an external connection interface 317.

  The ROM 312 is a non-volatile memory such as a flash memory, and plays a role of storing a program for controlling the server 300, various parameters, and the like.

  The recording device 313 is, for example, a hard disk drive, and performs recording related to a plurality of users. The recording device 313 records, for example, the contents of tasks performed by a plurality of users, biometric information for each of the plurality of users when performing the tasks, and the like.

  The voice analysis unit 314 acquires voices taken from the microphone 207 and the ceiling microphone 530 from the plurality of personal computers 200 and analyzes the acquired voices. The voice analysis unit 314 analyzes the voice generated by the user collected by each microphone 207, for example. Also, the voice analysis unit 314 analyzes noise around the user collected by the ceiling microphone 530, for example.

  Furthermore, the voice analysis unit 314 detects the conversation speed (speech speed), the loudness of the voice, the conversation time, and the like of the conversation with a colleague in the vicinity. The speech rate is detected as, for example, the number of output phonemes per unit time or the number of mora per unit time. A mora is a segmental unit of sound with a certain length of time. The voice analysis unit 314 can convert the identified voice into text data and transmit the converted data to the personal computer 200. The personal computer 200 can display text on the display 201 based on the received conversion data.

  The image analysis unit 315 acquires captured image data captured by the built-in camera 204 and captured image data captured by the ceiling camera 520 from the plurality of personal computers 200, and analyzes the acquired captured image data. The image analysis unit 315 performs user face recognition and facial expression recognition. For example, the image analysis unit 315 detects a facial expression with a wrinkle between eyebrows and a facial expression with narrowed eyes instead of a smile from the face area of the user in the image data. In addition, the image analysis unit 315 acquires the timing information of each timer 211 and detects, for example, how long a facial expression with a eyelid between the eyebrows continues. In addition, when detecting a facial expression with a narrowed eye, the image analysis unit 315 reads information about the average eye size on the image by the built-in camera 204 from the recording device 313 and is actually photographed. Detect by comparing with eye size. The eyelid between eyebrows may be detected by storing an image with eyelids between the eyebrows in the recording device 313 as a reference image and detecting it by pattern matching, or by detecting from the shadow distribution of the portion between the left eye and the right eye. Also good. In addition, the detection of the eyelid between eyebrows is also disclosed in, for example, US Patent Publication No. 2008-292148.

  The size of the image captured by the built-in camera 204 depends on the distance between the built-in camera 204 and the user. In the present embodiment, the image analysis unit 315 acquires information of the ultrasonic sensors 205 from the respective personal computers 200, detects the distance between the built-in camera 204 and the user based on the information of the ultrasonic sensors 205, and determines the size of the image. The distance dependence is eliminated by correcting the height. The distance measurement is not limited to the case where the ultrasonic sensor 205 is provided. For example, a laser distance sensor, an infrared sensor, or the like may be used. In addition, when the size of the specific part of the user (for example, the size of the face) is known, the image analysis unit 315 matches the built-in camera 204 and the user's size by matching the size of the known face with the size of the captured face. The distance can be calculated.

  Further, the image analysis unit 315 captures the image data of the ceiling camera 520 and detects the position of the user's head, the amount of movement, and the like. For example, if the image analysis unit 315 detects that the user's head constantly shakes, the server CPU 310 can determine whether the user is distracting, falling asleep, or the like. Note that the ceiling camera 520 may be omitted if the position and movement amount of the user's head can be detected by the ultrasonic sensor 205 or the like. Conversely, if the distance between the built-in camera 204 and the user can be detected by the ceiling camera 520, the ultrasonic sensor 205 may be omitted.

  Further, the image analysis unit 315 detects the user's gesture using the captured image. For example, the image analysis unit 315 performs pattern matching between a captured image and a reference image such as a gesture in which a hand is placed on the forehead or a gesture in which arms are folded, and detects a user's gesture.

  The schedule creation unit 316 accepts input for each user from the plurality of personal computers 200 and creates a schedule of tasks to be performed by each user. The schedule creation unit 316 creates a schedule of tasks to be performed by the user using each user's input received with the keyboard 202, the touch pad 203, the mouse 500, and the like. In addition, the schedule creation unit 316 may create a schedule using an analysis result obtained by analyzing the voice related to the user's schedule input from the microphone 207 by the voice analysis unit 314. The created schedule information is stored in the recording device 313.

  The external connection interface 317 is connected to the external connection interface 213 of the personal computer 200 via the network 400, and enables communication between the server 300 and the personal computer 200. The external connection interface 317 is compliant with a communication protocol such as the Internet protocol. The external connection interface 317 may be an interface for connecting to other external devices.

  In the present embodiment, the server 300 executes the voice analysis function and the image analysis function, but each of the plurality of personal computers 200 has at least a part of the voice analysis function or at least a part of the image analysis function. The analysis result may be transmitted to the server 300.

  FIG. 4 is a flowchart showing processing of the situation determination system according to the present embodiment. In this flowchart, the server CPU 310 executes a situation determination process for a plurality of users and a process according to the determination result. In this flowchart, it is assumed that a plurality of users operate a plurality of personal computers 200 to execute tasks. The server CPU 310 is used when a connection with at least one of the plurality of personal computers 200 is established, or when a user input received by the keyboard 202, the touch pad 203, the mouse 500, or the like is obtained after the connection with the personal computer 200 is established. The process of the flowchart is started.

  The server CPU 310 determines the content of the task being performed by each user (step S101). For example, the server CPU 310 refers to schedule information recorded in the recording device 313 to determine the content of the task performed by each user. In addition, the server CPU 310 acquires information input by each user from the personal computer 200 using the keyboard 202, the touch pad 203, the mouse 500, and the like, and determines the content of the task performed by each user using the acquired information. May be.

  Next, the server CPU 310 inputs information related to the living body of each user (step S102). Specifically, the server CPU 310 detects biological information such as the pulse, body temperature, and sweating of each user detected by the biometric sensor 540, the strength of tapping each user's keyboard 202 detected by the piezoelectric sensor 208, the speed at which the keyboard 202 is tapped, Information such as a user's poor shaking, each user's utterance speed, each user's utterance amount, each user's monologue, each user's sigh is input as information about the living body. As described above, the information related to the living body is not limited to the information acquired from the biological sensor 540, but can be acquired from the built-in camera 204, the microphone 207, the piezoelectric sensor 208, the ceiling camera 520, and the like. Even if it is a biometric sensor, the detection result is input to the server CPU 310. Further, the server CPU 310 does not need to input information on all of these living bodies, and may input information on living bodies that can determine the status of each user. In the present embodiment, the server CPU 310 functions as an input unit that inputs information related to a plurality of users' living bodies.

  Then, the server CPU 310 determines the status of each user (step S103). For example, the server CPU 310 measures the number of times each user speaks to himself or sighs and determines the situation of each user. The server CPU 310 detects monologues and sighs using the analysis result of the voice analysis unit 314, and measures the number of monologues and the number of sighs. Further, the server CPU 310 may detect the facial expression of each user, the movement of the mouth, and the like using the analysis result of the image analysis unit 315, and measure the number of self-talks and the number of sighs.

  For example, the server CPU 310 uses each timer 211 to measure the frequency of each user's monologue and sigh (the number of monologues and sighs per unit time). It is determined that the motivation of is down. In addition, the server CPU 310 uses the analysis result of the voice analysis unit 314, for example, to say negative utterances such as “Ah” or “I do n’t like it”, or positive singing such as “Let's do my best” or “Good”. To identify. Then, when the server CPU 310 determines that a certain user is speaking negatively, the server CPU 310 determines that the user's motivation is decreasing, and when determining that a certain user is speaking positively speaking, It is determined that the user is motivated. Further, the server CPU 310 records a monologue log, which is a log of the number of negative monologues and the number of sighs, in the recording device 313 for each user, and the number of negative monologues and the number of sighs recorded in the monologue log of a certain user. Can be determined that the user's motivation is decreasing. Here, when motivation is increasing, monoamine neurotransmitters such as adrenaline and serotonin are secreted and blood pressure and heart rate tend to increase. If the blood pressure or heart rate of the user is not increasing and the number of negative self-speaks or sighs of the user is increasing, it may be determined that the user's motivation is decreasing. Note that the server CPU 310 manages the degree of motivation by numerical values or levels so that the degree of motivation of a plurality of users can be compared.

  The server CPU 310 determines the degree of concentration of each user as the situation of each user using the information regarding the living body acquired in step S102. Generally, when a person is concentrated, the pulse rate and body temperature rise. Also, when doing a rush task (ie, when the concentration level is high), the strength of hitting the keyboard 202 is increased, the speed of hitting the keyboard 202 is increased, or poor shaking is performed. There is also. In addition, the head hardly moves when concentrating, whereas when it is not concentrating, the head moves more by looking away or depending on the situation. Therefore, the server CPU 310 compares the biometric information log, which is a log of the biometric information of each user continuously recorded in the recording device 313, with the information related to the biometric information of each user input in step S102. Determine the degree of concentration. In this case, the server CPU 310 may detect the degree of concentration of each user by comparing the information regarding the living body when each user has concentrated in the past with the information regarding the living body of each user input in step S102. If the pulse and the amount of force of hitting the keyboard 202 are increased by 10% or more than the normal state of a certain user, it may be determined that the user is concentrated. It should be noted that the poverty shaking may be performed when concentrated or when not concentrated. In such a case, the server CPU 310 may determine whether or not the user is a type that performs poor shaking when concentrating from information related to another living body for each user, and may be used for determining the degree of concentration thereafter. Note that the server CPU 310 manages the degree of concentration by a numerical value or a level in order to make it possible to compare the concentrations of a plurality of users.

  The server CPU 310 creates a task log by associating the task name that is the name of the task, the task content that is the task content, and the above-described biometric information log, and records the created task log in the recording device 313 (step S104). ). In addition, the server CPU 310 adds a task difficulty level (high, medium, low) to the task log, a task content category (creative business, office work, etc.), or when a task is performed by a plurality of people. A user relationship that is an interpersonal relationship of a plurality of people may be added.

  The server CPU 310 compares the situations of a plurality of users (step S105). For example, the server CPU 310 compares the degrees of motivation of a plurality of users or compares the degrees of concentration of a plurality of users. In the present embodiment, the server CPU 310 functions as a comparison unit that compares a plurality of users based on information related to a living body.

  Then, the server CPU 310 extracts a target user from a plurality of users based on the comparison result in step S105 (step S106). For example, the server CPU 310 extracts a user having the lowest motivation or the user having the lowest concentration among a plurality of users. In this case, when there are a plurality of users having the lowest degree of motivation, or when there are a plurality of users having the lowest concentration, the server CPU 310 refers to the task logs of the corresponding users and performs the motivation. You may extract the user whom the low situation or the situation where concentration is low lasts the longest. Further, the server CPU 310 may extract a predetermined number of users having a relatively low degree of motivation or a relatively low degree of concentration among a plurality of users. Further, the server CPU 310 may determine that there is no target user when the degree of motivation or concentration of the extracted target user is equal to or greater than a threshold value, and may return to step S101. In the present embodiment, the server CPU 310 functions as an extraction unit that extracts people with a relatively low degree of concentration based on the comparison result.

  When the target user is extracted in step S <b> 106, the server CPU 310 may transmit a control signal for popping up an unread office contact mail for the target user on the display 201 to the target user's personal computer 200. In addition, when the target user is extracted in step S106, the server CPU 310 transmits a notification that the target user is in a state where it can accept office communication, chores, etc., to the personal computer 200 of the target user's administrator. Also good.

  The server CPU 310 determines whether or not to change the environment of the target user (step S107). Specifically, the server CPU 310 determines that the environment change is necessary if the volume of the sound collected by the microphone 207 or the ceiling microphone 530 is 5 dB or more than usual, and the environment change is unnecessary if it is less than 5 dB. The server CPU 310 may set a threshold according to the time zone such as 55 dB during the day and 50 dB during the night, and may determine that the environment needs to be changed when this threshold is exceeded. A threshold value may be set for each user.

  When the server CPU 310 determines in step S107 that the environment of the target user is to be changed, the server CPU 310 executes environment control processing (step S108). The server CPU 310 reverses the phase of the sound input from the ceiling microphone 530 using an inverting amplifier, and outputs the inverted sound from the speaker 206 of the target user's personal computer 200 to the target user. In this case, since the position where the ceiling microphone 530 is provided is different from the position of the target user's ear, noise / noise cannot be completely removed, but noise / noise can be reduced. In this case, the ceiling microphone 530 and the speaker 206 function as a reduction device that detects and reduces sound (noise / noise) around the target user, and the server CPU 310 functions as an environment control unit that controls the user's environment. Further, the server CPU 310 may transmit a control signal for outputting a sound obtained by inverting the phase of noise of a copier or printer from a speaker installed in the vicinity of the copier or printer to the speaker via a wireless LAN. Good. In this case, a speaker and a ceiling microphone 530 installed in the vicinity of a copier, a printer, or the like function as a reduction device that detects and reduces sounds around the user (noise / noise). It functions as an environment control unit that controls the environment. Furthermore, when the server CPU 310 determines that the voice of another user is a noise for the target user, the server CPU 310 generates a control signal for causing the display 201 to display a caution sentence such as “be quiet”. You may make it transmit to. Note that noise or noise may be reduced with respect to the sound input from the microphone 207 instead of the ceiling microphone 530.

  Then, the server CPU 310 performs a process for changing the mood of the target user. Specifically, first, the personal computer CPU 210 of the target user's personal computer 200 receives the target user's family acquired from the target user's favorite music acquired from the external device or the like via the external connection interface 213, the microphone 207, or the like. Information related to the sound selected by the user, such as a lover's voice, is registered in the ROM 212. Then, the server CPU 310 transmits a control signal for outputting the sound registered in the ROM 212 of the target user's personal computer 200 from the speaker 206 to the target user's personal computer 200. The information related to the sound selected by the user may include not only the information of the user's favorite music, the voice of the user's family or lover, but also the output condition information such as the output volume, output sound pressure, and output time. Good. In the present embodiment, the server CPU 310 functions as an environment control unit that controls the user's environment.

  The server CPU 310 confirms a situation related to the directivity of the speaker 206 of the target user's personal computer 200, and sends a control signal for controlling at least one of the output sound pressure and the output volume of the speaker 206 according to the confirmed situation. Send to PC 200. For example, when the server CPU 310 detects a person other than the target user in the direction of directivity of the speaker 206 using the analysis result of the image analysis unit 315, the server CPU 310 sets at least one of the output sound pressure and the output volume of the speaker 206. A control signal to be changed is transmitted to the personal computer 200 of the target user. In this case, the server CPU 310 transmits a control signal for setting at least one of the output sound pressure and the output volume of the speaker 206 to be lower than the set value when a person other than the user is not detected. Anyway. Instead, the server CPU 310 detects the position of a person other than the target user based on the analysis result of the image analysis unit 315, and determines the position other than the target user from among a plurality (two in the present embodiment) of the speakers 206. May select the speaker 206 having directivity that does not reach the sound. Further, the server CPU 310 may transmit a control signal for limiting the time for playing music to, for example, 5 minutes, or for limiting the time zone for playing music to the personal computer 200 of the target user. Further, the server CPU 310 may transmit a control signal for pop-up displaying a long-term target, a user's favorite word, and the like on the display 201 to the personal computer 200 of the target user. When the environment change process is completed, the server CPU 310 returns to step S101.

  On the other hand, if the server CPU 310 determines that the environment of the target user is not changed in step S107, or if there is no improvement in the degree of concentration or motivation despite the above-described noise / noise reduction, the schedule is created. A new schedule for the target user is created using the unit 316 (step S109). Specifically, the server CPU 310 determines a task that is different from the task performed by the target user using the information related to the target user's living body, the status of the target user, and the task log of the target user, and changes the task order. A simple schedule.

  First, the server CPU 310 confirms the first task currently performed from the schedule information of the target user, and extracts the same type of task as the first task from the tasks performed in the past. Next, the server CPU 310 compares information regarding the target user's living body or the status of the target user when the extracted task is performed. Then, the server CPU 310 is a task to be performed in the future included in the schedule information, such as a task performed in a situation where motivation has been raised in the past, a task performed in a situation where the degree of concentration is a threshold value or more, or a routine task Detect if there is a task of the same type as a task that has been done a lot. Further, the server CPU 310 confirms a time zone in which the concentration level of the target user is high and a time zone in which the concentration level is low from the task log of the target user. The same type of tasks includes not only completely identical tasks but also tasks belonging to the same category when the tasks are classified into a plurality of categories.

  The server CPU 310 uses the task log of the target user to check whether the status of the target user is not preferable for performing the first task that is currently being performed, and confirms a change in the order of tasks in the past. Then, the server CPU 310 uses the target user's task log and schedule information, and the target user is better than the first task among the tasks to be performed in the future, or the second less difficult than the first task. Create a schedule to do the task first. Further, the server CPU 310 may create a schedule for performing the second task, which has been performed many times like a routine task, among tasks to be performed in the future. Note that the server CPU 310 may create a schedule for performing creative work if the target user seems bored with the routine task. Further, the server CPU 310 creates a schedule for performing the first task during a time period when the concentration degree of the target user is high.

  In addition, the server CPU 310 extracts, for example, a task whose degree of concentration is equal to or higher than a threshold among tasks performed by the target user in the past, and is the same as the task extracted from tasks to be performed in the future included in the target user's schedule information Determine a second task of the type. The same type of tasks includes not only completely identical tasks but also tasks belonging to the same category when the tasks are classified into a plurality of categories. When there are a plurality of tasks of the same type as the extracted tasks among tasks to be performed in the future, the server CPU 310 is set to a task with a high priority among these tasks, for example, the earliest time zone The task is determined as the second task.

  The server CPU 310 determines the second task according to the change of the target user situation with respect to a plurality of past tasks belonging to the same type. Specifically, first, the server CPU 310 confirms the history of a plurality of tasks belonging to each type recorded in the task log of the target user. When there is a type in which the concentration level at the previous task is higher than the concentration level at the previous task, the server CPU 310 performs the same type of task at a higher concentration level than the previous time. From among tasks to be performed in the future, a task belonging to the type is determined as the second task. However, if the concentration at the previous task is less than the threshold, the server CPU 310 excludes the type from the candidates.

  The server CPU 310 confirms the time zone with high task concentration and the time zone with low concentration from the task log of the target user, and changes the first task to a time zone with high task concentration. Then, the server CPU 310 creates a new schedule with the task order changed.

  The server CPU 310 transmits the schedule information created in step S109 to the target user's personal computer 200 via the external connection interface 317 (step S110). In the present embodiment, the server CPU 310 and the external connection interface 317 function as an output unit that outputs information regarding different tasks. In the present embodiment, the server CPU 310 and the external connection interface 317 function as an output unit that outputs information related to time change for performing a task, which is one of information related to change in task method.

  The personal computer CPU 210 of the personal computer 200 of the target user who acquired the schedule information from the server 300 presents the acquired schedule to the target user and inquires of the target user whether or not to change the task order. The personal computer CPU 210 outputs a sound from the speaker 206 to alert the target user, displays information on the second task to be performed instead of the first task currently being performed on the display 201, and also displays the first task. Displays the date and time when

  Then, the personal computer CPU 210 of the target user's personal computer 200 agrees to change the task order when the target user's input to agree to change the task order is received by the keyboard 202, the touch pad 203, the mouse 500, or the like. Is transmitted to the server 300 via the external connection interface 213. In addition, the personal computer CPU 210 of the target user's personal computer 200 receives information indicating that the target user agrees to change the order of the tasks when the microphone 207 accepts a voice that agrees with “Yes”, “OK”, or the like. Is transmitted to the server 300 via the external connection interface 213.

  The server CPU 310 determines whether or not information indicating consent to the task order change has been acquired (step S111). When the server CPU 310 obtains the information indicating that the task order change is agreed, the server CPU 310 changes the schedule information of the target user stored in the recording device 313 (step S112), and ends this flowchart. On the other hand, if the server CPU 310 has not acquired information indicating that the order of tasks is to be agreed, the process of the flowchart ends. In the above description, the order of performing a plurality of tasks to be performed by one target user has been changed. However, when there are a plurality of target users extracted in step S106, the server CPU 310 determines that a plurality of target users. The task to be performed may be replaced (for example, the target user A performs the first task of the target user B and the target user B performs the first task of the target user A). Further, the server CPU 310 may create a schedule in step S109 so that a part of the business of the target user extracted in step S106 is allocated to the motivated user. When exchanging tasks among a plurality of persons, the server CPU 310 inquires of a user whose load is relatively increased whether to accept the schedule change, and if accepted, the server CPU 310 schedules the user whose load is relatively decreased. Just contact the change.

  In the processing flow described above, the server CPU 310 transmits schedule information in which the task order is changed to the target user's personal computer 200, but the target user's task order is transmitted to the target user's administrator's personal computer 200. The changed schedule information may be transmitted. When the server CPU 310 acquires information indicating that the order of tasks is agreed to from the personal computer 200 of the target user's administrator, the server CPU 310 transmits schedule information whose task order has been changed to the personal computer 200 of the target user. In addition, by providing the management personal computer 200 with the voice analysis unit 314, the image analysis unit 315, and the schedule creation unit 316, the situation determination system 100 in which the server 300 is omitted can be configured.

  Moreover, although the above-described processing flow has been described assuming a business scene in the office, the scope of application of the situation determination system 100 is not limited to this. For example, the situation determination system 100 can be applied to work from home, or can be applied to change the schedule of learning subjects of a plurality of students / examination students.

  Further, the situation determination system 100 can be applied to a task change of a plurality of workers who work on a factory line. Specifically, first, the server CPU 310 acquires information about the living body of each worker wearing the biological sensor 540. Next, the server CPU 310 extracts the worker with the lowest motivation level or the worker with the lowest concentration level, and a task that is different from the first task currently performed by the worker, for example, a task performed in a line, Creates a schedule for performing unrelated work first and then performing the first task. Then, the server CPU 310 notifies the worker of a task different from the first task through a display, a speaker, etc. of the workplace, and performs the first task for the worker of the substitute worker. The display, speaker, etc. In this case, the server CPU 310 notifies the operator of information regarding the time for which the worker performs the first task again with a display, a speaker or the like of the workplace. Note that the server CPU 310 may alert a worker whose concentration degree is lowered instead of the worker change by using a directional speaker to prevent an accident.

  Further, when the server CPU 310 extracts the worker with the lowest motivation level or the worker with the lowest concentration level, the server CPU 310 performs the task or the concentration level in the past line that the worker has performed in a highly motivated situation. It is also possible to determine a task in a past line performed in a high situation and different from the first task currently performed by the worker as the second task. Then, the server CPU 310 notifies the worker of the second task with the display, the speaker, or the like so as to perform the second task, and performs the first task for the worker who is currently performing the second task. Notifications are given on the workplace display and speakers. In this case, if the worker who is currently performing the second task has performed the first task in a highly motivated situation or has performed in a highly concentrated situation, the server CPU 310 Announce the change.

  It may be determined whether or not to change the workplace layout after step S112 of the flowchart of FIG. Specifically, as described above, the server CPU 310 confirms the user relationship that is an interpersonal relationship when a task is performed by a plurality of people, the concentration level of the entire workplace, and the transition of motivation from the task log, and needs to change the layout. Determine no.

  Then, the server CPU 310 determines that the layout needs to be changed when the concentration and motivation of the entire workplace are declining, or when the business output is declining, and acquires the current layout information from the recording device 313. . The server CPU 310 receives the current layout information from the personal computers 200 of a plurality of users or a plurality of users' managers in advance and records it in the recording device 313. Further, the server CPU 310 may create current layout information in advance using an analysis result of a captured image of the ceiling camera 520 and record the information in the recording device 313.

  Then, the server CPU 310 refers to the current layout information and task log, and determines the placement locations of a plurality of users. For example, the server CPU 310 arranges a user who is highly concentrated even if the ambient noise level is high, in the vicinity of a copier, a printer, or the like, or a place where noise is likely to occur, such as an entrance / exit of an office. On the other hand, the server CPU 310 places a user having a high degree of concentration when the ambient noise level is low but a low concentration level when the noise level is high, away from a place where noise is likely to occur. Further, the server CPU 310 arranges a user who frequently performs a task in cooperation with a specific user near the specific user. Further, the server CPU 310 arranges a user who frequently consults a specific user about a task near the specific user. The server CPU 310 changes the current layout and creates a new layout after determining the arrangement locations of a plurality of users. Needless to say, this layout change includes an arrangement change of a copier, a printer, or the like.

  Although the above-described processing has been described assuming a business scene in the office, the scope of application of the situation determination system 100 is not limited to this. For example, the situation determination system 100 can be applied to a layout change when a plurality of students / examinees learn in a classroom and a layout change when a plurality of workers work on a factory line.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

100 situation determination system, 200 personal computer, 201 display, 202 keyboard, 203 touchpad, 204 built-in camera, 205 ultrasonic sensor, 206 speaker, 207 microphone, 208 piezoelectric sensor, 210 personal computer CPU, 211 timer, 212 ROM, 213 external connection Interface, 300 server, 310 server CPU, 312 ROM, 313 recording device, 314 audio analysis unit, 315 image analysis unit, 316 schedule creation unit, 317 external connection interface, 400 network, 500 mouse, 510 floor sensor, 520 ceiling camera, 530 Ceiling microphone, 540 Biosensor

Claims (14)

An input unit for inputting information on living bodies of a plurality of persons performing a task;
A comparison unit for comparing the plurality of persons based on information on the living body;
An electronic apparatus comprising: an output unit that outputs information on a task different from the task based on a comparison result by the comparison unit. A schedule creation unit for creating schedule information of the plurality of people;
The electronic device according to claim 1, wherein the output unit outputs information on the different tasks based on the schedule information created by the schedule creation unit.   The electronic device according to claim 1, wherein the output unit outputs schedule information for performing the task and the different task.   The electronic device according to claim 1, wherein the output unit outputs information on the different task to at least one of the plurality of people.   The electronic device according to claim 1, wherein the output unit outputs information regarding the different tasks to a person different from the plurality of persons. An input unit for inputting information on living bodies of a plurality of persons performing a task;
A comparison unit for comparing the plurality of persons based on information on the living body;
An electronic device comprising: an output unit that outputs information related to a change in the task method based on a comparison result by the comparison unit.   The electronic device according to claim 6, wherein the output unit outputs information related to a change in layout of the space where the plurality of persons are present.   The electronic device according to claim 6, wherein the output unit outputs information regarding a time change for performing the task.   The electronic device according to claim 6, wherein the output unit outputs information regarding the change to a person different from the plurality of persons.   The electronic device according to claim 1, further comprising an environment control unit that controls an environment of at least one of the plurality of persons.   The electronic device according to claim 1, wherein the comparison unit compares the degree of concentration of the plurality of people based on information on the living body.   The electronic device according to claim 11, further comprising an extraction unit that extracts a person with a relatively low concentration level based on a comparison result of the comparison unit. An input step for inputting information on living bodies of a plurality of persons performing a task;
A comparison step of comparing the plurality of persons based on information on the living body;
An electronic device control program that causes a computer to execute an output step of outputting information related to a task different from the task based on a comparison result of the comparison step. An input step for inputting information on living bodies of a plurality of persons performing a task;
A comparison step of comparing the plurality of persons based on information on the living body;
An electronic device control program that causes a computer to execute an output step of outputting information relating to a change in the task manner based on a comparison result of the comparison step.

Images