JP2023153646A - Information processing device, control method therefor, and program - Google Patents

Abstract

To enable the work efficiency of an operator in work of a plurality of tasks to be improved by proposing the plurality of tasks in an order corresponding to operator's state change or the like when the operator operates the plurality of tasks.SOLUTION: An information processing device 130 for acquiring a plurality of tasks to be operated by an operator and selecting a task to be operated by the operator from the plurality of tasks to be acquired has living body acquisition means 313 for acquiring biological information of the operator which can specify an awaking degree of the operator for operating the plurality of tasks. The information processing device 130 acquires the biological information of the operator which can specify an awaking degree of the operator from the living body acquisition means 310 each time a task to be operated by the operator is selected from the plurality of tasks, uses the biological information of the operator that can specify the awaking degree of the operator acquired by the living body acquisition means 310, and selects the next task to be operated by the operator from the plurality of acquired tasks.SELECTED DRAWING: Figure 8

Description

The present invention relates to an information processing device, a control method thereof, and a program.

In recent years, it has become possible to highly accurately and continuously acquire biological information such as heartbeat and brain waves using inexpensive wearable terminals. In addition, wearable devices are becoming lighter and more sophisticated in design, and their use is increasing not only in specific fields but also in daily desk work and private time.

As an information processing device that utilizes wearable terminals, a system has been developed that estimates the condition of a worker and assigns tasks to the worker based on the estimation results. For example, Patent Document 1 discloses a technology that records time-series biometric information of a worker, estimates the worker's current physical and mental state based on the record, and allocates work based on this state. By utilizing such a system, it is expected that the work efficiency of workers will be improved.

International Publication No. 2020/183570

However, in the prior art disclosed in the above-mentioned patent documents, the order of tasks is determined depending only on the mental and physical state at the time of the decision. In this case, the workers must perform the work in the order determined at the time of determination. On the other hand, the worker's condition, including his/her mental and physical condition, changes during the work. The mental and physical state of a worker increases or decreases, for example, each time he or she completes one task. With a predetermined work order of tasks, it is difficult to suggest tasks in an appropriate order in response to such changes in the worker's status during work.

In this way, even when a worker is working on multiple tasks, the information processing device proposes multiple tasks in an order that corresponds to changes in the worker's status during a series of tasks, and allows the worker to work on multiple tasks. There is a need to improve the work efficiency of workers.

The information processing device according to the present invention includes: a task acquisition unit capable of acquiring a plurality of tasks to be performed by a worker; and a selection unit that selects a task to be performed by the worker from the plurality of tasks acquired by the task acquisition unit. , a biometric acquisition means for acquiring biometric information of a worker capable of identifying the alertness level of a worker working on a plurality of tasks, and the selection means selects a task to be performed by the worker from the plurality of tasks. At each time, biometric information of the worker that can identify the worker's alertness level is obtained from the biometric acquisition means, and using the worker's biometric information that can identify the worker's alertness level acquired by the biometric acquisition unit, A task to be performed by the worker next is selected from among the plurality of tasks obtained by the task obtaining means.

In the present invention, when a worker is working on multiple tasks, the multiple tasks are proposed in an order that corresponds to changes in the worker's status during a series of tasks, and the worker's work on the multiple tasks is improved. It is expected that efficiency can be improved.

1 is a configuration diagram of a head-mounted information processing system according to a first embodiment of the present invention. FIG. 2 is an explanatory diagram showing the hardware configuration of the information processing device in FIG. 1. FIG. 2 is an explanatory diagram of various functional modules implemented in the head-mounted information processing system of FIG. 1. FIG. 12 is a flowchart of control for storing information on the appropriate range of biometric values and the transition tendency of biometric values that correspond to the type of task, based on the biometric information of the worker that can specify the worker's alertness level obtained during work. 5 is an explanatory diagram of an example of the types of a plurality of tasks related to the process of FIG. 4. FIG. FIG. 2 is an explanatory diagram of time-series information of brain waves and the number of blinks, which are biological information while working on one task. An explanatory diagram of an example of appropriate brain waves as an appropriate range of biological values of a specific worker and brain wave transition trends as transition trends of biological values, which are associated with the plurality of task types in FIG. 5 through the process of FIG. 4. It is. 2 is a flowchart of task recommendation control by the head-mounted information processing system of FIG. 1. FIG. 9 is an explanatory diagram of an example of a plurality of tasks related to the process of FIG. 8. FIG. 10 is an explanatory diagram of an example of a plurality of tasks obtained from FIG. 9, and appropriate brain waves and brain wave transition trends that are associated with each task based on each type. FIG. FIG. 6 is an explanatory diagram of a specific example of selection processing from a plurality of tasks. FIG. 3 is an explanatory diagram of an example of a transparent screen displayed on a head-mounted terminal. FIG. 7 is an explanatory diagram of various functional modules implemented in a head-mounted information processing system according to a second embodiment of the present invention. This is an explanatory diagram of a plurality of task types stored in advance in the memory by the alertness information acquisition unit in this embodiment, and an example of appropriate brain waves and brain wave transition trends that are associated in advance with each task type. be. FIG. 2 is an explanatory diagram of an example of a plurality of housework tasks performed by a worker.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the embodiments below are merely examples, and the scope of the present invention is not limited by the configurations described in the embodiments.

[First embodiment]
FIG. 1 is a configuration diagram of a head-mounted information processing system 100 according to a first embodiment of the present invention. The head-mounted information processing system 100 in FIG. 1 includes a head-mounted terminal (HMD) 120 and an information processing device 130 that can communicate with the head-mounted terminal (HMD) 120. In this embodiment, a case will be explained in which a worker 110 working at a certain software production company wants to work on a plurality of certain tasks. Here, the head-mounted information processing system 100 regularly measures biometric values of specific biometric information of the worker 110 during work, and generates information about the worker 110 for each task type based on the biometric values. Furthermore, the head-mounted information processing system 100 uses the generated information about the worker 110 to recommend a task that the worker 110 should perform.

The head-mounted terminal 120 is a wearable terminal that is used by being attached to the head of the worker 110. Note that the head-mounted terminal 120 may have a band-like shape or a glass-like shape. Various other types of wearable terminals have been put into practical use, such as wristwatch-shaped devices, band-shaped devices, ring-shaped devices, and bodysuit-shaped devices.

The wearable terminal that can be used in the head-mounted information processing system 100 of this embodiment may be any wearable terminal as long as it can acquire information about the task being performed by the worker 110 wearing the wearable terminal. Preferably, the wearable terminal is capable of acquiring, as a biometric acquisition means, biometric information of the worker 110 that can identify the level of alertness of the worker 110 working on the task. Note that the biometric information of the worker 110 may be acquired by a wearable terminal different from the wearable terminal that acquires information about the task that the worker 110 is working on.

Here, the biological information of the worker 110 that can identify the level of alertness of the worker 110 includes brain waves, pulse, amount of perspiration, and the like. Some head-mounted terminals 120 can measure biological values such as brain waves and pulse rate of the worker 110 wearing the head-mounted terminal 120. Further, the alertness level of the worker 110 refers to the "functioning state of consciousness and senses" of the worker 110. Details of the alertness level will be described later.

This embodiment will be described using brain waves as an example of biological information. Biometric information other than this can be used as biometric information of the worker 110 that can identify the alertness level of the worker 110. However, compared to other biological information such as pulse rate and amount of perspiration, brain waves are more likely to change instantaneously depending on the mental and physical state of the worker 110, so the alertness level of the worker 110 is It is good as a measurement.

FIG. 2 is an explanatory diagram showing the hardware configuration of the information processing device 130 in FIG. 1. The information processing device 130 may be, for example, a computer device, a mobile terminal, or an image forming device such as a copying machine. The information processing device 130 in FIG. 2 includes a CPU 201, a RAM 202, a ROM 203, an external storage device 207, and a bus 210 to which these are connected. A keyboard 204, a mouse 205, a storage medium drive 208, an interface unit (I/F) 209, and a display unit 206 are further connected to the bus 210. The keyboard 204 and mouse 205 are examples of input devices used by the user of the information processing device 130 to input information. The display section 206 is, for example, a liquid crystal panel, an organic EL panel, or the like. The display unit 206 displays information to be output to the user of the information processing device 130 using images, characters, and the like. The interface unit 209 has input/output ports to which peripheral devices of the information processing device 130 are connected. The input/output port may be one to which peripheral devices are connected using the USB method, or one to which peripheral devices are connected using the Ethernet method, for example. Here, a wearable terminal such as head-mounted terminal 120 is connected to interface section 209. The wearable terminal may be connected to the interface unit 209 by wireless communication.

The external storage device 207 is, for example, a mass storage device such as an HDD or an SSD. The storage medium drive 208 can be loaded with a disk-type storage medium such as a CD-ROM or a DVD-ROM. The storage medium drive 208 stores data in or reads data from an attached disk-type storage medium. The ROM 203 may be a semiconductor memory that stores information in a non-volatile manner. The external storage device 207, the disk-type storage medium attached to the storage medium drive 208, and the ROM 203 may store programs and data to be executed by the CPU 201. The ROM 203 may further store a boot program storing a sequence for starting the information processing device 130 and setting data. RAM 202 may be a semiconductor memory that stores information in a volatile manner. The RAM 202 stores programs read by the CPU 201, various temporary data used by the CPU 201 during execution, and the like in a randomly accessible manner. The RAM 202 may store information input and output by the interface unit 209. Such RAM 202 provides the CPU 201 with a work area used for its processing. The CPU 201 reads a program from the external storage device 207, storage medium drive 208, and ROM 203, expands it to the RAM 202, and executes it. Thereby, the CPU 201 controls the entire information processing device 130.

FIG. 3 is an explanatory diagram of various functional modules implemented in the head-mounted information processing system 100 of FIG. 1. When the CPU 201 in FIG. 2 executes the program, the various functions shown in FIG. 3 are realized in the information processing device 130. Specifically, the information processing device 130 implements a task specific information acquisition unit 305, a task identification unit 301, an arousal level information storage unit 302, a task list acquisition unit 303, and a recommended task determination unit 304. The head-mounted terminal 120 also includes an external environment imaging section 311, an eyeball information acquisition section 312, an alertness information acquisition section 313, and an output section 314. In this embodiment, the head-mounted terminal 120 and the information processing device 130 are separate bodies, and send and receive information to and from each other via wireless communication. Note that the head-mounted terminal 120 and the information processing device 130 may be integrated into the same housing. Furthermore, the head-mounted terminal 120 and the information processing device 130 may exchange information with each other through wired communication instead of wireless communication.

In the head-mounted terminal 120, the output unit 314 outputs a see-through screen, for example, to a see-through screen provided in the visual field of the worker wearing the head-mounted terminal 120. The worker can visually recognize the outputted perspective screen along with the work of the task he/she is working on. Note that the output unit 314 may output the screen to a screen that is provided in a part of the visual field of the worker wearing the head-mounted terminal 120 and cannot be seen through. Further, the output unit 314 may output audio, electrical stimulation, etc. other than the screen.

The external environment imaging unit 311 includes, for example, a small camera provided on the head-mounted terminal 120. The small camera for the external environment imaging unit 311 is preferably provided on the head-mounted terminal 120 so as to capture an image at an angle of view corresponding to the range of the visual field of the worker. Thereby, the image captured by the external environment imaging unit 311 becomes an image of the entire visual field of the worker. The visual field image captured by the external environment imaging unit 311 can be used to recognize what kind of task the worker is currently working on.

The task identification information acquisition unit 305 acquires object information for identifying the type of task that the worker is working on. Information on objects for each type of task may be stored in a memory (202, 207) such as the external storage device 207 or the RAM 202 in an updatable manner, for example. For example, the object for specifying a text creation task using a personal computer device may be the personal computer device itself, the screen of a text editor displayed on the personal computer device, or the like.

The task identification unit 301 acquires information from the external environment imaging unit 311 and the task identification information acquisition unit 305, and identifies the task that the worker is currently working on based on the acquired information. The visual field image captured by the external environment imaging unit 311 captures the object of the task that the worker is currently working on. Further, the current working state of the worker can be imaged. The task specific information acquisition unit 305 acquires object information for each type of task that the worker is working on. The task identifying unit 301 can identify the type of task that the worker is currently working on, for example, by determining whether these objects match. Note that the task identifying unit 301 uses, as information for identifying the task that the worker is currently working on, not information on the object that the worker is working on, but other information associated with the work. May be used. The task identifying unit 301 may identify the task that the worker is currently working on, for example, based on the person the worker is likely to meet when performing the task. Further, the task identification unit 301 may identify the task that the worker is currently working on, for example, based on the sound that is played when the worker performs the task.

The eyeball information acquisition unit 312 includes another small camera provided on the head-mounted terminal 120, for example. Another small camera for the eyeball information acquisition unit 312 may be provided on the head-mounted terminal 120 so as to capture images of both eyes of the worker. Thereby, the eyeball information acquisition unit 312 can capture an image including both eyes of the worker. The eyeball information acquisition unit 312 can track the movement of the eyeballs. Then, the eyeball information acquisition unit 312 generates blink number information indicating the number of blinks per unit time based on the captured images of both eyes. When workers are concentrating on their work, they blink less frequently. When workers are distracted, they blink more often. The time-series information on the number of blinks of the worker may include information on whether the worker is conscious during work and information on productivity depending on the worker's concentration level. Further, the eyeball information acquisition unit 312 may obtain, for example, information on the position of the worker's line of sight on the fluoroscopic screen.

The alertness level information acquisition unit 313 has a measuring device that measures, for example, the brain waves of the worker as information for determining the alertness level of the worker working on the task. In addition to this, the alertness information acquisition unit 313 may also measure the worker's pulse, sweat amount, etc.

The alertness level information storage unit 302 accumulates and stores the worker information generated by the eyeball information acquisition unit 312 and the worker information generated by the alertness level information acquisition unit 313 in the memories 202 and 207. . Further, the arousal level information storage unit 302 accumulates and stores information such as the type of task specified by the task identification unit 301 in the memories 202 and 207. As a result, the memories 202 and 207 store time-series information on the number of blinks and brain waves indicating the worker's level of alertness during the task, in association with information such as the type of task the worker is currently working on. be remembered. Thereby, the types and changes in the worker's brain waves for each task can be stored in the memories 202 and 207. Examples of types of brain waves include alpha waves, beta waves, and theta waves. Memories 202 and 207 store biological information of the worker that can identify the level of alertness of the worker working on the task. Further, the information on the alertness level at the end of each task can be used as the worker's alertness level after the task. Information on the initial alertness level of each task can be used as the worker's alertness level before work.

Then, the arousal level information storage unit 302 determines "appropriate brain waves" and "brain wave transition trends" for each task based on the number of blinks and time series information of brain waves stored in the memories 202 and 207 for each task. may be generated and stored in the memories 202 and 207 in association with the task type. As a result, the memories 202 and 207 can store information on "appropriate brain waves" and "brain wave transition trends" of the task in association with the task. Here, the task-appropriate brain waves refer to brain waves suitable for the task. It is thought that by starting a task from a state of appropriate brain waves, a worker can enjoy working with less stress in most cases. Furthermore, the transition tendency of brain waves of a task refers to the tendency of changes in the frequency of brain waves that change depending on the work of the task. The transition tendency of brain waves is information indicating whether the worker's alertness increases or decreases while performing the task, and strictly speaking, it differs depending on the task. However, if it is limited to the same worker, it is thought that there is a certain tendency of transition in most cases. Furthermore, for general tasks, it is considered possible to identify general trends among different workers empirically. It can be considered that the brain waves of a worker after a task generally change according to the transition tendency of the brain waves as the worker performs the task. By measuring and storing the biological information of workers that can identify their level of alertness, and using it to select tasks, it is possible to maintain workers in a good alertness state that is suitable for each task as much as possible. You can expect to be able to work on multiple tasks by doing this. For example, by using information on the transition tendency of the worker's brain waves, it is possible to predict the movement of the brain waves and create a work plan that indicates the order of execution of tasks, taking into account the work of the subsequent task.

The task list acquisition unit 303, as a task acquisition unit, acquires list-like information indicating a plurality of tasks performed by a worker. Information on multiple tasks performed by a worker may be stored in the memories 202 and 207, for example. The information on each task acquired by the task list acquisition unit 303 may include information such as the task name, the name of the person in charge of the task, the importance of the task, the due date of the task, the summary information of the task, and the progress information of the task. . This information can be used to identify the type of each task. Note that the task list acquisition unit 303 may acquire information on a plurality of tasks that the worker is working on from a business management database that the worker uses on a daily basis, and store it in the memories 202 and 207. Further, the task list acquisition unit 303 acquires information on a plurality of tasks performed by the worker from a task management tool device (not shown) with which the information processing device 130 can communicate, and stores the information in the memories 202 and 207. It's fine.

Here, the business management database may, for example, issue tasks in the form of tickets, accept input of the various types of information described above for each task, and manage this by linking it to the ticket as metadata. Note that the present invention is not limited to a ticket-type business management database, and may be a TODO management database or task management tool using spreadsheet software, for example, and there is no intention to limit the scale or type of the database or tool. By the task list acquisition unit 303 acquiring information from the existing business management database, the information processing device 130 can acquire information on multiple tasks to be performed by the worker without requiring the worker to perform any new special work. can do. By including metadata such as task importance and deadline in the task information and adding this to the work plan indicating the task execution order, the information processing device 130 can avoid unrealistic task selection and work. It can be difficult to plan.

Recommended task determining section 304 determines a task to recommend to a worker and outputs it to output section 314 . This allows the output unit 314 to visually recognize the task that is recommended to be performed next. For example, the task list acquisition unit 303 can acquire a plurality of tasks performed by a worker. The arousal level information storage unit 302 holds biological information for each type of task. The recommended task determining unit 304 may specify the type of each of the plurality of tasks that have been acquired based on this information.

Further, the alertness level information storage unit 302 acquires the current biological information of the worker and stores it in the memories 202 and 207. The recommended task determining unit 304 may determine the worker's current level of alertness based on this biological information. Then, the recommended task determination unit 304 recommends to the worker, for example, a task that is suitable for the determined worker's current alertness level, giving priority to a task that is not suitable for the determined worker's current alertness level. You can decide it as a task. As described above, each time a worker finishes working on a task, the recommended task determining unit 304 can determine the order of tasks in accordance with the relationship between the worker's alertness level and the user's productivity. In the present embodiment, the recommended task determining unit 304 performs the following tasks based on the brain waves obtained from the arousal information acquisition unit 313, the “appropriate brain waves” and “transition trends of brain waves” for each task, and the scheduled work tasks of the worker. You can decide which tasks to recommend. The recommended task determining unit 304, as a selection unit, selects a task to be performed by a worker from a plurality of tasks acquired by the task acquisition unit. The selection and determination of tasks to be recommended to workers will be described in detail later. Note that the recommended task determining unit 304 uses the worker's pulse or sweat rate instead of the worker's brain waves, or by combining multiple types of biological information indicating the worker's alertness level to recommend tasks. may be determined.

Figure 4 shows a control system that stores information on the appropriate range of biometric values and transition trends of biometric values that correspond to the task type, based on the biometric information of the worker that can identify the worker's alertness level obtained during work. It is a flowchart. The CPU 201 of the information processing device 130 mainly functions as a task specifying information acquisition unit 305, a task specifying unit 301, and an alertness information storage unit 302, and executes the flowchart of FIG. 4 when the worker is wearing the head-mounted terminal 120. May be executed. When working on a task, the worker wears the head-mounted terminal 120 from before to after the work. In this embodiment, the head-mounted information processing system 100 executes the control shown in the flowchart of FIG. 4 in the preparation stage. Further, the head-mounted information processing system 100 executes the control shown in FIG. 8, which will be described later, when the worker works while receiving task recommendations. The period of each task corresponds to the period during which the worker is working on that task. The duration of each task varies depending on the collection situation.

In step S501, the CPU 201 acquires information on the type of task. The CPU 201 may obtain task type information from task type information in a business management database that is used daily by workers. If the task type is not specified in the business management database, the CPU 201 infers task type information based on other metadata such as task summary information and task progress information in the business management database. You may obtain it. In step S502, the CPU 201 acquires the type of task that the worker is currently working on. For example, the CPU 201, as the task identification unit 301, recognizes which task the worker is currently working on based on the output of the external environment imaging unit 311, and acquires the type of task the worker is currently working on. It's fine. In this case, the CPU 201 acquires an image within the field of view that is the output of the external environment imaging unit 311, and uses object recognition technology such as deep learning from the image within the field of view to determine which images are included in the image within the field of view. Extract object information. Thereafter, the CPU 201 compares the task information output from the task specific information acquisition unit 305 with the extracted object information, and selects the one with the highest degree of matching as the task currently being worked on. May be obtained as a type. Note that information related to these processes may be stored in the memories 202 and 207.

In step S503, the CPU 201 determines whether the type of task acquired in step S502 has changed from the type of task acquired in the previous step S502. If the task type has not changed, the CPU 201 advances the process to step S504 for processing the task currently being worked on. If the type of task has changed, the CPU 201 advances the process to step S506 to process a new task. In step S504, the CPU 201 acquires alertness information regarding the task being worked on, such as the worker's current brain waves, and temporarily stores it in the memories 202 and 207 together with the measurement time.

In step S505, the CPU 201 acquires productivity information such as the current number of blinks of the worker and temporarily stores it in the memories 202 and 207 together with the measurement time. After that, the CPU 201 returns the process to step S502. The CPU 201 repeats the processing from step S502 to step S505 during a period in which the task type is not changed. As a result, the memories 202 and 207 temporarily store time-series information of the worker's brain waves for the task currently being worked on, and time-series information of the number of blinks of the worker for the task currently being worked on. Ru. Steps S506 and S507 are processes that are executed when the task that the worker is working on switches and the type of task changes. In this case, the memories 202 and 207 temporarily store time-series information about the worker's brain waves and the number of blinks in association with the type of task the worker was working on.

In step S506, the CPU 201, as the alertness information storage unit 302, determines the appropriate brain waves for the task based on the time series information of the brain waves and the time series information of the number of blinks temporarily stored in the memories 202 and 207. and stored in the memories 202 and 207. For example, the CPU 201 identifies a time when the number of blinks of a worker during work is low as "a time when productivity is high," and determines the brain waves at that "time when productivity is high" as "appropriate brain waves." and may be stored in the memories 202 and 207. The memories 202 and 207 may store "appropriate brain waves" based on information on classification of each brain wave frequency band, such as alpha waves, beta waves, or theta waves.

Note that the number of blinks is just an example of an index for measuring productivity. The CPU 201 may identify productivity based on the value of a specific index other than the number of blinks. For example, when working on a computer device, a worker operates the mouse 205 and keyboard 204. The CPU 201 may identify productivity based on the amount of operation of the mouse 205 or the keyboard 204. In addition to this, for example, the CPU 201 may specify productivity using information that is not directly linked to productivity, such as an evaluation of the physical condition of the worker, as a specific index. Furthermore, the CPU 201 may identify productivity based on the degree of progress as a result of the work, the work period, etc., rather than information on the worker itself. For example, in the task of creating materials, the CPU 201 can use the value obtained by dividing the number of input characters by the working time as specific index information in order to specify productivity. Furthermore, in the program implementation task, the CPU 201 can use the value obtained by dividing the number of source code commits to the source code management server by the working time as specific index information to identify productivity. . Based on the information of the specific index, the CPU 201 determines the appropriate brain waves suitable for the task of that type from the biological time-series information of the worker during the work, and stores the determined brain waves in the memories 202 and 207. Bye.

In step S507, the CPU 201, as the arousal level information storage unit 302, determines the transition tendency of the brain waves from the time series information of the brain waves temporarily stored in the memories 202 and 207, and stores it in the memories 202 and 207. For example, if the brain waves at the end of the task are higher than the brain waves at the start of the task, the CPU 201 determines that the transition tendency of the brain waves is increasing, and stores information on the transition tendency of the brain waves indicating the enhancement in the memory 202, 207. Conversely, if the brain waves at the end of the task are lower than the brain waves at the start of the task, the CPU 201 determines that the transition tendency of the brain waves is decreasing, and stores information on the transition tendency of the brain waves indicating the decrease in the memory. 202 and 207. The appropriate brain wave information and the brain wave transition trend information to be stored in the memories 202 and 207 are stored in the memories 202 and 207 in association with information on the task in which they were measured, such as information on the type of task. Ru.

Next, the process in FIG. 4 will be explained using a specific example. FIG. 5 is an explanatory diagram of an example of the types of a plurality of tasks related to the process of FIG. 4. The CPU 201, as the task specific information acquisition unit 305, may acquire information on the types of tasks shown in FIG. Figure 5 shows examples of multiple tasks performed by a software developer, such as idea generation, design, program implementation, general document creation, patent writing, and inventory, divided into multiple lines. There is. The task type in each row is associated with attribute information of the object and a "contained keyword" that may be included in the captured image of the object. This association information can be used as information for specifying the task that the worker is working on. For example, the task type "idea generation" in the first row of FIG. 5 is associated with "mind map" and "whiteboard" as attribute information of objects.

In step S502 of FIG. 4, the CPU 201, as a task determination unit, can identify the type of task that the worker is working on. For example, the CPU 201 extracts a target object from the captured image by pattern matching, and compares the target object with the target objects of the plurality of task type information, thereby identifying the type of task that the worker is working on. can be specified. Further, the CPU 201 uses character recognition technology for the captured image to extract character information included in the image within the visual field. Then, the CPU 201 compares the extracted character information with the "contained keywords" of the information on the types of tasks. Thereby, the CPU 201 can identify the type of task that the worker is working on.

In addition, the CPU 201 stores, for example, a syntax specific to a programming language, without referring to FIG. It may be specified as the type of task being carried out. Further, the CPU 201 may recognize the application currently being used by the worker and identify the type of task the worker is working on based on the type of the application. For example, when recognizing that the application "Mind Map" is captured in the captured image corresponding to the range of the visual field, the CPU 201 identifies that the task the worker is working on is of the "idea generation" type. You may do so. Further, the CPU 201 may identify the type of task that the worker is working on based on input on the keyboard 204 or operation on the head-mounted terminal 120 that the worker performs when starting work on the task. Furthermore, when the CPU 201 recognizes that a "text editor" is included in the captured image within the field of view and that a character string "Claims" has been input using character recognition technology, the CPU 201 determines whether the operator The type of task being performed may be specified as "patent writing." Further, the CPU 201 may ultimately identify the type of task that the worker is working on, not only by a single recognition but also by multiple recognitions. For example, by setting a threshold for the number of times a keyword appears or by setting a combination of keywords that appear, the CPU 201 may perform multiple recognitions to finally identify the type of task that the worker is working on. . Note that the above-mentioned task types are merely examples. The granularity of classification of task types may also be changed depending on the project work in which the worker is engaged, the project in which the worker is engaged, and the like.

FIG. 6 is an explanatory diagram of time-series information of brain waves and the number of blinks, which are biological information during one task. In step S506 or step S507 of FIG. 4, the CPU 201 determines "appropriate brain waves" and "brain wave transition trends" for each task type based on the biological information of the worker during the current work, and stores them in the memory 202. , 207. The upper part of FIG. 6 is a blink count graph 701 plotting time series information of the worker's blink count. The horizontal axis of the blink count graph 701 is time. The vertical axis of the blink count graph 701 is the value of the blink count. Here, it is the number of blinks per second. The lower part of FIG. 6 is an electroencephalogram graph 702 in which time-series information of the worker's brain waves is plotted. The horizontal axis of the electroencephalogram graph 702 is the same time as the blink count graph 701. The vertical axis of the electroencephalogram graph 702 is the electroencephalogram value (Hz). Further, the electroencephalogram graph 702 also shows a low beta wave band 705, an SMR wave band 706, and a high alpha wave band 707 as types of brain waves. The low beta wave band 705 may be, for example, 15 Hz to 18 Hz. The SMR wave band 706 may be, for example, 12Hz to 15Hz. The high alpha wave band 707 may be, for example, 8 Hz to 12 Hz. These three bands 705 to 707 are a detailed classification of the medium wakefulness state (8 Hz to 18 Hz), which is generally considered to improve human performance.

Then, the CPU 201 determines, for example, a period in which the number of blinks is low as a period in which productivity is high. According to this determination criterion, the CPU 201 determines the determination period 704 in the blink number graph 701 in the upper part of FIG. 6 as a period of high productivity. The brain waves in the determination period 704 are mainly in the SMR wave band 706. In this case, the CPU 201 records "SMR waves" in the memories 202 and 207 as the arousal level information storage unit 302 as a classification of the appropriate brain waves for the type of task. Further, the CPU 201 records "enhancement" in the memories 202 and 207 as the arousal level information storage unit 302 as the transition tendency of the brain waves in the determination period 704. Unlike in FIG. 6, when the brain waves are decreasing in the determination period 704, the CPU 201, as the alertness information storage unit 302, records "decline" in the memories 202 and 207 as the transition trend of the brain waves in the period. . Here, the CPU 201 may obtain an approximate straight line 703 by, for example, the least squares method based on the values of a plurality of brain waves in the determination period 704, and determine the transition tendency of the brain waves based on the slope of the approximate straight line 703. If the slope of the approximate straight line 703 is positive, the CPU 201 may determine that the transition tendency of the brain waves is "enhanced." If the slope of the approximate straight line 703 is negative, the CPU 201 may determine that the transition tendency of the brain waves is "decreasing". Note that the CPU 201 may obtain the approximate straight line 703 by other methods, or may determine the transition tendency of the brain waves without using the approximate straight line 703. Further, the CPU 201 may determine the transition tendency of brain waves into three or more types, including "stable" and the like, instead of the two types of "enhancement" and "decrease". The CPU 201 may determine "stability" by comparing the difference between the maximum value and the minimum value in the determination period 704 with a threshold value. Here, "stable" indicates that the worker's alertness level is unlikely to change to another alertness level due to work. In addition, for example, "hyperactivity" may be subdivided into two or more types: "easily aggravated" and "very apt to be aggravated."

FIG. 7 shows appropriate brain waves as the appropriate range of biological values of a specific worker and brain wave transition trends as transition trends of biological values, which are associated with the plurality of task types in FIG. 5 through the process of FIG. 4. It is an explanatory diagram of an example. In FIG. 7, "appropriate brain waves" and "brain wave transition trends" are associated with each of the plurality of task types shown in FIG. 5. For example, the task type "idea generation" in the first row of FIG. 7 is associated with low beta waves as "appropriate brain waves" and "enhancement" as "brain wave transition tendency." In this case, this means that it is desirable for the worker to start the "idea generation" task in a low beta wave state. It also means that the brain waves of the worker after the task tend to be "enhanced" compared to the brain waves before the task.

The information in FIG. 7 may then be recorded in the memories 202 and 207. In this way, the CPU 201, as a work-in-progress acquisition unit, acquires biological information of the worker during work that can identify the worker's alertness level while working on the task. Then, the CPU 201 obtains information about the appropriate range of the worker's biometric values during work and the transition tendency of the worker's biometric values during work, based on the acquired biometric information of the worker during work. It can be generated and stored in the memories 202 and 207. In addition, the memories 202 and 207 serve as storage means to store information on the generated suitability range of the worker's biological values during work and the transition trends of the worker's biological values during work. It can be stored in association with the task type. Then, by recording the information measured about the worker in the memories 202 and 207, the CPU 201 acquires information from the memory when selecting one task from a plurality of tasks as the recommended task determining unit 304. and can be used for selection. As a selection means, the CPU 201 obtains information on the appropriate range of biological values and the transition trend of biological values for each of the plurality of tasks related to the work from the memories 202 and 207, and selects the task to be performed by the worker next. can do.

Next, a description will be given of control by which the head-mounted information processing system 100 recommends a task when a worker is working. FIG. 8 is a flowchart of task recommendation control by the head-mounted information processing system 100 of FIG. The CPU 201 of the information processing device 130 mainly functions as an alertness level information storage unit 302, a task list acquisition unit 303, and a recommended task determination unit 304, and executes the flowchart of FIG. May be executed. When working on a task, the worker wears the head-mounted terminal 120 from before to after the work. Note that the CPU 201 may also execute the control in FIG. 4 and the control in FIG. 8 simultaneously and in parallel with respect to this recommendation task. In this case, it can be expected that the recommended tasks will continue to change to ones suitable for the worker.

In step S801, the CPU 201, as the task list acquisition unit 303, extracts and acquires information on tasks related to the worker from a business database or the like. The CPU 201 may extract and acquire a task in which the name of the worker is registered as the person in charge of the task from a business database or the like. In step S802, the CPU 201, as the recommended task determining unit 304, selects and obtains, as a task candidate, a task that the worker is to perform immediately from among the tasks obtained in step S801.

In step S803, the CPU 201, as the recommended task determining unit 304, associates each aptitude brain wave with a transition tendency of the brain wave for the plurality of task candidates acquired in step S802. At this time, the CPU 201 may determine the type of each acquired task candidate. Further, the CPU 201 may acquire the aptitude brain waves and the transition tendency of the brain waves for each type of task from the memories 202 and 207. Then, the CPU 201 may associate each aptitude brain wave with the transition tendency of the brain wave for the plurality of acquired task candidates based on the acquired correspondence. The CPU 201 may store the plurality of acquired task candidates in the memories 202 and 207 in association with information on their respective aptitude brain waves and transition trends of the brain waves. In step S804, the CPU 201, as the alertness level information acquisition unit 313, acquires the worker's current brain waves.

In step S805, the CPU 201, as the recommended task determining unit 304, selects and determines the recommended task for the worker to work on next based on the worker's current brain waves. If only one task candidate has been acquired in step S802, the CPU 201 determines that task candidate as the task to be recommended. If a plurality of task candidates have been acquired in step S802, the CPU 201 determines, from among the plurality of task candidates, the task candidate for the worker to work on next as the recommended task. At this time, the CPU 201 may decide on the recommended task, taking into consideration the task information, so as not to deviate from the realistic task priority. For example, the CPU 201 may select and determine recommended tasks in order from the task that must be worked on most recently, based on the importance of the task, the due date of the task, or both. A plurality of tasks basically have an order in which they are desired to be processed based on the importance of the tasks, the due dates of the tasks, and so on. A plurality of task candidates can be classified into a plurality of task groups based on such basic priorities.

Then, the CPU 201 may select and determine a task to recommend from among the plurality of acquired task candidates or from among the plurality of task candidates in the task group with the highest priority. For example, the CPU 201 prioritizes task candidates associated with a band to which the worker's current brain waves belong, over task candidates associated with a band to which the worker's current brain waves do not belong, as a recommended task. You can choose and decide. Further, the CPU 201 may select and determine a plurality of task candidates as the task to recommend. Some task candidates are more efficient to work on together than to work on them separately. In this case, the CPU 201 may determine the order of tasks among the plurality of task candidates selected as recommended tasks. Further, the CPU 201 may acquire worker productivity information and change the selection of recommended tasks according to the worker productivity information. In step S806, the CPU 201 outputs the recommended task from the output unit 314 of the head-mounted terminal 120. Thereby, the worker wearing the head-mounted terminal 120 can visually confirm the next task to be performed on the outputted transparent screen.

In step S807, the CPU 201 determines whether to end the task recommendation after the worker has finished working on the recommended task. When the worker finishes working on the recommended task, the worker's line of sight often moves away from the work target. It is not possible to identify the object to be worked on in an image taken while the person is looking aside. Further, after completing a series of tasks, the worker voluntarily removes the head-mounted terminal 120 or turns off the power of the head-mounted terminal 120. When these operations are performed, the alertness level information acquisition unit 313 and the eyeball information acquisition unit 312 can generate detection error information and the like. If the worker has finished working on the recommended task and is about to complete the series of tasks, the CPU 201 determines to end the task recommendation and ends this control.

On the other hand, if the worker has finished working on the recommended task but wants to continue working, the CPU 201 determines not to end the task recommendation and returns the process to step S801. The CPU 201 repeats the processing from step S801 to step S807 until the worker attempts to complete a series of tasks, and repeatedly recommends tasks to the worker. Thereby, the CPU 201 of the information processing device 130 can continuously make recommendations to the worker on how to efficiently complete tasks according to the state of the worker's brain waves and the status of unfinished tasks. . Note that the contents of the task list information acquired in step S801 are changed by the worker updating the original information such as the business management database. A worker or the like can update recommended tasks by performing an update operation on the business management database, such as deleting a task that has been worked on or adding a task to be worked on.

In this way, the CPU 201 can associate the plurality of tasks to be acquired with the biometric information of the worker himself/herself suitable for each task type. The biological information here includes the appropriate range of biological values (brain wave band) and the transition tendency of biological values during task work (brain wave transition tendency), which indicates the worker's productivity for each task type. , is composed of. Further, the CPU 201, as a selection means, acquires from a biological acquisition means a biometric value of the worker that can specify the worker's alertness level, every time the CPU 201 selects a task for the worker to work from among the plurality of acquired tasks. Then, the CPU 201 uses the brain waves (biological values) for identifying the worker's alertness level at the time of task recommendation and the biological information (appropriate range, transition tendency) associated with each task. , select a task that is appropriate for the worker's current mental and physical state. The CPU 201 can recommend the selected task as the next task to be worked on.

FIG. 9 is an explanatory diagram of an example of a plurality of tasks related to the process of FIG. 8. In FIG. 9, 15 tasks from task A to task K are listed as a plurality of tasks that the worker needs to work on. In addition, each task includes information such as the task type, task importance, and task due date, as well as the task name.

In step S801, the CPU 201 may obtain a list of multiple tasks as shown in FIG. Then, in step S802, the CPU 201 selects a plurality of task candidates to be immediately performed by the worker from the plurality of tasks shown in FIG. Further, in step S805, the CPU 201 selects and determines a task to be recommended from a plurality of task candidates. In this case, the CPU 201 may generate the task priority, task order, and task group for each task shown in FIG. 9, and select and determine the task to be recommended by taking these information into consideration. Thereby, the CPU 201 can recommend tasks without deviating from the realistically required priority. Further, the CPU 201 may select and determine tasks to recommend by taking into account the importance of the task, the due date of the task, or both. This allows the CPU 201 to prioritize and recommend tasks with close deadlines.

FIG. 10 is an explanatory diagram of a plurality of tasks obtained from FIG. 9, and an example of appropriate brain waves and brain wave transition trends that are associated with each task based on each type. In step S802, the CPU 201 selects a plurality of task candidates to be immediately worked on by a trader from the plurality of tasks shown in FIG. FIG. 10 shows 5 tasks from Task A-a to Task K, which are some of the 15 tasks shown in FIG. Two task candidates are listed. In addition, each task candidate includes the same task name, task importance, and task date as shown in FIG. Information on the transition tendency of brain waves depending on the task is associated. The CPU 201 specifies the task type for each selected task candidate, and further associates appropriate brain waves and brain wave transition trends associated with the specified task type with each task candidate.

FIG. 11 is an explanatory diagram of a specific example of selection processing from a plurality of tasks. FIG. 11(a) is a diagram in which the five task candidates shown in FIG. 10 are designed using appropriate brain waves. Each task candidate is represented by a rectangular figure with a task name attached. The horizontal axis is the frequency of brain waves. Also shown are a high alpha wave band 707, an SMR wave band 706, and a low beta wave band 705. Each task candidate is classified into one of the bands based on the appropriate brain waves. Also shown in the figure are dashed arrows indicating the transition trends of each task candidate. These stylizations are the same in FIGS. 11(b) and 11(c).

Each time the worker finishes a task, the CPU 201 acquires the current brain waves after the task in step S804 of FIG. If the current brain waves after the task acquired in step S804 are in the low beta wave band 705, the CPU 201 selects a task to recommend for the next task from the task candidates included in the dotted line frame 1222 in FIG. 11(b). Select. The dotted line frame 1222 includes a task H and a task K. For example, the CPU 201 may select task K, which has a near due date, with priority over task H from a plurality of task candidates in the low beta wave band 705. There is a possibility that the brain waves after completing task K will be higher than the low beta wave band 705. When the brain waves become higher than the low beta wave band 705, the possibility that the worker's brain waves deviate from the medium wakefulness state suitable for work increases. Therefore, if there are any unworked tasks remaining after the current selection, the CPU 201 will control the task H to maintain the medium wakefulness state on the condition that, for example, a predetermined number of work days remain until the due date. may be selected with priority. There is a high possibility that the brain waves after completing Task H will decline compared to the low beta waves at the beginning of the task, and it is highly likely that a state of moderate alertness suitable for continuing the next task can be maintained even after the task.

If the current brain waves after the task acquired in step S804 are in the SMR wave band 706, the CPU 201 selects a task to recommend for the next task from the task candidates included in the dotted line frame 1232 in FIG. 11(c). Select. The dotted line frame 1232 includes task A-a and task B. The CPU 201 may select, for example, task B, which has a close deadline, with priority over task A-a from a plurality of task candidates in the SMR wave band 706. There is a possibility that the brain waves after completing task B will be lower than the SMR wave band 706. When the brain waves fall below the high alpha wave band 707, there is a high possibility that the worker's brain waves will deviate from the medium wakefulness state suitable for work depending on the case. For this reason, the CPU 201 may select task A-a with priority, depending on the remaining state of unworked tasks after the current selection, so as to basically maintain the medium wakefulness state. There is a high possibility that the brain waves after completing the task A-a will be more enhanced than the low beta waves at the beginning of the task, and there is a high possibility that even after the task, a state of moderate alertness suitable for continuing the next task can be maintained. The CPU 201 may select a task so that there is a high possibility that the brain waves after completing the currently selected task will be in a band in which unworked tasks remain.

If the current brain wave after the task acquired in step S804 is in the high alpha wave band 707, the CPU 201 selects one task candidate included in the high alpha wave band 707 as a recommended task for the next task. Select as. Here, the CPU 201 selects task J as the task to be recommended. There is a high possibility that the brain waves after completing task J will be more enhanced than the high alpha waves at the beginning of the task, and there is a high possibility that even after the task, a state of moderate alertness suitable for continuing the next task can be maintained.

Further, if the current brain waves after the task acquired in step S804 deviate from these three bands of the medium wakefulness state, the CPU 201 determines whether the current brain waves after the task have been completed or not, based on information other than the appropriate brain waves. You may select a task to recommend from the candidates. Similarly, even if there are no unworked tasks remaining in the band to which the worker's brain waves belong, the CPU 201 selects a task to recommend from a plurality of unworked task candidates based on information other than the appropriate brain waves. It's fine. For example, the CPU 201 selects a task to recommend from a plurality of unworked task candidates based on the transition tendency of the brain waves so that the brain waves approach the band of the unworked task candidates by working on the plurality of tasks. You may do so. The CPU 201 may select a task to recommend from a plurality of unworked task candidates based on the transition tendency of the brain waves so that the brain waves after work approach the band to which most unworked tasks belong. Further, for example, if the largest number of unworked tasks remains in the SMR wave band 706, the CPU 201 may determine, for example, a task H whose alertness level tends to decrease due to task work as the task to be recommended. In this case, the unworked task to be selected next will be more likely to be worked on efficiently by the worker whose brain waves are in the SMR wave band 706. By selecting tasks that are recommended in a way that maintains a state of medium arousal in the brain waves, the worker can maintain a state of medium arousal overall while working on multiple tasks, and achieve relatively high efficiency during a series of tasks. will be able to continue.

FIG. 12 is an explanatory diagram of an example of a perspective screen showing the field of view of the worker, including the display by the head-mounted terminal 120. FIGS. 12(a) and 12(b) are recommendation screens displayed for recommending tasks. FIGS. 12(c) and 12(d) are examples of special perspective screens. When the task to be recommended is determined in step S805, the CPU 201 uses the output unit 314 to display a transparent screen 1300 as shown in FIG. 12(a) on the head-mounted terminal 120.

On a perspective screen 1300 as shown in FIG. 12(a), information 1301 about tasks to be recommended is displayed within the visual field of the worker. The wording of this recommendation task information 1301 is just an example. The wording of the recommended task information 1301 may be enough information to enable the worker to specify the task to be worked on next. Further, the CPU 201 may display information on remaining unfinished tasks, the worker's electroencephalogram 702, and the like on the head-mounted terminal 120. The CPU 201 displays the perspective screen 1300 not only after determining that one task has been completed, but also when, for example, the brain waves exceed the band at the start of the task and transition to another band. good. Further, the CPU 201 may display the perspective screen 1300 when the brain waves continuously transition to a state of another band for a certain period of time.

FIG. 12B shows a perspective screen 1310 that the CPU 201 displays on the head-mounted terminal 120 when the worker takes his or her attention away from the work target. In the perspective screen 1310 of FIG. 12(b), a personal computer device 1312, which is a workpiece, is missing. In contrast, in the perspective image 1300 of FIG. 12(a), the entire personal computer device 1302, which is a workpiece, is included. In this way, when the worker's visual field shifts from the object, the CPU 201 avoids as much as possible the worker's concentration during work by providing the worker with the information 1311 about the recommended task. be able to. The CPU 201 can prevent the notification of the next task from being displayed so as to disturb the worker while he or she is concentrating on the work. When workers finish their work, they often take their attention away from the work, even temporarily. The CPU 201 may determine whether the worker is concentrating on the workpiece based on whether the period during which the worker's line of sight is continuously directed toward the workpiece exceeds a threshold value.

FIG. 12C shows a perspective screen 1320 that displays the display position of task information 1311 so as not to overlap the workpiece after the CPU 201 detects that the worker has taken his/her line of sight away from the workpiece window 1312. This is an example. When the worker takes his/her line of sight off the workpiece window 1322, the CPU 201 displays information such as the next recommended task and information 1321 as shown in FIG. 12(c) on the head-mounted terminal 120. Then, at the timing when the CPU 201 actually displays the information 1321, the worker's line of sight may have returned to the work window 1322. In this case, the CPU 201 may use the worker's line of sight information to display the information 1321 at a position where the information 1321 is unlikely to overlap the object that the worker is gazing at for work. In FIG. 12C, the CPU 201 displays information 1321 in the lower left portion of the perspective screen 1320. Note that changes in the input frequency of the keyboard 204, mouse 205, etc. may be used to determine whether the worker's attention has been lost. Note that the information 1321 in FIG. 12C is for the CPU 201 to recommend a break task as a task other than the acquired task. In addition to this, for example, the CPU 201 may display a perspective screen 1330 on the head-mounted terminal 120 that recommends "moving your body (exercise)" as a task, as shown in FIG. 12(d). By "moving the body," the brain waves of the worker, that is, the level of alertness, can be increased. On the other hand, when the worker takes a break as shown in FIG. 12(c), the brain waves of the worker, that is, the alertness level may decline.

In this way, when the CPU 201 recommends a special task that is different from the original task as shown in FIGS. You can return to a state of moderate alertness suitable for work. For example, if the worker's current brain waves are higher than the band of the medium wakefulness state, the CPU 201 may recommend a special task of "rest" as shown in FIG. 12(c). In addition, for example, if the worker's current brain waves are lower than the band of the medium wakefulness state, the CPU 201 may recommend a special task of "exercise" as shown in FIG. 12(d). It's fine. Further, if a large decline or a large increase in the original task to be recommended is predicted based on task information, the CPU 201 may recommend a special task before recommending the original task. As a result, brain waves after performing a task where a large decline or increase can occur are more likely to be maintained in the medium arousal state band than when a special task is not recommended.

Furthermore, the CPU 201 may be able to switch the information to be output depending on the current brain wave position within the band of the medium wakefulness state, the extent to which the current brain wave is outside the medium wakefulness state, and the like. For example, when the degree of alertness deviates in the direction of high alertness, if the degree of deviation is smaller than the threshold, the CPU 201 displays a message to temporarily suspend the work, or makes the display smaller or diluted to make it less noticeable. , may be done. On the other hand, when the degree of deviation is greater than the threshold, the CPU 201 displays a message to recommend the task of snacking or taking a nap, makes the display larger or changes its color to make it more conspicuous, You may do so.

In this way, the CPU 201, as an output means, can visually output the task selected for the worker to work on next to the worker's visual field. Furthermore, when a worker who is working on multiple tasks to be acquired changes his/her line of sight and takes his/her attention away from the workpiece of the current task, the CPU 201 can select and output the next task. can. Then, as a selection means, the CPU 201 selects the next task from among the plurality of tasks to be acquired for the worker based on information about the appropriate range of biometric values and the transition tendency of the biometric values for the plurality of tasks. You can select the tasks to be performed in an order that maintains worker productivity. The biological value in this embodiment is an electroencephalogram. Moreover, the CPU 201, as a selection means, can sequentially select the task to be performed by the worker next so that the worker can maintain a specific level of alertness while working on the plurality of tasks to be acquired. In addition, as a selection means, when one task is selected from a plurality of unworked tasks, the CPU 201 prompts the worker to select the next task so that the most suitable range of brain waves can be obtained for the selected unworked task. You can select tasks to work on in order. Moreover, the CPU 201, as a selection means, can select the task to be performed next by the worker in order basically according to the work order of the plurality of tasks determined based on the information of each of the plurality of tasks to be acquired. For example, the CPU 201 can sequentially select a task for the worker to work on next according to at least one of the importance level and due date of each of the plurality of tasks to be acquired.

As described above, in this embodiment, when a worker works on multiple tasks in order, the user's alertness level identified from biometric information is acquired for each task, and the next recommendation is made accordingly. Select a task to do. Thereby, in this embodiment, it is possible to improve the overall work efficiency of the worker. By working on multiple tasks in the recommended order, the worker can efficiently perform the multiple tasks. On the other hand, if the work order of multiple tasks is fixedly determined based on, for example, brain waves before starting work on multiple tasks, changes in the mental and physical state during work may affect overall work efficiency. may decrease. In this embodiment, the work order is flexibly determined according to the worker's mental and physical condition, which increases or decreases with each task, so that such a decline in overall work efficiency can be suppressed.

[Second embodiment]
Next, a second embodiment of the present invention will be described. In the embodiment described above, the appropriate brain waves and transition trends of the brain waves of the worker are measured and determined, and these are associated with the type of task. In addition, for example, the appropriate brain waves and brain wave transition trends associated with the task type may be caused by something other than the worker himself/herself. Therefore, in this embodiment, an example will be described in which generally assumed appropriate brain waves and transition trends of brain waves are associated with each task type. In this case, the appropriate brain waves and the transition tendency of the brain waves can be obtained even if the worker himself/herself does not perform the task of that type. The appropriate brain waves and the transition tendency of the brain waves may be estimated based on a general tendency for each type of task, or may be estimated based on, for example, the brain waves of a plurality of workers who actually worked on the task. In the following, differences from the embodiments described above will be mainly explained.

FIG. 13 is an explanatory diagram of various functional modules implemented in the head-mounted information processing system 100 according to the second embodiment of the present invention. In the head-mounted information processing system 100 of FIG. 13, the information processing device 130 includes an alertness level information storage unit 302, a task list acquisition unit 303, and a recommended task determination unit 304. The head-mounted terminal 120 also includes an alertness information acquisition section 313 and an output section 314.

FIG. 14 shows a plurality of task types stored in advance in the memories 202 and 207 by the alertness information acquisition unit 313 in this embodiment, and appropriate brain waves and brain waves associated in advance with each task type. It is an explanatory view of an example of a transition trend. In FIG. 14, a plurality of types of housework tasks performed by workers are listed. Specifically, multiple task types are listed according to general housework classifications such as cleaning, laundry, household finances, menu planning, shopping, and cooking. Each type of housework task is associated with an "appropriate brain wave" and a "brain wave transition tendency" for each type. For example, the task type "cleaning" in the first row of FIG. 14 is associated with high alpha waves as "appropriate brain waves" and "enhancement" as "brain wave transition tendency." In this case, it is desirable for the worker to start the "cleaning" task in a state of high alpha waves. Furthermore, the brain waves of the worker after work tend to be "enhanced" compared to the brain waves before work.

The correspondence between the task type, "appropriate brain waves" and "brain wave transition tendency" may be determined by the creator of the head-mounted information processing system 100 based on the general impression of tasks. At this time, the "fun" of the task may be used as a criterion. Further, this correspondence relationship may be determined based on the results of a questionnaire survey conducted by the vendor to an unspecified number of customer candidates. At this time, filtering may be performed based on conditions such as the same age and gender as the worker using the system. Questionnaires may be sent only to those who are scheduled to perform the work. For example, the vendor sends a questionnaire to multiple people regarding the "fun" of each housework (rating on a 5-point scale, with 1 being the most fun and 5 being the most boring). Then, the vendor considers that if the average value of the entire questionnaire is 3.5 or more, the transition tendency of the brain waves is "enhanced", and if the average value of the entire questionnaire is less than 2.5, the transition tendency of the brain waves is "decreased". may be determined as Further, the vendor may determine that the average value of the entire questionnaire is "stable" if it is 2.5 or more and less than 3.5. In this way, the vendor may determine "appropriate brain waves" and "brain wave transition trends" for each task type, depending on the nature of each task.

Generally, it is preferable to work in a high-alpha state when working on tasks that belong to the mental category, such as patent writing or design work. On the other hand, tasks that belong to the physical category, such as inventory work and implementation work, are preferably performed in a low beta state. For tasks belonging to both the mental category and the physical category, it is preferable to work while the brain waves are in the SMR wave band 706. Further, as in the embodiment described above, the CPU 201 checks the correspondence between the task type stored in the memories 202 and 207 and the "appropriate brain waves" and "brain wave transition tendency" each time the worker works. , may be updated. The CPU 201 may add, delete, or change the information for each type of task stored in the memories 202 and 207 based on the operations of the worker himself/herself.

FIG. 15 is an explanatory diagram of an example of a plurality of housework tasks that a worker needs to perform. In FIG. 15, six tasks ranging from cleaning to cooking are listed as a plurality of housework tasks that the worker needs to perform. Furthermore, each task includes information such as a task name, a task executable date, and an executable time. Information about a plurality of housework tasks that such workers need to perform may be recorded in the memories 202 and 207. Note that these housework tasks are just examples. The plurality of tasks may be tasks from other fields.

The CPU 201 executes the control shown in FIG. 8 to sequentially recommend a plurality of housework tasks to the worker. In step S801, the CPU 201 may obtain a list of multiple housework tasks as shown in FIG. Then, in step S802, the CPU 201 selects a plurality of housework task candidates that the worker can immediately work on from the plurality of housework tasks shown in FIG. The CPU 201 obtains the current date and time, compares it with the workable days and workable hours shown in FIG. 15, and extracts a plurality of housework tasks to which the current date and time corresponds as a plurality of task candidates. For example, if the task list acquisition unit 303 acquires a task at 17:00 on Monday, the CPU 201 selects cleaning, household budget, menu, and cooking from the multiple housework tasks shown in FIG. 15 as task candidates. Extract as.

After that, the CPU 201 acquires the current brain waves of the worker wearing the head-mounted terminal 120 in step S804. In step S805, the CPU 201 selects one task from a plurality of housework task candidates based on the worker's current brain waves. In step S806, the CPU 201 outputs the selected task from the output unit 314 of the head-mounted terminal 120. As a result, the worker wearing the head-mounted terminal 120 can basically visually confirm information about housework tasks recommended according to his or her current brain waves. Workers can enjoy doing housework tasks. Note that in this embodiment, the process by which the CPU 201 selects a task to recommend from among a plurality of housework task candidates may be the same as in the embodiment described above.

Although the present invention has been described above in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and the present invention may take various forms without departing from the gist of the present invention. included.

The present invention provides a system or device with a program that implements one or more functions of the above-mentioned work format via a network or a storage medium, and one or more processors of a computer in the system or device reads the program. It is also possible to implement the process by executing the process. The present invention can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

The disclosure of this embodiment includes the following configuration and method.
(Configuration 1)
a task acquisition means capable of acquiring multiple tasks to be worked on by a worker;
Selection means for selecting a task to be performed by a worker from the plurality of tasks acquired by the task acquisition means;
a biometric acquisition means for acquiring biometric information of a worker that can identify the alertness level of a worker working on multiple tasks;
has
The selection means is
Each time a task to be performed by the worker is selected from a plurality of tasks, biometric information of the worker that can identify the worker's alertness level is obtained from the biometric acquisition means;
selecting the next task to be performed by the worker from the plurality of tasks acquired by the task acquisition means, using biological information of the worker that can identify the worker's alertness level acquired by the biological acquisition means;
Information processing device.
(Configuration 2)
The biological acquisition means acquires at least one biological value of the worker's brain waves, pulse, and sweat rate as the worker's biological information that can identify the worker's alertness level.
Information processing device according to configuration 1.
(Configuration 3)
The plurality of tasks acquired by the task acquisition means include an appropriate range of biological values suitable for task work for each task type, and information on task work that indicates worker productivity for each task type. It is possible to correlate the transition trends of biological values with the information of
The selection means is
A biometric value of the biometric information of the worker that can identify the worker's alertness level acquired by the biometric acquisition means when selecting a task to be performed by the worker, an appropriate range of the biometric value, and a transition tendency of the biometric value; selecting the next task to be performed by the worker from among the plurality of tasks acquired by the task acquisition means, based on the relationship;
Information processing device according to configuration 1 or 2.
(Configuration 4)
The selection means is
selecting the next task to be performed by the worker from among the plurality of tasks acquired by the task acquisition means for the worker to work on in an order that maintains the productivity of the worker;
An information processing device according to any one of configurations 1 to 3.
(Configuration 5)
The selection means is
selecting a task for the worker to work on next so that the worker maintains a specific level of alertness while working on the plurality of tasks acquired by the task acquisition means;
An information processing device according to any one of configurations 1 to 4.
(Configuration 6)
The selection means is
When one task is selected from a plurality of unworked tasks, the next task to be worked on by the worker is selected so that the suitability range of the most biological values is obtained in the unworked tasks remaining after selection.
An information processing device according to any one of configurations 1 to 5.
(Configuration 7)
The selection means further includes:
Based on the information of each of the plurality of tasks acquired by the task acquisition means, the task acquisition means obtains the work order of the plurality of tasks, and the next task is to be performed by the worker basically according to the work order. select,
An information processing device according to any one of configurations 1 to 6.
(Configuration 8)
The selection means is
obtaining the work order of the plurality of tasks acquired by the task acquisition means based on at least one of the importance and due date of each of the plurality of tasks acquired by the task acquisition means;
An information processing device according to any one of configurations 1 to 7.
(Configuration 9)
output means for outputting the task selected by the selection means for the worker to work next to the worker's visual field;
The output means is
outputting the task selected by the selection means when the worker who is working on the plurality of tasks acquired by the task acquisition means takes his attention away from the object of the task he is working on;
9. An information processing device according to any one of configurations 1 to 8.
(Configuration 10)
The output means acquires information on the worker's line of sight, and determines that the worker has taken his attention away from the object of the task he is working on based on a change in the obtained worker's line of sight.
An information processing device according to any one of configurations 1 to 9.
(Configuration 11)
an in-work acquisition means for acquiring biometric information of a worker that can identify the worker's alertness level while working on a task;
The appropriate range of the worker's biological value during work and the worker's biological value during work, based on the biological information of the worker that can identify the worker's alertness level, which is acquired by the work acquisition means during work. a storage means for storing the transition tendency of and the information of in association with the type of task being worked on;
has
The selection means is
Using the information stored in the storage means, the task acquisition means obtains the appropriate range of biological values and the transition tendency of the biological values for each of the plurality of tasks acquired by the task acquisition means. Select the task for the worker to work on next from the multiple retrieved tasks,
The information processing device according to any one of Configurations 1 to 10.
(Method 1)
A method for controlling an information processing device for managing the work of a worker, the method comprising:
A task acquisition process that can acquire multiple tasks for a worker to work on;
A process of selecting a task to be performed by a worker from a plurality of tasks acquired by the process of acquiring the task;
A process for acquiring biometric information of a worker that can identify the level of alertness of a worker working on multiple tasks;
has
The selection process is
Every time a worker selects a task from multiple tasks, the worker's biological information that can identify the worker's level of alertness is acquired through a process,
A task for the worker to perform next from among the plurality of tasks acquired through the task acquisition process using biometric information of the worker that can identify the worker's alertness level acquired through the biological information acquisition process. select,
A method for controlling an information processing device.
(Program 1)
A program that causes a computer to execute a method for controlling an information processing device for managing the work of a worker, the program comprising:
The method for controlling the information processing device includes:
A process of acquiring a task that can acquire multiple tasks for a worker to work on;
a process of selecting a task to be performed by a worker from a plurality of tasks acquired by the task acquisition means;
A process for acquiring biometric information of a worker that can identify the level of alertness of a worker working on multiple tasks;
has
The selection process is
Every time a worker selects a task from multiple tasks, the worker's biological information that can identify the worker's level of alertness is acquired through a process,
A task for the worker to perform next from among the plurality of tasks acquired through the task acquisition process using biometric information of the worker that can identify the worker's alertness level acquired through the biological information acquisition process. select,
program.

100 Head-mounted information processing system 110 Worker 120 Head-mounted terminal 130 Information processing device 201 CPU
202 RAM (memory, storage means)
206 Display unit 207 External storage device (memory, storage means)
301 Task identification unit 302 Arousal level information storage unit 303 Task list acquisition unit (task acquisition means)
304 Recommended task determining unit (selection means)
305 Task specific information acquisition unit (during work acquisition means)
311 External environment imaging unit 312 Eyeball information acquisition unit 313 Arousal level information acquisition unit (biological body acquisition means)
314 Output section (output means)
701 Blink number graph 702 Electroencephalogram graph 703 Approximate straight line 704 Judgment period 1300, 1310, 1320, 1330 Transparent screen

Claims (13)

a task acquisition means capable of acquiring multiple tasks to be worked on by a worker;
Selection means for selecting a task to be performed by a worker from the plurality of tasks acquired by the task acquisition means;
a biometric acquisition means for acquiring biometric information of a worker that can identify the alertness level of a worker working on multiple tasks;
has
The selection means is
Each time a task to be performed by the worker is selected from a plurality of tasks, biometric information of the worker that can identify the worker's alertness level is obtained from the biometric acquisition means;
selecting the next task to be performed by the worker from the plurality of tasks acquired by the task acquisition means, using biological information of the worker that can identify the worker's alertness level acquired by the biological acquisition means;
Information processing device. The biological acquisition means acquires at least one biological value of the worker's brain waves, pulse, and sweat rate as the worker's biological information that can identify the worker's alertness level.
An information processing device according to claim 1. The plurality of tasks acquired by the task acquisition means include an appropriate range of biological values suitable for task work for each task type, and information on task work that indicates worker productivity for each task type. It is possible to correlate the transition trends of biological values with the information of
The selection means is
A biometric value of the biometric information of the worker that can identify the worker's alertness level acquired by the biometric acquisition means when selecting a task to be performed by the worker, an appropriate range of the biometric value, and a transition tendency of the biometric value; selecting the next task to be performed by the worker from among the plurality of tasks acquired by the task acquisition means, based on the relationship;
An information processing device according to claim 1 or 2. The selection means is
selecting the next task to be performed by the worker from among the plurality of tasks acquired by the task acquisition means for the worker to work on in an order that maintains the productivity of the worker;
The information processing device according to claim 3. The selection means is
selecting a task for the worker to work on next so that the worker maintains a specific level of alertness while working on the plurality of tasks acquired by the task acquisition means;
The information processing device according to claim 4. The selection means is
When one task is selected from a plurality of unworked tasks, the next task to be worked on by the worker is selected so that the suitability range of the most biological values is obtained in the unworked tasks remaining after selection.
The information processing device according to claim 4. The selection means further includes:
Based on the information of each of the plurality of tasks acquired by the task acquisition means, the task acquisition means obtains the work order of the plurality of tasks, and the next task is to be performed by the worker basically according to the work order. select,
The information processing device according to claim 3. The selection means is
obtaining the work order of the plurality of tasks acquired by the task acquisition means based on at least one of the importance and due date of each of the plurality of tasks acquired by the task acquisition means;
The information processing device according to claim 7. output means for outputting the task selected by the selection means for the worker to work next to the worker's visual field;
The output means is
outputting the task selected by the selection means when the worker who is working on the plurality of tasks acquired by the task acquisition means takes his attention away from the object of the task he is working on;
An information processing device according to claim 1. The output means acquires information on the worker's line of sight, and determines that the worker has taken his attention away from the object of the task he is working on based on a change in the obtained worker's line of sight.
The information processing device according to claim 9. an in-work acquisition means for acquiring biometric information of a worker that can identify the worker's alertness level while working on a task;
The appropriate range of the worker's biological value during work and the worker's biological value during work, based on the biological information of the worker that can identify the worker's alertness level, which is acquired by the work acquisition means during work. a storage means for storing the transition tendency of and the information of in association with the type of task being worked on;
has
The selection means is
Using the information stored in the storage means, the task acquisition means obtains the appropriate range of biological values and the transition tendency of the biological values for each of the plurality of tasks acquired by the task acquisition means. Select the task for the worker to work on next from the multiple retrieved tasks,
An information processing device according to claim 1. A method for controlling an information processing device for managing the work of a worker, the method comprising:
A task acquisition process that can acquire multiple tasks for a worker to work on;
A process of selecting a task to be performed by a worker from a plurality of tasks acquired by the process of acquiring the task;
A process for acquiring biometric information of a worker that can identify the level of alertness of a worker working on multiple tasks;
has
The selection process is
Each time a task to be performed by a worker is selected from among a plurality of tasks, biometric information of the worker that can identify the worker's alertness level is acquired by the process of acquiring the biometric information,
A task for the worker to perform next from among the plurality of tasks acquired through the task acquisition process using biometric information of the worker that can identify the worker's alertness level acquired through the biological information acquisition process. select,
A method for controlling an information processing device. A program that causes a computer to execute a method for controlling an information processing device for managing the work of a worker, the program comprising:
The method for controlling the information processing device includes:
A process of acquiring a task that can acquire multiple tasks for a worker to work on;
a process of selecting a task to be performed by a worker from a plurality of tasks acquired by the task acquisition means;
A process for acquiring biometric information of a worker that can identify the level of alertness of a worker working on multiple tasks;
has
The selection process is
Each time a task to be performed by a worker is selected from among a plurality of tasks, biometric information of the worker that can identify the worker's alertness level is acquired by the process of acquiring the biometric information,
A task for the worker to perform next from among the plurality of tasks acquired through the task acquisition process using biometric information of the worker that can identify the worker's alertness level acquired through the biological information acquisition process. select,
program.

Images