JP5115173B2 - Information processing apparatus, information processing system, and information processing program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing system, and an information processing program for displaying a plurality of information such as an audio audible display of an e-mail or a document read out in parallel with main work. More specifically, the present invention relates to an information processing apparatus, an information processing system, and an information processing program capable of displaying information in parallel without interfering with main work in a multitask environment in which a plurality of works are performed in parallel.

  Conventionally, an apparatus that supports simultaneous processing of a plurality of information is known.

  For example, when simultaneously processing a plurality of types of character information, it is possible to easily recognize a plurality of pieces of information by changing the presentation format of one of the character information to speech (for example, patents). Reference 1).

  Moreover, what controls audio | voice output information according to the driving | operation load of a driver | operator is known about the format output from the audio | voice output apparatus mounted in the motor vehicle. Specifically, when recognizing information such as e-mails while driving a car, if the driver's driving load is heavy, such as when the speed of the car is high, the voice reading speed may be slowed down or read out. By providing a pause period at the punctuation mark, it is possible to promote understanding of the audio output information (see, for example, Patent Document 2).

  In addition, when recognizing information such as e-mails while driving a car, if the driver's driving load is heavy, such as when the speed of the car is high, shorten the continuous speech reading time or increase the volume. By doing so, it is possible to promote understanding of the voice reading information (see, for example, Patent Document 3).

JP 2007-148654 A JP 09-329458 A JP 2003-099080 A

  However, in multitasking in which multiple tasks are performed in parallel, when the load is high, increasing the volume may hinder the main task even though it can facilitate understanding of the speech-to-speech information. is there.

  The present invention has been made in view of the above problems, and an object thereof is to provide an information processing apparatus, an information processing system, and an information processing program capable of displaying information in parallel without interfering with main work. To do.

In order to solve the above-described problem, in the information processing apparatus according to the first embodiment of the present invention, the degree of concentration in the main work is determined based on the input interval of the operation signal from the input device, the movement amount of the line of sight, and the change in the brain wave. Determining means based on at least one, and determining means for determining the input interval of the operation signal based on at least one of a key input amount per unit time, a window switching number, and a page scroll amount ; If the determination means determines that the degree of concentration on the main work is high, how is the other information reduced so as to reduce the obstruction of the main work due to the display of other information performed in parallel with the main work setting means for setting whether the display condition is displayed on the other information is, in parallel the in principal work, the display control hand Gosuru by cormorants system is displayed according to the setting result by the setting means When, is characterized in that it comprises a. Thereby, information can be displayed in parallel without obstructing the main work (work). In other words, since an environment is provided for simultaneously processing a plurality of works whose actions that inhibit the execution of the main work are controlled, a plurality of works can be efficiently processed. In addition, this makes it possible to determine the concentration level of the main work from various angles, and to determine the concentration level without error. For example, in the determination from the input operation or the like, even if the input amount is small and the concentration level can be determined to be low on the surface, the thinking concentration level may be increased internally. In this case, if the judgment is made based on the change in the electroencephalogram, it can be seen that the degree of concentration is high, and the superficial concentration degree judgment error can be corrected.

In the information processing apparatus according to the second embodiment of the present invention, in contrast to the first embodiment, the setting means reads the number of characters read out per unit time as a display condition for the other information displayed in parallel. The audible display condition is set based on at least one of the sound volumes to be read out.

In the information processing apparatus according to a third embodiment of the present invention, the volume of the spoken voice is characterized in that is set smaller in accordance with increase in the degree of concentration of the to main working. As a result, the main work (work) can be executed efficiently without being disturbed by the read-out speech even if the degree of concentration is high, and the subordinate work is also efficient in accordance with the concentration of the main work. Multitask work (multi-layer work) can be executed efficiently. That is, it is possible to reduce an obstacle to processing for a worker's main work.

In the information processing apparatus according to the fourth embodiment of the present invention, in the first embodiment, the determination unit displays the degree of concentration corresponding to the input interval of the operation signal other than the main work. The correction is made based on the processing amount for the information. This makes it easy and quick to concentrate on the main work from the processing amount of the sub work for the display information other than the main work, that is, the display information displayed in parallel.

In the information processing apparatus according to the fifth embodiment of the present invention, in contrast to the first embodiment, the determination means determines the amount of movement of the line of sight in a unit time within the display screen for performing the main work. The degree of concentration is judged to be the distance between the two furthest points among the positions indicated by.

In the information processing apparatus according to the sixth embodiment of the present invention, in contrast to the first embodiment, the determination means determines the amount of movement of the line of sight in unit time within the display screen for the main work. The degree of concentration is judged to be an area formed by four points having the maximum value and the minimum value of the two-dimensional coordinates among the positions indicated by.

  Note that a button group for processing information displayed in parallel may be provided for the first embodiment. As a result, smooth processing can be performed even during execution of the main work, and an efficient multilayer work can be executed easily and quickly.

The button group may be a foot switch. As a result, it is possible to perform smooth processing without hindering key input and mouse operation for main work, and it is possible to execute an efficient multilayer work easily and quickly.

In the information processing apparatus according to the seventh embodiment of the present invention, the content of the other information displayed by the display control means is a text, a title, a sender, a creator, and a reception as compared with the first embodiment. It is characterized by being at least one of the days. Thereby, the contents can be understood effectively and a plurality of information can be processed quickly.

In the information processing system according to the eighth embodiment of the present invention, the degree of concentration on the main work is determined based on at least one of the input interval of the operation signal from the input device, the amount of movement of the line of sight, and the change in the electroencephalogram. A determination unit that determines the input interval of the operation signal based on at least one of a key input amount per unit time, a window switching number, and a page scroll amount; and the determination unit determines whether to input the main work. When determining that the degree of concentration is high, display conditions for how the other information is displayed so as to reduce the obstruction of the main work due to the display of other information performed in parallel with the main work setting means for setting a said other information is, parallel to the principal working, and audible display control means for controlling so that indicated audibly table according to the setting result by the setting means, was the main It is characterized in that it comprises a visible display control means for displaying on the display screen information for work. This Ri by the, it is possible to display a parallel information without interfering with serving as a main work (work). In other words, since an environment is provided for simultaneously processing a plurality of works whose actions that inhibit the execution of the main work are controlled, a plurality of works can be efficiently processed. In addition, this makes it possible to determine the concentration level of the main work from various angles, and to determine the concentration level without error. For example, in the determination from the input operation or the like, even if the input amount is small and the concentration level can be determined to be low on the surface, the thinking concentration level may be increased internally. In this case, if the judgment is made based on the change in the electroencephalogram, it can be seen that the degree of concentration is high, and the superficial concentration degree judgment error can be corrected.

In the information processing system according to the ninth embodiment of the present invention, as compared with the eighth embodiment, second visible display control for displaying the other information on a display screen in parallel with the main work. Means are provided.

In the information processing program according to the tenth embodiment of the present invention, the computer is set to at least one of the concentration of the main work, the input interval of the operation signal from the input device, the movement amount of the line of sight, and the change of the electroencephalogram. A determination means for determining the input interval of the operation signal based on at least one of a key input amount per unit time, the number of window switchings, and a page scroll amount; How to display the other information so as to reduce the obstruction of the main work due to the display of other information performed in parallel with the main work. setting means for setting a display condition, and the display control said other information is, parallel to the principal working, controlled so as to be displayed according to the setting result by the setting means It is intended to function as a step. Thereby, information can be displayed in parallel without hindering the main work (work). In other words, since an environment is provided for simultaneously processing a plurality of works whose actions that inhibit the execution of the main work are controlled, a plurality of works can be efficiently processed. In addition, this makes it possible to determine the concentration level of the main work from various angles, and to determine the concentration level without error. For example, in the determination from the input operation or the like, even if the input amount is small and the concentration level can be determined to be low on the surface, the thinking concentration level may be increased internally. In this case, if the judgment is made based on the change in the electroencephalogram, it can be seen that the degree of concentration is high, and the superficial concentration degree judgment error can be corrected.

  According to the present invention, it is possible to display a plurality of pieces of information such as a multitask work (multilayer work) in parallel without hindering the main work (work), and efficiently execute the multilayer work etc. It becomes possible. In other words, since an environment is provided for simultaneously processing a plurality of works whose actions that inhibit the execution of the main work are controlled, a plurality of works can be efficiently processed.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, exemplary embodiments of the invention will be described with reference to the drawings.

  The work (work) in the embodiment of the present invention described below is a personal work using a PC (information processing apparatus typified by a personal computer) as the main work performed in the information processing apparatus, and in parallel with the main work. The case where the information presented (displayed) is e-mail or document information will be described. Document information is a general document mainly composed of text. The multi-layer work support device 10 will be described as an information processing device. The term “presentation” is used in the same meaning as a display including a visual display such as a screen display, a permanent visual display for printing on a sheet or the like, and an audible display such as an audio output.

  FIG. 1 is a diagram illustrating an example of an external configuration of hardware of a multilayer work support device 10 according to an embodiment of the present invention. As shown in the figure, the multi-layer work support device 10 includes an information access device (input device) 16 (16a, 16b) in which three display devices 14 (14a to 14c) and a control button group for designating a display target are arranged. ) And an input / output interface (IF) 22. The multilayer work support device 10 also has an audible display speaker (not shown) that outputs a predetermined sound.

  The display devices 14a to 14c are provided on the front surface of the device main body 12, and are arranged in the horizontal direction. The display devices 14a to 14c are liquid crystal displays having display screens having the same screen size, for example. The display device 14 is a visible display device that is controlled by a control device 100 described later and displays predetermined information on a display screen. The term “display device” is used as a concept including a display unit and a display region included as a part of the display device.

  The display device 14 may be a virtual computer display. Further, the display device 14 may be composed of a display device other than the above-described liquid crystal display device such as a CRT (cathode ray tube), a PDP (plasma display panel), etc., and each may have a different screen size. Other display devices include an audible display device (not shown) that outputs sound information such as sound from a speaker or headphones, and may further include a printer that prints information on a sheet-like medium such as paper.

  In FIG. 1, the information access devices 16a and 16b are provided in front of the display device 14 with respect to the user and on both the left and right sides of the device main body 12, but may be either the left or right. . The information access device 16 is controlled by the control device 100 to display predetermined information, and further receives an input from the user and outputs it to the control device 100. The information access device 16 is preferably one that can flexibly display the key top, and for example, a touch panel can be considered. Further, the information access device 16 has a display screen for displaying display information from the control device 100 and the like, and is displayed on the display screen. The shape of the key top and the guidance display can be freely changed, and the guidance display is easy. A virtual key input unit may be used.

  The information access device 16 is provided with a plurality of buttons 18, and the control button group includes these buttons 18. The button 18 is assigned a predetermined operation such as a display target or calculation designation, and the information access device 16 receives a desired designation from the user when the button 18 is pressed (described later).

Information access device 16a, 16b between, and placing unit 20 to put put a predetermined object is disposed in the central area on the work table for performing input operations such as the upper surface of the mounting portion 20, An input device 26 such as a PC may be mounted. Here, the input device 26 includes, for example, a position indicating device such as a keyboard and a mouse, and is connected to the input / output IF 22 via the communication cable 24 to communicate data with the control device 100 of the multilayer work support device 10. To do. That is, the input device 26 is a display device (display device) together with a keyboard on which a user inputs execution instruction (command) information and various information for instructing execution of an application program (software) by operating a key or the like. 14) and a mouse that constitutes a user interface, and may further include an optical reader (scanner) that optically reads a document or the like written on a manuscript.

FIG. 2 is a block diagram illustrating a hardware configuration example of a computer system (information processing apparatus) used in the multilayer work support apparatus 10.

  As shown in FIG. 2, the multilayer work support device 10 includes a control device 100 (100a to 100e) and a relay device 112, and each of the control devices 100a to 100e includes a processing device 102 including a CPU 104 and a memory 106, A communication IF 108 and a storage device 110 are included.

  In the control device 100, the communication IF 108 communicates predetermined data with the other control device 100, the external input device 26, and the network 2 via the relay device 112.

  A CPU (Central Processing Unit) 104 controls each unit in accordance with a program stored in a memory (main storage device) 106.

  The memory (main storage device) 106 includes a ROM or a RAM, and is a program for performing information processing such as document creation / editing processing, multi-level work support processing such as concentration determination processing, condition setting processing, and text reading processing. Data and the like calculated by the CPU 104 are stored in the work area. More preferably, an image buffer for displaying an image on a display device (104, etc.) is included.

  The storage device 110 is a magnetic storage device such as a magnetic disk device represented by an HDD (hard disk drive) device or an optical storage device such as an optical disk device such as a CD device or a DVD device, and stores and reads data (reproduction). ) Further, it may be constituted by a semiconductor storage device such as a flash memory. Furthermore, the storage device 110 may store a large amount of data collected via a network or the like.

  As described above, the control device 100 includes a component as a computer that can perform information processing by executing a program and communication with another control device 100 or the like via a network.

  The relay device 112 relays data transmitted and received between the control devices 100, and is connected to an external computer (not shown) connected via the input device 26 and the network 2 via the input / output IF 22. Communicate. The relay device 112 may be realized as a server, and when the control device 100 is realized in a form having a network address such as a PC, the relay device 112 is directly connected to the P to P ( The control devices may be connected to each other by a peer-to-peer method.

  The control device 100a controls information displayed on the first display device 14a, the control device 100b controls information displayed on the second display device 14b, and the control device 100c Controls information displayed on the display device 14c. The control device 100d controls information displayed on the first information access device 16a and accepts an input from the first information access device 16a according to the display. Similarly, the control device 100e controls information displayed on the second information access device 16b and receives an input from the second information access device 16b according to the display. Thus, the display devices 14a to 14c and the information access devices 16a and 16b are controlled by different control devices 100, respectively. The control device 100 may be realized by a normal PC.

  Further, the control device 100a displays predetermined information on the second display device 14b, the third display device 14c, and the information access devices 16a and 16b. In this case, for example, the control device 100a communicates data with the control device 100b to display information on the second display device 14b. Further, the control device 100a receives data input from the information access devices 16a and 16b via the control devices 100d and 100e. Similarly, the control devices 100b to 100e display information on any of the display devices 14 and receive data from any of the information access devices 16.

  Any one of the control devices 100 may control the plurality of display devices 14 and the information access device 16 or may control all of them. One control device 100 may include a plurality of CPUs 104 and a memory 106.

  As described above, the control apparatus 100 as the main part of the information processing apparatus may be configured as an information processing apparatus (computer system) using a plurality of units as described above. If a processor develops and one control device 100 has sufficient processing capability for supporting a multi-layer workpiece, an information processing device may be configured by one control device 100. Hereinafter, in order to simplify the description, the functional configuration of the information processing apparatus will be described using the control apparatus 100x having the control apparatus 100 in which the functions are integrated in one unit (the reference numeral 100 in reference numeral 100 is a single unit or a plurality of units). The system also shows good meaning).

  FIG. 3 is a block diagram illustrating a functional configuration of the information processing apparatus according to the present exemplary embodiment. In the figure, the control device 100x stores the history of information necessary for the determination of the degree of concentration in the input information, and manages the history of the work based on the stored contents of the history management unit 50. A degree-of-concentration determination unit 51 for determining the degree of concentration on the condition; a condition setting unit 52 for setting display conditions for information displayed (presented) in parallel based on the determination result of the concentration level determination unit 51; A display control unit 53 that performs display control of a plurality of information based on information such as document information based on set conditions and document creation processing according to input information by a document processing unit (not shown), and displayed in parallel And an audible display control unit 54 that performs audible display control such as reading a text.

  The visible display unit 61 displays visible information on a display screen or the like based on the control of the display control unit 53. In the multilayer work support device 10 described above, a display screen of the display device 14 (14a to 14c), etc. To display.

  The audible display unit 62 generates, as synthesized speech information, reading contents corresponding to text included in a document displayed in parallel by the audible display control unit 54, and outputs the created synthesized speech information through a speaker or headphones. It is.

  The permanent visual display unit 63 prints information on a sheet or the like as a recording medium based on the control of the display control unit 53.

  The control apparatus 100x of the information processing apparatus according to the present embodiment may be realized by cooperation of a plurality of control apparatuses 100 as shown in the multilayer work support apparatus 10 as a representative example, or may be powerful with a single control apparatus 100. It may be realized by a control device including a CPU with a multiprocessor, a multi-core or the like having an appropriate processing capability. Here, it demonstrates functionally as follows.

  Processing necessary for controlling information to be presented in parallel with the main work, that is, (1) determination processing of the degree of concentration of the main work, and (2) determination processing for presenting (displaying) information to be presented (displayed) in parallel (3) Processing of information presented (displayed) in parallel will be described.

  First, the determination (determination) process of the concentration level of the main work by the concentration level determination unit 51 will be described.

  FIG. 4 shows a specific example of determination processing for determining the degree of concentration of the worker on the main work. The information processing apparatus performs an operation log (operation history) on an operation performed on an operator's main work execution window on the display screen of the visible display unit 61 from an input device (for example, the input device 26) such as a keyboard and a mouse. ) Is recorded in the history management unit 50. The degree of concentration on the main work is determined based on the size of the operation interval. Specifically, it is determined that the degree of concentration is higher as the key input interval from the keyboard is shorter.

  For example, when the key input interval is expressed by the average number of inputs (input speed) performed per minute, the degree of concentration is determined by classifying into five stages. Since the relationship between the key input speed and the degree of concentration differs depending on the work content and the operator's keyboard operating skill, the operator can freely change the setting.

  Furthermore, the relationship between the key input speed and the processing amount per unit time (additional information processing speed) of information presented in parallel can be measured and analyzed, and the relationship of the degree of concentration can be automatically changed.

  For example, as shown in FIG. 4, the initial concentration determination setting is 1 (concentration: high) at an input speed of 100 / min, 2 (concentration: slightly high) at 80 / min, and 3 at 60 / min. (Concentration: medium), 4 at 40 / min (concentration: slightly low), and 5 (concentration: low) at 20 / min. If the actual additional information processing speed is 1, 1, 1, 3, or 10 at this time, the level where there is no change in the processing amount is invalid. It is judged that the corresponding input speed setting is too large, and as shown in FIG. 5, 1 (concentration: high) at an input speed of 60 / min, 2 (concentration: slightly high) at 40 / min, 30 / Shift the input speed corresponding to the level of 3 (concentration; medium) at 20 minutes, 4 (concentration; slightly low) at 20 / minute, and 5 (concentration: low) at 10 / minute to the low speed side. , Automatically reset.

  The details of the determination of the processing speed of the additional information will be described later, but when the information can be browsed on one screen, the number of target windows is switched, and when browsing the information requires scrolling or page turning. Calculate with the number of screen operations.

  An index for keyboard input is a determination method that is effective mainly for simple input tasks. On the other hand, when a document is being browsed, there is almost no keyboard input, and page turning, scrolling, window switching, and the like by a mouse operation are used as criteria. In this case, as shown in FIG. 6, the degree of concentration is determined using the operation speed of the mouse as an index.

  Further, the degree of concentration on the main work may be determined by a line of sight. For the determination of the degree of concentration by line of sight, general line-of-sight input devices using a USB (Universal Serial Bus) connection are already known and can be used. When the line-of-sight input device is used, the input information is recorded in the history management unit 50 and is referred to by the concentration level determination unit 51 to determine the concentration level. The position of the line of sight is recognized as the cursor position of the mouse, and the high degree of concentration is determined based on a certain movement pattern such as fast movement or wide range. For example, as shown in FIG. 7, the distance moved per second is calculated from the XY coordinates of the cursor position. Alternatively, as shown in FIG. There is a method of calculating from four points having the maximum value and the minimum value (two-dimensional coordinates).

  When an operator's action is more thoughtful than input or browsing, actions such as key input and mouse operation decrease. In this case, it is also possible to utilize an electroencephalogram in order to appropriately determine whether the concentration level is decreasing or the concentration level is increasing due to thought. The measurement result of the electroencephalogram is stored as input information in the history management unit 50 and is referred to by the concentration level determination unit 51 to determine the concentration level. For example, evaluation based on the content ratio of α waves in the entire frequency range can be given.

  These concentration determination methods may be used alone or in combination. When a plurality of methods are used in combination, it is possible to use a level of a determination method that shows a higher degree of concentration, or use a simple average or a weighted average of levels in a plurality of determination methods.

  Next, a determination (setting) process by the condition setting unit 52 for determining (setting) a presentation (display) condition for information to be presented (displayed) in parallel will be described. First, adjustment of presentation (display) conditions according to the degree of concentration of an operator on the main work window in presentation (display) of additional audio information will be described.

  As shown in FIG. 9, the volume of the reading voice is set to the volume at the noise level of the museum as a standard condition, and is about 40 dB (A), for example.

  For this standard condition, the volume is set to be smaller as the concentration level becomes higher so as not to hinder the main work. For example, in the case of the concentration level 2, it is 35 dB (A), which is about a hospital room, and the highest concentration level. At a concentration level of 1, it is 30 dB (A), which is a very quiet office room. On the other hand, the volume is set to increase as the concentration level decreases. For example, when the concentration level is 4, the level is 45 dB (A), which is about the level of a library reading room. 50dB (A) of the noise level that can be spoken by voice). This value is a setting for performing a plurality of information recognitions in parallel, and the maximum value of the volume when the concentration level is the lowest is preferably the noise level during general conversation, for example 60 dB ( A) It is not preferable to make the size larger than necessary, for example, because the worker often feels uncomfortable.

  The volume adjustment is not limited to these. For example, when the concentration level exceeds a certain level, it is possible to stop presenting information by all methods such as reading aloud. Further, when the sub document corresponding to the speech reading is displayed on the screen (for example, sub window) of the visible display unit 61, the screen may be automatically scrolled when the speech reading is stopped.

  The reading volume is preferably adjusted periodically according to the degree of concentration in the main work, for example, every 5 minutes, more preferably every 1 minute.

  Further, as shown in FIG. 10, the presentation of the additional audio information is initially performed at a normal document reading speed. For example, the concentration of the main work window on the general kana-kanji mixed document is shown. Corresponding to the intermediate level 3, it is set to about 400 characters per minute.

  The reading speed is set slower as the degree of concentration is higher than the standard condition so as not to hinder the main work. For example, at the degree of concentration 2, 300 characters per minute and the degree of concentration having the highest degree of concentration are set. 1 is 200 characters per minute. On the other hand, the reading speed is set faster as the degree of concentration decreases. For example, when the degree of concentration is 4, the character is 500 characters per minute, and when the degree of concentration is the lowest, the character is 600 characters per minute.

  Note that the reading speed with respect to the concentration shown here is an example, and different settings can be made for each user of the apparatus.

  Further, the adjustment of the reading speed is not just for uniform reading, but is also performed by including a reading pause time for each fixed amount of reading. For example, as shown in FIG. 11, the reading condition when the degree of concentration is the minimum level 5 is continuous reading without pause, and as the degree of concentration increases, a reading pause time is provided before the reading point, and this value Adjust. Specifically, it is 1 second when the concentration is 4, 2 seconds when the concentration is 3, 4 seconds when the concentration is 2, and 8 seconds when the concentration is 1. This value can be freely set for each worker.

  In addition, a pause time may be inserted before a punctuation mark, or a pause time may be inserted for each paragraph. And these may be used independently and may be used combining plurality. For example, as shown in FIG. 12, when the degree of concentration is 5 at the lowest, it is assumed that there is no intentional pause time, and when the degree of concentration is 4, the pause between paragraphs is 2 seconds and the degree of concentration is 3. If there is a pause between paragraphs and 2 seconds before reading, if the degree of concentration is 2, pause between paragraphs and 2 seconds before reading and 2 seconds before reading and 1 second before pause When the degree of concentration is 1, the pause between paragraphs is 4 seconds, the pause before reading is 4 seconds, and the pause before paragraph is 1 second.

  Note that the adjustment of the reading speed and the reading volume may be used alone or in combination. For example, when the window switching is slow and the key input is fast in the main work window, it is assumed that only visual information is input and the thinking load is light. In such a case, as shown in FIG. 13, there is a certain margin in the ability to process auditory stimuli, and for information that can be easily understood using existing knowledge, the volume is fixed and the speed is fixed. One way is to slow down. On the other hand, when there is no window switching and key input is slow, it is assumed that the thinking load is large, and reducing the volume with a constant reading speed is a preferable adjustment method to reduce the obstruction of the main work. Can be considered.

  Further, when the window switching is fast, adjustments such as slowing down the speed and reducing the volume are preferably used.

Basically, these additional information presentation (display) conditions are always adjusted according to the concentration level, but if there is no change in the concentration measurement, further adjustments are made. Is done. That is, there may be a case where the concentration level of the worker is not properly expressed, for example, when the determination method has determined that the concentration level is high but the concentration is not at all. Therefore, when the concentration level does not change for a certain period, the additional information presentation condition can be changed to a condition in which the concentration level is one level lower than the determination value. Such adjustment is expected not only to respond to an appropriate concentration level but also to have an effect of daily multi-work capability development. In other words, not only always presenting the same additional information with a certain degree of concentration, but also presenting it under conditions with a larger amount of processing can be expected to increase the ability of multiple works.

  Next, with respect to the adjustment of the above-described additional information presentation (display) condition, an embodiment will be described in which the processing content of the additional information of the worker is detected and the presentation condition is adjusted. Specifically, if there is no processing input for the displayed additional information and the system automatically determines that it is not yet processed, it is determined that the degree of concentration on the main work is high, and the subsequent subwork presentation condition is 1 Step down. In the case of performing processing in combination with a plurality of conditions, any one of them can be applied, or it can be applied to a plurality of conditions. In the configuration example of the information processing apparatus in FIG. 3, for example, the processing status of the worker's additional information is stored in the history management means 50 from the corresponding input information, and this is stored in the concentration determination unit. 51 makes a determination with reference to the result and notifies the condition setting unit 52 of the determination result, and the condition setting unit 52 sets a condition in response to the notification.

  As described above, when the condition is set by the condition setting unit 52, the audible display control unit 54 of the display control unit 53 performs audible display control such as text-to-speech processing on the basis of the set condition. Is called. For example, under the control of the display control unit 53, the main work window is displayed on the main screen of the visible display unit 61, and the sub document (additional) is concurrently displayed on the sub screen of the visible display unit 61. An additional information window (subwindow) on which the target information is displayed is displayed. In one example of the multi-layer work support device 10, a main work window is displayed on the central display device 14c, and an additional information window is displayed on the right display device 14b (see FIG. 14 described later). For example, the main work window is used to create and edit the main document, and the additional information window is used to display a reference document and display an e-mail as a sub document. After the visual display is performed in this manner, the audible display control unit 54 reads out a predetermined text portion of the sub document (additional information), and converts the text into synthesized speech under the conditions set by the condition setting unit 52. The converted sound is output from the speaker or the like of the audible display unit 62.

  Next, control and processing based on an operator's input operation of information presented (displayed) in parallel will be described.

  Information to be additionally presented (displayed) is basically automatically updated in content presented. For example, in browsing a plurality of document materials, when reading of a certain material ends, reading of the next material starts. However, when it is necessary to perform some processing after recognition, such as checking an e-mail, the input device provided in the multi-layer work support apparatus 10 as the information processing apparatus according to the embodiment of the present invention is used.

  FIG. 14 shows an example of the information access device 16 (16a, 16b) as an input device necessary for processing. As described with reference to FIG. 1, general operations on the window can be performed from the input device 26 (including a keyboard and a mouse (not shown)) placed on the placement unit 20 and connected to the PC. . However, in addition to this, when the worker recognizes information to be additionally presented (displayed), the operator can also perform operations using other various function buttons realized by the information access device 16 (16a, 16b). On the information access device 16 (16a, 16b), a work button group 18a and a function button group 18b are displayed. For these buttons, that is, in FIG. 14, as the function button group 18b of the information access device 16b, “forward” and “return” functions corresponding to scrolling and page turning, “delete” for mail and document files. The “save” function, the “next document” and “previous document” functions for presenting previous and subsequent materials without processing are set.

  Further, as shown in FIG. 15, the information processing apparatus (multilayer work support apparatus 10) according to the embodiment of the present invention has a foot switch 26 f in which a function similar to the function button group 18 b is set as an additional function of the input device 26. May be provided. By providing the foot switch 26f, in addition to information presentation (display) means for simultaneously recognizing a plurality of information, a function for supporting simultaneous execution of various processes can be added.

  The information display format of the present invention is basically reading out the entire document. However, in the case of information having a plurality of attribute information such as title, text, sender, and reception date, such as e-mail, it can be read out only to specific attribute information. For example, the initial setting is to read only the title, and the reading target can be freely changed at any time by the function button group 18b shown in FIG. In addition, a function may be provided as a “detail” button, for example, for temporarily reading other attribute information for only the target material after the reading is performed without changing the reading target. In the figure, a “detail” button is displayed on the function button group 18b of the information access device 16a on the left side.

  In the embodiment described above, the multi-layer work support is described. However, the present invention is not limited to the multi-layer work, and it is necessary to display a plurality of pieces of information in parallel so that the worker understands the display contents without disturbing the main work. The present invention can also be applied to the case where there is.

  The present invention is used in an information processing apparatus, an information processing system, an information processing program, and the like capable of displaying information in parallel without interfering with main work in a multitasking environment in which a plurality of work is performed in parallel. The

It is a figure which shows the structural example of the multilayer work assistance apparatus which concerns on the Example of this invention. It is a block diagram which shows the hardware structural example of the multilayer work assistance apparatus which concerns on the Example of this invention. It is a block diagram which shows the functional structural example of the information processing apparatus which concerns on the Example of this invention. It is a figure explaining the determination process of the concentration degree which concerns on the Example of this invention. It is a figure explaining the reset process of the determination criterion of the concentration degree which concerns on the Example of this invention. It is a figure explaining another determination processing of the concentration degree which concerns on the Example of this invention. It is a figure explaining another judgment processing of the degree of concentration concerning the example of the present invention. It is a figure explaining other determination processes of the concentration degree which concern on the Example of this invention. It is a figure explaining the setting processing of the additional information display condition by volume adjustment. It is a figure explaining the setting process of the additional information display condition by reading speed adjustment. It is a figure explaining another setting processing of additional information display conditions by reading speed adjustment. It is a figure explaining further another setting processing of additional information display conditions by reading speed adjustment. It is a figure explaining the setting processing of additional information display conditions by compound conditions. It is a figure explaining the additional function of the information processing apparatus which concerns on the Example of this invention. It is a figure explaining the foot switch function added to the information processing apparatus which concerns on the Example of this invention. It is a figure explaining another additional function of the information processing apparatus which concerns on the Example of this invention.

Explanation of symbols

2: Network 10: Multi-layer work support device 12: Device body 14: Display device 16: Information access device 18: Button 20: Placement unit 22: Input / output IF
24: Communication cable 26: Input device 26f: Foot switch 50: History management unit 51: Concentration determination unit 52: Condition setting unit 53: Display control unit 54: Audible display control unit 61: Visible display unit 62: Audible display unit 63 : Permanent visible display unit 100, 100x: Control device 102: Processing device 104: CPU
106: Memory 110: Storage device 112: Relay device

Claims (10)

The degree of concentration in the main work is determined based on at least one of the input interval of the operation signal from the input device, the amount of movement of the line of sight, and the change of the electroencephalogram, and the input interval of the operation signal is determined per unit time. A determination means for determining based on at least one of a key input amount, a window switching number, and a page scroll amount ;
If the determination means determines that the degree of concentration on the main work is high, which of the other information is reduced so that obstruction of the main work due to display of other information performed in parallel with the main work is reduced. Setting means for setting the display condition of whether or not to be displayed,
It said other information is, and the parallel to the principal working, the display control means Gosuru by cormorants system is displayed according to the setting result by the setting means,
An information processing apparatus comprising:   The setting means sets the audible display condition based on at least one of the number of characters to be read per unit time and the volume of the voice to be read as a display condition for the other information displayed in parallel. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 2, wherein a volume of the voice to be read is set to be small in accordance with an increase in the degree of concentration on the main work. The information processing apparatus according to claim 1 , wherein the determination unit corrects the degree of concentration corresponding to the input interval of the operation signal based on a processing amount for display information other than the main work. . The determination means determines the degree of concentration by regarding the amount of movement of the line of sight as the distance between the two farthest points among the positions indicated by the line of sight in a unit time within the display screen where the main work is performed. The information processing apparatus according to claim 1 . The determination means forms the movement amount of the line of sight with four points having the maximum value and the minimum value of the two-dimensional coordinates among the positions designated by the line of sight in the unit time in the display screen for performing the main work. The information processing apparatus according to claim 1 , wherein the degree of concentration is determined to be an area to be processed.   2. The information processing apparatus according to claim 1, wherein the content of the other information displayed by the display control means is at least one of a text, a title, a sender, a creator, and a reception date. . The degree of concentration in the main work is determined based on at least one of the input interval of the operation signal from the input device, the amount of movement of the line of sight, and the change of the electroencephalogram, and the input interval of the operation signal is determined per unit time. A determination means for determining based on at least one of a key input amount, a window switching number, and a page scroll amount ;
If the determination means determines that the degree of concentration on the main work is high, which of the other information is reduced so that obstruction of the main work due to display of other information performed in parallel with the main work is reduced. Setting means for setting the display condition of whether or not to be displayed,
It said other information is, parallel to the principal working, and audible display control means for controlling so that indicated audibly table according to the setting result by the setting means,
Visible display control means for displaying information for the main work on a display screen;
An information processing system comprising: 9. The information processing system according to claim 8 , further comprising second visible display control means for displaying the other information on a display screen in parallel with the main work. Computer
The degree of concentration in the main work is determined based on at least one of the input interval of the operation signal from the input device, the amount of movement of the line of sight, and the change of the electroencephalogram, and the input interval of the operation signal is determined per unit time. A determination means for determining based on at least one of a key input amount, a window switching number, and a page scroll amount ;
If the determination means determines that the degree of concentration on the main work is high, which of the other information is reduced so that obstruction of the main work due to display of other information performed in parallel with the main work is reduced. Setting means for setting the display condition of whether or not to be displayed, and
Said other information is the parallel to the principal working, the information processing program for functioning as display control means for controlling so as to be displayed according to the setting result by the setting means.

Images