JP2007156877A - Multilayer work support apparatus, display method for multilayer work support apparatus, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a multilayer work support apparatus that can facilitate data management and search among a plurality of computers. <P>SOLUTION: When an object is dragged as at an arrow A toward a center display 14a and further to the right from the right end of a display 14b, the multilayer work support apparatus 10 displays the object to the center display 14a as at an arrow B. A display program 200 executes search processing according to file information received from a control device 100b corresponding to the left display 14b. The display program 200 determines whether or not a file entity corresponding to the received file information is saved, and if there is a corresponding file entity, displays the file entity on the center display 14a and otherwise, displays a blank window. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technology for constructing a computing environment for efficiently tackling a large number of complicated works by functionally integrating a plurality of computing environments such as a personal computer, a display, and a speaker.

  There is a need for an environment that supports multiple operations in multiple layers. In such an environment, the user may proceed with work using a plurality of displays (corresponding to display areas) and a computer. In this case, the user needs to manage the document data among a plurality of computers and retrieve the document data from these computers.

Japanese Patent Application Laid-Open No. 2004-151561 discloses a technique that enables a drag operation between computers and transfers data simultaneously with the drag.
However, the technique disclosed in Patent Document 1 is a technique for realizing simple cooperation between a plurality of computers. Patent Document 1 does not disclose document storage associated with document movement between a plurality of computers.

JP 2001-136504 A

  The present invention has been made from the above-described background, and an object of the present invention is to provide a multi-layer work support system that can easily manage and retrieve data between a plurality of computers.

  In order to achieve the above object, a multilayer work support apparatus according to the present invention includes at least two display areas, at least two computers corresponding to the display areas, and the display area corresponding to one of the computers. Control means for moving and displaying the displayed object in the display area corresponding to a computer different from the computer, and when the control means moves the object, the object is preset for the object. And processing means for executing processing.

Preferably, the apparatus further includes movement instruction means for instructing the control means to move the object displayed in the display area to another display area.
Preferably, the processing unit executes at least one of processing of storing the target and searching for related information of the target when the target is moved by the control unit.

  Preferably, the information processing device further includes biological information detection means for detecting biological information, and the control means moves the object displayed in the display area based on the biological information detected by the biological information detection means. To display.

  A display method for a multi-layer work support apparatus according to the present invention corresponds to any one of the computers in a multi-layer work support apparatus having at least two display areas and at least two computers corresponding to each of the display areas. When the object displayed in the display area is moved and displayed in the display area corresponding to a computer different from the computer, a process set in advance for the object is performed in synchronization with the movement. .

  In addition, the display object moving method of the multi-layer work support device according to the present invention includes, for example, a button format by hardware, an event generation area specification format by a touch panel, an event generation specification format by a temperature sensing device, and a gaze and face direction detection device. In a multi-layer work support device that has a designation device of at least one of the event generation designation formats as an input device, accepts the event generated by pressurization, contact, overheating, gaze, etc. to the designation device and moves the display target To do.

  Furthermore, the program according to the present invention is displayed in the display area corresponding to one of the computers in a multi-layer work support apparatus having at least two display areas and at least two computers corresponding to the display areas. The step of performing a preset process on the target in synchronization with the movement when the target is moved to the display area corresponding to a computer different from the computer and displayed. Let the computer of the device execute.

  According to the multilayer work support apparatus according to the present invention, data management and retrieval can be easily performed among a plurality of computers.

FIG. 1 is a diagram showing a multilayer work support device 10 according to an embodiment of the present invention.
As shown in FIG. 1, the multi-layer work support device 10 is configured with the apparatus main body 12 as a center, and leg portions 40 that support the apparatus main body 12, displays 14 a to 14 c, and objects to be displayed on these displays 14 a to 14 c. Information access devices 16a and 16b in which a group of buttons to be specified are arranged, and an input / output interface (IF) 22 are provided. The multilayer work support device 10 also includes a speaker (not shown) that outputs a predetermined sound.
In addition, the leg part 40 may be detachable and the apparatus main body 12 may be mounted on a table etc. and used. Further, when any one of a plurality of components such as the displays 14a to 14c is indicated without being specified, the display 14 may be simply abbreviated.

The displays 14a to 14c are provided on the front surface of the apparatus main body 12, and are arranged in the horizontal direction. The displays 14a to 14c are liquid crystal displays having the same screen size, for example. The display 14 is controlled by the control device 100 described later and displays predetermined information. In this way, the display 14 constitutes a display area.
The display 14 may be a virtual computer display. The display 14 may be composed of a CRT, a PDP, or the like, and may have different screen sizes.

  The information access devices 16a and 16b are provided in front of the display 14 for the user and on both the left and right sides of the device main body 12. The information access device 16 includes, for example, a touch panel, and is controlled by the control device 100 to display predetermined information. Further, the information access device 16 receives an input from the user and outputs it to the control device 100. The information access device 16 may be provided on either the left side or the right side of the device body 12.

  The information access device 16 is provided with a plurality of buttons 18, and the button group includes these buttons 18. The button 18 is assigned a predetermined operation such as designation of a display target or calculation, and the information access device 16 receives a desired designation from the user when the button 18 is pressed. The operation when the button 18 is pressed will be described in detail later.

Between the information access devices 16a and 16b, a placement unit 20 on which a predetermined object is placed is provided. On the top surface of the placement unit 20, an input device 26 such as a personal computer (PC) is provided. It may be placed. Here, the input device 26 includes a pointing device such as a keyboard and a mouse, and is connected to the input / output IF 22 via the communication cable 24 to communicate data with the control device 100 of the multilayer work support device 10.
Using such a multi-layer work support device 10, a user accesses a Web page provided via a network, a file stored in a storage device, and the like to perform many tasks in a multi-layer manner.

FIG. 2 is a diagram illustrating a hardware configuration of a computer used in the multilayer work support device 10.
As shown in FIG. 2, the multilayer work support device 10 includes control devices 100 a to 100 e and a relay device 112, and each of the control devices 100 a to 100 e includes a processing device 102 including a CPU 104 and a memory 106, a communication IF 108, And a storage device 110.

In the control device 100, the communication IF 108 communicates predetermined data with the other control device 100, the external input device 26, and the network 2 such as a LAN or WAN via the relay device 112. The storage device 110 is, for example, an HDD device, a CD device, or a DVD device, and stores and reproduces data.
As described above, the control device 100 includes a component as a computer that can perform information processing by executing a program and communication with another control device 100 or the like via a network.

  The relay device 112 relays data transmitted and received between the control devices 100, and is connected to an external computer (not shown) connected via the input device 26 and the network 2 via the input / output IF 22. Communicate. The relay device 112 may be realized as a server. When the control device 100 has a network address such as a PC, a plurality of control devices 100 are connected via the relay device 112. Instead, they may be connected directly by the PtoP method.

  Further, the control device 100a controls information displayed on the first display 14a, the control device 100b controls information displayed on the second display 14b, and the control device 100c controls the information displayed on the third display 14c. Control the information displayed on the screen. The control device 100d controls information displayed on the first information access device 16a and receives an input from the first information access device 16a. Similarly, the control device 100e controls information displayed on the second information access device 16b and receives an input from the second information access device 16b. Thus, the displays 14a to 14c and the information access devices 16a and 16b are controlled by different control devices 100, respectively. The control device 100 may be realized by a normal PC.

  Furthermore, the control device 100a displays predetermined information on the second display 14b, the third display 14c, and the information access devices 16a and 16b. In this case, for example, the control device 100a communicates data with the control device 100b to display information on the second display 14b. Further, the control device 100a receives data input from the information access devices 16a and 16b via the control devices 100d and 100e. Similarly, the control devices 100b to 100e display information on any of the displays 14 and receive data from any of the information access devices 16.

  Note that any one of the control devices 100 may control the plurality of displays 14 and the information access device 16 or may control all of them. One control device 100 may include a plurality of CPUs 104 and a memory 106.

FIG. 3 is a diagram illustrating a specific system configuration diagram of the multi-layer workpiece support apparatus 10.
As illustrated in FIG. 3, the control devices 100 a to 100 c and the displays 14 a to 14 c may be realized by a personal computer, and the input device 26 may be realized by a keyboard and a mouse. The relay device 112 is realized by a management server, and the input device 26 such as a mouse is connected to the management server 112 via the communication cable 24. The management server 112 performs output switching to the control devices 100a to 100c and the displays 14a to 14c, which are output systems, according to the operation request of the input device 26. As will be described later, the management server 112 constitutes a management unit, an input position detection unit, a processing output switching unit, and a virtual storage unit.

FIG. 4 is a diagram showing the drag operation and the data movement of the movement target associated therewith.
In FIG. 4, data 34a to 34c are data stored in the storage devices 110a to 110c, respectively. The pointers 30a to 30c are pointers displayed on the displays 14a to 14c, respectively. The icons 32a to 32c are icons in which data 34a to 34c are reflected on the displays 14a to 14c, respectively. Note that the icon 32 is displayed on the display 14 as an output system in the same manner as the pointer 30 on display, but the substance of the icon information exists in the system of the control device 100 including the processing device 102 and the storage device 110. To do.

  In the multilayer work support device 10 according to the present invention, data is moved between the plurality of processing devices 100 and the display 14. For example, the icon 32a is displayed as a result of the icon 32b being transferred from the display 14b (display corresponding to the control device 14b) to the display 14a (display corresponding to the control device 14a).

  When the pointer 30b existing on the display 14b is moved onto the display 14a by an operation via the input device 26, the input position detection unit of the management server 112 receives the display 14a and the control device from the display 14b and the control device 100b. It is determined that the processing output unit has been switched to 100a. Thereafter, the management unit of the management server 112 selects the control device 100a based on a predefined logical positional relationship table as a pointer operation transfer destination in the control device 100b, and the control device 100a can be connected. It is confirmed whether or not. Further, when the control device 100a is connectable, the management unit of the management server 112 receives the result, and the display position switching unit of the process switching unit of the management server 112 receives the display 14a and the control from the display 14b and the control device 100b. The pointer operation is transferred to the device 100a.

  In this way, the operation of the pointer 30b on the display 14b is taken over by the pointer 30a. During the above operation, when the icon 32b is requested to be transferred, the virtual storage unit of the management server 112 acquires and stores the icon 32b and the data 34b from the storage device 110b and stores the icon in the storage device 110a. 32a and data 34a are distributed. Thereby, the process regarding the icon is transferred from the control device 100b to the control device 100a, and the data 34a corresponding to the icon 32a is similarly transferred from the storage device 110b of the control device 100b to the storage device 110a of the control device 100a. . Here, the input device 26 such as a mouse constitutes a movement instruction means for giving an instruction to move the target displayed on the display 14 to another display 14.

FIG. 5 is a diagram illustrating a group of buttons displayed on the information access device 16.
As illustrated in FIG. 5, the button group includes information designation buttons 180-1 to 180-m and control buttons 182-1 to 182-n. Each button is displayed in a form and size that can be pressed. Is done. The information designation button 180 is displayed in the information designation button area indicated by the arrow S in the figure, and the control button 182 is displayed in the control button area indicated by the arrow T in the figure. The number of buttons 18 constituting the button group is not limited to this example, and the arrangement of the buttons 18 is not limited to the arrangement shown in FIG.

The information designation button 180 is a button for designating a target displayed on the display 14. The specified target includes a Web page, an electronic file held in the storage device 110, an electronic file held in another electronic device connected via the network 2, and the like.
For example, the button A is a button for displaying an electronic file of “Multiple Work Study 1” on the display 14. When the user presses the button A, the electronic file of the multiple work study 1 is displayed on at least one of the displays 14a to 14c. When the user presses the information specifying button 180 for accessing the Web page, the specified Web page is displayed on the display 14.

The control button 182 is a button for performing a predetermined operation on the target specified by the information specifying button 180. When the control button 182 is pressed, predetermined calculation, search, movement of the object, and the like are performed on the displayed object.
For example, the button B is a button for moving an object (window) activated on the display 14. When the button B is pressed with respect to a target activated on either the left or right display 14b, 14c, the target is closed and displayed on the center display 14a. Further, when the button B is pressed with respect to a target activated in the central display 14a, the target is closed and displayed on either the left or right display 14b or 14c. In this way, the movement button 182-1 constitutes a movement instruction unit that gives an instruction to move the target displayed on the displays 14a to 14c to the other displays 14a to 14c.

  In the designation of the target to be displayed and the designation of the control for the target, the input format is not limited to the button format, and may be, for example, a pull-down format or a format directly input by the user.

FIG. 6 exemplifies a file information sheet for managing a target designated by each information designation button 180.
As illustrated in FIG. 6, the file information sheet includes a file name, a storage location, a creation date, an update date, a window size, and a keyword.
The file name is the name of the file. The file name may be a character string displayed when the information specifying button 180 is displayed on the information access device 16, and a part of the file name may be displayed on the information access device 16. The file name may be an identifier that uniquely identifies the button 18 included in the button group.

The storage destination indicates a location where the target is stored, and for example, a path to a location where the target such as a URL or a file is stored, an IP address, or the like is designated.
The creation date is the date and time when the file was created, and the update date is the latest date and time when the file was updated. The window size is the size when the information specifying button 180 is displayed on the information access device 16.
The keyword is related information given to the target. A plurality of keywords may be set for one target.

  The user presses the information specifying button 180 or clicks with the mouse to access a Web page, an electronic file held in the storage device 110, another electronic device connected via the network 2, and the like. Instruct. The multilayer work support device 10 receives an instruction from the user, and displays the instructed target and a target related to the target on the display 14 based on the file information sheet. Related objects are searched based on keywords in the file information sheet.

Next, in order to facilitate understanding of the multilayer work support device 10 according to the present invention, an outline of the present invention will be described.
In this example, the control device 100b controls the information access devices 16a and 16b in addition to the left display 14b, the control device 100a controls the central display 14a, and the control device 100c controls the right display 14c. ing. When the target is displayed on the left display 14b, the target is stored in the control device 100b. When the target is displayed on the central display 14a, the target is stored in the control device 100a. When the target is displayed on the right display 14c, the target is stored in the control device 100c.

FIG. 7 is a diagram for explaining a method of moving and displaying an object displayed on the display 14b corresponding to the control device 100b to the displays 14a and 14c corresponding to the control devices 100a and 100c different from the control device 100b. It is.
As shown in FIG. 7, when the button X of the information access device 16a is pressed, an object specified by the button X is displayed, for example, on the left display 14b. The multilayer work support device 10 refers to the file information sheet (FIG. 6) stored in the control device 100b, acquires the file attribute and file entity, and displays them on the left display 14b.

When this object is moved in the direction of the center display 14a by the drag operation as indicated by the arrow A in the figure and further moved to the right from the right end of the display 14b, the object is It is moved and displayed on the center display 14a.
Further, when the object is moved in the direction of the right display 14b and further moved to the right from the right end of the display 14a, the object is moved and displayed on the right display 14c as indicated by an arrow C. .
The movement between the target displays 14 may be executed by movement buttons indicated by V and W in the drawing. The movement button is provided as one of the control buttons 182 and moves a target displayed on the display 14 to another display 14 via a display program 200 described later.

  When the object is moved from the left display 14b to the central display 14a, the file information is acquired by the control device 100b and then transmitted to the control device 100a. In the control device 100a, a file information search process is performed based on the transmitted file information. When the file entity is stored in the storage device 110 of the control device 100a, the file entity is displayed on the display 14a. When the file entity is not stored in the storage device 110 of the control device 100a, a saving process is executed, and the display 14a indicates that the file is being saved. The same applies when the object is moved from the center display 14a to the right display 14c.

FIG. 8 is a diagram for explaining a display method during a file entity saving process.
As illustrated in FIG. 8, when the target is moved from the other control device 100, the other control device 100 executes a process set in advance for the target. For example, if the file entity is not stored in the destination control device 100, the file entity is stored in the destination control device 100, and a blank window is displayed on the destination display 14a. In this example, when the target window is moved on the display 14b as indicated by the arrow A in the figure and the right end of the window is missing, a blank window of the same size is displayed on the display 14a. It is displayed like B. In the blank window, no object is displayed, and a message indicating that the file entity is being saved is displayed. Further, when the target is moved to the display 14c as indicated by the arrow C and is not stored in the control device 100c corresponding to the display 14c, the file entity is saved in the control device 100c, and the display 14c A blank window is displayed.

  As described above, when the user moves the target between the displays 14a to 14c, the control device 100 corresponding to the destination displays 14a to 14c performs a preset process (in this example, the file entity storage device 110). Is saved). For this reason, file backup is executed without the user being aware of it.

Next, the display program 200 for realizing the display method of the multilayer work support apparatus according to the present invention will be described.
FIG. 9 is a diagram showing a configuration of a display program 200 executed by the control device 100 of the multilayer work support device 10.
As illustrated in FIG. 9, the display program 200 includes a user interface (UI) unit 202, a communication unit 204, a control unit 206, a search unit 208, a display unit 210, a storage unit 212, and an information storage unit 214. The display program 200 moves the target displayed on the display 14 corresponding to one of the control devices 100 to the display 14 corresponding to the control device 100 different from the control device 100 by using these components. In doing so, a process preset for the object is performed in synchronization with the movement. In this example, in the destination control device 100, when the target is displayed on the display 14 corresponding to the control device 100, the control device 100 stores the target as a preset process.

  The display program 200 is supplied to the processing device 102 via, for example, the network 2 and the communication IF 108, loaded into the memory 106, and further using hardware on the OS operating on the processing device 102. Executed. Further, the display program 200 may be executed in all the control devices 100a to 100e, or may be executed in any one of the control devices 100.

  In the display program 200, the UI unit 202 accepts user operations on the information access device 16 and the input device 26, and outputs them to the components described later. Here, the user's operation includes pressing of the button 18 (including clicking with the mouse). Further, the UI unit 202 displays information (image data and the like) controlled by the display unit 210 (to be described later), processing contents of each component, and the like on the display 14 and the information access device 16.

  The communication unit 204 inputs / outputs data via the communication IF 108, and controls data transmission / reception in the multilayer work support device 10 via the relay device 112 and data transmission / reception with an external computer via the network 2. . The communication unit 204 may perform an encryption process for preventing falsification of transmitted information / data.

  The information storage unit 214 stores file information sheets such as the file information sheet shown in FIG. 6 and the latest file of the connection destination (Web page or the like) indicated by the information designation button 180, electronic files of document creation software or spreadsheet software. To do. The information storage unit 214 is realized by the storage device 110 (FIG. 2) and the memory 106.

The control unit 206 receives an input made by the user pressing the information designation button 180 and an input made using the input device 26 via the UI unit 202, and designates the specified target file information (attribute and file entity). The information is acquired from the information storage unit 214 via the search unit 208.
In addition, the control unit 206 transmits and receives file information via the communication unit 204 and the control unit 206 of the display program 200 operating on the other control device 100. When receiving the file information, the control unit 206 controls a search unit 208 described later to execute a file information search process based on the file information. When the file entity corresponding to the file information is not stored in the information storage unit 214, the control unit 206 controls the storage unit 212 described later to store the file entity in the information storage unit 214.

Further, the control unit 206 controls the display unit 210 based on the presence or absence of a file entity corresponding to the transmitted file information.
In this way, the control unit 206 moves the target displayed on the display 14 corresponding to one of the control devices 100 to the display 14 corresponding to the control device 100 different from the control device 100 and displays the target. The control means is configured.

  The search unit 208 receives the target specified via the information specifying button 180 or the transmitted file attribute from the control unit 206, and searches the file information by referring to the file information sheet stored in the information storage unit 214. Process. The search unit 208 outputs the search result to the control unit 206. In this way, the search unit 208 executes a process (file information search process) preset for the target when the control unit 206 transmits / receives the file information and moves the target. Configure.

  The display unit 210 displays the target instructed via the information specifying button 180. Here, the display target includes, for example, window display of application software (spreadsheet software, document creation software, remote conference software, etc.) for executing business, Web page display, and the like.

  In addition, the display unit 210 is controlled by the control unit 206 to display the target on the display 14 corresponding to the control device 100 on which the display program 200 operates in a display mode based on the presence or absence of the file entity. When the file entity is stored in the information storage unit 214, the display unit 210 displays the file entity on the display 14, and otherwise displays a blank window of the same size. Here, the display unit 210 displays a message indicating that the file is being saved in a blank window. In this way, the display unit 210 constitutes processing means for executing processing (display processing) preset for the target when the control unit 206 transmits / receives file information and moves the target. To do.

  The storage unit 212 is controlled by the control unit 206 to store the target file entity in the information storage unit 214. In this way, the storage unit 208 constitutes processing means for executing processing (preservation processing) preset for the target when the control unit 206 transmits / receives file information and moves the target. To do.

FIG. 10 is a flowchart showing display method determination processing (S10) executed by the display program 200 in the target control apparatus 100 of the movement destination.
As shown in FIG. 10, in step 100 (S100), the control unit 206 of the display program 200 (FIG. 9) is connected via the communication unit 204 from the control unit 206 of the display program 200 operating on the other control device 100. The file information retrieved by the other control device 100 is received.

  In step 102 (S102), the control unit 206 causes the search unit 208 to execute a file information search process based on the received file information. The search unit 208 searches the file entity based on the file information sheet stored in the information storage unit 214 and outputs the search result to the control unit 206.

In step 104 (S104), the control unit 206 determines whether or not a file entity corresponding to the received file information exists in the information storage unit 214. The display program 200 proceeds to the process of S108 if the corresponding file entity exists, and proceeds to the process of S106 otherwise.
In step 106 (S106), the storage unit 212 is controlled by the control unit 206 to store the file entity in the information storage unit 214.

  In step 108 (S108), the display unit 210 is controlled by the control unit 206 to determine a display method of the target on the display 14. More specifically, when the corresponding file entity exists, the display unit 210 determines to display the file on the display 14 in a window. The display unit 210 may display a file by newly starting application software corresponding to the file. The display unit 210 determines that a blank window is displayed on the display 14 when the corresponding file entity does not exist.

FIG. 11 is a flowchart showing the overall operation (S20) in the multilayer work support apparatus 10.
As shown in FIG. 11, in step 200 (S200), the user drags a window displayed on the left display 14b, and moves the window in the direction of the center display 14a. When the window is moved and the right edge of the window is missing, the subsequent processing is executed. Note that the instruction to move the window may be given by pressing the move button shown in FIG.

In step 202 (S202), the control unit 206 of the display program 200 operating on the control device 100b obtains the file information of the window from the file information sheet stored in the information storage unit 214 via the search unit 208. get.
In step 204 (S204), the control unit 206 transmits the acquired file information to the control device 100a corresponding to the central display 14a via the communication unit 204. In the control device 100a, the control unit 206 of the display program 200 that operates on the control device 100a receives the transmitted file information via the communication unit 204.
In step 206 (S206), the display unit 210 performs preprocessing for display on the display 14b and displays the target on the display 14b.

In the control device 100a corresponding to the central display 14a, when the display program 200 receives the transmitted file information, the display method determination process (S10; FIG. 10) is performed to determine the display method on the display 14a.
The user drags the window displayed on the center display 14a, moves the window in the direction of the right display 14c, and when the right edge of the window is missing, the subsequent processing is further executed.

In step 208 (S208), the control unit 206 transmits the acquired file information to the control device 100c corresponding to the right display 14c via the communication unit 204. In the control device 100c, the control unit 206 of the display program 200 that operates on the control device 100c receives the transmitted file information via the communication unit 204.
In step 210 (S210), the display unit 210 performs preprocessing for display on the display 14a, and displays the target on the display 14a. Note that the process of S210 may be performed after the display method determination process on the display 14a corresponding to the control device 100a is completed, or may be performed before the process of S208.

Similarly, in the control device 100c corresponding to the right display 14c, when the display program 200 receives the transmitted file information, the display method determination process (S10) is performed to determine the display method on the display 14c. .
Thereafter, in step 212 (S212), the display unit 210 performs preprocessing for display on the display 14c, and displays the target on the display 14c.

As described above, the multilayer work support device 10 according to the present invention includes at least two display areas (display 14), at least two computers (control apparatus 100) corresponding to the display areas, and any one of the computers. A control means (control unit 206) for moving and displaying the object displayed in the display area corresponding to the computer to the display area corresponding to a computer different from the computer, and the control means moving the object. Processing means (a search unit 208, a display unit 210, and a storage unit 212) that executes processing set in advance for the target.
As a result, data management and retrieval can be easily performed among a plurality of computers, and the user can display data on the plurality of displays 14 without being aware of the data stored in the respective computers. be able to.

  Further, the multi-layer work support apparatus 10 according to the present invention provides a movement instruction means (an input device such as a mouse) that instructs the control means to move the object displayed in the display area to another display area. 26, a movement button shown in FIG. Thus, the user can easily display the target on the display 14 on which the target is to be displayed without being aware of the data storage location.

  Furthermore, the multi-layer workpiece support apparatus 10 executes the storage process of the object when the object is moved by the control means. As a result, the user can automatically back up the data by an operation of moving the object between the displays without being aware of the data storage.

Next, a multilayer work support device 10 according to a second embodiment of the present invention will be described.
In FIG. 12, in this embodiment, the object (window 140) displayed on the display 14b corresponding to the control device 100b is moved to the displays 14a and 14c corresponding to the control devices 100a and 100c different from the control device 100b. It is a figure explaining the method to display.
As shown in FIG. 12, in the multi-layer workpiece support apparatus 10 according to the present embodiment, the window 140 is moved by a drag operation as indicated by an arrow A in the drawing, and is further moved to the right from the right end of the display 14b. And the center display 14a is displayed together with the related windows 142-1 and 142-2, which is different from the multilayer work support apparatus 10 according to the first embodiment.

  In the present embodiment, when the window 140 moves between the displays 14, related information search processing is executed, and in this related information search processing, related information is also a search target. Here, the related information is a keyword (FIG. 6) given in advance to the moved target. Based on these keywords, the related information search process is executed on the target stored in the storage device 110 of the destination control device 100a. When the stored object is given at least one of the keywords, the object is displayed on the display 14a as the related windows 142-1 and 142-2 together with the moved window 140.

  Similarly, when the window 140 is moved from the central display 14a to the right display 14c, related information search processing is executed in the control device 100c corresponding to the right display. This related information search processing is executed on the target stored in the storage device 110 of the control device 100c based on the keyword assigned to the target of the moved window 140. When at least one of the keywords is assigned to the stored object, the object is displayed on the display 14c as the moved window 140 with 142-2 to 142-5.

  The related information search unit 208 of the display program 200 stores the file attribute transmitted to the information storage unit 214 based on the file attribute including the keyword attached to the transmitted target under the control of the control unit 206. A related information search process is performed with reference to the stored file information sheet. The related information search unit 208 extracts a target (related target) given as a keyword with at least one of keywords assigned to the transmitted target, and controls the control unit 206 as a target related to the transmitted target. Output for.

  In addition to the transmitted object, the display unit 210 displays an object related to the object on the display 14 as a window. The display unit 210 may determine the size of the related target window 142 in accordance with the degree (relevance) that the related target is related to the transmitted target. The degree of association is determined, for example, according to the number of keywords assigned to both the transmitted target and the target related to the target. The display unit 210 may determine the distance between the transmitted target and the related target according to the degree of relevance. For example, the display unit 210 determines the position of the window so that the related target window 142 having a higher degree of relevance is displayed closer to the transmitted target window 140.

FIG. 13 is a flowchart showing display method determination processing (S30) executed by the display program 200 in the target destination control apparatus 100 in the present embodiment. Note that, among the processes shown in FIG. 13, substantially the same processes as those shown in FIG. 10 are denoted by the same reference numerals.
As illustrated in FIG. 13, in the process of S <b> 100, the control unit 206 of the display program 200 receives fill information via the communication unit 204.

  In step 302 (S302), the related information search unit 208 is controlled by the control unit 206 to search the transmitted target and the target related to the target based on the transmitted file information and keywords. The related information search unit 208 outputs the search result to the control unit 206.

In the processing of S104 to S106, it is determined whether or not the file entity corresponding to the received file information exists in the information storage unit 214. If the file entity does not exist, the file entity is saved.
In step 308 (S308), the display unit 210 displays the transmitted target window and the target window related to the target on the display 14.

In this way, when the target displayed on any of the displays 14 is moved to a display 14 different from the display 14, the multi-layer work support device 10 and the target related to the target are moved. Are displayed on the display 14.
Thereby, the user can recognize information related to each other by a simple operation without being aware of data stored in each computer.

  Note that when the target displayed on any of the displays 14 is moved to a display 14 different from the display 14, the multilayer work support apparatus 10 may display the moved target in an enlarged manner. Alternatively, in this case, the multilayer work support device 10 may reduce and display the moved target. In this way, the multi-layer workpiece support apparatus 10 receives the target movement operation and changes the display mode of the target based on the received operation. Thereby, the user can change the size of the object simply by moving the object to another display 14.

Next, a multilayer work support device 10 according to a third embodiment of the present invention will be described.
The multilayer work support apparatus 10 according to the present embodiment is the same as that of the first embodiment in that the user's line-of-sight information, brain wave information, speech information, mouse operation history, and keyboard operation history are acquired and the movement of the target is determined. This is different from the multilayer work support device 10.

  The multi-layer workpiece support apparatus 10 according to the present embodiment acquires the user's line-of-sight information, etc., determines these information, and moves the target displayed on the left or right display 14b, 14c to the central display 14a. And display. More specifically, when the user gazes at the target displayed on the left or right display 14b, 14c for a predetermined time or more, the multi-layer work support device 10 determines that the movement request for the target has been received, The target window is moved to the central display 14a and displayed.

  Further, the multi-layer work support apparatus 10 according to the present embodiment may change the display area of the window based on voice information such as a user's utterance. The multilayer work support device 10 acquires voice information via a microphone (not shown) connected to the device body 12. When the volume of the acquired audio information exceeds, for example, 50 dB, the multilayer work support apparatus 10 determines that a request for changing the display area of the target window has been received, and changes the display area of the window.

FIG. 14 is a diagram illustrating the movement of the watched object.
As shown in FIG. 14, when the user determines that the user has watched the window 140-2 for a predetermined time or more, for example, the multi-layer work support apparatus 10 moves the window 140-2 to the central display 14a and enlarges it. To display. At this time, when the target is not stored in the control device 100a corresponding to the central display 14, the multilayer work support device 10 stores the target in the control device 100a and displays the target on the display 14a.

Thereby, for example, the user can input a line of sight to the right display 14c while operating the mouse on the left display 14b. Also, the watched object is moved to a different display 14 and is stored and managed in the control device 100 corresponding to the destination display 14. Therefore, the user can perform a plurality of tasks among a plurality of computers without being aware of the data storage location.
Furthermore, the multilayer work support device 10 may perform related information search (FIG. 12) in the control device 100 of the movement destination based on the watched object. Further, the multilayer work support device 10 may perform an enlarged display of the target as the target moves.

FIG. 15 is a diagram showing a display program 300 that operates in the multilayer work support device 10 according to the present embodiment.
As illustrated in FIG. 15, the multilayer work support device 10 according to the present embodiment further includes a biological information acquisition device 28 and a voice information acquisition device 30, and the display program 300 includes a biological information acquisition unit 302, voice information acquisition. It differs from the multilayer work support device 10 according to the first embodiment in that it further includes a unit 304 and an operation information acquisition unit 306. In the present embodiment, the multilayer work support device 10 determines a target display method based on the biological information detected by the biological information acquisition device 28 and the voice information acquisition device 30. 15 that are substantially the same as those shown in FIG. 9 are denoted by the same reference numerals.

  The biological information acquisition device 28 is a device that acquires information about the eyeball such as information on the user (biological body), for example, breathing, heartbeat, pulse, blink, pupil diameter, gaze target, and gaze time. Is provided. The biometric information acquisition device 28 acquires these pieces of information at arbitrary timing from the user in the desk work, and outputs them to the display program 300.

  The voice information acquisition device 30 is a device that acquires user utterance information, and is used by being connected to the device main body 12. The audio information acquisition device 30 is, for example, a microphone. The voice information acquisition device 30 also outputs the acquired information to the display program 300 in the same manner as the biological information acquisition device 28.

In the display program 300, the biological information acquisition unit 302 receives the biological information input from the biological information acquisition device 28 via the UI unit 202 and outputs it to the control unit 206.
The audio information acquisition unit 304 receives the audio information input from the audio information acquisition device 30 via the UI unit 202 and outputs it to the control unit 206.

The operation information acquisition unit 306 receives operation information of at least one of the information access device 16 and the input device 26 by the user via the UI unit 202 and holds an operation history. Further, the operation information acquisition unit 306 outputs the operation information to the control unit 206.
The control unit 206 integrates information input from the biological information acquisition unit 302, the audio information acquisition unit 304, and the operation information acquisition unit 306, creates an integrated sheet described later, and manages biological information and the like. The control unit 206 outputs the created integrated sheet to the display unit 210.

  The display unit 210 determines a display target display method based on the integrated sheet. The display unit 210 displays the window that is currently displayed when the gaze time for the predetermined window exceeds a predetermined time and / or when the volume of audio information exceeds a predetermined level 14 is moved and displayed on a display 14 different from 14. For example, when the gaze time for the target displayed on the left or right display 14b or 14c exceeds a predetermined time, the display unit 210 moves the window to the center display 14a and displays it. Note that the display method change determination criteria are not limited to these, and may be controlled by the display unit 210 based on information included in an integrated sheet described later.

FIG. 16 is a diagram illustrating an integrated sheet for managing biometric information and the like acquired via the biometric information acquisition device 28 and the like.
As illustrated in FIG. 16, the integrated sheet includes biological information, audio information, and operation information. Here, the biometric information includes gaze coordinates (x, y), gaze time, blink presence / absence, and brain waves, voice information includes utterance presence / absence and volume, and operation information includes keyboard input and mouse input. . In the integrated sheet, each row indicates that these items are acquired at time t. The biological information or the like may be acquired at predetermined time intervals, or may be acquired at a timing when any item exceeds or falls below a predetermined value.

  The integrated sheet may include not only these items but also other items acquired by the biological information acquisition device 28 and the like. In addition, the biological information or the like may not be managed in a table format, and the control unit 206 determines the biological information and the like based on a predetermined determination criterion, and controls the display unit 210 each time to determine the display method of the target. It may be changed.

  Here, the audio information is acquired via a microphone (not shown) connected to the multi-device body 12. When the volume of the acquired audio information exceeds, for example, 50 dB, the multi-layer work support apparatus 10 determines that a request for performing at least one of movement, enlargement, and maximization of the target window has been received, and movement of the window, etc. I do.

FIG. 17 is a flowchart showing an overall operation (S40) in the multilayer work support device 10 according to the third embodiment of the present invention.
As shown in FIG. 17, in step 400 (S400), the biometric information acquisition device 28 and the like acquire biometric information and the like of the user who is operating the multilayer work support device 10 at predetermined time intervals, for example. The data is output to the display program 200 operating on the device 100. The biometric information acquisition unit 302 and the like of the display program 300 acquires biometric information via the UI unit 202 and outputs it to the control unit 206.

In step 402 (S402), the control unit 206 integrates the input biological information and the like, creates an integrated sheet, and outputs the integrated sheet to the display unit 210. The display unit 210 refers to an integrated sheet that includes biometric information and the like, and determines movement based on a predetermined criterion. The control unit 206 may refer to the created integrated sheet, determine the movement of the target with respect to the display 14 based on a predetermined determination criterion, and output the determined content to the display unit 210. .
In step 404 (S404), the display unit 210 displays the target window on the display 14 based on the control of the control unit 206 when the movement of the file is instructed.

As described above, the multilayer work support device 10 according to the present embodiment of the present invention further includes the biological information acquisition device 28 and the voice information acquisition device 30, and the biological information detected by the biological information acquisition device 28 and the like. Based on the above, the object displayed on the display 14 is moved to another display 14.
As a result, the multi-layer work support device 10 is controlled by using not only a mouse and a keyboard but also a plurality of instruction means such as biological information, so that the user performs “a different work at hand while watching the moving object” or the like. Data managed between a plurality of computers can be efficiently moved and displayed.

  In the above embodiment, biometric information, audio information, and the like are used as user information, but the present invention is not limited to this embodiment. For example, the multilayer work support device 10 may store a user's favorite music CD and calculate a user-specific rhythm using a music CD that the user likes and listens to. The multilayer work support device 10 may use biometric information when the user is listening to a favorite music CD in combination with biometric information.

FIG. 18 and FIG. 19 are diagrams illustrating a modification of the specific system configuration of the multilayer work support device 10.
As illustrated in FIG. 18, the input device 26 such as a mouse or a keyboard may be connected to any one of the control devices 100 a to 100 c instead of the relay device (management server) 112. In this case, the control device 100a to which the input device 26 is connected outputs the operation information from the input device 26 to the management server 112, and the management server 112 sends the operation information to the other control devices 100b and 100c. Output.

  Further, as illustrated in FIG. 19, a plurality of input devices 26 (for example, a mouse and a keyboard) may be connected to different control devices 100. In this case, the control device 100 to which each input device 26 is connected outputs the operation information of the input device 26 to the management server 112, and the management server 112 outputs the operation information to any control device 100. To do.

It is a figure showing multilayer work support device 10 concerning an embodiment of the present invention. 2 is a diagram showing a hardware configuration of a computer used in the multilayer work support device 10. FIG. It is a figure which illustrates the specific system block diagram of the multilayer work assistance apparatus. It is the figure which showed drag operation and the data movement of the moving object accompanying it. 4 is a diagram illustrating a group of buttons displayed on the information access device 16. FIG. The file information sheet which manages the object designated by each information designation button 180 is illustrated. It is a figure explaining the method of moving and displaying the object currently displayed on the display 14b corresponding to the control apparatus 100b on the displays 14a and 14c corresponding to control apparatuses 100a and 100c different from this control apparatus 100b. It is a figure explaining the display method during the preservation | save process of a file entity. It is a figure which shows the structure of the display program 200 performed by the control apparatus 100 of the multilayer workpiece support apparatus 10. FIG. 5 is a flowchart showing a display method determination process (S10) executed by the display program 200 in the target destination control apparatus 100 in the first embodiment of the present invention. It is a flowchart which shows the whole operation | movement (S20) in the multilayer workpiece support apparatus 10. In the second embodiment of the present invention, the object (window 140) displayed on the display 14b corresponding to the control device 100b is displayed on the displays 14a and 14c corresponding to the control devices 100a and 100c different from the control device 100b. It is a figure explaining the method to move and display. In the 2nd Embodiment of this invention, it is a flowchart which shows the display method determination process (S30) performed by the display program 200 in the control apparatus 100 of the moving destination of object. It is a figure explaining the movement of the observed object. It is a figure which shows the display program 300 which operate | moves with the multilayer workpiece support apparatus 10 which concerns on the 3rd Embodiment of this invention. It is a figure which illustrates the integrated sheet which manages the biometric information etc. which were acquired via the biometric information acquisition apparatus 28 grade | etc.,. It is a flowchart which shows the whole operation | movement (S40) in the multilayer workpiece support apparatus 10 which concerns on the 3rd Embodiment of this invention. It is a figure which illustrates the 1st modification of the specific system configuration | structure of the multilayer workpiece support apparatus. It is a figure which illustrates the 2nd modification of the specific system configuration | structure of the multilayer workpiece support apparatus.

Explanation of symbols

2 Network 10 Multi-layer Work Support Device 12 Device Main Body 14 Display 16 Information Access Device 18 Button 26 Input Device 28 Biometric Information Acquisition Device 30 Audio Information Acquisition Device 100 Control Device 102 Processing Device 104 CPU
106 Memory 108 Communication IF
110 storage device 112 relay device 180 information designation button 182 movement button 182 control button 200 display program 202 UI unit 204 communication unit 206 control unit 208 search unit 210 display unit 212 storage unit 214 information storage unit 300 display program 302 biometric information acquisition unit 304 Audio information acquisition unit 306 Operation information acquisition unit

Claims (6)

At least two display areas;
At least two computers corresponding to each of the display areas;
Control means for moving and displaying an object displayed in the display area corresponding to one of the computers in the display area corresponding to a computer different from the computer, and the control means moved the object A multi-layer work support device having processing means for executing a preset process for the object. The multilayer work support apparatus according to claim 1, further comprising a movement instruction unit that instructs the control unit to move the object displayed in the display area to another display area. The multilayer work support apparatus according to claim 1, wherein the processing unit executes at least one of processing of storing the target and searching for related information of the target when the target is moved by the control unit. It further has biological information detection means for detecting biological information,
The multilayer work support apparatus according to claim 1, wherein the control unit moves and displays a target displayed in the display area based on the biological information detected by the biological information detection unit. In a multi-layer work support device having at least two display areas and at least two computers corresponding to each of the display areas,
When the object displayed in the display area corresponding to one of the computers is moved to the display area corresponding to a computer different from the computer and displayed, the object is synchronized with the movement with respect to the object. A display method for a multi-layer work support device that performs preset processing. In a multi-layer work support device having at least two display areas and at least two computers corresponding to each of the display areas,
When the object displayed in the display area corresponding to one of the computers is moved to the display area corresponding to a computer different from the computer and displayed, the object is synchronized with the movement with respect to the object. A program for causing the computer of the multi-layer work support apparatus to execute the step of performing preset processing.

Images