JP7318918B2 - Work activity support system - Google Patents

Description

The present invention relates to a system for assisting work activities of a worker who enters a predetermined work space or the like and performs a predetermined work. In particular, the present invention relates to a system that supports work activities of a worker who enters a work space based on a user's request and performs work requested by the user on behalf of the user.

A server room in which a plurality of server devices are installed is managed by a data center operator or a server management company that provides the server room. When such a data center operator or server management company receives a work request from a user using the data center regarding network equipment such as a server owned by the user and IT equipment installed in the server room. In some cases, the client enters the server room and performs the requested work on behalf of the client. This is the so-called remote hand service.

In such a case, if an unexpected problem occurs when you enter the server room and start work, stop the work, report it to the user who requested it, wait for instructions, and do the necessary work will be resumed.

In such a case, when the requested work is urgent work, do you give priority to the execution of the requested work? It may be difficult for workers to make decisions such as whether to carry out

Moreover, even if the worker intends to carry out the requested work, he or she may perform the wrong work, such as rebooting the wrong server or unplugging the network cable.

If such a mistake occurs, is the cause and responsibility of the worker on the side of the worker, or is it due to the ambiguity of the request content of the user who requested the work? is very difficult to clarify.

Conventionally, in remote hand work, proposals have been made for computer programs that can prevent workers from operating other equipment that has not been specified by the user (for example, see Patent Document 2). 1, 2).

JP 2011-107850 A Japanese Unexamined Patent Application Publication No. 2012-238116

In the remote hand work, a worker who enters a work space such as a server room and carries out the work requested by the user on behalf of the user and the user closely exchange information during the work. The purpose is to propose a work activity support system that can prevent mistakes from occurring.

[1]
A wearable terminal worn on the head of a worker, a management server, and a user terminal used by a user are communicably connected via a communication network. A work activity support system that mutually transmits and receives audio information and image information via a server,
The wearable terminal is
an imaging means for imaging a real space including an object that is the target of work activity;
Wearable terminal side display means having a projection surface through which the physical space including the object is transmitted and for projecting work image information about the object;
with
The user terminal is
working image information extracting means for acquiring image information of a real space including the object imaged by the imaging means and extracting the working image information associated with the identification information of the object from the image information; and,
selecting the working image information to be superimposed on the physical space including the target by projecting it onto the projection plane through which the physical space including the target is transmitted, and transmitting the image information to the wearable terminal; work image information selection/instruction means for instructing the server;
Work activity support system.

According to the present invention, in remote hand work, a worker who enters a work space such as a server room and acts on behalf of a user to perform work requested by the user and the user can closely exchange information during the work. It is possible to provide a work activity support system that can prevent mistakes in content.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure showing an example of the system configuration|structure of the work activity assistance system of this invention. (a) A diagram showing an example of a wearable terminal adopted in the work activity support system of the present invention, (b) An example of a state in which a worker wears a wearable terminal adopted in the work activity support system of the present invention on the head. It is a figure showing. FIG. 2 is a diagram showing an example of real space image information displayed on a real space transmitted through a projection surface of a wearable terminal and a user terminal; It is a figure showing an example of the image information for work. FIG. 11 is a diagram showing another example of working image information; An example of a state in which the work image information shown in FIGS. 4 and 5 is superimposed on the real space shown in FIG. 3 that is transmitted through the projection surface of the wearable terminal, or the real space image information shown in FIG. 3 displayed on the user terminal 6 is a diagram showing an example of superimposed image information for work in which the image information for work shown in FIGS. 4 and 5 is superimposed on FIG.

An example of an embodiment of the present invention will be described below with reference to the accompanying drawings. In this embodiment, the target of the operation work by the worker is assumed to be a server rack installed in a data center or a server room, network equipment such as a user-owned server installed in the server rack, IT equipment, etc. FIG. As shown in , the wearable terminal 2 worn by the worker on the head, the management server 4, and the user terminal 3 used by the user are connected to the Internet communication network, a wireless communication network defined by wireless communication standards. are communicably connected via a communication network 5 such as the wearable terminal 2 and the user terminal 3, and audio information and image information are mutually transmitted and received via the management server 4, and the instructions of the user are transmitted and received between the wearable terminal 2 and the user terminal 3. and an example of a work activity support system 1 that supports operation work performed by the worker on network devices such as the server rack and the user-owned server, IT devices, and the like.

[Configuration of wearable device]
The wearable terminal 2 is used by being worn on the head of a worker, and is a display device such as the head-mounted display shown in FIG. 2, for example.

The wearable terminal 2 includes display means 2a, imaging means 2b, voice input means 2c, voice output means 2d, and superimposed image information creating means 2e for work. Although not shown, the wearable terminal 2 includes an arithmetic processing unit configured by a CPU, a RAM, etc., which processes various data and performs calculations, and a control unit for causing the arithmetic processing unit to execute predetermined processing under a predetermined computer program. , a storage unit for storing various data such as a memory, and a communication unit for transmitting and receiving various data to and from the user terminal 3 and the management server 4 .

The display means 2a is a device that enables visual recognition of the real space including the object of the work activity and displays image information for work on the object, and is, for example, an optical transmission type display. In this embodiment, as shown in FIG. 2, the display means 2a has a projection plane 2f through which the real space including the object is transmitted and on which working image information about the object is projected. As shown in FIG. 3, the worker wearing the wearable terminal 2 on his/her head can perform work activities on the server rack 7a, the user-owned server 7b, the monitor 7c, the IT equipment 7d, etc., which are transmitted through the display projection surface 2f as shown in FIG. The object 7 and the real space in the data center and server room including these can be visually recognized. A description of displaying the work image information about the object 7 will be given later.

The imaging means 2b is a device for imaging the physical space including the object 7, and is, for example, a camera or a video camera. In the present embodiment, the imaging means 2b is configured to match the worker's line of sight with the wearable terminal 2 worn by the worker, as shown in FIG. The user-owned server 7b, monitor 7c, IT equipment 7d, etc., and the real space in the data center or server room containing these are imaged. The captured image information 6 of the real space as shown in FIG.

The audio input means 2c is, for example, a microphone device, and the audio output means 2d is, for example, an earphone device. The worker can have a conversation with the user using the user terminal 3 via the communication network 5 or the management server 4 while wearing the wearable terminal 2 on the head.

The superimposed image information for work creation means 2e creates superimposed image information for work in which the image information for work is superimposed on the physical space including the object 7 on the projection plane 2f. This processing will be described later.

[Configuration of user terminal]
The user terminal 3 is a computer such as a personal computer, a smart phone, a tablet terminal, or the like, and is installed in a work space such as a data center or server room where the worker performs predetermined work. It is a terminal used by a person (user) who installs IT equipment, etc.

The user terminal 3 includes display means 3a, voice input means 3b, voice output means 3c, work image information extraction means 3d, and work image information selection/instruction means 3e. Although not shown, the user terminal 3 includes an arithmetic processing unit configured by a CPU, a RAM, etc., which processes various data and performs arithmetic operations, and a control unit for causing the arithmetic processing unit to execute predetermined processing under a predetermined computer program. , a storage unit that stores various data such as a hard disk and a memory, an information input unit such as a touch panel, and a communication unit that transmits and receives various data to and from the wearable terminal 2 and the management server 4 .

The display means 3a is a device for displaying the image information 6 of the physical space including the target object 7 acquired from the wearable terminal 2 and superimposed image information for work, which will be described later, and is, for example, a liquid crystal display. In this embodiment, the display unit 3a includes the server rack 7a, the user-owned server 7b, the monitor 7c, the IT equipment 7d, etc. shown in FIG. Image information 6 of the real space in the server room is acquired and displayed on the liquid crystal display.

The image information 6 of the real space displayed on the display means 3a is transmitted through the real space viewed by the worker through the projection plane 2f of the display means 2a of the wearable terminal 2, that is, the projection plane 2f. It is the same as the real space.

As shown in FIG. 3, the user can use the server rack 7a displayed on the liquid crystal display, the server 7b owned by the user, the monitor 7c, the IT equipment 7d, and other work activity objects 7, as well as data centers and servers including these. The image information 6 of the real space in the room can be visually recognized. A description of displaying the superimposed image information for work will be given later.

The audio input means 3b is, for example, a microphone device, and the audio output means 3c is, for example, an earphone device. The user can converse with the worker wearing the wearable terminal 2 on the head via the communication network 5 or the management server 4 .

The working image information extracting means 3d acquires image information 6 of the real space including the object 7 imaged by the imaging means 2b of the wearable terminal 2, and associates the identification information of the object 7 from the image information. Extract working image information.

For example, as shown in FIGS. 4 and 5, the working image information 8 of the present embodiment includes an identification ID 8a assigned to each target object 7 such as the user-owned server 7b, monitor 7c, and IT equipment 7d. Center name 8b, floor 8c, rack name 8d, user company 8e, person in charge 8f, expiration date 8g, equipment category 8h, power supply 8i, temperature 8j, humidity 8k, server rack, equipment layout and floor guide map 8l etc. are associated with each other. Such working image information 8 is stored in the storage means 4a of the management server 4 in advance.

The work image information 8 is created by associating the above information with the identification ID 8a of each object 7, and may be created by associating other information with the identification ID 8a. for example,
・Server rack status (in use, vacant, reserved, etc.)
・Trend graphs of current, temperature, and humidity for each server rack or device ・Equipment mounting diagram for each server rack ・Wiring routes based on network wiring information (underfloor, cable ladder, server rack, etc.)
・Wiring circuits based on power supply wiring information (inside distribution boards, under floors, server racks, etc.)
・Confirmation display of the server rack where the alert is generated (server rack color, arrow, etc.)
・Manuals for the equipment to be worked on and the manufacturer's website
- Messages, comments, etc. from viewers of the work video other than the worker can be associated with the identification ID 8a and used as the work image information 8. FIG.

Further, the working image information 8 is associated with an AR (Augmented Reality) marker. A conventionally known marker type or markerless type can be adopted as the AR marker.

When the marker type is adopted, a two-dimensional code having a specific graphic pattern associated with the identification ID 8a of the object 7 is displayed on the object 7, and an image of the real space including the object 7 is displayed from the wearable terminal 2. When acquiring the information 6, the working image information extracting means 3d reads the identification ID 8a from the AR marker displayed on the object 7, and acquires the working image information 8 for the identification ID 8a from the management server 4. .

When adopting the markerless type, characteristics such as the shape of the object 7 are associated with the identification ID 8a and recorded in the management server 4, and when the image information 6 of the real space including the object 7 is acquired from the wearable terminal 2 Secondly, the working image information extracting means 3d reads the identification ID 8a corresponding to the feature of the object 7 from the object 7, and acquires the working image information 8 for the identification ID 8a from the management server 4. FIG.

The work image information selection/instruction means 3e projects the work image information 8 on the projection surface 2f of the wearable terminal 2 through which the real space including the target object 7 is transmitted, and superimposes it on the real space including the target object 7. and instruct the management server 4 to send it to the wearable terminal 2 .

In this embodiment, after the working image information extraction means 3d extracts the working image information 8 of the object 7 as shown in FIGS. Data center name 8b, floor 8c, rack name 8d, user company 8e, person in charge 8f, expiration date 8g, power supply 8i, temperature 8j, humidity 8k, server rack, equipment layout and floor guide map 8l for 7b , and status 8m are selected, and the management server 4 is instructed to transmit to the wearable terminal 2 the working image information 8 composed of these pieces of information.

On the projection plane 2f of the display means 2a of the wearable terminal 2, as shown in FIG. 6, work image information 8 about the selected server 7b is displayed in the real space including the target object 7 that is transmitted through the projection plane 2f. is superimposed. As shown in FIG. 6, the worker wearing the wearable terminal 2 on his/her head sees through the projection plane 2f, the objects of work activities such as the server rack 7a, the user-owned server 7b, the monitor 7c, and the IT equipment 7d. 7, data center including these, and working image information 8 about the server 7b superimposed on the physical space in the server room.

In this case, the superimposed work image information 9 in which the work image information 8 about the server 7b is superimposed on the physical space including the object 7 as shown in FIG. Created by the creating means 2e. The superimposed image information for work 9 that has been created is directly sent to the user terminal 3 via the communication network 5 or sent to the user terminal 3 via the management server 4 .

The user terminal 3 acquires the work superimposed image information 9 shown in FIG. 6 from the wearable terminal 2 or the management server 4 and displays it on the display means 3a.

The superimposed image information for work 9 displayed on the display means 3a is the real space that the worker visually recognizes through the projection surface 2f of the display means 2a of the wearable terminal 2 and the object 7 superimposed on the real space. is the same as the working image information 8 for .

As shown in FIG. 6, the user can use the server rack 7a displayed on the liquid crystal display, the server 7b owned by the user, the monitor 7c, the IT equipment 7d and other work activity objects 7, the data center including these, and the server. The work image information 8 about the server 7b superimposed on the image information 6 of the physical space in the room can be visually recognized.

[Management server configuration]
The management server 4 is composed of a computer or the like installed so as to be connectable to the communication network 5 by a service provider who provides the work activity support system of this embodiment. The management server 4 comprises storage means 4a and image display control means 4b. Although not shown, the management server 4, which is a computer, includes an arithmetic processing unit configured by a CPU, a RAM, etc., which processes various data and performs calculations, and a predetermined processing in the arithmetic processing unit under a predetermined computer program. It includes a control unit to be executed, a storage unit that stores various data such as a hard disk and a memory, and a communication unit that transmits and receives various data to and from the wearable terminal 2 and the user terminal 3 .

The above-described working image information 8 is stored in the storage means 4a.

The image display control means 4b superimposes the working image information 8 about the object 7 acquired from the user terminal 3 on the real space transmitted through the projection plane 2f of the display means 2a of the wearable terminal 2. Control processing for projection onto 2f is performed.

Further, the image display control means 4b performs control processing for displaying the work superimposed image information 9 acquired from the wearable terminal 2 on the display means 3a of the user terminal 3. FIG.

[Implementation of work using the work activity support system]
The work in the work space by the worker using the work activity support system of this embodiment is performed as follows.

A worker wears the wearable terminal 2 as shown in FIG. 2(b), and works on the server rack 7a, the server 7b owned by the user, the monitor 7c, the IT equipment 7d, etc. which are transmitted through the projection surface 2f of the display means 2a. While visually recognizing the object 7 of the activity, the data center including these, and the real space in the server room, the user enters the work space.

At this time, the imaging means 2b of the wearable terminal 2, as shown in FIG. , captures the real space in the data center and server room including these. The captured image information 6 of the real space as shown in FIG. 3 is sent to the user terminal 3 via the management server 4 .

The user operating the user terminal 3 can access the server rack 7a, the server 7b owned by the user, the monitor 7c, the IT equipment 7d, etc. shown in FIG. and the image information 6 of the physical space in the server room is acquired via the management server 4 and displayed on the display means 3a for visual recognition.

The user uses the work image information selection/instruction means 3e to project a work image onto the projection surface 2f of the wearable terminal 2 through which the physical space including the target object 7 is transmitted, thereby superimposing the work image information on the physical space including the target object 7. It selects the image information 8 and instructs the management server 4 to send it to the wearable terminal 2 .

On the projection plane 2f of the display means 2a of the wearable terminal 2, the selected real space including the object 7 passing through the projection plane 2f is displayed by the above-described control processing of the image display control means 4b of the management server 4. Working image information 8 about the object 7 is superimposed.

As a result, for example, a guide map in the server room, a layout diagram of server racks and various devices are superimposed on the real space that is transmitted through the projection surface 2f of the display means 2a of the wearable terminal 2, and the user can see the server room. An incoming worker issues a work instruction using a voice input means 3b so that he/she can definitely go to a network device such as a server owned by the user, an IT device, etc., to work according to the guide map/layout map.

When the worker arrives at the target server or other network device or IT device according to this instruction, the user again operates the work image information selection/instruction means 3e to operate the wearable device through which the real space including the target object 7 is transmitted. The management server 4 is instructed to select work image information 8 to be projected onto the projection surface 2f of the terminal 2 and superimposed on the physical space including the target object 7, and to send it to the wearable terminal 2. FIG.

This allows, for example,
・Server rack status (in use, vacant, reserved, etc.)
・Trend graphs of current, temperature, and humidity for each server rack or device ・Equipment mounting diagram for each server rack ・Wiring routes based on network wiring information (underfloor, cable ladder, server rack, etc.)
・Wiring circuits based on power supply wiring information (inside distribution boards, under floors, server racks, etc.)
・Confirmation display of the server rack where the alert is generated (server rack color, arrow, etc.)
The manual of the work target equipment, the manufacturer's website, messages and comments from viewers of the work video other than the worker, etc. are superimposed on the real space that is transmitted through the projection surface 2f of the display means 2a of the wearable terminal 2. , the user issues further work instructions to the worker using the voice input means 3b based on these pieces of information.

As described above, in the work activity support system 1 of the present embodiment, the worker can see the real space superimposed with the work image information 8 about the object 7 projected on the projection plane 2f of the display means 2a of the wearable terminal 2. The user can work on network equipment such as a server owned by the user and IT equipment while visually recognizing the While viewing the work image information 8 about the object 7 superimposed on the image information 6 of the physical space, that is, the superimposed work image information 9, necessary work instructions are given to the worker. Therefore, according to the work activity support system 1 of this embodiment, the following effects can be exhibited.

・It is possible to prevent workers from making mistakes in the work targets (server racks, various devices, cables, places to open the underfloor grating, etc.).
・It is possible to quickly find an object for which an alert is generated.
・The worker can proceed while confirming the details of the work with the user immediately before proceeding, and if the worker makes a mistake in the work, the user can quickly issue a correction instruction.
・Because the worker and the user can proceed with the work while communicating with each other, the added value of a sense of security is created for both parties.
・Information related to IT equipment and network equipment such as server racks and servers to be worked on can be recognized by AR, and this information can be visually shared by workers and users.
・Since the IT skills of the workers can be directly communicated to the users, the workers can provide added value to the users with the high IT skills, and the users can enjoy the high IT skills of the workers. It is easy to recognize the added value in
・Because it becomes easier to find value not only in the IT skills of workers, but also in their communication skills with users and work behavior (behavior and demeanor), the principle of competition among workers works, and server management and IT infrastructure management The business market will be activated.

Although the preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to these embodiments, and various modifications can be made within the technical scope understood from the description of the claims. Can be changed.

1 work activity support system 2 wearable terminal 2a display means 2b imaging means 2c voice input means 2d voice output means 2e work superimposed image information creation means 2f projection surface 3 user terminal 3a display means 3b voice input means 3c voice output means 3d for work Image information extraction means 3e Work image information selection/instruction means 4 Management server 4a Storage means 4b Image display control means 5 Communication network 6 Real space image information 7 Object 8 Work image information 9 Work superimposed image information

Claims (4)

A wearable terminal worn on the head of a worker, a management server, and a user terminal used by a user are communicably connected via a communication network. A work activity support system that mutually transmits and receives audio information and image information via a server,
The wearable terminal is
an imaging means for imaging a real space including an object that is the target of work activity;
Wearable terminal side display means having a projection surface through which the physical space including the object is transmitted and for projecting work image information about the object;
with
The user terminal is
working image information extracting means for acquiring image information of a real space including the object imaged by the imaging means and extracting the working image information associated with the identification information of the object from the image information; and,
selecting the working image information to be superimposed on the physical space including the target by projecting it onto the projection plane through which the physical space including the target is transmitted, and transmitting the image information to the wearable terminal; work image information selection/instruction means for instructing the server;
Work activity support system. The wearable terminal is
a superimposed working image information creating means for creating superimposed working image information in which the working image information is superimposed on a real space including the object on the projection plane;
The user terminal is
2. The work activity support system according to claim 1, further comprising user terminal side display means for displaying image information of the real space including the object acquired from the wearable terminal and the superimposed work image information. 3. The work activity support system according to claim 1, wherein the work image information is associated with an AR marker. 4. The work activity support system according to any one of claims 1 to 3, wherein the work image information is a guide map of a room in which the worker works and a layout plan of the object.

Images