JP2021033364A - Work activity support system - Google Patents

Abstract

To provide a work activity support system that can prevent an occurrence of a mistake in work contents by closely exchanging information between a user and a worker who enters a work space such as a server room and carries out the work contents requested by the user on behalf of the user during the work, in a remote hand service.SOLUTION: In a work activity support system 1, a wearable terminal 2 includes imaging means 2b for imaging a real space including an object to be subjected to a work activity and display means 2a for transparency of the real space including the object and for projecting work image information about the object. A user terminal includes: work image information extraction means 3d for acquiring image information of the real space including the object and for extracting the work image information associated with identification information of the object from the image information; and work image information selection/instruction means 3e for instructing a management server to select work image information to be superimposed on the real space including the object and for sending it to the wearable terminal.SELECTED DRAWING: Figure 1

Description

The present invention relates to a system that supports the work activities of a worker who enters a predetermined work space or the like and performs a predetermined work. In particular, the present invention relates to a system that supports the work activities of a worker who enters a work space based on a request of a user and performs the work requested by the user on behalf of the user.

A server room in which a plurality of server devices are installed is managed by a data center operator or a server management company that provides the server room. Such a data center operator or a server management company requests work from a user using the data center for network devices such as servers and IT devices owned by the user installed in the server room. After receiving the request, the server room may be entered and the requested work may be performed on behalf of the customer. This is the so-called remote hand business.

In such a case, if an unexpected trouble occurs when you enter the server room and start the work, interrupt the work, report it to the requesting user, wait for instructions, and perform the necessary work. Will be restarted.

In such a case, when the requested work is an urgent work, the execution of the requested work should be prioritized, or the unexpected work that occurred suddenly should be prioritized. It may be difficult for workers to make a decision as to whether or not to do so.

Further, even if the worker intends to carry out the requested work, it is possible that the worker performs wrong work such as a mistake in the server to be rebooted or a mistake in disconnecting the network cable.

When such a mistake occurs, the cause and responsibility lies with the worker, or the request content of the user who requested the work is ambiguous, etc. Is very difficult to clarify.

Conventionally, in remote hand work, a computer program that can prevent a worker or the like from operating another device not specified by a user has been proposed (for example, a patent document). 1, 2).

Japanese Unexamined Patent Publication No. 2011-107850 Japanese Unexamined Patent Publication No. 2012-238116

According to the present invention, in remote hand work, a worker who enters a work space such as a server room and acts on behalf of a user-requested work content and a user can closely exchange information during the work to achieve the work content. The purpose is to propose a work activity support system that can prevent mistakes from occurring.

[1]
The wearable terminal worn by the worker on the head, the management server, and the user terminal used by the user are communicably connected via a communication network, and the management is performed between the wearable terminal and the user terminal. It is a work activity support system that sends and receives voice information and image information to and from each other via a server.
The wearable terminal is
An imaging means that captures the real space including the object to be worked on,
A wearable terminal-side display means having a projection surface for projecting work image information about the object while transmitting the real space including the object.
With
The user terminal is
A work image information extraction means that acquires image information in a real space including the object captured by the image pickup means and extracts the work image information associated with the identification information of the object from the image information. When,
The management so as to project on the projection surface through which the real space including the object is transmitted, select the work image information superimposed on the real space including the object, and send it to the wearable terminal. Work image information selection / instruction means to instruct the server,
Work activity support system equipped with.

According to the present invention, in remote hand work, work is performed by closely exchanging information between a worker who enters a work space such as a server room and acts on behalf of a user-requested work content and a user during the work. It is possible to provide a work activity support system that can prevent mistakes in the contents.

It is a figure which shows an example of the system structure of the work activity support system of this invention. (A) A diagram showing an example of a wearable terminal adopted in the work activity support system of the present invention, (b) An example of a state in which a worker wears a wearable terminal adopted in the work activity support system of the present invention on his / her head. It is a figure showing. It is a figure which shows an example of the real space which passes through the projection plane of a wearable terminal, and the real space image information which is displayed on a user terminal. It is a figure which shows an example of work image information. It is a figure which shows another example of work image information. An example of a state in which the work image information shown in FIGS. 4 and 5 is superimposed on the real space shown in FIG. 3 that is transmitted through the projection surface of the wearable terminal, or the real space image information shown in FIG. 3 displayed on the user terminal. It is a figure which shows an example of the work superimposition image information on which the work image information shown in FIGS. 4 and 5 is superposed.

Hereinafter, an example of the embodiment of the present invention will be described with reference to the accompanying drawings. In the present embodiment, the target of the operation work by the worker is a server rack installed in a data center or a server room, a network device such as a user-owned server installed in the server rack, an IT device, or the like, and FIG. As shown in the above, the wearable terminal 2 worn by the worker on the head, the management server 4, and the user terminal 3 used by the user are an Internet communication network and a wireless communication network defined by a wireless communication standard. The wearable terminal 2 and the user terminal 3 are connected to each other via a communication network 5 such as the above, and voice information and image information are mutually transmitted and received via the management server 4, and the user's instruction is also given. An example of a work activity support system 1 that supports operation work of network devices such as the server rack and the user-owned server and IT devices performed by the worker will be described.

[Wearable device configuration]
The wearable terminal 2 is used by a worker while being worn on the head, and is, for example, a display device such as the head-mounted display shown in FIG.

The wearable terminal 2 includes a display means 2a, an image pickup means 2b, an audio input means 2c, an audio output means 2d, and a work superimposed image information creating means 2e. Although not shown, the wearable terminal 2 is composed of a CPU, RAM, and the like, and has an arithmetic processing unit that processes and calculates various data, and a control that causes the arithmetic processing unit to execute a predetermined process under a predetermined computer program. It is provided with a storage unit for storing various data such as a unit and a memory, and a communication unit for transmitting and receiving various data to and from the user terminal 3 and the management server 4.

The display means 2a is a device that can visually recognize a real space including an object of work activity and displays work image information about the object, for example, an optical transmission type display. In the present embodiment, as shown in FIG. 2, the display means 2a is provided with a projection surface 2f that allows the real space including the object to pass through and projects working image information about the object. As shown in FIG. 3, the worker wearing the wearable terminal 2 on his / her head is engaged in work activities such as a server rack 7a that transmits the projection surface 2f of the display, the user-owned server 7b, the monitor 7c, and the IT device 7d. You can visually recognize the object 7, the data center including these, and the real space in the server room. A description of displaying working image information about the object 7 will be described later.

The imaging means 2b is a device that images a real space including an object 7, and is, for example, a camera or a video camera. In the present embodiment, the image pickup means 2b is a server rack 7a, which is an object 7 in accordance with the line of sight of the worker, as shown in FIG. 3, with the wearable terminal 2 attached to the head of the worker. The user-owned server 7b, monitor 7c, IT device 7d, etc., and the actual space in the data center or server room including these are imaged. The captured image information 6 in the real space as shown in FIG. 3 is sent directly to the user terminal 3 via the communication network 5 or sent to the user terminal 3 via the management server 4.

The voice input means 2c is, for example, a microphone device, and the voice output means 2d is, for example, an earphone device. The worker can talk with the user who is using the user terminal 3 via the communication network 5 or the management server 4 with the wearable terminal 2 attached to the head.

The working superimposed image information creating means 2e creates working superimposed image information in which the working image information is superimposed on the real space including the object 7 on the projection surface 2f. This process will be described later.

[User terminal configuration]
The user terminal 3 is a computer such as a personal computer, a smartphone, a tablet terminal, or the like, and is a network device such as a server owned by the company in a work space such as a data center or a server room where the worker takes over a predetermined work. It is a terminal used by a person (user) who has installed an IT device or the like.

The user terminal 3 includes a display means 3a, a voice input means 3b, a voice output means 3c, a work image information extraction means 3d, and a work image information selection / instruction means 3e. Although not shown, the user terminal 3 is composed of a CPU, RAM, and the like, and has an arithmetic processing unit that processes and calculates various data, and a control that causes the arithmetic processing unit to execute a predetermined process under a predetermined computer program. It is provided with a storage unit for storing various data such as a unit, a hard disk, and a memory, an information input unit such as a touch panel, and a communication unit for transmitting and receiving various data to and from the wearable terminal 2 and the management server 4.

The display means 3a is a device that displays image information 6 in the real space including the object 7 acquired from the wearable terminal 2 and superimposed image information for work, which will be described later, and is, for example, a liquid crystal display. In the present embodiment, the display means 3a includes the server rack 7a shown in FIG. 3, the user-owned server 7b, the monitor 7c, the IT device 7d, etc., imaged by the image pickup means 2b of the wearable terminal 2, and a data center including these. The image information 6 of the real space in the server room is acquired and displayed on the liquid crystal display.

The image information 6 in the real space displayed on the display means 3a is transmitted through the real space that the worker is visually recognizing through the projection surface 2f of the display means 2a of the wearable terminal 2, that is, the projection surface 2f. It is the same as the real space.

As shown in FIG. 3, the user includes a server rack 7a displayed on a liquid crystal display, a user-owned server 7b, a monitor 7c, an IT device 7d, and other objects 7 for work activities, and a data center and server including these. The image information 6 of the real space in the room can be visually recognized. A description of displaying the superimposed image information for work will be described later.

The voice input means 3b is, for example, a microphone device, and the voice output means 3c is, for example, an earphone device. The user can talk with the worker who wears the wearable terminal 2 on his / her head via the communication network 5 or the management server 4.

The working image information extraction means 3d acquires the image information 6 in the real space including the object 7 captured by the image pickup means 2b of the wearable terminal 2, and is associated with the identification information of the object 7 from the image information. Extract working image information.

As shown in FIGS. 4 and 5, for example, the working image information 8 of the present embodiment has data in the identification ID 8a assigned to each object 7 such as the user-owned server 7b, monitor 7c, and IT device 7d. Center name 8b, floor 8c, rack name 8d, user company 8e, person in charge 8f, expiration date 8g, equipment category 8h, power supply 8i, temperature 8j, humidity 8k, server rack, equipment layout map and floor guide map 8l Etc. are associated with each other. Such work image information 8 is stored in advance in the storage means 4a of the management server 4.

The working image information 8 may be created by associating the above information with the identification ID 8a for each object 7, or by associating other information with the identification ID 8a. For example
・ Server rack status (in use, free, reserved, etc.)
-Trend graph of current value, temperature, and humidity for each server rack or device-Device implementation diagram for each server rack-Wiring route based on network wiring information (underfloor, cable ladder, server rack, etc.)
・ Wiring circuit based on power supply wiring information (inside distribution board, underfloor, server rack, etc.)
-Confirmation display of the server rack where the alert is occurring (server rack color, arrow, etc.)
・ Manual of work target equipment and HP of manufacturer
-It is also possible to use the work image information 8 by associating a message, a comment, or the like from a viewer of a work video other than the worker with the identification ID 8a.

Further, the working image information 8 is associated with an AR (Augmented Reality) marker. As the AR marker, a conventionally known marker type or markerless type can be adopted.

When the marker type is adopted, a two-dimensional code having a specific graphic pattern associated with the identification ID 8a of the object 7 is displayed on the object 7, and an image of the real space including the object 7 is displayed from the wearable terminal 2. When the information 6 is acquired, the work image information extraction means 3d reads the identification ID 8a from the AR marker displayed on the object 7, and acquires the work image information 8 about the identification ID 8a from the management server 4. ..

When the markerless type is adopted, when features such as the shape of the object 7 are recorded in the management server 4 in association with the identification ID 8a and the image information 6 in the real space including the object 7 is acquired from the wearable terminal 2. In addition, the work image information extracting means 3d reads the identification ID 8a corresponding to the feature of the object 7 from the object 7, and acquires the work image information 8 about the identification ID 8a from the management server 4.

The work image information selection / instruction means 3e projects the work image information 8 onto the projection surface 2f of the wearable terminal 2 through which the real space including the object 7 is transmitted and superimposes it on the real space including the object 7. Is selected, and the management server 4 is instructed to send the message to the wearable terminal 2.

In the present embodiment, after the work image information extraction means 3d extracts the work image information 8 of the object 7 as shown in FIGS. 4 and 5, the server among the information shown in the work image information 8 is used. Data center name 8b, floor 8c, rack name 8d, user company 8e, person in charge 8f, expiration date 8g, power supply 8i, temperature 8j, humidity 8k, server rack, equipment layout map and floor guide map 8l for 7b , Status 8m is selected, and the management server 4 is instructed to send the work image information 8 composed of these information to the wearable terminal 2.

As shown in FIG. 6, the projection surface 2f of the display means 2a of the wearable terminal 2 has the working image information 8 about the selected server 7b in the real space including the object 7 passing through the projection surface 2f. Are superimposed. As shown in FIG. 6, the worker wearing the wearable terminal 2 on his / her head is an object of work activities such as a server rack 7a that transmits a projection surface 2f, a server 7b owned by the user, a monitor 7c, and an IT device 7d. The work image information 8 about the server 7b superimposed on the real space in the data center and the server room including the 7 and the work image information 8 can be visually recognized.

Further, in this case, the work superimposed image information 9 in which the work image information 8 about the server 7b is superimposed on the real space including the object 7 as shown in FIG. 6 is the work superimposed image information of the wearable terminal 2. It is created by the creation means 2e. The created superimposed image information 9 for work is sent directly to the user terminal 3 via the communication network 5, or is sent to the user terminal 3 via the management server 4.

The user terminal 3 acquires the work superimposed image information 9 shown in FIG. 6 from the wearable terminal 2 or the management server 4 and displays it on the display means 3a.

The work superimposed image information 9 displayed on the display means 3a is the real space that the worker is visually recognizing through the projection surface 2f of the display means 2a of the wearable terminal 2 and the object 7 superimposed on the real space. It is the same as the working image information 8 of the above.

As shown in FIG. 6, the user includes a server rack 7a displayed on a liquid crystal display, a user-owned server 7b, a monitor 7c, an IT device 7d, and other objects 7 for work activities, and a data center and server including these. The working image information 8 about the server 7b superimposed on the image information 6 in the real space in the room can be visually recognized.

[Management server configuration]
The management server 4 is composed of a computer or the like installed so that the service provider who provides the work activity support system of this embodiment can connect to the communication network 5. The management server 4 includes a storage means 4a and an image display control means 4b. Although not shown, the management server 4 composed of a computer has an arithmetic processing unit composed of a CPU, RAM, etc., which processes and calculates various data, and the arithmetic processing unit under a predetermined computer program performs predetermined processing. It includes a control unit to be executed, a storage unit that stores various data such as a hard disk and a memory, and a communication unit that transmits and receives various data to and from the wearable terminal 2 and the user terminal 3.

The above-mentioned working image information 8 is stored in the storage means 4a.

The image display control means 4b superimposes the working image information 8 about the object 7 acquired from the user terminal 3 on the projection surface 2f of the display means 2a of the wearable terminal 2 so as to superimpose it on the projection surface. The control process of projecting onto 2f is performed.

Further, the image display control means 4b performs a control process of displaying the work superimposed image information 9 acquired from the wearable terminal 2 on the display means 3a of the user terminal 3.

[Implementation of work using the work activity support system]
The work in the work space by the worker using the work activity support system of this embodiment is performed as follows.

The worker wears the wearable terminal 2 as shown in FIG. 2B, and works on the server rack 7a that passes through the projection surface 2f of the display means 2a, the user-owned server 7b, the monitor 7c, the IT device 7d, and the like. Enter the work space while visually observing the object 7 of the activity, the data center including these, and the real space in the server room.

At this time, as shown in FIG. 3, the image pickup means 2b of the wearable terminal 2 includes a server rack 7a which is an object 7, a server 7b owned by the user, a monitor 7c, an IT device 7d, etc. , Image the real space in the data center or server room including these. The captured image information 6 in the real space as shown in FIG. 3 is sent to the user terminal 3 via the management server 4.

The user operating the user terminal 3 can use the server rack 7a shown in FIG. 3, the server 7b owned by the user, the monitor 7c, the IT device 7d, and the like taken by the imaging means 2b of the wearable terminal 2, and a data center including these. And the image information 6 of the real space in the server room is acquired via the management server 4 and displayed on the display means 3a for visual recognition.

The user projects the image information for work on the projection surface 2f of the wearable terminal 2 through which the real space including the object 7 is transmitted by the work image information selection / instruction means 3e, and superimposes the image on the real space including the object 7. The management server 4 is instructed to select the image information 8 and send it to the wearable terminal 2.

The projection surface 2f of the display means 2a of the wearable terminal 2 is selected in the real space including the object 7 passing through the projection surface 2f by the above-mentioned control process of the image display control means 4b of the management server 4. The working image information 8 about the object 7 is superimposed.

As a result, for example, the guide map / server rack and the layout map of various devices in the server room are superimposed on the real space passing through the projection surface 2f of the display means 2a of the wearable terminal 2, and the user can move to the server room. The entered worker gives a work instruction using the voice input means 3b so that he / she can definitely go to the network device such as the server or the IT device owned by the user who should perform the work according to the guide map / arrangement map.

When a worker arrives at a network device such as a target server, an IT device, or the like in accordance with this instruction, the user again wears the real space including the object 7 by the work image information selection / instruction means 3e. The management server 4 is instructed to select the work image information 8 that is projected onto the projection surface 2f of the terminal 2 and superimposed on the real space including the object 7, and is sent to the wearable terminal 2.

This allows, for example,
・ Server rack status (in use, free, reserved, etc.)
-Trend graph of current value, temperature, and humidity for each server rack or device-Device implementation diagram for each server rack-Wiring route based on network wiring information (underfloor, cable ladder, server rack, etc.)
・ Wiring circuit based on power supply wiring information (inside distribution board, underfloor, server rack, etc.)
-Confirmation display of the server rack where the alert is occurring (server rack color, arrow, etc.)
-The manual of the work target device, the manufacturer's HP, the message, the comment, etc. from the viewer of the work video other than the worker are superimposed on the real space passing through the projection surface 2f of the display means 2a of the wearable terminal 2. , The user issues further work instructions to the worker using the voice input means 3b based on this information.

As described above, in the work activity support system 1 of the present embodiment, the worker is in the real space on which the work image information 8 about the object 7 projected on the projection surface 2f of the display means 2a of the wearable terminal 2 is superimposed. While visually observing, work is performed on network devices such as servers owned by the user and IT devices, and the user is in a data center or server room including an object 7 displayed on the display means 3a of the user terminal 3. The worker is given the necessary work instructions while visually recognizing the work image information 8 for the object 7 superimposed on the image information 6 in the real space, that is, the work superimposed image information 9. Therefore, according to the work activity support system 1 of the present embodiment, the following effects can be exhibited.

-It is possible to prevent mistakes in the work objects (server racks, various devices, cables, places to open the grating under the floor, etc.) by workers.
-It is possible to quickly find the object for which an alert is occurring.
-The worker can proceed while confirming the work contents to the user immediately before, and the user can promptly give a correction instruction when the worker makes a mistake in the work.
・ Since workers and users can work while communicating with each other, the added value of a sense of security is created for both.
-Information on network devices such as server racks and servers to be worked on and IT devices can be recognized by AR, and this information can be visually shared between workers and users.
-Since the IT skills of the workers can be directly transmitted to the users, it is possible to provide added value to the users with high IT skills for the workers, and to enjoy the high IT skills of the workers for the users. It is easy to recognize the added value.
-Since it becomes easier to find value not only in the IT skills of workers, but also in communication skills with users and behavior of work (behavior / behavior), the principle of competition among workers works, and server management and IT infrastructure management The business market is revitalized.

Although the preferred embodiments of the present invention have been described above with reference to the accompanying drawings, the present invention is not limited to these embodiments, and variously within the technical scope grasped from the description of the claims. It can be changed.

1 Work activity support system 2 Wearable terminal 2a Display means 2b Imaging means 2c Voice input means 2d Voice output means 2e Work superimposed image information creation means 2f Projection surface 3 User terminal 3a Display means 3b Voice input means 3c Voice output means 3d For work Image information extraction means 3e Work image information selection / instruction means 4 Management server 4a Storage means 4b Image display control means 5 Communication network 6 Real space image information 7 Object 8 Work image information 9 Work superimposed image information

Claims (4)

The wearable terminal worn by the worker on the head, the management server, and the user terminal used by the user are communicably connected via a communication network, and the management is performed between the wearable terminal and the user terminal. It is a work activity support system that sends and receives voice information and image information to and from each other via a server.
The wearable terminal is
An imaging means that captures the real space including the object to be worked on,
A wearable terminal-side display means having a projection surface for projecting work image information about the object while transmitting the real space including the object.
With
The user terminal is
A work image information extraction means that acquires image information in a real space including the object captured by the image pickup means and extracts the work image information associated with the identification information of the object from the image information. When,
The management so as to project on the projection surface through which the real space including the object is transmitted, select the work image information superimposed on the real space including the object, and send it to the wearable terminal. Work image information selection / instruction means to instruct the server,
Work activity support system equipped with. The wearable terminal is
Further provided with a work superimposed image information creating means for creating a work superimposed image information in which the work image information is superimposed on a real space including the object on the projection surface.
The user terminal is
The work activity support system according to claim 1, further comprising a user terminal side display means for displaying image information in a real space including the object acquired from the wearable terminal and superimposed image information for work. The work activity support system according to claim 1 or 2, wherein the work image information is associated with an AR marker. The work activity support system according to any one of claims 1 to 3, wherein the work image information is a guide map in a room where the worker works and a layout drawing of the object.

Images