JP2018092478A - Work instruction system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a work instruction system that can give a display without being bound by mutual setting even if the display setting of the aspect ratio or the like is different between a terminal on an administrator side and a terminal on a worker side.SOLUTION: A worker terminal 20 receives graphical information and aspect ratio information on an image display screen 200 by means of a communication unit 21, and deforms and displays the graphical information as necessary on the basis of the aspect ratio information and the aspect ratio of the worker terminal.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a work instruction system in which an administrator instructs a worker in a remote place.

  Conventionally, the diagnosis and various settings of electronic devices etc. have been performed by remote operation by a manager or support person via a communication line for workers or users in remote locations. Yes.

  For example, in Patent Document 1, in order to instruct a work that cannot be controlled inside software such as cable connection, moving image data obtained by photographing a support target with a mobile phone is transmitted to an operator terminal, and an operator uses the moving image data for the moving image. It is described that an icon such as an arrow, a figure, a mark including characters, an instruction sentence, and the like are displayed.

JP 2011-34315 A

  In the case of a system such as Patent Document 1, the user (operator) and the operator (administrator) rarely use the same device, and the screen size and aspect ratio (aspect ratio) that the user and the operator can visually recognize are small. May be different. In such a case, if the size or aspect ratio of the image to be displayed is determined according to one of the screens, it may not be possible to display all on the other screen. It may not be displayed on the operator side. In addition, because the aspect ratio is different, if the relative position of the graphic or the like indicating the instruction is different, the instruction target may be erroneously transmitted.

  As described above, there is a possibility that the instruction given by the administrator is not accurately transmitted to the worker.

  Therefore, in view of the above problems, the present invention displays images without being restricted by each other's settings even if the display settings such as the aspect ratio are different between the administrator side terminal and the worker side terminal. It is an object of the present invention to provide a work instruction system that can be used.

  In order to solve the above-mentioned problem, the invention according to claim 1 is directed to a work instruction having an administrator terminal for giving an instruction to a worker in a remote place and an operator terminal worn by the worker. In the system, the worker terminal includes photographing means for continuously photographing images in the line of sight of the worker, worker display means for reproducing the photographed image and displaying instructions for the worker, Worker communication means for transmitting the photographed image to the administrator terminal, and the administrator terminal receives administrator photograph means for receiving the photographed image, and administrator display means for reproducing and displaying the photographed image. The administrator terminal transmits graphic information indicating the instruction and aspect ratio information in the administrator display means from the administrator communication means, and the operator terminal transmits the graphic information and the administrator The worker communication means receives the aspect ratio information in the display means, and the graphic information is displayed in the manager display means based on the aspect ratio information in the manager display means and the aspect ratio of the worker display means. The work instruction system is characterized in that the relative position is maintained and displayed on the worker display means.

  According to a second aspect of the present invention, in the first aspect of the present invention, the manager terminal displays whether the aspect ratio of the captured image received by the manager communication means is maintained and displayed. It is set in setting information, and the manager display means displays the photographed image based on the display setting information.

  According to a third aspect of the present invention, in the first or second aspect of the present invention, when the display setting information is set so as not to maintain the aspect ratio of the captured image, the administrator display unit is preliminarily displayed. The size of the captured image is changed so as to be displayed on the entire surface within the designated display area, and is displayed on the manager display means.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the display setting information maintains an aspect ratio of the photographed image and is displayed in the display area. If set, the size of the captured image is changed and displayed on the administrator display means so that the aspect ratio of the captured image is maintained and displayed in the display area. It is.

  As described above, according to the first aspect of the present invention, even if the aspect ratio of the display screen is different between the administrator terminal and the worker terminal, the display environment of the worker terminal is not restricted by the setting of the administrator terminal. A combined display is possible.

  According to the second aspect of the present invention, even if the aspect ratio of the display screen is different between the administrator terminal and the worker terminal, the display is adapted to the display environment of the administrator terminal without being restricted by the setting of the worker terminal. be able to.

  According to the third aspect of the present invention, it is possible to perform display according to the size of the display area designated in advance on the manager display means.

  According to the invention described in claim 4, the aspect ratio of the worker terminal can be maintained and displayed on the manager terminal. Therefore, it is possible to perform display close to the display environment of the worker terminal.

1 is a configuration diagram of a work instruction system according to an embodiment of the present invention. It is a function block diagram of the administrator terminal shown by FIG. It is a function block diagram of the operator terminal shown by FIG. It is a flowchart of operation | movement of the administrator terminal and operator terminal which were shown by FIG. It is an example of a setting screen of the administrator terminal shown in FIG. It is a display example by the image size setting of the administrator terminal shown in FIG. It is an example of an image display screen of the administrator terminal shown in FIG. It is an example of a text input screen of the administrator terminal shown in FIG. It is an input example by free drawing, arc drawing, and arrow drawing. It is an example of a text display. It is an example of a display when an administrator terminal and an operator terminal have different aspect ratios.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram showing a work instruction system according to an embodiment of the present invention.

  In FIG. 1, the work instruction system 1 includes an administrator terminal 10 that gives an instruction to an operator, and an operator terminal 20 that the worker wears.

  The administrator terminal 10 and the worker terminal 20 can communicate with each other via a network 30 such as the Internet. In FIG. 1, the administrator terminal 10 is described as a notebook PC. However, a terminal device such as a desktop PC or a tablet terminal that has a display unit 13 and an input unit 14 to be described later can communicate with each other. That's fine.

  In the present embodiment, the worker terminal 20 is a glasses-type terminal (also referred to as smart glass) that the worker wears on the face. The worker terminal 20 has a frame 20a having a nose pad and a main body 20b provided on the right side of the frame (left side in FIG. 1). The main body 20b is provided with a display unit 23 and a camera 24, and also includes a network interface functioning as the communication unit 21 and the control unit 22 shown in FIG. Yes.

  The worker terminal 20 is not limited to the eyeglass-type terminal, and may be any terminal device that has the display unit 23 and the camera 24 and can communicate. For example, the display unit 23 and the camera 24 may be separate bodies, but are preferably wearable devices worn by workers. However, at the time of mounting, the camera 24 can take an image in the direction of the operator's line of sight, and the display unit 23 needs to be visible to the operator.

  In this embodiment, the manager means a person who operates the manager terminal 10 and gives instructions to the worker. The worker wears the worker terminal 20 and gives instructions from the manager. A person who receives and works.

  In the present embodiment, it is assumed that the worker who wears the worker terminal 20 and works is in a place (remote place) away from the place where the administrator operates the administrator terminal 10. The remote location is not limited to geographically separated places such as Japan and overseas, Tokyo and rural areas. For example, it may be in a state where the manager cannot directly give instructions to the worker, such as another building in the same site or another floor in the same building.

  FIG. 2 shows a functional configuration of the administrator terminal 10. The administrator terminal 10 includes a communication unit 11, a control unit 12, a display unit 13, and an input unit 14.

  The communication unit 11 serving as an administrator communication unit transmits information such as work instruction information, pause information, and resume information to the worker terminal 20, or receives image information (captured image) or the like from the worker terminal 20. To do. For example, if the communication unit 11 is a notebook PC, the network interface functions, and can be performed by either wired communication (for example, IEEE (Institute of Electrical and Electronics Engineers) 802.3) or wireless communication (for example, IEEE 802.11). You may communicate.

  The control unit 12 includes an image processing unit 12a and a text processing unit 12b. For example, if the control unit 12 is a notebook PC, the CPU functions. Further, the control unit 12 generates temporary stop information, resumption information, and work instruction information, which will be described later, based on an instruction input from the input unit 14, and causes the communication unit 11 to transmit the information to the worker terminal 20.

  The image processing unit 12a reproduces the image information received by the communication unit 11 and displays it on the display unit 13 as a captured image. In addition, the image processing unit 12 a causes the graphic information input from the input unit 14 to be superimposed on the captured image displayed on the display unit 13 and displayed on the display unit 13. This graphic information is transmitted from the communication unit 11 to the worker terminal 20 as work instruction information.

  The text processing unit 12 b causes the display unit 13 to display the text information input from the input unit 14. This text information is transmitted from the communication unit 11 to the worker terminal 20 as work instruction information.

  The display unit 13 as an administrator display unit displays the image information received by the communication unit 11, the graphic information and text information described above, and the like. If the display unit 13 is, for example, a notebook PC, display means such as a liquid crystal display functions.

  The input unit 14 serving as an input unit is used by the administrator to input work instructions and instructions such as suspension and resumption. For example, if the input unit 14 is a notebook PC, a keyboard, a mouse, and the like function. Further, a touch panel may be provided on the display unit 13 and a work instruction may be given by touch input using a finger or a stylus pen.

  FIG. 3 shows a functional configuration of the worker terminal 20. The worker terminal 20 includes a communication unit 21, a control unit 22, a display unit 23, and a camera 24.

  The communication unit 21 as worker communication means transmits image information and the like to the administrator terminal 10 and receives information such as work instruction information, suspension information, and resume information from the administrator terminal 10. The communication unit 21 functions as a network interface built in the worker terminal 20. Since the worker terminal is a wearable device worn by the worker in principle, it is preferable to perform wireless communication.

  The control unit 22 controls the pause and restart of the shooting of the camera 24 based on the pause information and the resume information. In addition, the control unit 22 causes the communication unit 21 to transmit the captured image captured by the camera 24 as image information to the administrator terminal 10, or causes the display unit 23 to display the work instruction information received by the communication unit 21. The control unit 22 functions as a CPU built in the worker terminal 20.

  The display unit 23 as an operator display unit displays a reproduction image of an image captured by the camera 24 and work instruction information received by the communication unit 21. As shown in FIG. 1, the display unit 23 is disposed at a position where the worker can visually recognize the information, and information displayed on the display unit 23 can be obtained from a part of the worker's field of view.

  As shown in FIG. 1, the camera 24 as an imaging unit is disposed in front of the main body 20 b and continuously captures images in the direction of the operator's line of sight. “Continuous” is not limited to so-called moving images, but includes taking still images at predetermined time intervals. The camera 24 is composed of, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

  Next, the operation of the work instruction system 1 configured as described above will be described with reference to the flowchart of FIG.

  First, the administrator terminal 10 will be described. The operation of the administrator terminal 10 is executed by the control unit 12. In step S101, transmission / reception is set and the process proceeds to step S102. The transmission / reception settings are, for example, settings related to general communication such as an IP (Internet Protocol) address and a communication port, settings for image communication, and the like. These settings are made by the administrator from the input unit 14, and the set information is stored in storage means (not shown) such as a memory in the administrator terminal 10.

  FIG. 5 shows an example of a setting screen for the administrator terminal. The setting screen 100 includes a reception IP address 101, a transmission destination IP address 102, an image communication port 103, an audio communication port 104, an image size designation 105, a magnification setting 106, an image size setting 107, and an aspect ratio. Is maintained, a setting 108, an OK button 109, and a Cancel button 110 are provided.

  The reception IP address 101 sets the IP address of the administrator terminal 10. The IP address of the worker terminal is set as the destination IP address. The port 103 for image communication sets a port number for image communication. The voice communication port 104 sets a port number for voice communication. Up to this point, settings related to general communication are made.

  The image size designation 105 selects whether to display the received image information according to the size transmitted from the worker terminal 20 or according to the designated size. The magnification setting 106 sets how many times the received image information is displayed when it is displayed in accordance with the size transmitted from the worker terminal 20.

  The image size setting 107 sets the vertical and horizontal sizes when the received image information is displayed in accordance with the specified size. Whether to maintain the aspect ratio is set 108 for setting whether to maintain the aspect ratio of the received image information. Up to this point, the settings for image communication are display setting information.

  The OK button 109 confirms the set contents. The Cancel button 110 discards the set contents.

  Here, optimization of image information transmitted from the worker terminal 20 will be described. In the present embodiment, the image information transmitted from the worker terminal 20 is transmitted in the size and aspect ratio (size and aspect ratio according to the specifications of the camera 24) of the image captured by the camera 24 as it is.

  In the administrator terminal 10, the received image information is set to the image size designation 105, the magnification setting 106, the image size setting 107, the size or aspect ratio to be displayed on the display unit 13 according to whether the aspect ratio is maintained or set 108. adjust. That is, the captured image is displayed based on the display setting information.

  For example, as shown in the upper part of FIG. 6, when it is assumed that the image size designation 105 matches the reception size, the image information transmitted from the worker terminal 20 is displayed on the display unit 13 of the administrator terminal 10 as it is (the aspect ratio). (The image display screen 200 shown in FIG. 7 is resized according to the received image size).

  Also, as shown in the middle of FIG. 6, if the size is designated by the above-described image size designation 105 and the aspect ratio is maintained or the setting 108 is not checked, the image information transmitted from the operator terminal 20 is managed. Displayed on the display unit 13 of the user terminal 10 in accordance with the size specified in the image size setting 107. That is, when it is set in the display setting information that the aspect ratio of the image is not maintained, the image is displayed on the entire display area (image display screen 200) designated in advance on the display unit 13 (administrator display means). Thus, the size of the image information (captured image) is changed and displayed on the display unit 13 (administrator display means).

  Also, as shown in the lower part of FIG. 6, when the size is designated by the image size designation 105 described above and the aspect ratio is maintained or the setting 108 is checked, the image information transmitted from the operator terminal 20 is managed. Displayed on the display unit 13 of the user terminal 10 while maintaining the aspect ratio within the size specified by the image size setting 107. That is, if the display setting information is set to maintain the image aspect ratio and display in the image display screen 200 (display area), the image aspect ratio is set in the image display screen 200 (display area). The size of the captured image is changed so as to be maintained and displayed on the display unit 13 (administrator display means).

  Returning to the description of the flowchart of FIG. 4, in step S <b> 102, it is determined whether or not there is a communication start trigger such as an administrator performing an operation indicating communication start from the input unit 14. Proceeding to step S103, if there is no communication start trigger, this step waits.

  Next, in step S103, image information transmitted from the worker terminal 20 is received, and the process proceeds to step S104. The image information received by the communication unit 11 is displayed on the display unit 13 (image display screen 200) as described above.

  Next, in step S104, it is determined whether or not there is an input indicating a pause from the input unit 14. If there is an input indicating a pause, the process proceeds to step S105, and if there is no input indicating a pause, step S108. Proceed to The temporary stop is input in a scene where the administrator wants to give an instruction to the worker among the captured images transmitted from the worker terminal 20. When there is an input indicating a pause, the image information (captured image) displayed on the display unit 13 is paused (becomes a still image).

  Next, in step S105, temporary stop information is generated and transmitted to the worker terminal 20 via the communication unit 11, and the process proceeds to step 106.

  Next, in step S106, the work instruction information input by the administrator from the input unit 14 is transmitted to the worker terminal 20 via the communication unit 11, and the process proceeds to step S107. The input of work instruction information will be described with reference to FIGS. The work instruction information is input by the administrator referring to the still image (the image at the time of pause) (based on the still image).

  FIG. 7 is an example of a display screen on which image information received from the worker terminal 20 is displayed. The image display screen 200 displays an icon section 210 for displaying settings, operations, operation states, and the like in the upper left corner in addition to image information.

  The icon unit 210 includes a setting call icon 211, a pause / resume icon 212, an image communication state icon 213, a voice communication state icon 214, and a work instruction input icon 215.

  When the setting call icon 211 is operated, a setting screen as shown in FIG. 5 is displayed. When the pause / resume icon 212 is operated, the pause / resume icon 212 transmits pause information to the worker terminal 20. When the pause / resume icon 212 is operated during the pause, the resume information is transmitted to the worker terminal 20.

  The image communication status icon 213 displays a status indicating whether image communication is being performed. The voice communication status icon 214 displays a status indicating whether voice communication is being performed. When the work instruction input icon 215 is operated, the instruction input icon part 220 is displayed in the upper right part of the image display screen 200 and the text input screen 300 shown in FIG. 8 is displayed.

  The instruction input icon unit 220 includes a pen icon 221, an arc icon 222, an arrow icon 223, and an eraser icon 224.

  When the pen icon 221 is selected, a figure having an arbitrary shape can be drawn at an arbitrary position of the image displayed on the image display screen 200 (a1 in the upper part of FIG. 9). When the arc icon 222 is selected, an arc can be drawn at an arbitrary position in the image displayed on the image display screen 200 (a2 in the middle of FIG. 9). When the arrow icon 223 is selected, an arrow can be drawn at an arbitrary position of the image displayed on the image display screen 200 (a3 in the lower part of FIG. 9). When the eraser icon 224 is selected, the above described drawing content can be erased (discarded). An image (graphic information) drawn (erased) based on these icons is displayed superimposed on the image information (still image) displayed on the display unit 13. That is, the work instruction information is input by being superimposed on the captured image displayed on the display unit 13 (administrator display means). The graphic information is also transmitted to the worker terminal 20 as work instruction information and displayed on the display unit 23 of the worker terminal 20.

  As shown in FIG. 8, the text input screen 300 has a setting 301 for the transmission language, a setting 302 for the text classification to be transmitted, a sentence / word selection 303 within the corresponding classification, and a selection of related phrases within the corresponding word. 304, transmission text 305, font name 306, size 307, color 308, preview 309, display position designation 310, old message automatic deletion 311, drawing button 312, and clear button 313. doing.

  In a transmission language setting 301, a language of text information to be transmitted to the worker terminal 20 is set. For example, Japanese and English can be selected, and can be set according to the language that the operator can understand. As the text classification setting 302 to be transmitted, classifications such as basic instruction, operation system, part system, and tool are set, and are selected according to the instruction to be transmitted.

  The sentence / word selection 303 in the corresponding category is set according to the category selected in the text classification setting 302 to be transmitted, and is selected according to the instruction to be transmitted. For example, when a part system is selected in the text classification setting 302, words such as “bolt” and “cover” can be selected. In the selection 304 of related words / phrases in the corresponding word, the wording is set in accordance with the classification selected in the sentence / word selection 303 in the corresponding classification, and is selected according to the instruction to be transmitted. For example, when “Bolt” is selected in the sentence / word selection 303 in the corresponding category, words such as “tighten” and “relax” can be selected.

  The transmitted text 305 is displayed in a state in which the word / phrase selected in the sentence / word selection 303 in the corresponding category and the related word / phrase selection 304 in the corresponding word is translated into the language set in the transmission language setting 301. For example, when the transmission language setting 301 is set to English, “bolt” is selected in the sentence / word selection 303 in the corresponding category, and “tighten” is selected in the related word / phrase selection 304 in the corresponding word, the “Bolt Lightten” "Is displayed. By doing so, even if the language understood by the administrator and the operator is different, it is possible to easily give an accurate instruction. The transmission text 305 may be directly input.

  A font name 306 sets a font name of text information to be transmitted. The size 307 sets the size of text information to be transmitted. A color 308 sets a color of text information to be transmitted. The preview 309 displays a preview of the content set with the font name 306, size 307, and color 308.

  The display position designation 310 sets whether or not to designate the position where the text information is displayed. For example, when the administrator terminal 10 includes a touch panel, the position for displaying the text information is specified by touching the display position. The old message automatic deletion 311 sets whether or not to delete the old message (text information) and display only the latest message. In other words, the already displayed message is deleted from the display unit 23. The setting information from the font name 306 to the old automatic message deletion 311 is included in the work instruction information as instruction display setting information and transmitted to the worker terminal 20.

  A specific example of the display position designation 310 and the old automatic message deletion 311 will be described with reference to FIG. The display position designation 310 and the old message automatic deletion 311 can change the display mode of the text information on the image display screen 200 by a combination of the settings.

  The upper left of FIG. 10 shows the case where the display position designation 310 is not checked (OFF) and the old message automatic deletion 311 is not checked (OFF). In this case, since the display position is not specified, it is displayed at the default position (bottom center in the figure), and the old message (text information) is not automatically deleted, so the old message is shifted up one line from the default position. Displayed with new message. The default position information is set in advance in the administrator terminal 10 and the worker terminal 20. In this case, from the viewpoint of the operator, for example, the order of operations such as first attaching bolts and then fastening bolts is displayed in order from the top to the bottom of the screen. Therefore, it becomes easy to grasp the flow of a series of work. In the example of FIG. 10, the default display position of the message is on the lower side of the screen, but may be on the upper side. In that case, in the pattern in the upper left of FIG. 10, the old messages are sequentially shifted down one line.

  The upper right of FIG. 10 shows the case where the display position designation 310 is checked (ON) and the old message automatic deletion 311 is not checked (OFF). In this case, since the display position is specified, it is displayed at the specified position (upper screen in the figure) and the old message is not automatically deleted, so the old message is a new message at the original position (lower center of the screen in FIG. 10). It is displayed with. In this case, when viewed from the operator, each message is displayed at a position related to each work, so that the work position related to the message can be easily grasped.

  The lower left of FIG. 10 shows the case where the display position designation 310 is not checked (OFF) and the old automatic message deletion 311 is checked (ON). In this case, since there is no designation of the display position, it is displayed at the default position (lower center in the figure), and the old message is automatically deleted, so only the new message is displayed. In this case, since only the latest message is displayed when viewed from the worker, it is easy to grasp the content that the worker should currently do.

  The lower right of FIG. 10 shows a case where the display position designation 310 is checked (ON) and the old automatic message deletion 311 is checked (ON). In this case, since the display position is specified, it is displayed at the specified position (upper screen in the figure), and the old message is automatically deleted, so only the new message is displayed. In this case, since only the latest message is displayed at the position related to the work as viewed from the worker, it becomes easy for the worker to grasp the contents to be currently done together with the work position.

  The drawing button 312 draws the set text information on the display unit 13. At the same time, the text information and instruction display setting information are transmitted to the worker terminal 20 as work instruction information. In the worker terminal 20, the received text information is displayed at the specified position when the position to be displayed on the display unit 23 is specified, and is displayed at the default position when it is not specified. Therefore, the position information of the text information is also included in the work instruction information and transmitted to the worker terminal. The clear button 313 clears (discards) the contents of the set text information.

  As described above, in this embodiment, only the information added by the administrator terminal 10 such as graphic information and text information is transmitted as the work instruction information, and the paused image itself is sent to the worker terminal 20. Not sent. Therefore, the amount of data transmitted to the worker terminal 20 can be reduced.

  Returning to the description of the flowchart of FIG. 4, when a restart instruction is input from the administrator in step S107, restart information is generated, transmitted to the worker terminal 20 via the communication unit 11, and the process proceeds to step S108. In this step, the pause is canceled and the display of the image information on the display unit 13 is resumed. The resume information is an operator terminal for instructing the display of the captured image (reproduced image) on the display unit 23 of the operator terminal 20 paused in step S105 and the restart of transmission of the image information to the administrator terminal 10. 20 is information to be transmitted.

  Next, in step S108, it is determined whether or not there is a communication end trigger such as an operation that indicates an end of communication from the input unit 14, and if there is a communication end trigger, the flowchart ends and the communication ends. If there is no trigger, the process returns to step S104.

  Next, the worker terminal 20 will be described. The operation on the worker terminal 20 is executed by the control unit 22. In step S201, transmission / reception is set and the process proceeds to step S202. The transmission / reception setting is a setting related to general communication such as an IP (Internet Protocol) address and a communication port. When the worker terminal 20 has an input unit or the like, this setting is performed by the worker or the like from the input unit. When the worker terminal 20 does not have an input unit or the like, setting information is set from another terminal (PC or the like) Can be transferred. The set information is stored in storage means (not shown) such as a memory in the worker terminal 20.

  Next, in step S202, it is determined whether there is a communication start trigger such as an operator performing an operation indicating communication start. If there is a communication start trigger, the process proceeds to step S203, and there is no communication start trigger. Waits at this step.

  Next, in step S203, the captured image captured by the camera 24 is transmitted as image information to the administrator terminal 10, and the process proceeds to step S204. The captured image is also displayed on the display unit 23 as a reproduced image. It is assumed that the reproduced image displayed on the display unit 23 has at least the same aspect ratio as the captured image. The display size may be appropriately enlarged or reduced according to the specifications of the display unit 23 or the like.

  Next, in step S204, it is determined whether or not the temporary stop information is received from the administrator terminal 10 via the communication unit 21, and if the temporary stop information is received, the process proceeds to step S205. If not, the process proceeds to step S207. Proceed to When the pause information is received, the playback image displayed on the display unit 23 is paused and the image transmission to the administrator terminal 10 is also stopped. Therefore, the image displayed on the display unit 23 is a still image.

  Next, in step S <b> 205, work instruction information is received from the administrator terminal 10 via the communication unit 21. The received work instruction information is displayed superimposed on an image (still image) displayed on the display unit 23 based on the above-described work display setting information, aspect ratio information described later, and the like. Therefore, the worker can see the graphic information and text information as the work instruction information superimposed on the image stationary in step S204.

  By the way, the image information displayed on the image display screen 200 does not necessarily have the same aspect ratio as the reproduced image viewed by the worker on the worker terminal 20 as described with reference to FIG. Therefore, the work instruction information includes the aspect ratio information of the image display screen 200 (aspect ratio information in the administrator display means) and the relative position of the graphic information and text information (when the display position is specified) on the image display screen 200. Information (drawing position information). By doing in this way, based on these information and the aspect ratio of the worker terminal 20, the graphic information is deformed as necessary according to the aspect ratio of the worker terminal 20 and displayed on the display unit 23. . The aspect ratio information is not limited to the so-called vertical / horizontal ratio of the screen, and may be the vertical and horizontal sizes (number of pixels) of the image display screen 200.

  FIG. 11 shows a display example of work instruction information on the administrator terminal 10 and the worker terminal 20. The arc (graphic information) indicated by b in FIG. 11 is the work instruction information. Since the administrator terminal 10 and the worker terminal 20 have different aspect ratios, the shapes of the arcs are different. However, based on the aspect ratio information and the relative position information, the administrator instructs the administrator terminal 10 to deform the arc. Can be displayed at the position.

  Returning to the description of the flowchart of FIG. 4, in step S <b> 206, resumption information is received from the administrator terminal 10 via the communication unit 21. When the resume information is received, the pause is canceled, the display of the reproduced image on the display unit 23 is resumed, and the transmission of the image information is resumed via the communication unit 21.

  Next, in step S207, it is determined whether or not there is a communication end trigger such as an operator performing an operation indicating the end of communication. If there is a communication end trigger, the flowchart is ended, and there is no communication end trigger. Returns to step S204.

  Note that the text information may be transmitted from the administrator terminal 10 to the worker terminal 20 even when the text information is not paused. For example, when instructing the operator to move the shooting range, such as “Please turn left”, there is no need to pause. Therefore, text information input from the text input screen 300 may be transmitted to the worker terminal 20 regardless of the operation of the pause / resume icon 212.

  Moreover, what is stopped by the temporary stop information and restarted by the resume information is not limited to the display on the display unit 23 or the transmission of the captured image to the administrator terminal 10, but may be the capturing of the camera 24 itself. Moreover, since the display of the display part 13 and the display part 23 should just pause, transmission itself of the picked-up image from the operator terminal 20 to the administrator terminal 10 does not need to stop.

  Further, as is clear from the above description, it is desirable that the image at the time of the temporary stop is the same image on the administrator terminal 10 and the worker terminal 20. Therefore, the suspension timing may be adjusted in consideration of the suspension information transmission processing time of the administrator terminal 10, the delay time of the network 30, the suspension processing time of the worker terminal 20, and the like.

  According to the work instruction system 1 described above, the manager terminal 10 receives a photographed image photographed by the worker terminal 20 as image information. When an instruction to pause image information is input from the administrator to the worker terminal 20, the image information displayed on the display unit 13 is paused and the pause information is sent to the worker terminal 20. Send. Thereafter, the work instruction information input from the administrator based on the image information at the time of the suspension by the suspension information is transmitted to the worker terminal 20. By doing so, the administrator can give an instruction based on the image visually recognized by the worker, so that the information visually recognized by the worker can be shared and given an instruction. Further, since an instruction is given based on the temporarily stopped image, the instruction can be given in an accurate scene.

  In addition, the worker terminal 20 receives the pause information from the administrator terminal 10 and pauses the reproduced image displayed on the display unit 23. Then, the work instruction information is received from the administrator terminal 10, and the work instruction information is displayed on the display unit 23 so as to be superimposed on the image at the time of pause. In this way, the instruction information is displayed superimposed on the playback image paused by the worker, so that the worker can obtain an instruction based on the image that he / she is viewing and understands the instruction. It becomes easy.

  Further, since the work instruction information is input while being superimposed on the image at the time of the temporary stop displayed on the display unit 13, the instruction can be input based on the image visually recognized by the worker. It is possible to give an accurate instruction based on the above.

  When the administrator terminal 10 inputs an instruction to resume shooting to the worker terminal 20, the administrator terminal 10 cancels the pause and restarts the display on the display unit 13, and uses the resume information. To the user terminal 20. When the worker terminal 20 receives the resume information from the administrator terminal 10, the worker terminal 20 releases the pause of the display unit 23 and resumes the display of the reproduced image. By doing in this way, the image of the operation | work which becomes the next instruction | indication object can be obtained by canceling | suspending a pause and restarting the transmission of the image from the operator terminal 20. In addition, the work can be confirmed according to the instruction given by the administrator.

  Further, since the worker terminal 20 is a glasses-type terminal worn on the worker's face, it is possible to acquire an image as close as possible to the worker's line of sight and to display work instruction information in the worker's field of view. Can do. In addition, since it is not necessary to have a terminal such as a mobile phone, it is possible to receive instructions while working.

  Further, in the worker terminal 20, the communication unit 21 receives the graphic information and the aspect ratio information on the image display screen 200, and displays the graphic information by modifying the graphic information as necessary based on the aspect ratio information. By doing in this way, even if the aspect ratios of the display screens are different between the administrator terminal 10 and the worker terminal 20, a display that matches the display environment of the worker terminal 20 without being restricted by the setting of the administrator terminal 10 is possible. can do.

  In addition, whether or not to display the administrator terminal 10 while maintaining the aspect ratio of the image information received by the communication unit 11 is set in the setting screen 100 (display setting information). Image information is displayed based on the setting of the screen 100. By doing in this way, even if the aspect ratios of the display screens are different between the administrator terminal 10 and the worker terminal 20, a display suitable for the display environment of the administrator terminal 10 is possible without being restricted by the setting of the worker terminal 20. can do.

  If the setting screen 100 (display setting information) is set not to maintain the aspect ratio of the image information, the image information size is changed so that the image information is displayed on the entire surface of the image display screen 200. It is displayed on the screen 200. By doing so, it is possible to display in accordance with the size of the image display screen 200.

  Further, when the setting screen 100 (display setting information) is set to maintain the aspect ratio of the image information and to be displayed in the display area of the image display screen 200, the aspect of the image information is displayed in the image display screen 200. The size of the image information is changed so as to be displayed while maintaining the ratio, and the image information is displayed on the image display screen 200. By doing so, the aspect ratio of the worker terminal 20 can be maintained and displayed on the administrator terminal 10. Therefore, it is possible to perform display close to the display environment of the worker terminal 20.

  In addition, the administrator terminal is set in the text input screen 300 (instruction display setting information) with respect to a mode in which an instruction (text information) to the worker terminal 20 is displayed on the worker terminal 20. Is input from the input unit 14, the setting information of the text input screen 300 is included in the work instruction information and transmitted from the communication unit 11 to the worker terminal 20. The worker terminal 20 receives the work instruction information from the communication unit 21. The display unit 23 receives the text information based on the setting information on the text input screen 300. By doing in this way, it is possible to display an instruction on the worker terminal 20 according to an aspect that the administrator wants to display.

  Since the text input screen 300 includes a display position designation 310, it is possible to select whether or not to display an instruction at the position designated by the administrator.

  Since the text input screen 300 includes the automatic message deletion 311 that has already been displayed, the old instruction (message) that has already been displayed is deleted and only the latest instruction is displayed. It is possible to select a mode in which the latest instruction is displayed while leaving the instruction.

  The present invention is not limited to the above embodiment. That is, those skilled in the art can implement various modifications in accordance with conventionally known knowledge without departing from the scope of the present invention. Of course, such modifications are included in the scope of the present invention as long as the configuration of the work instruction system of the present invention is provided.

DESCRIPTION OF SYMBOLS 1 Work instruction | indication system 10 Manager terminal 11 Communication part (manager communication means)
13 Display (Administrator display means)
14 Input section (input means)
20 Worker terminal (glasses type terminal)
21 Communication unit (worker communication means)
23 Display section (worker display means)
24 Camera (photographing means)

Claims (4)

A work instruction system having an administrator terminal that gives instructions to a worker at a remote location, and a worker terminal worn by the worker,
The worker terminal includes a photographing unit that continuously captures images in the line-of-sight direction of the worker, a worker display unit that reproduces the photographed image and displays an instruction to the worker, and Worker communication means for transmitting the captured image,
The administrator terminal includes an administrator communication unit that receives the captured image, and an administrator display unit that reproduces and displays the captured image.
The administrator terminal transmits graphic information indicating the instruction and aspect ratio information in the administrator display means from the administrator communication means,
The worker terminal receives the graphic information and the aspect ratio information in the manager display means by the worker communication means, and based on the aspect ratio information in the manager display means and the aspect ratio of the worker display means, The graphic information is displayed on the operator display means while maintaining the relative position in the captured image in the manager display means.
A work instruction system characterized by that. Whether or not to display the administrator terminal while maintaining the aspect ratio of the captured image received by the administrator communication unit is set in the display setting information,
The manager display means displays the captured image based on the display setting information.
The work instruction system according to claim 1.   If the display setting information is set not to maintain the aspect ratio of the photographed image, the size of the photographed image is set so as to be displayed on the entire surface within the display area designated in advance by the administrator display means. The work instruction system according to claim 1, wherein the work instruction system is changed and displayed on the manager display means.   If the display setting information is set to maintain the aspect ratio of the captured image and display in the display area, the display setting information is displayed with the aspect ratio of the captured image maintained. 4. The work instruction system according to claim 3, wherein the size of the captured image is changed and displayed on the manager display means.

Images