JP2021180369A - Worker terminal, remote work support device and work support system - Google Patents

Abstract

To provide a technique capable of appropriately setting imaging conditions of an imaging device that is provided in a worker terminal, while suppressing burden on a worker.SOLUTION: A worker terminal according to the present invention is characterized to identify which work a worker is performing, and switch an operation mode of an imaging part so that the imaging part operates in an operation mode corresponding to the identified work.SELECTED DRAWING: Figure 1

Description

The present invention relates to a technique for supporting the work of a worker.

As a technique for supporting on-site work, a technique has been developed in which a worker wears a worker terminal equipped with an image pickup device and provides various support via the worker terminal. Patent Document 1 discloses a work support device that provides information to a user by using a terminal including an image pickup unit. Patent Document 2 discloses a head-mounted image display device that corrects the position and posture of a camera based on the information of the captured image.

JP-A-2019-079469 Japanese Unexamined Patent Publication No. 2009-000231

The image pickup device provided in the worker terminal is used, for example, for a worker to take an image of equipment at a work site and provide various support using the image. The shooting environment and the object to be imaged vary depending on the situation at the work site, and if appropriate imaging conditions are not set, the image quality may deteriorate and appropriate support may not be provided.

The operator can also operate the image pickup device by himself / herself to adjust the image pickup conditions. However, the worker needs to carry out the original work, and if the work of adjusting the image pickup device separately occurs, the burden on the worker is heavy. Therefore, a technique that can set appropriate imaging conditions without increasing the burden on the operator is desired.

In the technique of correcting the position of the camera based on the captured image as in Patent Document 2, it is necessary to capture an image to be used for the correction process before performing the correction. Therefore, the worker needs to perform an imaging operation different from the original work only for the correction process, and at least to that extent, the worker is burdened.

The present invention has been made in view of the above problems, and provides a technique capable of appropriately setting the imaging conditions of the imaging device provided in the operator terminal while suppressing the burden on the operator. The purpose is.

The worker terminal according to the present invention identifies which work the worker is performing, and switches the operation mode of the image pickup unit so as to operate in the operation mode corresponding to the identified work.

According to the present invention, it is possible to appropriately set the imaging conditions of the imaging device included in the operator terminal while suppressing the burden on the operator.

It is a block diagram of the worker terminal 10 which concerns on Embodiment 1. FIG. It is a flowchart explaining the operation of a worker terminal 10. An example of work data 107 is shown. An example of the operation mode data 106 is shown. A modification of the operation mode data 106 is shown. A modification of the worker terminal 10 is shown. A modification of the operation mode data 106 is shown. An example of the operation mode data 106 when the mode determination unit 104 identifies the number of characters in the character string of the work content is shown. An example of the operation mode data 106 when the mode determination unit 104 identifies the number of strokes of the character string of the work content is shown. An example of the operation mode data 106 when the mode determination unit 104 identifies the number of characters of the reading kana of the character string of the work content is shown. This is an example of work data 107 in the case of defining a character string (font) of a character string in addition to a character string of a work content. This is an example of work data 107 in the case of defining the print size of the character string in addition to the character string of the work content. This is an example of work data 107 in the case of defining the character color of the character string in addition to the character string of the work content. An example of the operation mode data 106 when the mode determination unit 104 determines the operation mode according to the font of the character string of the work content is shown. An example of the operation mode data 106 when the mode determination unit 104 determines the operation mode according to the print size of the character string of the work content is shown. An example of the operation mode data 106 when the mode determination unit 104 determines the operation mode according to the character color of the character string of the work content is shown. This is an example of the operation mode data 106 when the mode determination unit 104 determines the operation mode according to the work type. It is a block diagram of the work support system 100 which concerns on Embodiment 2. FIG. It is a flowchart explaining the operation of the worker terminal 10 in Embodiment 2. A modification of the work support system 100 is shown. It is a flowchart explaining the operation of the work support system 100 of FIG. It is a block diagram of the work support system 100 which concerns on Embodiment 3. It is a flowchart explaining operation of a remote work support apparatus 40. A modification of the work support system 100 according to the third embodiment is shown.

<Embodiment 1>
FIG. 1 is a configuration diagram of a worker terminal 10 according to the first embodiment of the present invention. The worker terminal 10 is a terminal that supports the work of the worker 20 by being worn by the worker 20. The worker 20 performs the work on the work target 30, and the worker terminal 10 supports the work.

The worker terminal 10 includes an image pickup unit 101, an input unit 102, a work management unit 103, a mode determination unit 104, an operation mode switching unit 105, an operation mode data 106, and a work data 107.

The work management unit 103, the mode determination unit 104, and the operation mode switching unit 105 are realized as processing of software mounted in the processor 140 as an example. The processor 140 is configured by, for example, a CPU (Central Processing Unit) or the like. The work management unit 103, the mode determination unit 104, and the operation mode switching unit 105 may be realized as digital circuits. For example, it may exist as a functional block in an integrated circuit of the same IC, for example, FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit), or the like. In the following, for convenience of description, these functional units will be described as an operating entity, but when these functional units are implemented by software, the actual operating entity is an arithmetic unit that executes the software. The same applies to each functional unit such as the mode determination unit 204, the work instruction unit 316, the work management unit 303, and the voice recognition unit 320, which will be described later.

The worker terminal 10 is, for example, a device used by attaching the image pickup unit 101 to the head of the worker 20. The image pickup unit 101 may be connected to the worker terminal 10 by a cable or the like, and each functional unit other than the image pickup unit 101 may be held at a place other than the head of the worker 20.

The operation mode data 106 and the work data 107 are stored in the memory 150. The memory 150 is a memory area for storing data or the like used by the processor 140 to control the worker terminal 10, and is realized by, for example, a flash memory or the like. The memory 150 may be another storage medium such as an HDD (Hard Disk Drive) or an optical disk capable of writing and reading. Further, it may be a temporary storage area such as RAM (Random Access Memory).

The worker 20 performs work such as visual confirmation and operation on the work target 30. The image pickup unit 101 is installed so as to photograph the direction of the field of view of the operator 20, and photographs the direction of the work target 30 during work.

FIG. 2 is a flowchart illustrating the operation of the worker terminal 10. Each step of FIG. 2 will be described below.

In step S202, the worker 20 uses the input unit 102 to input that the work is to be started. The input unit 102 is realized by a device such as a push button.

In step S203, the work management unit 103 refers to the work data 107 and reads out information about the first work. Specific examples of the work data 107 will be described later. In this step, although the description is omitted in the flowchart, the work management unit 103 may notify the worker 20 of the read work content information by the notification unit 108. As an example of the notification unit 108, a means for visually notifying the work content can be used by a head-mounted display or the like. The notification unit 108 may be a means for notifying by voice such as a speaker. If the contents of the work data 107 are grasped by the worker 20 by a printed matter (not shown) or the like, the notification unit 108 may be omitted.

In step S204, the work management unit 103 transmits the read work data to the mode determination unit 104. The mode determination unit 104 identifies the operation mode corresponding to the work data by referring to the operation mode data 106 using the work data. Specific examples of the operation mode data 106 will be described later.

In step S205, the operation mode switching unit 105 sets the operation mode of the image pickup unit 101 according to the operation mode data specified by the mode determination unit 104.

In step S206, the worker 20 performs the work of the notified contents on the work target 30.

In step S207, the worker 20 uses the input unit 102 to input that the work has been completed.

In step S208, the work management unit 103 refers to the work data 107 and determines whether or not there is the next work. If there is a next work, the process proceeds to step S209, the work management unit 103 refers to the work data 107, reads out the data of the next work, returns to step S204, and performs the same until all the work is completed. Repeat the operation of. If there is no next work, all the work is completed and this flowchart is finished.

While the flowchart of FIG. 2 is being performed, the image pickup unit 101 may photograph the surrounding environment and store the image data in a storage unit (not shown). Alternatively, the captured image data may be transmitted to another device via a network (not shown).

FIG. 3 shows an example of work data 107. The work data 107 is, for example, list data in which a number indicating a work procedure and a character string describing the work content are associated with each other. For example, the work management unit 103 identifies the work currently being performed by the worker 20 by incrementing the work number each time the worker 20 inputs the work completion in S207. The work management unit 103 reads information about the work content (character string describing the work content) corresponding to the current work number from the work data 107.

FIG. 4A shows an example of the operation mode data 106. The operation mode data 106 is, for example, list data in which the work content and the focus mode at the time of shooting are associated with each other. The mode determination unit 104 reads out the focus mode corresponding to the data of the work content. For example, according to the record on the first line, it can be seen that when the work number 1 (or work content: name label confirmation “control device”) is executed, the shooting condition of the image pickup unit 101 is set to the autofocus mode.

FIG. 4B shows a modified example of the operation mode data 106. The text of the work content is not always necessary, and as shown in FIG. 4B, the operation mode data 106 may be configured by a list showing the correspondence between the work procedure number and the focus mode.

In this way, by switching the operation mode of the image pickup unit 101 according to the work content, the worker 20 does not need to perform an additional operation on the image pickup unit 101 in order to adjust the operation mode according to the work environment. It is possible to reduce the time required for work. The following is an example of the effect of switching the operation mode.

When the image pickup unit 101 is attached to the head of the worker 20, the time and distance at which the worker 20 sees the direction of the work target 30 differs depending on the content of the work. For example, when performing the work of confirming the name label in FIG. 3, it is expected that the worker 20 approaches the work target 30 to a position where the characters on the label can be read, and during the time for recognizing and reading the label characters. It is expected that the head will be stationary.

The time it takes to recognize and read the label characters depends on the type of character. For example, the "control device" and "power operation switch" written in Chinese characters have a large number of characters to be read out with respect to the number of characters, and the head of the worker 20 has a long rest time. Kana, alphabets and numbers such as "generator" and "A01" have a small number of characters to be read aloud and have a short head rest time.

On the other hand, when the label is photographed by the image pickup unit 101, characters having a large number of strokes such as Chinese characters have many lines per space, so that it is difficult to distinguish the characters if the contrast of the photographed image is low. Characters with a large number of strokes, such as kana, alphabets, and numbers, have few lines per space and can be photographed to the extent that the characters can be recognized even if the shooting conditions are slightly poor.

When the image pickup unit 101 can switch the focus mode between autofocus and fixed focus, the contrast of the captured image can be increased by focusing on the subject to be photographed by autofocus, but the time required for focusing is about 1 second or more. , The camera needs to be stationary.

Therefore, if the autofocus function is turned on when capturing a character type that requires a long time to read such as Chinese characters, the camera's autofocus operation is completed during the time when the operator 20 rests his / her head due to the reading work. It is possible, so there is no need to intend the head to be stationary. On the other hand, in the case of pseudonyms, alphabets, and numbers, the contrast required for shooting is low, so the time burden on the operator 20 can be reduced by capturing the fixed focus in a short still time.

As a result of the above examination, as a specific example of the operation mode data 106, it was decided to switch between the autofocus mode and the fixed focus mode according to the label character string as shown in FIG. 4AB. However, other operation modes can be set according to the work content. Specific examples of other operation modes will be described later.

FIG. 5 shows a modified example of the worker terminal 10. The worker terminal 10 shown in FIG. 5 includes a microphone 109 and a voice recognition unit 110 in place of the input unit 102. Since other configurations are the same as those in FIG. 1, the description thereof will be omitted.

The microphone 109 picks up the utterance content of the worker 20, and the voice recognition unit 110 recognizes the picked up voice as characters. The work management unit 103 identifies the work content from the character string recognized by the voice recognition unit 110. Subsequent operations are the same as the configuration of FIG.

The voice recognition unit 110 recognizes a specific keyword such as "work OK". When the voice recognition unit 110 recognizes the keyword, the work management unit 103 adds, for example, a number indicating the work procedure one by one. In this case, the worker 20 performs the work in the order of the list, utters a keyword each time each work is completed, and the voice recognition unit 110 operates.

In addition to this, a specific work content may be selected by voice recognition of a combination such as the keywords "label confirmation" and "A01" included in the work name, or voice recognition of the work number. In this case, the worker 20 operates the voice recognition unit 110 by reading out and confirming the work name immediately before performing the work.

A part of the worker terminal 10 may be realized by the function of an electronic device such as a tablet or a smartphone. In this case, the notification unit 108 is realized by a display or a speaker. The input unit 102 is realized by a touch panel. The processor 140 and the memory 150 are realized by a SoC (System on Chip) or a RAM (Random Access Memory) in an electronic device. When a part of the worker terminal 10 is realized by a tablet or a smartphone, among the connections indicated by the arrows in FIG. 1, the connection between the tablet or smartphone part and the other part is wireless communication such as Bluetooth or Wifi. It may be a wired connection such as USB or MIPI.

<Embodiment 1: Modification example of work data and operation mode data>
In addition to the operations described above, the mode determination unit 104 may be configured to have a function of identifying work contents. For example, the mode determination unit 104 specifies the character type from the character string of the work content received from the work management unit 103. The mode determination unit 104 determines whether the character type of the label such as "control device" or "generator" is kanji, kana, number, or alphabet. For example, a correspondence table to which the character type of the character code is associated is stored in the memory 150 in advance, and the character type of the work content character string can be specified by referring to the correspondence table. Other suitable methods may be used.

FIG. 6 shows a modified example of the operation mode data 106. When the mode determination unit 104 can determine the character type, the operation mode data 106 can be configured as data in which the character type and the operation mode are associated with each other as shown in FIG. The mode determination unit 104 determines the operation mode by referring to the operation mode data 106 using the determined character type.

When the mode determination unit 104 can identify the character type, the amount of data of the operation mode data 106 can be reduced. For example, the same work may be performed multiple times in a series of work. In this case, the data size of the operation mode data 106 can be suppressed by defining the operation mode for each character type of the work content rather than defining the operation mode for each work number. The advantage can be obtained by determining the operation mode according to the character type.

In addition to the character type of the character string of the work content, the mode determination unit 104 may identify the number of characters in the character string, the number of strokes, the number of characters in the reading kana, and the like. The number of characters, the number of strokes, and the number of characters in the reading kana can be determined from the character string in the work content column of the work data 107.

7A to 7C show an example of the operation mode data 106 when the mode determination unit 104 identifies the number of characters, the number of strokes, and the number of characters of the reading kana in the character string of the work content. Even in this case, the operation mode data 106 defines the correspondence between the number of characters in the work content character string, the number of strokes, the number of characters in the reading kana, and the shooting mode. The mode determination unit 104 can determine the operation mode by referring to the operation mode data 106 using the identified number of characters, the number of strokes, and the number of characters of the reading kana.

8A to 8C are examples of work data 107 in the case of defining a character string (font), a print size, a character color, and the like of the character string in addition to the character string of the work content. The mode determination unit 104 can also determine the operation mode according to the character type, print size, character color, and the like of the character string in addition to the character type of the character string of the work content. In this case, the work data 107 defines the character string of the work content, as well as the character style, print size, character color, and the like of the character string.

9A to 9C show an example of the operation mode data 106 when the mode determination unit 104 determines the operation mode according to the character style, print size, and character color of the character string of the work content. Even in this case, the operation mode data 106 defines the correspondence between the font, print size, character color, and the shooting mode of the work content character string. The mode determination unit 104 can determine the operation mode by referring to the operation mode data 106 using the character style, print size, and character color of the character string.

As shown in FIGS. 7A to 9C, when the operation mode is defined according to the attribute of the character string representing the work content, the person who defines the work data 107 and the person who defines the operation mode data 106 can be separated. For example, when the manager of the work procedure defines the work data 107, the manager may not be familiar with the operation mode of the image pickup unit 101, but may be familiar with the attributes of the character string on the work target 30. In this case, the administrator may define only the work data 107, and the operation mode data 106 may be defined by a person who is familiar with the imaging unit 101. This makes it possible to comprehensively define the operation modes in various work environments.

The operation mode of the image pickup unit 101 may be determined depending on the work type such as whether it is a visual operation such as a label or an operation involving other operations such as a switch operation. Alternatively, it operates according to the distance between the worker 20 and the work target 30 (position of the worker 20) for each work, the brightness of the work target 30 within the range visually visible by the worker 20, the work posture of the worker 20, and the like. The mode may be determined. These may be combined. These pieces of information can be defined in advance in the work data 107 for each work content. The mode determination unit 104 acquires these information corresponding to the current work contents from the work data 107.

The operation mode of the image pickup unit 101 switched by the operation mode switching unit 105 is not limited to either autofocus or fixed focus. For example, the zoom function of the image pickup unit 101, the focus position, the aperture, the shutter speed, the on / off of flash lighting (not shown), the resolution when saving the captured image, the frame rate when acquiring the moving image data, and when compressing and saving the moving image data. It may be a parameter such as the bit rate of. Further, the image pickup unit 101 has a function of acquiring a color image and an infrared image, and may switch whether to capture a color image or an infrared image. Further, a plurality of these switching functions may be provided.

FIG. 10 is an example of the operation mode data 106 when the mode determination unit 104 determines the operation mode according to the work type. Here, the operation mode of the image pickup unit 101 is set to the focus position. The mode determination unit 104 determines the operation mode (focus position) by referring to the operation mode data 106 using the work type described in the work data 107. In this case, even if the distance at which the worker 20 approaches the work target 30 changes due to the work, the focus of the image captured by the image pickup unit 101 can be optimized. When reading characters, the worker 20 approaches the work target 30 according to the size of the characters, but in the case of switch operation, etc., the worker 20 works at a distance that is easy to operate, such as the length of a hand, so the optimum focus position is different. Optimal focusing can be achieved by setting the focus position in which the approach distance is predicted according to the work content.

The information used by the mode determination unit 104 for determination can be expressed numerically, for example, the number of characters and the character size of the label, and the operation mode switched by the operation mode switching unit 105 is numerical values such as zoom magnification, focus position, and aperture. If it can be expressed, the operation mode may be determined by a function that receives a numerical value as an input and outputs a numerical value of the operation mode. In this case, the operation mode data 106 holds the parameters that define the function, not the list information.

<Embodiment 2>
FIG. 11 is a block diagram of the work support system 100 according to the second embodiment of the present invention. The work support system 100 is a system that supports the work of the worker 20. The main difference from the first embodiment is that the worker terminal 10 does not have the mode determination unit 104 and the operation mode data 106, and instead, the remote work support device 40 has the mode determination unit 204 and the operation mode data 206. (Stored in the memory of the remote work support device 40) is provided. In the following, the same reference numerals will be given to the same functional parts as those in the first embodiment, and the points different from those in the first embodiment will be mainly described.

The remote work support device 40 is a device that supports or manages the work of the worker 20. The worker terminal 10 communicates with the remote work support device 40 via the communication unit 209 and the network 50. The remote work support device 40 communicates with the worker terminal 10 via the communication unit 214 and the network 50. The memory of the remote work support device 40 can be configured by, for example, a flash memory or a hard disk device.

The network 50 can be realized by a configuration connected by wireless communication using electromagnetic waves such as Wi-fi, Bluetooth, and mobile communication, and wired communication using a cable such as Ethernet. The network 50 may include a router, an exchange, a repeater, or the like (not shown), or may be in a form in which the communication unit 209 and the communication unit 214 directly communicate with each other.

FIG. 12 is a flowchart illustrating the operation of the worker terminal 10 in the second embodiment. Each step of FIG. 12 will be described below.

In step S802, the worker 20 uses the input unit 102 to input that the work is to be started.

In step S803, the work management unit 103 refers to the work data 107 and reads out the information of the first work (character string describing the work contents).

In step S804, the work management unit 103 transmits the work content to the remote work support device 40 via the communication unit 209 and the network 50. The remote work support device 40 receives the work content via the communication unit 214. The mode determination unit 204 reads out the operation mode corresponding to the work content by referring to the operation mode data 206. The operation mode data 206 is the same data as the operation mode data 106 in the first embodiment. The mode determination unit 204 transmits the operation mode read from the operation mode data 206 to the worker terminal 10 via the communication unit 214.

In step S805, the worker terminal 10 receives the operation mode data transmitted from the remote work support device 40.

In step S806, the operation mode switching unit 105 sets the operation mode of the image pickup unit 101 according to the operation mode data transmitted from the remote work support device 40. Although the description is omitted in the flowchart, the work management unit 103 may notify the worker of the read work content information by the notification unit 108. The notification means is the same as that of the first embodiment.

In step S807, the worker 20 performs the work of the notified contents on the work target 30.

In step S808, the worker 20 uses the input unit 102 to input that the work has been completed.

In step S809, the work management unit 103 refers to the work data 107 and determines whether or not there is the next work. If there is a next work, the process proceeds to step S810, and the work management unit 103 refers to the work data 107 and reads out the data of the next work. The process returns to step S804, and the operation is repeated until all the work is completed. If there is no next work, all the work is completed and this flowchart is finished.

FIG. 13 shows a modified example of the work support system 100. In this modification, the work data 207 is held on the side of the remote work support device 40.

FIG. 14 is a flowchart illustrating the operation of the work support system 100 of FIG. Each step of FIG. 14 will be described below. Since S801, S802, S806, S807, S808, S809, and S810 are the same as those in FIG. 12, the description thereof will be omitted.

In step S813, the settings in the work support system 100 are initialized. For example, the work management information held by the work management unit 103 is set as an initial value.

In step S814, the work management information held by the work management unit 103 (for example, the work number to be performed by the worker 20) is transmitted from the worker terminal 10 to the remote work support device 40 by the communication unit 209 via the network 50. .. The remote work support device 40 receives work management information via the communication unit 214, the mode determination unit 204 reads the work content from the work data 207, and the operation mode data 206 sets the operation mode corresponding to the work content. read out. The mode determination unit 204 transmits the work content and the operation mode data to the worker terminal 10 by the communication unit 214. At this time, if all the work in the work data 207 has been completed, data indicating that all the work has been completed is transmitted as the work content.

In step S815, the worker terminal 10 receives the work content data and the operation mode data transmitted from the remote work support device 40.

In step S819, the work mode data transmitted from the remote work support device 40 is referred to, and it is determined whether or not all the work has been completed. If not all work is completed, the process proceeds to step S806. If all the work is completed, it means that all the work is completed, and this flowchart is terminated.

In step S820, the work management unit 103 advances the work state by one and returns to step S814. The operation is repeated until all the work is completed.

By aggregating the work data 207 and the operation mode data 206 in the remote work support device 40 in this way, the work support system 100 can reduce the data holding area. Further, even when a plurality of the worker 20 and the worker terminal 10 exist, the work data 207 and the operation mode data 206 can be managed by the remote work support device 40, and the data can be updated or changed collectively.

<Embodiment 3>
FIG. 15 is a block diagram of the work support system 100 according to the third embodiment of the present invention. In the work support system 100 according to the third embodiment, in addition to the configuration described in the second embodiment, the user (supporter 60) of the remote work support device 40 and the worker 20 mutually interact with each other each time one work is performed. It is a system that assumes that work will proceed while communicating. Therefore, the remote work support device 40 is provided with an interface for the supporter 60 to operate the remote work support device 40. In the following, the part in which the supporter 60 is mainly involved will be described.

The worker terminal 10 includes an imaging unit 101, an input unit 102, a work management unit 103, an operation mode switching unit 105, a notification unit 108, a communication unit 209, a recording unit 310, a playback unit 311, a microphone 312, and a speaker 313. .. The image pickup unit 101, the input unit 102, the work management unit 103, the operation mode switching unit 105, the work data 107, and the notification unit 108 are the same as the worker terminal 10 of the first embodiment, and the description thereof will be omitted.

The remote work support device 40 includes a mode determination unit 204, an operation mode data 206, a work data 207, a communication unit 214, a display unit 315, a work instruction unit 316, a playback unit 317, an input unit 318, a speaker 319, a recording unit 321 and a microphone. It is equipped with 322. The communication unit 209, the mode determination unit 204, the operation mode data 206, the work data 207, and the communication unit 214 are the same as those in the second embodiment, and the description thereof will be omitted.

The operation of the worker terminal 10 is the same as that of FIG. 14 described in the second embodiment. While executing the flowchart of FIG. 14, the image pickup unit 101 transmits the captured image data to the remote work support device 40 via the communication unit 209. The remote work support device 40 displays the image data together with the work information on the display unit 315. The supporter 60 can refer to the viewpoint image of the worker 20 by the image displayed on the display unit 315. The worker terminal 10 and the remote work support device 40 may have a storage unit (not shown), and the image data captured by the image pickup unit 101 may be stored in the storage unit. The image data may be a moving image or a still image. It is also possible to limit the shooting period to, for example, only during S807 to reduce power consumption and communication amount.

FIG. 16 is a flowchart illustrating the operation of the remote work support device 40. Each step of FIG. 16 will be described below.

In step S1302, the communication unit 214 receives the work information transmitted by the worker terminal 10. For example, the worker 20 receives the completed work number information.

In step S1303, the received work information is displayed on the display unit 315 and the supporter 60 is notified. The information displayed on the display unit 315 may be a part of the work data 207 held in the remote work support device 40, which is related to the information transmitted by the worker terminal 10. For example, the work content information corresponding to the work number information is displayed. The work data 207 is the same data as the work data 107 in the first embodiment.

In step S1304, the supporter 60 confirms the information displayed on the display unit 315, and inputs the instruction information using the input unit 318. For example, instruct the displayed information to do the following: The work instruction unit 316 transmits the instruction content to the worker terminal 10. With reference to the work data 207, if all the work in the list has been completed, data indicating that all the work has been completed is transmitted as work data.

In step S1305, the mode determination unit 204 selects operation mode data from the operation mode data 206 in relation to the instruction content transmitted by the work instruction unit 316. The operation mode data 206 is the same as the operation mode data 106 in the first embodiment.

In step S1306, the mode determination unit 204 transmits the selected operation mode data to the worker terminal 10 via the network 50.

In the third embodiment, the worker 20 and the supporter 60 can share information and proceed with the work. By setting the operation mode of the image pickup unit 101 according to the content of the work instruction, both the worker 20 and the supporter 60 can shorten the time required for setting the shooting.

The worker terminal 10 converts the conversation and surrounding sounds of the worker 20 picked up by the microphone 312 into voice data by the recording unit 310, and transmits the voice data to the remote work support device 40 by the communication unit 209. The remote work support device 40 receives the transmitted voice data by the communication unit 214, reproduces it by the reproduction unit 317, and transmits it to the supporter 60 by the speaker 319. Similarly, the remote work support device 40 converts the conversation of the supporter 60 picked up by the microphone 322 into voice data by the recording unit 321 and transmits it to the work support system terminal 11 by the communication unit 214. The work support system terminal 11 receives the transmitted voice data by the communication unit 209, reproduces it by the reproduction unit 311 and transmits it to the worker 20 by the speaker 313. As a result, the worker 20 and the supporter 60 can proceed with the work while communicating with each other by voice.

FIG. 17 shows a modified example of the work support system 100 according to the third embodiment. The work support system 100 shown in FIG. 17 uses a microphone 322 instead of the input unit 318 of the remote work support device 40. The remote work support device 40 further includes a recording unit 321 and a voice recognition unit 320, and converts the utterance to the microphone 322 into a character string by voice recognition. Details will be described later.

The remote work support device 40 operates according to the flowchart shown in FIG. However, since some steps are different from those in FIG. 16, the differences will be described below.

Also in this modification, when the work information is transmitted from the worker terminal 10, the remote work support device 40 operates according to the flowchart of FIG.

In step S1302, the communication unit 214 receives work information. For example, the work number information completed by the worker 20 is transmitted.

In step S1303, the information based on the received work information is displayed on the display unit 315 or pronounced by the speaker 319 via the reproduction unit 317, and the supporter 60 is notified. The information displayed on the display unit 315 or pronounced by the speaker 319 may be a part of the work data 207 held in the remote work support device 40 related to the information transmitted by the worker terminal 10. For example, it is work content information corresponding to work number information.

In step S1304, the supporter 60 confirms the information displayed on the display unit 315 or the content reproduced by the speaker 319, and utters the instruction information using the microphone 322. For example, the following work content is uttered in response to the presented information. The recording unit 321 converts the sound picked up by the microphone 322 into data. The voice recognition unit 320 performs voice recognition of the voice information converted into data and recognizes it as characters. The operation of the voice recognition unit 320 is the same as that of the voice recognition unit 110 in FIG.

The work management unit 303 selects work data from the character information recognized by the voice recognition unit 320. The work management unit 303, for example, adds numbers indicating work procedures one by one. In this case, the supporter 60 recognizes that the worker 20 has completed each work by the information obtained from the display unit 315 or the speaker 319, utters a keyword instructing the next work, and the voice recognition unit 320 operates. do. The voice recognition unit 320 recognizes that a specific keyword such as "work OK" has been spoken. The work management unit 303 selects the next work data with reference to the work information transmitted from the worker terminal 10 and the work data 207.

As described above, the work management unit 303 refers to the work data 207 and selects the work data. The work management unit 303 transmits the selected work data to the worker terminal 10. With reference to the work data 207, if all the work in the list has been completed, data indicating that all the work has been completed is transmitted as work data.

In addition to this, the voice recognition unit 320 may select a specific work content by voice recognition of a combination such as the keywords "label confirmation" and "A01" included in the work name, or voice recognition of the work number.

In step S1305, the mode determination unit 204 selects operation mode data from the operation mode data 206 based on the work data selected by the work management unit 303. The operation mode data 206 can be configured with the same data as the operation mode data 106 in the first embodiment.

In step S1306, the mode determination unit 204 transmits the selected operation mode data to the worker terminal 10.

In the work support system 100 of FIG. 17, work data is selected by the voice recognition unit 320 recognizing the content spoken by the supporter 60. Therefore, the supporter 60 does not need a special input for designating the work data, and can give an oral instruction to the worker 20.

10 ... Worker terminal 20 ... Worker 30 ... Work target 101 ... Imaging unit 102 ... Input unit 103 ... Work management unit 104 ... Mode determination unit 105 ... Operation Mode switching unit 106 ... Operation mode data 107 ... Work data 108 ... Notification unit 140 ... Processor 150 ... Memory 109 ... Microphone 110 ... Voice recognition unit 40 ... Remote work Support device 50 ... Network 204 ... Mode determination unit 206 ... Operation mode data 209 ... Communication unit 214 ... Communication unit 60 ... Supporter 303 ... Work management unit 310 ... Recording unit 311 ... Playback unit 312 ... Microphone 313 ... Speaker 315 ... Display unit 316 ... Work instruction unit 317 ... Playback unit 318 ... Input unit 319 ... Speaker 320.・ ・ Voice recognition unit 321 ・ ・ ・ Recording unit 322 ・ ・ ・ Microphone

Claims (12)

It is a worker terminal that supports the work of the worker by being worn by the worker.
An imaging unit that captures the surroundings of the worker,
Work management department, which identifies which work the worker is performing
An operation mode switching unit that switches the operation mode of the imaging unit,
Mode determination unit that specifies the operation mode,
Equipped with
The mode determination unit specifies the operation mode corresponding to the work identified by the work management unit.
The operation mode switching unit is a worker terminal characterized by switching the image pickup unit to the operation mode designated by the mode determination unit. The worker terminal further comprises an input interface that receives designated inputs that specify the work performed by the worker by the worker.
The worker terminal according to claim 1, wherein the work management unit identifies the work designated by the designated input as the work to be performed by the worker. The worker terminal further includes a storage unit for storing operation mode data that describes the correspondence between the work performed by the worker and the operation mode to be performed by the image pickup unit.
The mode determination unit identifies the operation mode corresponding to the work identified by the work management unit according to the operation mode data.
The worker terminal according to claim 2, wherein the operation mode switching unit sets the image pickup unit so as to execute the operation mode specified by the mode determination unit. The image pickup unit is used as the operation mode.
Whether to perform autofocus, zoom function, focus position, aperture, shutter speed, flash lighting on / off, image resolution, video frame rate, image data compression rate, switching between color image and infrared image,
It is configured so that one or more of them can be switched.
The mode determination unit is in accordance with the operation mode data.
Whether to perform autofocus, zoom function, focus position, aperture, shutter speed, flash lighting on / off, image resolution, video frame rate, image data compression rate, switching between color image and infrared image,
The worker terminal according to claim 3, wherein the image pickup unit is set so as to switch any one or more of them. The worker terminal further includes a storage unit for storing work data in which the work content to be performed by the worker is described by a character string.
The operation mode data includes one or more of the type, the number of characters, the number of strokes, and the number of characters in the phonetic spelling of the character string described in the work data, and the operation mode to be executed by the imaging unit. Describes the correspondence between
The mode determination unit specifies one or more of the character type, the number of characters, the number of strokes, and the number of characters in the phonetic spelling of the character string corresponding to the work identified by the work management unit according to the character string. ,
The mode determination unit refers to the operation mode data using any one or more of the specified character type, the number of characters, the number of strokes, and the number of characters in the reading kana, and the operation to be performed by the imaging unit. The worker terminal according to claim 3, wherein the mode is specified. The worker terminal further includes a storage unit for storing work data in which the work content to be performed by the worker is described by a character string.
The work data defines one or more of the font, print size, and character color of the character string.
The operation mode data corresponds to one or more of the font, print size, and character color of the character string described in the work data, and the operation mode to be executed by the image pickup unit. Describes the relationship and
The mode determination unit identifies any one or more of the font, print size, and character color of the character string corresponding to the work identified by the work management unit according to the work data.
The mode determination unit specifies the operation mode to be executed by the image pickup unit by referring to the operation mode data using any one or more of the specified font, print size, and character color. The worker terminal according to claim 3, wherein the worker terminal is characterized in that. The worker terminal further provides work data describing any one or more of the work type, the brightness of the work target, the position of the work target, and the work posture of the worker of the work performed by the worker. Equipped with a storage unit to store
The operation mode data is one or more of one or more of the work type, the brightness of the work target, the position of the work target, and the work posture of the worker of the work performed by the worker, and the image pickup unit performs the operation mode data. It describes the correspondence between the operation mode and the operation mode to be used.
The mode determination unit determines one or more of the work type, the brightness of the work target, the position of the work target, and the work posture of the worker of the work corresponding to the work identified by the work management unit. Identify according to the above work data
The mode determination unit refers to the operation mode data by using any one or more of the specified work type, the brightness of the work target, the position of the work target, and the work posture of the worker. The worker terminal according to claim 3, wherein the image pickup unit specifies the operation mode to be executed. The worker terminal further includes a communication unit that communicates with a remote work support device that remotely supports the work of the worker.
The work management unit identifies to that effect each time the worker completes one of the tasks.
When the work management unit identifies that the worker has completed one of the tasks, the communication unit transmits work completion data indicating that fact to the remote work support device.
The communication unit is characterized in that after transmitting the work completion data to the remote work support device, the communication unit receives a work start instruction instructing the remote work support device to start the next work from the remote work support device. The worker terminal according to claim 1. It is a remote work support device that remotely supports the work of a worker wearing a worker terminal.
A mode determination unit that specifies the operation mode of the image pickup unit provided in the worker terminal,
Communication unit that communicates with the worker terminal,
Equipped with
The mode determination unit acquires data indicating which work the worker is performing, and obtains data indicating which work the worker is performing.
The mode determination unit is characterized by transmitting instruction data instructing the operation mode corresponding to the work indicated by the data to the worker terminal via the communication unit. Support device. The communication unit receives work completion data indicating that the worker has completed one of the work from the worker terminal, and receives the work completion data.
The claim is characterized in that, after receiving the work completion data from the worker terminal, the communication unit transmits a work start instruction instructing the worker terminal to start the next work. The remote work support device according to 9. It is a work support system that supports the work of workers.
Worker terminal worn by the worker,
A support terminal that instructs the worker to work from a remote location,
Equipped with
The worker terminal includes an image pickup unit that images the surroundings of the worker, and an operation mode switching unit that switches the operation mode of the image pickup unit.
The work support system further includes a mode determination unit for designating the operation mode.
The work support system further includes a work management unit that identifies which work the worker is performing.
The mode determination unit specifies the operation mode corresponding to the work identified by the work management unit.
The operation mode switching unit is a work support system characterized by switching the image pickup unit to the operation mode designated by the mode determination unit. The mode determination unit is arranged on the support terminal.
The work support system according to claim 11, wherein the work management unit is arranged on the worker terminal.

Images