JP2019203987A - System, method, and program - Google Patents

Abstract

To provide a system, a method, and a program in which voice recognition results of the same word are not different due to a difference in pronunciation for each user or a disturbance in the surroundings when an instruction is received from a user by voice.SOLUTION: In a system for specifying instructions to a wearable terminal from a voice acquired by the wearable terminal attached to the head of an operator, the wearable terminal 10 includes: a voice acquisition unit which acquires the voice of the operator; a recognition result acquisition unit which acquires a character string obtained by voice recognition of the voice by the operator; a correspondence information storage unit which stores correspondence information associating an instruction to the wearable terminal and a plurality of character strings; and an instruction specifying unit which specifies an instruction associated with the character string acquired by the recognition result acquisition unit by the correspondence information as an instruction to the wearable terminal.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a system, a method, and a program.

As a wearable ordering terminal equipped with a head-mounted display, there is known a device that displays an order screen including an order content when receiving an order on the head-mounted display and erases the order screen when the order is completed (see, for example, Patent Document 1).
Patent Document 1 JP 2011-48439 A

  When an instruction is received by voice from a user, the voice recognition result of the same word may be different due to a difference in pronunciation for each user or a disturbance in the surroundings. For this reason, the instruction may not be correctly recognized.

  In a first aspect, a system is provided for specifying an instruction for a wearable terminal from voice acquired by a wearable terminal worn on a worker's head. The system may include a voice acquisition unit that acquires the voice of the worker. The system may include a recognition result acquisition unit that acquires a character string obtained by voice recognition of the worker's voice. The system may include a correspondence information storage unit that stores correspondence information that associates an instruction for the wearable terminal with a plurality of character strings. The system may include an instruction specifying unit that specifies, as an instruction to the wearable terminal, an instruction associated with the character string acquired by the recognition result acquisition unit based on the correspondence information.

  The wearable terminal may provide the worker with an image associated with each of the plurality of work items. The correspondence information storage unit associates each work item of a plurality of work items with instructions to be input when an image associated with each work item is provided to the worker into a plurality of character strings. Correspondence information to be associated may be stored. The instruction specifying unit associates the character string acquired by the recognition result acquisition unit with the correspondence information stored in the correspondence information storage unit in association with the work item associated with the image provided to the worker through the wearable terminal. The indicated instruction may be specified as an instruction for the wearable terminal.

  In response to an instruction for presenting a list of instructions, a list of instructions corresponding to the work item associated with the work item associated with the image provided to the worker through the wearable terminal is associated with the work information. You may further provide the instruction | indication presentation control part to show.

  For each of the plurality of work items, a usage frequency acquisition unit that acquires the frequency of use of the plurality of instructions when an image associated with each work item is provided to the worker may be further provided. The instruction presentation control unit may present a list of instructions to the worker in an order corresponding to the frequency.

  For each of the plurality of character strings associated with the instruction by the correspondence information, a cancellation frequency acquisition unit that acquires the frequency at which the instruction specified by the instruction specifying unit is canceled by the operator may be provided. The correspondence information may include an invalidating unit that invalidates the correspondence between the character string whose frequency of cancellation is a predetermined value or more and the instruction.

  A totaling unit that acquires a plurality of character strings obtained by voice recognition of voices of instructions by a plurality of people and totals the number of persons whose voices are recognized as the respective character strings of the plurality of character strings for each character string It's okay. You may provide the selection part which selects the character string which should be matched with an instruction | indication in correspondence information from several character strings based on the number of persons totaled by the total part.

  The voice acquisition unit, the recognition result acquisition unit, the correspondence information storage unit, and the instruction specifying unit may be provided in a server that can communicate with the wearable terminal. The server may transmit information indicating the instruction specified by the instruction specifying unit to the wearable terminal.

  A wearable terminal may be provided.

The wearable terminal may include a microphone that acquires the voice of the worker. The wearable terminal may include a voice recognition unit that recognizes voice acquired by a microphone and generates a character string. The wearable terminal may include a storage unit that stores correspondence information.
When the wearable terminal can communicate with the server, the wearable terminal transmits the voice acquired by the microphone to the server, receives the instruction specified by the instruction specifying unit from the server, and if the wearable terminal cannot communicate with the server, the storage unit You may provide the instruction | indication acquisition part which acquires the instruction | indication matched with the character string which the speech recognition part produced | generated by the corresponding | compatible information memorize | stored as an instruction | indication with respect to a wearable terminal.

  The voice acquisition unit, the recognition result acquisition unit, the correspondence information storage unit, and the instruction specifying unit may be provided in the wearable terminal.

  In a 2nd aspect, the method of specifying the instruction | indication with respect to a wearable terminal from the audio | voice acquired by the wearable terminal with which a worker's head is mounted | worn is provided. The method may comprise a voice acquisition step of acquiring a worker's voice. The method may include a recognition result acquisition step of acquiring a character string obtained by voice recognition of an operator's voice. The method may include a correspondence information storing step of storing correspondence information that associates an instruction for the wearable terminal with a plurality of character strings. The method may include an instruction specifying step of specifying, as an instruction for the wearable terminal, an instruction associated with the character string acquired in the recognition result acquisition step by the correspondence information.

  In a third aspect, a system program for specifying an instruction for a wearable terminal from voice acquired by a wearable terminal worn on a worker's head is provided. The program may cause the computer to function as a voice acquisition unit that acquires the voice of the worker. The program may cause the computer to function as a recognition result acquisition unit that acquires a character string obtained by voice recognition of a writer's voice. The program may cause the computer to function as a correspondence information storage unit that stores correspondence information that associates an instruction for the wearable terminal with a plurality of character strings. The program may cause the computer to function as an instruction specifying unit that specifies, as an instruction to the wearable terminal, an instruction associated with the character string acquired by the recognition result acquisition unit using the correspondence information.

  The summary of the invention does not enumerate all the features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

1 shows a schematic configuration of a work support system 100 according to an embodiment. 1 schematically shows a functional block configuration of wearable terminal 10. The functional block configuration of the server 80 is schematically shown. 3 is a flowchart illustrating an entire inspection support process by the wearable terminal 10. An example of the login screen 500 is shown. 4 is a flowchart showing login processing by the wearable terminal 10. 4 is a flowchart showing inspection support processing by the wearable terminal 10. An example of the inspection screen 800 is shown. An example of the inspection screen 900 in a state where a voice command list is displayed is shown. 4 is a flowchart showing a process of acquiring an instruction from the worker 40 by voice in the wearable terminal 10. Information stored as correspondence information is shown in a table format. An example of the prior learning data for producing | generating correspondence information is shown. 4 is a flowchart showing processing for specifying an instruction of an operator 40 in a server 80. It is a flowchart showing the update process of correspondence information. An example of an inspection result display screen based on inspection result data collected by the server 80 from the wearable terminal 10 is shown. The other example of the display screen of the inspection result based on inspection result data is shown. An example of the inspection result data for every inspection item downloaded from the wearable terminal 10 is shown. An example of the inspection result data for every inspection object downloaded from the wearable terminal 10 is shown. The other example of the inspection result data for every inspection item downloaded from the wearable terminal 10 is shown. The other example of the inspection result data for every inspection object downloaded from the wearable terminal 10 is shown.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a schematic configuration of a work support system 100 according to an embodiment. The work support system 100 includes a server 80, a voice recognition server 82, a wearable terminal 10a, and a wearable terminal 10b. The wearable terminal 10a is attached to the head 42a of the worker 40a. Wearable terminal 10b is attached to head 42b of worker 40b.

  The wearable terminal 10a and the wearable terminal 10b have the same configuration. When the wearable terminal 10a and the wearable terminal 10b are collectively referred to, it may be referred to as “wearable terminal 10”. When the function of the wearable terminal 10 is described, only the wearable terminal 10a may be taken up and described. In addition, when the workers 40a and 40b are collectively referred to, they may be referred to as “workers 40”.

  The work support system 100 is an example of a system for providing an image to the worker 40 through the wearable terminal 10. In the present embodiment, the function of the work support system 100 will be specifically described by taking an inspection work as an example of the work. Specifically, it is assumed that the worker 40 is a worker who checks the equipment.

  The work support system 100 provides an image for supporting an inspection performed by the worker 40. Specifically, the work support system 100 provides an image regarding inspection including a plurality of inspection items to the worker 40 through the wearable terminal 10. The wearable terminal 10 may be used at an inspection work site, for example. The work may include various work such as assembling work of goods, nursing care, education, office work, etc., in addition to work of checking equipment and goods.

  The server 80 and the wearable terminal 10 are communicably connected via the network 90. The network 90 may include various types of networks such as the Internet, a LAN, a WAN, a public line network, and a private line network.

  The wearable terminal 10a includes a main body part 11a and a display part 12a. The wearable terminal 10a can be attached to the head 42a of the worker 40a by attaching the main body 11a to the ear of the worker 40a. The wearable terminal 10a can be attached to the head 42a of the worker 40a by attaching the main body 11a to the glasses of the worker 40a. The wearable terminal 10a may be a glasses-type terminal. The wearable terminal 10a may be so-called eyewear.

  The wearable terminal 10 acquires the contents of one or more inspection items included in one inspection work from the server 80 and stores them. The inspection items may include items for inputting pass / fail inspection results, such as “Is there any flaw or chipping”? In addition, the inspection items may include items for inputting numerical inspection results such as “confirm length” and items for inputting character inspection results such as “input model number”.

  The wearable terminal 10 sequentially displays the contents of one or more inspection items on the display unit 12. The operator 40 sequentially performs inspections according to the inspection items displayed on the display unit 12. The worker 40 inputs the inspection result by voice. In addition, the worker 40 inputs an instruction to the wearable terminal 10 by voice.

  For example, the worker 40 can cause the wearable terminal 10 to take a picture by uttering the sound “photograph”. In addition, the worker 40 can cause the display unit 12 to display inspection results and photographs performed in the past inspection by uttering a voice “actual result”. Further, the worker 40 can input the pass / fail check result to the wearable terminal 10 by uttering “OK” and “NG”. The operator 40 can input inspection results such as measured values to the wearable terminal 10 by issuing numerical values and units.

  The wearable terminal 10 transmits voice data generated by the voice uttered by the worker 40 to the server 80 through the network 90, and acquires a character string indicating an instruction or an inspection result from the server 80. The server 80 transmits the voice data received from the wearable terminal 10 to the voice recognition server 82 and receives a character string obtained by voice recognition by the voice recognition server 82. The server 80 transmits an instruction associated with the character string received from the voice recognition server 82 to the wearable terminal 10.

  For example, the server 80 stores character strings such as “Ji-Seki” and “Ji-Seki” in addition to “Ji-Seki” in association with the “result” instruction. Thereby, even if the character string obtained by the voice recognition is “Ji-Seki” or “Ji-Seki”, an instruction of “Actual” is transmitted to the wearable terminal 10. Thereby, even if the voice recognition result of the same instruction differs due to a difference in pronunciation for each user or a disturbance in the surroundings, it is possible to increase a possibility that a correct instruction can be acquired.

  Further, the wearable terminal 10 measures the inspection start time when the worker 40 starts the inspection, the inspection end time when the worker 40 finishes the inspection, and the inspection time which is the time required for the worker 40 to perform the inspection. . The wearable terminal 10 measures the inspection start time, the inspection end time, and the inspection time by using the internal clock of the wearable terminal 10 itself. When the wearable terminal 10 transmits the inspection result input from the worker 40 to the server 80, the wearable terminal 10 also transmits the inspection start time, the inspection end time, and the inspection time to the server 80.

  When the server 80 provides the inspection result data including the inspection result, the inspection start time, the inspection end time, and the inspection time to the outside, the inspection is performed in a state where the internal clock of the wearable terminal 10 is not set to the server 80. For the work for which the result has been input, the inspection start time and inspection end time data are masked with a character string such as “----”. Thereby, the time information acquired in a state in which the internal clock of the wearable terminal 10 is not set in time can be output in an appropriate form. For example, the wearable terminal 10 does not have a battery that maintains the operation of the internal clock when the power is turned off. In this case, when the power is turned on after the power is turned off, the internal clock is reset at a fixed date and time when the wearable terminal 10 is shipped from the factory or immediately before the power is turned off. Therefore, accurate values cannot be obtained for the inspection start time and inspection end time. However, a relatively accurate value can be obtained for the inspection time. According to the wearable terminal 10, the inspection start time and the inspection end time are masked for the operation in which the inspection result is input in a state where the time of the internal clock of the wearable terminal 10 is not set with respect to the server 80. It can suppress that a value is provided as management data.

  FIG. 2 schematically shows a functional block configuration of the wearable terminal 10. The wearable terminal 10 includes a display unit 12, an imaging unit 202, a microphone 205, an operation member 207, a control unit 200, a storage unit 210, and a communication unit 290.

  The control unit 200 may be an arithmetic device such as a microprocessor. The storage unit 210 may be a non-volatile storage device such as a flash memory or a volatile storage device such as a RAM. The storage unit 210 stores a program for executing each stage of the operation of the wearable terminal 10. The function of the wearable terminal 10 is mainly realized by the control unit 200 executing the program. The program is recorded on a recording medium and provided to the storage unit 210. The communication unit 290 has a communication function through the network 90 in the wearable terminal 10.

  The display unit 12 is provided so that the display surface faces the viewing direction of the worker 40 when the wearable terminal 10 is mounted on the head 42 of the worker 40. The imaging unit 202 is provided so that the imaging optical axis of the imaging unit 202 is along the viewing direction of the worker 40 when the wearable terminal 10 is attached to the head 42 of the worker 40.

  The microphone 205 acquires the voice of the worker 40. The microphone 205 is attached to the wearable terminal 10 via a flexible support member so that the wearable terminal 10 can be moved near the mouth of the worker 40 when the wearable terminal 10 is attached to the head 42 of the worker 40. . The operation member 207 is a physical member such as a button. The operation member 207 can acquire an instruction from the worker 40. In the present embodiment, the case where the operator 40 gives an instruction by voice will be mainly described. However, at least a part of the instructions can be performed using the operation member 207.

  The control unit 200 includes a timing unit 204, a start processing unit 208, a display control unit 220, an invalidation unit 230, a usage frequency acquisition unit 232, a cancellation frequency acquisition unit 234, a work result information generation unit 240, a work result output unit 248, an instruction An acquisition unit 250, a voice acquisition unit 260, a recognition result acquisition unit 270, a voice recognition unit 272, and an instruction specifying unit 280 are provided.

  The voice acquisition unit 260 acquires the voice of the worker 40. Specifically, the voice acquisition unit 260 acquires the voice acquired by the microphone 205 and generates voice data. The voice recognition unit 272 recognizes the voice acquired by the microphone 205 and generates a character string. Specifically, the voice recognition unit 272 analyzes the voice data generated by the voice acquisition unit 260 and generates a character string.

  The recognition result acquisition unit 270 acquires a character string obtained by voice recognition of the worker 40's voice. For example, the recognition result acquisition unit 270 outputs the voice data to the voice recognition unit 272 and acquires a character string obtained by voice recognition by the voice recognition unit 272. When the communication unit 290 can communicate with the voice recognition server 82, the voice data generated by the voice acquisition unit 260 is transmitted to the external voice recognition server 82 through the communication unit 290 and the network 90. The recognition result acquisition unit 270 acquires a character string obtained by voice recognition by the voice recognition server 82.

  The storage unit 210 stores correspondence information that associates an instruction for the wearable terminal 10 with a plurality of character strings. For example, in the correspondence information, a character string such as “jiseki”, “jiseki”, “jiseki” is associated with an instruction “actual result”. The instruction specifying unit 280 specifies an instruction associated with the character string acquired by the recognition result acquisition unit 270 based on the correspondence information as an instruction for the wearable terminal 10.

  When the instruction acquisition unit 250 can communicate with the server 80, the instruction acquisition unit 250 transmits the sound acquired by the microphone 205 to the server 80 and receives the instruction specified by the server 80 from the server 80. The instruction acquisition unit 250 is associated with the character string generated by the voice recognition unit 272 or the character string acquired from the voice recognition server 82 based on the correspondence information stored in the storage unit 210 when communication with the server 80 is not possible. Is acquired as an instruction to the wearable terminal 10.

  The wearable terminal 10 provides the worker 40 with an image associated with each of the plurality of inspection items. For example, the display control unit 220 causes the display unit 12 to display an image indicating the content of inspection performed on the inspection item. Specifically, the display control unit 220 causes the display unit 12 to display a screen including characters that explain the contents of the inspection, such as “input model number” and “whether there are no scratches or missing parts”. “Input model number”, “Check for scratches and chipping”, etc. are examples of inspection items.

  The storage unit 210 associates each inspection item of the plurality of inspection items with instructions to be input when an image associated with each inspection item is provided to the worker 40 into a plurality of character strings. The correspondence information to be associated is stored. The instruction specifying unit 280 is a character string acquired by the recognition result acquisition unit 270 based on correspondence information stored in the storage unit 210 in association with an inspection item associated with an image provided to the worker 40 through the wearable terminal 10. Is associated with the wearable terminal 10 as an instruction. As a result, the instruction specifying unit 280 only needs to specify an effective instruction in the current inspection item, so that the probability that the instruction is erroneously specified can be reduced.

  In response to an instruction for presenting a list of instructions, the display control unit 220 associates the image provided to the worker 40 through the wearable terminal 10 with the inspection items associated with each other and is associated with the correspondence information. A list of instructions is presented to the worker 40. As a result, a list of instructions effective for the current work item can be presented to the worker 40.

  The usage frequency acquisition unit 232 acquires, for each of a plurality of inspection items, the frequency at which a plurality of instructions are used when an image associated with each inspection item is provided to the worker 40. The display control unit 220 displays a list of a plurality of instructions to the worker 40 in an order corresponding to the usage frequency. Thereby, the worker 40 can quickly find instructions that are frequently used.

  The cancellation frequency acquisition unit 234 acquires the frequency at which the instruction specified by the instruction specifying unit 280 is canceled by the worker 40 for each of a plurality of character strings associated with the instruction by the correspondence information. The invalidating unit 230 invalidates the association between the instruction and the character string whose frequency of cancellation is a predetermined value or more in the correspondence information. For example, when the cancellation frequency acquisition unit 234 acquires the voice instruction “return” immediately after executing the “actual result” process according to the voice instruction recognized as “chiseki” from the worker 40. Therefore, it is determined that the instruction has been canceled, and the number of cancellations corresponding to “Chiseki” is counted up.

  As described above, according to the wearable terminal 10, even if a recognition result of a regular character string cannot be obtained due to a difference in accent of words uttered by an operator, ambient noise, or the like, the recognition result is relatively It is possible to convert to a normal instruction with a high probability.

  Next, an operation when an inspection result is input will be described. When an image of a work item with the display control unit 220 is first displayed on the display unit 12, the storage unit 210 stores the current time measured by the time measuring unit 204 in the storage unit 210 as an inspection start time. The inspection start time is an example of a first time measured by the wearable terminal 10 when an image relating to work is displayed on the wearable terminal 10. Here, when the instruction acquisition unit 250 acquires an instruction to input the inspection result, the storage unit 210 stores the current time measured by the time measuring unit 204 in the storage unit 210 as the inspection end time. The inspection end time is an example of a second time measured by the wearable terminal 10 when the wearable terminal 10 acquires the inspection result from the worker 40. The work result information generation unit 240 generates inspection result information including an inspection start time, an inspection end time, an inspection time that is a time from the inspection start time to the inspection end time, and an input inspection result, and stores the inspection result information. 210. The storage unit 210 functions as a work result storage unit that stores inspection result information. The communication unit 290 transmits the inspection result information generated by the time measuring unit 204 to the server 80.

  Inspection result information is generated for each of a plurality of work items. That is, the inspection result information includes, for each of a plurality of work items, an inspection start time measured by the wearable terminal 10 when an image related to each work item is displayed on the wearable terminal 10, and an inspection result of each inspection item. Including the inspection end time measured by the wearable terminal 10 when the wearable terminal 10 acquires the information from the worker 40, the inspection time that is the time from the inspection start time to the inspection end time, and the inspection result. The inspection time indicates the inspection time from when the image relating to the work item is displayed on the wearable terminal 10 until the wearable terminal 10 acquires the inspection result from the worker 40.

  When performing a plurality of work items, when the inspection result of one work item is input, the display control unit 220 displays an image related to the next work item. Thereby, when the inspection result is input by the voice of the worker 40, the wearable terminal 10 acquires the time from the inspection start time to the inspection end time, transmits the inspection result information to the server 80, and the inspection result is An image related to the next operation after the input operation is displayed. Thereby, the time measurement of the inspection time of the next work item is started. Thereby, the worker 40 can accumulate information for managing the inspection time in the server 80 while efficiently performing the work of the plurality of work items.

  The start processing unit 208 starts measuring time from a fixed time set in advance in the wearable terminal 10 each time the wearable terminal 10 is turned on. In addition, the start processing unit 208 transmits authentication information input from the worker 40 to the server 80, and when the worker 40 is authenticated by the server 80, the server 80 manages the time counted in the wearable terminal 10. Set to the current time. The fixed time may be, for example, a reference date and time such as January 1, 1970, 00:00:00. The fixed time may be a time set when the wearable terminal 10 is shipped from the factory. The fixed time may be the time when the wearable terminal 10 was last turned off.

  When the inspection result is input from the operator 40, the operation result output unit 248 displays the inspection result information on the condition that the operator 40 is authenticated by the server 80 and can communicate with the server 80. Output to the server 80. On the other hand, when the worker 40 is not authenticated by the server 80 or when communication with the server 80 is not possible, the work result output unit 248 outputs the inspection result information to the storage unit 210, and the inspection result information is stored in the storage unit 210. When the worker 40 is authenticated by the server 80 after the output, the inspection result information stored in the storage unit 210 is transmitted to the server 80.

  FIG. 3 schematically shows a functional block configuration of the server 80. The server 80 includes a control unit 300, a storage unit 310, and a communication unit 390.

  The control unit 300 may be an arithmetic device such as a microprocessor. The communication unit 390 has a communication function through the network 90 in the server 80. The storage unit 310 includes a nonvolatile storage device such as a flash memory or a hard disk device. The storage unit 310 includes a volatile storage device such as a RAM. The program for the server 80 is recorded on a recording medium and provided to the storage unit 210.

  The control unit 300 includes a time management unit 304, an authentication control unit 320, an invalidation unit 330, a usage frequency acquisition unit 332, a cancellation frequency acquisition unit 334, a result output unit 340, a determination unit 342, a total time calculation unit 344, and a voice acquisition unit. 360, a recognition result acquisition unit 370, an instruction specification unit 380, a totaling unit 392, and a selection unit 394.

  As described above, in the wearable terminal 10, the inspection result information including the work time start time, the inspection end time and the inspection time, and the inspection result is transmitted from the wearable terminal 10. The communication unit 390 receives the inspection result information transmitted from the wearable terminal 10. The communication unit 390 functions as an operation result receiving unit that receives inspection result information. The inspection result information received by the communication unit 390 is stored in the storage unit 310.

  When the result output unit 340 is requested to transmit the inspection result data, the inspection start time and the inspection end time, the inspection time, when the inspection start time and the inspection end time coincide with the time managed by the server 80, And inspection result data including the inspection result is generated. On the other hand, when the inspection start time or the inspection end time does not match the time managed by the server 80, the result output unit 340 generates inspection result data that masks the inspection start time and the inspection end time. For example, the inspection result data with the inspection start time and the inspection end time set to “----” is generated. The communication unit 390 transmits the inspection result data generated by the result output unit 340 to the request destination of the inspection result data.

  The time management unit 304 manages the current time. The time management unit 304 sets the system clock based on the reference time received from the server 80. The authentication control unit 320 authenticates the worker 40 based on the authentication information of the worker 40 received from the wearable terminal 10, and executes the time adjustment for matching the time counted in the wearable terminal 10 to the current time in the wearable terminal 10. Let

  When the difference between the inspection start time or the inspection end time and the current time managed by the time management unit is larger than a predetermined value, the determination unit 342 manages the inspection start time or the inspection end time by the server 80. Judge that it is not consistent with the current time. For example, the determination unit 342 manages the inspection start time or inspection end time with the server 80 when the difference between the inspection start time or inspection end time and the time managed by the server 80 exceeds a predetermined value. It is determined that it is not consistent with the current time. For example, if the time of the wearable terminal 10 is not synchronized with the server 80 after the wearable terminal 10 is turned on, the wearable terminal 10 sets the reference time from 1:00:00 on January 1, 1970 to the reference time. The initial value of elapsed time is reset to 0 and the time is counted. In this case, since the difference between the inspection start time or the inspection end time and the current time managed by the time management unit 304 becomes large, it is determined that the current time is not consistent.

  The total time calculation unit 344 calculates, for each work target, a total value of time over a plurality of work items set as the work target. The communication unit 390 requests inspection result data including the total value calculated by the total time calculation unit in addition to the inspection start time, the inspection end time, the inspection time, and the inspection result in association with the work target. Send to the original.

  Next, processing related to speech recognition in the server 80 will be described. The voice acquisition unit 360 acquires the voice data transmitted from the wearable terminal 10 received by the communication unit 390. The recognition result acquisition unit 370 and the instruction specification unit 380 are functional blocks corresponding to the recognition result acquisition unit 270 and the instruction specification unit 380 in the wearable terminal 10, respectively.

  Specifically, the recognition result acquisition unit 370 acquires a character string obtained by voice recognition of the worker 40's voice. For example, the voice data acquired by the voice acquisition unit 360 is transmitted to the external voice recognition server 82 through the communication unit 290 and the network 90, and the voice recognition server 82 acquires a character string obtained by voice recognition.

  The storage unit 310 stores correspondence information that associates an instruction for the wearable terminal 10 with a plurality of character strings. For example, in the correspondence information, a character string such as “jiseki”, “jiseki”, “jiseki” is associated with an instruction “actual result”. The storage unit 310 functions as a correspondence information storage unit that stores correspondence information. The instruction specifying unit 380 specifies an instruction associated with the character string acquired by the recognition result acquisition unit 270 based on the correspondence information as an instruction for the wearable terminal 10. Information indicating the instruction specified by the instruction specifying unit 380 is transmitted to the wearable terminal 10 through the communication unit 390 and the network 90.

  The usage frequency acquisition unit 332, the cancellation frequency acquisition unit 334, and the invalidation unit 330 are functional blocks corresponding to the usage frequency acquisition unit 232, the cancellation frequency acquisition unit 234, and the invalidation unit 230, respectively, in the wearable terminal 10. That is, the usage frequency acquisition unit 332 acquires, for each of a plurality of inspection items, the frequency at which a plurality of instructions are used when an image associated with each inspection item is provided to the worker 40.

  The cancellation frequency acquisition unit 334 acquires the frequency at which the instruction specified by the instruction specifying unit 380 is canceled by the worker 40 for each of a plurality of character strings associated with the instruction by the correspondence information. The invalidating unit 330 invalidates the correspondence between the character string whose frequency of cancellation is equal to or greater than a predetermined value in the correspondence information and the instruction. For example, when the cancellation frequency acquisition unit 334 executes the “actual result” process in response to the voice instruction recognized as “chiseki” from the worker 40, the cancellation frequency acquisition unit 334 immediately acquires the voice instruction “return”. Therefore, it is determined that the instruction has been canceled, and the number of cancellations corresponding to “Chiseki” is counted up.

  Here, a method of generating correspondence information stored in the storage unit 310 of the server 80 and the storage unit 210 of the wearable terminal 10 will be described. The totaling unit 392 acquires a plurality of character strings obtained by voice recognition of voices instructed by a plurality of people, and totals the number of persons whose voice is recognized as the character strings of the plurality of character strings for each character string. To do. The selection unit 394 selects a character string to be associated with the instruction in the correspondence information from among a plurality of character strings based on the number of people counted by the counting unit 392. Thereby, it can respond to the utterance of various people. A specific example of a method for selecting a character string to be associated with an instruction by correspondence information will be described with reference to FIG.

  According to the wearable terminal 10 and the server 80 described above, since the instruction is specified using the correspondence information that associates the plurality of character strings as the voice recognition result with the instruction, the difference in pronunciation for each user or the disturbance of the surroundings Etc. can be reduced. Further, when the server 80 provides the inspection result data, the inspection start time and inspection end time data for the work in which the inspection result is input in a state where the wearable terminal 10 and the server 80 are not set in time is “−”. Since it is masked with a character string such as “---”, it is possible to prevent an incorrect value from being provided as management data.

  FIG. 4 is a flowchart showing the entire inspection support process by the wearable terminal 10. The process of this flowchart is mainly realized by the control unit 200 controlling each unit of the wearable terminal 10.

  In S402, when the wearable terminal 10 is powered on, the start processing unit 208 causes the timing unit 204 to start timing from a fixed time.

  In S404, the display control unit 220 causes the display unit 12 to display a login screen. If authentication information such as a user ID is input while the login screen is displayed, the start processing unit 208 performs authentication using the authentication information in S406. Details of the process of S406 will be described with reference to FIG.

  When the login is completed, the location, equipment, and part to be inspected are acquired in S410. The location, equipment, and part instructions are input by the voice of the operator 40. Subsequently, in S412, the wearable terminal 10 sets an inspection item list. For example, when the wearable terminal 10 can communicate with the server 80, the wearable terminal 10 transmits information indicating the location, equipment, and part acquired in S410 to the server 80, and generates an inspection item list including one or more inspection items from the server 80. get. If communication with the server 80 is not possible, the inspection item list stored in the storage unit 210 in association with the information indicating the location, facility, and part acquired in S410 is read from the storage unit 210.

  In S414, a process for supporting the inspection of the worker 40 is performed. Specific processing of S414 will be described later.

  FIG. 5 shows an example of the login screen 500. The login screen 500 includes an object 510 indicating contents input by voice and an object 580 indicating whether voice input is possible. When the voice input is possible, the display control unit 220 displays the color of the outer frame of the object 580 in a predetermined first color. The display control unit 220 displays the color of the outer frame of the object 580 in a predetermined second color when a new voice input is not possible, for example, during voice recognition. In the case where voice input is possible, the display control unit 220 displays the recognized character in the frame when the voice is input.

  FIG. 6 is a flowchart showing login processing by the wearable terminal 10. The process of this flowchart is mainly realized by the control unit 200 controlling each unit of the wearable terminal 10. The process of this flowchart can be applied to the process of S406 in FIG.

  In step S602, the control unit 200 acquires authentication information. For example, the worker 40 acquires the authentication information by recognizing the user's voice acquired in a state where the login screen shown in FIG. 5 is displayed. Note that the control unit 200 may acquire authentication information from an image captured by the imaging unit 202. For example, a login certificate printed with a QR code (registered trademark) in which authentication information is encoded is distributed to the worker 40 who can use the wearable terminal 10. When the worker 40 images the login certificate with the imaging unit 202, the control unit 200 may acquire the authentication information by decoding the encoded information extracted from the image of the login certificate.

  In step S <b> 604, the start processing unit 208 transmits authentication information to the server 80 through the communication unit 290. In step S <b> 606, the start processing unit 208 determines whether the server 80 has authenticated. When authenticated by the server 80, in S608, the start processing unit 208 adjusts the time measured by the time measuring unit 204 to the current time of the server 80, and proceeds to S410 in FIG. The state authenticated by the server 80 may be referred to as “online state”.

  If it is not authenticated by the server 80 in S606, the process proceeds to S610. The case where the server 80 has not authenticated includes the case where the server 80 notifies that the worker 40 cannot be authenticated, and the case where the wearable terminal 10 cannot communicate with the server 80. In S610, the start processing unit 208 collates the reference information stored in the storage unit 210 with the authentication information. When the worker 40 is authenticated by comparing the reference information in the storage unit 210 with the authentication information, the process proceeds to S410 in FIG. A state in which authentication is not performed by the server 80 but is verified by comparing reference information in the storage unit 210 with authentication information may be referred to as an “offline state”. If the worker 40 cannot be authenticated by comparing the reference information with the authentication information, the process proceeds to S404 in FIG.

  FIG. 7 is a flowchart showing inspection support processing by the wearable terminal 10. The process of this flowchart is mainly realized by the control unit 200 controlling each unit of the wearable terminal 10. The process of this flowchart can be applied to the process of S414 in FIG.

  In S702, the display control unit 220 displays an inspection start screen on the display unit 12, and the control unit 200 waits until an instruction of “inspection start” is acquired (S704).

  When “inspection start” is instructed, the work result information generation unit 240 stores the inspection report start time in the storage unit 210 in S706. In step S708, the display control unit 220 displays a screen for the first inspection item. The inspection item screen will be described later.

  In S720, the instruction acquisition unit 250 acquires the instruction of the worker 40. As described above, the voice instruction of the worker 40 is specified by the server 80 or the instruction specifying unit 280. The process of S720 will be described with reference to FIG.

  In this flowchart, as the instructions acquired in S720, an inspection result input instruction, a “command” instruction for displaying a command list, a “close” instruction for hiding the command list, and other instructions or A case where there is no corresponding instruction will be described.

  If the instruction acquired in S720 is an instruction to input an inspection result, the current time is acquired in S722, and the inspection result information generated by the work result information generation unit 240 is output to the storage unit 210 or the server 80 in S724. .

  Subsequently, in S726, it is determined whether or not the next inspection item exists in the inspection item list. When the next inspection item exists, the process proceeds to S708. If the next inspection item does not exist, the end time for inspection report is stored in S728, and the process of this flowchart is terminated.

  If the instruction acquired in S720 is “command”, a voice command list is displayed in S730, and the process proceeds to S720. The voice command list will be described with reference to FIG. If the instruction acquired in S720 is “close”, the display of the voice command list is closed in S732, and the process proceeds to S720. If the instruction acquired in S720 is not an inspection result input instruction, “command” or “close”, or if there is no instruction corresponding to the voice recognition result of the worker 40, other instructions are handled in S734. Or a predetermined process when there is no corresponding instruction, and the process proceeds to S720.

  FIG. 8 shows an example of the inspection screen 800. The inspection screen 800 includes an object 810 indicating contents for inputting the inspection result and an object 820 indicating three instructions most frequently used in this inspection item.

  The inspection screen 800 is a screen for inspecting the cable model number. On the inspection screen 800, numbers, alphabets, and symbols can be input as inspection results. Lowercase letters can be input by adding “komoji” immediately before the letters of the alphabet. For example, “xYz” can be input by uttering “Komoji-ku-waiko-komo-zetsuto”. That is, when “Komoji” is included in the recognition result, the instruction specifying unit 280 specifies the instructed character string by converting the alphabet represented by the character string following “Komoji” to lower case. In Japanese pronunciation, the number “9” and the alphabet “Q” are difficult to distinguish, and therefore the alphabet “Q” is associated with “Kebek”. That is, the instruction specifying unit 280 converts the “result” of the recognition result into “Q”.

  FIG. 9 shows an example of an inspection screen 900 in a state where a voice command list is displayed. The inspection screen 900 includes an object 910 indicating a voice command list. The display control unit 220 displays a voice command list by displaying the object 910 as an overlay on the inspection screen 800.

  The object 910 includes a list of instructions that can be input on the inspection screen 800. The display control unit 220 arranges the order of displaying instructions in the object 910 in descending order of usage frequency. For example, the instructions positioned on the left side of the screen may be arranged so that the usage frequency is higher than the instructions positioned on the right side of the screen. The instructions at the same position in the left-right direction may be arranged so that the instruction located on the upper side toward the screen is used more frequently than the instruction located on the lower side toward the screen.

  If there is an instruction to “close” while the object 910 is displayed, the display control unit 220 ends the display of the object 910. An instruction can be input even when the object 910 is displayed. For example, when the worker 40 utters “Jiseki” in a state where the object 910 is displayed, the screen transitions to a screen that displays past results.

  FIG. 10 is a flowchart showing a process of acquiring an instruction from the worker 40 by voice in the wearable terminal 10. The process of this flowchart is mainly realized by the control unit 200 controlling each unit of the wearable terminal 10. The process of this flowchart can be applied to the process of S720 of FIG.

  In step S <b> 1002, the voice acquisition unit 260 generates voice data acquired by the microphone 205. In step S <b> 1004, the instruction acquisition unit 250 determines whether the wearable terminal 10 is online and can communicate with the server 80. When the wearable terminal 10 is online and can communicate with the server 80, the communication unit 290 transmits audio data to the server 80. In the server 80, the instruction of the worker 40 is specified by the voice acquisition unit 360, the recognition result acquisition unit 370, and the instruction specifying unit 380, and information indicating the specified instruction is transmitted from the server 80 to the wearable terminal 10. The process in which the server 80 specifies the instruction of the worker 40 will be described later with reference to FIG. In step S1008, the instruction acquisition unit 250 acquires the instruction specified by the server 80 through the communication unit 290, and ends the processing of this flowchart.

  If the wearable terminal 10 is offline in S1004, or if the wearable terminal 10 cannot communicate with the server 80, in S1010, the wearable terminal 10 specifies the instruction of the worker 40, and the processing of this flowchart is performed. finish. In S1010, as described above, the voice recognition unit 272, the recognition result acquisition unit 270, and the instruction specifying unit 280 specify the instruction of the worker 40.

  FIG. 11 shows information stored as correspondence information in a table format. FIG. 11 shows correspondence information associated with the “result” instruction. Correspondence information is prepared for each instruction. The correspondence information associates the recognized character string, the number of times of recognition, the number of times of cancellation, and the valid flag with each other.

  The recognized character string corresponds to a character string obtained by voice recognition. The number of times of recognition represents the number of times the character string of the recognized character string is obtained by voice recognition. For example, the number of times of recognition is incremented every time the voice recognition server 82 or the like recognizes it as a character string “Jiseki”.

  The number of times of cancellation represents the number of times the corresponding instruction is canceled after the character string of the recognized character string is recognized. For example, when a “return” instruction is input within a predetermined time after being recognized as a character string “chiseki” by the voice recognition server 82 or the like, an “actual” instruction based on “chiseki” Is canceled, and the number of cancellations corresponding to “Chiseki” is incremented.

  The valid flag indicates whether or not the recognized character string and the instruction are associated with each other. “Valid” indicates that the recognized character string and the instruction are associated with each other, and “invalid” indicates that the recognized character string and the instruction are not associated with each other. The invalidation unit 230 switches the validity flag from “valid” to “invalid” when the cancellation frequency of the instruction based on the number of times of recognition and the number of cancellations exceeds a predetermined value.

  FIG. 12 shows an example of pre-learning data for generating correspondence information. FIG. 12 shows pre-learning data associated with the “actual” instruction. Correspondence information regarding the “actual” instruction is generated by learning a speech recognition result when a large number of people utter “actual”.

  In FIG. 12, a recognized character string represents a character string recognized by the voice recognition server 82 or the like when a large number of people uttered “actual results”. The number of people represents the number of people who uttered the speech recognized as the character string of the recognized character string. The number of people is counted by the counting unit 392 when performing prior learning. The selection unit 394 selects a recognized character string to be associated with the “result” instruction in the correspondence information based on the prior learning data. Specifically, the selection unit 394 selects recognized character strings in descending order of the number of people. The selection unit 394 selects the recognized character string until the total number of the selected recognized character strings exceeds 95% of the total number of people. The recognized character string selected by the selection unit 394 is associated with the “result” instruction by the correspondence information. Specifically, as shown in FIG. 11, the recognized character string from “Jiseki” to “Chiseki” is selected, and the association with the “result” instruction becomes effective. On the other hand, the association of the recognized character string “Jiseiki” with the “result” instruction is invalid.

  FIG. 13 is a flowchart showing processing for specifying an instruction of the worker 40 in the server 80. The process of this flowchart is mainly realized by the control unit 300 controlling each unit of the server 80.

  When the voice acquisition unit 360 acquires the voice data received from the wearable terminal 10 through the communication unit 390 in S1302, the communication unit 390 transmits the voice data to the voice recognition server 82 in S1304. In S <b> 1306, the recognition result acquisition unit 370 acquires the character string recognized by the voice recognition server 82 via the communication unit 390.

  In S1310, the instruction specifying unit 380 refers to the correspondence information of each instruction, and has found whether correspondence information in which the character string acquired in S1306 exists in the recognized character string whose valid flag is “valid” is found. Determine whether. If the correspondence information is found, in S1312, the instruction specifying unit 380 specifies the instruction associated with the found correspondence information as the instruction of the worker 40.

  In S1314, the correspondence information is updated. The process of S1314 will be described with reference to FIG.

  In S1316, the communication unit 390 transmits information indicating the instruction specified in S1312 to the wearable terminal 10. If no corresponding information is found in S1310, the communication unit 390 transmits information indicating that there is no corresponding instruction to the wearable terminal 10 in S1318.

  FIG. 14 is a flowchart showing the correspondence information update process. The process of this flowchart is mainly realized by the control unit 300 controlling each unit of the server 80. The process of this flowchart can be applied to the process of S1314 in FIG.

  In S1402, the invalidating unit 330 increments the value of the number of times of recognition associated with the recognized character string in the correspondence information corresponding to the specified instruction. In S1404, it is determined whether or not the instruction of the worker 40 identified in S1312 is an instruction to cancel the immediately preceding instruction. For example, in the case where the instruction of the worker 40 identified in S1312 is “return” and the elapsed time from the time when the previous instruction is given is shorter than a predetermined value, the instruction to cancel the previous instruction is issued. Judge that there is. If it is not an instruction to cancel the immediately preceding instruction, the process of this flowchart is terminated. If the instruction is to cancel the immediately preceding instruction, in S1406, the invalidating unit 330 increments the number of cancellations associated with the recognized character string in the immediately preceding instruction in the correspondence information of the immediately preceding instruction.

  In S1408, the cancellation frequency acquisition unit 334 calculates the cancellation frequency based on the usage frequency and the cancellation frequency, and the invalidation unit 330 determines whether the cancellation frequency is equal to or higher than a predetermined threshold. When the cancellation frequency is less than a predetermined threshold, the process of this flowchart is terminated. If the cancellation frequency is greater than or equal to a predetermined threshold value, in S1410, the invalidation unit 330 switches the validity flag of the recognized character string of the immediately preceding instruction to “invalid”. In S1412, the invalidating unit 330 switches the valid flag of the recognized character string having the largest number of people in the pre-learning among the recognized character strings whose valid flag is “invalid” to “valid”. For example, in the correspondence information associated with “actual”, when the valid flag of “Chiseki” is switched to “invalid”, the valid flag of “jiseki” is switched to “valid”.

  As described with reference to FIGS. 11 to 14, the correspondence information associates a plurality of character strings that may be obtained by voice recognition with one instruction. Thus, the probability that the instruction is not recognized can be reduced. In the wearable terminal 10, a plurality of work items are sequentially displayed and instructions are input by voice. However, the number of instructions that can be input in one work item can be relatively small. The method of associating a plurality of character strings with each instruction is particularly effective in a system in which the number of instructions that can be input is small.

  11 to 14, the processing performed by the server 80 when the server 80 specifies an instruction has been described. At least part of the processing described with reference to FIGS. 11 to 14 can be applied to processing in the case of specifying an instruction in the wearable terminal 10. For example, it can be applied to the processing of S1010 in FIG.

  FIG. 15 shows an example of an inspection result display screen based on inspection result data collected by the server 80 from the wearable terminal 10. The screen of FIG. 15 is displayed, for example, on the computer terminal of the manager who manages the inspection of the worker 40.

  The inspection result information transmitted from the wearable terminal 10 to the server 80 includes information for identifying the sender of the inspection result information, a report inspection start time and a report inspection end time, a location to be inspected, equipment, Information for identifying a part, information for identifying a plurality of inspection items, inspection results of each inspection item, inspection start time, inspection end time, and inspection time are included. The result output unit 340 generates inspection result data from the inspection result information and the detailed information of the inspection items stored in the storage unit 310.

  FIG. 15 is a display screen of the inspection result generated from the inspection result information of the inspection result acquired when the wearable terminal 10 is online and can communicate with the server 80. “Work item display time”, “work result input time”, and “work time” in FIG. 15 represent an inspection start time, an inspection end time, and an inspection time, respectively. “Total work time” represents the total time of inspection time by the total time calculation unit 344. Since the wearable terminal 10 has acquired the inspection result in the online state, the result output unit 340 includes the inspection start time and the inspection end time in the inspection result data without masking. Therefore, the time counted by the wearable terminal 10 is displayed in the “work item display time” and “work result input time”.

  FIG. 16 shows another example of the inspection result display screen based on the inspection result data. The display screen of FIG. 16 is different from the display screen of FIG. 15 in that the display screen of the inspection result generated from the inspection result information of the inspection result acquired by the wearable terminal 10 in the offline state. Since the wearable terminal 10 has acquired the inspection result in an off-line state, the result output unit 340 masks the inspection start time and inspection end time in the inspection result data. Therefore, “----” is displayed for “work item display time” and “product result input time”. On the other hand, “work time” and “total work time” display accurate times based on the inspection time counted by the wearable terminal 10. Therefore, the manager can grasp the time required for the inspection by the worker 40 properly.

  FIG. 17 shows an example of inspection result data of each inspection item downloaded from the wearable terminal 10. FIG. 18 shows an example of inspection result data for each inspection object downloaded from the wearable terminal 10.

  Each inspection result data can be downloaded as, for example, CSV format text data. FIGS. 17 and 18 show the inspection result data generated from the inspection result information of the inspection result acquired when the wearable terminal 10 is online and can communicate with the server 80. “Work item display time”, “Work result input time”, and “Work time” in FIG. 17 represent an inspection start time, an inspection end time, and an inspection time, respectively. “Total work time” in FIG. 18 represents a time obtained by totaling the inspection time by the total time calculation unit 344. “Work start time” and “work end time” in FIG. 18 indicate the inspection start time for reporting and the inspection end time for reporting. The wearable terminal 10 acquires the inspection result in an online state. Therefore, the result output unit 340 includes each time in the inspection result data without masking.

  FIG. 19 shows another example of inspection result data for each inspection item downloaded from the wearable terminal 10. FIG. 20 shows another example of inspection result data for each inspection object downloaded from the wearable terminal 10.

  Each inspection result data can be downloaded as, for example, CSV format text data. 19 and 20 differ from the inspection result data of FIGS. 17 and 18 in that the inspection result data is generated from the inspection result information of the inspection result acquired by the wearable terminal 10 in the offline state. The wearable terminal 10 acquires the inspection result in an offline state. Therefore, the result output unit 340 masks each time included in the inspection result data with “----”. On the other hand, “work time” and “total work time” include accurate time based on the inspection time counted by the wearable terminal 10. Therefore, the manager can grasp the time required for the inspection by the worker 40 properly.

  In the above, the form which the wearable terminal 10 memorize | stores inspection start time, inspection end time, and inspection time for every inspection item was mainly demonstrated. However, in order to store information indicating the inspection start time, the inspection end time, and the inspection time, not all of the inspection start time, the inspection end time, and the inspection time are necessary. For example, if at least one of the inspection start time and the inspection end time and the inspection time are stored, the inspection start time, the inspection end time, and the inspection time can be expressed. In addition, if the inspection start time and the inspection end time are stored, the inspection start time, the inspection end time, and the inspection time can be expressed.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above embodiment. It is apparent from the description of the scope of claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operation, procedure, step, and stage in the apparatus, system, program, and method shown in the claims, the description, and the drawings is as follows. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is explained using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 Wearable terminal 11 Main body part 12 Display part 40 Worker 42 Head 80 Server 82 Voice recognition server 90 Network 100 Work support system 200 Control part 202 Imaging part 204 Timekeeping part 205 Microphone 207 Operation member 208 Start processing part 210 Storage part 220 Display Control unit 230 Invalidation unit 232 Usage frequency acquisition unit 234 Cancellation frequency acquisition unit 240 Work result information generation unit 248 Work result output unit 250 Instruction acquisition unit 260 Speech acquisition unit 270 Recognition result acquisition unit 272 Speech recognition unit 280 Instruction identification unit 290 Communication Unit 300 control unit 304 time management unit 310 storage unit 320 authentication control unit 330 invalidation unit 332 usage frequency acquisition unit 334 cancellation frequency acquisition unit 340 result output unit 342 determination unit 344 total time calculation unit 360 voice acquisition unit 370 recognition result acquisition unit 380 Instruction specifying unit 39 The communication unit 392 counting unit 394 selecting unit 500 login screen 510 Object 580 Object 800 check screen 810 Object 820 Object 900 check screen 910 objects

Claims (12)

A system for specifying an instruction for the wearable terminal from a voice acquired by a wearable terminal worn on a worker's head,
A voice acquisition unit for acquiring the voice of the worker;
A recognition result acquisition unit for acquiring a character string obtained by voice recognition of the worker's voice;
A correspondence information storage unit that stores correspondence information associating an instruction for the wearable terminal with a plurality of character strings;
A system comprising: an instruction specifying unit that specifies an instruction associated with the character string acquired by the recognition result acquisition unit based on the correspondence information as an instruction for the wearable terminal. The wearable terminal provides the worker with an image associated with each of a plurality of work items,
The correspondence information storage unit associates each work item of the plurality of work items with a plurality of instructions to be input when an image associated with each work item is provided to the worker. Stores correspondence information associated with a character string,
The instruction specifying unit is acquired by the recognition result acquisition unit based on the correspondence information stored in the correspondence information storage unit in association with a work item associated with an image provided to the worker through the wearable terminal. The system according to claim 1, wherein an instruction associated with the character string is specified as an instruction for the wearable terminal. In response to an instruction for presenting a list of instructions, a list of the plurality of instructions associated with the work item associated with the work item associated with the image provided to the worker through the wearable terminal is associated with the work information. The system according to claim 2, further comprising an instruction presentation control unit that presents the worker. For each of the plurality of work items, further comprising a usage frequency acquisition unit that acquires the frequency of use of the plurality of instructions when an image associated with each work item is provided to the worker,
The system according to claim 3, wherein the instruction presentation control unit presents a list of the plurality of instructions to the worker in an order corresponding to the frequency. For each of a plurality of character strings associated with the instruction by the correspondence information, a cancellation frequency acquisition unit that acquires the frequency at which the instruction specified by the instruction specifying unit is canceled by the operator;
The invalidation part which invalidates the said correspondence with the said character string and the said instruction | indication more than the predetermined value in the said correspondence information further in any one of Claim 1 to 4 The described system. A totaling unit that acquires a plurality of character strings obtained by voice recognition of the voice of the instruction by a plurality of people, and totals the number of persons whose voices are recognized as the respective character strings of the plurality of character strings for each character string; ,
The selection unit according to any one of claims 1 to 5, further comprising: a selection unit that selects a character string to be associated with the instruction in the correspondence information from the plurality of character strings based on the number of persons counted by the aggregation unit. A system according to claim 1. The voice acquisition unit, the recognition result acquisition unit, the correspondence information storage unit, and the instruction specifying unit are provided in a server that can communicate with the wearable terminal,
The system according to any one of claims 1 to 6, wherein the server transmits information indicating the instruction specified by the instruction specifying unit to the wearable terminal. The system according to claim 7, comprising the wearable terminal. The wearable terminal is
A microphone for obtaining the voice of the worker;
A voice recognition unit that recognizes the voice acquired by the microphone and generates a character string;
A storage unit for storing the correspondence information;
When the communication with the server is possible, the voice acquired by the microphone is transmitted to the server, the instruction specified by the instruction specifying unit is received from the server, and when the communication with the server is not possible, The instruction acquiring unit according to claim 8, further comprising: an instruction acquisition unit that acquires, as an instruction to the wearable terminal, an instruction associated with the character string generated by the voice recognition unit based on the correspondence information stored in the storage unit. system. The system according to claim 1, wherein the voice acquisition unit, the recognition result acquisition unit, the correspondence information storage unit, and the instruction specifying unit are provided in the wearable terminal. A method for identifying an instruction for the wearable terminal from voice acquired by a wearable terminal worn on a worker's head,
Obtaining a voice of the worker;
A recognition result acquisition step of acquiring a character string obtained by voice recognition of the worker's voice;
A correspondence information storing step for storing correspondence information associating an instruction for the wearable terminal with a plurality of character strings;
A method comprising: an instruction specifying step of specifying, as an instruction to the wearable terminal, an instruction associated with the character string acquired in the recognition result acquisition step by the correspondence information. A program for a system for specifying an instruction for the wearable terminal from a voice acquired by a wearable terminal worn on a worker's head, the computer comprising:
A voice acquisition unit for acquiring the voice of the worker;
A recognition result acquisition unit for acquiring a character string obtained by voice recognition of the worker's voice;
A correspondence information storage unit that stores correspondence information that associates an instruction for the wearable terminal with a plurality of character strings;
A program for causing an instruction associated with the character string acquired by the recognition result acquisition unit based on the correspondence information to function as an instruction specifying unit that specifies an instruction for the wearable terminal.