JP6682333B2 - Work support system, display control method and program - Google Patents

Description

  The present invention relates to a work support system, a display control method, and a program.

  Various work support systems have been proposed in order to improve the productivity of workers. For example, Patent Document 1 describes a work support system that outputs a guidance voice of a work procedure in accordance with the progress of the work, advances the work while checking the guidance voice, and records the time taken for the work. There is.

Japanese Patent No. 5120871

  The use of the work support system has a side effect that work efficiency is deteriorated because it is necessary to stop to input work results and check work instructions. Therefore, even if the work support system is introduced at the work site, it is highly likely that it will be difficult for the workers to fix the use of the system.

  Therefore, an object of the present invention is to provide a work support system, a display control method, and a program that can solve the above problems.

According to the first aspect of the present invention, there is provided a work support system for inputting a work record as work progresses, the voice recognition unit recognizing voice information input by a user, and the recognition result of the voice recognition unit. a processing unit that performs processing based on a display control unit for outputting information to be displayed on the display based on the instruction of the processing unit, e Bei a storage unit, wherein the display control unit, the identification information of the user When the user selects the detailed procedure by the first voice input by outputting the image data of the detailed procedure selection screen displaying a list of detailed procedures constituting the work to be performed by the associated user, the voice recognition unit Recognizes the selected detailed procedure, outputs the information of the recognized detailed procedure to a processing unit, and the processing unit has a function of voice-inputting a work record of the selected detailed procedure; A function of displaying a work instruction sheet of the detailed procedure on the display in response to a display request by user's voice input, and instructing the display control unit to output a record registration screen, and the display control unit, When the image data of the record registration screen is output and the user inputs a second voice that indicates the start of the detailed procedure, the voice recognition unit recognizes the second voice input, and the processing unit The time when the second voice input is recognized is registered in the storage unit as the start time of the detailed procedure, the output of the start time is instructed, and the display control unit displays the start time. When the image data of the record registration screen is output and the user performs a third voice input indicating the completion of the detailed procedure, the voice recognition unit recognizes the third voice input, and the processing unit The third voice input The recognized time is registered in the storage unit as the completion time of the detailed procedure, the output of the completion time is instructed, and the display control unit outputs the image data of the result registration screen displaying the completion time. To do.

According to the second aspect of the present invention, when the user voice-inputs a display request for the work instruction sheet while the display control unit is outputting the image data of the result registration screen, the voice recognition unit. Recognizes the display request, the processing unit instructs the output of the work instruction sheet of the selected detailed procedure based on the recognition, and the display control unit outputs the text data of the work instruction sheet. .

According to the third aspect of the present invention, the display control unit outputs the text data included in the work instruction sheet shaped according to the display area of the display.

According to the fourth aspect of the present invention, when the user voice-inputs a display end instruction of the work instruction sheet while the display control section is outputting the work instruction sheet, the voice recognition section, Recognizing the display end instruction, the processing unit instructs the output of the record registration screen based on the recognition, and the display control unit outputs the image data of the record registration screen.

According to a fifth aspect of the present invention, when the user performs a voice input indicating interruption after the second voice input is performed, the voice recognition unit recognizes the voice input indicating the interruption. The processing unit registers the time when the voice input indicating the interruption is recognized as the interruption start time of the detailed procedure in the storage unit.

According to the sixth aspect of the present invention, when the user performs a voice input indicating a start after the voice input indicating the interruption is performed, the voice recognition unit recognizes the voice input indicating the start. The processing unit registers the time at which the voice input indicating the start is recognized as the restart time of the detailed procedure in the storage unit.

According to a seventh aspect of the present invention, when the user performs a voice input requesting calculation after performing the third voice input, the voice recognition unit recognizes the request for calculation and performs the process. Based on the recognition, the unit subtracts the time from the interruption start time to the restart time from the time from the start time to the completion time to calculate the actual work time, and instructs the output of the actual work time. The display control unit outputs image data of the record registration screen displaying the actual work time.

According to the eighth aspect of the present invention, the display control unit outputs the information displayed on the display to the wearable terminal.

According to the ninth aspect of the present invention, the display control unit outputs information in which a list of detailed procedures is arranged and displayed on the detailed procedure selection screen in the order of performing work.

According to a tenth aspect of the present invention, the work support system may further include a conversion unit that shapes the text data included in the work instruction sheet according to a display area .

An eleventh aspect of the present invention is a detail in which a work support system for inputting a work record along with the progress of a work displays a list of detailed procedures constituting work to be performed by the user, which is associated with identification information of the user. When the user selects the detailed procedure by the first voice input by outputting the image data of the procedure selection screen to the display, the first voice input is recognized, and the work record of the selected detailed procedure is voice-input. And a function of displaying a work instruction sheet of the detailed procedure on the display in response to a display request by the user's voice input, outputting image data of a record registration screen to the display, and the user When the second voice input indicating the start of the detailed procedure is performed, the second voice input is recognized, and the recognized time is set as the start time of the detailed procedure. When the user inputs a third voice input indicating the completion of the detailed procedure, the image data of the record registration screen displaying the start time is output to the display, and the third voice input is performed. Of the voice input, the recognized time is registered in the storage unit as the completion time of the detailed procedure, and the image data of the record registration screen displaying the completion time is output to the display. Is.

A twelfth aspect of the present invention displays a list of detailed procedures constituting a work to be performed by the user, which is associated with the identification information of the user, on the computer of the work support system for inputting the work record as the work progresses Means for outputting the image data of the detailed procedure selection screen to the display, means for recognizing the selected detailed procedure when the user selects the detailed procedure by the first voice input, and means for recognizing the recognized detailed procedure. Means for instructing output of a record registration screen, which provides a function of voice inputting a work record and a function of displaying a work instruction sheet of the detailed procedure on the display in response to a display request by the user's voice input; A means for outputting the image data of the record registration screen to the display, and the user performs a second voice input indicating the start of the detailed procedure. And a means for recognizing the second voice input, a means for registering the time at which the second voice input is recognized as a start time of the detailed procedure in a storage unit, and a record registration screen displaying the start time. A unit for outputting image data to the display; a unit for recognizing the third voice input when the user inputs a third voice input indicating completion of the detailed procedure; and a unit for recognizing the third voice input. It is a program for functioning as means for registering a time as a completion time of the detailed procedure in a storage unit and means for outputting image data of the record registration screen displaying the completion time to the display .

  According to the work support system of the present invention, the worker can browse the work instruction information by calling the work instruction information while inputting the work record. As a result, it is possible to improve work efficiency and fix work record input.

It is a 1st figure which shows the structure of the work assistance system in one Embodiment which concerns on this invention. It is a functional block diagram showing an example of a personal digital assistant device in one embodiment concerning the present invention. It is a figure which shows an example of the display screen which the work assistance system in one Embodiment which concerns on this invention provides. It is a first flow chart showing an example of operation of the work support system in one embodiment concerning the present invention. It is a second flow chart showing an example of operation of the work support system in one embodiment concerning the present invention. It is a 2nd figure which shows the structure of the work assistance system in one Embodiment which concerns on this invention. It is a third flow chart showing an example of operation of the work supporting system in one embodiment concerning the present invention. It is a figure showing an example of hardware constitutions of a work support system in one embodiment concerning the present invention.

<Embodiment>
Hereinafter, a work support system according to an exemplary embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a first diagram showing the configuration of a work support system in an embodiment according to the present invention. The work support system provides a worker with a means for inputting work results and a means for requesting display of work instructions and drawings by voice input. As a result, the worker can input the work record and browse the work instruction sheet without using the hands. As shown in FIG. 1, the work support system includes a glass type display 10, a mobile terminal device 20, and a work navigation device 30. The work navigation device 30 includes a work navigation DB 31. The work navigation DB 31 stores text data of work instructions, which is shaped for the glass-type display 10, image data such as drawings, work performance data, and the like. These data will be described later.
The mobile terminal device 20 receives an instruction by voice input by a worker and acquires necessary data from the work navigation device 30. The mobile terminal device 20 outputs the data acquired from the work navigation device 30 to the glass-type display 10. Next, the functional configuration of the mobile terminal device 20 will be described.

FIG. 2 is a functional block diagram showing an example of the mobile terminal device according to the embodiment of the present invention.
The mobile terminal device 20 includes an input / output unit 21, a voice recognition unit 22, a communication unit 23, a processing unit 24, a display control unit 25, and a storage unit 26.
The input / output unit 21 is an interface for operations by a worker and input / output of data. For example, the input / output unit 21 is a microphone, a touch panel, a display, an input / output port, or the like.
The voice recognition unit 22 performs voice recognition processing on the voice information acquired by the input / output unit 21. The voice recognition unit 22 outputs instruction information obtained as a result of performing the voice recognition process to the processing unit 24. The voice information that can be recognized by the voice recognition unit 22 is stored in advance in the storage unit 26 in association with the information of the instruction content that the voice information means.
The communication unit 23 communicates with other devices by wireless communication or the like.
The processing unit 24 controls various processes in the work support system.
The display control unit 25 generates information (image data) to be displayed on the screen of the glass display 10 and outputs the image data. Note that the output of the image data by the display control unit 25 may be referred to as simply outputting the screen.
The storage unit 26 stores various data such as data acquired from the work navigation device 30, work records input by workers, programs, and the like. For example, the voice recognition unit 22, the processing unit 24, and the display control unit 25 are functions provided by the CPU (Central Processing Unit) in the mobile terminal device 20 executing a program.

FIG. 3 is a diagram showing an example of a display screen provided by the work support system according to the embodiment of the present invention. Each display screen illustrated in FIG. 3 is displayed on the screen of the glass-type display 10.
The worker inputs the work record during the daily work. FIG. 3 shows the screen transition until the worker displays the work result input screen. The input of the work record is performed for the selected detailed procedure through the selection of the work process, the work machine, the work, and the detailed procedure of the work defined in advance in association with the worker. The work navigation device 30 stores information such as work determined for each worker.
In the mobile terminal device 20, the display control unit 25 generates an image of a screen that guides candidates for the work process and outputs the image to the glass-type display 10. The worker selects a work process from the candidates by voice input. The same applies to machines, operations, and detailed procedures.
Each screen illustrated in FIG. 3 is an example of an image displayed on the screen of the glass-type display 10. For example, the worker can perform the work while looking at each screen displayed on a small screen arranged so as to be positioned in the space diagonally below and in front of the user's eyes.

  The upper left diagram of FIG. 3 is the login screen 301 generated by the display control unit 25. Here, when the worker continuously inputs account information such as user ID and voice input such as “login”, the microphone (input / output unit 21) of the mobile terminal device 20 inputs the voice information and voice recognition is performed. It is output to the unit 22. The voice recognition unit 22 recognizes the account information and the instruction information “login” and outputs it to the processing unit 24. The processing unit 24 performs login processing using the acquired account information. When the login process is successful, the display control unit 25 outputs the work process selection screen 302. The worker speaks instruction information such as “up”, “down”, “next page”, “previous page”, “work process (number)” and “decision” displayed in the command display area on the right side of the screen. A work process is selected by inputting a voice. For example, in many cases, the worker remembers the number assigned to the work process he is in charge of. The number assigned to the work process is, for example, the first "1" in the case of "1 work process 1". In this case, the worker can select the work process promptly and without using a hand by voice-inputting the number "1" assigned to the work process and then voice-inputting "decide". . This selection method uses "work process (number)" and "decide" among the above commands. In the work process selection screen 302, the display control unit 25 may output a list of work process candidates associated with the worker ID so that the worker can select the work process more quickly.

  When a worker selects a work process by voice input, the input / output unit 21 receives the voice input, and the display control unit 25 outputs the next screen, the machine selection screen 303. The display control unit 25 outputs list information of machine candidates associated with the selected work process. Similarly, the worker voice-inputs the instruction information displayed in the command display area on the right side of the screen to select the machine. Then, the input / output unit 21 receives the voice input, and the display control unit 25 outputs the work selection screen 304 which is the next screen. The display control unit 25 outputs a list of work candidates associated with the worker ID on the work selection screen 304. The work associated with the worker's ID means that the worker is in charge of the work. Which work is the work associated with the worker's ID is recorded in the work navigation DB 31. Further, a work order and a scheduled work time are set for each work based on the work schedule of the day, and the display control unit 25 may output work candidates by arranging work candidates in order of work time, for example. Further, when a certain work is completed based on the work record input on the record registration screen 306 described later, the processing unit 24 sets a completion flag for the completed work, and the display control unit 25 displays the completion flag. It is also possible to extract only the work that is not standing and output a list of work candidates.

  Next, a work selection method by voice input will be described. It is assumed that the work selection screen 304 of FIG. 3 is displayed. The worker voice-inputs "up", "down", etc., and selects a work to be performed from the displayed work names. In addition, “Next Page” and “Previous Page” are input by voice to select the page where the work candidates are displayed. Alternatively, the worker may select the work by voice-inputting the displayed number and “decision” assigned to the work name.

  When the worker voice-inputs “unplanned”, the display control unit 25 outputs a list of unplanned works. In addition, when the worker inputs the voice "unsteady", the display control unit 25 outputs a list of unsteady works. The unplanned and unsteady work may be work that is not associated with the worker ID.

  When the worker selects a work by voice input, the input / output unit 21 receives the voice input, and the display control unit 25 outputs the detailed procedure selection screen 305 which is the next screen. On the detailed procedure selection screen 305, a list of detailed procedures (a group of smaller units of work constituting one work) included in the work selected by the worker on the previous screen is displayed side by side in the order of execution of the detailed procedures. It The detailed procedure is, for example, preparation for a certain work, accompanying work, main work, cleaning work, or the like. Since the detailed procedure is almost always performed in a predetermined order, the display control unit 25 arranges the output in the order of execution so that the worker can select the detailed procedure displayed at the top of the first page. , Workers can select detailed procedures efficiently. When the worker selects the detailed procedure by voice input similar to the case of selecting the work, the display control unit 25 outputs the record registration screen 306 which is the next screen.

  The record registration screen 306 is a screen used by a worker to input a work record. For example, when the worker inputs the voice “start” when starting the “detailed procedure 1”, the processing unit 24 records the time at that time in the storage unit 26 as the start time of the detailed procedure 1. The display control unit 25 outputs the start time recorded in the storage unit 26 to the start time display field of the performance registration screen 306. When the worker inputs the voice “completion” when the work of “detailed procedure 1” is completed, the processing unit 24 records the time at that time in the storage unit 26 as the completion time of the detailed procedure 1. To do. The display control unit 25 outputs the completion time recorded in the storage unit 26 to the completion time display field of the record registration screen 306.

  Further, when the worker temporarily interrupts the work of the “detailed procedure 1” by returning home or starting another work, “interrupt” is input, and when the worker temporarily pauses for a break or the like, “rest” is input. When the instruction information is input, the processing unit 24 records the time at that time in the storage unit 26 as the suspension start time and the break start time of the detailed procedure 1, respectively. When resuming the work after interrupting the work or the like, the worker inputs a voice "start". Then, the processing unit 24 records the time in the storage unit 26 as the restart time of the detailed procedure 1. When the work is interrupted, the processing unit 24 calculates the time from the interruption start time recorded in the storage unit 26 to the restart time, and the display control unit 25 displays the time in the interruption time display field of the record registration screen 306. Output. When the work is taken as a break, the processing unit 24 calculates the time from the break start time to the restart time recorded in the storage unit 26, and the display control unit 25 puts the time in the break time display field of the result registration screen 306. Output.

Further, when the worker inputs a voice message “calculation”, the processing unit 24 calculates and displays the actual work time from the start time to the completion time, which is recorded in the storage unit 26, excluding the interruption / rest time. The control unit 25 outputs the calculated time in the work time column of the record registration screen 306.
In this way, the display control unit 25 successively outputs selection screens configured in accordance with hierarchical work information (work name information described later) until reaching the work record registration screen 306 for inputting work results. To do. In addition, the display control unit 25, in each selection screen, outputs only by concentrating only the necessary information, or outputs the data that the operator is likely to select in order, and outputs the data. Saves the trouble and time of selecting data. On the other hand, the worker can make selections one after another by voice input without looking at the displayed selection screens and using hands to reach the record registration screen 306. Further, since the work performance itself can be input by voice input, the work input can be performed without deteriorating the work efficiency. It should be noted that one group of data including work processes, machines, works, and detailed procedures displayed in each hierarchy of the hierarchical selection screen is called work name information. In the work navigation DB 31, work name information is recorded in association with the worker's ID.

Further, when the worker inputs a voice message “work instruction” on the record registration screen 306, the display control unit 25 causes the display control unit 25 to display the detailed procedure displayed on the record record screen 306 (in the case of the example of FIG. The work procedure manual of “procedure 1”) is output to the screen of the glass type display 10. As will be described later, the text data of the work procedure manual is shaped according to the size of the screen of the glass-type display 10 so that the size of the characters and the display unit of the text are shaped so that the worker can easily read it.
Further, when the worker inputs a voice with the “attachment screen” on the record registration screen 306, the display control unit 25 displays a drawing regarding the detailed procedure displayed on the record registration screen 306 on the screen of the glass type display 10. Output. This drawing may include limit information (limit sample) such as, for example, how much processing is required to deviate from the allowable range of specifications. Alternatively, it may be a drawing in which the way of working is illustrated in an easy-to-understand manner. Conventionally, work instructions and drawings have often been browsed on, for example, a PC (Personal Computer) near the work site. There is a detailed procedure in which it is stipulated that the work must be done while looking at the work procedure manual. According to the work support system of the present embodiment, the worker can browse the instruction sheet and the drawings regarding the detailed procedure of the current work without using a hand or moving to the place where the PC is installed. You can Thereby, work efficiency can be improved. Further, since information useful for the worker can be called by an operation that does not disturb the work, the worker can use the work support system by himself, and it can be expected to promote system fixation. It should be noted that, for example, when the worker inputs a voice message of "enlargement" while the drawing is displayed, the drawing may be enlarged and displayed.

  It should be noted that when the worker inputs a voice message “Cancel” on the record registration screen 306, the input work record can be canceled. When the worker utters “close”, the display control unit 25 ends the record registration screen 306 and outputs the previous detailed procedure selection screen 305. For example, when the work of “detailed procedure 1” is completed, the worker “closes” to display the detailed procedure selection screen 305. At this time, the processing unit 24 may determine the completion of the “detailed procedure 1” based on the performance information input on the performance registration screen 306, and set a work completion flag for the “detailed procedure 1”. Then, the display control unit 25 may output only the names of the detailed procedures after the “detailed procedure 2” in which the work completion flag is not set, excluding the “detailed procedure 1” in which the work completion flag is set. Further, at this time, the worker speaks, for example, “2”, and then “decision”. Thereby, the worker can select the “detailed procedure 2” to be performed next and output the record registration screen 306 corresponding to the “detailed procedure 2” by only performing a simple voice input. As a result, it is possible to quickly shift to the next work.

  In addition, when all the detailed work included in the work is completed after selecting a certain work, when the worker inputs a voice of “confirm” on the detailed procedure selection screen 305, the display control unit 25 The work selection screen 304 is output. Also in this case, the work completion flag is set for the work completed by the processing unit 24 (the start time / completion time is input for all the detailed works included in the work), and the display control unit 25 sets A list of work names may be output only for incomplete works associated with the ID. The worker selects a new work to be performed next on the work selection screen 304.

Next, the flow of processing for screen display control illustrated in FIG. 3 will be described with reference to FIGS. 4 and 5.
FIG. 4 is a first flowchart showing an example of the operation of the work support system according to the embodiment of the present invention.
FIG. 5 is a second flowchart showing an example of the operation of the work support system according to the embodiment of the present invention.
First, the processing unit 24 of the mobile terminal device 20 performs a login process (step S10). For example, when the worker voice-inputs the user ID on the login screen illustrated in FIG. 3, the input / output unit 21 receives the voice information of the user ID and outputs it to the voice recognition unit 22. The voice recognition unit 22 performs voice recognition processing on the acquired voice information and outputs the recognized user ID to the processing unit 24. The processing unit 24 performs authentication based on the acquired user ID. Alternatively, the mobile terminal device 20 and the user may be assigned in advance, and the terminal number such as the product number may be used instead of the user ID. When the login process is successful, the communication unit 23 sends the user ID to the work navigation device 30 and requests the work name information associated with the user ID according to an instruction from the processing unit 24 (step S11). In the work navigation device 30, work name information is recorded in advance in association with the user ID. The work navigation device 30 transmits work name information associated with the user ID (step S12). The communication unit 23 receives the work name information and outputs it to the processing unit 24. The processing unit 24 records the work name information in the storage unit 26. Next, based on the instruction from the processing unit 24, the display control unit 25 extracts the work process data from the work name information and outputs the work process selection screen 302 to the glass-type display 10 (step S13). . Here, the worker gives an instruction to select a work process by voice input. Then, the input / output unit 21 accepts the input of the voice information instructing the selection of the work process (step S14), and the voice recognition unit 22 performs the voice recognition process to identify the work process selected (for example, in FIG. 3). Recognize "1" in case of "1 work process 1". The voice recognition unit 22 outputs the recognized identification information of the work process to the processing unit 24. The processing unit 24 instructs the display control unit 25 to output the machine selection screen 303 according to the selected work process. Next, based on the instruction from the processing unit 24, the display control unit 25 outputs the machine selection screen 303 to the glass type display 10 (step S15). A worker gives an instruction to select a machine by voice input. The input / output unit 21 receives the selection of the machine (step S16), and through the same processing as the selection of the work process, the voice recognition unit 22 recognizes the identification information of the selected machine. Next, the processing unit 24 instructs the display control unit 25 to output the work selection screen 304 according to the selected machine.

  Next, based on the instruction from the processing unit 24, the display control unit 25 outputs the work selection screen 304 to the glass type display 10 (step S17). A worker selects work by voice input or gives an instruction to select unplanned / unsteady work. If there is an unplanned or unsteady voice input (step S18; Yes), the communication unit 23 requests the unplanned or unsteady work name information from the work navigation device 30 according to the instruction of the processing unit 24 (step S18). S19). In the work navigation device 30, work name information of unsteady work is recorded. When there is an unplanned request, the work navigation device 30 does not search the work name information by the worker ID and transmits all work name information to the mobile terminal device 20. Further, the work navigation device 30 transmits the work name information regarding the non-steady work to the mobile terminal device 20 when the non-steady work is requested (step S20). The display control unit 25 outputs the work selection screen 304 regarding the unplanned or unsteady work received from the work navigation device 30 to the glass type display 10 (step S21). Next, the worker gives an instruction to select a work by voice input. The input / output unit 21 receives the selection of the work (step S22), and through the same processing as step S14 and the like, the voice recognition unit 22 recognizes the identification information of the selected work. Next, the processing unit 24 instructs the display control unit 25 to output the detailed procedure selection screen 305 according to the selected work.

  Next, based on the instruction of the processing unit 24, the display control unit 25 outputs the detailed procedure selection screen 305 to the glass type display 10 (step S23). A worker gives an instruction to select a detailed procedure by voice input. The input / output unit 21 accepts the selection of the work (step S24), the voice recognition unit 22 recognizes the identification information of the selected detailed procedure, and the processing unit 24 causes the record registration screen 306 corresponding to the selected detailed procedure. To the display control unit 25. The display control unit 25 outputs the record registration screen 306 to the glass type display 10 (step S25). Here, for example, the worker performs a voice input such as “start” when performing the detailed procedure. When the implementation of the detailed procedure is completed, the worker inputs a voice message “completion”. Further, when the user wants to browse the work instruction sheet and the drawing at the time of work, the worker inputs a voice by using the “work instruction” or the “attached drawing screen”. When the processing unit 24 receives the request for the “work instruction” or the “attachment screen” (step S26; Yes), the communication unit 23 follows the instruction of the processing unit 24 and performs the work of the detailed procedure selected on the detailed procedure selection screen 305. An instruction or drawing is requested from the work navigation device 30 (step S27). The work navigation device 30 reads the requested text data of the work instruction sheet or the image data of the drawing from the work navigation DB 31 using the detailed procedure as a key, and transmits the read information to the mobile terminal device 20 (step S28). ). The text data of the work instruction sheet is shaped into a layout that is easy to see on the screen of the glass-type display 10. Further, the image data of the drawing is edited in advance so as to be enlarged / reduced by an authoring tool, added with a comment, or viewed on the screen of the glass-type display 10. The processing unit 24 instructs the display control unit 25 to output the data such as the work instruction sheet acquired via the communication unit 23. The display control unit 25 outputs the work instruction sheet or the drawing to the glass type display 10 (step S29). Next, when the worker performs voice input such as “return” and gives an instruction to end the display of the work instruction sheet or the drawing (step S30; Yes), the display control unit 25 outputs the record registration screen 306 again. To do.

  On the other hand, when the input / output unit 21 does not accept the input of the “work instruction” or the “attachment screen” (step S26; No), the processing unit 24 performs an instruction operation for the worker to finish using the mobile terminal device 20. It is determined whether or not (step S31). For example, on the work selection screen 304, when a worker inputs a voice message “logout”, the voice recognition unit 22 recognizes that a voice indicating that the user logs out is input, and the processing unit 24 causes the recognition result. Therefore, it is determined that the worker finishes the use. When the end of use is determined (step S31; Yes), the communication unit 23 transmits the work record information input on the record registration screen 306 to the work navigation device 30 (step S34). The work record information is information such as a worker ID, a start time for each detailed procedure, a completion time, an interruption time, and a break time. The work navigation device 30 writes and stores the received work performance information in the work navigation DB 31. The work navigation device 30 may transmit work record information stored in the arrival completion system 50 described later. Next, the processing unit 24 performs termination processing such as deleting unnecessary temporary data or recording the logout time (step S35).

Further, in step S31, when the worker has not performed the operation of instructing the end of use (step S31; No), the processing unit 24 determines whether the detailed procedure is completed (step S32). For example, when the worker inputs a voice of “close” on the record registration screen 306, the processing unit 24 determines that the detailed procedure is completed. When it is not determined that the detailed procedure is completed, the processing unit 24 waits until the condition of step S32 is satisfied while performing the arrival completion input process by the voice instruction of the worker. When it is determined that the detailed procedure is completed (step S32; Yes), the processing unit 24 determines whether the work is completed (step S33). For example, when the worker inputs a voice of “confirm” on the detailed procedure selection screen 305, the processing unit 24 determines that the work is completed. When it is determined that the work is completed (step S33; Yes), the process returns to step S17, and the processing unit 24 instructs the display control unit 25 to output the work selection screen 304. The display control unit 25 outputs the work selection screen 304 to the glass type display 10. When it is determined that the work is not completed (step S33; No), the process returns to step S23, and the processing unit 24 instructs the display control unit 25 to output the detailed procedure selection screen 305. The display control unit 25 outputs the detailed procedure selection screen 305 to the glass-type display 10. The worker carries out the detailed procedure by selecting the detailed procedure and inputting the work result and browsing the work procedure manual as necessary.
In the flowcharts of FIGS. 4 and 5, the work record information is collectively transmitted (step S34). However, the work navigation device is used each time the worker inputs voice such as “start” or “completion”. The work record information may be transmitted to 30.

  According to the present embodiment, it is possible to easily input the work record by voice input without using a hand, and it is possible to improve the efficiency and fixation of the work record input at the production site. Since it is possible to request the display of the work instruction information by voice input, it is possible to easily confirm the work instruction sheet and the drawings, and it is possible to suppress the occurrence of nonconformity. Further, even in a work in which the mobile terminal device 20 cannot be operated due to a dirty hand, the work procedure manual can be confirmed and the work record can be input. Further, since it is possible to confirm the work instruction while performing the work, it is not necessary to stop the work, which leads to the efficiency of the work. Further, conventionally, a system for inputting work results and a system for browsing work instructions were separate, but according to the present embodiment, work results input and work are performed using a work name (for example, the name of a detailed procedure) as a key. As the instructions are linked, it is possible to switch between the work result input screen and the work instruction and drawing confirmation screen regarding the detailed procedure being performed, and you must handle both systems while engaging in work. It is possible to reduce the burden on the worker who had to do so and improve the convenience of the worker. Also, by selecting and displaying only the necessary information on each selection screen, it is possible to reduce the selection burden on the worker and improve the selection speed. You can concentrate.

  Note that a standard work completion time is set for each detailed work, and if there is no work completion input even if the standard work time is exceeded, the processing unit 24 may cause the display control unit 25 to output an alarm. Good. In the above example, the output destination of various information is the glass type display 10. However, for example, in a narrow working space, it is difficult to attach the glass type display 10. It may have a function of switching so that the screen generated by is output to the screen of the mobile terminal device 20. The output destination of the screen such as the record registration screen 306 is not limited to the glass type display 10, and may be a wearable terminal device such as a wristwatch device. Further, in the present embodiment, in the flow of the work process selection screen 302, the machine selection screen 303, the work selection screen 304, and the detailed procedure selection screen 305, the candidates of work information in the lower work units are displayed one after another in order from the higher order, and the work information is displayed. Although an example of prompting the staff to select is given, for example, the selection contents on the work process selection screen 302 and the machine selection screen 303 may be determined in advance, and after the login processing, the work selection screen 304 may be displayed. . Alternatively, when the work to be performed by the worker is determined, the detailed procedure selection screen 305 may be displayed after the login processing to prompt the user to select the detailed procedure.

So far, the configuration has been described in which the worker provides the function of inputting the work record and displaying the work instruction information in the work support system. Next, the configuration of the work support system that provides means for creating content to be displayed on the glass-type display 10 will be described.
FIG. 6 is a second diagram showing the configuration of the work support system in the embodiment according to the present invention. As shown in FIG. 6, the work support system includes a work navigation device 30, a work instruction system 40, a finish system 50, and an editing device 60 as content creating means.
The work instruction system 40 stores work procedure manuals and drawing data related to the work procedures, and in response to a request from a worker, the work procedure manual data and the image of the drawing edited for the screen of the PC or the like. It is a system that displays data. The data of the work procedure manual and the drawings are called work instruction information.
The arrival completion system 50 is a system that manages work results for each worker. The arrival completion system 50 stores the worker ID, work name information, and work record information in association with each other. The work name information is information including each name of work process, machine, work, and detailed procedure and their hierarchical relationship. The work record information is the record (start, completion time, etc.) for each worker in units of detailed procedures. The work instruction system 40 and the arrival completion system 50 are composed of one or a plurality of computer devices.

  The editing device 60 is a device that edits the content displayed on the glass display 10 for the screen of the glass display 10. The editing device 60 is, for example, a computer device such as a PC. The editing device 60 acquires the text data (D3) of the work instruction information from the work instruction system 40. D3 is, for example, a file name of text data of a work procedure manual and image data including a drawing. Further, the editing device 60 acquires the work name information and the work record information (D4) from the arrival completion system 50. As shown in the figure, the editing device 60 includes a conversion unit 601, an association processing unit 602, and an editing function providing unit 603. The conversion unit 601 shapes the work instruction information into a shape suitable for display on the glass-type display 10. The association processing unit 602 associates the acquired work instruction information (D3) with the work name information based on the correspondence table between the work name information and the work instruction information. The editing function providing unit 603 acquires the image data of the drawing stored in the work navigation device 30 and performs an editing process of adding a comment to the image data or enlarging / reducing the image data based on the operation of the operator. To do. Further, the editing function providing unit 603 performs an editing process (such as adjustment of a portion that the conversion unit 601 cannot handle) on the text data shaped by the conversion unit 601 based on an operator's operation. The editing function providing unit 603 is, for example, an authoring tool. The editing device 60 transmits the associated information, the formatted text data, the edited image data, and the like (D5) to the work navigation device 30.

  The work navigation device 30 acquires image data (D1) such as drawings and limit samples accompanying the work instruction sheet from the work instruction system 40 and stores the image data (D1). Further, the work navigation device 30 acquires data (D2) such as a worker ID, work record information, and work name information from the arrival completion system 50 and stores the data. Further, the work navigation device 30 acquires the information in which the work instruction information and the work name information are associated with each other, the text data after shaping, and the image data after editing from the editing device 60 and stores them. In this way, the work navigation device 30 stores the work record information and the work name information in association with the worker ID. Accordingly, when the processing unit 24 performs the login process from the state where the login screen 301 of FIG. 3 is displayed, the mobile terminal device 20 transmits the worker ID to the work navigation device 30, and the work navigation device 30 The work name information associated with the worker ID is transmitted to the mobile terminal device 20. Then, the display control unit 25 generates images of the screens of the work process selection screen 302 to the record registration screen 306 based on the work name information. Furthermore, work instruction information is stored in the work navigation device 30 in association with the work name information based on the work name (for example, the name of the detailed procedure). As a result, when the worker voice-inputs “work instruction” while the result registration screen 306 of FIG. 3 is displayed, the work navigation device 30 is related to the detailed procedure for inputting the result on the result registration screen 306. The attached work instruction information (work procedure manual, drawing) is transmitted to the mobile terminal device 20. Then, the display control unit 25 outputs the text data of the work instruction sheet after the shaping to the glass type display 10.

  Next, a conversion process for shaping the text data according to the display area (screen) of the glass type display 10 will be described. Shaping according to the display area means dividing the text data according to the size, number, and shape of the display area so that the operator can easily view the text data. In the past, work instructions were often viewed on a sufficiently large screen such as a PC monitor. In order to make this easy to read even on a small screen of the glass-type display 10, it is desirable to display cohesive information within one page (display area that is displayed once per screen) with an appropriate character size. . Therefore, the conversion unit 601 inserts a line feed code at an appropriate position in the text data of the work procedure manual prepared for the PC so that one set of information (for example, one line of text data) is displayed in one page. Is inserted or a page break code is inserted to divide the text data. This process is called a conversion process in this embodiment.

  For example, the conversion unit 601 may perform shaping so that one line of text data for PC does not extend over a plurality of screens when displayed on the screen of the glass display 10. Therefore, when the number of lines displayed on one page exceeds the maximum number of lines that can be displayed on the screen of the glass-type display 10, processing may be performed such that the page break occurs at the beginning of the sentence that causes the excess. Alternatively, when the number of displayed characters on one page exceeds the maximum number of characters, it may be processed so as to start a new page at the beginning of the sentence that causes the excess. In addition, in order to make the text easier for the worker to read, for example, if the last character of the line has a punctuation mark, insert a line feed code, or if the blank lines are continuous, display the second and subsequent blank lines. It may be processed so that it does not occur, or if the last character of the line is "te", "ni", "wo", "ha", "because", ",", no line break is performed.

FIG. 7 is a third flowchart showing an example of the operation of the work support system in the embodiment according to the present invention.
The conversion processing of the text data of the work procedure manual by the conversion unit 601 of the editing device 60 will be described with reference to FIG. 7.
Note that an initial value 0 (representing the first row) is set to the variable i for counting the rows. Further, it is assumed that the screen size of the glass type display 10 and the character size of the text data to be displayed on the screen are determined in advance by performing verification work or the like. Further, it is assumed that the text data of the work procedure manual edited for the PC is input to the editing device 60.
First, the conversion unit 601 sets the character size displayed on the screen of the glass-type display 10 (step S30). For example, the operator inputs the character size to be displayed on the screen of the glass type display 10 into the editing device 60. In the editing device 60, the conversion unit 601 receives input of character size information and records the input character size information in a storage unit (not shown). Next, the conversion unit 601 sets the screen size of the glass type display 10 (step S31). For example, the operator inputs the screen size of the glass type display 10 into the editing device 60. In the editing device 60, the conversion unit 601 receives input of screen size information, and records the input screen size information in a storage unit (not shown).

  Next, the conversion unit 601 calculates the maximum number of display lines per screen from the set screen size and character size (step S32). Specifically, for example, when text data is displayed horizontally, the maximum size of display lines is calculated by dividing the vertical size of the screen by the character size. Next, the conversion unit 601 calculates the maximum number of table characters per line from the set screen size and character size (step S33). Specifically, for example, when the text data is displayed horizontally, the horizontal size of the screen is divided by the character size to calculate the number of display characters per line. Next, the conversion unit 601 selects the i-th line of the input text data and counts the number of characters in the selected line (step S34). Next, the converting unit 601 counts how many lines are included in the screen of the glass-type display 10 up to the selected line after the immediately preceding page feed code is inserted (step S35). That is, when the selected i-th row is displayed, the number of rows on the screen of the glass display 10 is counted. Next, the conversion unit 601 determines whether or not the counted number of lines is less than the maximum number of lines displayed per screen (step S36). If it is not less than the maximum number of display lines (step S36; No), the converting unit 601 inserts the page break code immediately before the selected line (step S38).

  When the number is less than the maximum number of display lines (step S36; Yes), the converting unit 601 determines whether the selected line (i) and the previous line (i-1) are both blank (step S37). This is a judgment for performing a page break when there is a blank line. If either the selected line or the previous line (i-1) is a blank line (step S37; No), the converting unit 601 inserts a page break code immediately before the selected line (step S38). If neither the selected line nor the previous line (i-1) is a blank line (step S37; Yes), the converting unit 601 determines whether or not the selected line includes characters (step S39). If there is no character (step S39; No), the conversion unit 601 inserts a line feed code immediately after the selected line (step S42). If the character is included (step S39; Yes), the converting unit 601 then determines whether the last character of the selected line ends with a reading point (step S40). If the line ends with a reading point (step S40; Yes), the converting unit 601 inserts a line feed code immediately after the selected line (step S42). If it does not end with a reading point (step S40; No), the converting unit 601 determines whether or not the last character of the selected line ends with a word / complex written in the conversion definition list (step S41). The words / collocations listed in the conversion definition list are, for example, “te”, “ni”, “wo”, “wa”, “by”, and punctuation marks. This is a determination to prevent line breaks at punctuation marks and "te", "ni", "wa", and "ha" so that the worker can easily read the sentences. If the last character does not end with the word / collocation listed in the conversion definition list (step S41; No), the converting unit 601 inserts a line feed code immediately after the selected line (step S42). When the last character ends with the word or compound word listed in the conversion definition list (step S41; Yes), it is determined whether the selected line is the last line (step S43). If it is not the last row (step S43; No), the converting unit 601 adds 1 to i (step S44), and repeats the processing from step S35. In the case of the last line (step S43; Yes), the conversion unit 601 ends the conversion process. The conversion unit 601 records the text data after the conversion process in a storage unit (not shown). The editing device 60 transmits the text data after the conversion process to the work navigation device 30.

  For example, the work 1 includes the detailed procedure 1, the detailed procedure 2, and the detailed procedure 3, and on the PC screen, the work instruction text data relating to the detailed procedures of the detailed procedures 1 to 3 are simultaneously displayed on one screen. Even if it is done, by performing the conversion process of the present embodiment, the work instruction text data is divided into, for example, each detailed procedure unit on the screen of the glass-type display 10, and the present work is performed according to the progress of the detailed work. The work instruction text data corresponding to the procedure can be displayed.

  According to this conversion process, the text data for the PC can be automatically shaped according to the screen size of the glass-type display 10, so that the labor and time for creating the text data for the glass-type display 10 can be saved. Further, a worker can insert line breaks and page breaks so that the text is easily recognized on the screen of the glass display 10. In addition, the text data linking between the PC and the glass type display 10 becomes easy, and the existing system can be utilized.

  Although the case where the screen of the glass type display 10 is matched is taken as an example here, the screen size and the character size can be given to any size display device as long as it is the process described in FIG. Can automatically convert the text data according to the screen of the display device. For example, the text data for the PC can be shaped for the screen of the mobile terminal device used by the worker or for the screen of various wearable terminal devices. In addition, even if there are multiple types of glass-type displays manufactured by various manufacturers, by performing conversion processing that matches the screen size of each glass-type display, the text data that matches each glass-type display can be easily obtained. Can be obtained.

FIG. 8 is a diagram showing an example of the hardware configuration of the work support system according to the embodiment of the present invention.
The computer 900 includes a CPU 901, a main storage device 902, an auxiliary storage device 903, an input / output interface 904, and a communication interface 905.
The mobile terminal device 20 described above is implemented in the computer 900. The operation of each processing unit described above is stored in the auxiliary storage device 903 in the form of a program. The CPU 901 reads the program from the auxiliary storage device 903, expands the program in the main storage device 902, and executes the above processing according to the program. Further, the CPU 901 secures a storage area corresponding to the storage unit 26 in the main storage device 902 according to the program. Further, the CPU 901 secures a storage area for storing the data being processed in the auxiliary storage device 903 according to the program. Although the computer 900 is described as an example in which the computer 900 is a mobile terminal device such as a smartphone, the computer 900 may be a PC, a server terminal device, a wearable terminal device, or the like. The editing device 60 described above is also installed in the computer 900 illustrated in FIG. 8.

  Note that in at least one embodiment, the auxiliary storage device 903 is an example of a non-transitory tangible medium. Other examples of non-transitory tangible media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, semiconductor memories, etc. connected via the input / output interface 904. Further, when this program is distributed to the computer 900 via a communication line, the computer 900 that has received the distribution may expand the program in the main storage device 902 and execute the above processing.

  Further, the program may be a program for realizing some of the functions described above. Further, the program may be a so-called difference file (difference program) that realizes the function described above in combination with another program already stored in the auxiliary storage device 903.

  In addition, it is possible to appropriately replace the components in the above-described embodiments with known components without departing from the spirit of the present invention. Further, the technical scope of the present invention is not limited to the above embodiment, and various modifications can be made without departing from the spirit of the present invention. For example, the work place and the machine may be selected by voice. Note that part or all of the work process selection screen 302, the machine selection screen 303, the work selection screen 304, and the detailed procedure selection screen 305 are examples of work information selection screen information. The worker is an example of a user. The record registration screen 306 is an example of record registration screen information.

10 ... Glass type display 20 ... Mobile terminal device 21 ... Input / output unit 22 ... Voice recognition unit 23 ... Communication unit 24 ... Processing unit 25 ... Display control unit 26 ...・ Storage unit 30 ... Work navigation device 31 ... Work navigation DB
40 ... Work instruction system 50 ... Finishing system 60 ... Editing device 601 ... Conversion unit 602 ... Association processing unit 603 ... Editing function providing unit 900 ... Computer 901 ... CPU
902 ... Main storage device 903 ... Auxiliary storage device 904 ... Input / output interface 905 ... Communication interface

Claims (12)

A work support system for inputting work results as work progresses,
A voice recognition unit that recognizes voice information input by the user,
A processing unit that performs processing based on the recognition result of the voice recognition unit;
A display control unit that outputs information to be displayed on the display based on an instruction from the processing unit ;
Storage part,
Bei to give a,
The display control unit outputs image data of a detailed procedure selection screen displaying a list of detailed procedures constituting the work to be performed by the user, which is associated with the identification information of the user,
When the user selects the detailed procedure by the first voice input, the voice recognition unit recognizes the selected detailed procedure, outputs information of the recognized detailed procedure to the processing unit, and the processing unit Is a record registration which provides a function of voice-inputting a work record of the selected detailed procedure and a function of displaying a work instruction sheet of the detailed procedure on the display in response to a display request by the user's voice input. Instructing the display control unit to output a screen, the display control unit outputs image data of the result registration screen,
When the user inputs a second voice input indicating the start of the detailed procedure, the voice recognition unit recognizes the second voice input, and the processing unit recognizes the second voice input. While registering the time as the start time of the detailed procedure in the storage unit, instructing the output of the start time, the display control unit outputs the image data of the result registration screen displaying the start time,
When the user inputs a third voice input indicating completion of the detailed procedure, the voice recognition unit recognizes the third voice input, and the processing unit recognizes the third voice input. The time is registered in the storage unit as the completion time of the detailed procedure, the output of the completion time is instructed, and the display control unit outputs the image data of the result registration screen displaying the completion time.
Work support system. When the user voice-inputs a display request for the work instruction sheet while the display control unit is outputting the image data of the performance registration screen, the voice recognition unit recognizes the display request, and the processing unit. Based on the recognition, instructs the output of the work instruction sheet of the selected detailed procedure, the display control unit outputs the text data of the work instruction sheet,
The work support system according to claim 1. The display control unit outputs text data included in the work instruction sheet shaped according to a display area of the display,
Work support system according to 請 Motomeko 2. When the user voice-inputs a display end instruction of the work instruction while the display control unit is outputting the work instruction, the voice recognition unit recognizes the display end instruction, and the processing unit. Based on the recognition, instructs the output of the achievement registration screen, the display control unit outputs the image data of the achievement registration screen,
The work support system according to claim 2 or claim 3. When the user performs a voice input indicating the interruption after the second voice input is performed, the voice recognition unit recognizes the voice input indicating the interruption, and the processing unit causes the voice indicating the interruption. The time when the input is recognized is registered in the storage unit as the suspension start time of the detailed procedure,
The work support system according to any one of claims 1 to 4. After the voice input indicating the interruption is performed, when the user inputs the voice input indicating the start, the voice recognition unit recognizes the voice input indicating the start, and the processing unit outputs the voice indicating the start. The time when the input is recognized is registered in the storage unit as the restart time of the detailed procedure,
The work support system according to claim 5. When the user performs a voice input requesting calculation after performing the third voice input,
The voice recognition unit recognizes the calculation request, and based on the recognition, the processing unit subtracts a time from the start time to the completion time from the interruption start time to the restart time. Calculating the actual work time, instructing the output of the actual work time, the display control unit outputs the image data of the result registration screen displaying the actual work time,
The work support system according to claim 6. The display control unit outputs information to be displayed on the display to a wearable terminal,
The work support system according to any one of claims 1 to 7 . The display control unit outputs, on the detailed procedure selection screen , information in which a list of detailed procedures is arranged and displayed in the order of performing work.
The work support system according to any one of claims 1 to 8 . A conversion unit that shapes the text data included in the work instruction sheet according to the display area,
The work support system according to any one of claims 1 to 9, further comprising: A work support system for inputting work results as work progresses,
The image data of the detailed procedure selection screen displaying a list of detailed procedures constituting the work to be performed by the user, which is associated with the identification information of the user, is output to the display,
When the user selects the detailed procedure by the first voice input, a function of recognizing the first voice input and voice-inputting the work record of the selected detailed procedure, and a display request by the voice input of the user A function of displaying a work instruction sheet of the detailed procedure on the display, and outputting image data of a performance registration screen to the display,
When the user inputs a second voice input indicating the start of the detailed procedure, the second voice input is recognized, and the recognized time is registered in the storage unit as the start time of the detailed procedure. Output the image data of the result registration screen displaying the start time to the display,
When the user performs a third voice input indicating completion of the detailed procedure, the third voice input is recognized, and the recognized time is registered in the storage unit as the completion time of the detailed procedure. Outputting the image data of the result registration screen displaying the completion time to the display,
Display control method. A computer of a work support system for inputting work results with work progress,
Means for outputting to the display the image data of the detailed procedure selection screen displaying a list of detailed procedures constituting the work to be performed by the user, which is associated with the identification information of the user,
Means for recognizing the selected detailed procedure when the user selects the detailed procedure by a first voice input,
A record registration screen providing a function of voice-inputting the recognized work record of the detailed procedure and a function of displaying a work instruction sheet of the detailed procedure on the display in response to a display request by the user's voice input. Means for directing the output of
Means for outputting the image data of the achievement registration screen to the display,
Means for recognizing the second voice input when the user inputs a second voice input indicating the start of the detailed procedure;
A unit for registering the time when the second voice input is recognized in the storage unit as the start time of the detailed procedure;
Means for outputting to the display the image data of the achievement registration screen displaying the start time,
Means for recognizing the third voice input when the user inputs a third voice input indicating completion of the detailed procedure;
A unit for registering the time when the third voice input is recognized in the storage unit as the completion time of the detailed procedure;
Means for outputting the image data of the result registration screen displaying the completion time to the display,
Program to function as.

Images