JP2017167391A - Operation result recording system, operation result recording method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation result recording system which enables result input by voice.SOLUTION: An operation result recording system comprises a voice input unit to which voice is input, a voice recognition unit which recognizes predetermined keywords included in the voice input to the voice input unit, and an operation result log recording unit which, on the basis of recognition of a keyword instructing the start and end of an operation out of the predetermined keywords, records an operation result log including the operation start time, the operation end time and a keyword recognized from the operation start time until the operation end time.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a work record recording system, a work record recording method, and a program.

  In general, work records are recorded at factories and the like. At that time, it is necessary for the worker to stop working and input data to a terminal device such as a PC (Personal Computer) or a tablet terminal. Further, in the work where the hands are soiled with oil or the like, when inputting data to the terminal device, extra work may be required for input, such as attaching and detaching gloves and possibly washing hands. In addition, since it is not efficient to stop the actual work only for recording the work results, workers tend to input the work results collectively later. Then, the accuracy of the recorded work performance deteriorates, and timely information acquisition may not be possible.

  Patent Document 1 discloses an inspection system in which a portable terminal having a microphone and an earphone gives a work instruction by voice, and a worker responds to the work instruction by voice to perform an inspection work.

JP 2010-028279 A

  In order to deal with the above problem, there has been proposed a method of inputting data by voice instead of inputting data by hand (Patent Document 1). As a result, the worker is not blocked for recording work results, and work efficiency can be improved. However, voice data input has problems such as malfunction due to voice misrecognition, and workers sometimes feel inconvenient. For this reason, it has been desired for workers on site to provide an easy-to-use work record recording system.

  Accordingly, an object of the present invention is to provide a work record recording system, a work record recording method, and a program that can solve the above-described problems.

According to the first aspect of the present invention, the work record recording system includes a voice input unit that inputs voice, a voice recognition unit that recognizes a predetermined keyword included in the voice input by the voice input unit, and the predetermined Based on the recognition of the keywords for instructing the start and end of work among the keywords, the start time of the work, the end time of the work, and the keyword recognized from the start time to the end time of the work And a work result log recording unit that records a work result log including:
The operation results can be input by voice input, and the worker does not need to interrupt the operation to input the operation results. This improves work efficiency. Further, since keywords that can be input by voice are limited, the possibility of erroneous recognition can be reduced.

According to the second aspect of the present invention, the work record recording system uses a process step related to recording of a work record log including a plurality of process steps executed in a predetermined order as a keyword recognized by the voice recognition unit. A processing step control unit that controls the processing step may be further provided, and the voice recognition unit may recognize a predetermined keyword corresponding to the processing step.
Since only the keywords corresponding to the processing steps are recognized, the possibility of erroneous operation or erroneous recognition can be further reduced. For example, even if an operator erroneously inputs a keyword for another processing step, no malfunction occurs.

According to the third aspect of the present invention, the processing process control unit selects a work for recording work results from the plurality of processing steps, and a work execution process for recording the work results log. May be switched based on the recognition of the keyword.
Since the work selection process and the work execution process can be switched by voice input, the worker does not need to operate the terminal by manual input when switching the work.

According to a fourth aspect of the present invention, the work record recording system guides a candidate for a work to record a work record among a plurality of works according to the keyword recognized by the voice recognition unit in the work execution step. A work selection process control unit may be further provided that instructs the output of the guidance voice and selects work information for recording work performance based on a keyword input to the guidance voice.
Since it is possible to select a work to be recorded as a work result by voice input, for example, when starting a new work, the worker does not need to take a hand to input the work result. Efficiency is improved.

According to a fifth aspect of the present invention, the work record recording system controls the work record recording operation according to a keyword corresponding to a work situation recognized by the voice recognition unit in the work execution step. A control unit may be further provided.
Since recording operations such as the start and end of the recording of work results can be performed by voice input, the worker does not need to stop to input the work results, and the work efficiency is improved.

According to the sixth aspect of the present invention, the processing step control unit executes the processing step to be executed before the current processing step based on the recognition of the keyword instructing cancellation of the processing by the voice recognition unit. Other processing steps may be set.
By the voice input for instructing cancellation, the processing step related to the recording of the work performance log can be returned to the previous processing step. Thereby, the range which can be operated by voice input is expanded, and operability is improved.

According to the seventh aspect of the present invention, the work record recording system may further include a confirmation voice output unit that outputs a recognition result by the voice recognition unit for the keyword input by the voice input unit.
Since the worker can confirm the recognition result of the voice input by himself / herself, it is possible to predict in advance that an unintended operation due to erroneous recognition of the voice will occur and take measures.

According to an eighth aspect of the present invention, the work performance recording system may further include a voice recognition log recording unit that records a recognition result by the voice recognition unit.
By recording the voice recognition result by the voice recognition unit, it is possible to study the recognition rate improvement based on the recording.

According to the ninth aspect of the present invention, the work record recording system may further include a recording unit that starts recording based on the keyword recognized by the voice recognition unit.
By recording and recording the surroundings when troubles occur, it can be used for future troubleshooting.

  According to a tenth aspect of the present invention, the work record recording system inputs a voice, recognizes a predetermined keyword included in the input voice, and specifies a start and end of the work among the predetermined keywords. A work performance record that records a work performance log that includes the start time of the work, the end time of the work, and the keyword recognized from the start time of the work to the end time. Is the method.

  According to an eleventh aspect of the present invention, there is provided a computer for a work record recording system comprising: means for inputting voice; means for recognizing a predetermined keyword included in the input voice; and start and end of work among the predetermined keywords. Based on the recognition of the keyword that indicates the work, a work performance log including the work start time, the work end time, and the keyword recognized from the work start time to the end time is recorded. It is a program for functioning as means.

  According to the work record recording system of the present invention, a worker can record a work record by a voice instruction during work in a factory or the like. The worker can record the work performance while the hand can be used, thereby improving work efficiency. In the present invention, by recognizing only a predetermined keyword as a voice instruction, it is possible to reduce the possibility of erroneous input of a worker's voice and erroneous recognition by the work record recording system.

It is a block diagram of the work performance record system in a first embodiment concerning the present invention. It is a figure explaining the outline | summary of the work performance recording process of the work performance recording system in 1st embodiment which concerns on this invention. It is a figure which shows an example of the speech recognition log in 1st embodiment which concerns on this invention. It is a figure which shows an example of the work performance log in 1st embodiment which concerns on this invention. It is a flowchart which shows an example of the work selection process in 1st embodiment which concerns on this invention. It is a flowchart which shows an example of the operation process during work in 1st embodiment which concerns on this invention. It is a figure which shows an example of the hardware constitutions of the work performance recording system in 1st embodiment which concerns on this invention.

<First embodiment>
Hereinafter, a work performance recording system according to a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram of a work record recording system according to the first embodiment of the present invention. The work performance recording system is a system for a worker to record the performance of work performed by the worker. In the present embodiment, the work record recording system may be configured by a mobile terminal device having a computer function, such as a smartphone or a tablet terminal device. The work performance recording apparatus 10 in FIG. 1 is an example of a work performance recording system.

  As shown in the figure, the work result recording apparatus 10 includes a voice input unit 101, a voice recognition unit 102, a guidance voice output unit 103, a confirmation voice output unit 104, a voice recognition log recording unit 105, a work result log recording unit 106, and a recording unit 107. , A process control unit 108, a work selection process control unit 109, a work record recording control unit 110, a display control unit 111, an input / output unit 112, and a storage unit 113. The storage unit 113 includes a keyword DB 114, a voice recognition log DB 115, and a work performance log DB 116.

The voice input unit 101 inputs voice information issued by a worker from the microphone 20 connected to the work record recording apparatus 10.
The voice recognition unit 102 performs voice recognition processing on the voice information input by the voice input unit 101. The voice recognition unit 102 performs a recognition process for a predetermined keyword included in the voice information.

The guidance voice output unit 103 outputs a guidance voice that guides a candidate for a task to be a worker recording target of operation guidance and work results to a worker.
The confirmation voice output unit 104 outputs a confirmation voice including the result recognized by the voice recognition unit 102 for the keyword included in the voice information input by the voice input unit 101. The worker can confirm the keyword recognized by the voice recognition unit 102 by the confirmation voice.

The voice recognition log recording unit 105 records a voice recognition log in which a keyword recognition result by the voice recognition unit 102 is recorded in the voice recognition log DB 115.
The work performance log recording unit 106 records a work performance log that is a record of the work performance of the worker in the work performance log DB 116. The work performance log records the work start time, end time, work interruption time, keywords recognized by the voice recognition unit 102 during the work, and the like.
When a trouble occurs, the recording unit 107 records audio information indicating the surrounding situation, and records the audio information in the storage unit 113.

  The processing process control unit 108 switches each processing process of the work performance log recording process including a plurality of processing processes executed in a predetermined order according to the progress of the process. The processing process refers to each process when the procedure required for recording the work performance log is divided into a user authentication process, a work location selection process, a machine selection process, a work selection process, and a work execution process. Say. As will be described later, in the work selection process and the work execution process, operation control is performed by voice input. The processing step control unit 108 switches between these two processing steps in order to perform a work performance log recording process.

The work selection process control unit 109 controls a process in a work selection process in which a worker selects a work for which work results are to be recorded.
The work record recording control unit 110 controls the operation record recording operation by the work record log recording unit 106 based on the input operation of the worker.

The display control unit 111 controls an image to be displayed on the screen (input / output unit 112) of the work performance recording apparatus 10.
The input / output unit 112 is an input / output interface to the work performance recording apparatus 10 of the worker. The input / output unit 112 includes a display screen of the work record recording device 10, buttons provided on the housing, and the like. The display screen may have an input function such as being configured integrally with a touch panel, for example.

  The storage unit 113 includes a keyword DB 114, a voice recognition log DB 115, and a work performance log DB 116, and stores various information. The keyword DB 114 stores keywords for each work. The speech recognition log DB 115 stores keyword recognition results recognized by the speech recognition unit 102. The work record log DB 116 stores work start time, end time, and the like.

  As an example, the work performance recording device 10 is a portable terminal device, and an operator stores the work performance recording device 10 in a holder or the like and attaches the holder to a belt. The work performance recording device 10 is put in a pocket of clothes. Alternatively, the work record recording apparatus 10 can be worn by a method such as using the work record recording apparatus as a wearable terminal. Further, if a hands-free microphone or hands-free set is connected to the work record recording device 10 and used, the work record can be recorded only by voice, and the work is not hindered.

FIG. 2 is a diagram for explaining the outline of the work record recording process of the work record recording system in the first embodiment according to the present invention.
The work record recording process is performed on the selected work after the worker selects the work place, work machine, and work. For each worker, candidates for work to be performed by the worker, work place, and machine to be used are determined in advance and recorded in the storage unit 113. The work record recording apparatus 10 guides the work place, machine, and work candidates to the worker, and the worker selects the work place, machine, and work from the candidates. Since the work place and machine are selected before entering the work, these selections are made by manual input by the worker, and the case where the process steps after the work selection processing process are performed by voice input is described as an example. Do.

  The upper left diagram in FIG. 2 is a login screen 301 displayed by the display control unit 111. The process control unit 108 sets the process to the user authentication process in the initial state. The worker inputs account information by touching the “login” portion or the like. The input / output unit 112 outputs the input account information to the login processing unit 117. The login processing unit 117 performs login processing using the input account information. Then, the processing process control unit 108 sets the processing process as a work place selection process. Then, the display control unit 111 displays a work place selection screen 302. In the work place selection screen 302, the display control unit 111 displays list information of work place candidates associated with the account information of the worker. The worker selects a work place by touching a portion where information indicating the work place to be selected on the display screen is displayed. When the input / output unit 112 accepts an operation of selecting a work place, the processing process control unit 108 sets the processing process as a machine selection process. Then, the display control unit 111 displays a machine selection screen 303. In the machine selection screen 303, the display control unit 111 displays machine candidate list information associated with the account information of the worker. The worker selects a machine by touching a portion where information indicating the machine to be selected on the display screen is displayed. When the input / output unit 112 accepts an operation for selecting a work place, the processing process control unit 108 sets the processing process as a work selection process. The display control unit 111 displays a work selection screen 304. The display control unit 111 displays work candidate list information (work list information) associated with the account information of the worker on the work selection screen 304. A work order is determined for each work, and the display control unit 111 displays work candidates in order from the top according to the work order.

  Next, a voice work selection instruction method in the work selection step will be described. First, it is assumed that the work selection screen 304 illustrated in FIG. 2 is displayed. The work selection process control unit 109 activates the function of the voice input unit 101. As a result, the work record recording apparatus 10 is in a standby state for input of the start instruction keyword. The start instruction keyword is one of keywords in the work selection process. The work record recording apparatus 10 recognizes only keywords defined for each processing process. Examples of keywords in the work selection process are “open”, “start”, “unnecessary”, “skip”, “cancel”, and “trouble”. “Open” is a start instruction keyword for putting the work record recording apparatus 10 in a keyword input waiting state. “Start” is a keyword for instructing to select a work with guidance. “Unnecessary” is a keyword for instructing that the guided work is unnecessary. “Skip” is a keyword for skipping a guided work and instructing the next work. “Cancel” is a keyword for instructing to discard the contents selected so far and return the process to the work place selection process. “Trouble” is a keyword for instructing recording of voice data of the surrounding situation when a trouble occurs.

  When the voice recognition unit 102 recognizes the start instruction keyword “open”, the work selection process control unit 109 executes a work selection process. First, the guidance voice output unit 103 outputs a voice saying “Please select work to start”. Subsequently, the guidance voice output unit 103 outputs a guidance voice “Do you want to start work 2?”. Here, “work 2” is selected first because “work 1” has already been completed. Next, when the voice recognition unit 102 recognizes the keyword “skip”, the guidance voice output unit 103 outputs a voice “Do you want to start work 3?”. Next, when the voice recognition unit 102 recognizes the keyword “start”, the guidance voice output unit 103 outputs a confirmation voice that “work 3 is started”. The work selection processing control unit 109 selects work information “work 3”. Thereby, the selection of operation 3 is completed. When the selection of the work 3 is completed, the work performance log recording unit 106 records the start time in the work performance log DB 116. The above is an example of the work selection process by voice input.

  In this way, by responding only to limited keywords in the work selection process, it does not react to ordinary conversations between workers, and prevents unintended operations of the work record recording apparatus 10. it can. In particular, since a series of keyword recognition is started with the keyword “open” as a trigger, malfunction can be prevented. Further, by outputting a confirmation voice of the keyword recognized by the voice recognition unit 102 to the user, it is possible to feed back whether the recognized keyword is correct.

  Each time the voice recognition unit 102 recognizes a keyword, the voice recognition log recording unit 105 records the recognition result in the voice recognition log DB 115.

  The work selection process in the work selection process can also be performed manually by an operator. For example, when the worker touches the “manual input” portion of the work selection screen 304, the work selection processing control unit 109 switches the input mode of the work selection process from voice input to manual input. The worker may select a work by performing a touch operation on a position where the work to be selected is displayed. As a result, for example, even in a situation where a work cannot be selected by voice input due to a failure of the voice recognition function or noise, the worker can select a work to be recorded.

  When the work selection process is completed, the processing process control unit 108 sets the processing process as a work execution process. The display control unit 111 displays a result input screen 305. The display control unit 111 displays work result information such as the name of the work being performed, the state (work in progress), and the start date / time on the result input screen 305.

  Next, the control method of the work performance log recording process by voice in the work execution process will be described. First, it is assumed that the result input screen 305 illustrated in FIG. 2 is displayed. The work record recording control unit 110 activates the function of the voice input unit 101. As a result, the work record recording apparatus 10 enters a standby state for input of a start instruction keyword (“open”). The keywords in the work execution process are, for example, “open”, “complete”, “suspend”, “break”, “resume”, “cancel”, and “trouble”. “Open” is a start instruction keyword for putting the work record recording apparatus 10 in a keyword input waiting state. Further, “completion” is a keyword indicating completion of work being performed. When the voice recognition unit 102 recognizes the keyword “complete”, the work performance log recording unit 106 records the completion of the work in the work performance log. “Suspend” is a keyword indicating that work being performed is interrupted. When the voice recognition unit 102 recognizes the keyword “interruption”, the work performance log recording unit 106 records the work suspension in the work performance log. “Rest” is a keyword indicating that the work is continued but the user temporarily takes a break. When the voice recognition unit 102 recognizes the keyword “break”, the work record log recording unit 106 records a break in the work record log. “Resume” is a keyword indicating that work is resumed from a rest state. When the voice recognition unit 102 recognizes the keyword “resumption”, the work performance log recording unit 106 records the resumption of work in the work performance log. “Cancel” is a keyword instructing to return the processing process to the work selection process. When the voice recognition unit 102 recognizes the keyword “cancel”, the work performance log recording unit 106 records the work cancellation in the work performance log. “Trouble” is a keyword for instructing recording of voice information as in the work selection process. For example, when the voice recognition unit 102 recognizes the keyword “trouble”, the work performance log recording unit 106 records the trouble in the work performance log DB 116.

  When the voice recognition unit 102 recognizes the keyword “open”, the work record recording control unit 110 executes a process of controlling the work record recording operation. First, the confirmation voice output unit 104 outputs a guidance voice saying “work 3 is in progress”. Next, it is assumed that the worker who has finished “Work 3” speaks “Complete” in order to record the completion of the work in the work performance log DB 116. When the voice recognition unit 102 cannot recognize the voice information, the work record recording control unit 110 instructs the guidance voice output unit 103 to output a guidance voice that prompts the worker to input voice again. The guidance voice output unit 103 outputs a guidance voice such as “Could not recognize voice. Please speak again”. When the worker speaks “complete” again and the voice recognition unit 102 recognizes this voice information as “completed”, the confirmation voice output unit 104 outputs a confirmation voice such as “complete work 3”. . The work result log recording unit 106 records the completion of work in the work result log DB 116. The above is an example of the process for controlling the operation recording operation by voice input.

  Even in the work execution process, it reacts only to limited keywords necessary for the control in this processing process, so that it does not react to ordinary conversations between workers, and malfunctions can be prevented. Also, by outputting a confirmation voice for the keyword recognized by the voice recognition unit 102, it is possible to feed back whether the recognized keyword is correct.

  Moreover, control of the recording process to the work performance log in the work execution process can also be performed by manual input by an operator. For example, when the worker touches the “manual input” portion of the result input screen 305, the work result recording control unit 110 switches the input mode of the work execution process from voice input to manual input. The worker controls the recording process by performing a touch operation on the position where the “break”, “interrupt”, and “complete” buttons are displayed.

  In addition, for example, when an operation is selected incorrectly, and when it is desired to start over from the previous operation selection step in the operation execution step, the operator can return to the operation selection step when “cancel” is uttered. In the case of manual input, a touch operation can be performed on the “return” position on the result input screen 305 to return to the work selection screen 304.

FIG. 3 is a diagram showing an example of a speech recognition log in the first embodiment according to the present invention.
In the left column of FIG. 3, voice recognition processing in which voice recognition log information is to be recorded in the voice recognition log DB 115 is described. The section detection is to detect the end of a word. When the speech recognition unit 102 detects the end of a word, the speech recognition log recording unit 105 records, for example, the time when the end of the word is detected and text data “section detection” in association with each other in the speech recognition log DB 115. Next, “recognition completion” indicates that the recognition processing of the word subjected to the section detection is completed. When the speech recognition unit 102 completes the word recognition process, the speech recognition log recording unit 105 records the recognition completion time and the text data “recognition complete” in the speech recognition log DB 115 in association with each other, for example. The recognition result is a word output by the speech recognition unit 102 as a result of the recognition process. When the speech recognition unit 102 outputs the recognition result, the speech recognition log recording unit 105 records the output time of the recognition result, the output word, and the text data “recognition result” in association with each other in the speech recognition log DB 115, for example. “Reading completion” indicates that the confirmation voice output unit 104 has finished outputting the confirmation voice including the recognition result by the voice recognition unit 102. When the confirmation voice output unit 104 completes the output of the confirmation voice, the voice recognition log recording unit 105 associates, for example, the output completion time of the confirmation voice with the character string of the output confirmation voice and the text data “Reading completion”. And recorded in the voice recognition log DB 115.

  The operation response can be evaluated from the recording of the voice recognition log. For example, the motion response is a time difference from the section detection time to the recognition completion time. The action response can be used when considering changing a keyword with a slow action response to another keyword. In addition, recording of a voice recognition log can be used for evaluation of a voice recognition rate. This will be described later.

FIG. 4 is a diagram showing an example of a work performance log in the first embodiment according to the present invention.
In the column on the left side of FIG. 4, operations that should record work performance log information in the work performance log DB 116 are described. The work result log recording unit 106 displays a work place, a machine number, an operation such as work place selection, machine selection, start (work selection), completion, break, restart, interruption, unnecessary, skip, and cancel. The work, the time at which these actions were performed, and text data (“work location selection”, “cancel”, etc.) indicating the contents of the actions are associated and recorded in the work performance log DB 116. For example, since the machine number and the work are not selected at the timing when the work place is selected, the work result log recording unit 106 does not record the machine number and the work.

  The administrator can grasp the work performance of the worker from the record of the work performance log. For example, when the work 3 is completed without break or interruption after the worker starts the work 3, the time required for the work 3 is from the start time to the completion time of the work performance log. Further, when the worker takes a break, the sum of the time from the start time of the work result log to the break time and the time from the restart time to the completion time is the time required for the work 3. Further, when the work 3 is interrupted, the sum of the time from the start time of the work result log to the stop time and the time from the next start time of the work 3 to the completion time is the time required for the work 3.

  Further, the speech recognition rate can be evaluated from the recording of the voice recognition log and the record of the work performance log. For example, the ratio that “cancel” is recorded after a keyword such as “start” is calculated from the record of the work performance log. It is also confirmed that keywords other than “cancel” are recorded after “cancel”. For example, if it is recorded in the order of “Start”, “Cancel”, “Start”, “Cancel”, “Start”, “Cancel”, “Complete”, what the worker uttered “Complete” three times It is thought that it was misrecognized as "complete". In this case, the recognition rate is 25% because, for example, four times of “completed” voice input are erroneously recognized three times. If the recognition rate falls below a predetermined threshold, it may be considered to change the keyword to a keyword that is easier to recognize.

FIG. 5 is a flowchart showing an example of work selection processing in the first embodiment according to the present invention.
The process flow of the work selection process will be described with reference to FIG.
First, the work selection processing control unit 109 activates the function of the voice input unit 101 and waits for the input of the start instruction keyword “open”. When the worker speaks “open”, the voice input unit 101 inputs the voice information (step S11). The voice information input by the voice input unit 101 is output to the voice recognition unit 102. The voice recognition unit 102 recognizes voice information. The voice recognition unit 102 outputs the recognition result to the work selection processing control unit 109. The work selection process control unit 109 determines whether the recognition result is the start instruction keyword “open” (step S12). When the start instruction keyword is not “open” (step S12; No), the processing from step S11 is repeated. When the start instruction keyword is “open” (step S12; Yes), the work selection processing control unit 109 instructs the guide voice output unit 103 to output a work guide voice. The guidance voice output unit 103 outputs a work guidance voice (step S13). For example, the guidance voice output unit 103 outputs a voice “Please select work to start”. Next, the guidance voice output unit 103 reads the work list information associated with the worker from the storage unit 113. The work list information includes work name and work order information. Further, the guidance voice output unit 103 reads the work status of each work included in the work list information from the work performance log DB 116 (completed, working, not started). The guidance voice output unit 103 selects work information with the earliest work order among the unfinished works, and outputs a voice for guiding the work. For example, in the example of the work selection screen 304 in FIG. 2, the guidance voice output unit 103 first outputs voice information “Do you want to start work 2”? Further, the work selection processing control unit 109 sets keywords other than the open keyword (“start”, “unnecessary”, “skip”, “cancel”, “trouble”) as acceptable keywords.

  In response to the guidance voice output from the guidance voice output unit 103, the work selection processing control unit 109 waits for the voice input of the worker. When the worker speaks a keyword, the voice input unit 101 inputs the voice information (step S14) and outputs it to the voice recognition unit 102. The voice recognition unit 102 recognizes voice information and outputs a recognition result to the work selection processing control unit 109. The voice recognition log recording unit 105 records the items described in FIG. 3 in the voice recognition log DB 115 (step S15).

  Next, the work selection process control unit 109 determines whether or not the voice has been recognized (step S16). Specifically, the work selection processing control unit 109 is a predetermined keyword (“start”, “unnecessary”, “skip”, “cancel”, “cancel”) in which the recognition result by the voice recognition unit 102 is associated with the work selection process. If it is any of “trouble”), it is determined that the voice has been recognized. If the recognition result is not included in the predetermined keyword, the work selection processing control unit 109 determines that the voice has not been recognized.

  When it is determined that the voice cannot be recognized, the work selection processing control unit 109 instructs the guidance voice output unit 103 to output voice information that prompts re-input. The guidance voice output unit 103 outputs a voice such as “Please speak again if it could not be recognized” (step S17). In this case, the process from step S14 is repeated.

  If it is determined that the voice has been recognized (step S16; Yes), the work selection process control unit 109 switches the process according to the recognized keyword (step S18).

(skip)
When the recognized keyword is “skip”, the work selection processing control unit 109 instructs the confirmation sound output unit 104 to output confirmation sound. The confirmation voice output unit 104 outputs, for example, a confirmation voice “Skip work 2” (step S19). Next, as described with reference to FIG. 3, the voice recognition log recording unit 105 records each time of the voice recognition process for the voice spoken by the worker in the voice recognition log DB 115 (step S20). Next, as described with reference to FIG. 4, the work performance log recording unit 106 associates each information of the keyword “skip” uttered by the worker, the work place, the work machine, the work, and the current time, into the work performance log DB 116. (Step S21).
Subsequently, returning to step S13, the guidance voice output unit 103 selects work information having the next work order among the unfinished works, and outputs a guidance voice for guiding the work. In the example of FIG. 2, when the worker utters “Skip” in response to the guidance voice “Do you want to start work 2”, the guidance voice output unit 103 starts the guidance voice “Do you start work 3?” Is output.

(Not required)
When the recognized keyword is “unnecessary”, the work selection processing control unit 109 performs a process of deleting the work from the work list for the work output last in step S13 (step S22). Specifically, the work selection processing control unit 109 reads work list information associated with a worker from the storage unit 113, and deletes the work to be deleted from the work included in the work list information. Next, the confirmation voice output unit 104 outputs, for example, a confirmation voice “Delete work 2” (step S23). Next, the voice recognition log recording unit 105 records each time of the voice recognition process for the voice uttered by the worker in the voice recognition log DB 115 (step S24). Next, the work performance log recording unit 106 records information such as the keyword “unnecessary” uttered by the worker, the work location, the current time, and the like in the work performance log DB 116 (step S25). Next, the process after step S13 is repeated.

(Trouble)
When the recognized keyword is “trouble”, the work selection processing control unit 109 instructs the recording unit 107 to start recording. The recording unit 107 starts recording (step S26). The recording unit 107 records the recorded audio information in the storage unit 113. The process control unit 108 sets the process to the recording process. Next, when the worker speaks “open”, the recording unit 107 sets an end instruction keyword (“end”) as a keyword that can be accepted. Next, when the worker utters “end”, the voice input unit 101 inputs the voice information and outputs the voice information to the voice recognition unit 102. The voice recognition unit 102 recognizes voice information and outputs the recognition result to the recording unit 107. The recording unit 107 inputs an end instruction keyword (step S27). The recording unit 107 ends the recording (step S28). The processing process control unit 108 sets the processing process as a work selection process. Next, the process after step S13 is repeated.

(Cancel)
When the recognized keyword is “cancel”, the work selection processing control unit 109 outputs information indicating that “cancel” has been input to the processing process control unit 108. The processing process control unit 108 sets the processing process as a work place selection process.

(Start)
When the recognized keyword is “start”, the work selection processing control unit 109 selects work information (“work 2”), and instructs the confirmation voice output unit 104 to output a confirmation voice of the selected work information. The confirmation voice output unit 104 outputs, for example, a confirmation voice saying “I will start work 2” (step S29). Next, the voice recognition log recording unit 105 records each time of the voice recognition process for the voice “start” uttered by the worker in the voice recognition log DB 115 (step S30). Next, the work record log recording unit 106 records information such as the keyword “start” uttered by the worker, the work, the work place, and the current time in the work record log DB 116 (step S31). This is the end of the work selection process.

  Here, after step S31, before starting the work, the worker may again perform a confirmation process as to whether or not the content of the voice output in step S29 is correct. For example, the worker inputs a confirmation result as to whether or not the content of the voice is correct. If it is correct, for example, it is determined that the worker speaks “start” again, and if not correct, speaks “cancel”. When “cancel” is uttered, the work selection process control unit 109 may repeat the process from step S13, for example. When “start” is spoken, the process of the work selection process ends. When the work selection process ends, the processing process control unit 108 sets the processing process as a work execution process.

FIG. 6 is a flowchart showing an example of work selection processing in the first embodiment according to the present invention.
With reference to FIG. 6, the process flow of the work execution process will be described.
As a premise, the work selection process is completed, and the start time for the work selected by the worker is recorded in the work performance log DB 116.
The work record recording control unit 110 waits for input of the start instruction keyword “open”. When the worker speaks “open”, the voice input unit 101 inputs the voice information (step S41) and outputs the voice information to the voice recognition unit 102. The voice recognition unit 102 recognizes voice information and outputs a recognition result to the work record recording control unit 110. The work record recording control unit 110 determines whether or not the recognition result is the start instruction keyword “open” (step S42). When the start instruction keyword is not “open” (step S42; No), the processing from step S41 is repeated. When the start instruction keyword is “open” (step S42; Yes), the work record recording control unit 110 instructs the confirmation voice output unit 104 to output the name of the work in progress. The confirmation voice output unit 104 outputs the confirmation internal voice (step S43). For example, the confirmation voice output unit 104 outputs a voice “work 2 is in progress”. Next, the work record recording control unit 110 sets keywords other than the open keyword (“complete”, “suspend”, “break”, “cancel”, “trouble”) as acceptable keywords.

  In response to the confirmation voice output from the confirmation voice output unit 104, the work record recording control unit 110 waits for the worker's voice input. When the worker speaks a keyword, the voice input unit 101 inputs the voice information (step S44) and outputs it to the voice recognition unit 102. The voice recognition unit 102 recognizes voice information and outputs a recognition result to the work record recording control unit 110. Further, the voice recognition log recording unit 105 records each time of the voice recognition processing process on the voice uttered by the worker in the voice recognition log DB 115 (step S45).

  Next, the work record recording control unit 110 determines whether or not the voice has been recognized (step S46). Specifically, the work record recording control unit 110 uses predetermined keywords (“complete”, “suspend”, “break”, “restart”, “restart”, “restart”, “ If “cancel” or “trouble”), it is determined that the voice has been recognized. If the recognition result is not included in the predetermined keyword, the work record recording control unit 110 determines that the voice has not been recognized.

  When it is determined that the voice has not been recognized, the work record recording control unit 110 instructs the guidance voice output unit 103 to output voice information that prompts re-input. The guidance voice output unit 103 outputs a voice such as “Please speak again if it could not be recognized” (step S47). In this case, the processing from step S44 is repeated.

  When it is determined that the voice can be recognized (step S46; Yes), the work record recording control unit 110 switches processing according to the recognized keyword (step S48).

(Cancel)
When the recognized keyword is “skip”, the work record recording control unit 110 instructs the guidance voice output unit 103 to output the guidance voice. The guidance voice output unit 103 outputs, for example, a guidance voice “Return to work selection” (step S49). Next, the voice recognition log recording unit 105 records each time of the voice recognition processing process for the voice “skip” uttered by the worker in the voice recognition log DB 115 (step S50). Next, the work record log recording unit 106 records the keyword “skip” uttered by the worker, the work place, the work machine, the work, and the current time in association with each other and records them in the work record log DB 116 (step S51). The work record recording control unit 110 outputs information indicating cancellation of the process of the work execution process to the process process control unit 108. The processing process control unit 108 sets the processing process as a work execution process.

(Suspension or trouble)
When the recognized keyword is “interruption” or “trouble”, the work record recording control unit 110 instructs the confirmation sound output unit 104 to output confirmation sound. The confirmation voice output unit 104 outputs, for example, a confirmation voice “Work 2 is interrupted” (step S52). Next, the voice recognition log recording unit 105 records each time of the voice recognition process for the voice uttered by the worker in the voice recognition log DB 115 (step S53). Next, the work performance log recording unit 106 records information such as the keyword “interruption” or “trouble” uttered by the worker, the work location, the current time, and the like in the work performance log DB 116 (step S54).

  Next, the work record recording control unit 110 determines whether or not the recognized keyword is “trouble” (step S55). When the recognized keyword is not “trouble” (step S55; No), the work record recording control unit 110 outputs information indicating interruption of the work to the processing process control unit 108. The processing process control unit 108 sets the processing process as a work selection process. In the work selection process, the display control unit 111 displays the work selection screen 304 in FIG. For example, when the work is interrupted and the user returns home, the worker performs a touch operation on “logout” on the work selection screen 304 and then turns off the power of the work record recording apparatus 10. You may go. In the work record log DB 116, the start time and the suspension time for the suspended work are recorded.

  When the recognized keyword is “trouble” (step S55; Yes), the work record recording control unit 110 instructs the recording unit 107 to start recording. The recording unit 107 starts recording (step S56). The recording unit 107 records the recorded audio information in the storage unit 113. The process control unit 108 sets the process to the recording process. Next, when the worker speaks “open”, the recording unit 107 sets an end instruction keyword (“end”) as a keyword that can be accepted. Next, when the worker utters “end”, the voice input unit 101 inputs the voice information and outputs the voice information to the voice recognition unit 102. The voice recognition unit 102 recognizes voice information and outputs the recognition result to the recording unit 107. The recording unit 107 inputs an end instruction keyword (step S57). The recording unit 107 ends the recording (step S58). The recording unit 107 outputs information indicating the completion of the recording process to the processing step control unit 108. The processing process control unit 108 sets the processing process as a work selection process.

(Break, resume)
When the recognized keyword is “break”, the guidance voice output unit 103 outputs, for example, a guidance voice saying “I will break work 2” (step S59). Further, when the recognized keyword is “restart”, the guidance voice output unit 103 outputs a guidance voice saying “work 2 is resumed”, for example.
When the recognized keyword is “break”, the work record recording control unit 110 changes “rest” to “resume” among the acceptable keywords. When the recognized keyword is “restart”, the work record recording control unit 110 changes “restart” to “break” among the keywords that can be accepted.
Next, the voice recognition log recording unit 105 records each time of the voice recognition processing process for the keyword (“rest” or “resume”) spoken by the worker in the voice recognition log DB 115 (step S60). Next, the work record log recording unit 106 records information such as a keyword (“break” or “restart”) spoken by the worker, a work place, and the current time in the work record log DB 116 (step S61). When the recognized keyword is “break” or “resume”, the process from step S41 is repeated when the process of step S61 is completed.

(Completed)
When the recognized keyword is “completed”, the confirmation voice output unit 104 outputs a confirmation voice, for example, “Complete work 2” (step S62). Next, the voice recognition log recording unit 105 records each time of the voice recognition process for the voice “completed” uttered by the worker in the voice recognition log DB 115 (step S63). Next, the work record log recording unit 106 records information such as the keyword “complete” uttered by the worker, the work place, and the current time in the work record log DB 116 (step S64). The work record recording control unit 110 outputs information indicating the completion of work to the processing process control unit 108. The processing process control unit 108 sets the processing process as a work selection process.
Here, when the worker proceeds to the next work, the work to be performed next is selected according to the flowchart of FIG.

  According to the present embodiment, the worker can input the work record without looking at the display screen of the work record recording device 10 by giving a voice instruction. In addition, since the recognizable keywords are limited for the voice to be input, the operator does not need to give a complicated voice instruction, and erroneous input can be suppressed. In addition, the work record recording apparatus 10 does not need to distinguish and recognize many types of keywords, so that the possibility of erroneous recognition can be reduced. In addition, the work record recording device 10 outputs a voice including the keyword spoken by the worker so that the worker can recognize whether or not the keyword is correctly recognized, and the work can be performed in a state where the keyword is erroneously recognized. The possibility that the record information is recorded can be reduced. In addition, the keyword recognition rate can be evaluated by analyzing the voice recognition log recorded by the work record recording apparatus 10. A keyword with a low recognition rate can be changed to a similar keyword to improve the recognition rate, thereby improving the operability of the worker. In addition, regarding the input operation necessary for recording the work record performed by the worker on the work record recording device 10, an operation in a situation where a manual input is possible (login, work place selection, machine selection) With respect to the above, an interface for accepting an operation by manual input is provided, and an interface for voice input is provided for an operation in a situation where a manual input is expected to be troublesome, so that the input operation is efficient. Furthermore, since an interface for manual input is also prepared for operations in a scene where voice input is possible, input of work results can be continued even in a situation where voice input does not work well. In addition, since the recording function can be activated, the situation at the site can be recorded by voice when trouble occurs on the site. Further, daily man-hour management, attendance management, and the like for each worker may be performed based on the work results input by voice.

FIG. 7 is a diagram showing an example of a hardware configuration of the work record recording system in the first embodiment according to the present invention.
The computer 900 includes a CPU 901, a main storage device 902, an auxiliary storage device 903, an input / output interface 904, and a communication interface 905.
The above-described work record recording apparatus 10 is mounted on the computer 900. The operation of each processing unit described above is stored in the auxiliary storage device 903 in the form of a program. The CPU 901 reads a program from the auxiliary storage device 903, develops it in the main storage device 902, and executes the above processing according to the program. In addition, the CPU 901 ensures a storage area corresponding to the storage unit 113 in the main storage device 902 according to the program. In addition, the CPU 901 ensures a storage area for storing data being processed in the auxiliary storage device 903 according to the program. The computer 900 may be connected to the microphone 20, the speaker 30, or a hands-free microphone (not shown) via the input / output interface 904.

The computer 900 may be connected to a computer 910 such as a PC or a server terminal device via a communication interface 905. For example, the computer 900 may transmit voice recognition data stored in the main storage device 902 and work performance data stored in the main storage device 902 to the computer 910. For example, the computer 910 aggregates the work results based on the work result data. For example, the computer 910 analyzes a voice recognition rate, a response, and the like based on the voice recognition data.
Further, although the embodiment has been described by taking the case where the computer 900 is a mobile terminal device such as a smartphone as an example, it may be a PC, a server terminal device, or the like. In addition, the work results may be aggregated by the computer 900. In addition, the computer 910 may include some of the functions of the computer 900.

  In at least one embodiment, the auxiliary storage device 903 is an example of a tangible medium that is not temporary. Other examples of the tangible medium that is not temporary include a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, and a semiconductor memory connected via the input / output interface 904. When this program is distributed to the computer 900 via a communication line, the computer 900 that has received the distribution may develop the program in the main storage device 902 and execute the above processing.

  The program may be for realizing a part of the functions described above. Further, the program may be a so-called difference file (difference program) that realizes the above-described function in combination with another program already stored in the auxiliary storage device 903.

  In addition, it is possible to appropriately replace the components in the above-described embodiments with known components without departing from the spirit of the present invention. The technical scope of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention. For example, the selection of the work place and the machine may be performed by voice.

DESCRIPTION OF SYMBOLS 10 ... Work performance recording device 101 ... Voice input part 102 ... Voice recognition part 103 ... Guidance voice output part 104 ... Confirmation voice output part 105 ... Voice recognition log recording part 106 ... Work record log recording unit 107 ... recording unit 108 ... processing process control unit 109 ... work selection process control unit 110 ... work result record control unit 111 ... display control unit 112 ... on Output unit 113 ... storage unit 114 ... keyword DB
115 ... Voice recognition log DB
116 ... Work result log DB
117 ... Login processing unit 20 ... Microphone 30 ... Speaker 900 ... Computer 901 ... CPU
902 ... Main storage device 903 ... Auxiliary storage device 904 ... Input / output interface 905 ... Communication interface 910 ... Computer

Claims (11)

A voice input unit for inputting voice;
A voice recognition unit for recognizing a predetermined keyword included in the voice input by the voice input unit;
Based on the recognition of the keywords for instructing the start and end of the work among the predetermined keywords, the work start time, the work end time, and the work start time to the end time are recognized. A work result log recording unit for recording a work result log including the keyword,
Work performance recording system with A processing step control unit that controls processing steps related to recording of work performance logs including a plurality of processing steps to be executed in a predetermined order based on the keywords recognized by the voice recognition unit;
Further comprising
The voice recognition unit recognizes a predetermined keyword corresponding to the processing step;
The work record recording system according to claim 1. The processing process control unit switches between a work selection process for selecting a work for recording work performance and a work execution process for recording the work performance log among the plurality of processing processes based on the recognition of the keyword. ,
The work record recording system according to claim 2. In the work execution step, in accordance with the keyword recognized by the voice recognition unit, the keyword input to the guidance voice is instructed to output a guidance voice that guides a candidate for a work that records work results among a plurality of works. A work selection processing control unit that selects work information for recording work results,
Further comprising
The work record recording system according to claim 3. In the work execution step, a work record recording control unit that controls a recording operation of the work record according to a keyword corresponding to a work situation recognized by the voice recognition unit;
Further comprising
The work performance recording system according to claim 3 or 4. The processing step control unit sets a processing step to be executed to another processing step to be executed before a current processing step based on recognition of a keyword that instructs cancellation of the processing by the voice recognition unit.
The work record recording system according to any one of claims 2 to 5. A confirmation voice output unit for outputting a recognition result by the voice recognition unit for the keyword input by the voice input unit;
The work performance recording system according to any one of claims 1 to 6, further comprising: A voice recognition log recording unit for recording a recognition result by the voice recognition unit;
The work record recording system according to any one of claims 1 to 7, further comprising: A recording unit that starts recording based on the keyword recognized by the voice recognition unit;
The work performance recording system according to any one of claims 1 to 8, further comprising: Work record system
Enter your voice,
Recognizing a predetermined keyword included in the input voice,
Based on the recognition of the keywords for instructing the start and end of the work among the predetermined keywords, the work start time, the work end time, and the work start time to the end time are recognized. A work result log including the keyword,
Work record recording method. The computer of the work record system
Means for inputting voice,
Means for recognizing a predetermined keyword included in the input voice;
Based on the recognition of the keywords for instructing the start and end of the work among the predetermined keywords, the work start time, the work end time, and the work start time to the end time are recognized. Means for recording a work result log including the keyword,
Program to function as.

Images