JP2002023791A - Speech recognition system on construction equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible for a speech recognition system to contribute to improve the work efficiency of construction machinery without burdening an excessive load on an operator, by making it possible to replace various switch operations for an operation panel and auxiliary machinery with command inputs by speech, in construction machinery such as a hydraulic shovel. SOLUTION: A construction machine is provided with an operation panel 60, sensors 67 for detecting a driving status, a display monitor 10, and a display control part 70 for receiving outputs from the operation panel 60 or detection results by the sensors 67 and performing desired displays on the monitor 10, and is also arranged to comprise a microphone 61, a loudspeaker 62, a speech recognition part 71 for speech-recognizing the speech command inputted from the microphone 61, a decision part 72 for deciding processing contents corresponding to the recognition command based on the recognition command recognized by the speech recognition part 71, and a speech display control part 73 for making the loudspeaker 62 perform desired speech displays by speech synthesis.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice recognition system for a construction machine such as a hydraulic excavator for digging the ground.

[0002]

2. Description of the Related Art Generally, a construction machine such as a hydraulic shovel has an upper revolving structure 100 having a driving operation room (cabin) 600 on a lower traveling structure 500 having an endless track section 500A as shown in FIG. And the upper revolving superstructure 1
00, boom 200, stick 300, bucket 4
It is equipped with an articulated arm mechanism consisting of 00.

The boom drive hydraulic cylinders 120,
The stick driving hydraulic cylinder 121 and the bucket driving hydraulic cylinder 122 are usually
00 is operated by an operation lever (not shown) (this operation lever is also referred to as a joystick) provided in the apparatus. By the way, conventional construction machines can display information that the operator wants to know (for example, engine speed, hydraulic oil temperature, etc.), and can notify an abnormality of the machine, and an air conditioner (hereinafter, referred to as an air conditioner). "Air conditioner"
, Radios, lights, wipers, etc.

For this reason, conventionally, FIGS. 7 (a) and 7 (b)
As shown in the figure, various sensors 701 that can detect information that the operator wants to know, such as the engine speed and hydraulic oil temperature, an operation panel with a keypad 702 that performs an operation for displaying the information that the operator wants to know, Are provided with various switches 703 for operating various auxiliary machines 706, a monitor 704 for display, and a speaker 705 for alarm notification, and further, signals from various sensors 701 and an operation panel 702 are input. When done
An electronic control unit (computer) 707 for displaying information desired by an operator, such as the engine speed and the operating oil temperature, on the monitor 704 and issuing an alarm through the speaker 705 is provided according to the situation.

[0005]

However, in a conventional construction machine, the operator must operate the operation panel 702 in order to display information (eg, engine speed, hydraulic oil temperature, etc.) that the operator wants to know. In addition, in order to operate various accessories 706 such as an air conditioner, a radio, lights, a wiper, etc., it is necessary to operate various switches 703 for operating various accessories. Such an operation must be performed by the operator releasing the operating lever, and during this operation, the actual work such as excavation is interrupted, and the work efficiency may be reduced. While the operator operates the body with one hand, the operation panel 7 with the other hand is used.
02 and various switches 703 may be operated, and in such a case, an excessive load may be imposed on the operator.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and the operation of various switches for an operation panel and auxiliary equipment can be replaced with a command input by voice, thereby imposing an excessive burden on an operator. An object of the present invention is to provide a speech recognition system in a construction machine, which can contribute to improvement in work efficiency of the construction machine without forcing.

[0007]

According to a first aspect of the present invention, there is provided a voice recognition system for a construction machine according to the present invention, wherein an input operation section for executing an input operation and an operation state of the construction machine are detected in the construction machine. And a display unit for performing a desired display according to the output from the input operation unit or the detection result at the detection unit, and receiving the output from the input operation unit or the detection result at the detection unit. A voice command input unit for inputting a voice command, a voice display unit for performing voice display, and a voice command input from the voice command input unit; A voice recognizing unit for recognizing a voice, a determining unit for determining a processing content corresponding to the recognition command based on the recognition command recognized by the voice recognizing unit, and a display control unit. And a voice display control unit for causing the voice display unit to perform a desired voice display by voice synthesis in accordance with the content determined by the determination unit in preference to the display by the display control unit. It is characterized by:

In the voice recognition system for a construction machine according to claim 1, an abnormality detection unit for detecting an abnormality in an operation state of the construction machine from a detection result of the detection unit,
An abnormality notification unit that notifies an abnormality of the operation state of the construction machine; and if the abnormality detection unit detects an abnormality, the display control unit notifies the abnormality notification unit of the abnormality of the operation state of the construction machine. In addition, the voice display control unit may cause the voice display unit to notify the abnormality of the operation state of the construction machine by voice synthesis (claim 2).

According to a third aspect of the present invention, there is provided a voice recognition system for a construction machine according to the present invention, wherein a voice command input unit for inputting a voice command, a voice display unit for performing voice display, and the voice command input are provided. A voice recognition unit for recognizing a voice command input from the unit, a determination unit for determining processing content corresponding to the recognition command based on the recognition command recognized by the voice recognition unit, and a determination by the determination unit It is characterized by comprising a voice display control unit for causing the voice display unit to display a desired voice by voice synthesis according to the content.

According to the third aspect of the present invention, in the voice recognition system for a construction machine according to the present invention, a detection unit for detecting an operation state of the construction machine, and an abnormality in the operation state of the construction machine based on a result detected by the detection unit. And an abnormality detection unit for detecting the abnormality, wherein when the abnormality detection unit detects an abnormality, the voice display control unit causes the voice display unit to notify the abnormality of the operation state of the construction machine by a synthetic voice. (Claim 4).

Further, in the voice recognition system for a construction machine according to any one of claims 1 and 3, the determination unit stores a processing content to be performed corresponding to each of the plurality of commands. It may be configured to include a search unit for searching the storage content of the storage unit based on the recognized recognition command (claim 5).

[0012]

Embodiments of the present invention will be described below with reference to the drawings. As shown in FIG. 2, the hydraulic excavator as a construction machine according to the present embodiment includes an upper revolving superstructure (construction machine main body) 100 having a driving operation room 600 on a lower traveling body 500 having an endless track portion 500A on the left and right.
Are provided rotatably in a horizontal plane.

Then, with respect to the upper revolving superstructure 100,
A boom (arm) 200 having one end rotatably connected thereto is provided, and a stick (arm) 30 having one end rotatably connected to the boom 200 via a joint.
0 is provided. Further, there is provided a bucket (working member) 400 having one end rotatably connected to the stick 300 via a joint, and a tip excavating the ground and capable of storing earth and sand therein. This bucket 4
00 is detachably provided to the stick 300, and another work member (for example, an attachment such as a hammer or a shear) can be attached instead of the bucket 400.

As described above, in the present embodiment, the boom 20
The articulated arm mechanism is constituted by the 0, the stick 300, and the bucket 400. A boom driving hydraulic cylinder 120, a stick driving hydraulic cylinder 121, and a bucket driving hydraulic cylinder 122 (hereinafter referred to as boom driving hydraulic cylinders 12) as cylinder type actuators.
0 may be referred to as the boom cylinder 120 or simply the cylinder 120, the stick driving hydraulic cylinder 121 may be referred to as the stick cylinder 121 or simply the cylinder 121, and the bucket driving hydraulic cylinder 122 may be referred to as the bucket cylinder 122 or simply the cylinder 122. Is provided).

Here, one end of the boom cylinder 120 is rotatably connected to the upper swing body 100, and the other end is rotatably connected to the boom 200. That is, the boom cylinder 120 is interposed between the upper swing body 100 and the boom 200, and the distance between the ends expands and contracts, so that the boom 200 is moved to the upper swing body 1
00 can be rotated.

The stick cylinder 121 has one end rotatably connected to the boom 200 and the other end rotatably connected to the stick 300. That is, the stick cylinder 121 is interposed between the boom 200 and the stick 300, and can rotate the stick 300 with respect to the boom 200 by expanding and contracting the distance between the ends.

The bucket cylinder 122 has one end rotatably connected to the stick 300 and the other end rotatably connected to the bucket 400. That is, the bucket cylinder 122 is interposed between the stick 300 and the bucket 400, and can rotate the bucket 400 with respect to the stick 300 by expanding and contracting the distance between the ends. Note that a link mechanism 130 is provided at the tip of the bucket hydraulic cylinder 122.

As described above, each of the cylinders 120 to 12
2, a cylinder-type actuator mechanism having a plurality of cylinder-type actuators for driving the arm mechanism by performing an extension / contraction operation is configured. Although not shown, a hydraulic motor that drives the left and right endless track portions 500A and a turning motor that drives the upper turning body 100 to turn are also provided.

A hydraulic circuit is provided for the cylinders 120 to 122, the hydraulic motor and the swing motor, and the hydraulic circuit includes a pump and a pump driven by an engine mounted in the upper swing body 100. A main control valve (main control valve) and the like are interposed. A pilot hydraulic circuit is provided for controlling the main control valve. The pilot hydraulic circuit includes a pilot pump driven by an engine, electromagnetic proportional valves 3A, 3B, 3C, an electromagnetic switching valve, and the like. Is interposed.

By controlling the main control valve via the electromagnetic proportional valves 3A, 3B and 3C, the boom 20 is controlled.
A controller (control means) 1 is provided as an electronic control device for controlling the 0, the stick 300, and the bucket 400 to have a desired telescopic displacement. The controller 1 includes a microprocessor, a memory such as a ROM and a RAM, and an appropriate input / output interface.

Detection signals (including setting signals) from various sensors are input to the controller 1. The controller 1 controls each cylinder 120 based on the detection signals from these sensors. , 121,1
22 control, for example, control in the heavy lift operation mode or the normal lift operation mode, control to reduce the engine speed when the operation lever is in neutral, automatic traveling second speed switching control, aircraft condition test mode control or display on the monitor Various controls such as control, voice display control, and alarm display control can be executed.

The engine controller 27 receives the information on the engine speed from the engine speed sensor 23 and controls the engine. The engine controller 27 can exchange cooperative information with the controller 1.
That is, the engine speed information from the engine speed sensor 23 is also supplied to the controller 1 via the engine controller 27.

The electromagnetic proportional valves 3A to 3C receive a control signal from the controller 1 and control the hydraulic pressure supplied from the pilot pump. By applying this hydraulic pressure to the main control valve, The spool position of the main control valve is controlled. Note that these electromagnetic proportional valves 3A to 3C are also used when performing an override function used for the purpose of testing the condition of the aircraft.

Incidentally, the rotation speed of the engine differs depending on the position of the engine throttle set by the operator. Further, even if the engine throttle is constant, the rotation speed of the engine changes depending on the load. Since the pump is directly connected to the engine, when the engine speed changes,
Since the pump discharge amount also changes, even if the spool position of the main control valve is constant, the cylinder speed changes according to the change in the engine speed. Therefore, an engine rotation speed sensor 23 is attached to the engine to correct this. The detection result of the engine speed sensor 23 can be displayed on the monitor 10.

The oil temperature sensor 25 detects the oil temperature of the hydraulic circuit, and the result detected by the oil temperature sensor 25 can be displayed on the monitor 10. Monitor 10
Can display the detection results of the engine rotation speed sensor 23 and the oil temperature sensor 25, as described above, and can also display the setting status of the memory in the controller 1 (information on attachments such as work members). is there.

Reference numeral 6 in FIG. 2 denotes an operating lever (joystick) for operating a boom, bucket, and stick. In the figure, the operating lever is depicted as one, but actually, this operation is performed. There are a plurality of levers. By the way, as described above, the construction machine according to the present embodiment includes the control in the heavy lift operation mode or the normal lift operation mode, the control to reduce the engine speed when the operation lever is neutral, the automatic traveling second speed switching control, and the body condition test mode. Although control or display control on the monitor 10 can be performed, voice display control and alarm display control can also be executed.

The construction machine according to the present embodiment also has
Various accessories such as an air conditioner, a radio, lights, and a wiper are provided, and various switches for operating these various accessories are provided. In the present embodiment, operation signals from the various switches are transmitted to the controller 1. Therefore, the various auxiliary machines are controlled by the controller 1.

FIG. 1 is a main control block diagram for control performed through an operation panel with a keypad and a voice input microphone. As shown in FIG. Various sensors as a detection unit for detecting the operating state of the machine (various sensors include:
The sensor includes an engine speed sensor 23, a sensor (not shown) for detecting a disconnection or a battery short-circuit, and the like. An operation panel 60 with a keypad as an input operation unit for executing operations, a microphone 61 for voice input as a voice command input unit for inputting voice commands, and various switches 66 for operating various auxiliary machines are connected.

On the output side of the controller 1, outputs from the operation panel 60 with a keypad and various sensors 6 are provided.
7, a monitor 10 as a display unit for performing display in accordance with the detection result, a speaker 62 as an audio display unit for performing audio display, and a control valve such as an electromagnetic proportional valve or an on / off valve (also in this case, an electromagnetic proportional valve or an on / off valve). When a control valve is used as a representative of a valve or the like, a control valve is denoted by reference numeral 68) and various auxiliary devices 65 are connected.

Here, the operation panel 60 with a keypad
Is to set the operation mode to select either the heavy lift operation mode or the normal lift operation mode described above, to set the control method such as lowering the engine speed when the operation lever is neutral, and to switch to the automatic traveling second speed switching control. The switch 1 is set or the operation for instructing the aircraft condition test mode is performed using the keypad. When the setting instruction is input through the operation panel 60 with the keypad, the controller 1 By controlling the state of the hydraulic pressure (including the pilot hydraulic pressure) of the hydraulic circuit using signals from required sensors, switches, and the like, the cylinder 120
To 122, the above-described traveling hydraulic motor, the turning motor, and the like, so that control in a desired mode can be executed.

The voice input microphone 61 functions as a voice command input unit for inputting a voice command (a voice command is a voice command, and the voice command will be described later). The input audio signal is input to the controller 1. As the microphone 61 for voice input, a hand-free type that allows both hands of the operator to be used is used.

The speaker 62 is used for notifying an alarm (for displaying an alarm) and for notifying with a synthesized voice (for displaying a voice).
Used as The monitor 10, the operation panel 60 with a keypad, the microphone 61 for voice input,
The speaker 62 is provided together with the operation lever 6 in the operation room 60
0 is provided.

Further, the controller 1 includes a display control unit 70, a voice recognition unit 71, a determination unit 72, a voice display control unit 73, a voice synthesis unit 74, a valve control unit 75, and an accessory control unit 7.
6. The function of the abnormality detecting unit 77 is provided.
Here, the display control unit 70 receives a result of detection by various sensors 67 or an output from the operation panel 60 with a keypad and causes the monitor 10 to perform a desired display, and also has a conventional construction machine. Is what it is.

The voice recognition unit 71 is for automatically recognizing a command in voice input from the microphone 61. For example, a computer analyzes an input voice signal acoustically and obtains a similarity to a characteristic parameter obtained by the analysis. Is calculated, and some phonemes are optimally arranged to output candidates as words and sentences, thereby performing speech recognition. As such a speech recognition technique, a known technique is used.

The deciding section 72 decides processing contents corresponding to the recognition command based on the recognition command recognized by the speech recognition section 71, and includes a plurality of commands and processing contents to be performed corresponding to each command. And a search unit (search engine) 72B for searching the storage contents of the storage unit 72A based on the recognition command recognized by the speech recognition unit 71.

The audio display control unit 73 controls the speaker 62 as an audio display unit in accordance with the content determined by the determination unit 72 in parallel with the display by the display control unit 70 or in preference to the display by the display control unit 70. A desired voice is displayed by voice synthesis. For this purpose, a voice synthesizer 74 is provided on the output side. The voice synthesizing section 74 synthesizes voice by software on a computer based on an instruction from the voice display control section 73, and a known voice synthesizing technique is used.

The valve control section 75 controls the control valve 68 in response to signals from the various sensors 67 and the operation panel 60 with a keypad and instructions from the voice display control section 73. To execute the override function as a mode, the operation panel 6 with a keypad is required.
An instruction is input from 0 or by an instruction from the voice display control unit 73 based on a voice command input.

The accessory control unit 76 controls various accessories 65 in response to an instruction from the audio display control unit 73 based on an operation signal from various switches 66 and a voice command input. The abnormality detection unit 77 detects an abnormality in the operation state of the construction machine, such as a disconnection, a short circuit of the battery, or an abnormal rise in the oil temperature, based on signals from the various sensors 67. Upon detection, the display control unit 70 controls the monitor 10 and the speaker 62 as an abnormality notification unit.
, And the voice display control unit 73 causes the speaker 62 to notify the speaker 62 of the abnormality in the operation state of the construction machine by voice synthesis.
That is, the display control unit 70 receives the detection results from the various sensors 67 or the output from the operation panel 60 with a keypad, and causes the monitor 10 to perform a desired display. Upon detection, the monitor 10 and the speaker 62 also have a function of notifying the abnormality of the operation state of the construction machine. Further, in addition to the function of causing the speaker 62 to perform a desired voice display by voice synthesis, the voice display control unit 73 also
The speaker 62 also has a function of notifying the abnormality of the operation state of the construction machine by voice synthesis.

Next, the operation of the above-described speech recognition system in the construction machine according to the present embodiment will be described. In the present embodiment, the operation of the operation panel 60 and the various switches 66 for auxiliary equipment can be replaced with the input by the voice command through the microphone 61. It is necessary to perform a matching process of a corresponding process by inputting a voice command. This process is called an initial matching process.

That is, in this initial matching process, as shown in FIG.
The operator inputs a command by voice through, performs voice recognition processing on the command by voice (voice command) (step A2), and recognizes the recognized command (the recognized command is referred to as a “recognized command”). (Step A3).

As the matching processing in step A3, a method of storing the recognition command as it is in a required address portion of the storage unit 72A and associating the recognition command with a corresponding processing, and an initial matching processing, A plurality of commands and processing contents to be performed corresponding to the respective commands are stored in advance in the storage unit 72A in association with each other, and the storage contents of the storage unit 72A are searched using the search unit 72B, and the voice recognition unit 71 is searched. There is a method of searching for a command that matches the recognition command recognized in step (1) and adjusting the recognition rate so that the recognition rate is equal to or higher than the recognition normal setting value.

Thus, prior to use of the present voice recognition system, there is provided an initial matching processing means for inputting a voice command and performing matching processing of a corresponding process. After performing the initial matching processing in this way, the present speech recognition system is operated on an actual machine.

That is, as shown in FIG. 4, first, in step B1, N = 0 (N is an integer of 0 or more) is initialized, and then in step B2, the input operation unit (operation panel 6
It is determined whether or not there is an input according to 0), and if so, a display corresponding to the input operation on the input operation unit (operation panel 60) is displayed on the monitor 10 (step B3). This processing is the same as the conventional processing.

In step B2, if there is no input from the input operation unit (operation panel 60), it is determined in step B4 whether or not a voice command has been input. A voice recognition process is performed, and in step B6, it is determined whether or not voice recognition has been successfully performed.
Then, the contents stored in the storage unit 72A are searched for a command that matches the recognition command (step B7). Thereafter, if a command corresponding to the recognition command is found (YES route in step B7), the processing content corresponding to this command is determined (step B8). Thereafter, the voice display control unit 73 causes the voice synthesis unit 74 to perform voice display of the found command by voice synthesis (step B9). This allows the operator to confirm that the input voice command has been correctly recognized.

After that, the processing contents corresponding to the found command are executed by the valve control unit 75 and the accessory control unit 76 according to the contents of the command while receiving the information from the voice display control unit 73 (step S1). B10). Note that, even when there is an input from the operation panel 60, the valve control unit 75 and the auxiliary device control unit 76 receive an instruction signal from the operation panel 60 and perform a process corresponding to the operation content (step B1).
0).

Thus, for example, it is conceivable to perform voice display and processing in the following modes. (1) The operator inputs a command related to information that the operator wants to know (for example, the engine speed, the operating oil temperature, and the setting status of the attachment set in the controller internal memory) by voice through the microphone 61 (for example, “engine speed display”). "), And the contents of the information that the operator wants to know are transmitted to the operator in a synthesized voice by the actions of the voice recognition unit 71, the determination unit 72, the voice display control unit 73, and the voice synthesis unit 74. In this example, the engine speed is read by reading the output of the engine speed sensor and executing software for executing a process for displaying the value in a synthesized voice.

(2) When the operator inputs a command for information relating to a deep hierarchy of the menu system by voice through the microphone 61 (for example, when saying “calibration service”), the voice recognition unit 71, the determination unit 72, and the voice display control By the operation of the unit 73 and the voice synthesizing unit 74, for example, the “calibration service” and the synthesized voice are transmitted to the operator, and the voice recognition unit 7
1, by the operation of the determination unit 72, the voice display control unit 73, etc.
For example, calibration is performed. This allows direct access to the deeper levels of the menu system. Also in this example, software that executes the processing content corresponding to the calibration service (this software corresponds to the conventional software that executes the processing content instructed on the operation panel 60, and corresponds to the command recognized by voice recognition) (To which a function of executing the process is added) is activated to execute the calibration.

(3) When the operator inputs a command relating to switching of the operation mode, control method and setting through the microphone 61 by voice (for example, as a command relating to the operation mode, "heavy lift mode" is uttered,
If the command relating to the control method is "AEC" or the command relating to switching is "automatic second speed switching", the voice recognition unit 71, the determination unit 72, the voice display control unit 73, the voice synthesis unit By the operation of 74, the corresponding content (switching of the operation mode, control method, and setting) is changed to, for example, “heavy lift mode” or “AE
"C" or "automatic second speed switching" to the operator in a synthesized voice, and a voice recognition unit 71 and a determination unit 7
2. Voice display control unit 73, voice synthesis unit 74, valve control unit 7
The contents (“heavy lift mode”, “AEC”, automatic traveling second speed switching) are executed by the action of 5 and the like.
Also in this example, software that executes processing contents corresponding to “heavy lift mode”, “AEC”, and automatic traveling second speed switching (this software is also conventional software that executes the processing contents instructed on the operation panel 60) Ware is added with a function of executing a process corresponding to a command recognized by voice recognition), and the processes of "heavy lift mode", "AEC", and automatic traveling second speed switching are executed. I do.

(4) When an operator inputs a command relating to switch input of various auxiliary machines such as an air conditioner, a radio, lights, a wiper, etc. through the microphone 61 by voice (for example, "air conditioner on", "radio on", or "light on") Such as "wiper on", "air conditioner off", "radio off", "light off", "wiper off"
When the voice recognition unit 71, the determination unit 72, the voice display control unit 73, and the voice synthesis unit 74 operate, the corresponding content is changed to, for example, "air conditioner on", "air conditioner off", "radio on", "radio on". Radio off "," light on "," light off "," wiper on "," wiper off "are transmitted to the operator as synthesized voice, and a voice recognition unit 71, a determination unit 72, a voice display control unit 73, a voice synthesis unit 74, the contents (“air conditioner on / off” or “radio on / off” or “light on / off” or “wiper on / off”) are executed by the operation of the accessory control unit 76 and the like. Air conditioner on,
Start the software that executes the processing corresponding to "Off", "Radio on, off", "Light on, off", or "Wiper on, off" and "Air conditioner on, off" or "Radio on, off" Or "light on, off" or "wiper on, off"
Execute the processing of

(5) When the operator inputs a command relating to the override function by voice through the microphone 61 (for example, when "override" is uttered), the voice recognition unit 71, the determination unit 72, the voice display control unit 73, and the voice synthesis unit 74 By the action, the corresponding contents are transmitted to the operator in the form of, for example, "override" and synthesized voice, and the action of the voice recognition unit 71, the determination unit 72, the voice display control unit 73, the voice synthesis unit 74, the valve control unit 75, etc. And its contents (override function). Also in this example, the software that executes the processing content corresponding to the override function (this software also includes the conventional software that executes the processing content specified by the operation panel 60 and the processing corresponding to the command recognized by the voice recognition) Is started, and the process of the override function is executed.

In this manner, the operation of the operation panel can be replaced with the input by the voice command, so that the operator can obtain the information he wants to know without interrupting the actual work of the machine at all. Since the switch input can be made by voice, it is possible to concentrate on the work, without imposing an excessive burden on the operator. Further, since the work is not interrupted, the work efficiency of the construction machine can be improved.

If voice recognition cannot be performed in step B6 or if a command corresponding to a recognition command cannot be found in step B7, a voice command input is notified again, N is set to N + 1, and the number of retries N is reduced. If it is smaller than N ₀ (N ₀ is a threshold value) (steps B11 to B11)
13), the processing from step B4 to step B6 or step B4 to step B7 is repeated again, and N becomes N
_If it becomes ₀ or more, it is determined that the command input by voice is impossible, and in step B14, the input operation unit (the operation panel 6
The input process according to 0) is notified, and the processes after step B1 are performed.

When the voice cannot be recognized or when the command corresponding to the recognition command and the processing content corresponding to the command cannot be found, the operator can be prompted to input the voice command again. In addition to promptly recognizing a defect, it is also possible to call attention, for example, to make a subsequent voice command input by the operator with an easily recognizable sound.

As shown in FIG. 5, when an abnormality is detected by the abnormality detecting section 77 (step C1), the display control section 70 notifies the monitor 10 and the speaker 62 of the abnormality of the operation state of the construction machine, and outputs a sound. The display control unit 73 causes the speaker 62 to notify the abnormality of the operation state of the construction machine by voice synthesis (step C2). In this example, when an abnormality is detected by the abnormality detection unit 77, software that reads the details of the abnormality and executes processing for displaying the details of the abnormality in a synthesized voice is activated to display the details of the abnormality by voice.

As described above, when an abnormality is detected by the abnormality detecting section 77, not only an alarm sound and an alarm display but also, for example, a "disconnection", a "battery short", or a "hydraulic abnormality"
Or a warning such as "oil temperature abnormality" is issued, so the operator can instantly analyze and judge the abnormality without looking at the display of the details of the abnormality, realizing the operator's calm response in the event of an abnormality Becomes possible.

It should be noted that the display control unit 70 may notify only the monitor 10 of the abnormality in the operation state of the construction machine, and the voice display control unit 73 may cause the speaker 62 to notify the abnormality of the operation state of the construction machine by voice synthesis. Good. Further, the present invention adopts a voice command input method through the microphone 61 in addition to the manual input method using the operation panel 60 with the keypad and the switch 66 which also has the conventional type as in the above-described embodiment. It is also possible to have only a voice command input method through the microphone 61.
In this case, in FIG. 1 described above, the function of the display control unit 70 is deleted from the controller 1 and signal lines from the operation panel 60 and various sensors 67 to the display control unit 70 are connected.
The signal line from the operation panel 60 to the valve control unit 75 and the signal line from the switch 66 to the accessory control unit 76 are deleted. That is, in this case, the controller 1 includes the voice recognition unit 71, the determination unit 72,
Voice display control unit 73, voice synthesis unit 74, valve control unit 75,
It is configured to have the functions of the accessory control unit 76 and the abnormality detection unit 77.

It should be noted that the present invention is not limited to the above-described embodiment, and can be implemented with various modifications without departing from the spirit of the present invention.

[0058]

As described above in detail, according to the voice recognition system for a construction machine of the present invention, the operation by the operation panel can be replaced by the input by the voice command, without imposing an excessive burden on the operator. In addition, there is an advantage that can greatly contribute to improvement of the working efficiency of the construction machine.

When an abnormality is detected by the abnormality detection unit, a warning is issued by voice, so that the operator can instantaneously analyze and judge the abnormality without looking at the display of the contents of the abnormality. Therefore, the operator can take a calm measure in the event of an abnormality.

[Brief description of the drawings]

FIG. 1 is a main part control block diagram of a speech recognition system in a construction machine as one embodiment of the present invention.

FIG. 2 is a schematic configuration diagram of a construction machine having a voice recognition system as one embodiment of the present invention.

FIG. 3 is a flowchart for explaining the operation of one embodiment of the present invention.

FIG. 4 is a flowchart for explaining the operation of one embodiment of the present invention.

FIG. 5 is a flowchart for explaining the operation of one embodiment of the present invention.

FIG. 6 is a perspective view showing a general construction machine.

FIGS. 7A and 7B are block diagrams schematically showing a control system of a conventional construction machine.

[Explanation of symbols]

Reference Signs List 1 controller (control means) 2 external terminal 3A to 3C proportional solenoid valve 6 operation lever 10 monitor (display unit) 23 engine rotation speed sensor 27 engine controller 60 operation panel with keypad (input operation unit) 61 microphone for voice input ( Voice input unit) 62 Speaker (voice display unit) 65 Various accessories 66 Various switches 67 Various sensors 68 Control valve 70 Display control unit 71 Voice recognition unit 72 Decision unit 73 Voice display control unit 74 Voice synthesis unit 75 Valve control unit 76 Supplement Machine control unit 77 Abnormality detection unit 100 Upper revolving superstructure (main body of construction machine) 120 Boom cylinder (Cylinder actuator) 121 Stick cylinder (Cylinder actuator) 122 Bucket cylinder (Cylinder actuator) 130 Link mechanism 200 Boom 300 S Ikku 400 bucket 500 undercarriage 500A caterpillar unit 600 operator cab

Claims (5)

[Claims] 1. A construction machine, comprising: an input operation unit that executes an input operation; a detection unit that detects an operation state of the construction machine; and an output from the input operation unit or a detection result obtained by the detection unit. A display unit for performing a desired display; a display control unit for receiving the output from the input operation unit or the detection result of the detection unit to perform a desired display on the display unit; and inputting a voice command. A voice command input unit, a voice display unit that performs voice display, a voice recognition unit that recognizes a voice command input from the voice command input unit, and a voice recognition unit that recognizes the voice command based on the recognition command recognized by the voice recognition unit. A determining unit for determining the processing content corresponding to the recognition command; and the sound in accordance with the content determined by the determining unit in parallel with the display by the display control unit or in preference to the display by the display control unit. A voice recognition system for a construction machine, comprising a voice display control unit for causing a voice display unit to perform a desired voice display by voice synthesis. 2. An abnormality detection unit for detecting an abnormality in an operation state of the construction machine from a detection result of the detection unit, and an abnormality notification unit for notifying an abnormality in an operation state of the construction machine. When the abnormality is detected by the unit, the display control unit notifies the abnormality notification unit of the abnormality of the operation state of the construction machine, and the voice display control unit notifies the voice display unit of the operation state of the construction machine. The speech recognition system for a construction machine according to claim 1, wherein the abnormality is notified by speech synthesis. 3. A construction machine, wherein: a voice command input unit for inputting a voice command; a voice display unit for displaying by voice; a voice recognition unit for recognizing a voice command input from the voice command input unit; A determining unit that determines processing content corresponding to the recognition command based on the recognition command recognized by the voice recognition unit; and displaying a desired voice by voice synthesis on the voice display unit in accordance with the content determined by the determining unit. And a voice display control section for performing a voice recognition. 4. A detection unit for detecting an operation state of the construction machine, and an abnormality detection unit for detecting an abnormality in an operation state of the construction machine based on a detection result of the detection unit. 4. The construction machine according to claim 3, wherein, when detecting, the voice display control unit causes the voice display unit to notify the abnormality of the operation state of the construction machine by a synthetic voice. Voice recognition system. 5. A storage unit for storing processing contents to be performed corresponding to each of a plurality of commands, and a storage unit for storing the storage contents of the storage unit based on the recognition command recognized by the voice recognition unit. The voice recognition system for a construction machine according to claim 1 or 3, further comprising a search unit for searching.