JP7291530B2 - Plant management system, information processing device, and program - Google Patents

Description

The present invention relates to a plant management system, an information processing device, and a program.

2. Description of the Related Art Conventionally, technology related to voice operation for operating an operation target based on user's voice is known. For example, Patent Literature 1 discloses a plant control system that recognizes a plant operation command using voice recognition technology in response to a voice input, reads out the corresponding operation method from a database, and automatically operates the plant. there is

JP-A-5-137181

However, in a plant, the noise generated by the plant equipment installed on site is relatively large. As a result, the user's uttered voice is buried in noise, and the voice operation cannot always be performed appropriately. Therefore, there is room for improvement in the technology related to voice operation in plants.

SUMMARY OF THE INVENTION An object of the present invention, which has been made in view of such circumstances, is to improve techniques relating to voice operation in plants.

A plant management system according to one embodiment of the present invention includes:
a first storage means for storing a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant;
a first acquisition means for acquiring first voice data including a voice component of an operation instruction for plant equipment uttered by a user and a noise component of a location where the user is located;
noise reduction means for reducing the noise component from the first audio data based on noise data corresponding to the location where the user is located;
a first detection means for detecting the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced;
and output means for outputting the operation instruction to the plant equipment.

An information processing device according to an embodiment of the present invention includes:
a first storage means for storing a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant;
a first acquisition means for acquiring first voice data including a voice component of an operation instruction for plant equipment uttered by a user and a noise component of a location where the user is located;
noise reduction means for reducing the noise component from the first audio data based on noise data corresponding to the location where the user is located;
a first detection means for detecting the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced;
and output means for outputting the operation instruction to the plant equipment.

An information processing device according to an embodiment of the present invention includes:
a first storage means for storing a plurality of noise data in which noises at a plurality of locations in a plant are respectively recorded; a voice component of an operation instruction for plant equipment uttered by a user; and a noise component at a location where the user is located; noise reduction means for reducing the noise component from the first audio data based on noise data corresponding to the location where the user is located; and the noise A plant management system comprising: first detection means for detecting the operation instruction for the plant equipment from the first voice data whose components have been reduced; and output means for outputting the operation instruction for the plant equipment. to configure
At least one of the first storage means, the first acquisition means, the noise reduction means, and the first detection means is provided.

A program according to an embodiment of the present invention is
information processing equipment,
a first storage means for storing a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant;
a first acquisition means for acquiring first voice data including a voice component of an operation instruction for plant equipment uttered by a user and a noise component of a location where the user is located;
noise reduction means for reducing the noise component from the first audio data based on noise data corresponding to the location where the user is located;
a first detection means for detecting the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced;
and output means for outputting the operation instruction to the plant equipment.

A program according to an embodiment of the present invention is
A first storage means comprising a plurality of information processing devices communicatively connected and storing a plurality of noise data in which noises at a plurality of locations in the plant are respectively recorded; a first acquiring means for acquiring first voice data including a voice component and a noise component of the location where the user is located; and obtaining the first voice based on the noise data corresponding to the location where the user is located. noise reduction means for reducing the noise component from data; first detection means for detecting the operation instruction for the plant equipment from the first voice data with the noise component reduced; and output means for outputting an operation instruction, one of the plurality of information processing devices in a plant management system comprising:
At least one of the first storage means, the first acquisition means, the noise reduction means, and the first detection means is caused to function.

According to one embodiment of the present invention, techniques for voice manipulation in plants are improved.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows schematic structure of the plant management system which concerns on 1st Embodiment of this invention. 1 is a block diagram showing a schematic configuration of a mobile terminal according to a first embodiment; FIG. 2 is a block diagram showing a schematic configuration of a server according to the first embodiment; FIG. FIG. 3 is a diagram showing multiple noise data respectively recorded at multiple locations in a plant; 4 is a flow chart showing the operation of the mobile terminal according to the first embodiment; 4 is a flow chart showing the operation of the server according to the first embodiment; It is a block diagram which shows schematic structure of the server which concerns on 2nd Embodiment of this invention. 9 is a flow chart showing the operation of the mobile terminal according to the second embodiment; 9 is a flowchart showing operations of a server according to the second embodiment; FIG. 11 is a block diagram showing a schematic configuration of a server according to a third embodiment of the present invention; FIG. It is a flow chart which shows operation of a server concerning a 3rd embodiment. It is a block diagram which shows schematic structure of the plant equipment which concerns on the modification of embodiment of this invention. FIG. 11 is a block diagram showing a schematic configuration of a mobile terminal according to a modified example; 9 is a flow chart showing the operation of a mobile terminal according to a modification; It is a flowchart which shows the operation|movement of the server which concerns on a modification.

Embodiments of the present invention will be described below.

(First embodiment)
A plant management system 1 according to a first embodiment of the present invention will be described with reference to FIG. The plant management system 1 is a system used to manage the operation of any plant such as a water treatment plant. A plant management system 1 includes a mobile terminal 10 and a server 20 . Although only one mobile terminal 10 is illustrated in FIG. 1 , the plant management system 1 may include any number of mobile terminals 10 .

The mobile terminal 10 is a portable information processing device used by a user such as a plant worker. For example, a general-purpose information processing device such as a smart phone or a tablet terminal, or an information processing device dedicated to the plant management system 1 can be employed as the mobile terminal 10 . The mobile terminal 10 can wirelessly communicate with the server 20 via a network N such as the Internet or a LAN (Local Area Network).

The server 20 is an information processing device that remotely operates a plurality of plant facilities 30 installed in the plant. Here, the plant equipment 30 is any equipment used for plant operation. For example, the plant equipment 30 in a water treatment plant includes, but is not limited to, on-site equipment such as a pump installed in the plant, and a PLC (Programmable Logic Controller) that controls the on-site equipment. The server 20 can communicate with the mobile terminal 10 and the plurality of plant facilities 30 via the network N, respectively. The server 20 is installed, for example, in the central control room of the plant, but is not limited to this and can be installed in any location.

In the present embodiment, for example, a user such as a field worker of a plant can operate the plant equipment 30 by voice by uttering an operation instruction for the plant equipment 30 to the mobile terminal 10 . Here, as will be described later, in this embodiment, the noise component of the location where the user is located is reduced from the voice data when the user speaks. Therefore, since the voice recognition accuracy of the operation instruction to the plant equipment 30 is improved, the technology related to the voice operation in the plant is improved. The present embodiment will be described in detail below.

(Hardware configuration of mobile terminal)
A hardware configuration of the mobile terminal 10 will be described with reference to FIG. The mobile terminal 10 includes a communication section 11 , a voice input section 12 , a storage section 13 and a control section 14 .

The communication unit 11 is one or more communication interfaces that communicate with an external device wirelessly or by wire. In this embodiment, the communication unit 11 includes a communication interface that communicates with the server 20 via the network N. FIG.

Audio input unit 12 is one or more microphones.

The storage unit 13 is one or more memories. In this embodiment, the "memory" is, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like, but is not limited to these and can be any memory. Each memory of the storage unit 13 functions, for example, as a main memory device, an auxiliary memory device, or a cache memory. The storage unit 13 is built in the mobile terminal 10, for example, but may be configured to be externally connected to the mobile terminal 10 via an arbitrary interface.

Controller 14 is one or more processors. In this embodiment, the "processor" is a general-purpose processor, a dedicated processor specialized for specific processing, or the like, but is not limited to these and can be any processor. The control unit 14 controls the operation of the mobile terminal 10 as a whole. Details of the operation of the mobile terminal 10 will be described later.

Note that the hardware configuration of the mobile terminal 10 is not limited to the example described above. For example, the mobile terminal 10 can be configured to further include a touch screen that displays a screen and detects user operations, and audio output means that is one or more speakers.

(Server hardware configuration)
A hardware configuration of the server 20 will be described with reference to FIG. The server 20 includes a communication section 21 , a storage section 22 and a control section 23 .

The communication unit 21 is one or more communication interfaces that communicate with an external device wirelessly or by wire. In this embodiment, the communication unit 21 includes communication interfaces that communicate with the mobile terminal 10 and the plant equipment 30 via the network N, respectively. The communication unit 21 also includes a communication interface that communicates with each of the display device 40 and the input device 50 . Here, the display device 40 is an arbitrary display such as a liquid crystal display or an OEL (Organic Electro-luminescence) display. The input device 50 is any input interface, such as a keyboard or mouse, that accepts user operations.

The storage unit 22 is one or more memories. Each memory included in the storage unit 22 functions, for example, as a main memory device, an auxiliary memory device, or a cache memory. The storage unit 22 is built in the server 20, for example, but may be configured to be externally connected to the server 20 via an arbitrary interface.

Control unit 23 includes one or more processors. The control unit 23 controls the operation of the server 20 as a whole. Details of the operation of the server 20 will be described later.

(Software configuration of mobile terminal)
A software configuration of the mobile terminal 10 will be described with reference to FIG. One or more programs used to control the operation of the mobile terminal 10 are stored in the storage unit 13 . The one or more programs, when read by the control unit 14 , cause the control unit 14 to function as recording means 141 and transmission means 142 .

An outline of each means will be explained. The recording means 141 is means for recording the sound input to the voice input section 12 . The transmission means 142 is means for transmitting data to the server 20 via the communication section 11 . Specific operations of each means will be described later.

(Server software configuration)
A software configuration of the server 20 will be described with reference to FIG. One or more programs used to control the operation of server 20 are stored in storage unit 22 . When the one or more programs are read by the control unit 23, the control unit 23 is controlled by the first storage means 231, the first acquisition means 232, the identification means 233, the noise reduction means 234, the first detection means 235, and the output means. 236.

An outline of each means will be explained. The first storage means 231 is a means for storing, in the storage unit 22, a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant.

Here, the "location in the plant" is, for example, the location where the plant equipment 30 is installed or an area in the plant that is partitioned by any method, but is not limited to these and can be determined arbitrarily. In general, noise with different acoustic characteristics is generated at each location in the plant according to the installed plant equipment 30 . Therefore, a plurality of noise data may have acoustic features different from each other. Specifically, the plurality of noise data may differ from each other in noise frequency bands, but are not limited to this, and may differ from each other in arbitrary acoustic features such as the occurrence period (occurrence pattern) and the presence or absence of beats, for example.

The first acquisition unit 232 is a unit that acquires, via the communication unit 21, the first audio data transmitted from the mobile terminal 10 as will be described later. As will be described later, the "first voice data" is voice data including a voice component of an operation instruction for the plant equipment 30 uttered by the user of the mobile terminal 10 and a noise component of the location where the user is located.

The identifying means 233 is a means for identifying the place where the user of the mobile terminal 10 is located among a plurality of places in the plant.

The noise reduction means 234 is a means for reducing noise components from the first voice data based on noise data corresponding to the location where the user is located among the plurality of noise data stored in the storage unit 22 .

The first detection means 235 is means for detecting a user's operation instruction for the plant equipment 30 from the first voice data whose noise component has been reduced by the noise reduction means 234 .

The output means 236 is means for outputting operation instructions to the plant equipment 30 via the communication section 21 . Specific operations of each means will be described later.

(Operation of plant management system)
The operation of the plant management system 1 according to the first embodiment will be described with reference to FIGS. 5 and 6. FIG. FIG. 5 is a flow chart showing the operation of the mobile terminal 10. As shown in FIG.

Step S100: The recording means 141 generates the first voice data recording the sound including the voice component of the operation instruction for the plant equipment 30 uttered by the user and the noise component of the location where the user is located.

Step S<b>101 : The transmitting means 142 transmits the first voice data of step S<b>100 to the server 20 via the communication section 11 . Then the process ends.

FIG. 6 is a flow chart showing the operation of the server 20. As shown in FIG.

Step S200: The first storage means 231 stores, in the storage section 22, a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant. For example, as shown in FIG. 4, for each location in the plant, the location ID uniquely indicating the location and the noise data of the location are stored in the storage unit 22 . It should be noted that noise recording can be performed in advance, for example, before the start of operation of the plant management system 1 while the plant is in operation.

Step S<b>201 : The first acquisition unit 232 acquires the first voice data transmitted from the mobile terminal 10 via the communication unit 21 .

Step S202: The identifying means 233 identifies the place where the user of the mobile terminal 10 is located from among a plurality of places in the plant. Any method can be adopted to specify the place where the user is located. In this embodiment, the identifying means 233 identifies the place where the user is located based on the comparison between the first voice data and the multiple noise data stored in the storage unit 22 . Specifically, the identifying means 233 compares the first sound data with a plurality of noise data stored in the storage unit 22, and the acoustic features of noise correspond to the noise data that substantially match the first sound data. A location is identified as where the user is located.

Step S203: The noise reduction means 234 reduces the noise component from the first voice data based on the noise data corresponding to the location where the user is located among the multiple noise data stored in the storage unit 22 . Any technique that utilizes the acoustic characteristics of noise can be used to reduce noise components. In this embodiment, the noise reduction means 234 detects the acoustic features of the noise (for example, the frequency band of the noise) at the location based on the noise data corresponding to the location where the user is located, and detects the detected acoustic features is reduced from the first audio data as a noise component (for example, the gain of the noise frequency band is reduced).

Step S<b>204 : The first detection means 235 detects a user's operation instruction for the plant equipment 30 from the first voice data whose noise component has been reduced by the noise reduction means 234 . Any method can be used to detect the operation instruction. For example, the first detection means 235 may detect an operation instruction uttered in a prescribed format such as a keyword or command by keyword-type speech recognition, or detect an operation instruction uttered in a natural language by natural language processing. You may To implement natural language processing, for example, dictionary data in which a plurality of words are registered is generally required. Data used for performing natural language processing is pre-stored in the storage unit 22 . The operation instruction includes, for example, information indicating the content of the operation for the plant equipment 30, but is not limited to this, and may further include information designating the date and time for executing the operation.

Step S<b>205 : The output means 236 outputs an operation instruction to the plant equipment 30 via the communication section 21 . The operation of the plant facility 30 is controlled according to the operation instruction. In addition, when the date and time for executing the operation related to the operation instruction is specified as described above, the output unit 236 outputs the operation instruction to the plant equipment 30 at the specified date and time. Then the process ends.

As described above, according to the plant management system 1 according to the first embodiment, since the noise data corresponding to the place where the user is located is used, the noise component of the place is appropriately reduced from the first voice data. be. Therefore, since the probability that the user will properly perform the voice operation of the plant equipment 30 is improved, the technology related to the voice operation in the plant is improved.

(Second embodiment)
Next, a plant management system 1 according to a second embodiment of the invention will be described. The plant management system 1 according to the second embodiment further performs an operation of detecting and registering words that have not been registered in the dictionary data from conversations between users, as compared with the above-described first embodiment. Hereinafter, the same reference numerals will be given to the same configurations as in the first embodiment, and the description thereof will be omitted.

(Server software configuration)
A software configuration of the server 20 will be described with reference to FIG. One or more programs used to control the operation of server 20 are stored in storage unit 22 . When the one or more programs are read by the control unit 23, the control unit 23 is controlled by the first storage means 231, the first acquisition means 232, the identification means 233, the noise reduction means 234, the first detection means 235, and the output means. 236, it functions as a second storage means 237, a second acquisition means 238, and a registration means 239.

An outline of each means will be explained. The second storage unit 237 is a unit that stores dictionary data in which words are registered in the storage unit 22 . The second acquisition means 238 is means for acquiring, via the communication unit 21, second voice data in which conversations between users are recorded, for example, in the plant. The registering means 239 is a means for detecting words not registered in the dictionary data from conversations between users based on the second voice data and registering them in the dictionary data. Specific operations of each means will be described later.

(Operation of plant management system)
The operation of the plant management system 1 according to the second embodiment will be described with reference to FIGS. 8 and 9. FIG. This operation is an operation of detecting and registering words that are not registered in the dictionary data from conversations between users. FIG. 8 is a flow chart showing the operation of the mobile terminal 10. As shown in FIG. The operation is performed independently of the operation shown in FIG. 5, for example.

Step S300: The recording means 141 generates second voice data recording conversations between users.

Step S<b>301 : The transmitting means 142 transmits the second voice data of step S<b>300 to the server 20 via the communication section 11 . Then the process ends.

FIG. 9 is a flow chart showing the operation of the server 20. As shown in FIG. The operation is performed independently of the operation shown in FIG. 6, for example.

Step S400: The second storage unit 237 stores dictionary data in which words are registered in the storage unit 22. FIG.

Step S401: The second acquisition means 238 acquires, via the communication unit 21, second voice data in which conversations between users in the plant are recorded, for example. In the second embodiment, the recording of the conversation is performed by the mobile terminal 10 of each user, but is not limited to this. is also possible.

Step S402: Based on the second voice data, the registration unit 239 detects words that are not registered in the dictionary data from conversations between users and registers them in the dictionary data. Specifically, the registration unit 239 performs natural language processing such as morphological analysis on the second voice data, and detects each word that appears in conversation between users. The registration means 239 compares the detected words with words included in the dictionary data to detect words not registered in the dictionary data. Note that the registration unit 239 may automatically register the detected unregistered words, or may register them according to user operations.

As described above, according to the plant management system 1 according to the second embodiment, words that are not registered in dictionary data are detected from conversations between users and registered in the dictionary data. Therefore, since the accuracy of voice recognition is improved by enriching the dictionary data, the technique of voice operation in the plant is further improved.

(Third embodiment)
Next, a plant management system 1 according to a third embodiment of the invention will be described. The plant management system 1 according to the third embodiment further determines whether the execution of the operation instruction for the plant equipment 30 is permitted or not, as compared with the above-described first embodiment. Hereinafter, the same reference numerals will be given to the same configurations as in the first embodiment, and the description thereof will be omitted.

(Server software configuration)
A software configuration of the server 20 will be described with reference to FIG. One or more programs used to control the operation of server 20 are stored in storage unit 22 . When the one or more programs are read by the control unit 23, the control unit 23 is controlled by the first storage means 231, the first acquisition means 232, the identification means 233, the noise reduction means 234, the first detection means 235, and the output means. 236, it functions as third storage means 240 and determination means 241.

An outline of each means will be explained. The third storage means 240 is means for storing authority information of each of a plurality of users in the storage section 22 . The determination unit 241 is a unit for determining whether or not to permit execution of the operation instruction detected by the first detection unit 235, based on the authority information of the user who uttered the operation instruction. Specific operations of each means will be described later.

(Operation of plant management system)
The operation of the plant management system 1 according to the third embodiment will be described with reference to FIG. 11 . FIG. 11 is a flow chart showing the operation of the server 20. As shown in FIG. This operation is performed instead of the operation shown in FIG. 6, for example.

Step S500: The first storage means 231 stores, in the storage section 22, a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant. Also, the third storage unit 240 stores authority information of each of the plurality of users in the storage unit 22 . The authority information may be, for each user, whitelist type information indicating operation instructions permitted to be executed with the authority of the user, or blacklist information indicating operation instructions not permitted to be executed with the authority of the user. It may be type information. Note that the authority information can be created in advance, for example, before the operation of the plant management system 1 is started.

Step S<b>501 : The first acquisition unit 232 acquires the first voice data transmitted from the mobile terminal 10 via the communication unit 21 .

Step S502: The identifying means 233 identifies the place where the user of the mobile terminal 10 is located from among a plurality of places in the plant.

Step S503: The noise reduction means 234 reduces the noise component from the first voice data based on the noise data corresponding to the place where the user is located among the plurality of noise data stored in the storage unit 22 .

Step S<b>504 : The first detection means 235 detects a user's operation instruction for the plant equipment 30 from the first voice data whose noise component has been reduced by the noise reduction means 234 .

Step S505: The determination unit 241 determines whether or not to permit execution of the operation instruction detected by the first detection unit 235 in step S504, based on the authority information of the user who uttered the operation instruction. Specifically, the determination unit 241 determines whether or not execution of the operation instruction is permitted by the authority of the user by referring to the authority information. When determining that execution of the operation instruction is permitted, the determining unit 241 determines that execution of the operation instruction is permitted (step S505-Yes), and the process proceeds to step S506. On the other hand, if it is determined that the operation instruction is not permitted to be executed, the determination unit 241 determines that the operation instruction is not permitted to be executed (step S505-No), and the process proceeds to step S507.

Step S<b>506 : The output means 236 outputs an operation instruction to the plant equipment 30 via the communication section 21 . The operation of the plant facility 30 is controlled according to the operation instruction. Then the process ends.

Step S507: The determination means 241 discards the operation instruction for the plant equipment 30. Then, the operation instruction is not output to the plant facility 30, and the process ends.

As described above, according to the plant management system 1 according to the third embodiment, whether or not to permit execution of an operation instruction for the plant equipment 30 is determined based on the authority of the user who has uttered the operation instruction. Therefore, the possibility that an operation instruction uttered by an unauthorized user by mistake will be executed is reduced, so that the technology related to the voice operation in the plant is further improved.

Although the present invention has been described with reference to the drawings and examples, it should be noted that various variations and modifications will be readily apparent to those skilled in the art based on this disclosure. Therefore, please note that these variations and modifications are included in the scope of the present invention. For example, the functions included in each means, each step, etc. can be rearranged so as not to be logically inconsistent, and it is possible to combine a plurality of means, steps, etc. into one or divide them. .

For example, the plant management system 1 may include a plurality of information processing devices, and each component or means of the mobile terminal 10 or the server 20 according to the above-described embodiment may be distributed to the plurality of information processing devices. be.

An embodiment combining the above-described second embodiment and third embodiment is also possible. That is, one or more programs used for controlling the operation of the server 20 are stored in the storage unit 22, and when the one or more programs are read by the control unit 23, the control unit 23 is transferred to the first storage unit 231 and the second storage unit 231. 1 acquisition means 232, identification means 233, noise reduction means 234, first detection means 235, output means 236, second storage means 237, second acquisition means 238, registration means 239, third storage means 240, and determination means 241 It is also possible to have a configuration that functions as

Further, in the above-described embodiment, regarding an example in which the specifying means 233 of the server 20 specifies the place where the user is located based on the comparison between the first voice data and the plurality of noise data stored in the storage unit 22. explained. However, the method by which the identifying means 233 identifies the location where the user is located is not limited to this example.

For example, a modification is also possible in which the specifying means 233 specifies the place where the user is located based on a comparison between the position information of the mobile terminal 10 used by the user and the position information of each of a plurality of places in the plant. Specifically, the mobile terminal 10 further includes a positioning unit such as a GPS receiver, and transmits the position of the mobile terminal 10 to the server 20 . On the other hand, the server 20 stores in advance the position information of each of a plurality of locations in the plant in the storage unit 22, and the user selects a location corresponding to the location information acquired from the mobile terminal 10 among the plurality of locations. identify as a place to

Further, for example, a modification is possible in which the user reads the data of the place where the plant facility is installed with the mobile terminal 10, and the specifying means 233 specifies the place where the user is located based on the data of the place. The modification will be specifically described with reference to FIGS. 12 to 15. FIG.

Each plant facility 30, for example, as shown in FIG. 12, has a display means 31 for indicating the place where the facility is installed. The indicating means 31 is any means capable of indicating the place where the plant equipment 30 is installed. For example, the indicating means 31 is a member printed with a one-dimensional code or a two-dimensional code indicating location data, or a display for displaying these, but is not limited to these, and indicates location data via infrared rays, Bluetooth (registered trademark), or the like. may be a communication module that transmits via short-range wireless communication.

On the other hand, as shown in FIG. 13, the mobile terminal 10 further includes a reading unit 15 that reads the data of the location indicated by the indicating means 31. FIG. For example, when the indicating means 31 indicates a place with a one-dimensional code or a two-dimensional code, the reading section 15 is a camera. Further, for example, when the indicating means 31 indicates a location by short-range wireless communication, the reading unit 15 is a communication module compatible with the short-range wireless communication. Also, the control unit 14 of the mobile terminal 10 functions as a reading unit 143 in addition to the recording unit 141 and the transmission unit 142 . The reading means 143 is means for reading the data of the location indicated by the indicating means 31 .

The operation of the plant management system 1 according to the modification of the embodiment will be described with reference to FIGS. 14 and 15. FIG. FIG. 14 is a flow chart showing the operation of the mobile terminal 10. As shown in FIG. This operation is performed, for example, when transmitting the first audio data to the server 20 in the above-described embodiment.

Step S600: The reading means 143 reads the data of the location indicated by the indicating means 31. FIG.

Step S<b>601 : The transmitting means 142 transmits the location data read in step S<b>600 to the server 20 via the communication section 11 .

FIG. 15 is a flow chart showing the operation of the server 20. As shown in FIG. This operation is performed instead of the operation shown in FIG. 6, for example.

Step S700: The first storage means 231 stores in the storage section 22 a plurality of noise data in which noises at a plurality of locations in the plant are respectively recorded.

Step S<b>701 : The first acquisition unit 232 acquires the first voice data transmitted from the mobile terminal 10 via the communication unit 21 .

Step S<b>702 : The first acquiring unit 232 acquires the location data read by the reading unit 143 via the communication unit 21 .

Step S703: The identifying means 233 identifies the place where the user of the mobile terminal 10 is located from among a plurality of places in the plant. Specifically, the identification unit 233 identifies the location indicated by the data read by the reading unit 143 as the location of the user.

Step S704: The noise reduction means 234 reduces the noise component from the first voice data based on the noise data corresponding to the location where the user is located among the plurality of noise data stored in the storage unit 22. FIG.

Step S<b>705 : The first detection means 235 detects a user's operation instruction for the plant equipment 30 from the first voice data whose noise component has been reduced by the noise reduction means 234 .

Step S<b>706 : The output means 236 outputs an operation instruction to the plant equipment 30 via the communication section 21 . The operation of the plant facility 30 is controlled according to the operation instruction. Then the process ends.

Moreover, in the embodiment described above, an example of the operation of the plant management system 1 has been described with reference to FIGS. 5, 6, 8, 9, 11, 14, and 15. However, it is also possible to omit some of the steps included in the above-described operations or some of the operations included in one step within a logically consistent range. Also, it is possible to change the order of a plurality of steps included in the above operation within a logically consistent range.

Further, in the above-described embodiments, various means realized by the control units 14 and 23 have been described as software configurations, but at least some of these means are based on the concept of including software resources and/or hardware resources. There may be. For example, the recording means 141 may include a microphone, the transmitting means 142, the first obtaining means 232, the output means 236, and the second obtaining means 238 may include communication modules, the first storage means 231, the second storage means. 237 and third storage means 240 may include memory.

Moreover, in the embodiment described above, the configuration for detecting an operation instruction for the plant equipment 30 by user's speech has been described. However, it is not limited to the operation instruction for the plant facility 30, and for example, it is possible to detect an operation instruction for the mobile terminal 10 and/or the server 20 by user's utterance.

Moreover, a general-purpose information processing device such as a computer or a mobile phone can be used to function as the mobile terminal 10 or the server 20 according to the above-described embodiment. The information processing device stores a program describing processing details for realizing each function of the mobile terminal 10 or the server 20 according to the embodiment in the memory of the information processing device, and the processor of the information processing device executes the program. It can be realized by reading and executing.

1 Plant management system 10 Mobile terminal 11 Communication unit 12 Voice input unit 13 Storage unit 14 Control unit 141 Recording means 142 Transmission unit 143 Reading unit 15 Reading unit 20 Server 21 Communication unit 22 Storage unit 23 Control unit 231 First storage unit 232 1 acquisition means 233 identification means 234 noise reduction means 235 first detection means 236 output means 237 second storage means 238 second acquisition means 239 registration means 240 third storage means 241 determination means 30 plant equipment 31 indication means 40 indication device 50 input Equipment N network

Claims (8)

a first storage means for storing a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant;
a first acquisition means for acquiring first voice data including a voice component of an operation instruction for plant equipment uttered by a user and a noise component;
noise reduction means for reducing the noise component from the first audio data based on the noise data corresponding to the location read by the portable terminal used by the user from the indicating means provided in the plant equipment;
a first detection means for detecting the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced;
output means for outputting the operation instruction to the plant equipment;
a second storage means for storing dictionary data in which words are registered;
a second acquisition means for acquiring second audio data in which a conversation between users is recorded;
registration means for detecting words not registered in the dictionary data from the conversation between the users based on the second voice data and registering the words in the dictionary data;
with
The plant management system, wherein the first detection means detects the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced, using the dictionary data. The plant management system according to claim 1,
The noise reduction means reduces the gain of the frequency band of the noise at the location specified based on the noise data corresponding to the location with respect to the first audio data, thereby reducing the noise from the first audio data. A plant management system that reduces components. The plant management system according to claim 1 or 2,
a third storage means for storing the authority information of the user;
determination means for determining whether or not to permit execution of the operation instruction detected by the first detection means based on the authority information of the user;
further comprising
The plant management system, wherein the output unit outputs the operation instruction to the plant equipment when it is determined that execution of the operation instruction is permitted. The plant management system according to any one of claims 1 to 3,
The operation instruction includes the content of the operation for the plant equipment and the date and time to execute the operation,
The plant management system, wherein the output means outputs the operation instruction to the plant equipment when the date and time come. a first storage means for storing a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant;
a first acquisition means for acquiring first voice data including a voice component of an operation instruction for plant equipment uttered by a user and a noise component;
noise reduction means for reducing the noise component from the first audio data based on the noise data corresponding to the location read by the portable terminal used by the user from the indicating means provided in the plant equipment;
a first detection means for detecting the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced;
output means for outputting the operation instruction to the plant equipment;
a second storage means for storing dictionary data in which words are registered;
a second acquisition means for acquiring second audio data in which a conversation between users is recorded;
registration means for detecting words not registered in the dictionary data from the conversation between the users based on the second voice data and registering the words in the dictionary data;
with
The information processing apparatus, wherein the first detection means detects the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced, using the dictionary data. a first storage means for storing a plurality of noise data in which noises at a plurality of locations in the plant are respectively recorded; The noise component is reduced from the first voice data based on the first acquisition means for acquiring and the noise data corresponding to the location read by the mobile terminal used by the user from the display means provided in the plant equipment. a first detection means for detecting the operation instruction for the plant equipment from the first voice data with the noise component reduced; and an output means for outputting the operation instruction to the plant equipment. a second storage means for storing dictionary data in which words are registered; a second acquisition means for acquiring second voice data in which conversations between users are recorded; and a dictionary based on the second voice data In order to configure a plant management system comprising a plurality of information processing devices in which registration means for detecting words not registered in data from conversations between users and registering them in the dictionary data are distributed,
At least the registration among the first storage means, the first acquisition means, the noise reduction means, the first detection means, the output means, the second storage means, the second acquisition means, and the registration means An information processing device comprising means . information processing equipment,
a first storage means for storing a plurality of noise data obtained by respectively recording noises at a plurality of locations in the plant;
a first acquisition means for acquiring first voice data including a voice component of an operation instruction for plant equipment uttered by a user and a noise component;
noise reduction means for reducing the noise component from the first audio data based on the noise data corresponding to the location read by the portable terminal used by the user from the indicating means provided in the plant equipment;
a first detection means for detecting the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced;
output means for outputting the operation instruction to the plant equipment;
a second storage means for storing dictionary data in which words are registered;
a second acquisition means for acquiring second audio data in which a conversation between users is recorded;
registration means for detecting words not registered in the dictionary data from the conversation between the users based on the second voice data and registering the words in the dictionary data;
function as
The program, wherein the first detection means detects the operation instruction for the plant equipment from the first voice data in which the noise component has been reduced, using the dictionary data. a first storage means for storing a plurality of noise data in which noises at a plurality of locations in the plant are respectively recorded; The noise component is reduced from the first voice data based on the first acquisition means for acquiring and the noise data corresponding to the location read by the mobile terminal used by the user from the display means provided in the plant equipment. a first detection means for detecting the operation instruction for the plant equipment from the first voice data with the noise component reduced; and an output means for outputting the operation instruction to the plant equipment. a second storage means for storing dictionary data in which words are registered; a second acquisition means for acquiring second voice data in which conversations between users are recorded; and a dictionary based on the second voice data In order to configure a plant management system comprising a plurality of information processing devices in which a registration means for detecting words not registered in the data from the conversation between the users and registering them in the dictionary data are distributed, the plurality of one of the information processing devices of
At least the registration among the first storage means, the first acquisition means, the noise reduction means, the first detection means, the output means, the second storage means, the second acquisition means, and the registration means A program that functions as a means .

Images