JP4327545B2 - Field monitoring system and field monitoring method - Google Patents

Description

  The present invention relates to an on-site monitoring system and an on-site monitoring method that enable a supervisor to perform witness work and confirmation work efficiently even when the supervisor is away from the work site.

  Conventionally, on-site work for plants, etc., work is carried out according to work procedure manuals prepared in advance by the site workers, and reports are made to the supervisor after completion of the prescribed work. If the contents can be approved, the work on site is completed by marking an approval mark on the work completion form. The work completion document is kept for management records.

  No method has been provided in the past to retrospectively analyze or re-evaluate the specific content of this work. In addition, since a series of these approval works are carried out based on the mutual trust and tacit understanding between workers and supervisors, whether or not the approval work based on objective evaluation indicators has been carried out regularly and It was difficult to confirm retroactively. Furthermore, if one supervisor is present at multiple sites, it takes time to move between multiple sites, and the attendance work cannot be carried out efficiently.

As a technique similar to the present invention, various video conference apparatuses (Patent Document 1) for performing a video conference between a plurality of points, work efficiency improvement by implementing two-way communication between a work site and a control room in a plant. An in-plant information communication system (Patent Document 2) that reduces the burden on workers, a plant maintenance work support system (Patent Document 3) that can share information necessary for inspection and maintenance work between the site and the office, and further remote technology A support system (Patent Document 4) is known.
JP-A-8-130719 (page 4, FIG. 1) Japanese Patent No. 3106107 (page 4, FIG. 1) JP-A-11-202904 (page 4-6, FIG. 1) Japanese Patent No. 2920449 (page 3, FIG. 1)

  In the above-mentioned conventional on-site work monitoring technology, emphasis is placed on sharing information and reducing the burden on workers as the main focus of its introduction, and there is a possibility of an increase in the potential burden related to newly generated work due to the introduction of the system. Is not considered the target of the effect.

  In other words, the introduction of the system makes it possible to record the status of work, but new post-record editing and reporting work is added to the conventional work, which increases the amount of work and the burden on the field worker. It is assumed to be connected.

As a result, the recording work is not sufficiently thorough or the video and audio editing work after the work is complicated, and it is difficult to exhibit a sufficient effect as the work recording. In particular, since the recording work is recorded in different media such as video camera and measuring instrument data on different media, it is very difficult to search and extract only the necessary part of what is still recorded as a record. It needed time and effort.
Also, although the recording itself has been digitized, it has been necessary to transfer the recording medium onto the electronic recording after returning to the office after the work is completed.

  Furthermore, for certain tasks, the effect of introducing a video conference system is recognized for sharing information between the site and the office, but the information transmitted there is considered to be temporary under the circumstances. Record value has not always been emphasized.

  In addition, video information has multiple complex information, and the amount of information is enormous. However, it is necessary to perform unified management and extraction of important information after work. However, it was not possible to fully utilize the various advantages of video in business. One of the main reasons for this is the lack of information and the lack of solutions to potential inconsistencies between information. It was of a nature that could be attributed to the uncertainties of the criteria, or due to uncertainties in the provisions of judgment criteria appropriate to each situation.

  All work that requires witnessing and confirmation requires a supervisor to be stationed at the site or to go to the work site in the plant for confirmation. In that case, it is necessary for the worker and supervisor to be at the work site at the same time. On the other hand, plant inspection work is diverse, and it is difficult to confirm details of actual work after work for work that does not require attendance.

  Furthermore, in a similar system using a multipoint video conference system that transmits and receives audio data and video data, it is possible to record data actually transmitted / received, but for maintenance and monitoring of the transmitted / received plant. No mechanism has been established to quickly investigate the progress of equipment degradation by automatically extracting, recording, and organizing important data, reusing them, and comparing them with previously recorded video information. .

  Accordingly, the first object of the present invention is to solve the above-mentioned problems of the prior art, and is an integrated management system that centrally manages work information centered on images related to plant maintenance and inspection work. It is to provide a reasonable on-site monitoring system using a simple monitoring and record management system.

  In addition, the second object of the present invention is to carry an on-site information terminal at the site, easily record important matters during work, and provide instructions and confirmation from a supervisor who stands by at a remote office as necessary. It is an object of the present invention to provide an on-site monitoring method capable of easily obtaining the above without being restricted by time and distance.

In order to achieve the above-described object, the field monitoring system invention according to claim 1 includes a field information terminal device carried on site by a worker, and a remote information terminal device installed at the site or at a location remote from the site. , An information distribution device for receiving information transmitted from the field information terminal device and distributing information to the remote information terminal device requested for distribution, the field information terminal device, the remote information terminal device, and information distribution An information recording device for recording information from the field information terminal device, which is integrated with any one of the devices or provided independently, and these devices are mutually connected to communicate with each other. In the field monitoring system configured with a communication device for performing, the field information terminal device is a video information input having a function of photographing the state of equipment installed in the field A confirmation request information input means for inputting procedure confirmation request information to a supervisor at the installation location of the remote information terminal device, transmitting the video information and the procedure confirmation request information to the communication device, and the communication device Communication means for receiving a signal from the information distribution apparatus, wherein the information distribution apparatus includes one or a plurality of procedural information including images for remotely monitoring information exchanged between a worker and a supervisor as needed. Communication means for distributing between a field information terminal device and one or a plurality of remote information terminal devices, the remote information terminal device presenting video information for confirming field work based on video information from the information distribution device Means, a procedure confirmation means having a function of approving the work for the procedure confirmation request information, and procedure confirmation information are transmitted to the communication device, and A communication means for receiving a signal from a communication apparatus, wherein the information recording apparatus is a means for transmitting / receiving part or all of information exchanged between a field worker and a supervisor; Procedural information recording means having a function of recording in time series together with request and approval information, and the field information terminal device or the remote information terminal device inputs meter image data, Performs processing to detect the contour line corresponding to the contour shape, performs noise shape extraction processing based on the detected contour line, performs meter shape extraction processing, and based on the meter model information stored in the meter model database The pattern recognition process of the model is performed, the position or orientation of the pointer indicating the value on the meter indicator plate is extracted, and then the numbers in the meter Meter indication value recognition processing that outputs the indication value reading processing result together with the display position detection result, and valve image data is input, and then the valve contour shape extraction processing is performed from this image data. A contour line corresponding to the shape is detected, a valve shape feature based on the detected contour line is extracted, valve type pattern recognition processing is performed based on the valve type information stored in the valve information database, Detects the position of the upper and lower ends, calculates the actual distance between the upper and lower ends from the valve model and the number of pixels on the image, then converts the valve stem position to the valve opening and outputs the result A feature amount such as a specific numerical value or a character is extracted from the video data by performing at least one of the valve opening degree recognition process and the recognition process .

According to a seventh aspect of the present invention, there is provided a field information terminal device carried by a worker on site, a remote information terminal device installed on the site or in a place away from the site, and the field information terminal. Any of the information distribution device for receiving information transmitted from the device and distributing the information to the remote information terminal device for which distribution has been requested, and any of the field information terminal device, the remote information terminal device, and the information distribution device An information recording device for recording information from the on-site information terminal device, and a communication device for interconnecting and communicating with each other. using site monitoring system is composed of a, at least one of the state of the meter and valve installed in the field by using the video information input means provided in said site information terminal device The procedure confirmation request information to the supervisor at the installation location of the remote information terminal device is input using the confirmation request information input means, and the video information and the procedure confirmation request information are distributed by the communication device to the information distribution A video that is transmitted to a device, receives a signal from the information distribution device, and remotely monitors information exchanged between a field worker and a supervisor using the information distribution device as needed Is distributed between one or a plurality of field information terminal devices and one or a plurality of remote information terminal devices, and is received by the remote information terminal device, at least one of the valve and the meter from the information distribution device or the other feature amounts, such as specific number or character in the video information to verify site work by presenting the video information presentation unit, followed procedures confirm Yi Approve the work for the information, send the approval information to the information distribution device, and use the procedure information recording means to request part or all of the information exchanged between the on-site worker and the supervisor And approval information is recorded in time series.

  According to the present invention, even when a worker who is engaged in field work and a supervisor who is witnessing the work are in a place separated in time or distance, the witness work and the confirmation work are efficiently performed. Including on-site work and images that have been rarely implemented as permanent record management in the past due to extremely simple procedures, by providing technology for recording, confirming, and sharing business conditions for It is possible to provide an on-site monitoring system and an on-site monitoring method for easily performing a record creation operation.

An embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram of a field monitoring system according to the present invention. The field monitoring system according to the present invention includes the following devices. 101 is an on-site information terminal device that a worker carries on the site, and 103 is a remote information terminal device installed in an office or the like away from the work site. 104 is an information recording device for receiving and recording information transmitted from the field information terminal device 101 carried at the work site, and 105 receives information transmitted from the field information terminal device 101 and receives a distribution request. This is an information distribution device for distributing information to the remote information terminal device 103. A communication device 102 connects these devices to each other and performs communication.

  By the way, the on-site information terminal device 101 makes a procedure confirmation request regarding information transmitted from the site to the office, etc., and the TV camera 106 as a video information input means for photographing the state of the devices installed on the site. A mouse 107 with an input switch for performing is connected.

  Then, the site information terminal device 101 also transmits a speaker 111 for listening to the on-site worker, such as the supervisor's voice transmitted from the remote information terminal device 103, and the acoustic information of the work site, if necessary. Microphone 112 as acoustic information input means for recording, video information display means for displaying video information photographed by the TV camera 106 or video information received from the remote information terminal device 103 and other additional information for confirmation Connected to a recording medium 115 that records information such as video and audio recorded and processed by the display 110 and the field information terminal device 101 as well as input information of workers such as confirmation request inputs in the terminal device. ing.

  On the other hand, the remote information terminal device 103 receives a signal transmitted from the on-site information terminal device 101 or a signal transmitted from the information distribution device 105 through the communication device 102, and displays the image thereof. The display device 108 is connected to a mouse 109 with an input switch for inputting a procedure confirmation in response to a procedure confirmation request transmitted from the field information terminal device 101.

  Then, the remote information terminal device 103 includes a speaker 113 for outputting on-site voices and device operation sounds, etc., as necessary, on-site voice terminal devices 101, and voice input means for instructing on-site workers. And a recording medium 116 that records information such as reproduced video and audio, and input information of workers such as confirmation input, and the like are connected.

  In the on-site monitoring system configured as described above, the series of video information input to the on-site information terminal device 101 and the procedure confirmation information input to the remote information terminal device 103 both pass through the communication device 102. The information is once transmitted to the information distribution apparatus 105 and then recorded on the recording medium on the information recording apparatus 104 via the communication apparatus 102 again.

  Note that various forms of the communication device 102 can be assumed according to the field work environment. For example, the present apparatus can be configured by a method based on a communication standard such as digital communication using a mobile phone or a simple mobile phone (PHS), a wireless LAN, or a wired communication. In this case, each communication module built in the field information terminal device 101, the remote information terminal device 103, the information recording device 104, and the information distribution device 105 according to the communication standard and communication conditions of the communication device 102 during actual operation is the standard. Of course, it is necessary to have unity.

  For information extracted as a result of image processing, important matters regarding the progress of work, additional information that needs to be transmitted to the supervisor, text information and markers are superimposed on the image and displayed, and supplementary information on the video It shall have a format that can be used as reference information for approval.

  When compressing images to be sent and received, it is necessary to have sufficient resolution for confirmation and approval work through video. It is assumed that the resolution of video transmitted and received can be changed.

Hereinafter, the internal configuration of the information distribution apparatus 105 from the site information terminal apparatus 101 will be described in order.
First, the site information terminal device 101 will be described with reference to FIG.
In the field information terminal device 101, the video information of the work site photographed by the worker with the TV camera 106 is input to the video input module 201, and the acoustic information of the work site is input to the voice input module 202 as an audio signal from the microphone 112. Further, the coordinates input from the input switch mouse 107 and the confirmation request click information are input to the confirmation request input module 203, respectively.

The video information, audio information, coordinates and confirmation request click information output from the video input module 201, audio input module 202, and confirmation request input module 203 are input to the logic control module 204.
The logic control module 204 determines the response / processing as the on-site information terminal device 101 in accordance with each input information.

  In other words, the distribution status of video / audio information (information presence / absence of information, information amount, information transmission speed, feature amount of information to be distributed, etc.) in each module constituting the site information terminal device 101 is constantly monitored and necessary. Data input / output parameters related to information distribution can be set and controlled automatically and adaptively based on a logic control sequence set in advance from the monitoring results, and whether there is a setting request from the user of the field information terminal device Accordingly, it has a function of setting a parameter related to data input / output to a constant value and controlling the flow of information related to data input / output within the field information terminal device and external devices.

  The data processing module 205 performs a series of data processing such as data compression, image and audio recognition, information extraction, and the like to be performed by the field information terminal device 101, and processing results, that is, processed data To capture.

  Data such as video and audio via the logic control module 204 or the result of processing them and other input information are displayed on the display 110 and the like used by workers on site to check the video. Is output to the information display module 206 for performing the sound and the sound reproducing module 207 for presenting the data to the speaker 111 as acoustic data or sound information.

  In addition, these pieces of information are recorded on the recording medium 115 in the terminal device, such as video and audio information recorded and processed by the field information terminal device 101, and input information of workers such as confirmation request inputs. In addition to being sent to the data recording module 208 that performs the above processing, the remote information terminal device 103 is also used to send and receive on-site information and information between workers and supervisors via the information recording device 104 and the information distribution device 105. It is also sent to a communication module 209 that transmits information to the communication device 102 for performing.

Next, the remote information terminal device 103 will be described with reference to FIG.
The remote information terminal device 103 has a configuration similar to the on-site information terminal device 101, but the on-site information terminal device 101 has a video input module such as a camera 106 and a microphone 112, and an audio input module as basic components. On the other hand, in this remote information terminal device 103, whether it is on-site information such as live video / audio transmitted from the on-site information terminal device 101 in the present simultaneous progress delivered from the information delivery device 105 via the communication device 102 Alternatively, the configuration is different in that the information recorded and recorded in the past is taken out from the information recording device 104 and the reproduced information such as video / audio becomes input information.

  The remote information terminal device 103 converts the input information from the communication device 102 into terminal device internal information (data type conversion) by the communication module 301, and then inputs the information to the logic control module 302, where it is displayed to the supervisor Processing and processing as. The function of this logic control module 302 basically provides the same function as the logic control module 204 in the on-site information terminal device 101 except that the input / output relationship is partially different. In addition, data for images and sounds is sent to the data processing module 303 as necessary, and a series of data processing such as data compression processing, video / sound recognition, information extraction and the like to be performed by the remote information terminal device 103 is performed. Then, the processing result, that is, the data after processing is taken in.

  That is, based on the information about the compression rate and compression algorithm added to the video / audio information input via the communication device 102, the data transmitted to the internal data processing module 303 is sent to perform data expansion. . Next, the data decompressed in the data processing module 303 is separated into video / audio through the logic control module 302 and then sent to the information display module 304 and the audio reproduction module 305. On the basis of information such as the free capacity of the recording medium, the logic control module 302 records the data that has been compression-converted again by the data processing module 303 when it is necessary to match the recording format / compression algorithm in the recording medium. To record.

  The logic control module 302 superimposes on-site information such as timing adjustments, processing results, and text information on the display 108 via the information display module 304 and is presented to the supervisor.

  The distributed sound / audio data is reproduced by the speaker 113 connected to the audio reproduction module 305. On the other hand, based on the reproduced video and audio, and additional information such as confirmation requests additionally input by field workers, the supervisor inputs further additional information and data for confirming the execution of the work procedure, such as the mouse 109 Information input through the device is input to the logic control module 302 via the confirmation input module 307 and input to the logic control module 302.

  Furthermore, the input information of the field worker reproduced by the remote information terminal device 103, that is, the input information of the field worker such as information such as video and sound or confirmation input is transmitted via the data recording module 306. The information is sent to the recording medium 116 and recorded in the remote information terminal device 103, and the same information is also recorded in the information recording device 104 on the network via the communication module 301 and the communication device 102.

Next, the information recording apparatus 104 will be described with reference to FIG. Note that the term “database” in the specification is abbreviated as DB for the sake of space.
The information recording device 104 is connected to the communication device 102 and mainly communicates with the information distribution device 105. From the information distribution device 105, a series of operations on the site centered on images transmitted from the field information terminal device 101. Is delivered.

  Information distributed from the information distribution device 105 is subjected to data processing in the logic control module 402 via the communication module 401 that performs communication according to the communication mode of the communication device 102 in the information recording device 104, and further in the database recording module 403 After being converted into an appropriate recording format, it is sent to the field information database 405.

  The site information database 405 is divided into the following four databases, namely, a procedure information database 406, a still image database 407, an audio information database 408, and a moving image database 409. Here, the procedure information database 406 corresponds to a database related to a series of procedure information such as request issuance, text input, image processing / recognition results, etc., for the approval of work and procedures according to the data format. Still image database 407 is a database related to still images transmitted from the site for work confirmation in important scenes of field work, and voice information database 408 is attached to field information terminal device 101. It is a database equivalent to a database that records the acoustic state of the site and the utterances of workers recorded by the microphone 112. The moving image database 409 is continuously transmitted from the site until the end of the site work, Data of moving images that can grasp the overall flow Is a database that corresponds to the base.

  The four databases from the procedure information database 406 to the moving image database 409 described above are classified by a plurality of work attributes such as work date and time, work place, worker, and work subject, and in response to requests from a large amount of accumulated data. Only necessary information is efficiently extracted and stored and managed in a reusable format.

  When an information search request is input from the remote information terminal device 103 via the information distribution device 105 while the work is continued or after the work is finished, the database is based on the search request contents processed via the communication module 401 and the logic control module 402. The search module 404 creates a data list in the database that matches the requested content.

  When an information browsing request corresponding to the search result is input, the database search module 404 accesses the site information database 405 and extracts the corresponding information according to the request contents, and the data in the database 405 is transferred to the information distribution device 105. Sent to.

  Further, when approval / confirmation procedure processing is performed in the remote information terminal device 103 based on transmission information from the field information terminal device 101 or information extracted and browsed from the information recording device 104 in advance, the information distribution device 105 The contents of the procedure processing are transmitted from the information recording apparatus 104 to the information recording device 104, and the procedure information database 406 in the site information database 405 is updated through the database recording module 403.

  Note that there may be a situation in which any one of the on-site information terminal device 101, the remote information terminal device 103, and the information distribution device 105 is operated in an integrated manner with the information recording device 104. There is no change in the basic processing except that the communication between the devices integrated with 104 is performed without going through the communication device 102.

  In the information recording apparatus 104, strict security is assumed for writing and correction in order to prevent fraud such as falsification of information. For example, a public key / private key encryption algorithm, which is widely used as a security method on the Internet, is introduced, and the secret key is strictly managed at the time of encryption, and it is possible to assume an operation mode in which the public key is generally distributed. .

  While tightening the authority to modify data, it is necessary to place importance on the transparency and certainty of data for the authority to access data.

  Next, the internal configuration of the information distribution apparatus 105 will be described with reference to FIG. 5, and transmission / reception of data between the communication apparatus 102 and the field information terminal apparatus 101, the remote information terminal apparatus 103, and the information recording apparatus 104 will be described.

  The information distribution apparatus 105 receives the information transmitted from the field information terminal apparatus 101 by the communication module 501 via the communication apparatus 102. Data (information) received by the communication module 501 is configured to be recorded by the information recording device 104 and distributed to the remote information terminal device 103 by the logic control module 502. Note that the operating state of the information distribution apparatus 105 can be monitored by a display device 1051 connected via the information display module 503 as necessary.

  When the plurality of site monitoring systems 101 function in the plant, that is, when the information distribution device 105 is in an environment where a plurality of site information terminal devices 101 and remote information terminal devices 103 are mixed, the information distribution device 105 105 can start line connection, distribution of information received from the terminal, and transmission to the information recording device 104 in response to a connection request from each field information terminal device 101.

  Furthermore, when connecting the remote information terminal device 103, the information distribution device 105 creates a list of already connected site information terminal devices 101 and transmits the list to the remote information terminal device 103 via the communication device 102. The remote information terminal device 103 can select a connection destination while referring to this list. In addition, the connection destination list includes the information recording device 104, and the information on the work performed in the past and recorded in the information recording device 104 using the on-site information terminal device 101 is also the on-site information being connected. It can be browsed in the same way as information such as live video transmitted from the terminal device 101 in real time.

  In addition, even if the work has already started and the information transmission by the field information terminal device 101 is continuing, the information recording device in parallel with receiving the live information distribution from the field information terminal device 101 by the remote information terminal device 103 It is also possible to connect to 104 and view / confirm a record of work progress information up to now.

  Next, the flow of data when the site monitoring system is operated will be described based on FIG. After receiving the connection request / authentication information 504 from the site information terminal device 101, the information distribution device 105 transmits a connection authentication / permission 505 to the site information terminal device 101 if there is no problem with the connection person and the connection terminal.

  Transmission of this connection authentication / permission 505 starts on-site information / procedure request transmission 506, and an approval / confirmation response from the remote information terminal device 103 is received in response to the procedure request, and on-site information / record information reception Obtained by 516.

  Next, with regard to data transmission / reception with the remote information terminal device 103, as in the case of the field information terminal device 101, after the connection request / authentication information 507 is sent to the distribution device 105, the connection authentication / permission 508 is received. Sent.

  Subsequently, an information communication session is started, and information is sequentially transmitted to the remote information terminal device 103 by reception of on-site information / record information and procedure request reception 509. Procedure confirmation / approval transmission 510 is performed based on a procedure request transmitted from the field information terminal device 101 for confirmation / approval necessary for work. A field information / procedure request record 511 is transmitted to the information recording apparatus 104 in order to record information transmitted from the field information terminal apparatus 101.

  Further, the remote information terminal device 103 transmits a record information search / reproduction request 512 for extracting information already recorded in the information recording device 104, and a history search result answer 513 as the search result is returned. Also, based on the reproduction request, the recorded information is extracted by the recorded information transmission 514 and reproduced on the remote information terminal device 103.

  A procedure confirmation / approval record 515 that records confirmation / approval by the supervisor of the information reproduced on the remote information terminal device 103 in response to the procedure confirmation request based on the series of recorded information reproduced is stored in the information recording device 104. Sent.

The configuration and function of each element constituting the on-site monitoring system according to the present invention have been described above. Next, an application example of the device of the present invention will be described.
FIG. 6 is a flow example of a meter instruction value recognition processing program installed in the above-described data processing module 205 inside the field information terminal device 101 or the data processing module 303 inside the remote information terminal device 103 .

This meter instruction value recognition processing program starts when image data is sent from the logic control module 204 or 302 to the data processing module 205 or 303 in response to an image processing request.

First, image data is loaded onto the memory of the processing program by the image input processing 601. Next, the edge detection process 602 detects a contour line corresponding to the contour shape of the meter. Thereafter, based on this contour line, noise is reduced and meter shape extraction processing 603 is performed.

  Next, based on the meter type information (type, place, shape) stored in the meter type database 605, a meter type pattern recognition process 604 is performed. Similarly, the extraction process 606 of the position or orientation of the pointer that indicates the value on the meter instruction plate is performed.

  Next, the instruction value reading process 607 is performed together with the numerical display position detection result in the meter, and then the output process 608 is performed using the numerical value obtained by the image processing as the recognition result, and the meter instruction value recognition process of the information processing module is performed. finish.

FIG. 7 shows an example of a flow realized by a valve opening degree recognition processing program installed in the data processing module 205 inside the field information terminal 101 or the data processing module 303 inside the remote information terminal 103.
This valve opening degree recognition processing program starts when the image data is sent from the logic control module 204 or 302 to the information processing module in response to the image processing request.

  First, an image is loaded onto the memory of the processing program by the image input processing 701. Next, after the smoothing process 702, a contour line corresponding to the contour shape of the valve is detected by a contour shape extraction process 703, and then a valve shape feature based on the detected contour line is extracted. Next, based on the valve type information (type, location, shape) stored in the valve information database 705, valve type pattern recognition processing 704 is performed.

  Next, the upper and lower end position detection processing 706 of the valve is performed from the contour shape, and the upper and lower end distance calculation processing 707 is performed to calculate the actual distance between the upper and lower ends from the valve type and the number of pixels on the image. Thereafter, conversion processing 708 from the valve stem position to the valve opening is performed. Then, an output process 709 is performed on the recognition result of the valve open / close state, and the valve opening degree recognition process of the information processing module is completed.

Next, a flowchart of internal processing in the site information terminal apparatus 101 will be described with reference to FIG.
In FIG. 8, the site information terminal apparatus 101 transmits a connection request to the information distribution apparatus 105 by the line connection request processing 801 by a method according to the line condition of the communication apparatus 102.

  After the line connection is made to the information distribution device 105 in response to this connection request, the program connection / authentication processing 802 for performing data communication is performed according to the identification information of the field information terminal device 101 and the identification information of the user. Make sure that the session you are trying to do is being performed by the appropriate device and user.

  After this confirmation is completed, the process proceeds to an on-site information transmission start process 803, and various information including video is transmitted from the site to the information distribution apparatus 105. As a series of work progresses, a situation in which the procedure confirmation request determination 804 is necessary is reached, for example, when a stage where the supervisor needs to approve or confirm the work progress is reached.

  In the procedure confirmation request determination 804, when a field worker needs a procedure confirmation request, the procedure confirmation request input process 805 selects information (video, audio, text information, etc.) related to the confirmation and requested items. Then, an input is performed by clicking a mouse 107 with a click button connected to the field information terminal device 101. In accordance with this input, image recognition processing 806 and the like are performed, and then a procedure confirmation request is transmitted to the information distribution apparatus 105 by procedure information transmission processing 807.

  In a situation where the supervisor stands by at the place where the remote information terminal device 103 is installed and watches the progress of the work as needed, the supervisor who has received the procedure information transmission process 807 confirms the contents and performs an approval process. As a result, the procedure confirmation reception process 808 allows the work to proceed to the next step, and the information transmission continuation process 809 is performed.

  One work is considered to be composed of multiple procedure confirmation items, but the above procedure is repeated as the work progresses, and when the work is completed, the information transmission end process 810 is reached and the line is disconnected to end the communication. Processing 811 is performed and the session is terminated.

  Next, FIG. 9 is a flowchart of internal processing in the remote information terminal device 103. In FIG. 9, the remote information terminal device 103 transmits a connection request to the information distribution device 105 by the line connection request processing 901 by a method according to the line condition of the communication device 102.

  After the line connection is made to the information distribution device 105 in response to this connection request, the program connection / authentication processing 902 for performing data communication is performed according to the identification information of the field information terminal device 101 and the identification information of the user. Make sure that the session you are trying to do is being performed by the appropriate device and user.

  After this confirmation is completed, one connection destination is selected and searched from one or a plurality of on-site information terminal devices 101 assumed as a connection destination of live video or an information recording device 104 as a supply source of past information. Selection is made in process 903.

  After selecting the connection destination, the connection destination is determined, and the process proceeds to the on-site / record information reception start processing 904. As a result, various information including video is started to be distributed from the field information terminal device 101 or the information recording device 104 via the information distribution device 105.

  As the series of work progresses, the procedure confirmation request determination 905 is performed each time a stage is reached where approval or confirmation regarding work progress is required according to the type of work. More detailed information regarding the procedure confirmation request determination is confirmed in the procedure detail browsing process 906, and after performing the image recognition process 907 and the supplementary procedure information input process 908 as necessary, the information is connected to the remote information terminal device 103. An input process for approval / confirmation is performed by clicking an input device such as a mouse 109 with a click button.

  In accordance with this input process, a procedure confirmation request is transmitted to the information distribution apparatus 105 in the procedure confirmation transmission process 909. In the case of live work, a worker is waiting at the place where the site information terminal device 101 is installed, and the worker who has received the procedure confirmation transmission 909 continues to work in the situation where the supervisor's approval is waiting. .

  That is, the work worker at the site receives the procedure confirmation reception 808 shown in FIG. 8 and can proceed to the next step, and the information reception continuation determination 910 is made. One work is considered to be composed of multiple procedure confirmation items. The above procedure is repeated as the work progresses, and when the work is completed, the information reception end processing 911 is reached and the line is used to end the communication. Disconnection processing 912 is performed, and the session on the remote information terminal device 103 side is terminated.

FIG. 10 is a diagram showing a screen example of the display 110 of the site information terminal device 101.
In the frame of the display screen 1001 of the display 110, there is a video display frame 1002 for displaying the state of the video transmitted from the site (the meter is shown in the figure) and for changing the resolution of the transmitted image. Resolution change button 1005, confirmation request transmission button 1006 for transmitting a procedure confirmation request in field work, image recognition processing button 1007 for executing image recognition processing, and results obtained by performing image recognition processing, input text information, etc. A text display frame 1008 to be displayed is arranged.

  These buttons are displayed on the screen, and the cursor 1004 that moves on the screen in conjunction with the movement of the mouse 107 with the input switch connected to the field information terminal device 101 is moved to the button coordinates on the screen, and the switch is turned on. It is considered that these buttons have been pressed by clicking.

  The marker 1003 is used as an aid when the supervisor and field workers communicate based on the transmitted site video, etc., but the cursor 1004 is moved into the video display frame 1002 and the mouse with input switch By pressing switch 107, the marker is displayed at the coordinates when it is pressed.

FIG. 11 is a diagram showing a screen example of the display 108 of the remote information terminal device 103.
In the frame of the display screen 1101 of the display 108, a video that displays a live video transmitted from the field or a previously recorded video transmitted from the information recording device 104 (in this case, a meter is also displayed) Display frame 1102, resolution display 1105 indicating the resolution of the transmitted image, procedure request approval button 1106 for transmitting procedure request confirmation / approval in field work, image recognition processing button 1107 for executing image recognition processing, and further image recognition A text display frame 1108 for displaying a result obtained by processing and text information input by a field worker in the field information terminal device 101 or input by a supervisor to the remote information terminal device is arranged.

  These buttons are displayed on the screen, and the cursor 1104 that moves on the screen in conjunction with the movement of the mouse 109 with the input switch connected to the remote information terminal device 103 is moved on the button coordinates of the screen, and the switch is turned on. It is considered that these buttons have been pressed by clicking.

  The marker 1103 is used as an aid when the supervisor and the field worker communicate with each other based on the transmitted site video, etc., but the cursor 1104 is moved into the video display frame and the mouse 109 with the input switch is used. By pressing the switch, the marker is displayed at the coordinates when it is pressed.

The embodiment described above can achieve the following effects.
(1). It is possible to provide the minimum necessary functions for simplifying the creation of on-site work records and for eliminating the temporal and spatial constraints of work attendance and confirmation work.
(2). The on-site information terminal device is provided with a display function for video and input information, so that information other than voice can be transmitted and received and information transmitted from the site can be confirmed.

(3). By adding a function for recording voice and on-site acoustic signals, it is possible to transmit on-site sounds and utterances of workers to the remote information terminal device and to record information.
(4). Smooth communication means can be provided by inputting text information or marker position information on video.

(5). The image compression function added to the front of the communication device not only enables efficient management of on-site information such as a series of images stored in the recording device, but also enables effective use of limited on-site communication resources. It becomes like this.
(6). The on-site monitoring function can be realized with a simple configuration without providing a separate information distribution device.

(7). Means for realizing smooth communication can be provided by the character information relating to the transmitted video information.
(8). Since it is possible to select the timing at which the site and the remote information terminal device transmit and receive video, it is possible to provide an effective means for more accurate communication.

(9). This on-site monitoring system automatically performs image processing and feature extraction processing, which not only reduces the input work for workers, but also prevents human errors such as reading errors and transcription errors. It is beneficial.

(Ten). This device can also make text information superimposed on video information the feature quantity extracted by the video feature quantity extraction processing means, so that workers can check the results of automatic processing and grasp the state of the site accurately can do.

(11). Since the image quality of the transmitted / received video can be set as a parameter, this device and infrastructure resources are effective when you want to focus on tracking the movement according to the work contents and communication conditions, or when you want to transmit clear video. Can be used for

(12). The remote information terminal device can handle past records in the same way as live information from the on-site information terminal device, thereby eliminating the simultaneity of witnessing work on site.

(13). By checking the progress of other work and confirming the past work by using the time during the other work witnessing, it is possible to improve the work efficiency by the parallel work regardless of the place.

(14). In addition to realizing a function for performing post-confirmation / approval that can be retroactively approved, it is possible to provide a function for browsing the work history of past similar work and other workers from the field.

(15). It will be possible to check the progress video of the work site working in parallel elsewhere.
(16). It is possible to achieve smooth execution of work when performing confirmation / approval work.
(17). Since the information recorded in the information recording apparatus can be protected, the safety of data management can be improved.
(18). A display function for video and input information is provided, and information other than audio can be transmitted and received and information transmitted from the site can be confirmed.

(19). By adding a function for recording voice and on-site acoustic signals, it is possible to transmit on-site sounds and utterances of workers to the remote information processing process and record information.
(20). Smooth communication means can be provided by inputting text information or marker position information on video.

(twenty one). Since the limited on-site communication resources can be used effectively, smooth on-site monitoring can be provided even in an environment where a plurality of information processing steps are operating simultaneously.
(twenty two). The on-site monitoring function can be realized with a simple configuration.

(twenty three). Means for realizing smooth communication can be provided by the character information relating to the transmitted video information.
(twenty four). Since the timing for transmitting and receiving video can be selected, it is possible to provide an effective means for more accurate communication.

(twenty five). By automatically performing image processing / feature extraction processing, it is possible not only to reduce the input work of workers but also to prevent human errors such as reading errors and transcription errors.

(26). Since the text information superimposed on the video information can be the feature quantity extracted by the video feature quantity extraction processing means, the worker can check the automatic processing result and accurately grasp the state of the site .

(27). Since the image quality of the transmitted / received video can be set as a parameter, communication resources can be used effectively even if you want to focus on tracking the movement according to the work content and communication conditions, or when you want to transmit clear video. Become.

(28). Since past records can be handled in the same way as information from the on-site information processing process in live, it is possible to eliminate the simultaneity of witnessing work on site.
(29). By checking the progress of other work and confirming the past work by using the time during another on-site work witness, it is possible to improve the work efficiency by witnessing parallel work regardless of location.

(30). In addition to realizing a function for performing post-confirmation / approval that can be retroactively approved, it is possible to provide a function for browsing the work history of past similar work and other workers from the field.

(31). It will be possible to check the progress video of the work site working in parallel elsewhere.
(32). It is possible to achieve smooth execution of work when performing confirmation / approval work.
(33). Since the information recorded in the information recording process can be protected, the safety of data management can be improved.

1 is a configuration diagram of an embodiment of an on-site monitoring system according to the present invention. The internal block diagram of a field information terminal device. The internal block diagram of a remote information terminal device. The internal block diagram of an information recording device. The figure which shows data transmission / reception with the internal structure of an information delivery apparatus, and another component. The meter instruction value recognition process flowchart. The valve opening recognition process flowchart. The processing flowchart of a field information terminal device. The processing flowchart of a remote information terminal device. The example of a display of a field information terminal device. The display example figure of a remote information terminal device.

Explanation of symbols

101 ... Site side information terminal device, 102 ... Communication device, 103 ... Remote information terminal device, 104 ... Information recording device, 105 ... Information distribution device, 106 ... TV camera, 107 ... Mouse with input switch, 108 ... Display for display, 109 ... mouse with input switch, 110 ... display for display, 111 ... speaker, 112 ... microphone, 113 ... speaker, 114 ... microphone, 115 ... recording medium, 116 ... recording medium.

Claims (10)

There was an on-site information terminal device carried to the site by a worker, a remote information terminal device installed at the site or in a place away from the site, and information received from the on-site information terminal device for distribution request An information distribution device for distributing information to the remote information terminal device and any one of the field information terminal device, the remote information terminal device, and the information distribution device are integrated or provided independently In an on-site monitoring system composed of an information recording device for recording information from the on-site information terminal device and a communication device for connecting and communicating between these devices,
The on-site information terminal device includes video information input means having a function of photographing the state of equipment installed on the site, and confirmation request information for inputting procedure confirmation request information to a supervisor at the installation location of the remote information terminal device. The communication means for transmitting the input means, the video information and the procedure confirmation request information to the communication apparatus and receiving a signal from the communication apparatus,
The information distribution apparatus includes one or a plurality of on-site information terminal devices and a single or a plurality of remote information including procedure information including a video for remotely monitoring information exchanged between a worker and a supervisor as needed. A communication means for distributing between terminal devices;
The remote information terminal device includes video information presenting means for confirming on-site work based on video information from the information distribution apparatus, a procedure confirming means having a function for a supervisor to approve work for procedure confirmation request information, and While transmitting information of procedure confirmation to the communication device, it comprises a communication means for receiving a signal from the communication device,
The information recording device is a means for transmitting and receiving part or all of information exchanged between a field worker and a supervisor, and a function for recording part or all of the information in a time series together with procedure request and approval information. It includes a procedure information recording means having,
The site information terminal device or the remote information terminal device,
After inputting the meter image data, the contour line corresponding to the contour shape of the meter is detected from this image data, and the meter shape extraction process is performed by reducing noise based on the detected contour line. Based on the meter model information stored in the model database, pattern recognition processing of the model of the meter is performed, and the position or orientation of the pointer indicating the value on the meter indicating plate is extracted. Meter indication value recognition processing that outputs the indication value reading processing result together with the numeric display position detection result in
After inputting the valve image data, the valve contour shape extraction process is performed from this image data to detect the contour line corresponding to the valve contour shape, and the valve shape feature based on the detected contour line is extracted, and the valve information Based on the valve type information stored in the database, the valve type pattern recognition processing is performed, the position detection processing of the upper and lower ends of the valve is performed from the contour shape, and the actual distance between the upper and lower ends is determined from the valve type and the number of pixels on the image. A valve opening recognition process that calculates the distance, and then performs conversion processing from the valve stem position to the valve opening and outputs the result;
A field monitoring system characterized in that at least one of the recognition processes is performed to extract a feature value such as a specific numerical value or characters from video data .   Video information display means for enabling a worker to confirm video information directly input from the video information input means or video information received from an information communication means from a remote information terminal device is provided in the field information terminal device. The on-site monitoring system according to claim 1.   The on-site monitoring system according to claim 1, wherein an on-site information terminal device is provided with acoustic information input means capable of recording on-site acoustic information.   4. The site monitoring system according to claim 1, wherein a text information input unit or a marker position information input unit is provided in the site side information terminal device.   5. The site monitoring system according to claim 1, wherein the site information terminal device includes a video information processing unit capable of compressing video information obtained by the video information input unit.   6. The site monitoring system according to claim 1, wherein either the site information terminal device or the remote information terminal device has the function of the information distribution device. There was an on-site information terminal device carried to the site by a worker, a remote information terminal device installed at the site or in a place away from the site, and information received from the on-site information terminal device for distribution request An information distribution device for distributing information to the remote information terminal device and any one of the field information terminal device, the remote information terminal device, and the information distribution device are integrated or provided independently Using an on-site monitoring system composed of an information recording device for recording information from the on-site information terminal device and a communication device for connecting and communicating between these devices,
Photographing the state of at least one of a meter and a valve installed at the site using video information input means provided at the site information terminal apparatus, and setting location of the remote information terminal apparatus using confirmation request information input means The procedure confirmation request information is input to the supervisor who is in the network, and the video information and the procedure confirmation request information are transmitted to the information distribution device by the communication device, and the signal from the information distribution device is received.
Procedure information including video for remotely monitoring information exchanged between a field worker and a supervisor using the information distribution device as needed, and including one or more on-site information terminal devices and one or more on-site information Distribute between remote information terminal devices,
By presenting a feature value such as a specific numerical value or a character in the video information of at least one of the valve and the meter from the information distribution device received by the remote information terminal device to the video information presentation means Confirming the work, and subsequently approving the work for the procedure confirmation request information, sending this approval information to the information distribution device,
An on-site monitoring method characterized in that, by using the procedure information recording means, a part of or all of information exchanged between an on-site worker and a supervisor is recorded in a time series as procedure request and approval information. 8. The on-site monitoring method according to claim 7 , wherein a worker confirms the video information directly input from the video information input means or the video information received from the remote information terminal device through the information communication means. The on-site monitoring method according to any one of claims 7 to 8 , wherein acoustic information input means is provided in the on-site information terminal device to record on-site acoustic information. The scene information terminal apparatus provided with a text information input means or the marker position information input means, the field information terminal device or the preceding claims 7, characterized in that to be able to see the text information or the marker position in the remote information terminal 9 The on-site monitoring method described in any one.

Images