JP7054310B2 - Video recording system - Google Patents

Description

An embodiment of the present invention relates to a moving image recording system that records a moving state of maintenance, monitoring work, and the like of equipment and devices on a plant production line.

In recent years, with the development of small electronic devices, it has become an environment where it is easy to shoot and record moving images. Since ancient times, it has been commonplace to utilize video recording like surveillance cameras, and it is thought that they will become even more popular in the future.

By the way, in maintenance and monitoring work (hereinafter referred to as maintenance, etc.) of plant equipment and equipment (hereinafter referred to as equipment, etc.), sound operation of hundreds to thousands of equipment, etc. may be confirmed. Such maintenance work is carried out at a fixed cycle such as daily, weekly, monthly, and yearly. The work such as maintenance is the work of confirming the soundness of many facilities and the like, and is often performed visually by humans.

The idea of automation that introduced a video recording system for such visual maintenance has been raised, but it has not been put into practical use, and human visual confirmation is still being carried out. The following reasons can be considered as the reasons why automation such as maintenance is not progressing.

Unlike automation of product inspection under limited conditions to determine whether the final product meets the standards, visual maintenance has a large number of target equipment, etc., and the points to be focused on depending on the equipment, etc. Is different. Therefore, it is difficult to establish an automation algorithm, and even if it is possible, it is costly. In addition, confirmation of soundness by maintenance or the like largely relies on the human senses of performing the confirmation work, which is also a factor that hinders automation.

When a video is taken of the situation such as maintenance, the number is large and a huge amount of video data is often left over. Confirmation of maintenance, etc. has an aspect of work that leaves confirmation that the equipment of the plant is always confirmed to be normal and sound. Therefore, simply recording and playing back the captured video data is inefficient in verifying the soundness.

In addition, there is a request to use the captured video data to examine and analyze the malfunction status and causes when an abnormality occurs in equipment, etc., but it is enormous and long as to where the target equipment is confirmed. It is difficult to find out from such video data.

The technique of Patent Document 1 has an advantage that wearable moving images can be efficiently used by making the hardware configuration easy to shoot. However, the process of starting / stopping shooting is triggered by the button attached to the main unit, and in this respect it is the same as a normal video camera.

In the technique of Patent Document 2, a wearable camera and a laser pointer are used to assist product inspection. Although it is effective for product inspection, there is a pre-model (in this case, the master image) called "what it should be", as in the algorithm "Matches with the master image?". However, if a highly accurate pre-model is essential, it is difficult to use for equipment maintenance.

Japanese Unexamined Patent Publication No. 2016-122115 Japanese Unexamined Patent Publication No. 2018-54439

An embodiment of the present invention has been made to solve the above-mentioned problems, and is a moving image recording that can easily extract inspection points for each equipment for maintenance and monitoring work of equipment on a plant production line. The purpose is to provide a system.

The moving image recording system according to the embodiment includes an image pickup device that captures moving images at the time of inspection of a plurality of facilities on a plant production line and generates moving image data, and a laser pointer that points to each inspection point of the plurality of facilities. , The moving image recording device connected to the imaging device and storing the moving image data, and the moving image data acquired when connected to the moving image recording device, and the point of the laser pointer on the image included in the moving image data. It is provided with a moving image editing device for determining whether or not the image includes the above and extracting an image including the point of the laser pointer as a part of the moving image data.

In the present embodiment, a video recording system capable of easily extracting inspection points for each equipment for maintenance and monitoring of equipment on the production line of the plant is realized.

It is a schematic block diagram which illustrates the moving image recording system which concerns on 1st Embodiment. It is a schematic diagram which illustrates a part of the moving image recording system of 1st Embodiment. It is a schematic timing chart for demonstrating the operation of the moving image recording system of 1st Embodiment. 4 (a) and 4 (b) are schematic views illustrating a part of the moving image recording system of the second embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
It should be noted that the drawings are schematic or conceptual, and the relationship between the thickness and width of each part, the ratio of the sizes between the parts, and the like are not necessarily the same as the actual ones. Further, even when the same part is represented, the dimensions and ratios may be different from each other depending on the drawing.
In addition, in the present specification and each figure, the same elements as those described above with respect to the above-mentioned figures are designated by the same reference numerals, and detailed description thereof will be omitted as appropriate.

(First Embodiment)
FIG. 1 is a schematic block diagram illustrating a moving image recording system according to the present embodiment.
As shown in FIG. 1, the video recording system 1 of the present embodiment includes a camera 10, a laser pointer 12, a video recording terminal 20, a video editing device 30, and a storage device 40.
The camera (imaging device) 10 captures a moving image of the subject 100 and converts it into moving image data. The moving image data may include audio data. The subject 100 is various equipment and devices installed in the plant. In the following, equipment and equipment shall be collectively referred to as equipment, and the term equipment shall include equipment.

The laser pointer 12 emits a laser beam 2 when an inspection worker presses a button 14. The laser pointer 12 may be separate from the camera 10, but is preferably integrated with the camera 10 as in this example. When the camera 10 and the laser pointer 12 are integrated, the direction of imaging and the direction of the laser beam 2 emitted by the laser pointer 12 can be made to be substantially the same. In the case of a separate body from the camera 10, the operator can emit the laser beam 2 by pressing a button provided on the laser pointer 12.

The laser pointer 12 irradiates the subject 100 with the emitted laser beam 2. Point 3 is formed on the subject 100 by the laser beam 2. When inspecting a necessary part of equipment or the like, the inspection worker presses the button 14 of the laser pointer 12 to irradiate the necessary part of the inspection with the laser beam 2 to form the point 3 on the subject 100. While forming the point 3, the inspection worker points the camera 10 at the subject 100 and shoots a moving image so that the point 3 enters the screen of the moving image.

In the moving image recording system 1 of the present embodiment, the inspection point is identified by irradiating the subject 100 with the laser beam 2 emitted by the laser pointer 12. Therefore, it is possible to reliably identify the inspection points of equipment that are sufficiently distant, as compared with the case of identifying the inspection points by pointing or the like.

The video recording terminal (video recording device) 20 records and saves video data captured by the camera 10. The moving image recording terminal 20 is an information processing terminal having a built-in processing device operated by a program and a storage device for storing the program. The video recording terminal 20 is, for example, a smartphone or a tablet-type computer terminal.

The video recording terminal 20 has a check sheet as an application program that lists the inspection points of the production line of the plant. When inspecting the equipment of the production line, the inspection worker calls the corresponding check sheet and inspects the production line according to the called check sheet.

FIG. 2 is a schematic diagram illustrating a part of the moving image recording system of the present embodiment.
FIG. 2 is an example of the screen 21 of the moving image recording terminal 20, and shows an example of a check sheet displayed on the screen 21.
As shown in FIG. 2, on the screen 21 of the moving image recording terminal 20, a check sheet of the corresponding production line (in the figure, the xxxxxx line and the production line name are shown) is displayed. The video recording terminal 20 stores not only one production line but also check sheets for inspection of a plurality of production lines, and an inspection worker selects a corresponding check sheet from among the check sheets for inspection of a plurality of production lines. It may be possible to select.

Further, in this example, it is displayed as "(daily report)", and it is shown that the corresponding check sheet is a daily report format check sheet used for daily inspection. The video recording terminal 20 has a plurality of types, for example, a daily report for each production line, a monthly report format check sheet that lists items to be inspected monthly, and a check sheet used for annual inspection. It may be set and the inspection worker may select an appropriate one.

The check sheet displayed on the screen 21 includes, for example, a date input field 22, a check start check box 23, and a check completion check box 24 in this example.

In the date input field 22, the inspection worker inputs the date on which the inspection of the corresponding inspection is performed.

The check start check box 23 and the check completion check box 24 are provided for each equipment name such as an item to be inspected, in this example, “equipment 1”, “equipment 2”, and the like.

The inspection worker checks the check start check box 23 when starting the inspection for each inspection item. When the inspection worker completes the inspection for each inspection item, he / she checks the check completion check box 24. The program of this check sheet records the time when the check start check box 23 and the check completion check box 24 are checked, and records the check flag together with the recorded moving image. Therefore, the moving image data can be associated with each of the plurality of facilities depending on the recording time of the check flag.

The explanation will be continued by returning to FIG.
The video editing device 30 acquires video data from the video recording terminal 20. As shown by the broken line in this example, the video editing device 30 may be connected to the video recording terminal 20 offline at normal times and connected to the video recording terminal 20 when transferring video data. Alternatively, the video editing device 30 is always connected to the video recording terminal 20, and for example, when the capacity of the video data stored in the video recording terminal 20 approaches the recording capacity of the video recording terminal 20, the video recording terminal 20 is used. 20 may automatically transfer the moving image data to the moving image editing device 30 or the like.

The moving image editing device 30 detects the image data including the point 3 of the laser pointer 12 among the moving image data acquired from the moving image recording terminal 20. The moving image editing device 30 extracts a portion of the moving image data including the point 3. The moving image editing device 30 stores the extracted moving image data in the storage device 40 as the edited moving image data. In addition to the video data after editing, the video editing device 30 stores the video data including the portion of the video data that does not include the point 3 in the storage device 40 as the video data before editing. The moving image editing device 30 can access the desired moving image data of the storage device 40 at any time, and can read, play back, and display the moving image data before editing and the moving image data after editing at any time.

As described above, the storage device 40 stores the moving image data after editing and the moving image data before editing by the moving image editing device 30.

The moving image editing device 30 and the storage device 40 are, for example, computer devices. The storage device 40 may be a storage device connected to or built in the moving image editing device 30, or may be a storage area such as a data server connected by a communication network or the like.

The operation of the moving image recording system of this embodiment will be described.
FIG. 3 is a schematic timing chart for explaining the operation of the moving image recording system of the present embodiment.
FIG. 3 shows matters related to the edited moving image data, and a check signal, a portion of the recorded moving image data, and a signal indicating that the button 14 of the laser pointer 12 is pressed are displayed on the same time axis. Shows.

As described in FIG. 2, the check signal is recorded when the check start check box 23 and the check completion check box 24 are checked on the check sheet displayed on the screen 21 of the video recording terminal 20. It is a signal. The check signal is associated with the time of the moving image data and is stored together with the moving image data. Since the check signal is associated with the equipment name to be inspected by the application program on the moving image recording terminal 20, the moving image data between the two check signals (first identification signal and second identification signal) is to be inspected. It is related to the inspection work of the equipment of.

For example, a case where the “equipment 1” in FIG. 2 is inspected will be described.
First, when the inspection of "equipment 1" is started, the check box 23 for starting the check of "equipment 1" is checked. The moving image recording terminal 20 records a check signal indicating that the check start check box 23 is checked at time t1.

The video recording terminal 20 starts recording video data sent from the camera 10 by inputting a check signal. The moving image recording terminal 20 records the moving image data until the input of the next check signal. In this example, when the check box 24 for completing the check of "Equipment 1" is checked at time t6, the check signal is recorded, and at time t5, the recording of the moving image of "Equipment 1" ends.

The moving image recording terminal 20 records a moving image during the time when the two check signals are recorded, and in this example, the moving image recording terminal 20 records a part a to e of the moving image data. The moving image data including the parts a to e of the moving image data is stored in the moving image recording terminal 20 in association with the “equipment 1” and the acquisition date.

This moving image data is transferred to the moving image editing device 30 and stored in the storage device 40. Similarly for other equipment, the moving image data is stored in the moving image recording terminal 20 in association with the equipment name and the acquisition date, transferred to the moving image editing device 30, and stored in the storage device 40.

The moving image data portion includes data including the point data of the laser pointer 12 by the inspection worker and data not including the point data of the laser pointer 12. The moving image data portions a and d do not include the point 3, and the moving image data portions b, c and e include the point 3.

When the inspection worker starts the check of "equipment 1", he presses the button 14 of the laser pointer 12 to point to the inspection point. The recorded moving images b and c show the point 3 at that time. The inspection worker keeps pressing the button 14 of the laser pointer 12 for a period from time t2 to t3 to check the same inspection point.

After the time t3, the inspection worker once turns off the button 14 of the laser pointer 12, and then at the time t4, points to another inspection point of the “equipment 1”. The inspection worker keeps pressing the button until the time t5 to inspect the part.

The moving image editing device 30 analyzes the image data of the acquired moving image data and determines whether or not the point 3 of the laser pointer 12 is included in the image data. The moving image editing device 30 adds flag data to the moving image data before editing, with the period in which the point 3 of the laser pointer 12 is included in the image data as the inspection period. In this example, the moving image editing device 30 adds flag data to the recorded moving images b and c. Further, the moving image editing device 30 adds flag data to the recorded moving image e.

The moving image editing device 30 determines whether or not the point 3 is included in the image data by analyzing the image data. On the other hand, the distance from the camera 10 and the laser pointer 12 to the subject may be different, or the equipment that is the subject may be moving, and the size, brightness, etc. of the point 3 may be significantly different or fluctuate. Sometimes. On the other hand, in the inspection work, since the same item is repeatedly carried out, it is possible to collect a large amount of data for determination. Therefore, by introducing a deep learning technique or the like into the image analysis, it is possible to accurately determine the presence or absence of the point 3 in response to various variable conditions.

The moving image editing device 30 stores the moving image data before adding the flag data in the storage device 40 as the moving image data before editing, and stores the moving image data to which the flag data is added in the storage device 40 as the operating data after editing. do.

The moving image editing device 30 reads out the moving image data before editing or the moving image data after editing from the storage device 40 and reproduces the moving image data. When the moving image data before editing is selected, the moving image editing device 30 reproduces the moving image data recorded in the moving image recording terminal 20 over the entire period regardless of whether or not the inspection point is inspected. When the edited moving image data is selected, the moving image editing device 30 reproduces only the moving image data including the point 3, that is, the moving image data from which the inspected portion is extracted.

Since the equipment name is associated with each video data via the inspection time, by adding an appropriate search program, the part of the video data showing the inspection status of the desired equipment can be quickly searched. Can be played.

The effect of the moving image recording system 1 of the present embodiment will be described.
In the moving image recording system 1 of the present embodiment, since the moving image recording terminal 20 associates the inspection time with the equipment name, it is possible to record and save the moving image data for each equipment to be inspected. Therefore, the moving image editing device 30 can quickly search for and reproduce the inspection record of the desired equipment.

In the moving image recording system 1, it is possible to quickly search the inspection record of the desired equipment and save and reproduce the moving image data of all the inspection records including the situation before and after the inspection of the desired equipment. Therefore, by verifying the moving image data including before and after the place where the defect occurs in the corresponding production line, it can be useful for investigating the cause of the defect, analyzing the cause, and the like.

In the moving image recording system 1, the inspection point is pointed by the laser pointer 12, and the moving image data including the point 3 is extracted by the moving image editing device 30. Since the extracted video data is associated with the inspection date by the video recording terminal 20, the video data for each inspection date can be reproduced in a short time only for the part related to the inspection item, and the reliability of the inspection, etc. Allows you to verify.

(Second embodiment)
In the above-described embodiment, the inspection record is saved and reproduced as moving image data regardless of the inspection operator. Depending on the skill of the inspection worker, even if the inspection contents are the same, the inspection contents may be substantially different. In this embodiment, in further automation of maintenance and the like, data for applying deep learning technology to inspection contents and judgment criteria at the time of inspection is provided.

4 (a) and 4 (b) are schematic views illustrating a part of the moving image recording system of the second embodiment.
FIG. 4A is an example of the screen 221 of the video recording terminal 220, and shows an example of the check sheet displayed on the screen 221. The video recording terminal 220 of this embodiment has the same hardware as the video recording terminal 20 of the other embodiments described above, but the application program for displaying the check sheet is partially different.
As shown in FIG. 4A, a check sheet for the corresponding production line is displayed on the screen 221 of the video recording terminal 220. In this check sheet, the date input field 222, the check start check box 223, and the check completion check box 224 are the same as in the other embodiments described above.

In this check sheet, an inspection worker input field 225 for inputting the name of the performer who carries out the inspection work is newly provided. In this example, the inspection worker input field 225 is a pull-down menu, and the pull-down menu lists the names of the persons who perform the inspection work registered in advance. The person who actually performs the inspection work searches for his / her own name from the pull-down menu and sets it.

The inspection worker, the date of inspection, the inspection start time and the inspection completion time are all associated with each equipment name.

FIG. 4B is an example of a table showing the association regarding the moving image data in the case of the present embodiment.
As shown in FIG. 4B, the table 242 includes an inspection worker column 242a, an overall moving image data column 242b, and an extracted moving image data column 242c. For example, this table 242 is generated for each equipment name and stored in the storage device 40 by the moving image editing device 30.

In the inspection worker column 242a, the name of the inspection worker selected from the pull-down menu is input. In the whole moving image data field 242b, moving image data including an image that does not include the point 3 of the laser pointer 12 is input. In the extracted moving image data field 242c, moving image data from which an image including the point 3 of the laser pointer 12 is extracted is input.

In this embodiment, in this way, the name of the inspection worker is associated with all the moving image data and stored in the storage device 40 for each facility.

The moving image recording system of the present embodiment operates in the same manner as in the case of the other embodiments described above, and a database associated with the inspection worker can be constructed and stored in the storage device 40.

Audio data can also be recorded in the moving image data at the same time. For example, some inspection workers may be able to recognize that abnormal noise or the like is generated from the equipment or its surroundings during the inspection of the equipment. In addition, it is possible to recognize an abnormality in equipment that is difficult to convey only with an image of moving image data and a precursor thereof, and explain and record the content with one's own voice. Since the degree of recognition of these situations differs depending on the skill of the inspection worker, when developing a deep learning program for automation by temporarily recording it in video data and comparing it with others. It can be used as data.

According to the embodiment described above, it is possible to realize a video recording system capable of easily extracting inspection points for each equipment and equipment for maintenance and monitoring work of equipment and equipment on the plant production line.

Although some embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are also included in the scope of the invention and its equivalents described in the claims. In addition, each of the above-described embodiments can be implemented in combination with each other.

1 video recording system, 2 laser beam, 3 points, 10 cameras, 12, laser pointer, 14 buttons, 20, 220 video recording terminal, 30 video editing device, 40 storage device, 100 subjects

Claims (5)

An imaging device that captures video during inspection of multiple facilities on the plant production line and generates video data,
A laser pointer that points to each inspection point of the plurality of equipment,
A moving image recording device connected to the imaging device and storing the moving image data,
The moving image data is acquired when connected to the moving image recording device, and the moving image data is acquired.
It is determined whether or not the image included in the moving image data includes the point of the laser pointer.
A moving image editing device that extracts an image including a point of the laser pointer as a part of the moving image data, and a moving image editing device.
Video recording system with. The moving image recording system according to claim 1, wherein the moving image recording device applies an identification signal for identifying each of the plurality of facilities to the moving image data. In the moving image recording device ,
The identification signal includes a first identification signal and a second identification signal.
The first identification signal is added to the moving image data when the inspection of each of the plurality of facilities is started.
The second identification signal is added to the moving image data when the inspection of each of the plurality of facilities is completed.
The video editing device is
The moving image recording system according to claim 2, wherein the moving image data between the first identification signal and the second identification signal is determined to identify each of the plurality of facilities. Further, a storage device connected to the video editing device and storing data possessed by the video editing device is provided.
The video editing device is
Unedited moving image data including both the extracted part of the moving image data of the image including the point of the laser pointer and the moving image data part of the image not including the point of the laser pointer.
Edited image data including the extracted part of the moving image data of the image including the point of the laser pointer, and
The moving image recording system according to any one of claims 1 to 3, wherein the image is stored in the storage device and read from the storage device. The moving image recording device is any one of claims 1 to 4, which stores the moving image data of each of the plurality of facilities in association with the date when the moving image data was acquired and the inspection worker who captured the moving image data. The video recording system described in one.

Images