JP6063753B2 - Visual inspection device - Google Patents

Description

  The present invention relates to a visual inspection technique. The present invention also relates to a visual inspection device for obtaining a moving image of an object by an imaging unit and performing a visual inspection by a person.

  For example, facilities such as nuclear power plants are required to have high safety, and sufficient inspections must be carried out regularly. Examples of the inspection object include structures such as a reactor pressure vessel, a shroud in the vessel, a core support plate, and a fuel assembly. There are also inspections outside the nuclear reactor for fuel assemblies stored outside the nuclear reactor.

  As one of the inspection methods, there is a visual inspection method, that is, a method in which an inspector visually inspects a moving image obtained by imaging the surface of an object using an optical camera or the like. In the visual inspection, for example, an optical camera is brought close to the object to some extent, and a portion of the object to be inspected is photographed. A color or gray scale moving image is acquired from the optical camera, and the moving image is displayed on a monitor and visually inspected by an inspector. The acquired moving image is recorded in the storage means so that it can be confirmed later. In addition, the optical camera is equipped with a drive device and lighting device so that detailed shooting locations and lighting conditions for the object can be moved and changed, and the shooting position and lighting state of the optical camera can be automatically or visually determined by a visual inspection device. In some cases, it has a function that can be controlled and operated manually from a remote place by a person.

  The visual inspection may be performed in an environment where there is a lot of radiation such as gamma rays, such as a nuclear power plant. In this case, radiation noise is superimposed on the captured moving image. Radiation also damages the electronic circuitry in the optical camera and gradually loses its function. The more miniaturized semiconductors in recent years are vulnerable to the damage caused by the radiation. Therefore, a high-resolution camera element, a wide dynamic range camera element, and an integrated circuit necessary for transmitting a large amount of image signals at high speed cannot be used as imaging means for visual inspection of a plant or the like. When priority is given to durability against radiation, an optical camera that does not use much of the electronic circuit as described above, that is, an optical camera with a low resolution, a narrow dynamic range, etc., is employed.

  Further, in the nuclear reactor, since there is usually no illumination and darkness, at the time of visual inspection, the inspection illumination device is brought close to the optical camera together with the optical camera to illuminate and photograph. In many cases, a nuclear reactor has a three-dimensional and complicated structure, so that a space area where an optical camera and an illumination device can be installed and a range where illumination can reach are limited. For this reason, in photographing the inspection object, the illumination is partially insufficient or excessive, and in the photographing moving image for inspection, the brightness difference is increased and the visibility is deteriorated. Therefore, it becomes difficult to obtain high reliability in the visual inspection of the inspection object.

  As countermeasures for the above problems, there are a method of devising a photographing means such as an optical camera, and a method of devising image processing for a moving image photographed and acquired by the optical camera.

  As the former method, for example, a radiation shield is provided in the optical camera, and the radiation is shielded so as not to hit the electronic circuit of the optical camera. This reduces the influence of radiation on the optical camera and the captured moving image.

  As the latter method, for example, image quality improvement processing or the like is performed on a moving image taken by an optical camera, and visual inspection is performed using the moving image (referred to as an image quality improved moving image or the like).

  Examples of prior art relating to the latter method include Japanese Patent Application Laid-Open No. 2008-278143 (Patent Document 1) and Japanese Patent Application Laid-Open No. 2012-032217 (Patent Document 2).

  Patent Document 1 discloses a method of performing image quality improvement processing such as super-resolution processing and signal enhancement processing on a captured moving image. Japanese Patent Application Laid-Open No. 2004-151561 describes that “... a high-resolution image having a higher resolution than the inspection image is created from the inspection image”. With this configuration, the inspection image is subjected to super-resolution processing to improve the resolution. In addition, “....... has an image enhancement device that performs brightness enhancement processing on a high-definition image”. With this configuration, luminance enhancement processing such as edge enhancement is performed on the high-definition image to improve visibility.

  Patent Document 2 discloses a method of performing image quality improvement processing such as noise removal processing on a captured moving image. In patent document 2, it describes also about the visual inspection in a plant. Japanese Patent Application Laid-Open No. 2003-228561 describes that “... frame synthesis is performed on a plurality of frames to generate a frame having a higher SN ratio than each frame before frame synthesis”. With this configuration, signal noise is preserved in the captured image, and radiation noise is reduced.

  Patent Document 2 also discloses a method for adjusting conditions for image quality improvement processing. In Japanese Patent Laid-Open No. 2004-228688, “... processing for removing a signal (noise) almost independent for each frame with respect to a deteriorated video obtained by superimposing noise on the calibration video in a pseudo manner. "Adjust based on the video obtained by doing ..." and the like. In addition, “... noise removal processing parameters include, for example, display rate, number of frames, synthesis method, weight, alignment method, and frame synthesis method”. With this configuration, the conditions for image quality improvement processing are adjusted.

JP 2008-278143 A JP2012-032217A

  With respect to a method for devising processing of moving images photographed and acquired by an optical camera in visual inspection of the plant or the like, the prior art examples have the following problems.

  In the method of Patent Document 1, image quality improvement processing such as super-resolution processing and luminance enhancement processing is used. In the method of Patent Document 2, image quality improvement processing such as noise removal processing is used. When the above-described image quality improvement processing is used for a captured moving image, it is common to adjust the degree of image quality improvement of the processing using parameters or the like. Depending on how the parameters and the like are adjusted, the visibility in the moving image after the image quality improvement processing is increased or decreased. Depending on how the parameters are adjusted, sufficient visibility cannot be obtained, and the reliability of visual inspection becomes low.

  Further, the image quality improvement processing of the captured moving image is often a complex algorithm in which many parameters are combined. Therefore, it is not easy for the inspector to suitably adjust these various parameters. In particular, an inspector who performs a visual inspection using a visual inspection apparatus at a site such as a plant is not always familiar with the contents of the image quality improvement processing, and thus the parameter adjustment is more difficult.

  Further, the output destination (also referred to as a transmission destination) for visual inspection of the captured moving image or the image quality improvement moving image is not limited to one and may be various. For example, there are a case of outputting to a monitor for a specific inspector according to a moving image and a case of saving in a storage means such as a storage. In a conventional visual inspection apparatus, it is not easy for a person such as an inspector to grasp and work with a plurality of various output destinations as described above, and the burden is large. In addition, when there are a plurality of various moving images and image quality improvement processing thereof, it is not easy to adjust and grasp which image quality improvement processing should be performed on which moving image and output to which output destination.

  Further, for example, when visual inspection is performed on the inside of a nuclear power plant, as described above, for example, each target portion of the inspection object may be photographed in each direction / distance while moving an optical camera or the like remotely. In addition, the lighting state at that time also changes. Although it is necessary or effective to perform image quality improvement processing by adjusting appropriate conditions and parameters as described above according to moving images having various contents as described above, it is not easy in the past.

  Further, for example, when visual inspection is performed on the inside of a nuclear power plant, radioactive substances due to radiation may adhere to the optical camera or a visual inspection apparatus connected thereto as described above. Countermeasures against this, for example, prevention or removal of radioactive substances, are necessary or effective, but have not been sufficiently studied.

  Although Patent Document 1 and Patent Document 2 describe image quality improvement processing for a single moving image, image quality improvement processing, output destination, and visual inspection work support for a plurality of various moving images as described above. There is no description about the mechanism for this.

  In the prior art examples such as Patent Document 2, it is described that the image processing conditions are adjusted using, for example, an image for calibration. It does not describe a mechanism for making it easy for inspectors and others to adjust and grasp parameters.

  Conventional visual inspection devices are inadequate for user interfaces and other mechanisms that effectively support operations such as adjustment and grasping of the various and complex moving images, image quality improvement processing, output destinations, etc. described above by inspectors. There is a problem.

  The main object of the present invention relates to the technology of visual inspection for the above-mentioned plants and the like, adjustment of various and complex moving images, image quality improvement processing conditions / parameters, and output destinations by persons such as inspectors. It is to provide technology that can facilitate and improve efficiency by supporting tasks such as grasping. For example, to provide a visual inspection device having an effective user interface for visual inspection.

  In order to achieve the above object, a representative embodiment of the present invention is a visual inspection device for performing a visual inspection by an inspector using a moving image obtained by photographing a plant object, and has the following configuration. It is characterized by having.

  The visual inspection apparatus captures a plant object and outputs a first moving image, and generates a second moving image by performing moving image processing including image quality improvement processing on the first moving image. A plurality of moving image data receiving means including a moving image processing unit, one or more storage units, and one or more display units, which are candidates for receiving at least one moving image data of the first or second moving image; A user interface unit that performs control processing for generating and displaying a screen for an operation by a user including an inspector, and the first and second moving images of the moving image processing unit based on a user operation on the screen A transmission selection unit that selects which of the plurality of moving image data receiving means to transmit the plurality of moving image data including; and first and second of the moving image processing unit based on a user operation on the screen. Multiple video files including A character assigning unit that assigns an arbitrary character by the user to the specified moving image data, according to a selection state by the transmission selection unit, A plurality of moving image data including the first and second moving images is transmitted from the moving image processing unit to the plurality of moving image data receiving means, and the moving image data transmitted to the storage unit is stored and transmitted to the display unit The displayed moving image data is displayed, and in the case of displaying the moving image data to which the character is added, the image is displayed in a state where the character is superimposed on the image.

  In addition, the visual inspection apparatus includes a moving image process to be applied to a plurality of moving image data including the first and second moving images and a condition adjusting unit that adjusts the condition or parameter based on a user operation on the screen. A plurality of moving image data including the first and second moving images, moving image processing to be applied to each moving image data, its conditions or parameters, and each of the moving image data based on a user operation on the screen Information management is performed on the relationship between the elements including the moving image data receiving means that is the transmission destination of the moving image data.

  According to a typical embodiment of the present invention, regarding the visual inspection technology for the plant or the like, the inspector adjusts various and complicated moving images, image quality improvement processing conditions / parameters, output destinations, and the like. Can be made easier and more efficient by supporting tasks such as and understanding. For example, a visual inspection device having an effective user interface for visual inspection can be provided.

It is a figure which shows the whole structure of the visual inspection system of Embodiment 1 of this invention. It is a figure which shows the detailed structural example of the visual inspection apparatus of Embodiment 1. FIG. 6 is a diagram illustrating an example of display of a GUI screen on a monitor according to Embodiment 1. FIG. 5 is a diagram illustrating an example of transmission selection in Embodiment 1. FIG. 5 is a diagram illustrating an example of a relationship between elements such as data information in the first embodiment. FIG. It is a figure which shows an example, such as transmission selection in the visual inspection apparatus of Embodiment 2. 10 is a diagram illustrating a display example of a GUI screen in Embodiment 2. FIG. 10 is a diagram illustrating a display example of a GUI screen in the visual inspection device according to Embodiment 3. FIG. FIG. 10 is a diagram showing an outline of processing of moving image data in a third embodiment. 10 is a time chart example of moving image data processing in the third embodiment. It is a figure which shows the outline | summary of the process in the visual inspection apparatus of Embodiment 4. FIG. FIG. 20 is a diagram illustrating a display example of a GUI screen in the fourth embodiment. 10 is a diagram illustrating a configuration example of condition / parameter information management in Embodiment 4. FIG. FIG. 10 is a diagram illustrating a configuration example of information management in the visual inspection device according to the fifth embodiment. FIG. 10 is a diagram showing an outline of processing in a visual inspection apparatus according to a sixth embodiment. FIG. 20 is a diagram illustrating a display example of a GUI screen in the sixth embodiment. FIG. 10 is a diagram illustrating a configuration of a system including a visual inspection device according to a seventh embodiment. FIG. 38 is a diagram showing a configuration of a modified example of the seventh embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that components having the same function are denoted by the same reference symbols throughout the drawings for describing the embodiment, and the repetitive description thereof will be omitted. For the sake of explanation, symbols such as X, Y, etc. are appropriately used in addition to the signs.

<Summary>
The visual inspection system including the visual inspection apparatus 1 (FIG. 1 and the like) according to the present embodiment is generated by a moving image process including a captured moving image obtained by photographing the object 20 of the plant 2 and an image quality improvement process for the captured moving image. It has an image quality improvement processing function by a moving image processing unit that handles a plurality of moving image data including an image quality improved moving image. The visual inspection apparatus 1 includes a plurality of moving image data receiving means 15 including a monitor 16 and a storage unit 17 as transmission destinations or output destinations of the moving image data. The visual inspection apparatus 1 has a function of transmitting / outputting each moving image data to the selected moving image data receiving means 15 according to the operation of the inspector who is a user on the GUI screen. Provided by the selection unit 12 or the like.

  Further, the visual inspection apparatus 1 is a function for managing information by associating the plurality of moving image data, the image quality improvement process, the conditions and parameters thereof, and the plurality of transmission destinations based on a user operation on the GUI screen. In addition, the condition adjusting unit 18 provides a function capable of easily adjusting and setting the conditions / parameters of the image quality improvement processing.

  In addition, the visual inspection device 1 can provide inspection information and the like for each video of each transmission destination in accordance with a user operation on the GUI screen so that the relationship between a plurality of elements in the transmission selection and the like can be easily understood. In particular, the character assigning unit 14 provides a function capable of assigning an arbitrary character.

  The visual inspection apparatus 1 transmits and outputs a plurality of moving image data including the photographed moving image and the image quality improved moving image, for example, in parallel to the moving image data receiving unit according to the transmission selection.

<Embodiment 1>
A visual inspection system according to Embodiment 1 of the present invention will be described with reference to FIGS. In the first embodiment, a basic configuration is shown, and in the second and subsequent embodiments, components are added and processing contents are changed on the premise of the first embodiment.

  In the first embodiment, a solution is provided for problems that arise when moving image processing or image processing such as image quality improvement processing is introduced for visual inspection. One of the problems is that, as described above, it is not easy for the inspector to grasp and adjust various image quality improvement processing conditions and parameters. As this solution, functions such as a unique GUI screen and its control processing are provided to support visual inspection work by users including inspectors. As a result, adjustment and grasping of image quality improvement processing conditions, parameters, and the like can be facilitated, and flexible selection and management of which moving image is subjected to what image quality improvement processing and output to which transmission destination can be performed.

[System (1)]
FIG. 1 shows the overall configuration of the visual inspection system according to the first embodiment. The system includes a visual inspection device 1 and a plant 2. In FIG. 1, the visual inspection device 1 is arranged outside the plant 2, and only the photographing unit 21 is arranged in the plant 2. The imaging unit 21 and the moving image processing unit 13 of the visual inspection device 1 are connected by a cable 22. The visual inspection device 1 may be disposed inside the plant 2. Moreover, it has the inspector U as a user who operates the visual inspection apparatus 1. The inspector U performs a visual inspection by displaying a captured moving image of the object 20 or a moving image with improved image quality on the screen of the monitor 16.

  The plant 2 is a nuclear power plant in the present embodiment, and an object 20 for visual inspection and an imaging unit 21 are arranged. The object 20 is various components of the plant 2, and includes, for example, structures such as tubes and plates, or various substances such as fuel. In the present embodiment, the object 20 includes a case where the object 20 is a nuclear reactor having a large radiation dose. Therefore, only the imaging unit 21 is arranged near the object 20 for imaging, and the visual inspection apparatus 1 that is another element is arranged outside the plant 2 that is an environment with a large radiation dose.

  The photographing unit 21 is a moving image acquisition unit that captures a surface of the object 20 in the plant 2 and acquires a moving image (referred to as a captured moving image), and includes an optical camera or the like. Moreover, the imaging | photography part 21 may be provided with the illuminating device and drive device regarding imaging | photography as mentioned above. As the type of the photographing unit 21, for example, an optical camera incorporating an image pickup tube, CCD, CMOS, or the like can be used. The photographing unit 21 can capture a color or gray scale moving image. The moving image shot by the shooting unit 21 is transmitted to the moving image processing unit 13 via the cable 22. In addition, it is good also as a form transmitted by radio | wireless instead of the wired cable 22. FIG. In that case, a wireless communication interface device or the like is provided.

  The photographing unit 21 is installed at a position where the object 2 inside the plant 2 can be photographed. In the case of visual inspection, the camera of the imaging unit 21 is imaged relatively close to the object 20. The photographing unit 21 is not limited to a fixed camera, and can move the position of the camera and control the operation through a driving device by remote control from the outside, that is, the inspector U or the visual inspection apparatus 1. The imaging unit 21 can take an image from a desired angle and distance around a desired location of the object 20 according to the remote control. The remote control may be automatic computer control of the visual inspection apparatus 1 or manual control by the inspector U.

  Further, when the plant 2 is a nuclear power plant, the imaging unit 21 is affected by radiation as described above, and radiation noise is superimposed on an image of the captured moving image. Therefore, when priority is given to durability against radiation, a high-resolution / wide dynamic range camera including fine semiconductor elements and integrated circuits is hardly used, and a relatively simple optical camera is used. . Therefore, the moving image obtained by the optical camera has a relatively low resolution and a narrow dynamic range. Further, the vicinity of the object 20 in the plant 2 is dark because there is no normal illumination. At the time of visual inspection, the inspection illumination device is brought close to the location of the object 20 together with the camera of the imaging unit 21, and the object 20 is imaged while being illuminated. In addition, the plant 2 often has a three-dimensional and complicated structure, and since the area / position where the camera of the photographing unit 21 can be installed and the range where the illumination for inspection reaches can be limited, the illumination is partially insufficient or excessive. There is a case. Therefore, the captured moving image often has poor visibility for the inspector U. In this system, the visual inspection of the object 20 can cope with various factors such as radiation and illumination, and provides a function for realizing high reliability by a suitable visual inspection.

  The visual inspection device 1 has a basic control unit 10, a GUI control unit 11, a moving image processing unit 13, a character assigning unit 14, and a plurality of moving image data receiving means 15. The GUI control unit 11 includes a transmission selection unit 12 and a character assignment unit 14. The plurality of moving image data receiving means 15 includes a plurality of monitors 16 and a plurality of storage units 17. The photographing unit 21 may be regarded as a part of the visual inspection apparatus 1.

  The basic control unit 10 performs basic control as a computer of the visual inspection apparatus 1. The basic control unit 10 realizes each unit including the GUI control unit 11 and the moving image processing unit 13 by software program processing or a dedicated circuit.

  The GUI control unit 11 performs control processing for providing a GUI (graphical user interface) screen for the user (U) of the visual inspection device 1 based on the control by the basic control unit 10. The GUI control unit 11 includes a transmission selection unit 12 and a character assignment unit 14 as processing units realized as a part of the GUI function. The GUI control unit 11 generates GUI screen data, transmits it to the monitor 16, and displays it. The GUI control unit 11 receives user (U) input information on the GUI screen, performs control processing in accordance with the input information, and outputs the result information to the GUI screen. In the case where the monitor 16 itself includes a display and a computer, the GUI control unit 11 may be implemented by the computer of the monitor 16. In addition to the monitor 16 for the inspector U, it can be displayed on a display dedicated to the GUI screen, for example, a display provided in the visual inspection apparatus 1.

  The transmission selection unit 12 is a transmission destination of a plurality of moving images including each captured moving image in the image capturing unit 21 and an image quality improved moving image after processing in the moving image processing unit 13 in accordance with an operation on the GUI screen by the user (U). Or, the moving image data receiving means 15 as an output destination is selected. Then, according to the transmission selection, a control process for transmitting moving image data from the moving image processing unit 13 to the transmission destination is performed. On the GUI screen, the user (U) can select and set which moving image is processed, transmitted to which moving image data receiving means 15. In the first embodiment, according to the selection by the transmission selection unit 12, a plurality of moving image data is transmitted in parallel from the moving image processing unit 13 to the data receiving means 15 of a plurality of designated transmission destinations (described later in FIG. 2). FIG. 4 etc.). Note that the plurality of moving image data can be transmitted not only in parallel but also in a permutation. For example, when transmitting in parallel, such as when two moving images are to be reproduced and displayed at the same time, they can be transmitted by synchronous processing.

  The moving image processing unit 13 performs image quality improvement processing on the captured moving image, which is the moving image data input / acquired from the imaging unit 21, according to the operation on the GUI screen by the user (U) as necessary, and the processed moving image Generate a video with improved image quality. The moving image processing unit 13 performs image quality improvement processing on the moving image data specified by the user (U) according to the specified conditions and parameters. Then, the moving image processing unit 13 performs processing for transmitting the captured moving image and the image quality improved moving image to the moving image data receiving unit 15 serving as a transmission destination designated by the user (U).

  The character assigning unit 14 performs a process of assigning an arbitrary character to each of a plurality of pieces of moving image data including the shot moving image and the image quality improved moving image in the moving image processing unit 13 according to the operation on the GUI screen by the user (U). . The user (U) can specify which transmission destination video data is to be given a character. The character assigned by the character assigning unit 14 is inspection information or the like. A given character such as inspection information is overwritten on the image frame of the target moving image. The characters assigned to the moving image are displayed in an overlapping manner on the image frame when the moving image is reproduced and displayed on the monitor 16. The inspection information is information such as date / time and location related to photographing or visual inspection, information indicating the contents of image quality improvement processing, and other information such as a name that can be arbitrarily determined by the user (U). The user (U) can arbitrarily input characters to be added to the moving image. Further, when there is information such as date and time that can be automatically acquired as basic functions of the photographing unit 21 and the visual inspection apparatus 1, for example, the inspection information is used and the manual input of the user (U) is omitted. .

  The moving image data receiving unit 15 is a unit that receives moving image data transmitted from the moving image processing unit 13, and includes a plurality of monitors 16 and a plurality of storage units 17. In FIG. 1, at least two monitors 16 (16a, 16b) and a storage unit 17 (17a, 17b) are provided. “# 1” and the like are numbers for distinguishing a plurality. The monitor 16 and the storage unit 17 are not limited to the visual inspection apparatus 1 but may be connected to the outside of the visual inspection apparatus 1 through a communication cable or the like. A plurality of moving image data receiving means 15 (16, 17) can store and display a plurality of the same or different moving image data in parallel.

  The monitor 16 is a display unit including at least a display, and can display moving image data transmitted from the moving image processing unit 13 and a GUI screen by the GUI control unit 11. The inspector U performs a visual inspection while viewing and operating the GUI screen of the monitor 16.

  When the monitor 16 is composed only of a display, the GUI screen data generated by the GUI control unit 11 is output to the monitor 16. When the monitor 16 has a computer function in addition to the display, the GUI control unit 11 may be configured in the monitor 16. In addition to the visual inspection GUI screen and monitor, a management / setting GUI screen and its monitor may be provided in the same manner.

  The storage unit 17 includes a data storage device, and stores the moving image data transmitted from the moving image processing unit 13 for later use. The inspector U can confirm the contents of the moving image data in the storage unit 17 later, or can read and perform the process again to perform a visual inspection again. The storage unit 17 can be configured by, for example, an HDD, a DVD, or other various memories.

[System (2)]
FIG. 2 shows a detailed functional block configuration and transmission selection example of the visual inspection apparatus 1 of FIG. In this configuration, the GUI control unit 11 includes various units such as a transmission selection unit 12, a character assignment unit 14, a condition adjustment unit 18, and a setting unit 19, and the moving image processing unit 13 includes a plurality of image quality improvement processing units 13a to 13a. 13c and the like. Each unit can be realized by software program processing, for example. In addition, there are a plurality of inspectors U (examples: U1, U2) as users. Each inspector U (U1, U2) performs a visual inspection using the monitor 16 (16a, 16b) associated with him / herself. The GUI screen 50 by the GUI control unit 11 is similarly displayed in each monitor 16 (16a, 16b). In the configuration of FIG. 2, the first storage unit (# 1) 17a is configured with an HDD, and the second storage unit (# 2) 17b is configured with a DVD.

  The basic control unit 10 includes, for example, a calculation unit such as a CPU, a storage unit such as a ROM and a RAM, a communication interface unit, an input / output unit including an input device / output device / input / output interface unit, a bus, and a top of them. It is composed of known elements such as an OS running on the OS.

  The moving image processing unit 13 selects and stores the image quality improvement moving image (Y) obtained by performing the image quality improvement processing by the selected image quality improvement processing unit 13a on the captured moving image (X) from the imaging unit 21. Transmit / output to the unit 17 and the monitor 16. Further, the moving image processing unit 13 can read out not only the moving image data transmitted from the photographing unit 21 but also the moving image data stored in the storage unit 17 and perform the same processing. For example, the moving image processing unit 13 performs image quality improvement processing by the image quality improvement processing units 13a to 13c on the input moving image A to obtain the image quality improved moving images A1 to A3.

  Each image quality improvement processing unit 13a performs processing based on conditions / parameters selected and set by the user (U). Each image quality improvement processing unit 13a or the like may be a program or the like based on another processing content / algorithm or the like, or the condition / parameter or the like may be changed by the same program or the like.

  The condition adjustment unit 18 (also referred to as a parameter adjustment unit) adjusts / sets conditions / parameters and the like to be applied to the processing of each image quality improvement processing unit 13a of the moving image processing unit 13 in accordance with the operation of the user (U) on the GUI screen 50. Perform processing to do.

  The character assigning unit 14 performs a process of assigning characters to each captured moving image (X) and image quality improved moving image (Y) of the moving image processing unit 13 in accordance with the operation of the user (U). For example, the characters of the inspection information are given to each of the moving images A1 to A3.

  The transmission selection unit 12 selects each transmission destination for each captured moving image (X) and image quality improved moving image (Y) of the moving image processing unit 13 according to the operation of the user (U). According to the selection state in the transmission selection unit 12, for example, the moving image A1 is stored in parallel in the two storage units 17a (# 1: HDD) and 17b (# 2: DVD). For example, the moving image A2 is output in parallel to the storage unit 17b (# 2: DVD) and the screen (# 1) of the monitor 16a. Further, for example, the moving image A3 is displayed in parallel on the screens (# 1, # 2) of the two monitors 16a, 16b. For example, a plurality of moving images (for example, A2 and A3) are displayed in parallel on the screen of one monitor 16.

  The setting unit 19 provides a function for setting an initial operation condition of the visual inspection apparatus 1 of the present system and necessary setting values of each function by the user (U) on the GUI screen 50. For example, it is possible to set how automatic control is performed when the user (U) has not yet performed an operation such as fine transmission selection at the start of photographing and visual inspection. For example, first, a shooting condition of the predetermined object 20 is set, and a predetermined shooting moving image is input. A predetermined image quality improvement process is used for an input photographed moving image, and the transmission selection is initially set to display only on monitor # 1 and to store only on storage unit # 1. Based on such initial settings, the user (U) can make detailed settings for processing contents and transmission destinations as appropriate. Further, a plurality of settings (for example, FIG. 4 described later) are stored, and can be selected and used as appropriate.

[Transmission selection]
Examples of visual inspection and transmission selection in the first embodiment are as follows. Conventionally, in a visual inspection of an object in a plant, it is necessary to display a moving image to be used on a monitor and store it in a storage unit for recording. In addition, when a moving image obtained by image quality improvement processing in the moving image processing unit is used for visual inspection, it is common to adjust the degree of image quality improvement using parameters. However, depending on how the parameters are adjusted, sufficient visibility may not be obtained in the moving image after the image quality improvement processing. For this reason, it is not possible to uniquely determine which moving image is appropriate to be displayed and stored among a captured moving image and a plurality of different image quality improved moving images obtained by parameter adjustment.

  Therefore, in the first embodiment, the moving image data of both the captured moving image (X) and the image quality improved moving image (Y) is stored in any of the plurality of monitors 16 and the plurality of storage units 17 in the plurality of moving image data receiving means 15. A function is provided so that a user such as an inspector U can freely select whether to transmit and output. That is, the transmission selection unit 12 has a function that allows the user (U) to select a transmission destination or output destination of each moving image data on the GUI screen 50.

  In the first embodiment, the following (a) to (d) are given as options or patterns that can be taken as a combination of a moving image and a transmission destination by the transmission selection function. The user (U) can use these combinations as appropriate. FIG. 4 shows an outline of transmission selection corresponding to examples (a) to (d). X: Photographed moving image, Y: Image quality improved moving image.

  (A) First, the visual inspection device 1 outputs the captured moving image X from the image capturing unit 21 to the storage unit # 1 (17a) that is an HDD, and the image quality improved moving image Y of the captured moving image X is stored as a DVD. Output to # 2 (17b) and monitor 16, for example, monitor # 1 (16a).

  In the case of the above (a), the following effects (a1) to (a3) are exemplified. (A1) First, it is possible to cope with a case where parameter adjustment for image quality improvement processing is insufficient. For example, since the parameter adjustment of the image quality improvement processing for generating the image quality improvement video Y with respect to the captured video X is insufficient, there is a case where good visibility cannot be obtained by visual inspection of the image quality improvement video Y. In this case, after the visual inspection, the image quality improvement processing parameters for the captured moving image X can be readjusted by the user (U), and the image quality improvement processing can be performed again. Inspection is possible. That is, such visual inspection work is facilitated and the burden is reduced. In addition, the reliability of visual inspection is increased by adjusting parameters.

  (A2) It is also possible to change / adjust the image quality improvement processing parameters to better parameters. For example, after a visual inspection, if a better parameter is found, the parameter can be changed to the parameter and an image quality improvement process can be performed to perform a visual inspection again.

  (A3) Further, it is possible to deal with a difference in image quality for each scene on the moving image, that is, on the time axis. For example, when the image quality is different for each scene in a moving image, it is difficult to optimize the image quality of all scenes with a single parameter adjustment. Therefore, according to this configuration, after visual inspection, it is possible to optimize the image quality of all scenes by adjusting the parameters individually for each scene where image quality improvement is insufficient, and performing image quality improvement processing again It is.

  (B) Secondly, the visual inspection apparatus 1 outputs the captured moving image X to the DVD (storage unit # 2) and the monitor 16 (for example, # 1), and the image quality improved moving image Y of the captured moving image X to the DVD (storage unit #). 2) and the monitor 16 (# 1).

  In the case of (b) above, the following effects can be mentioned. For example, by reproducing and displaying the captured moving image X and the image quality improved moving image Y in parallel on the screen of the same monitor 16 (# 1), the user (U) can confirm them simultaneously. For example, suitable moving images differ depending on the contents of the visual inspection work. For example, in the confirmation work for the presence or absence of cracks on the surface of the object 20, a moving image that makes it easy to see cracks by performing signal enhancement processing as image quality improvement processing is suitable. On the other hand, in the measurement of crack dimensions, a moving image in which the original dimensions of the cracks are stored without performing the signal enhancement process is more suitable. Therefore, according to the present configuration, for example, the presence or absence of cracks can be confirmed with the image quality improvement movie Y that has been subjected to the above signal enhancement processing, and the crack size measurement can be performed without any signal enhancement with respect to the shooting movie X that has not been subjected to the above signal enhancement processing. is there.

  (C) Thirdly, the visual inspection apparatus 1 uses the first image quality improvement movie Y1 that has been subjected to the first image quality improvement processing (for example, # 1 (13a)) for the captured movie X as the DVD (storage unit # 2). Output to the monitor 16 (for example, # 1), and output the second image quality-improved video Y2 that has been subjected to the second image quality improvement processing (# 2) for the same X to the DVD (# 2) and the monitor 16 (# 1). Then, the third image quality improving moving image Y3 subjected to the third image quality improving process (# 3) for the same X is output to the DVD (# 2) and the monitor 16 (# 1). Further, the processing is not limited to processing of three moving images, and processing of two moving images or processing of four or more moving images is similarly possible.

  In the case of the above (c), the following effects are mentioned. For example, the user (U) can confirm in parallel on the monitor 16 (# 1) a plurality of image quality improved videos Y1 to Y3 having different image quality improvement processing conditions and parameters of the video processing unit 13. For example, the image quality improvement processing conditions suitable for the work contents of the visual inspection may be different. For example, the optimum image quality improvement processing condition for emphasizing fine cracks is different from the optimum image quality improvement processing condition for contrast enhancement of a structure existing in a dark area where illumination does not reach. Therefore, according to this configuration, for example, the inspector U can generate two image quality improvement videos (for example, Y1 and Y2) subjected to the image quality improvement processing under the above-described conditions and display them on the monitor 16 (# 1). Both the fine crack and the structure in the dark area can be observed with the image quality under the optimum conditions.

  Similarly, three moving images (Y1 to Y3) and four or more moving images having different image quality improvement processing conditions and parameters can be confirmed in parallel. For example, the amount of radiation noise may vary depending on the scene in the captured moving image X, that is, the image on the time axis. In that case, moving images (Y1 to Y3) of three image quality improvement processing conditions having different noise removal levels are generated and displayed on the monitor 16 (# 1). As a result, the user (U) can visually inspect the moving images in parallel or in the order of the scenes, with the most visible moving images according to the scenes.

  (D) Fourth, the visual inspection apparatus 1 outputs the first image quality improved moving image Y1 by the first image quality improving process for the captured moving image X to the DVD (storage unit # 2) and the monitor 16 (for example, # 1). Then, a plurality of respective image quality improved videos Y2 to Yn obtained by a plurality of respective image quality improvement processes for the captured moving image X are output to the HDD (storage unit # 1). Further, for example, the first image quality improvement moving image Y1 may be output to the monitor (# 1).

  In the case of (d) above, the following effects can be mentioned. The user (U) can confirm by storing a plurality (n) of image quality improvement videos (Y1 to Yn) having different image quality improvement processing conditions and parameters. For example, when a large number of image quality improvement videos (Y1 to Yn) are generated, it is difficult for one inspector U to check them simultaneously. Therefore, one of the videos (Y1) is first saved on the DVD (# 2) and checked in real time on the monitor 16 (# 1). The remaining plurality of moving images (Y2 to Yn) are stored in the HDD (# 1) and can be confirmed later.

  The first embodiment is not limited to the above (a) to (d), and combinations thereof are also possible. Although the output destination monitor 16 in the combination of FIG. 4 is, for example, monitor # 1 (16a), one or more can be appropriately selected from the plurality of monitors 16 in the moving image data receiving means 15. For example, with respect to certain moving image data, a plurality of monitors 16 may be transmitted in parallel as output destinations. For example, a plurality of monitors 16 related to a plurality of moving image data may be transmitted as output destinations. When transmitting / outputting from the moving image processing unit 13 to the plurality of monitors 16 and the storage unit 17, a plurality of moving image data may be transmitted simultaneously in parallel or may be transmitted one by one in time order.

  Further, for example, two or more moving images can be reproduced and displayed simultaneously on the GUI screen 50 of the monitor 16 (for example, # 1) of one inspector U for visual inspection and confirmation. Also, visual inspection / confirmation can be performed by reproducing and displaying moving images related to the individual in charge on the GUI screen 50 of the monitor 16 (# 1, # 2) of a plurality of inspectors U (for example, U1, U2). Is possible. When visual inspection is performed by a plurality of inspectors U, the same moving image may be output or different moving images may be output.

[Character addition (1)]
The function of character provision by the character provision unit 14 is as follows. The visual inspection work by the inspector U is performed using a plurality of moving image data to a plurality of transmission destinations while adjusting the conditions and parameters of the image quality improvement processing as described above. In this case, grasping, managing, and operating the relationship between various information such as moving images, image quality improvement processing, and transmission destinations become problems. That is, it is necessary and useful to manage information (“inspection information”) indicating when and where each moving image data (X, Y) is taken, processed and inspected under what conditions.

  Therefore, in the first embodiment, when the inspector U performs a visual inspection while looking at the GUI screen 50 using the character assigning unit 14 and the condition adjusting unit 18, the inspection information as described above can be easily grasped. Provide a function that can be set. That is, the visual inspection apparatus 1 arbitrarily assigns the character of the inspection information to the image frame of each moving image data based on the operation of the inspector U on the GUI screen 50 using the character assigning unit 14 or the like. And has a function of managing data information to be written. Thereby, when the inspector U reproduces and displays each moving image on the GUI screen 50 and visually inspects the image, the image frame of the moving image is displayed in a form including the inspection information that is a given character. Therefore, the inspector U can easily grasp when and under what conditions the moving image was taken / processed / inspected by looking at the inspection information. In addition, regarding the work of adding characters to the moving image of each transmission destination, it is possible to set the presence / absence of the addition and the content of the addition in an easy-to-understand manner on the GUI screen 50, so the workload is reduced.

  In the first and second embodiments as the first method for character addition, moving image data including characters as a part of an image is obtained by writing the added character in a moving image frame. And, it is a method for managing information of moving image data to which characters have been added. For the sake of explanation, the first method is also referred to as an overwriting method.

[Character addition (2)]
However, in the case where the inspection information is added to the image frame of the moving image by the first method, it may be inconvenient to simply add the inspection information to all the moving images. For example, a character of examination information indicating conditions at the time of photographing is given to a certain photographed video and stored in the storage unit 17, and then an image quality improvement process is performed on the photographed video with the character to obtain the image quality improved video Let us consider the case of using and visually inspecting (refer to Embodiment 2 for details). As in this case, if the character of the inspection information has already been written in the image frame of the moving image data to be processed, it will hinder the image quality improvement processing, and good visibility by the correct or good image quality improvement processing May not be possible. As another example, an image quality improvement movie that has been subjected to image quality improvement processing under certain conditions is appended with characters of the inspection information and stored in the storage unit 17, and then is subjected to image quality improvement processing according to the adjusted conditions again. The case where it visually inspects using a moving image is mentioned. In this case as well, characters already written in the image may be disturbed as described above.

  Therefore, in the first and second embodiments, as a function of the character assigning unit 14, arbitrary / selection of inspection information characters for moving image data (X, Y) of each transmission destination by the inspector U is performed on the GUI screen 50. Provides a function that enables efficient writing. As a result, in this system, it is possible to manage the information by associating the moving image data of each transmission destination with the added character of the inspection information, and to perform reprocessing / reinspection using the captured moving image or the image quality improved moving image. For example, in transmission selection such as (a) in FIG. 4, the user (U) designates not to add a character, and the captured moving image (X) is stored in the storage unit 17, so that the captured moving image is later displayed. When (X) is read and image quality improvement processing is performed, since no characters are written in the image frame, image quality improvement processing can be performed correctly or satisfactorily.

  In addition, the following second method may be used as another method, not limited to the first method of character assignment. When character addition is selected / designated by the user (U) on the GUI screen 50, the character assignment unit 14 does not write the assigned character in the image frame of the moving image, and the assigned character is separated and associated as information. Get the video data in the specified form. That is, information management is performed by associating the moving image data with the added character data information. When the moving image data is reproduced and displayed on the monitor 16, control is performed so that the added character information is superimposed and displayed on the image frame of the moving image based on the control information managed by the information. That is, the display is controlled so that it looks the same as the first method. When the image quality improvement process is performed on the moving image data, since the added characters are not directly included in the image frame, the image quality improvement process can be performed correctly or satisfactorily without hindrance. The user (U) may select and set these methods on the GUI screen 50.

[GUI screen]
FIG. 3 shows a display example of the GUI screen 50 on the monitor 16 by the GUI control unit 11 according to the first embodiment. This is a case where the GUI screen 50 is displayed on the monitor # 1 (16a) for the inspector U1, for example, as the user (U). Further, in this example, two moving images (X, Y) are simultaneously reproduced and displayed in one screen in accordance with a transmission selection state (for example, FIG. 4B). The inspector U1 performs a visual inspection on the moving image (X, Y) while viewing the GUI screen 50 and inputting appropriate operations. Information input by the user (U) on the GUI screen 50 is processed by the transmission control unit 12 and the character adding unit 14 through the control of the GUI control unit 11. The setting information in the transmission control unit 12 and the character assigning unit 14 can be stored in a table or the like in the visual inspection apparatus 1 and can be reproduced and reused later.

  On the GUI screen 50, an area 301 for displaying a captured moving image (X) that is the first moving image output (# 1) and an area for displaying the image quality improvement moving image (Y) that is the second moving image output (# 2). 302, a transmission selection area 303 by the transmission selection section 12, a character assignment area 304 by the character assignment section 14, an area 310 for designating a target moving image, and the like.

  In the moving image output area 301, the captured moving image (X) transmitted from the moving image processing unit 13 is reproduced and displayed. In the moving image output area 302, the image quality improved moving image (Y) transmitted from the moving image processing unit 13 is reproduced and displayed. In addition, according to a user's (U) operation, the moving image read from the preservation | save part 17 can be displayed similarly. In this example, two moving image output (# 1, # 2) areas 301 and 302 are provided at predetermined positions in the illustrated screen. However, the number of the output areas may be increased / decreased or the position may be changed by the operation / setting of the user (U). Two or more moving image outputs are displayed after being synchronized in terms of time in the case of real-time playback display. Further, in the case of reproduction display of a moving image read from the storage unit 17, operations such as pause and reproduction start can be performed by a known technique.

  G <b> 1 indicated by a broken line frame indicates an example of inspection information provided and displayed on the image frame of the moving image by the character assigning unit 14. For example, the object 20 is “pump”, the shooting date is September 9, 2012, and the condition of image quality improvement processing is “condition 1”. g2 shows an example of an image frame including noise in the captured moving image X. g3 shows an example of an image frame from which noise has been removed by the image quality improvement processing in the image quality improvement video Y for the captured video X. g4 is information of each output moving image, and indicates, for example, a name, type, ID, and the like.

  The target moving image area 310 displays the moving image to be displayed in 301 (# 1) and 302 (# 2), and the moving image to be processed by 303 transmission selection and 304 character assignment by the user (U). Can be specified. If there are a plurality of candidate videos (X, Y), they can be selected from a list or the like. For example, it is possible to select a case where there are a plurality of different image quality improvement moving images. Similarly, input of a moving image from the photographing unit 21, input of a moving image from the storage unit 17, and the like may be selectable (specifically, the third embodiment).

  In the transmission selection area 303, the transmission destination or output destination is selected by the user (U) from the plurality of moving image data receiving means 15 for each of the captured moving image (X) and the image quality improved moving image (Y) as moving image data. Provide the function to select. In other words, the item 331 can select which moving image is transmitted to or output to which monitor 16 or storage unit 17. For example, as in 331, a check box for selecting the presence or absence of transmission (that is, display) to each monitor 16 (mode 1, mode 2) and transmission (that is, storage) to each storage unit 17 (e, 1 and 2). And a check box for selecting presence or absence. For example, “MO 1” indicates monitor # 1 (16a). For example, the user (U) checks a check box that is selected as a moving image transmission destination by operating an input device such as a mouse or a keyboard or touching the touch panel screen. The check in this area 303, that is, the state of transmission selection is managed as setting information by the transmission selection unit 12. In accordance with this state, each moving image data is transmitted from the moving image processing unit 13 to the moving image data receiving means 15 of the transmission destination.

  In the character assignment area 304, for each of the moving image data (X, Y), a function for assigning characters of arbitrary inspection information by the user (U), and whether or not to add a character to which destination moving image Provides the function to specify In the item of inspection information input (341), the user (U) can input and specify characters of the inspection information to be provided. In this example, a format for directly inputting an arbitrary character is shown. However, the present invention is not limited to this. For example, a preset character item is prepared, and the user (U) turns on / off the character item. It may be a format for selecting. Examples of the assigned character item include an object name, a shooting date and time, and an image quality improvement processing condition name.

  In the item of adding inspection information (342), in the same way as 331, whether or not to add the character of the inspection information input in 341 is specified for each video data (X, Y) of each transmission destination by a check box or the like. Is possible. Similarly, information on the input / designation state in the area 304 is managed by the character assigning unit 14. According to this state, a given character is written for each moving image data.

  When character addition is designated in the area 304, for example, as shown in g1, added characters are displayed at predetermined positions such as four corners in the image frame. In addition, you may provide the item etc. which a user (U) can variably designate the position which displays a provision character within an image frame.

  In the area 304, it is possible to assign the same character all at once to the moving image of each designated transmission destination. However, the present invention is not limited to this, and a different character may be assigned to each individually designated moving image. For example, you may provide the item which selects the moving image of character provision, and a transmission destination.

  In addition, the function areas (303, 304) may be displayed in parallel with the output moving image areas (301, 302) in the GUI screen 50 of the monitor 16, or may be displayed separately. For example, the output moving image monitor 16 and the function monitor 16 may be displayed separately. Each function can be operated by a GUI component in the GUI screen 50. However, the present invention is not limited to this. For example, each function may be implemented as a hardware interface such as a dedicated console. For example, a transmission destination can be set for each button, and the transmission destination can be selected by turning the button on / off.

  Still further, for example, in the area 303, an item for selecting / setting the above-described character assignment method, that is, whether to overwrite or not, with a button or the like by the user (U) may be provided. For example, when overwriting is selected, processing is performed by the first method described above. The above setting may be performed separately on the screen by the setting unit 19.

[Data information example]
As a supplement, FIG. 5 shows an example of the relationship between the elements of each data information in the transmission selection or the like in the first embodiment. In the moving image processing unit 13, for example, according to the transmission selection by the transmission selection unit 12, the input shooting moving image X is output as it is to the selected transmission destination 1 such as the monitor 16 or the storage unit 17 in accordance with the transmission selection by the transmission selection unit 12. In addition, the video image X2 to which the character M0 is added is output to the transmission destination 2. In addition, the moving image processing unit 13 generates an image quality improving moving image Y1 obtained by performing the first image quality improving process # 1 by the image quality improving processing unit 13a on the input photographed moving image X, and assigns the character M1 to the transmission destination. Output to 3. The condition / parameter group of the first image quality improvement processing # 1 by the image quality improvement processing unit 13a is adjusted and set as the predetermined condition / parameter group 1 by the condition adjustment unit 18. Similarly, the image quality improvement moving image Y2 formed by performing the second image quality improvement processing # 2 on the condition / parameter group 2 by the image quality improvement processing unit 13b is generated for the photographed moving image X, the character M2 is added, and the transmission destination Output to 4. Similarly, an image quality improvement movie Y3 is generated by applying the third image quality improvement processing # 3 with the condition / parameter group 3 by the image quality improvement processing unit 13c to the photographed movie X, and the character M3 is added to the transmission destination. Output to 5. Further, the present invention is not limited to the use of the plurality of image quality improvement processing units 13a to 13c, and a process in which the parameter value is changed using only one image quality improvement processing unit may be applied.

[Effects]
As described above, in the first embodiment, the above-described problems that occur when the image quality improvement process is introduced into the visual inspection, that is, the grasp and adjustment regarding the plurality of moving images, the image quality improvement process, the transmission destination, and the like are performed by the inspector U. As a framework for solving problems that are burdensome for the user, a means such as a specific GUI is provided. In the system of the visual inspection apparatus 1 for the plant 2, it is easy to support the inspector U for work such as adjustment and grasping of various and complex videos, conditions and parameters for image quality improvement processing, transmission destinations, etc. Can be made more efficient.

<Embodiment 2>
A visual inspection system according to the second embodiment of the present invention will be described with reference to FIGS. The second embodiment is a configuration in which many components are shared on the premise of the framework shown in the first embodiment, and a configuration example that is more detailed and effective for characteristic components in the framework of the first embodiment. Indicates. The main difference between the second embodiment and the first embodiment is that the character assigning unit 14 selectively assigns characters according to the moving image data, for example, no character is added to the captured moving image (X). The image quality improved moving image (Y) has a function of giving characters and transmitting them. The user (U) can set the above function on the GUI screen 50, and the character assigning unit 14 automatically performs processing according to the setting.

  The system configuration of the second embodiment is substantially the same as that of the first embodiment shown in FIG. In the second embodiment, the moving image data receiving unit 15 includes one monitor 16 and two storage units 17, for example, HDD (# 1) and DVD (# 2).

  In the second embodiment, the character imparting unit 14 does not impart the inspection information characters to the photographed moving image (X) among the plurality of moving image data (X, Y) handled by the visual inspection device 1, thereby improving the image quality. The inspection information characters are assigned to the moving image (Y). The inspection information, which is a given character, can be arbitrarily input / selected by the user (U) as described above. The captured moving image (X) from the image capturing unit 21 is transmitted and stored in the storage unit # 1 (17a) such as the HDD in the moving image data receiving means 15. In addition, for example, an image quality improved moving image (Y) generated based on a captured moving image (X) read from the storage unit 17 is assigned a character and transmitted to and stored in a storage unit # 2 (17b) such as a DVD. At the same time, it is transmitted and displayed on the monitor 16.

  In order to realize an effective visual inspection, it is necessary or effective that the inspector U can confirm the image quality improvement moving image (Y) in real time, and the moving image data should be stored in order to leave a record of the inspection. Is also necessary. In some cases, after visual inspection, reprocessing / inspection may be performed by changing image quality improvement processing conditions and parameters. Considering this, it is necessary or effective to store the captured moving image (X). In the above case, it is also necessary to record and manage the inspection information related to the moving image data. Is written by the above-described overwriting, when the image quality improvement process and the visual inspection are performed again using the moving image data, the assigned characters may interfere with the image quality improvement process.

  Therefore, in the second embodiment, both the captured moving image (X) and the image quality improved moving image (Y) are displayed in the same manner as (a) in the transmission selection combinations described in the first embodiment (FIG. 4). save. Then, by the function of the character assigning unit 14, the characters of the inspection information are written in the image quality improved moving image (Y), stored on a DVD (# 2) that can be easily reproduced, and monitored so that it can be visually confirmed in real time. 16 is displayed. On the other hand, the characters of the inspection information are not written in the corresponding captured moving image (X), and are stored in the HDD (# 1) or the like so that reprocessing can be easily performed.

  In FIG. 6, the outline | summary and example of the said transmission selection and character provision in the visual inspection apparatus 1 of Embodiment 2 are shown. In the moving image processing unit 13, the photographed moving image X (referred to as Xa) transmitted from the image capturing unit 21 is assigned the inspection information character (referred to as M) and stored in the HDD (# 1). In addition, the image quality improved moving image Y1 subjected to the image quality improving process based on the captured moving image X is given the character (M) of the inspection information such as the condition and is output to the DVD (# 2) and the monitor 16. In particular, the moving image processing unit 13 improves the image quality by changing conditions, parameters, and the like for the captured moving image X (Xb) once read from the captured moving image X (Xa) once stored in the HDD (# 1). The processed image quality improved moving image Y2 is provided with the character (M) of the inspection information such as the condition and is output to the DVD (# 2) and the monitor 16.

  FIG. 7 shows a display example of the GUI screen 50-2 on the monitor 16 in the second embodiment. The GUI screen 50-2 in FIG. 7 differs from the GUI screen 50 in FIG. 3 in the selection format in the transmission selection area 703 and the character assignment area 704. In addition, this is a case where only the image quality improved moving image Y is displayed in real time and visually inspected in one output moving image region 302 in the GUI screen 50-2. Note that the real-time display here is to reproduce the image frame of the moving image on the time axis at the rate at the time of shooting. Note that when the moving image data read from the storage unit 17 is processed and reproduced and displayed, it can be controlled by a computer, so that the reproduction display rate is variablely controlled according to the designation of the user (U) and stopped at an arbitrary frame. -Reproduction and repetition are also possible according to known techniques. In the second embodiment, a plurality of moving images can be displayed in parallel in one screen as described above.

  In the target moving image area 710, as described above, the user (U) can select and specify the captured moving image X and the image quality improving moving image Y to be displayed in the area 302.

  The transmission selection area 703 includes items such as a check box for selecting a transmission destination and transmission presence / absence for each of the captured moving image X and the image quality improved moving image Y, as described above. Corresponding to the system configuration, there are three transmission destinations: a monitor, an HDD (storage unit # 1), and a DVD (storage unit # 2). The check state in FIG. 7 corresponds to the example in FIG.

  The character assignment area 704 has items for inputting inspection information, items for specifying inspection information for each transmission destination of each moving image (X, Y), and the like, as described above. In the item of designation designation of inspection information, designation of designation can be made for each transmission destination (monitor, HDD, DVD) of each moving image (X, Y) by a check box or the like corresponding to the function of selective character assignment. . In the checked state of FIG. 7, corresponding to the setting for adding characters only to the image quality improved moving image Y, X is not checked at all, and Y is checked, for example, on the monitor and the DVD. In accordance with the setting state, the character assigning unit 14 does not add characters to the captured moving image X, and adds characters to the image quality improved moving image Y to be output to the monitor 16 and the DVD (# 2). Then, the moving image processing unit 13 transmits / stores the captured moving image X to the HDD (# 1), and transmits / outputs the image quality improved moving image Y with characters added to the monitor 16 and the DVD (# 2). The character assigning unit 14 manages the information input / set by the user (U) in the character assigning area 304, that is, the association information such as X, Y, and the assigned character, in a table or the like in the visual inspection apparatus 1. To be reproduced and reused later.

  In addition, it is not limited to the format that is individually checked and specified as described above. For example, as in the item 741 in the area 304, the character assignment target can be selected from the options such as X or Y or both X and Y by the user (U ) May be selectable. Further, for example, in the case of setting only Y, characters may be automatically added to the all-quality-improved moving image (Y), or only the individually designated videos among the all-quality-improved moving images (Y). You may make it give a character to. In addition to the above, other than the illustrated example, an item for inputting an added character may be provided for each moving destination moving image.

  As described above, according to the second embodiment, the combination of the first embodiment shown in FIG. 4A and the like is given using the photographed moving image X as shown in FIG. Since reprocessing is possible without interfering with characters, reprocessing / inspection after the second time becomes easy, and reliability can be increased.

  In the second embodiment, as a selective character assignment function, a configuration has been described in which characters are not added to the captured video X but characters are added to the image quality improved video Y. However, the present invention is not limited to this. A configuration in which characters are added to the image quality improved moving image Y so that characters are not added is also possible.

<Embodiment 3>
A visual inspection system according to the third embodiment of the present invention will be described with reference to FIGS. The third embodiment further provides a function such as a synchronization process that takes into account the processing time of various moving images. As in Embodiments 1 and 2, the introduction of image quality improvement processing and the provision of a GUI can improve the visibility of visual inspections and facilitate work, but on the other hand, it can be used for video processing such as image quality improvement processing. There is a concern that the time may be too large to ignore. The processing time may be increased or decreased by adjusting image quality improvement processing conditions and parameters. The image quality improvement processing for the captured moving image (X) needs to be performed in synchronization with the captured moving image (X) without delay regardless of the processing time, particularly when displayed on the monitor 16 in real time.

  When reprocessing / inspection is considered as described above, unsaved moving image data (Xa) transmitted from the photographing unit 21 to the moving image processing unit 13 through the cable 22 as the photographed moving image (X), and the storage unit 17 once. There are two types of video data (Xb) stored and read out.

  Therefore, the moving image processing unit 13 according to the third embodiment automatically improves the image quality by automatically switching the allowable processing time value for two types of moving images (Xa, Xb) having different transmission sources according to the types of the moving images. Apply processing. Thus, for example, when the captured moving image X (Xa) from the imaging unit 21 is transmitted and displayed on the monitor 16 in real time, the image quality improvement processing is performed without delay within the allowable value of the required processing time and transmitted and displayed. To do. In other words, the processing rate of the moving image (X, Y) is adjusted appropriately. In addition, if the actual image quality improvement process exceeds the allowable value for the required processing time, for example, the image processing of the moving image is skipped as appropriate to perform the image quality improvement process, giving priority to the synchronization process and the overall process. Make sure the time is not too long.

  FIG. 8 shows a display example of the GUI screen 50 on the monitor 16 in the third embodiment. The GUI screen 50-3 includes a moving image type area 801 in addition to the same elements as described above. In this area 801, the type of the captured moving image (X) to be input and processed in the image quality improvement processing of the moving image processing unit 13 can be selected / designated by the user (U) with a radio button or the like. As this type, in this example, the user selects whether to use “captured moving image” (Xa) input from the capturing unit 21 or “stored moving image” (Xb) that is a captured moving image read out from the storing unit 17. (U) can be selected. In accordance with the setting state in the area 801, the moving image processing unit 13 performs image quality improvement processing and the like. In addition, an item for specifying an individual moving image may be provided as described above.

  FIG. 9 shows an overview of the functions of moving image data processing and synchronization processing in the third embodiment. First, (a) shows a captured moving image Xa transmitted and input in real time from the image capturing unit 21 and a captured moving image Xb read from the storage unit 17 (for example, HDD). Ra and Rb are frame rates for transmission of (Xa, Xb), respectively. Ra is a fixed value depending on the shooting / transmission rate of the shooting unit 21. Rb is a variable value by computer processing control of the visual inspection apparatus 1.

  In (b), an image quality improved moving image obtained by performing the image quality improving process of the moving image processing unit 13 (for example, process # 1 by 13a) on the photographed moving image Xa is defined as Ya, and the same image quality improving process is performed on the photographed moving image Xb. The image quality improved moving image subjected to (# 1) is defined as Yb. An allowable value of the processing time of the image quality improvement processing of Xa is set as Ka, and an allowable value of the processing time of the same processing of Xb is set as Kb.

  The allowable value Ka of Xa is set in advance to a predetermined value smaller than the fixed transmission rate Ra (Ka <Ra). Further, the allowable value Kb of Xb is set to an arbitrary value according to the variable transmission rate Rb or does not need to be set. The allowable value can be set in advance by the setting unit 19, for example.

  In (c), when the measured value of the processing time per frame in the image quality improvement processing of the captured moving image Xa is T2 as the control processing content in the function of this synchronization processing, T2 is equal to or less than the allowable value Ka corresponding to Xa. In such a case (T2 ≦ Ka), high-definition image quality improvement processing is performed without skipping the image frame to be processed. If T2 exceeds Ka (T2> Ka), the image frame to be processed is skipped as appropriate, and the image quality improvement processing is performed to give priority to the synchronization processing, thereby shortening the processing time and increasing the speed.

  On the other hand, in the case of the stored moving image Xb, when the measured value of the processing time per frame in the image quality improvement processing of Xb is T5, the allowable value Kb corresponding to Xb is an arbitrarily set value, so that it is stored to match the value of T5. The rate of reading / transmitting the stored moving image Xb from the unit 17 is adjusted.

  FIG. 10 shows a time chart example of processing of each moving image in the third embodiment, corresponding to FIG. (A) shows the shooting moving image Xa transmitted / input from the shooting unit 21. f1 and the like indicate an image frame, and T1 is one frame time corresponding to a fixed transmission rate Ra of Xa. (B) and (c) are image quality improvement processing for the captured moving image Xa of (a), and synchronization processing is necessary. T2 and T2 ′ are measurement values of the processing time per frame in the image quality improvement processing of Xa. T3 is a set value of the allowable value Ka of the processing time of Xa. (B) is an example when T2> T3 (Ka), and (c) is an example when T2 ≦ T3 (Ka). T3 (Ka) corresponds to the time required for processing without skipping frames.

  When the processing target is Xa, the transmission speed or transmission rate Ra (T1) of Xa is a fixed value depending on the shooting rate of the imaging unit 21 and the like. Therefore, the allowable value Ka of the processing time of Xa is set in advance to a predetermined value (T3) smaller than the rate (Ra, T1). For example, T3 (Ka) = 30 ms.

  In (b), the moving image processing unit 13 measures the processing time T2 per frame of Xa when performing the image quality improvement processing on the captured moving image Xa from the shooting unit 21, and the processing time T2 is the allowable value Ka. When (T3) is exceeded (T2> Ka), the image frame is skipped until the frame from the imaging unit 21 in (a) is caught, and the image quality improvement process is performed. For example, as shown in the figure, after processing f1, f2 is skipped and the next f3 is processed.

  In (c), when the processing time T2 ′ per frame of Xa falls within the allowable value Ka (T3) (T2 ≦ Ka), the moving image processing unit 13 does not need to skip the frame to be processed and does not need to skip the image quality improvement processing. Can be applied.

  (D) shows a stored moving image Xb that is a captured moving image read out and transmitted from the storage unit 17. T4 is one frame time corresponding to the variable transmission rate Rb of Xb.

  (E) is an image quality improvement process for the stored moving image Xb in (d), for example, a synchronization process is performed. T5 is the processing time per frame of Xb.

  When the processing target is Xb, the moving image processing unit 13 can variably control the transmission speed or transmission rate Rb of Xb. Therefore, it is not necessary to set the allowable value Kb of the processing time of Xb to a desired value in advance regardless of Ra (T1) or to provide Kb.

  The moving image processing unit 13 variably adjusts the Xb transmission / reading rate T4 from the storage unit 17 so as to match the processing time T5 per frame required for the Xb image quality improvement processing. T4> T5. Thereby, image quality improvement processing can be performed without skipping frames.

  As described above, according to the third embodiment, it is possible to appropriately perform the image quality improvement processing by the synchronization processing regardless of the type (Xa, Xb) of the moving image, and the processing time becomes longer as a whole. Can be prevented, and an efficient visual inspection is possible.

  It is also possible not to perform the synchronization process. For example, the captured moving image Xb data read from the storage unit 17 is buffered in a memory, and the data is subjected to high-accuracy image quality improvement processing over a relatively long time, and the processed moving image is reproduced at a desired rate. This is the case.

<Embodiment 4>
A visual inspection system according to Embodiment 4 of the present invention will be described with reference to FIGS. The fourth embodiment particularly shows a detailed configuration of the condition adjusting unit 18 in the GUI control unit 11 of the first embodiment (FIG. 2). A function is provided that more effectively supports the adjustment and grasping of the conditions and parameters of the image quality improvement processing of the moving image processing unit 13 by the operation of the user (U) on the GUI screen 50.

  As described above, when the image quality improvement process is introduced, the degree of the image quality improvement by the process is generally adjusted by the parameter. The image quality improvement process is often a complex algorithm that combines many processes, and often includes a plurality of parameters for adjustment. However, as described above, adjusting and grasping the conditions and parameters of the various and complex image quality improvement processing is not easy and particularly burdensome for an inspector U who is not familiar with image processing. In particular, there are various image quality improvement processes, such as luminance enhancement processes and noise removal processes, according to various moving images and transmission destinations, and the more these conditions / parameters increase, the less it becomes easier.

  On the other hand, there are a plurality of factors that cause a decrease in the visibility of a moving image for visual inspection assumed in a nuclear power plant or the like. Each factor does not always occur at the time of inspection. It is difficult to adjust a parameter having sensitivity in adjusting a decrease in visibility of a moving image in which a certain factor does not occur. For example, in the case of a visual inspection for a nuclear power plant, there is a method of confirming visibility using a wire moving image obtained by photographing a calibration target using a wire. This wire movie has almost no radiation noise. Although it is effective to perform parameter adjustment such as super-resolution processing and luminance enhancement processing using this wire moving image, it is not appropriate to perform parameter adjustment for noise removal processing using this wire moving image. As a result, there is a possibility that the image quality of the moving image after the image quality improvement processing becomes insufficient, that is, the visibility is lowered.

  It can be said that the adjustment of the conditions / parameters and the like of the image quality improvement processing is desirably performed by the inspector U confirming the visibility using an adjustment moving image appropriate for the conditions / parameters.

  Therefore, in the fourth embodiment, as the condition adjustment unit 18, the inspector U or the like associates the conditions / parameters of the image quality improvement processing corresponding to each of the above-described visibility reduction factors and the adjustment video on the GUI screen 50. Provides a function that can be set easily.

  FIG. 11 shows a processing concept and the like in the fourth embodiment. First, the moving image processing unit 13 receives, for example, a shooting moving image X1 from the shooting unit 21, and performs, for example, image quality improvement processing # 1 of the image quality improvement processing unit 13a to obtain an image quality improving moving image Y1. Then, the inspection information character (M1) is added to the image quality improved moving image Y1 and is output to the selected transmission destination. The condition of image quality improvement process # 1 is indicated by “condition 1”. The condition is related to a set of a plurality of image quality improvement processing parameters (referred to as P). For example, the condition 1 is related to the parameter group G including the parameters P1 to Pm and its value.

  In the fourth embodiment, the condition adjustment unit 18 divides a set of parameters constituting the image quality improvement processing conditions into a plurality of parameter groups (G) according to the operation of the user (U) on the GUI screen 50. To set. For example, as shown in the figure, condition 1 relating to the image quality improvement processing is set by being divided into parameter groups G1 to G3. This division can be performed as a division into a parameter group that is sensitive to adjustment for each factor of visibility reduction during visual inspection. Then, the condition adjustment unit 18 is configured to relate different moving images suitable for the visibility reduction factor for adjustment for each of the divided parameter groups according to the operation of the user (U) on the GUI screen 50. Can do. For example, different moving images A1 to A3 are set for adjustment for each of the parameter groups G1 to G3 for division. For example, with regard to the image quality improvement processing using the parameter group G1 under the condition 1, it is possible to set a moving image A1 for adjustment suitable for a certain visibility reduction factor a (for example, radiation noise). The image quality improvement processing conditions are adjusted using the adjustment moving image suitable as described above, and an effective visual inspection can be performed using the image quality improved moving image that copes with the decrease in visibility.

  Although three divided parameter groups G1 to G3 are set for one condition 1 in FIG. 11, the main point is that information management may be performed by regarding each divided parameter group as an individual condition. It is the same. In this case, for example, the parameter group G1 is managed in such a manner that the condition 1 is related to G1, the condition G2 is related to Condition 2, and so on.

  FIG. 12 shows a display example of the GUI screen 50 on the monitor 16 in the fourth embodiment. The GUI screen 50-4 includes a condition adjustment area 401, a condition designation area 402, a condition / parameter detail area 403, and the like in addition to the above-described elements. The condition adjustment unit 18 performs processing related to the functions provided in these areas through the GUI control unit 11 and manages setting information in a table or the like in the visual inspection apparatus 1.

  In the condition adjustment area 401, an item (411) that allows the user (inspector U) to select a condition or parameter group or individual parameter for image quality improvement processing and values in the selected condition / parameter group / parameter are displayed. And an item (412) that is variably adjusted and set by the user. In the item 411, for example, the user (U) can select a condition / parameter group / parameter name or ID from the list. In the item 412, for example, the parameter value can be variably adjusted with an adjustment gauge or the like. Not only this but a numerical value input column etc. may be provided. In this example, a case where a noise removal processing parameter is selected as the condition / parameter group / parameter to be adjusted in the region 401 and the parameter value is adjusted is illustrated. However, the present invention is not limited to this, and a plurality of items may be provided in the same manner so that a plurality of conditions / parameters can be adjusted by the user (U). Information input / set in the area 401 is managed by the condition adjustment unit 18.

  In the condition designation area 402, a condition to be applied can be selected and designated by the user (U) from the image quality improvement processing condition information stored and set in the visual inspection apparatus 1. For example, it has an item (421) that can be applied with an apply button or the like by selecting a condition name or ID from the list.

  The conditions selected and applied in the area 402 are reflected in the image quality improvement processing of the moving image processing unit 13 and can also be reflected as added characters by the character adding unit 14. For example, as in 409, it can be automatically reflected in the target moving image as a character to be added to the inspection information.

  In addition, you may provide the item etc. which the user (U) selects the moving image used as condition adjustment and application object similarly to the above-mentioned 310 grade | etc.,.

  Further, in the condition / parameter details area 403, detailed information regarding conditions 401/402, parameters / parameters, etc., is displayed in a list format and can be confirmed by the user (U). Further, each parameter value may be variably adjustable in the area 403.

  11 may be set by the user (U) by displaying a table as shown in FIG. 13 below on the GUI screen 50-4, for example.

  FIG. 13 shows an example of an information management table for adjusting conditions / parameters and the like for image quality improvement processing by the condition adjustment unit 18 according to the fourth embodiment. For example, the condition adjustment unit 18 manages information such as each parameter group as shown in FIG. 11 divided and adjusted by the user (U) on the GUI screen 50-4 in the table of FIG.

  In the table configuration of FIG. 13, information items related by records include conditions, parameter groups, parameters, image quality improvement processing, adjustment moving images, inspection information, and the like. “Condition” indicates the name and ID of a condition for image quality improvement processing. “Parameter group” indicates the name and ID of the parameter group (G) constituting the condition. “Parameter” indicates one or more parameters (P) constituting the parameter group (G). “Image quality improvement processing” indicates the name and ID of the image quality improvement processing such as 13a of the moving image processing unit 13 or the information on the corresponding visibility lowering factor. “Adjustment moving image” indicates the name and ID of the adjustment moving image applied to the image quality improvement processing. “Inspection information” indicates inspection information associated with the adjustment moving image or the like.

  As the name in each item of the above table, a user (U) can input and set a name that is easy for the user (U) to understand. Further, the “inspection information” may be managed as the above-described character addition information. Further, the “inspection information” associated with the “adjustment moving image” may be obtained by processing, for example, information in the form of property information of a moving image file, by the moving image processing unit 13. Each of the above information may be associated with each of the plurality of image quality improvement processing units 13a and the like in FIG.

  In the setting example of FIG. 13, for example, the plurality of parameters constituting the condition 1 of the image quality improvement processing by the image quality improvement processing unit 13a of the moving image processing unit 13 are divided into groups A to C as in FIG. Indicates when to do. For example, the group A includes parameters (P1, P2,...) And the like, is used as a parameter for noise removal processing, and a radiation noise moving image (imaging moving image X1) is used as the adjustment moving image. The group B (Pa, Pb,...) Is a parameter group different from the group A. For example, the parameter enhancement processing parameter is used as the parameter enhancement processing parameter, and the fine structure shooting movie (shooting movie X2) is used. Similarly, for the group C, for example, a parameter for image quality improvement processing corresponding to insufficient illumination is used, and a dark moving image (captured moving image X3) is used as the adjustment moving image.

  For example, the following (1)-(3) are mentioned as an example of the visibility reduction factor assumed in the case of a nuclear power plant. (1) Noise is generated in the moving image due to the radiation hitting the pixels of the camera of the photographing unit 21, that is, an image on which radiation noise is superimposed. (2) There are fine streaky cracks as objects to be found by visual inspection, and the edges of the cracks become unclear depending on the way of photographing. (3) Since the inside of the plant has a three-dimensional and complicated structure, the range in which the illumination to the object 20 reaches is limited, and the luminance is partially lowered due to insufficient illumination.

  As for the factor (1), as shown in the setting example of FIG. 13, a parameter group A for noise removal processing and a radiation noise moving image (X1) that is a captured moving image including an image on which radiation noise is superimposed are used. . Regarding the factor (2), a parameter group B of signal enhancement processing and a fine structure photographing moving image (X2) that is a photographing moving image in which the edge of the fine structure of the object 20 is unclear are used. Regarding the factor (3), a parameter group C of image quality improvement processing corresponding to insufficient illumination and a dark movie (X3) that is a captured movie including a portion that is dark due to insufficient illumination are used.

  As described above, according to the fourth embodiment, the inspector U uses the GUI screen 50-4 to handle various videos, image quality improvement processing conditions / parameters, transmission destinations, and the like. Conditions, parameters, etc. can be easily adjusted and grasped for each visibility reduction factor. In addition, since users other than the inspector U can make settings using the GUI screen 50-4 in the same manner, a plurality of people can easily collaborate.

<Embodiment 5>
A visual inspection system according to the fifth embodiment of the present invention will be described with reference to FIG. The fifth embodiment shows a particularly effective detailed configuration for elements such as parameter group division settings in the function of the condition adjustment unit 18 in the framework of the fourth embodiment.

  As described above, in a visual inspection for a conventional nuclear power plant or the like, visibility is also confirmed using a wire moving image obtained by photographing a calibration target using a wire. Correspondingly, it is preferable to use the wire moving image used for checking the visibility for adjusting the condition / parameters of the image quality improvement processing described above.

  However, the wire moving image has almost no radiation noise, that is, almost no noise image due to the superposition of radiation noise is seen. It is difficult to adjust a parameter group for noise removal processing using a moving image having almost no radiation noise.

  On the other hand, since the wire moving image is a moving image obtained by photographing a fine wire, the edge of the wire in the image is unclear. Therefore, it is effective to use this wire moving image for adjustment of parameters for signal enhancement processing.

  Therefore, in the visual inspection apparatus 1 according to the fifth embodiment, the condition adjustment unit 18 sets a set of parameters constituting the image quality improvement processing conditions as noise based on the operation of the user (U) through the GUI screen 50 described above. The first group which is a parameter group for removal processing and the second group which is a parameter group including at least other parameters for signal enhancement processing are set. For the latter parameter group adjustment, a wire moving image is used.

  Although the GUI screen 50 in the fifth embodiment is not shown, the GUI screen 50 has the same areas 401 and 402 as the GUI screen 50-4 in the fourth embodiment. The table is displayed and can be set by the user (U) in the same manner.

  FIG. 14 shows a table configuration example of information management of conditions / parameters and the like of the image quality improvement processing by the condition adjustment unit 18 in the fifth embodiment. The table configuration in FIG. 14 is substantially the same as that in FIG. Based on the operation of the user (U), the condition adjustment unit 18 includes a plurality of parameters for image quality improvement processing conditions, a parameter group for noise removal processing (for example, group A), and other signal enhancements in this table. The parameters are divided into parameter groups (for example, group B) including parameters for processing. The parameter group for noise removal processing (group A) is set to use a predetermined adjustment moving image (X1) as described above, and the other parameter group (group) including parameters for signal enhancement processing is used. About B), it sets so that a wire animation (X2) may be used. The moving image processing unit 13 adjusts the signal enhancement parameter using the wire moving image (X2) in accordance with this setting.

  As described above, according to the fifth embodiment, the inspector U can easily adjust the image quality improvement processing conditions and parameters on the GUI screen 50. The parameters for dealing with edge blurring can be easily adjusted. Thereby, the reliability of the visual inspection can be increased.

<Embodiment 6>
A visual inspection system according to the sixth embodiment of the present invention will be described with reference to FIGS. 15 and 16. The sixth embodiment has a configuration premised on the fourth embodiment, and particularly shows detailed functions of the moving image processing unit 13. In the sixth embodiment, first, a plurality of conditions for image processing or image quality improvement processing in the moving image processing unit 13 are set. Then, the moving image processing unit 13 automatically switches the plurality of conditions for the processing moving image to be processed at predetermined time intervals on the time axis, and sequentially executes the processing for each condition. Generate a video with improved image quality. With the automatic switching function, it is possible to realize an image quality suitable for each moving image and its scene, and to reduce the work load on the user (U). In other words, the sixth embodiment has a batch automatic execution function of a plurality of image quality improvement processes.

  As in the above-described fourth embodiment, the condition adjustment unit 18 or the like is used to appropriately adjust and set the image quality improvement processing conditions and parameters, so that a plurality of conditions can be used. In that case, it is necessary or effective to be able to appropriately manage and grasp which image quality improvement processing is applied to which moving image and use it for visual inspection.

  The conditions or parameters of the image quality improvement process can be freely adjusted by the user (U) by the amount that is adjusted in advance in the adjustment stage before the visual inspection. However, with regard to the image quality improvement processing conditions used in the visual inspection stage, it is necessary or effective that the inspector U confirms the visibility in the corresponding video before or after the visual inspection. is there.

  There is a possibility that the image quality of a moving image for visual inspection in a nuclear power plant or the like is different for each scene, that is, for each image frame. When image quality improvement processing under uniform conditions is performed on the moving image, it is difficult to make an arbitrary scene in the moving image have an appropriate image quality. For example, when the object is imaged while moving the camera in the nuclear power plant as described above, the amount of radiation noise superimposed on the captured moving image varies because the radiation intensity varies depending on the location in the plant. When uniform noise removal processing is performed on the captured moving image, for example, in a scene where the amount of radiation noise is large, noise may not be sufficiently removed, and image quality may be insufficient.

  On the other hand, it is possible for the inspector U to confirm and adjust all of the image quality improvement processing conditions and parameters that may be used in the visual inspection stage before or after the visual inspection. Difficult or heavy burden for In particular, in the case where a plurality of conditions are provided, it becomes more burdensome to grasp which moving image is processed according to which condition and which image quality improved moving image is obtained.

  In the sixth embodiment, a function for automatically switching a plurality of conditions in the moving image processing unit 13 is provided. In the adjustment stage before the visual inspection, a plurality of conditions adjusted on the GUI screen 50 by the user (U) are stored and set in the aforementioned table or the like. In the confirmation stage before or after the visual inspection, the moving image processing unit 13 reads the plurality of conditions, automatically switches them on the time axis, and sequentially executes image quality improvement processing for each condition, thereby Generate improved videos. For example, the processing may be performed by switching the conditions at regular intervals such as several seconds depending on the scene in the moving image. In addition, it is possible to process by switching multiple conditions for multiple videos, and it is also possible to process by switching multiple conditions for videos of multiple scenes in one video It is.

  Further, in order to facilitate the processing of a plurality of conditions and the understanding of moving images as described above, the character assigning unit 14 according to the sixth embodiment is configured to generate a plurality of the generated plurality of items based on the setting of the user (U). It has a function of automatically assigning a character representing a plurality of conditions applied to each image quality improvement moving image.

  FIG. 15 shows processing concepts such as the automatic switching function of the moving image processing unit 13 in the sixth embodiment. In the moving image processing unit 13, for example, one shooting moving image X obtained by shooting the same object 20 in the plant 2 is input. A plurality of conditions set by the condition adjusting unit 18, for example, condition 1 (parameter group a), condition 2 (parameter group b), and condition 3 (parameter group c) are applied to the photographed moving image X. The moving image processing unit 13 sequentially executes image quality improvement processing, for example, processing of 13a to 13c, while controlling automatic switching of the plurality of conditions. Accordingly, a plurality of corresponding image quality improvement moving images (for example, Y1 to Y3) are generated. And the character provision part 14 automatically assign | provides the character (for example, M1-M3) of the test | inspection information showing each said conditions with respect to the said several image quality improvement moving image. If the user (U) is set in advance, there is no need to add characters for each individual image quality improvement moving image. Then, each image quality improved moving image is output from the moving image processing unit 13 to the corresponding transmission destination (for example, transmission destinations 1 to 3) according to the state of transmission selection. The above is an example in which image quality improvement processing is performed under conditions suitable for each scene in one captured moving image X. However, the same processing is possible when processing a plurality of captured moving images. The same processing as described above is also possible when processing is performed while changing one image quality improvement processing parameter. Also, a plurality of image quality improvement videos generated for each condition and scene may be integrated into one for output so as to be easy to output.

  FIG. 16 shows a display example of the GUI screen 50 on the monitor 16 in the sixth embodiment. On the GUI screen 50-6, the user (U) can specify and set processing contents such as the automatic switching function of the moving image processing unit 13. In the GUI screen 50-6, the user (U) can specify and apply the conditions of the image quality improvement processing for each moving image such as the captured moving image X in the condition specifying area 402 for each moving image such as the captured moving image X. Although FIG. 16 shows an example in which the same captured moving image X is targeted, different moving images may be designated by the user (U) as described above. The item 423 includes an automatic button that can set whether or not to execute automatic processing by the automatic switching function for a plurality of conditions specified in 422. When the automatic button is pressed, the moving image processing unit 13 automatically switches a plurality of image quality improvement processing conditions and the like on the target moving image and executes the processing sequentially in the same manner as in FIG. Generate a video. Then, the information of each applied condition is added to the image frame of each image quality improved moving image as in 409, for example.

  As described above, according to the sixth embodiment, the inspector U uses the GUI screen 50 to check all of the plurality of image quality improvement processing conditions used in the visual inspection stage before or after the visual inspection. Can be easily confirmed and set. In addition, it is possible to reduce the burden of work using image quality improvement processing under a plurality of conditions.

<Embodiment 7>
A visual inspection system according to the seventh embodiment of the present invention will be described with reference to FIGS. The seventh embodiment has a configuration further including the following elements in addition to the first to sixth embodiments. When visual inspection is performed on the inside of a nuclear power plant, as described above, radioactive substances may be attached due to radiation, for example, in an optical camera of an imaging unit or a visual inspection apparatus connected thereto. As a countermeasure, the following dustproof filter 74 or the like is provided as a means for preventing or removing radioactive substances from being easily removed.

  FIG. 17 shows a system configuration of the seventh embodiment. The visual inspection device 1 according to the seventh embodiment is arranged in the plant 2. In the visual inspection apparatus 1 according to the seventh embodiment, a part such as the moving image processing unit 13 described above is mounted on an electronic circuit board 70 or the like in a unit 71 that is a casing. The electronic circuit board 70 includes a known processor, memory, and the like.

  In the unit 71, a fan 72 is provided at a position behind the electronic circuit board 70. Further, a dustproof filter 74 is provided in the air inlet 73 behind the fan 72 in the unit 71. The unit 71 has an intake port 73 for taking in cooling air. A dustproof filter 74 is fixed with an attachment 75 such as a screw from the outside so as to cover the air inlet 73 of the unit 71.

  In the visual inspection device 1 according to the seventh embodiment, the electronic circuit board 70 including the moving image processing unit 13 and the like and the fan 72 are accommodated in a unit 71 having a dustproof filter 74 that covers the air inlet 73. The dustproof filter 74 can be removed and replaced by a mounting tool 75 outside the unit 71.

  In the above-described moving image processing unit 13, for example, in order to realize various and high-speed image quality improvement processing, an electronic circuit board 70 or the like equipped with a high-performance processor or the like is necessary, and a fan 72 that cools the processor or the like. Etc. are also necessary.

  On the other hand, in the case of a plant 2 such as a nuclear power plant, when measures such as the dustproof filter 74 are not provided, the fan 72 sucks dust containing radioactive material and can adhere to the electronic circuit board 70 including the moving image processing unit 13. There is sex. Once attached, it cannot be removed from the plant 2 unless removed.

  Therefore, in the seventh embodiment, the electronic circuit board 70 including the moving image processing unit 13 and the like and the fan 72 are accommodated in the unit 71 as described above, and the dustproof filter 74 and the like covering the air inlet 73 are provided. When the cooling fan 72 is operated, even if dust containing radioactive substances is present, it does not adhere to the electronic circuit board 70 but adheres to the dustproof filter 74. Since only the dust filter 74 can be easily removed by the removal mechanism outside the unit 71, the dust filter 74 can be prevented from being attached and removed easily.

  FIG. 18 shows another structural example of the visual inspection apparatus 1 as a modification of the seventh embodiment. As a different point, the dustproof filter 74 is attached to the inside so as to cover the air inlet 73 of the unit 71 as a housing from the inside. Further, the dustproof filter 74 is fixed to the inside as described above by the attachment tool 75 such as a screw from the outside of the unit 71 via the filter fixing tool 77 penetrating the filter removal hole 76 on the upper side of the unit 71, for example. Thereby, it is possible to prevent the radioactive material from being attached and facilitate the removal.

  According to the seventh embodiment, the visual inspection device 1 can be arranged and used in a plant 2 such as a nuclear power plant, and visual inspection with reduced influence of radiation can be realized.

  Still further, a computer terminal device or the like for the inspector U may be remotely connected to the outside of the plant 2 or the like through another cable with respect to the unit 71 of the visual inspection device 1 of the seventh embodiment. In that case, the above-described GUI control unit 11 or the like may be mounted on the computer terminal device, and functions in the same manner as described above in communication and cooperation with a part such as the moving image processing unit 13 of the visual inspection device 1 in the plant 2. Can be realized.

<Effects>
As described above, according to each embodiment, in the visual inspection system for the plant 2 and the like, the visual inspection device 1 that provides an effective GUI screen 50 for visual inspection is provided, and the inspector U Can facilitate and improve efficiency by supporting operations such as adjustment and understanding of various and complex moving images, image quality improvement processing conditions and parameters, and output destinations. In the present system, various types of moving image data, conditions and parameters for each adjustable image quality improvement process, inspection information to be added, transmission destinations, and the like can be associated and managed. When visual inspection is performed by an inspector U using an image quality improvement movie by introducing image quality improvement processing, conditions and parameters can be easily adjusted to improve visibility, and the reliability of visual inspection can be increased. .

  As mentioned above, the invention made by the present inventor has been specifically described based on the embodiment. However, the present invention is not limited to the embodiment, and various modifications can be made without departing from the scope of the invention. Needless to say. For example, the inspection object is not limited to a nuclear power plant and can be applied.

  DESCRIPTION OF SYMBOLS 1 ... Visual inspection apparatus, 2 ... Plant, 10 ... Basic control part, 11 ... GUI control part, 12 ... Transmission selection part, 13 ... Moving image processing part, 14 ... Character provision part, 15 ... Moving image data reception means, 16 ... Monitor , 17 ... storage unit, 18 ... condition adjustment unit, 19 ... setting unit, 20 ... object, 21 ... photographing unit, 22 ... cable.

Claims (4)

An imaging unit for imaging a plant object and outputting a first video;
A moving image processing unit that generates a second moving image by performing moving image processing including image quality improvement processing on the first moving image;
A plurality of moving image data receiving means including one or more storage units and one or more display units, which are candidates for receiving at least one moving image data of the first or second moving image;
A user interface unit that performs control processing to generate and display a screen for operation by a user including an inspector;
Transmission selection for selecting to which of the plurality of moving image data receiving means a plurality of moving image data including the first and second moving images of the moving image processing unit is transmitted based on a user operation on the screen And
Based on the user's operation on the screen, specify which of the plurality of moving image data including the first and second moving images of the moving image processing unit is to be given a character, and for the specified moving image data A character giving unit for giving an arbitrary character by the user,
A plurality of moving image data including the first and second moving images is transmitted from the moving image processing unit to the plurality of moving image data receiving means according to a selection state by the transmission selection unit, and the moving image transmitted to the storage unit The data is stored, the moving image data transmitted to the display unit is displayed, and in the case of displaying the moving image data with the character added, the image is displayed with the characters superimposed ,
Based on a user operation on the screen, the moving image processing to be applied to a plurality of moving image data including the first and second moving images, and a condition adjustment unit for adjusting the condition or parameter thereof,
Based on the user's operation on the screen, a plurality of moving image data including the first and second moving images, moving image processing applied to each moving image data, its condition or parameter, and transmission of each moving image data Information management of the relationship between each element including the previous video data receiving means,
The condition adjustment unit divides a plurality of parameters constituting the condition into a plurality of parameter groups for each visibility reduction factor of the moving image according to a user operation on the screen, and for each parameter group, Set to relate the video data for adjustment of the parameter,
The condition adjustment unit includes a plurality of parameters constituting the condition, a first parameter group for noise removal processing that is first image quality improvement processing, and at least a second image quality other than the first parameter group. Divided into a second parameter group including parameters for signal enhancement processing, which is an improvement process, and set so as to relate the moving image obtained by photographing the wire as moving image data for adjustment of the second parameter group,
The condition adjusting unit applies a condition or parameter for each moving image data or for each scene in the moving image data as a moving image processing condition or parameter to be applied to the moving image data based on a user operation on the screen. Set multiple conditions or parameters as
The moving image processing unit is configured to set the plurality of conditions or parameters for each of a plurality of input moving image data or for each of a plurality of scenes of one moving image data based on the setting of the plurality of conditions or parameters. Are applied on the time axis by switching and applying the moving image processing to generate a plurality of second moving images,
The character assigning unit assigns a character including information on the applied condition or parameter to each of the plurality of generated second videos based on a user operation on the screen.
Visual inspection device. An imaging unit for imaging a plant object and outputting a first video;
A moving image processing unit that generates a second moving image by performing moving image processing including image quality improvement processing on the first moving image;
A plurality of moving image data receiving means including one or more storage units and one or more display units, which are candidates for receiving at least one moving image data of the first or second moving image;
A user interface unit that performs control processing to generate and display a screen for operation by a user including an inspector;
Transmission selection for selecting to which of the plurality of moving image data receiving means a plurality of moving image data including the first and second moving images of the moving image processing unit is transmitted based on a user operation on the screen And
Based on the user's operation on the screen, specify which of the plurality of moving image data including the first and second moving images of the moving image processing unit is to be given a character, and for the specified moving image data A character giving unit for giving an arbitrary character by the user,
A plurality of moving image data including the first and second moving images is transmitted from the moving image processing unit to the plurality of moving image data receiving means according to a selection state by the transmission selection unit, and the moving image transmitted to the storage unit The data is stored, the moving image data transmitted to the display unit is displayed, and in the case of displaying the moving image data with the character added, the image is displayed with the characters superimposed,
Based on a user operation on the screen, the moving image processing to be applied to a plurality of moving image data including the first and second moving images, and a condition adjustment unit for adjusting the condition or parameter thereof,
Based on the user's operation on the screen, a plurality of moving image data including the first and second moving images, moving image processing applied to each moving image data, its condition or parameter, and transmission of each moving image data Information management of the relationship between each element including the previous video data receiving means,
The user interface unit, based on a user operation on the screen, the moving image data transmitted from the photographing unit as the type of the first moving image to be subjected to moving image processing by the moving image processing unit, It has a video type designation part that can be designated from the video data read after being saved in the storage part,
The moving image processing unit inputs a first moving image of the specified type based on a user operation on the screen, and performs moving image processing including the image quality improvement processing on the first moving image. 2 is generated, and the second moving image is transmitted to the moving image data receiving means of the transmission destination according to the selection state by the transmission selection unit,
A setting unit that presets an allowable value of processing time according to the type of input moving image to be processed by the moving image processing;
The moving image processing unit applies an allowable value of the processing time according to the type of moving image to be subjected to the moving image processing based on a user operation on the screen, and the moving image transmitted from the photographing unit When performing the moving image processing on the data, if the processing time required for the moving image processing exceeds the allowable value, the entire processing time is shortened by omitting part of the content of the moving image processing, When the moving image processing is performed on the moving image data that has been once stored in the storage unit, the moving image data reading rate from the storage unit is adjusted so as to be within the allowable processing time. ,
Visual inspection device. In the visual inspection apparatus according to claim 1 or 2 ,
An electronic circuit board including the moving image processing unit;
A fan for cooling a portion including the electronic circuit board;
A unit for housing a portion including the electronic circuit board and the fan;
A dustproof filter attached to cover the air inlet of the unit,
The visual inspection device, wherein the dustproof filter is detachably fixed to the outside of the unit by a removal mechanism. In the visual inspection apparatus according to claim 1 or 2 ,
An electronic circuit board including the moving image processing unit;
A fan for cooling a portion including the electronic circuit board;
A unit for housing a portion including the electronic circuit board and the fan;
A dustproof filter attached to cover the air inlet of the unit,
The visual inspection device, wherein the dustproof filter is detachably fixed to the inside of the unit by a removal mechanism.