JP7027494B2 - Systems and methods for menu directed inspection - Google Patents

Description

The subject matter disclosed herein relates to non-destructive inspection. In particular, the subjects described below relate to systems and methods for performing nondestructive testing via Menu Directed Inspection (MDI).

Some devices can be used to inspect various systems and equipment such as power generation equipment and equipment, oil and gas equipment and equipment, aircraft equipment and equipment, manufacturing equipment and equipment, and the like. The inspection device may include various non-destructive inspection or non-destructive testing (NDT) devices. For example, video borescopes, portable overcurrent inspection devices, portable X-ray inspection devices, etc. can be used to observe or inspect systems and equipment using nondestructive inspection techniques. NDT equipment and NDT computing systems provide a graphical user interface that helps users perform NDT inspections, perform inspection functions, and provide inspection data to computing devices connected to NDT equipment. Can be prepared. It would be beneficial to improve the graphical user interface of the NDT appliance and improve the overall efficiency of NDT testing.

U.S. Patent Application Publication No. 2013/033519

Several embodiments within the scope of the originally claimed invention are summarized below. These embodiments are not intended to limit the scope of the claimed invention, but these embodiments are intended only to provide a brief overview of the feasible embodiments of the invention. ing. In fact, the invention can embrace various aspects that may or may not be similar to the embodiments described below.

In one aspect, a method of performing a non-destructive test (NDT) is provided. In one embodiment of the method, a tree model of machine inspection may be displayed on the display of the NDT device. The tree model may contain multiple nodes, each of which may correspond to a checkpoint for inspection. In this method, the inspection tree model may also be provided to a web browser configured on a computing device communicatively connected to the NDT device. A web browser may display a web page that presents a tree model. In this method, the NDT device may further receive user input for selecting a node in the tree model. In this method, the inspection data of the machine may also be acquired by using the NDT device. The inspection data may be acquired at the inspection point corresponding to the selected node. In addition, the method may use an NDT device to present inspection data along with a tree model on a web page. The inspection data may be automatically presented in real time on a web page because the inspection data is associated with the selected node.

In one aspect, a method of creating an inspection tree model for nondestructive testing (NDT) inspection is provided. In one embodiment of the method, an inspection template associated with an NDT inspection may be provided. The inspection template may include a template tree model, which corresponds to a machine inspection and may contain multiple nodes. Each of the plurality of nodes of the template tree model may correspond to the inspection point of the NDT inspection. In this method, one or more defect characteristics may also be applied to at least one node of the template tree model. Each of the applied defect characteristics may be selected from a plurality of defect characteristics that characterize the machine's defects. The method may further apply one or more inspection instructions to at least one node of the template tree model. Each of the applied inspection orders may be selected from a plurality of inspection instructions that characterize the inspection tasks performed during the NDT inspection of the machine. The method may also apply one or more image transformations to at least one node of the template tree model. Each of the applied image transformations may be selected from a plurality of image transformations that characterize the image processing modifications applied to the image data acquired during the NDT inspection at the inspection point. In addition, the method may generate an inspection tree model that includes defect characteristics, inspection instructions, and image transformations applied to at least one node of the template tree model based on the inspection template. Further, in this method, the inspection tree model generated during the NDT inspection may be displayed on the display of the NDT apparatus.

A non-temporary computer program product (ie, a physically implemented computer) that is executed by one or more data processors in one or more computing systems and contains instructions that operate at least one data processor. Program products) are also described. Similarly, a computer system having one or more data processors and memory connected to one or more data processors is also described. The memory may temporarily or permanently store instructions that cause at least one processor to perform one or more of the operations described herein. Further, the method may be distributed within a single computing system or among two or more computing systems and implemented by one or more data processors. These computing systems are connectable and have one or more connections, including connections over networks (eg, the Internet, wireless wide area networks, local area networks, wide area networks, wired networks, etc.). Data and / or commands or other commands may be exchanged, such as through a direct connection between multiple computing systems.

These and other features, embodiments and advantages of the invention will be better understood by reading the following detailed description with reference to the accompanying drawings in which similar reference numerals indicate similar parts throughout the drawing. ..

It is a figure which shows the apparatus and system of a plurality of nondestructive test (NDT) by one Embodiment of this approach. FIG. 1 is a screenshot of a home screen included in the graphical user interface (GUI) of the NDT device of FIG. 1 according to an embodiment of this approach. It is a screenshot of the inspection detail screen included in the GUI of the NDT apparatus of FIG. 1 according to one embodiment of this approach. It is a screenshot of the inspection point screen included in the GUI of the NDT apparatus of FIG. 1 according to one embodiment of this approach. It is a figure which shows the various screen embodiments displayed by searching the inspection point tree by one embodiment of this approach. FIG. 6 is a screenshot of the inspection point screen included in the GUI of the NDT apparatus of FIG. 1, according to another embodiment of the approach. It is a screenshot of the report setting screen included in the GUI of the NDT apparatus of FIG. 1 according to one embodiment of this approach. It is a screenshot of the page layout screen included in the GUI of the NDT apparatus of FIG. 1 according to one embodiment of this approach. It is a figure which shows the example of the process which performs a non-destructive test by one Embodiment of this approach. It is a figure which shows the example of the web page configured to provide the inspection data acquired during the NDT inspection by one embodiment of this approach. It is a figure which shows the example of the process of making the tree model of NDT inspection by one embodiment of this approach. It is a figure which shows the example of the inspection template including the template tree model by one Embodiment of this approach.

Specific embodiments of the present invention are described below. In order to provide a concise description of these embodiments, all features of the actual implementation may not be described in the specification. It should be noted that in the development of such an actual implementation, as in a technology or design project, the FAA's Airworthiness Directive (AD) may vary from implementation to implementation in order to achieve the developer's specific goals. It should be understood that many implementations should make specific decisions, such as compliance with inspection requirements required by such industry or government agencies, or system-related and business-related constraints. Moreover, it is understood that such development efforts, which can be complex and time consuming, are the routine tasks of design, manufacture and manufacture for those with ordinary knowledge who benefit from this disclosure. Should be.

When introducing the elements of various embodiments of the invention, the articles "a", "an", "the" and "said" are intended to mean that there is one or more of the elements. ing. The terms "comprising", "inclating" and "having" are not exclusive and are intended to have additional elements other than those listed.

The present embodiment generally covers systems for performing non-destructive inspection of industrial equipment using, for example, various portable non-destructive testing (NDT) devices described in more detail below. In particular, the embodiments described herein relate to a graphical user interface (GUI) for providing a menu-driven inspection (MDI) technique. The MDI configuration can model inspection areas and inspection points as inspection point trees. Then, the operator of the NDT device can search the inspection point tree and acquire images and videos of specific inspection areas and inspection points. By following the inspection point tree, the operator can quickly and efficiently inspect the appliance and obtain an improved test coverage of the appliance. In addition, the MDI configuration can automatically map the acquired images and videos to the corresponding inspection areas and inspection points, as compared to, for example, not using the MDI techniques disclosed herein. When this happens, the inspection of equipment and equipment can be improved. MDI GUI also allows an operator to flag an image or video if he suspects or observes a defect within a particular inspection point or area. The GUI may then present vertically side-by-side icons indicating whether the image and video for the inspection point or area have been flagged. In addition, the GUI can include an interactive marker that displays the current path through the checkpoint tree and can be used to navigate to different nodes in the checkpoint tree.

As an introduction, FIG. 1 shows a block diagram of various portable NDT system embodiments that may include the techniques described herein. In the embodiments shown herein, the portable NDT system includes a video borescope 10, an overcurrent inspection device 12, a portable pan-tilt zoom (PTZ) camera 14, an ultrasonic flaw detector 16, a portable digital radiography device 18, and a portable digital radiography device 18. The interface device 20 can be provided. The aforementioned NDT is suitable for providing enhanced visualization (eg, with a larger screen display) and for remote control and operation of the NDT systems 10, 12, 14, 16 and 18. It can be a mobile device (eg, a mobile phone, laptop, tablet, etc.) communicatively coupled to systems 10, 12, 14, 16, 18. The NDT systems 10, 12, 14, 16, 18, 20 are connected to each other to form a local server (eg, a local area network (LAN) server), a remote server (eg, a wide area network (WAN) server), and a "cloud". Can be connected to base equipment and services. In one embodiment, the interface device 20 is software "executable via a MENTOR ™ hardware device or portable device (eg, mobile phone, telephone, tablet, etc.) available from the General Electric Company in Schenectady, NY. It can be "application software (app)". Similarly, devices 10, 12, 14, 16, 18 may also be available from the General Electric Company in Schenectady, NY. Also, in some embodiments, devices 10, 12, 14, 16, 18 may be obtained from Baker Hughes Company, Waygate Technologies, Houston, Texas.

The NDT apparatus 10, 12, 14, 16, 18, 20 shown herein comprises processors 22, 24, 26, 28, 30, 32 and memories 34, 36, 38, 40, 4244, respectively. There is. NDT devices 10, 12, 14, 16, 18, 20 are in addition to other NDT devices 10, 12, 14, 16, 18, 20, as well as "cloud" based systems, servers, computing devices (eg, eg). It can be equipped with a suitable communication system for communicating with external systems such as tablets, workstations, laptops, notebooks, etc.). The memory 34, 36, 38, 40, 4244 is a computer code or computer code that can be executed via the respective processors 24, 26, 28, 30, 32, 34, which implement the various techniques described herein. It may include tangible non-temporary storage devices suitable for storing instructions. The devices 10, 12, 14, 16, 18, 20 may also be equipped with their respective displays useful for visualizing the techniques described herein. In operation, the operator 46 may also include an oil / gas device 50 of a pipe or conduit 56 having a bend or bend, such as inside a pipe or conduit 52, a place 54 in water (or in a liquid). NDT devices 10, 12, 14, 16, 18, 20 can be utilized to inspect equipment 48, including equipment that may include locations where it is difficult to observe such locations. Aircraft systems, power generation systems that may include conduit 60, various surfaces 62, 64, and in many other applications can be used to find unwanted cracks 66 or to visualize parts 68. Other systems such as (eg, gas turbines, steam turbines, wind turbines, hydraulic turbines, internal combustion engines, generators, electric motors, etc.), mechanical devices (eg, compressors, expanders, valves, actuators, etc.) 58 can also be inspected. Thus, X-ray observation modality, ultrasonic observation modality, and overcurrent observation modality can be used to enhance the visual observation of various devices, such as aircraft systems 58 and equipment 48. .. For example, the interior and walls of pipes 52, 56, 60 can be inspected for corrosion and erosion. Similarly, internal failures or unwanted growth of pipes 52, 56, 60 can be detected using devices 10, 12, 14, 16, 18, 20. Similarly, cracks or cracks inside certain iron or non-iron materials 62, 64 can be observed. In addition, the placement and feasibility of the component 68 inserted inside the component can be verified. In fact, using the techniques described herein can improve the inspection of equipment 48 and system 58.

The NDT devices 10, 12, 14, 16, 18 utilize a menu-driven inspection (MDI) GUI that allows the operator 46 to inspect equipment 48 and system 58. As described herein, the MDI has devices (eg, NDT devices 10, 12, 14, 16,) in and around equipment 48 and system 58 to acquire images and videos. For NDT inspection using a graphical "menu" with several visual components (eg icons, text components, numerical components, etc.) to assist the operator in navigating 18, 20). It's a technology. MDI programs on NDT devices 10, 12, 14, 16, 18, 20 utilize GUI 70, as shown in FIGS. 2-8 and further described below. However, the embodiments and features of the embodiments described below can also be applied to other types of inspection programs used in NDT equipment.

Next, referring to FIG. 2, the GUI 70 includes a home screen 72. The home screen 72 may be the first screen presented to the startup by the NDT device (eg, the videoborescope 10). Alternatively, the home screen 72 may be shown after other screens. The home screen 72 includes a list 73 of all ongoing examinations assigned to the operator 46. Each in-progress inspection is represented by tile 74. It should be noted that in other embodiments of interface configuration 70, other types of design specifications may be used to indicate an ongoing inspection. In that represented embodiment, Listing 73 includes four tiles 74.

As shown in FIG. 2, each tile 74 has a label or title 76 used to identify the inspection, the name 78 of the folder containing the data related to the inspection, and the last date the inspection was performed. The date 80 corresponding to can be included. In some embodiments, the particular tile 74 may also include a flag icon 82 suitable for "bookmarking" or otherwise to indicate that the corresponding inspection was the last performed inspection. can. Further, in some embodiments, the tile 74 has a corresponding inspection during the last period of time that the NDT device was connected to an external system used to generate, assign, and supervise the inspection. It can include a "new" label 84 indicating that it has been downloaded to the NDT device. Alternatively or additionally, the "new" label 84 may indicate that the operator 46 has not yet begun the corresponding inspection. That is, the "new" label 84 can indicate that the tile 74 corresponds to the template for the corresponding inspection and that the operator 46 has not yet started or finished the corresponding inspection.

As shown in FIG. 2, the home screen 72 can also include some buttons (eg, virtual buttons) that indicate the actions that the operator 46 can take for the inspection. For example, the operator 46 may select any tile 74 to activate the "resume" button 86 to resume the corresponding inspection. Invoking the "restart" button 86 can lead the operator 46 to the last saved point in the inspection or to the beginning of the inspection. In another example, the operator 46 may activate the "Resume Last" button 88 to resume the last performed inspection. This selection can guide the operator 46 to the last saved point in the inspection or to the beginning of the inspection, similar to the "Resume" button 86.

The operator 46 also selects any tile 74 to activate the "report generation" button 90 to generate a shell document for the report containing the image associated with the corresponding inspection. Can be done. The "report generation" button 90 and its associated features are described in more detail below. Further, the operator can select any tile 74 and initiate a "management" menu 92 to access options related to managing the corresponding inspection.

When the operator 46 selects a new inspection, such as the "Craft" inspection shown in FIG. 2, he or she is presented with the inspection detail screen 94 shown in FIG. .. The inspection detail screen 94 can be used to collect and capture information related to the entire inspection. Some of the information, such as the serial number 98 of the device to be inspected, may be entered into the text box 96 by the operator 46. In addition, additional information such as the location to be inspected, inspector identification information, and additional asset characteristics may be incorporated. In addition, some of the information, such as the current date 100 and time 102, can be automatically captured and placed in text box 96.

Once the information has been entered into the inspection detail screen 94, the operator 46 can begin the inspection. In one embodiment, the inspection can be modeled using the inspection point tree data structure, and the inspection point tree data structure is displayed as a hierarchical view of the inspection points, as shown in FIGS. 4-6. Can be done. In particular, each checkpoint and region can be represented as a node in the checkpoint tree. As shown in FIGS. 4-6, each node can have children. For example, a node corresponding to an inspection area can have several children corresponding to inspection points located within the inspection area.

Next, referring to FIG. 4, the operator 46 first sees the inspection point screen 104 associated with the root of the inspection point tree 106. Although the checkpoint screen 104 is described below as compared to the root of the checkpoint tree 106, the checkpoint screen 104 can be navigated and used to display any node of the checkpoint tree 106. ..

The checkpoint screen 104 can include a child node 107 of the current node (eg, the root in the represented embodiment). For example, the checkpoint screen 104 in FIG. 4 includes five child nodes 107 corresponding to the five children of the root of the checkpoint tree 106. Each child node 107 has a node name 108 and an associated checkpoint or region, a counter 110 indicating the number of images currently captured for the child node 107, and a video currently captured for the child node 107. Includes a counter 112 indicating the number. If a particular child node 107 has any children, the child node 107 causes the screen 104 to redisplay all child nodes of the selected node 107 (eg, grandchild nodes of the root of tree 106) when selected. The arrow icon 114 can be included, thus allowing the tree 106 to be explored in depth-first. Other tree navigating techniques, including breadth-first, going to nodes, etc., can also be used. Each child node 107 also includes a color strip icon 116 indicating whether any image and video associated with the child node 107 has been flagged, the color strip icon 116 being discussed in more detail below. Will be done.

The checkpoint screen 104 can also include an interactive label or marker 118 indicating the current path through the checkpoint tree 106. For example, FIG. 4 shows the route of the inspection point tree 106, so that the interactive marker 118 includes only the title of the inspection. As the operator 46 searches the checkpoint tree 106, the interactive marker 118 is expanded or collapsed to indicate the current path. Further, each node displayed on the interactive marker 118 is a checkpoint screen 104 for that particular node so that when selected, the operator can search the checkpoint tree using the interactive marker 118. Navigate to.

The inspection point screen 104 may further include a "stop" button 120 to save and exit the inspection when started. For example, the last node searched may be saved in the current inspection state. In addition, the checkpoint screen 104 may include an "up" button 122 that, when selected, navigates to the checkpoint screen 104 for the parent node of the current node. As will be appreciated, the "up" button 122 can be an alternative to using the interactive marker 118 to explore the inspection point tree. The checkpoint screen 104 can also include a "references" button 124 that, when selected, pulls out a display of references associated with the current node. The "reference" button 124 is described in more detail below. Also, the inspection point screen 104 can include a "report generation" button 90. The inspection point screen 104 may further include an inspection progress notification 125. The inspection progress notification 125 may provide an inspection progress indicator to the NDT operator performing the inspection. In some embodiments, the inspection progress indicator 125 may be displayed on the inspection point screen 104 depending on the comparison between the inspection progress rate of the current inspection and the predetermined inspection progress rate.

It should be noted that in some embodiments, the background of the inspection point screen 104 can be the current view of the sensor (eg, camera), as shown in FIG. In fact, the graphical menu of FIG. 4 can be overlaid and used on images and videos during the inspection process. Using the right angle icon 114, the interactive marker 118, and the "up" button 122, the operator 46 can navigate to all the nodes of the inspection point tree 106. For example, the operator 46 can search for a particular level of inspection point tree 106, as shown in FIG. For example, FIG. 5 shows a first screen state 115 to reach the inspection point screen 104 represented in FIG. 6, and a second screen state 117 reached via user selection 119, and user selection. It shows the third screen state 121 reached via 123.

As mentioned above, the inspection point screen 104 of FIG. 6 includes a child node 107, an interactive marker 118, an "stop" button 120, an "up" button 122, a "reference" button 124, and a "report generation" button 90. .. Further, neither of the two child nodes 107 has children, as evidenced by the lack of the right angle icon 114 in FIG. At this point, the operator 46 can acquire an image or video for each of the inspection points (ie, the nozzle guide V and the rotor blades) represented by the child node 107. In particular, the operator 46 selects one of the child nodes 107 and begins to acquire images and videos. The MDI program relates to a manual association process (eg, a non-MDI process) that is performed after the inspection is completed by associating the acquired images and videos with the selected child node 107 as the images and videos are captured. Improve. Further, as the operator 46 acquires images and videos, the counters 110 and 112 are updated on a display operably coupled to the NDT device. As will be appreciated, counters 110 and 112 for parent nodes, grandparent nodes, etc. are also off-screen but updated.

If the operator 46 suspects or observes a defect (eg, crack 66) based on the image or video, he or she may flag the image or video. As mentioned above, the color strip icon 116 is updated as needed to indicate whether the image or video associated with the checkpoint node has been flagged. For example, in FIG. 6, a child node 106 entitled "Nozzle Guide V" has a red strip icon 116 indicating that at least one image or video associated with the inspection point node has been flagged. Have. However, the child node "106", entitled "Loader Blade", has a green strip icon 116 indicating that neither the associated image nor the video is flagged. In some embodiments, the functionality of the color strip icon 116 may be combined with the functionality of the counters 110 and 112. For example, the yellow strip icon 116 can indicate that no image or video was acquired for the selected checkpoint node and its children. Like the counters 110 and 112, flagging the image and video affects the color strip icon 116 not only for the selected child node 106, but also for the parent node, grandparent node, and so on.

In addition to flagging images and videos, operator 46 can also add comments. Some common comments, such as "the conduit needs to be cleaned," can be a pre-stored option that allows the operator 46 to make choices to add to the image or video. Further, in certain embodiments, the operator 46 may also record voice annotations during the examination of a particular child node 107.

As mentioned above, the inspection point screen 104 shown in FIG. 6 includes a "reference" button 124. When selected, the References button 124 elicits a display of references, including reference manuals associated with the selected checkpoint node. The reference manual is a condition for the corresponding inspection point (eg, "very good condition", "acceptable"" that the operator 46 can compare with the images and videos acquired to evaluate the inspection point. , "Maintenance required", etc.) can be indicated. The reference material may include an illustration of the orientation of the image that is desired to be captured in the examination. In some embodiments, the reference manual may be shown side by side with the MDI program so that the operator 46 can view the MDI program and the reference manual without searching between the two objects. In other embodiments, the reference material may include a translucent image that can be displayed as an overlay over the live inspection image as an aid to orient the object under inspection in the desired orientation.

The inspection point screen 104 of FIG. 6 also includes a "report generation" button 90, as described above. When activated, the "report generation" button 90 will press the information collected via the inspection detail screen 94 and all images and any accompanying data (eg, whether the images are flagged or have any comments). Generate a shell document for the report that contains. In some embodiments, the shell document also includes a link (eg, a hyperlink) to a repository that contains video and some accompanying data. Alternatively or in addition, the shell document may include the actual video and any accompanying data. Similarly, a shell document can include a link to a repository that contains recorded voice annotations or recorded voice annotations.

The operator 46 may have some control over the format of the shell document. For example, selecting the "report generation" button 90 can bring up a report setting screen 126 similar to that in FIG. The report setting screen 126 can include a summary 128 of the images contained in the shell document, the name of the shell document, the layout 127 of the shell document, the cover page type, and the final page type. The report setting screen 126 can also include options for the operator 46 to preview the shell document. If the operator 46 desires, he or she may modify any information in the summary 128, such as the layout of the shell document. For example, invoking a change button as shown in FIG. 7 enumerates various formatting or layout embodiments for a shell document, as shown in FIG. 8, a page layout screen. Can cause 130. For example, one image 132 with the text at the top of the layout, one image 134 with the text at the bottom of the layout, 136 pairs of images with the text at the top of the layout, and a pair with the text at the bottom of the layout. Image 138, paired image 140 with text on the left side of the layout, paired image 142 with text on the right side of the layout, multiple images 144 with text on the left side of the layout, with text on the right side of the layout Pull out multiple images 146 and so on. In fact, different layouts may be provided, suitable for some images, along with the associated text, at the top, at the bottom, on the left, on the right, or in combination thereof. Alternatively or in addition to this, some information in summary 128 may be immutable.

Looking back at FIG. 7, when operator 46 is satisfied with the preview of the shell document, he or she can generate the shell document, which is then the same as any other file associated with the inspection. Saved to location. In some embodiments, the operator 46 transfers the generated reports, inspection files, images, videos, and other associated data to a storage location, the inspection system described above, and other components, devices and systems. Can be sent.

FIG. 9 shows an example of process 900 performing a nondestructive test according to the embodiments described herein. Process 900 enables transmission / reception of NDT inspection data and inspection progress data between the above-mentioned NDT devices illustrated in FIG. This allows inspection data to be provided to experts and / or inspection managers to assess inspection progress, NDT inspection equipment usage, and inspection quality. The interface used herein is monitored in real time or substantially in real time and continuously provides inspection progress data via web-based applications and interfaces to provide NDT equipment 10, 12, 14, 16 , 18 and improve the operation of the interface device 20. In one embodiment, inspection data and inspection progress data may be provided to a remote computing device connected to an NDT device used in inspection via a cloud computing environment. The inspection data and inspection progress data may be continuously provided to the interface device in a live dynamic manner as the inspection progresses. The progress of NDT inspection and the management of NDT inspection can be enhanced by the systems and methods described with reference to FIG.

As shown in FIG. 9, in step 910, a tree model of machine inspection is displayed on the display of the NDT device. NDT devices such as NDT devices 10, 12, 14, 16, 18 may display a tree model associated with NDT inspection performed on the machine at one or more inspection sites. The inspection site may correspond to each node of the tree model 106 as described with reference to FIG. Machines to be inspected include power generation systems, oil and gas production systems, aircraft, automobiles, ships, industrial manufacturing facilities, chemical treatment facilities, and the like. Each node of the tree model 106 may correspond to an inspection site associated with a component of the machine being inspected or associated with another machine being inspected.

In step 920, the tree model 106 is provided to a web browser configured on a computing device 20 communicably connected to one or more of the NDT devices 10, 12, 14, 16, 18. A web browser can provide a web page displaying a tree model to a user who is far away from where the NDT inspection is taking place. A web browser may be configured to dynamically update the web page displaying the tree model so that the test data and test progress data are automatically provided via the web page when the test is performed. In some embodiments, the web page may include a graphical icon configured to connect the web page to the NDT devices 10, 12, 14, 16, 18. In some embodiments, the inspection data and the inspection progress data are dynamically set by a predetermined time schedule set by the user, such as every minute, every hour, every 6 hours, every 12 hours, every 24 hours, and the like. You may configure the web page to update.

In step 930, a user input for selecting a node in the tree model 106 is received on the NDT device. The user can select a node such as node 107 of the tree model 106 shown in FIG. The user performing the inspection may select node 107 when he / she arrives at the inspection site corresponding to node 107. In step 940, the user uses the NDT device to acquire machine inspection data. In some embodiments, the inspection data may include images, flagged images, videos, flagged videos, or a combination thereof associated with a machine located at a location corresponding to node 107. Further, in some embodiments, additional details related to the subject to be inspected may be automatically obtained from an external device communicably connected to the NDT device. For example, the blade number at a particular stage during inspection can be obtained from an external device used to rotate the engine during inspection. In step 950, the user uses the NDT device to associate the inspection data with the selected node.

In step 960, the inspection data is provided on the web page along with the tree model. The inspection data and the inspection progress data can be transmitted from the NDT devices 10, 12, 14, 16 and 18 to the interface device 20, and may be presented on a web page displayed on a web browser provided in the interface device 20. .. Inspection data and / or inspection progress data may be displayed on a web page when visiting an inspection site (or node) and / or when inspection data is acquired at that location. In some embodiments, inspection data and / or inspection progress data can be provided to a web page based on the approval of the inspection data by the operator of the interface device 20.

FIG. 10 shows an example of a web page 1000 displayed in a web browser 1005 configured on the interface device 20 of FIG. As shown in FIG. 10, the web page 1000 may include a tree model 106 that includes a node 107. Web page 1000 also includes an "inspection progress control" button 1010 that can be configured to rewind, play, fast forward, stop, pause, and record an in-flight inspection. Web page 1000 may also present an estimated completion time 1015 to complete the inspection based on the inspector's inspection progress 1020. Further, the current inspection rate 1025 may be obtained and displayed on the web page 1000. In some embodiments, the current inspection rate may be compared to the target inspection rate or the objective inspection rate 1030. Comparing the target inspection rate 1030 with the current inspection rate 1025, the inspection progress notification is provided to the NDT devices 10, 12, 14, 16 and 18, and the inspection progress status for the desired or target inspection rate 1030 is inspected. You may decide whether to notify the user who is implementing. In some embodiments, the web page 1000 is an icon for directly connecting the web page 1000 to the NDT devices 10, 12, 14, 16, 18 so that it can be seen as soon as the data is acquired by the NDT device. 1035 may be included.

FIG. 11 shows an example of process 1100 for creating a tree model 106 for NDT inspection according to one embodiment of this approach. The tree model 106 can consist of an inspection template tree model that allows the user to set the node 107 associated with the inspection site of the machine. Further, in the inspection tree model, the user can associate characteristics such as defect characteristics, inspection instructions, and image transformations applied to the inspection data collected at each inspection site with each node 107. In this way, the NDT inspection can be customized to provide the operator of the NDT device with robust data regarding appropriate defects, inspection methods, and / or inspection image processing.

In step 1110, the inspection template associated with the NDT inspection is provided to the computing device such as the interface device 20. The inspection template may have a tree structure such as a template tree model. The template tree model may include multiple nodes 107, each associated with a different inspection point in the NDT inspection.

In step 1120, the user applies one or more defect characteristics to the nodes of the template tree model. Defect characteristics may include defects that may be identified during inspection of the machine. The user may select defect characteristics from the list of defect characteristics that characterize machine defects or expected defects and apply one or more defect characteristics to node 107. In some embodiments, defect properties may include cracks, chars, dents, chips, stains, scratches, and / or quality control defects. The defect characteristics applied to node 107 can characterize machine defects at the inspection point position as characteristics of the acquired inspection data.

At step 1130, the user applies one or more inspection instructions to the nodes of the template tree model. The inspection instruction may include tasks performed during the inspection at the inspection point location associated with node 107. The user may select an inspection instruction from the list of inspection instructions related to inspection of the machine and apply one or more inspection instructions to node 107. For example, in some embodiments, inspection instructions may include measurement tasks, device configuration tasks, display configuration tasks, reference evaluation tasks, inspection approval tasks, and inspection criteria tasks.

The measurement task inspection command may include a command notifying the user of the NDT device performing the inspection to obtain machine measurements such as machine dimensions, images, and / or scans. In some embodiments, the measurement task may include instructions for the user of the NDT device to obtain machine measurements by reconfiguring the NDT devices 10, 12, 14, 16, 18. The device configuration task may include instructions to guide the user of the NDT device to configure or reconfigure the NDT device in order to properly acquire the inspection data. For example, if the NDT device is preconfigured to acquire image inspection data in "stereo view", the inspection command at a particular node 107 will inspect the image at the inspection point position associated with that particular node 107. It may include a device configuration task that informs the user to apply a "single view" when retrieving data. In another example, the device configuration task may include instructions that modify the chip or attachment or use it on NDT devices 10, 12, 14, 16, 18 to make it possible to obtain higher quality or specific inspection data.

In some embodiments, the inspection command may include a display configuration task. The display configuration task provides instructions for setting or adjusting the display of acquired inspection data within NDT devices 10, 12, 14, 16, 18 and on remote computing devices connected to NDT devices such as interface device 20. It may be given to the user of the NDT device. The display configuration task also directs the inspection data to be properly displayed on the interface device 20 from the perspective of an expert or skilled inspection resource who may be away from the inspection site. May be good. In some embodiments, the inspection order may include a reference evaluation task. The reference evaluation task may notify the user of the NDT device 10, 12, 14, 16, 18 to access or browse the reference data associated with the inspection point location. For example, the reference evaluation task may include instructions on the NDT device 10, 12, 14, 16, 18 to automatically display a reference image for comparison with inspection data acquired by the user of the NDT device. This can emphasize to the user of the NDT device the importance of acquiring inspection data of a particular format or quality level provided via a reference evaluation task.

In some embodiments, the inspection order may include an inspection approval task. The inspection approval task may include instructions indicating whether the acquired inspection data needs to be provided to the administrator or a skilled resource before further inspection. In some embodiments, the inspection order may include an inspection reference task. The inspection criteria task may include criteria that must be met to complete the inspection at the inspection point location. For example, the inspection criteria task may include criteria performed by the user of the NDT device. In some embodiments, the inspection criteria task may include criteria regarding the quality, quantity, or format of the acquired inspection data.

In step 1140, the user applies one or more image transformations to the nodes of the template tree model. The image transformation may include image processing modifications or tasks performed during the inspection at the inspection point location associated with the node 107. The user may select an image transformation from the list of image transformations related to machine inspection and apply one or more image transformations to node 107. For example, in some embodiments, the image conversion includes brightness level correction (Brightness), inversion correction (Invert), inversion plus correction (Inverse +), contrast correction (Contrast), darkness boost correction (Darkness Boost), and zoom. Modifications (Zoom) may be included. The inversion correction may be set to adjust the display of the image data, such as horizontally inversion or overturning the inspection image so as to display a mirror image of the inspection image. The inversion plus correction may be set to invert the dark part and the bright part of the inspection data so that the dark area is inverted and displayed as a bright area and the bright area is inverted and displayed as a dark area.

In step 1150, an inspection tree model is generated based on the inspection template. The generated inspection tree model may include defect characteristics, inspection instructions, and image transformations that apply to any of the nodes contained in the template tree model. In some embodiments, the inspection tree model is based on the NDT apparatus user selecting a node in the inspection tree that contains the inspection instructions and / or image transformations applied in the template tree model. 12, 14, 16 and 18 may include instructions that can be read and executed by a computer configured to automatically set itself for inspection. This allows the user to operate the NDT devices 10, 12, 14, 16 and 18 to perform the inspection more efficiently without having to manually configure the NDT devices 10, 12, 14, 16 and 18. can. For example, if you select a node in the inspection tree model that has the zoom correction applied to the corresponding node in the tree model, the NDT devices 10, 12, 14, 16, 18 will automatically zoom or zoom in before retrieving the inspection data. May be set on the device.

In step 1160, during the NDT inspection, the generated inspection tree model is displayed on the displays of the NDT devices 10, 12, 14, 16 and 18. In some embodiments, the generated inspection tree model may be provided before or after performing the inspection. In some embodiments, the generated inspection tree model may be simultaneously displayed on the display of the interface device 20 communicably connected to the NDT devices 10, 12, 14, 16, 18.

FIG. 12 shows an example of an inspection template 1200 displayed on a computing device such as the interface device 20 of FIG. 1 that can be connected to the NDT devices 10, 12, 14, 16, 18. As shown in FIG. 12, inspection template 1200 is provided and may include template tree model 1205. The template tree model may include one or more nodes 1210 indicating inspection point locations from which inspection data is acquired during NDT inspection. Node 1210 is a defect property (eg, "DP"), an inspection instructions (eg, "Inst"), an image transformation (eg, "Image Transfers") (eg, "DP"), as shown in reference 1220 of node 1215. It may be configured to provide a list of "Transforms").

Users who configure nodes in the template tree model 1205 can use graphic icons such as pull-downs, toggles, checkboxes, or multi-component selectors associated with defect characteristics, inspection instructions, and image transformations applied to nodes 1210 and 1215, or similar. Can interact with the graphic display of. For example, as shown in FIG. 12, the user makes a switch or selection to see one or more image transformations applied to node 1215. The user can expand the list of image transformations 1225 and enter the selection of image transformations applied to node 1220. In the example of FIG. 12, the user inputs by "check" and selects the image conversion "zoom" applied to the node 1220. The inspection tree model generated based on the template tree model shown in the inspection template of FIG. 12 has an image transformation "zoom" applied to the rotor blade inspection data acquired at the inspection site associated with node 1215. Will be included.

The technical effects of this embodiment include a system for performing remote visual inspection of industrial equipment and constructing an inspection tree model for NDT inspection. Certain embodiments can improve the efficiency and effectiveness of the test. For example, the present embodiment includes a GUI for an MDI process that guides the user through areas and points of inspection based on an inspection tree model and sends inspection data to a web browser on a remote computing device in real time. For example, the remote operator or administrator may review the progress of the inspection and provide feedback on the inspection. By dynamically updating the inspection data in the web browser, the remote operator can immediately know the inspection data even if he / she is not at the inspection point position. Further technical effects of this embodiment include a system for creating an inspection tree model for NDT inspection. The GUI may be configured to provide an inspection template that includes a template tree model to which the user can apply one or more of defect characteristics, inspection instructions, and / or image transformations. The GUI may generate an inspection tree model based on the template tree model. The inspection tree model may include nodes that identify and include applied defect characteristics, inspection instructions, and image transformations. As such, the GUI provides an efficient means of performing NDT inspections with customized requirements performed at each inspection point location. As a result, inspections can be performed more accurately and high-quality inspection data can be generated in the initial inspection, reducing the need for inspection data re-inspection and post-processing to correct errors in the acquired inspection data. can. It should be noted that the embodiments described in the present specification may have other technical effects and may solve other technical problems.

Exemplary embodiments have been described to facilitate an overall understanding of the principles of structure, function, manufacture, and use of the systems, devices, and methods disclosed herein. An example of one or more of these embodiments is shown in the accompanying drawings. The systems, devices, and methods specifically described herein and shown in the accompanying drawings are non-limiting and exemplary embodiments, and the scope of the invention is defined solely by the claims. Will be understood by those skilled in the art. The features illustrated or described in connection with one exemplary embodiment may be combined with the features of another embodiment. Such modifications and modifications are intended to be included within the scope of the invention. Further, in the present disclosure, components of similar names in embodiments generally have similar characteristics, and therefore, in certain embodiments, each feature of each component of similar names is not necessarily fully detailed. I'm not.

The subject matter described herein is analog electronic circuits, digital electronic circuits, and / or computer software, firmware, or hardware, including the structural means and structural equivalents thereof disclosed herein. It can be implemented in a combination of them. Also, the subject matter described herein is performed by a data processing device (such as a programmable processor, computer, or plurality of computers), or to control its operation, an information carrier (eg, machine-readable storage). It can be implemented as one or more computer program products, such as one or more computer programs that are actually incorporated into the device) or incorporated into the propagated signal. Computer programs (also called programs, software, software applications, or code) are written in any form of programming language, including compiled or interpreted languages, in stand-alone programs or modules, components, subroutines, or computing environments. It can be deployed in any format, such as other units suitable for use. Computer programs do not always support files. A program may be part of another program or file that holds data, a single file dedicated to that program, or multiple organizational files (for example, one or more modules, subprograms, or parts of code. It may be stored in the file to be stored). Computer programs may be deployed at one site or distributed across multiple sites and interconnected over a communication network so that they run on one computer or multiple computers.

The processes and logical flows described herein, including the method steps of the subject matter herein, are performed and input by one or more programmable processors running one or more computer programs. By processing the data to produce output, the functions of the subject matter described herein may be performed. The apparatus of the subject described herein may be implemented as a dedicated logic circuit, such as a GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). The logic flow can also be executed by a dedicated logic circuit.

Suitable processors for running computer programs include, for example, general purpose and dedicated microprocessors, and any one or more processors of any type of digital computer. In general, processors receive instructions and data from read-only memory and / or random access memory. Essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. In general, computers are also equipped with one or more mass storage devices for storing data, such as magnetic / magneto-optical disks, optical discs, etc., or are operably connected to transmit or receive data. Or both. Suitable information carriers for embodying computer program instructions and data include, for example, semiconductor memory devices (such as EPROM, EEPROM, and flash memory devices), magnetic disks (such as internal hard disks or removable disks), magneto-optical disks, and so on. Includes all forms of non-volatile memory, including optical discs (such as CD and DVD discs). Processors and memory may be complemented or incorporated into dedicated logic circuits.

In order to interact with the user, the subject matter described herein is, for example, a display device for displaying information such as a CRT (Casode Ray Tube) or an LCD (Liquid Crystal Display) monitor, and the user inputs to a computer. It may be carried out on a computer having a keyboard or a pointing device (such as a mouse or a trackball) for performing the above. Interaction with the user can also be achieved using other types of devices. For example, the feedback provided to the user may be any form of sensory feedback (such as visual feedback, auditory feedback, or tactile feedback), and the input from the user may be any, including acoustic, audio, or tactile input. Can be received in format.

The techniques described herein can be performed using one or more modules. It should be noted that, as used herein, the term "module" refers to computing software, firmware, hardware, and / or various combinations thereof. However, at the very least, the module should not be construed as software that is not implemented in the hardware, firmware, or recorded on a storage medium that can be read and recorded by a non-temporary processor (that is, the module is software). Not that). In fact, a "module" is always interpreted to include at least some physical and non-temporary hardware, such as a processor or part of a computer. Two different modules may share the same physical hardware (eg, two different modules may use the same processor and network interface). The modules described herein can be connected, integrated, separated, and / or duplicated to support a variety of applications. Also, the functions described herein as being performed in a particular module are in place of or in addition to the functions performed in that module, and / or in one or more other modules. It may be executed by one or more other devices. In addition, the modules may be implemented on multiple devices and / or other components local or remote to each other. Modules can also be moved from one device to another and / or included in both devices.

The subject matter described herein allows a back-end component (eg, a data server), a middleware component (eg, an application server), or a front-end component (eg, a user to be involved in the implementation of the subject matter described herein). It may be implemented in a computing system with any combination of such backend, middleware, and frontend components), or a client computer with a graphical user interface or web browser. The components of the system can be interconnected by any form or medium, such as digital data communication, such as a communication network. Examples of communication networks include local area networks (LANs) and wide area networks (WANs), such as the Internet.

Throughout the specification and claims, the descriptive terminology used herein applies to modify any quantitative representation that may vary within tolerance without altering the relevant underlying functionality. Is to be done. Therefore, the values modified by terms such as "about", "approximately", and "substantially" are not limited to specific exact values. At least in some cases, the descriptive term may correspond to the accuracy of the device that measures the value. Throughout the specification and claims, scope limitations may be combined and / or replaced, and unless otherwise specified in context or language, such scope shall be deemed to include all subranges contained therein.

One of ordinary skill in the art will understand the further features and advantages of the invention based on the above embodiments. Therefore, this application is not limited to the contents specifically illustrated and described, except as indicated by the appended claims. All publications and references cited herein are expressly incorporated herein by reference in their entirety.

10 Video Borescope 12 Overcurrent Inspection Device 14 Portable Pan-Tilt Zoom (PTZ) Camera 16 Ultrasonic flaw detector 18 Portable Digital Radiography Device 20 Interface Device 22, 24, 26, 28, 30, 32 Processors 34, 36, 38 , 40, 42, 44 Memory 46 Operator 48 Equipment 50 Oil and gas equipment 52 Pipes or conduits 54 Underwater (or in liquid) locations 56 Pipes or conduits with curves or bends 58 Systems 60 Pipes 62, 64 Surfaces 66 Cracks 68 Parts 70 GUI
72 Home screen 73 List 74 Tile 76 Label or title 78 Name 80 Date 82 Flag icon 84 Label 86 Resume button 88 Resume last button 90 Report generation button 92 Administration menu 94 Inspection details screen 96 Text box 98 Serial number 100 Date 102 Hours 104 Checkpoint screen 106 Checkpoint tree 107 Child node 108 Node name 110, 112 Counter 114 Right arrow icon, Right angle icon 115 First screen state 117 Second screen state 116 Color strip icon 118 Interactive label or marker 119 User selection 120 "Stop" button 121 Third screen status 122 "Up" button 123 User selection 124 "Reference" button 125 Inspection progress notification 126 Report setting screen 127 Layout 128 Summary 130 Page layout screen 132 , 134, 136, 138, 140, 142, 144, 146 Image 1000 Web page 1005 Web browser 1010 "Inspection progress control" button 1015 Estimated completion time 1020 Inspection progress 1025 Current inspection rate 1030 Target inspection rate 1035 Icon 1200 Inspection template 1210 , 1215 Node 1220 See 1225 Image conversion

Claims (10)

A method of creating an inspection tree model for nondestructive testing (NDT) inspection.
A step of providing an inspection template associated with an NDT inspection, wherein each node contains a plurality of nodes corresponding to the inspection points of the NDT inspection and has a template tree model corresponding to the inspection of the machine.
A step of applying one or more defect characteristics selected from a plurality of defect characteristics, each of which characterizes the defect of the machine, to at least one node of the template tree model.
A step of applying one or more inspection instructions selected from a plurality of inspection instructions, each of which characterizes the task performed during the NDT inspection of the machine, to at least one node of the template tree model.
One or more images selected from a plurality of image transformations, each characterized image processing modifications applied to the image data acquired during the NDT inspection at the inspection point, on at least one node of the template tree model. The steps to apply the transformation and
A step of generating an inspection tree model, including defect characteristics, inspection instructions, and image transformations applied to at least one node of the template tree model, based on the inspection template.
During the NDT inspection, the step of displaying the generated inspection tree model on the display of the NDT device, and
How to include. The method of claim 1 , wherein the plurality of defect properties comprises one or more of cracks, chars, dents, chips, stains, scratches, and quality control defects. The method of claim 1 or 2 , wherein the plurality of inspection instructions characterize one or more of a measurement task, a device configuration task, a display configuration task, a reference evaluation task, an inspection approval task, and an inspection criterion task. The method according to any one of claims 1 to 3, wherein the plurality of image conversions feature one or more of luminance level correction, inversion correction, inversion plus correction, contrast correction, darkness boost correction, and zoom correction. .. For each node of the generated inspection tree model, the user selects at least one node of the inspection tree model that includes one or more inspection instructions and / or image transformations applied in the template tree model. The method of any one of claims 1 to 4, comprising a computer-readable and executable instruction that causes the NDT device to set itself for inspection. A system that creates an inspection tree model for non-destructive testing (NDT) inspection.
An NDT device with a display and
It comprises a memory, a display, and a computing device having a processor operably coupled to the memory and the display, communicatively connected to the NDT device.
The processor
An inspection template in which each node contains a plurality of nodes corresponding to the inspection points of the NDT inspection and has a template tree model corresponding to the inspection of the machine, and provides an inspection template associated with the NDT inspection.
Applying one or more defect characteristics selected from a plurality of defect characteristics, each of which characterizes the defect of the machine, to at least one node of the template tree model.
Applying one or more inspection instructions selected from a plurality of inspection instructions, each of which characterizes the task performed during the NDT inspection of the machine, to at least one node of the template tree model.
One or more images selected from a plurality of image transformations, each characterized image processing modifications applied to the image data acquired during the NDT inspection at the inspection point, on at least one node of the template tree model. Apply the transformation,
Based on the inspection template, an inspection tree model containing defect characteristics, inspection instructions, and image transformations applied to at least one node of the template tree model is generated.
A system characterized in that the generated inspection tree model is displayed on the display of the NDT device and is configured to perform an operation. The system of claim 6 , wherein the plurality of defect properties comprises one or more of cracks, chars, dents, chips, stains, scratches, and quality control defects. The system of claim 6 or 7 , wherein the plurality of inspection instructions characterize one or more of a measurement task, a device configuration task, a display configuration task, a reference evaluation task, an inspection approval task, and an inspection criterion task. The system according to any one of claims 6 to 8, wherein the plurality of image conversions feature one or more of luminance level correction, inversion correction, inversion plus correction, contrast correction, darkness boost correction, and zoom correction. .. For each node of the generated inspection tree model, the user selects at least one node of the inspection tree model that includes one or more inspection instructions and / or image transformations applied in the template tree model. The system of any one of claims 6-9, comprising a computer-readable and executable instruction that causes the NDT device to set itself for inspection.

Images