WO2024180824A1 - 表示制御装置、表示制御方法、及び表示制御プログラム - Google Patents
表示制御装置、表示制御方法、及び表示制御プログラム Download PDFInfo
- Publication number
- WO2024180824A1 WO2024180824A1 PCT/JP2023/040819 JP2023040819W WO2024180824A1 WO 2024180824 A1 WO2024180824 A1 WO 2024180824A1 JP 2023040819 W JP2023040819 W JP 2023040819W WO 2024180824 A1 WO2024180824 A1 WO 2024180824A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- display control
- images
- group
- control device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N23/00—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
- G01N23/02—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material
- G01N23/04—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and forming images of the material
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N23/00—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
- G01N23/02—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material
- G01N23/06—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and measuring the absorption
- G01N23/083—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and measuring the absorption the radiation being X-rays
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N23/00—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00
- G01N23/02—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material
- G01N23/06—Investigating or analysing materials by the use of wave or particle radiation, e.g. X-rays or neutrons, not covered by groups G01N3/00 – G01N17/00, G01N21/00 or G01N22/00 by transmitting the radiation through the material and measuring the absorption
- G01N23/18—Investigating the presence of flaws defects or foreign matter
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—Two-dimensional [2D] image generation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2223/00—Investigating materials by wave or particle radiation
- G01N2223/40—Imaging
- G01N2223/401—Imaging image processing
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2223/00—Investigating materials by wave or particle radiation
- G01N2223/40—Imaging
- G01N2223/408—Imaging display on monitor
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
Definitions
- This disclosure relates to a display control device, a display control method, and a display control program.
- JP 2010-203808 A discloses a non-destructive inspection system that combines partial images of an inspection object captured by a radiation detector to synthesize an image of the entire inspection object.
- This non-destructive inspection system synthesizes an image of the entire inspection object by superimposing partial images of adjacent objects so that there are no overlapping areas.
- the process of generating a single large image by synthesizing multiple images in this way is called mosaicking.
- image inspections In the manufacturing process of industrial products, inspections using images taken of the target object (hereafter referred to as “image inspections”) may be carried out. For example, non-destructive inspections are carried out to determine whether or not there are defects inside the product using radiological images.
- the object of the image inspection when the object of the image inspection is a large device, etc., the object may not fit in a single image and may need to be photographed multiple times. In this case, each image taken multiple times will be an image of a different part of the object. In this case, the user can only check the object locally with only one image. This results in the effort of sequentially accessing the divided number of images and checking them one by one.
- a user cannot obtain information about the surrounding areas, such as the surrounding parts of a part of an object captured in a single image or the structure of the entire object, and so in order to confirm the entire object, the user must compare multiple images and make a comprehensive judgment, which reduces the efficiency with which the user can confirm images.
- This disclosure has been made in consideration of the above circumstances, and aims to provide a display control device, a display control method, and a display control program that can suppress a decrease in efficiency when a user checks an image.
- the first aspect of the display control device is a display control device that includes at least one processor, and the processor accepts the selection of at least one image from a plurality of images stored in a storage device, and when a group of identical individual images obtained by photographing a plurality of parts of the same individual, at least some of which do not overlap, that includes the at least one selected image is present in the storage device, the processor controls the display of a composite image based on the group of identical individual images.
- the second aspect of the display control device is the display control device of the first aspect, in which the processor controls the display of both the at least one selected image and the composite image.
- the third aspect of the display control device is a display control device according to the first or second aspect, in which the composite image is an image in which a group of images of the same individual are arranged based on the relative positional relationships of parts of the same individual that appear in each image of the group of images of the same individual.
- the display control device of the fourth aspect is a display control device of any one of the first to third aspects, in which the identical individual is the object of non-destructive testing, and the processor acquires the results of the flaw detection process performed on each image of the group of identical individual images, and when controlling the display of the composite image, controls the display of the results of the flaw detection process on each image of the group of identical individual images that make up the composite image in a distinguishable manner.
- the fifth aspect of the display control device is the fourth aspect, in which the processor controls the display control device to distinguishably display, as a result of the flaw detection process, information indicating whether or not a defect exists, and at least one of the number, density, and severity of the flaws.
- a sixth aspect of the display control device is a display control device according to any one of the first to fifth aspects, in which the group of images of the same individual includes images of adjacent parts obtained by photographing some overlapping areas, and the processor extracts features of the shape of the part from each image in the group of images of the same individual, and generates a composite image by performing image processing to superimpose shapes that have the features of two images obtained by photographing adjacent parts and that have a feature similarity of a certain value or more.
- the seventh aspect of the display control device is a display control device according to any one of the first to sixth aspects, in which the same individual is a subject of non-destructive testing, the same individual image group includes images of adjacent parts obtained by photographing some overlapping areas, and the processor obtains the results of a flaw detection process performed on each image in the same individual image group, and generates a composite image by performing image processing to superimpose flaws in two images obtained by photographing adjacent parts and in which the same flaw is visible.
- the eighth aspect of the display control device is the fourth or seventh aspect of the display control device, in which the processor performs flaw detection processing on each image in the same individual image group.
- the ninth aspect of the display control device is a display control device according to any one of the first to eighth aspects, in which each image in the same individual image group is an image obtained by photographing the same individual in a state in which a marker is captured, and the processor generates a composite image by performing image processing to superimpose the markers in two images obtained by photographing adjacent parts.
- the tenth aspect of the display control device is a display control device according to any one of the first to ninth aspects, in which a link is set for each image in a group of identical individual images that constitute a composite image, for individually accessing that image.
- the display control device of the eleventh aspect is a display control device of any one of the first to tenth aspects, in which attribute information is assigned to each image in the group of identical individual images, and the processor determines, based on the attribute information, whether or not a group of identical individual images including at least one selected image exists in the storage device.
- the display control device of the twelfth aspect is a display control device of any one of the first to eleventh aspects, in which, if the process of generating a composite image by synthesizing a group of identical individual images fails, the processor controls to display information indicating that the process of generating the composite image has failed, and accepts a user's correction of the composite image or a user's instruction to re-synthesize the image.
- the display control device of the thirteenth aspect is a display control device of any one of the first to twelfth aspects, in which the processor performs at least one of tone correction processing, distortion correction processing, and zoom processing on at least one image that constitutes the composite image.
- the display control method of the fourteenth aspect accepts the selection of at least one image from a plurality of images stored in a storage device, and if a group of identical individual images obtained by photographing a plurality of parts of the same individual, at least some of which do not overlap, that includes the at least one selected image is present in the storage device, a processor provided in the display control device executes a process of controlling the display of a composite image based on the group of identical individual images.
- the display control program of the fifteenth aspect is for receiving the selection of at least one image from a plurality of images stored in a storage device, and, if a group of identical individual images obtained by photographing a plurality of parts of the same individual, at least some of which do not overlap, and which includes the at least one selected image, is present in the storage device, causing a processor provided in the display control device to execute a process of controlling the display of a composite image based on the group of identical individual images.
- FIG. 1 is a block diagram showing a schematic configuration of a radiation image capturing apparatus
- 2 is a block diagram showing an example of a hardware configuration of a display control device.
- FIG. FIG. 11 is a diagram for explaining attribute information.
- FIG. 1 is a diagram for explaining a trained model.
- 2 is a block diagram showing an example of a functional configuration of a display control device.
- FIG. 11 is a diagram for explaining image synthesis processing.
- 13A and 13B are diagrams for explaining image synthesis processing according to a modified example.
- 13A and 13B are diagrams for explaining image synthesis processing according to a modified example.
- FIG. 13 is a diagram showing an example of a display screen.
- FIG. 13 is a diagram illustrating an example of a composite image.
- FIG. 13 is a diagram illustrating an example of a composite image.
- FIG. 13 is a diagram showing an example of a display screen according to a modified example.
- 13 is a flowchart illustrating an example of a display control process.
- FIG. 13 is a diagram for explaining image synthesis processing using markers.
- FIG. 13 is a diagram showing an example of a marker according to a modified example.
- the radiographic imaging device 1 is used for non-destructive testing of an object to be inspected.
- the radiographic imaging device 1 includes a display control device 10, a radiation source 12, and a radiation detector 14.
- the display control device 10, the radiation source 12, and the radiation detector 14 are connected in a state in which they can communicate with each other. Examples of the display control device 10 include a personal computer or a server computer.
- the radiation source 12 irradiates radiation R, such as X-rays, to the object O of non-destructive testing.
- the radiation source 12 in this embodiment irradiates cone-beam radiation R.
- the radiation detector 14 includes a scintillator as an example of a light-emitting layer that emits light when irradiated with radiation R, and a TFT (Thin Film Transistor) substrate.
- the scintillator and TFT substrate are laminated.
- the TFT substrate has a plurality of pixels arranged two-dimensionally, and each pixel has a sensor unit and a field-effect thin-film transistor as an example of a conversion element in which the electric charge generated increases with an increase in the amount of irradiated radiation.
- the sensor unit absorbs the light emitted by the scintillator to generate electric charges, and accumulates the generated electric charges.
- the field-effect thin-film transistor converts the electric charges accumulated in the sensor unit into an electric signal and outputs it.
- a radiation image captured by irradiating the object O with radiation R from the radiation source 12 is stored in the display control device 10.
- the radiation image captured by irradiating the object O with radiation R is referred to as an "examination image.”
- the display control device 10 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a non-volatile storage device 22.
- the display control device 10 also includes a display 23 such as a liquid crystal display, an input device 24 such as a keyboard and a mouse, and a network I/F (InterFace) 25 connected to a network.
- the display control device 10 also includes an external I/F 26 to which the radiation source 12 and the radiation detector 14 are connected.
- the CPU 20, the memory 21, the storage device 22, the display 23, the input device 24, the network I/F 25, and the external I/F 26 are connected to a bus 27.
- the CPU 20 is an example of a processor related to the disclosed technology.
- the storage device 22 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like.
- the display control program 30 is stored in the storage device 22 as a storage medium.
- the CPU 20 reads the display control program 30 from the storage device 22, expands it in the memory 21, and executes the expanded display control program 30.
- the storage device 22 also stores a plurality of inspection images 32, a plurality of pieces of attribute information 34, and one trained model 36.
- the plurality of inspection images 32 includes an inspection image 32 in which the entire object O is captured in one frame, for example when the object O is a relatively small device. In the example of FIG. 1, the object O is smaller than the radiation detector 14, so the entire object O is captured in one inspection image 32.
- the multiple inspection images 32 also include a group of inspection images 32 taken multiple times of the object O, which cannot fit into a single image, for example when the object O is a large device.
- the group of inspection images 32 is a group of images obtained by photographing multiple parts of the same individual, at least some of which do not overlap (hereinafter referred to as a "group of images of the same individual").
- the term "same individual” here means, for example, that the object O is the same product and has the same manufacturing number. In other words, in this embodiment, even if the object O is the same product, if the manufacturing numbers are different, it is considered to be a different individual.
- each image in the group of images of the same individual is an image obtained by photographing adjacent parts with some areas overlapping.
- each inspection image 32 is assigned attribute information 34, which is metadata including multiple pieces of information related to that inspection image 32.
- the attribute information 34 may be added as an external data file to the inspection image 32, or may be integrated with the inspection image 32 as a property of the inspection image 32.
- the attribute information 34 includes attribute items such as the date and time of shooting, product ID (identification), serial number, and shooting order.
- the shooting date and time is information indicating the date and time when the inspection image 32 was shot.
- the product ID is information for identifying the product.
- the serial number is information for identifying an individual product. In other words, it is possible to determine whether or not the products are the same individual product by the combination of the product ID and serial number.
- the shooting order is information indicating the order in which the inspection images 32 in the same individual image group were shot. In this embodiment, adjacent parts are photographed in consecutive order.
- the trained model 36 is a trained model that takes the inspection image 32 as input and outputs information about defects on the object O in the input inspection image 32.
- the trained model 36 is obtained in advance by machine learning using a plurality of sets of inspection images 32 and information about defects on the object O in the inspection images 32 as training data. Examples of information about defects include the position of the defect in the inspection image 32, the size of the defect, and the shape of the defect.
- the position of the defect in the inspection image 32 is expressed by the coordinates of an orthogonal coordinate system that has a specific point (e.g., the point in the upper left corner) of the two-dimensional inspection image as the origin and is composed of two axes, the X axis and the Y axis.
- "defect" is defined as a term in non-destructive inspection and means a discontinuity such as an air bubble, a foreign object, or a crack.
- the display control device 10 includes a reception unit 40, a determination unit 42, a detection unit 44, a composition unit 46, and a display control unit 48.
- the CPU 20 executes the display control program 30, it functions as the reception unit 40, the determination unit 42, the detection unit 44, the composition unit 46, and the display control unit 48.
- the user selects one inspection image 32 from among the multiple inspection images 32 stored in the storage device 22.
- the user selects one inspection image 32 via file management software such as a filer.
- the reception unit 40 accepts the selection of one inspection image 32 by the user.
- the determination unit 42 determines whether or not a group of identical individual images including the selected inspection image 32 exists in the storage device 22 based on the attribute information 34. Specifically, the determination unit 42 determines whether or not a group of identical individual images exists in the storage device 22 by determining whether or not two or more inspection images 32 having the same set of product ID and serial number as the selected inspection image 32 exist in the storage device 22.
- the determination unit 42 may further use the photographing date and time to determine whether or not a group of identical individual images exists in the storage device 22. In this case, the determination unit 42 determines whether or not there are two or more inspection images 32 in the storage device 22 that have the same set of product ID and serial number as the selected inspection image 32 and whose photographing dates and times differ by a predetermined time (for example, within 30 minutes). In this case, the predetermined time is set in advance according to the time required to photograph the inspection images 32.
- the detection unit 44 inputs the inspection image 32 to the trained model 36.
- the trained model 36 outputs information about defects on the object O in the input inspection image 32 as a result of the defect detection process.
- the detection unit 44 performs defect detection processing on the inspection image 32.
- the detection unit 44 inputs each image of the group of identical individual images to the trained model 36. From the trained model 36, information regarding defects on the object O in each input inspection image 32 is output as a result of the defect detection process. As a result, the detection unit 44 performs defect detection processing on each image of the group of identical individual images.
- the detection unit 44 may detect flaws on the object O in the inspection image 32 using a known detection algorithm.
- the flaws on the object O in the inspection image 32 may also be specified by the user via the input device 24. In this case, the detection unit 44 detects the flaws specified by the user.
- the flaw detection process may be executed by a device other than the display control device 10. In this case, the detection unit 44 obtains the results of the flaw detection process from the other device.
- the synthesis unit 46 When the determination unit 42 determines that a group of identical individual images including the selected inspection image 32 exists in the storage device 22, the synthesis unit 46 generates a single image (hereinafter referred to as the "synthetic image") by synthesizing each image of the group of identical individual images.
- the synthesis unit 46 extracts the shape characteristics of the part depicted in each image of the same individual image group.
- a publicly known shape detection algorithm can be applied to this extraction process.
- the synthesis unit 46 generates a synthetic image by performing image processing to superimpose shapes having features of two inspection images 32 obtained by photographing adjacent parts and having a certain level of similarity between the extracted features of the two inspection images 32.
- the part surrounded by a dashed circle indicates the shape part having a certain level of similarity between the features.
- the inspection images 32 are translated and rotated, etc.
- the compositing unit 46 can grasp the two test images 32 obtained by photographing adjacent body parts by referring to the shooting order item in the attribute information 34. Furthermore, when the group of images of the same individual includes three or more test images 32, the compositing unit 46 generates one composite image by repeatedly compositing the above two test images with different sets of two images.
- the composite image is an image in which the group of images of the same individual are arranged based on the relative positional relationships of the body parts of the same individual that appear in each image of the group of images of the same individual.
- the combining unit 46 may generate a composite image by performing image processing to superimpose two images obtained by photographing adjacent areas, in which the same flaw detected by the detection unit 44 is captured.
- the display control unit 48 controls the display of the composite image generated by the composition unit 46 on the display 23.
- the display control unit 48 controls the display of both the selected inspection image 32 and the composite image generated by the composition unit 46 on the display 23.
- the example in FIG. 9 shows an example in which "Image #2" is selected. Note that the display control unit 48 may make the selected inspection image 32 in the composite image distinguishable by highlighting the border of the portion of the composite image that corresponds to the selected inspection image 32.
- the composite image may be a combination of multiple inspection images 32 obtained by capturing images of the side of a cylindrical pipe in a circular motion.
- the composite image may be a combination of multiple inspection images 32 obtained by capturing images of the object O while rotating it with the center fixed along the direction of the detection surface of the radiation detector 14.
- FIG. 11 shows an example of a composite image in which four inspection images 32 obtained by capturing four images of the object O while rotating it 90 degrees each time are combined.
- the display control unit 48 when the display control unit 48 controls the display of a composite image, it may also control the display of the results of the flaw detection process for each image of the group of identical individual images that make up the composite image in a distinguishable manner.
- the example in FIG. 12 shows an example in which the display control unit 48 displays "OK" and "NG,” which are examples of information indicating whether or not a defect exists, as the results of the flaw detection process. Whether or not a flaw is a defect is determined, for example, by whether or not the size of the flaw is equal to or larger than a threshold value.
- the display control unit 48 may also control the display of at least one of the number of flaws, flaw density, and flaw severity as a result of the flaw detection process.
- the flaw density is determined, for example, by the ratio of the flaw's area to the area of the part shown in the inspection image 32.
- the flaw severity is set to a higher value, for example, as the flaw size increases.
- the display control unit 48 may also control the display of the number of flaws, flaw density, and flaw severity so that the magnitude of the flaw count, flaw density, and flaw severity values can be discerned, for example, by darkening the color of the image frame or the color of the "NG" letters as the flaw count, flaw density, and flaw severity values increase.
- the CPU 20 executes the display control program 30, thereby executing the display control process shown in FIG. 13.
- the display control process shown in FIG. 13 is executed, for example, when one inspection image 32 is selected by the user.
- step S10 of FIG. 13 the reception unit 40 receives the user's selection of one test image 32.
- step S12 the determination unit 42 determines, as described above, based on the attribute information 34, whether or not a group of identical individual images including the one test image 32 selected in step S10 exists in the storage device 22. If this determination is positive, the process proceeds to step S14.
- step S14 the detection unit 44 performs a flaw detection process on each image in the group of identical individual images, including the one inspection image 32 selected in step S10, as described above.
- step S16 the synthesis unit 46 generates a synthetic image by synthesizing each image in the group of identical individual images, as described above.
- step S18 the display control unit 48 controls the display of both the one test image 32 selected in step S10 and the composite image generated in step S16 on the display 23.
- the display control processing ends.
- step S12 determines whether the determination in step S12 is negative. If the determination in step S12 is negative, the process proceeds to step S20.
- step S20 the detection unit 44 performs a flaw detection process on the one inspection image 32 selected in step S10, as described above.
- step S22 the display control unit 48 controls the display of the one inspection image 32 selected in step S10 on the display 23. When the process in step S22 ends, the display control process ends.
- control is performed to display a composite image. Therefore, the user can check the image while also grasping information about the surrounding area of the one inspection image 32, and as a result, a decrease in efficiency when the user checks the image can be suppressed.
- a case has been described in which a user selects one inspection image 32 from among a plurality of inspection images 32 stored in the storage device 22, but the disclosed technology is not limited to this aspect.
- a configuration may also be adopted in which a user selects two or more inspection images 32 from among a plurality of inspection images 32 stored in the storage device 22.
- the display control process in the above embodiment is performed for each selected inspection image 32.
- the composite image is a single image generated by combining the images of the same individual image group, but the disclosed technology is not limited to this aspect.
- the composite image may be a plurality of inspection images 32 arranged based on the relative positional relationships of parts of the same individual that appear in each image of the same individual image group.
- each image of the same individual image group may be an image obtained by photographing adjacent parts without some areas overlapping.
- the synthesis unit 46 generates a synthetic image by performing image processing to superimpose shapes having features of two inspection images 32 obtained by photographing adjacent parts, the shapes having a similarity of extracted features being equal to or greater than a certain value, but the disclosed technology is not limited to this aspect.
- the synthesis unit 46 may generate a synthetic image by performing image processing to superimpose the marker M of two inspection images 32 obtained by photographing adjacent parts.
- FIG. 14 shows an example in which the marker M is a number indicating the order of photographing.
- the marker M is formed of a material that does not transmit radiation R, such as lead.
- the marker M is not limited to numbers and may be letters. Also, as shown in FIG. 15, the marker M may be a symbol such as an arrow indicating the range that will remain in the composite image. Also, the marker M does not have to be dedicated to the composition process.
- Non-destructive testing standards e.g., JIS Z 2036:2015
- IQI Image Quality Indicator
- the shape of the transmittance meter is also stipulated by the standard. Therefore, the composition unit 46 may use the transmittance meter as the marker M.
- the synthesis unit 46 may set a link for each image of the group of identical individual images that make up the composite image to access that image individually.
- the display control unit 48 controls the display of that image on the display 23.
- the display control unit 48 may control the display 23 to display information indicating that the process of generating a composite image has failed.
- the reception unit 40 may receive a user's modification of the composite image or a user's instruction to recombine. Modifications by the user in this case include, for example, modifying the positions of the images that make up the composite image.
- the user may rotate some of the images or change the magnification ratio, add images to be combined, or remove some images from the composite image from the targets for combination.
- the CPU 20 may perform at least one of tone correction processing, distortion correction processing, and enlargement/reduction processing on at least one image constituting the composite image. For example, when the enlargement ratios of the images constituting the composite image are different, the CPU 20 performs enlargement/reduction processing to make the enlargement ratios uniform.
- the various processors shown below can be used as the hardware structure of a processing unit that executes various processes, such as each functional unit of the display control device 10.
- the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as programmable logic devices (PLDs), which are processors whose circuit configuration can be changed after manufacture, such as FPGAs (Field Programmable Gate Arrays), and dedicated electrical circuits, such as ASICs (Application Specific Integrated Circuits), which are processors with a circuit configuration designed specifically to execute specific processes.
- a CPU which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as programmable logic devices (PLDs), which are processors whose circuit configuration can be changed after manufacture, such as FPGAs (Field Programmable Gate Arrays), and dedicated electrical circuits, such as ASICs (Application Specific Integrated Circuits), which are processors with a circuit configuration designed specifically to execute
- a single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.
- Examples of configuring multiple processing units with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, as typified by client and server computers, and this processor functions as multiple processing units. Secondly, a form in which a processor is used to realize the functions of the entire system, including multiple processing units, with a single IC (Integrated Circuit) chip, as typified by system on chip (SoC). In this way, the various processing units are configured as a hardware structure using one or more of the various processors listed above.
- SoC system on chip
- the hardware structure of these various processors can be an electrical circuit that combines circuit elements such as semiconductor elements.
- the display control program 30 is described as being pre-stored (installed) in the storage device 22, but this is not limited to the above.
- the display control program 30 may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory.
- the display control program 30 may also be downloaded from an external device via a network.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Biochemistry (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Toxicology (AREA)
- Image Processing (AREA)
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP23925377.6A EP4675263A1 (en) | 2023-02-28 | 2023-11-13 | Display control device, display control method, and display control program |
| CN202380094172.7A CN120712470A (zh) | 2023-02-28 | 2023-11-13 | 显示控制装置、显示控制方法及显示控制程序 |
| JP2025503577A JPWO2024180824A1 (cg-RX-API-DMAC7.html) | 2023-02-28 | 2023-11-13 | |
| US19/294,330 US20250363623A1 (en) | 2023-02-28 | 2025-08-08 | Display control device, display control method, and display control program |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2023030565 | 2023-02-28 | ||
| JP2023-030565 | 2023-02-28 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/294,330 Continuation US20250363623A1 (en) | 2023-02-28 | 2025-08-08 | Display control device, display control method, and display control program |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024180824A1 true WO2024180824A1 (ja) | 2024-09-06 |
Family
ID=92589550
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2023/040819 Ceased WO2024180824A1 (ja) | 2023-02-28 | 2023-11-13 | 表示制御装置、表示制御方法、及び表示制御プログラム |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20250363623A1 (cg-RX-API-DMAC7.html) |
| EP (1) | EP4675263A1 (cg-RX-API-DMAC7.html) |
| JP (1) | JPWO2024180824A1 (cg-RX-API-DMAC7.html) |
| CN (1) | CN120712470A (cg-RX-API-DMAC7.html) |
| WO (1) | WO2024180824A1 (cg-RX-API-DMAC7.html) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11112790A (ja) * | 1997-10-06 | 1999-04-23 | Canon Inc | 画像合成装置および方法 |
| JP2000097881A (ja) * | 1998-09-24 | 2000-04-07 | Hitachi Constr Mach Co Ltd | X線検査装置、x線検査用画像処理装置、x線検査装置用画像処理プログラムが格納された記録媒体 |
| JP2009122982A (ja) * | 2007-11-15 | 2009-06-04 | Jfe Engineering Corp | 分割撮像画像を用いた画像構築方法、放射線を用いた欠陥検査方法 |
| JP2010203808A (ja) | 2009-02-27 | 2010-09-16 | Central Res Inst Of Electric Power Ind | 非破壊検査方法及び非破壊検査システム |
| JP2012517022A (ja) * | 2009-02-04 | 2012-07-26 | 株式会社アドバンテスト | マスク検査装置及び画像生成方法 |
| JP2014095623A (ja) * | 2012-11-09 | 2014-05-22 | Fujifilm Corp | 画像表示装置及び方法並びにプログラム |
| WO2018037689A1 (ja) * | 2016-08-22 | 2018-03-01 | 富士フイルム株式会社 | 画像処理装置及び画像処理方法 |
| JP2020085699A (ja) * | 2018-11-27 | 2020-06-04 | 株式会社高速道路総合技術研究所 | 積層ゴム支承の検査方法 |
| JP2023030565A (ja) | 2021-08-23 | 2023-03-08 | ローム株式会社 | 半導体装置 |
-
2023
- 2023-11-13 JP JP2025503577A patent/JPWO2024180824A1/ja active Pending
- 2023-11-13 WO PCT/JP2023/040819 patent/WO2024180824A1/ja not_active Ceased
- 2023-11-13 CN CN202380094172.7A patent/CN120712470A/zh active Pending
- 2023-11-13 EP EP23925377.6A patent/EP4675263A1/en active Pending
-
2025
- 2025-08-08 US US19/294,330 patent/US20250363623A1/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11112790A (ja) * | 1997-10-06 | 1999-04-23 | Canon Inc | 画像合成装置および方法 |
| JP2000097881A (ja) * | 1998-09-24 | 2000-04-07 | Hitachi Constr Mach Co Ltd | X線検査装置、x線検査用画像処理装置、x線検査装置用画像処理プログラムが格納された記録媒体 |
| JP2009122982A (ja) * | 2007-11-15 | 2009-06-04 | Jfe Engineering Corp | 分割撮像画像を用いた画像構築方法、放射線を用いた欠陥検査方法 |
| JP2012517022A (ja) * | 2009-02-04 | 2012-07-26 | 株式会社アドバンテスト | マスク検査装置及び画像生成方法 |
| JP2010203808A (ja) | 2009-02-27 | 2010-09-16 | Central Res Inst Of Electric Power Ind | 非破壊検査方法及び非破壊検査システム |
| JP2014095623A (ja) * | 2012-11-09 | 2014-05-22 | Fujifilm Corp | 画像表示装置及び方法並びにプログラム |
| WO2018037689A1 (ja) * | 2016-08-22 | 2018-03-01 | 富士フイルム株式会社 | 画像処理装置及び画像処理方法 |
| JP2020085699A (ja) * | 2018-11-27 | 2020-06-04 | 株式会社高速道路総合技術研究所 | 積層ゴム支承の検査方法 |
| JP2023030565A (ja) | 2021-08-23 | 2023-03-08 | ローム株式会社 | 半導体装置 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4675263A1 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN120712470A (zh) | 2025-09-26 |
| US20250363623A1 (en) | 2025-11-27 |
| JPWO2024180824A1 (cg-RX-API-DMAC7.html) | 2024-09-06 |
| EP4675263A1 (en) | 2026-01-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI737659B (zh) | 半導體試樣的基於深度學習之檢查的方法及其系統 | |
| US8204291B2 (en) | Method and system for identifying defects in a radiographic image of a scanned object | |
| US20100220910A1 (en) | Method and system for automated x-ray inspection of objects | |
| CN100496402C (zh) | 图像处理方法、图像处理系统以及x-射线ct系统 | |
| JP6422573B2 (ja) | 画像処理装置及び画像処理方法及びプログラム | |
| EP3980790A1 (en) | Automated inspection method for a manufactured article and system for performing same | |
| JPWO2019059011A1 (ja) | 教師データ作成方法及び装置並びに欠陥検査方法及び装置 | |
| WO2010135901A1 (zh) | 伪双能欠采样物质识别系统和方法 | |
| JP2019109563A (ja) | データ生成装置、データ生成方法及びデータ生成プログラム | |
| JP2017049974A (ja) | 識別器生成装置、良否判定方法、およびプログラム | |
| CN105849772A (zh) | 检查系统及方法 | |
| Syryamkin et al. | Digital X-ray tomography | |
| JP2017003323A (ja) | 画像取得装置及び画像取得方法並びに画像補正プログラム | |
| CN110211091A (zh) | 一种高分辨图像重构方法、装置及隐裂无损检测系统 | |
| JP2005252166A (ja) | 欠陥検査装置および欠陥検査方法 | |
| CN108593687A (zh) | 一种基于三维层析成像的快速缺陷检测方法 | |
| WO2021002356A1 (ja) | 放射線画像判定装置、検査システム及びプログラム | |
| CN115428012A (zh) | 图像检查装置、图像检查方法以及学习完毕模型生成装置 | |
| WO2023136030A1 (ja) | 情報処理装置、情報処理方法、及び情報処理プログラム | |
| CN120712470A (zh) | 显示控制装置、显示控制方法及显示控制程序 | |
| JP7575738B2 (ja) | 表示装置 | |
| JP4155866B2 (ja) | X線断層撮像装置 | |
| JP4431591B2 (ja) | 試料検査装置、及び試料検査方法 | |
| JP2021051013A (ja) | 情報処理装置、情報処理方法、及び情報処理プログラム | |
| JP4728092B2 (ja) | X線画像出力装置、x線画像出力方法およびx線画像出力プログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23925377 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2025503577 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2025503577 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023925377 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023925377 Country of ref document: EP Effective date: 20250929 |
|
| ENP | Entry into the national phase |
Ref document number: 2023925377 Country of ref document: EP Effective date: 20250929 |
|
| ENP | Entry into the national phase |
Ref document number: 2023925377 Country of ref document: EP Effective date: 20250929 |
|
| WWP | Wipo information: published in national office |
Ref document number: 2023925377 Country of ref document: EP |