WO2022011394A1 - Systems and methods for optimizing camera and microscope configurations for capturing thin section images - Google Patents
Systems and methods for optimizing camera and microscope configurations for capturing thin section images Download PDFInfo
- Publication number
- WO2022011394A1 WO2022011394A1 PCT/US2021/070854 US2021070854W WO2022011394A1 WO 2022011394 A1 WO2022011394 A1 WO 2022011394A1 US 2021070854 W US2021070854 W US 2021070854W WO 2022011394 A1 WO2022011394 A1 WO 2022011394A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- thin section
- microscope
- pixels
- camera
- percentage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N33/00—Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
- G01N33/24—Earth materials
- G01N33/241—Earth materials for hydrocarbon content
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/66—Analysis of geometric attributes of image moments or centre of gravity
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
Definitions
- the present disclosure generally relates to methods for analyzing petrographic thin section images.
- Core samples are collected from wells during drilling so that they can be analyzed to determine certain characteristics of rock formations for particular well sections.
- the core samples are often collected during drilling from what is anticipated to be the productive reservoir sections of a well.
- Petrographic thin section samples can then be prepared from plug that is extracted from sections of the core samples.
- images are produced from the petrographic thin section samples by using a high- resolution polarizing microscope that photographs the petrographic thin section samples.
- a common issue in geological petrography work is the analysis of thin sections.
- Thin section analysis may be used to determine properties of the thin section such as mineral composition and texture. Hydrocarbon fluids may be found in the pore spaces visible in thin sections.
- the study of geological thin sections has become one of the most important disciplines for hydrocarbon exploration.
- thin section analysis has been performed by a point counting method. Point counting in thin sections is normally conducted through mechanical or electromechanical devices attached to a microscope. Such mechanical and electromechanical devices can be expensive and offer limited functionality. The final results of point counting analysis are subjective and dependent on expertise of the user who performed the point counting.
- This specification describes a system implemented as computer programs on one or more computers in one or more locations that performs automated analysis of petrographic thin section images.
- One embodiment is a method for optimizing settings for a camera and microscope for capturing thin section images of a reservoir rock in a hydrocarbon reservoir.
- the method may include extracting a plurality of core samples from a well, cutting a respective plurality of thin sections from the plurality of core samples, and capturing a thin section image using a robotic microscope and a camera.
- the method may further include performing a frequency analysis of each pixel of the thin section image, associating each pixel in the thin section image with a class identifier selected from a plurality of class identifiers, each class identifier associated with range of frequencies, determining a percentage of pixels in each class identifier, and determining a percentage of pixels comprising noise.
- the method may further include saving the thin section image and the settings for the camera and microscope associated with the thin section image, saving data generated from the frequency analysis of the thin section image, and saving the determination of the percentage of pixels comprising noise associated with the thin section image.
- the method may further include repeating these steps for a plurality of thin section images taken at a plurality of settings for the camera and the microscope.
- the method may also include combining the settings for the camera and microscope associated with the plurality of thin section images, data generated from the frequency analysis of the plurality of thin section images, and the determination of the percentage of pixels comprising noise associated with the plurality of thin section images to produce a structured data set, generating a machine learning model using the structured data set, and determining, using the machine learning model, an optimized setting for the camera and an optimized setting for the microscope based on the thin section image with the least noise.
- the step of determining a percentage of pixels comprising noise further comprises determining a percentage of pixels having a frequency over a predetermined threshold.
- the machine learning model comprises an artificial neural network (ANN), a support vector machine (SVM), a radial basis function (RBF), fuzzy logic, a decision tree, random forest, or k-means algorithm.
- the plurality of settings comprise magnification, illumination, stage position, plane polarized light (PPL), cross polarized light (XPL), thin focus, or coarse focus.
- the optimized setting comprises at least one setting for magnification, illumination, stage position, plane polarized light (PPL), cross polarized light (XPL), thin focus, and coarse focus.
- Another example embodiment is a system including a microscope configured to take images of a plurality of petrographic thin section samples and create petrographic thin section sample digital image files from the images, and a computer system comprising a processor and a non-transitory computer readable storage medium in data communication with the processor storing instructions executable by the processor and that upon such execution causes the processor to perform some operations.
- the operations may include performing a frequency analysis of each pixel of the thin section image, associating each pixel in the thin section image with a class identifier selected from a plurality of class identifiers, each class identifier associated with range of frequencies, determining a percentage of pixels in each class identifier, and determining a percentage of pixels comprising noise.
- the operations may further include saving the thin section image and the settings for the camera and microscope associated with the thin section image, saving data generated from the frequency analysis of the thin section image, and saving the determination of the percentage of pixels comprising noise associated with the thin section image.
- the operations may further include repeating these steps for a plurality of thin section images taken at a plurality of settings for the camera and the microscope.
- the operations may also include combining the settings for the camera and microscope associated with the plurality of thin section images, data generated from the frequency analysis of the plurality of thin section images, and the determination of the percentage of pixels comprising noise associated with the plurality of thin section images to produce a structured data set, generating a machine learning model using the structured data set, and determining, using the machine learning model, an optimized setting for the camera and an optimized setting for the microscope based on the thin section image with the least noise.
- Another example embodiment is a non-transitory computer readable storage medium storing instructions executable by a data processing apparatus and that upon such execution causes the data processing apparatus to perform some operations.
- the operations may include performing a frequency analysis of each pixel of the thin section image, associating each pixel in the thin section image with a class identifier selected from a plurality of class identifiers, each class identifier associated with range of frequencies, determining a percentage of pixels in each class identifier, and determining a percentage of pixels comprising noise.
- the operations may further include saving the thin section image and the settings for the camera and microscope associated with the thin section image, saving data generated from the frequency analysis of the thin section image, and saving the determination of the percentage of pixels comprising noise associated with the thin section image.
- the operations may further include repeating these steps for a plurality of thin section images taken at a plurality of settings for the camera and the microscope.
- the operations may also include combining the settings for the camera and microscope associated with the plurality of thin section images, data generated from the frequency analysis of the plurality of thin section images, and the determination of the percentage of pixels comprising noise associated with the plurality of thin section images to produce a structured data set, generating a machine learning model using the structured data set, and determining, using the machine learning model, an optimized setting for the camera and an optimized setting for the microscope based on the thin section image with the least noise.
- the thin section analysis system as described in this specification uses advanced machine learning and automated image processing methods to process thin section images and achieves several advantages over manual systems for thin section image analysis.
- the thin section analysis system as described in this specification can be implemented to perform thin section image analysis orders of magnitude faster than manual methods for thin section image analysis (such as point counting methods).
- the thin section analysis system as described in this specification can be implemented to process thin section images in two minutes or less, whereas conventional point counting methods (that require a geologist to manually examine the thin section images at a large number of different points) may take up to four hours.
- the thin section analysis system as described in this specification may be more accurate than manual methods for thin section image analysis.
- the thin section analysis system as described in this specification relies on machine learning and automated image analysis algorithms and thereby obviates sources of human error that are present in manual methods for thin section image analysis.
- point counting methods for thin section image analysis place a high cognitive burden on the user performing the point counting method, increasing the likelihood of human errors such as the user incorrectly counting the number of grains or pores in a region of a thin section image.
- the thin section analysis system as described in this specification is consistent and eliminates potential biases present in manual methods for thin section image analysis. For example, a user that performs a point counting method multiple times on a single thin section image to determine an estimate of a characteristic of a thin section image (for example, the average diameter of grains in the thin section) may determine different values each time. In contrast, the thin section analysis system as described in this specification will determine consistent estimates of the same characteristic.
- the thin section analysis system as described in this specification performs a comprehensive analysis of the thin section characteristics, including both the compositional properties of the thin section (for example, the fraction of the thin section occupied by pores) and properties of the grains of the thin section (for example, the distribution of grain diameters in the thin section).
- many conventional thin section analysis systems perform a less comprehensive analysis by identifying fewer relevant properties of thin sections.
- the thin section analysis system as described in this specification is fully automated and thereby enables more efficient use of computational resources than conventional systems that are not fully automated. Conventional systems that are not fully automated require user intervention (for example, to manually calibrate system parameters).
- FIG. 1 illustrates a flow chart of an example core extraction through petrographic thin section sample analysis system and method in accordance with an embodiment of the disclosure
- FIG. 2 illustrates an implementation of a polarizing robotic microscope used for an image-based analysis of a geological thin section in accordance with an embodiment of the disclosure
- FIG. 3 illustrates an image-based analysis of a geological thin section in accordance with an embodiment of the disclosure
- FIG. 4 illustrates an image-based analysis of a geological thin section in accordance with an embodiment of the disclosure
- FIG. 5 illustrates another plane polarized image of the geological thin section in accordance with an embodiment of the disclosure
- FIG. 6 illustrates example steps in a method for capturing an image by a robotic thin section analyzer in accordance with an embodiment of the disclosure
- FIG. 7 illustrates example steps in a method for optimizing settings for a camera and microscope in accordance with an embodiment of the disclosure.
- FIG. 8 illustrates a computer system for optimizing settings for a camera and microscope in accordance with an embodiment of the disclosure.
- FIG. 1 illustrates an example layout of a particular system 5 starting with the extraction of core samples or “core plugs” from a well 10. Following the step of extracting a core sample from a well 10, multiple samples are organized by the depth they were collected 12, and transported to a laboratory for further analysis. Once at the laboratory the next step is cutting core samples further into smaller plugs 20 that can be sliced into petrographic thin section samples 22. After the petrographic thin section samples 22 are prepared, the next step is to scan the thin section samples in the laboratory 30 with a high-resolution polarizing microscope 32.
- the microscope can be a robotic microscope including a control system for controlling the magnification, illumination, stage position, plane polarized light (PPL), cross polarized light (XPL), thin focus, or coarse focus of the microscope.
- images 34 that are representative of each petrographic thin section sample are output from the high- resolution polarizing microscope 32.
- a technician then loads the images into a processing program 40 on a computer system 42.
- the computer system 42 utilizes specialized software that generates permeability estimations for each of the images 34 that are representative of each petrographic thin section sample 22.
- the original collection depth of the core and subsequent petrographic thin section samples are tracked such that the depth information can be input into the computer system 42 and logged along with the permeability estimations for each petrographic thin section sample 22.
- the characteristics of the subsurface formation over various depths can then be graphed or turned into another visualized output 44 that is helpful for making decisions about the plan for a particular well.
- the permeability and depth information for each of the petrographic thin section samples can be stored into a database for additional analysis and processing.
- Other information about the samples or permeability estimates can also be stored in the database. For example, the well location, time of collection, time of analysis, or other information may also be stored in the database and associated with a particular petrographic thin section sample.
- FIG. 2 an implementation of a robotic polarizing microscope system 200 that may be used for an image-based analysis of the geological thin section 22 is illustrated.
- Geological thin sections such as geological thin section 22, can be examined using the polarizing microscope system 200 to examine the grains and pores of the geological thin section 22.
- the microscope system 200 uses polarized light, because the light waves vibrate in one direction, whereas in normal light, the light waves vibrate in random directions.
- the primary components of the polarizing microscope system 200 include: a rotating stage 230, polars 240, a Bertrand lens control 215, a Senarmont compensator 265, a rotating analyzer slider 270, an objective 225 beam-splitter prism, a high-resolution digital camera system with extension tube 285, and a condenser 235 beam-splitter prism.
- the rotating stage 230 supports the geological thin section 22 during observation.
- the rotating stage 230 is a 360-degree circular rotating stage to facilitate view of the geological thin section 22 at different rotational perspectives.
- the polars 240 include polarizing and analyzing devices or filter and may be placed above and below the rotating stage 230.
- the polars 240 allow light to pass through in a north-south (N-S) vibration direction and is placed below the rotating stage 230.
- the Bertrand lens control 215 allows observation in a conoscopic view where it brings the image of an interference figure into the focal plane of the ocular.
- the compensator 265 is held in place with a compensator lock 220 and helps determine the order of interference colors between crossed-nicols.
- the analyzer slider 270 allows light to pass through in an east- west (E-W) vibration direction. It is placed above the rotating stage 230.
- optical accessories such as a mica plate, a gypsum plate, and a quartz wedge, and, as are known, may be included in the polarizing microscope system 200.
- the mica plate gives an interference color of first order white (as understood in optical microscopy).
- the gypsum plate gives a distinct magenta color at the boundary between first and second order colors.
- the quartz wedge helps produce interference colors and produce a range of retardations.
- the polarizing microscope system 200 shown in FIG. 2 also includes standard components, such as the eyepiece 205, observation tubes 210, and a base 245 that supports the other components. Also included are a number of filters 250 and focus 255 as are known. There is also an illumination intensity control 260.
- the polarizing microscope system 200 includes or is communicably coupled to a computing system 280.
- the computing system 280 in this implementation, is a microprocessor based computing system that includes one or more memory modules, one or more processors, input and output peripherals (including the polarizing microscope as an input), and other associated components.
- the computing system 280 may also include software in the form of instructions stored on the one or more memory modules and executable by the one or more processors to perform operations, either automatically without human intervention or with human input.
- the polarizing microscope system 200 may facilitate viewing and image-capture of the geological thin section 22 in plane-polarized light and cross-polarized light.
- plane- polarized light many minerals are colorless, which makes it impossible to distinguish grain boundaries between two adjacent colorless grains.
- crossed-polarized light the interference color displayed depends on the mineral type, the orientation of the indicatrix of the grain with respect to the polarizers and the thickness of the thin section 22.
- two adjacent grains may have similar interference colors at some orientations of the thin section 22 with respect to the polarizers 240. If sufficient contrast between adjacent grains exists, the boundaries between them can be recognized.
- the boundaries may be difficult to recognize.
- the contrast between adjacent grains can be increased by rotating the thin section 22 relative to the polarizer 240 and analyzer 270.
- full visual recognition of grain boundaries of the grains of the rock sample in geological thin section 22 can be facilitated by using multiple thin section images taken at different angles of rotation.
- the computer unit for performing the automated thin section analysis is connected to the camera, and the robotic control unit controls the settings for the microscope tools (magnification, illumination, stage position, plane polarized light (PPL) versus cross polarized light (XPL), and thin or coarse focus) in accordance with an embodiment of the disclosure.
- FIG. 3 illustrates an image-based analysis of a geological thin section in accordance with an embodiment of the disclosure.
- FIG. 3 shows how changing the setting of brightness improves the edge continuity of some grains differently. If these images are shortened to one, then not all the edges on all of the grains can been discovered.
- FIG. 4 illustrates an image-based analysis of a geological thin section in accordance with an embodiment of the disclosure.
- both images 402, 404 have the same brightness of 33%, which is conventional for representative images for analysis.
- the one on the right 404 has 0 degrees orientation, while the one on the left 402 has 22.5 degree orientation.
- the change in orientation results in the detection of cleavage angle and detecting edges in grains marked with an X, in accordance with an embodiment of the disclosure.
- FIG. 4 shows how changing the orientation, usually used to detect cleavage angle, helps in detecting edges in grains.
- This specification discloses an automated optimization workflow for the best microscope and camera settings configuration by utilizing the automated analysis while the images are being captured and not after capturing the images.
- FIG. 5 illustrates another plane polarized image of the geological thin section in accordance with an embodiment of the disclosure. Exclusion of the pore space may best be accomplished by using the plane-polarized image, since a histogram 505 of the plane-polarized image is bimodal as shown in FIG. 5. Indeed, as shown, image 500 shows that a clear cut-off can be determined or calculated to segment this image into a grain color and a pore color. This value can be applied to the plane-polarized image 500 to distinguish grains from pores more easily.
- the cut-off value may depend on a color of the dye epoxy used to prepare the geological thin section. For example, the cut-off value can be estimated manually for a particular geological thin section to be analyzed and then used for other geological thin sections to be analyzed, provided that the same epoxy is being used for all of the geological thin sections.
- FIG. 6 illustrates example steps in a method 600 for capturing an image by a robotic thin section analyzer in accordance with an embodiment of the disclosure.
- the method may be used for optimizing settings for a camera and microscope for capturing thin section images of a reservoir rock in a hydrocarbon reservoir.
- the method includes extracting a plurality of core samples from a well.
- the method involves cutting a respective plurality of thin sections from the plurality of core samples.
- the method includes capturing a thin section image using a robotic microscope and a camera.
- the method includes performing a frequency analysis of each pixel of the thin section image, and associating each pixel in the thin section image with a class identifier selected from a plurality of class identifiers, at step 610.
- Each class identifier may be associated with range of frequencies.
- the method includes determining a percentage of pixels in each class identifier, and step 614 the method includes determining a percentage of pixels comprising noise.
- Method 600 may include additional steps, which are described with reference to FIG. 7 below. [0034] FIG. 7 illustrates additional steps in the method 600 for optimizing settings for a camera and microscope in accordance with an embodiment of the disclosure.
- the method may further include saving the thin section image and the settings for the camera and microscope associated with the thin section image.
- the method may include saving data generated from the frequency analysis of the thin section image.
- the method may include saving the determination of the percentage of pixels comprising noise associated with the thin section image.
- the method may include repeating these steps for a plurality of thin section images taken at a plurality of settings for the camera and the microscope.
- the method may include combining the settings for the camera and microscope associated with the plurality of thin section images, data generated from the frequency analysis of the plurality of thin section images, and the determination of the percentage of pixels comprising noise associated with the plurality of thin section images to produce a structured data set.
- the method may include generating a machine learning model using the structured data set.
- the method may include determining, using the machine learning model, an optimized setting for the camera and an optimized setting for the microscope based on the thin section image with the least noise.
- the step of determining a percentage of pixels comprising noise further comprises determining a percentage of pixels having a frequency over a predetermined threshold.
- the plurality of settings comprise magnification, illumination, stage position, plane polarized light (PPL), cross polarized light (XPL), thin focus, or coarse focus.
- the optimized setting comprises at least one setting for magnification, illumination, stage position, plane polarized light (PPL), cross polarized light (XPL), thin focus, and coarse focus.
- FIGS. 6 and 7 depict a process 600 illustrating construction and operation of the machine learning model in accordance with an embodiment of the disclosure.
- the machine learning engine may be use an artificial neural network (ANN), a support vector machine (SVM), a radial basis function (RBF), fuzzy logic, a decision tree, random forest, or k-means algorithm.
- ANN artificial neural network
- SVM support vector machine
- RBF radial basis function
- fuzzy logic a decision tree
- random forest or k-means algorithm.
- a machine learning model may be trained by adjusting and optimizing learning parameters of the machine learning engine.
- Example learning parameters may include learning rate, number of neurons, number of layers, activation function, and weight coefficients.
- the prior art methodologies for thin section image analysis compute red, green, and blue (RGB) values for every pixel and utilize different image processing toolboxes, pattern recognition techniques, and algorithms to detect different geological information.
- the information includes porosity, grain size, roundness, petrological properties, and other pre defined objects and features such as fossils, and special grains (peloids, ooids). These are not all identifiable under the same settings configuration like magnification, plane polarized light (PPL) versus cross polarized light (XPL), orientation, focus of the microscope, and brightness of the camera, and some of them can only be identified by changing these parameters (or extinction angle).
- PPL plane polarized light
- XPL cross polarized light
- orientation focus of the microscope
- brightness of the camera and some of them can only be identified by changing these parameters (or extinction angle).
- a geoscientist would have to change the settings configuration and perform an analysis in the lab.
- One embodiment is an automated configuration system of image capturing settings (magnification, focus, brightness, orientation, plane polarized light (PPL) versus cross polarized light (XPL)) in microscope and camera.
- the best configuration is determined by automated object detection programs that can detect geological features and objects.
- the system quantifies the processing uncertainty of the object detection by comparing the variable results of different image settings. Additionally, the system aims to gives a measure of the thickness consistency of samples in thin sections as a quality check of their conditions.
- an expert is responsible for analyzing the objects and properties of samples in thin sections under the microscope.
- the expert changes and fine-tunes the configurations of the microscope and camera until images that best represent the sample properties and elements are achieved.
- These past years witnessed the rise of fast and automated robotic microscopes that has motorized parts and cameras with pre-defmed settings of capturing images. Images captured in these automated microscopes represent one or few setting configurations of many possibilities including orientation of microscope stage, magnification, focus or stage position, brightness, plane polarized light (PPL) versus cross polarized light (XPL) of the microscope, and brightness of the camera.
- PPL plane polarized light
- XPL cross polarized light
- pre-defmed ranges for the different settings are set by the user (1, 20X, 1, 1, 1, PPL). Also, the user has the option of choosing a course of action for changing the parameters such as magnification, focus, brightness, orientation, and selecting plane polarized light (PPL) versus cross polarized light (XPL).
- PPL plane polarized light
- XPL cross polarized light
- the camera takes a picture and sends it to the computer system.
- the system utilizes different object detection programs to detect objects and properties of the image.
- the computer system runs the analysis, it sends signals to the camera and microscope motorized parts to automate the change of the settings to a different configuration; it changes one parameter until all possible configurations for every parameter are covered. In the end, several pieces of information are saved.
- the system automatically picks several setting configurations of the camera and the microscope that result in the best image analysis.
- This analysis is deemed “best” as defined by different criteria. For example, one or more thin sections with their analysis already done could be used as training step where the images that produced analysis close to them are chosen as the “best”.
- An image or “images” can be defined as “best” for analysis if it allows the detection and identification of most objects and properties in the whole area of thin sections. This means that all the setting configurations and the images resulted from them fall under two categories: the category with the best images and setting configurations defined previously, and the disregarded category of no analysis or minimal detection and identification caused by blurry images or too dark or too bright or out of focus images. Nevertheless, other scenarios might also occur.
- the detection and analysis programs should have a workflow of detecting objects with properties that change with different setting configurations (for example, some mineral show different colors with different settings or stage orientations). This would not only solve the variability of the analysis output but it would also help in identifying these objects by the change of their properties. For that, the areas of the thin section have to be registered and referenced so they would be traced with changing settings.
- thin section images under the microscope are chosen by an expert or pre-defmed settings, which means that these images represent the optimal settings configuration that the human eye could analyze the objects and features in such images and not what the automated programs can analyze since they are not involved in choosing the images.
- thin section images represent one or few configurations of camera and microscope settings (orientation of microscope stage, magnification, focus, stage position, brightness, contrast, plane polarized light (PPL) versus cross polarized light (XPL)) which does not represent the full spectrum of possibilities. This limits the analysis of objects and features to one or few rather than all configurations.
- Prior art methodologies also do not include the different procedures and methodologies enlisted in this specification including the quality check of the thickness consistency of samples, picking the best image capturing configuration. Also, even if different papers or patents propose the change of configurations during image capturing of thin section images they do not use the feedback from the automated image analysis programs as a way of quality check or for picking the best camera and microscope configurations but rather these different configurations are already set prior to the capture of images.
- the auto analyzer tool is a computer software that helps in configuring the settings of the camera and the microscope based on the output of the analysis program without the intervention of experts and to produce consistent and optimized analysis results.
- the auto analyzer tool is connected to both the camera and microscope, and to the analysis program. This tool changes the settings on the camera and the microscope automatically after receiving certain outputs from the analysis program. These outputs are one of two types: Type one is 1 or 0 outputs.
- Type one is 1 or 0 outputs.
- the analysis program runs different operations like pattern recognition, and supervised expert system, to identify different features and objects it will produce a matrix grid where for every pixel the program has an answer or identification which would be given the number 1.
- these analysis programs were built on best case scenario that might not be captured by every camera or microscope many pixels in these images would not be identifiable and given the number 0 for non-identifiable or noise.
- the proposed specification tool allows the re-configuration of the camera or microscope until the image (termed “best”) that has the most identifiable pixels is acquired.
- Type two is the uncertain analysis output. Where the output answer for every pixel is either 0, 1, or 2. This means that under different settings the same pixel might have two or more different identification or analysis results.
- the basic forward feed neural network would compare the analysis output of the image to the trading images and pick the settings that best match the trading set. This neural network could be replaced with a simple supervised and automated rules. In this case, the user has the choice when setting the auto analyzer of either accepting the analysis with most repetition or accepting all analyses.
- the analysis program interpret pixels with RGB values of (>50, 0, 0) as red, while pixels with RGB values of (0, 0, >50) with blue.
- the output analysis would be a grid with each pixel labels blue or red.
- some pixels might have no identification. In this example, all the pixels are either blue or red but because of the settings they were captured under they do not follow the criteria the analysis program was programmed to detect and interpret as such; blue color might lower or higher values if the brightness of the camera was too low or too high.
- red pixels would be interpreted as blue or vice versa under different setting configurations.
- the final “best” result would be either the analysis with the highest consistency (out of 1000 iterations 900 analysis reports identified pixel 1 as red), or the result would list the different analyses instead of one. The other option would allow the uncertainty measurement.
- images would have the same number of identified number of pixels but not the same pixels identified. For example, pixel 1 would have an analysis and pixel 2 would not be identified in configuration 1 while pixel 1 has no analysis and pixel 2 has analysis in configuration 2.
- the auto analyzer would enable the stitching of pixels from different images. This means that final “best” image would be constructed from pixels from images that have different setting configurations. A pixel with an analysis would replace the same pixel location where in an image where that pixel had no analysis or was not identified.
- the auto analyzer tool is not only meant to automate the change of the camera or microscope settings but also to pick the “best” images and settings.
- the user involvement or training has two aspects to it. One aspect is by choosing what sequence of camera or microscope parameters to change and also pre-define certain ranges of these parameters to avoid redundancy. Second aspect is a replacement to the mechanism of choosing “the best configurations or images” outlined previously. In this step, the user judges what images or configurations produce the best analysis and which do not. Based on these “answers” they system would build a one-layer neural network of what ranges and what sequence of parameter changing got the desired answers and apply them on the rest of images.
- the user has the choices of how the system selects the “best” images or configuration settings between 1) pre-defined automated rules set by the user or 2) neural network model that performs the job of the predefined rules.
- the other option the user has the choice to select is training single layer neural network with already analyzed sample images.
- the user picks a couple of samples. Then the user supervises the analysis process by the analysis program and chooses the best analysis with the user’s subjective judgment.
- the analysis results (X and Y coordinates of pixels, analysis identifier or class for every pixel) are used as a training data set or input. Then the system of camera or microscope is trialed with random configuration settings. The captured images are sent to the analysis programs producing all the analysis results possible.
- the new analysis results are correlated to the analysis results of the training set, creating a single layer neural network. This network is used to correlate which configuration settings are optimal to produce satisfactory analysis results of images. If the other samples come from the same field and prepared under the same conditions, their images would be captured using the configuration settings predicted by the neural network model.
- the embodiments disclosed are configured to work with any image analysis program that may be suitable for the purpose including those based on image features using any type or any level of image processing. Additionally, the output of these image processing programs may include a grid map, based on for example the input image, with an identification classifier for every pixel or cell of the image. These identification classifiers may represent the analysis result and output of the image features analyzed by the disclosed program.
- FIG. 8 illustrates a data processing system 800 for optimizing settings for a camera and microscope in accordance with an embodiment of the disclosure.
- system 800 includes a computer 150 having a processor 152 and memory 154 coupled to processor 152 to store operating instructions, control information and database records.
- the computer 150 may be a portable digital processor, such as a personal computer in the form of a laptop computer, notebook computer or other suitable programmed or programmable digital data processing apparatus, such as a desktop computer.
- the computer 150 may be a multicore processor with nodes such as those from Intel Corporation or Advanced Micro Devices (AMD), a High Performance Computing (HPC) Linux cluster computer or a mainframe computer of any conventional type of suitable processing capacity such as those available from International Business Machines (IBM) or other source.
- AMD Advanced Micro Devices
- HPC High Performance Computing
- mainframe computer of any conventional type of suitable processing capacity such as those available from International Business Machines (IBM) or other source.
- the system 800 has a user interface 156 and an output data or graphical user display 158 for displaying output data or records of lithological facies and reservoir attributes according to this embodiment.
- the output display 158 includes components such as a printer and an output display screen capable of providing printed output information or visible displays in the form of graphs, data sheets, graphical images, data plots and the like as output records or images.
- the user interface 156 of system 800 also includes a suitable user input device or input or output control unit 160 to provide a user access to control or access information and database records and operate the computer 150.
- Data processing system 800 further includes a database 162 stored in the computer memory, which may be internal memory 154, or an external, networked, or non-networked memory 164 in an associated database server 166.
- the data processing system 800 includes program code 168 stored in memory 154 of the computer 150.
- the program code 168 is in the form of non-transitory computer operable instructions causing the data processor 152 to perform the computer implemented method of the present disclosure in the manner described above.
- program code 168 may be in the form of microcode, programs, routines, or symbolic computer operable languages that provide a specific set of ordered operations that control the functioning of the data processing system 800 and direct its operation.
- the instructions of program code 168 may be stored in non-transitory form in memory 154 of the computer 150, or on computer diskette, magnetic tape, conventional hard disk drive, electronic read-only memory, optical storage device, or other appropriate data storage device having a non-transitory computer usable medium stored thereon.
- Program code 168 may also be contained in non-transitory form on a data storage device such as server 166 as a computer readable medium.
- the method of the present embodiment performed in the computer 150 can be implemented utilizing the computer program steps of FIGS. 3-7 stored in memory 154 and executable by system processor 152 of computer 150.
- the input data to processing system 800 are the input parameters and reservoir data of the types described above.
- This specification uses the term “configured” in connection with systems and computer program components.
- a system of one or more computers to be configured to perform particular operations or actions means that the system has installed on it software, firmware, hardware, or a combination of them that in operation cause the system to perform the operations or actions.
- one or more computer programs to be configured to perform particular operations or actions means that the one or more programs include instructions that, when executed by data processing apparatus, cause the apparatus to perform the operations or actions.
- Embodiments of the subject matter and the functional operations described in this specification can be implemented in digital electronic circuitry, in tangibly-embodied computer software or firmware, in computer hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them.
- Embodiments of the subject matter described in this specification can be implemented as one or more computer programs, that is, one or more modules of computer program instructions encoded on a tangible non-transitory storage medium for execution by, or to control the operation of, data processing apparatus.
- the computer storage medium can be a machine readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of them.
- the program instructions can be encoded on an artificially-generated propagated signal, for example, a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus.
- data processing apparatus refers to data processing hardware and encompasses all kinds of apparatus, devices, and machines for processing data, including by way of example a programmable processor, a computer, or multiple processors or computers.
- the apparatus can also be, or further include, special purpose logic circuitry, for example, an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).
- the apparatus can optionally include, in addition to hardware, code that creates an execution environment for computer programs, for example, code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them.
- a computer program which may also be referred to or described as a program, software, a software application, an app, a module, a software module, a script, or code, can be written in any form of programming language (for example, compiled or interpreted languages, or declarative or procedural languages).
- a computer program can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.
- a program may, but need not, correspond to a file in a file system.
- a program can be stored in a portion of a file that holds other programs or data, for example, one or more scripts stored in a markup language document, in a single file dedicated to the program in question, or in multiple coordinated files, for example, files that store one or more modules, sub-programs, or portions of code.
- a computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a data communication network.
- engine is used broadly to refer to a software-based system, subsystem, or process that is programmed to perform one or more specific functions.
- an engine will be implemented as one or more software modules or components, installed on one or more computers in one or more locations. In some cases, one or more computers will be dedicated to a particular engine; in other cases, multiple engines can be installed and running on the same computer or computers.
- the processes and logic flows described in this specification can be performed by one or more programmable computers executing one or more computer programs to perform functions by operating on input data and generating output.
- the processes and logic flows can also be performed by special purpose logic circuitry, for example, an FPGA or an ASIC, or by a combination of special purpose logic circuitry and one or more programmed computers.
- Computers suitable for the execution of a computer program can be based on general or special purpose microprocessors or both, or any other kind of central processing unit.
- a central processing unit will receive instructions and data from a read-only memory or a random access memory or both.
- the essential elements of a computer are a central processing unit for performing or executing instructions and one or more memory devices for storing instructions and data.
- a computer will also include (or be operatively coupled to share data with) one or more mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks.
- mass storage devices for storing data, for example, magnetic, magneto-optical disks, or optical disks.
- a computer need not have such devices.
- a computer can be embedded in another device, for example, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device, for example, a universal serial bus (USB) flash drive, to name just a few.
- PDA personal digital assistant
- GPS Global Positioning System
- USB universal serial bus
- Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, for example, EPROM, EEPROM, and flash memory devices; magnetic disks, for example, internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.
- semiconductor memory devices for example, EPROM, EEPROM, and flash memory devices
- magnetic disks for example, internal hard disks or removable disks
- magneto-optical disks and CD-ROM and DVD-ROM disks.
- embodiments of the subject matter described in this specification can be implemented on a computer having a display device, for example, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user and a keyboard and a pointing device, for example, a mouse or a trackball, by which the user can provide input to the computer.
- a display device for example, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor
- keyboard and a pointing device for example, a mouse or a trackball
- Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback, for example, visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, or tactile input.
- a computer can interact with a user by sending documents to and receiving documents from a device that is used by the user; for example, by sending web pages to a web browser on a user’s device in response to requests received from the web browser.
- a computer can interact with a user by sending text messages or other forms of message to a personal device, for example, a smartphone that is running a messaging application, and receiving responsive messages from the user in return.
- Data processing apparatus for implementing machine learning models can also include, for example, special-purpose hardware accelerator units for processing common and compute intensive parts of machine learning training or production (for example, inference) workloads.
- Machine learning models can be implemented and deployed using a machine learning framework, for example, a TensorFlow framework, a Microsoft Cognitive Toolkit framework, an Apache Singa framework, or an Apache MXN framework.
- Embodiments of the subject matter described in this specification can be implemented in a computing system that includes a back-end component, for example, as a data server, or that includes a middleware component, for example, an application server, or that includes a front-end component, for example, a client computer having a graphical user interface, a web browser, or an app through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back-end, middleware, or front-end components.
- the components of the system can be interconnected by any form or medium of digital data communication, for example, a communication network. Examples of communication networks include a local area network (LAN) and a wide area network (WAN), for example, the Internet.
- LAN local area network
- WAN wide area network
- the computing system can include clients and servers.
- a client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
- a server transmits data, for example, a hypertext markup language (“HTML”) page, to a user device, for example, for purposes of displaying data to and receiving user input from a user interacting with the device, which acts as a client.
- HTML hypertext markup language
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Pathology (AREA)
- Environmental & Geological Engineering (AREA)
- Biochemistry (AREA)
- Remote Sensing (AREA)
- Geology (AREA)
- Immunology (AREA)
- Medicinal Chemistry (AREA)
- Food Science & Technology (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Analytical Chemistry (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Geometry (AREA)
- Microscoopes, Condenser (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| SA522441847A SA522441847B1 (en) | 2020-07-09 | 2022-12-21 | Systems and methods for optimizing camera and microscope configurations for capturing thin section images |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/924,527 US11126819B1 (en) | 2020-07-09 | 2020-07-09 | Systems and methods for optimizing camera and microscope configurations for capturing thin section images |
| US16/924,527 | 2020-07-09 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2022011394A1 true WO2022011394A1 (en) | 2022-01-13 |
Family
ID=77412399
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2021/070854 Ceased WO2022011394A1 (en) | 2020-07-09 | 2021-07-09 | Systems and methods for optimizing camera and microscope configurations for capturing thin section images |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US11126819B1 (en) |
| SA (1) | SA522441847B1 (en) |
| WO (1) | WO2022011394A1 (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110295580A1 (en) * | 2010-05-28 | 2011-12-01 | Ingrain, Inc. | Method for obtaining consistent and integrated physical properties of porous media |
| DE102014102080A1 (en) * | 2014-02-19 | 2015-08-20 | Carl Zeiss Ag | Method for image acquisition and image acquisition system |
| US20190318467A1 (en) * | 2018-04-17 | 2019-10-17 | Saudi Arabian Oil Company | Automated analysis of petrographic thin section images using advanced machine learning techniques |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4868883A (en) * | 1985-12-30 | 1989-09-19 | Exxon Production Research Company | Analysis of thin section images |
| US6495106B1 (en) | 1998-03-24 | 2002-12-17 | Biogenex Laboratories | Automated staining apparatus |
| US20070031056A1 (en) | 2005-08-02 | 2007-02-08 | Perz Cynthia B | System for and method of focusing in automated microscope systems |
| US8676556B2 (en) * | 2007-11-27 | 2014-03-18 | Exxonmobil Upstream Research Company | Method for determining the properties of hydrocarbon reservoirs from geophysical data |
| US20090238435A1 (en) | 2008-03-21 | 2009-09-24 | Applied Imaging Corp. | Multi-Exposure Imaging for Automated Fluorescent Microscope Slide Scanning |
| US8311788B2 (en) * | 2009-07-01 | 2012-11-13 | Schlumberger Technology Corporation | Method to quantify discrete pore shapes, volumes, and surface areas using confocal profilometry |
| US20120127297A1 (en) | 2010-11-24 | 2012-05-24 | Baxi Vipul A | Digital microscopy with focus grading in zones distinguished for comparable image structures |
| CA2931216A1 (en) | 2013-12-31 | 2015-07-09 | Ventana Medical Systems, Inc. | Systems and methods for spectral unmixing of microscopic images using pixel grouping |
| WO2016101092A1 (en) | 2014-12-22 | 2016-06-30 | 杭州唐光科技有限公司 | Digital microscope and focusing method thereof |
| US20160320769A1 (en) * | 2015-04-30 | 2016-11-03 | Aramco Services Company | Method and device for obtaining measurements of downhole properties in a subterranean well |
| US9626771B2 (en) | 2015-05-20 | 2017-04-18 | Saudi Arabian Oil Company | Image-based analysis of a geological thin section |
| CN120629082A (en) * | 2018-05-03 | 2025-09-12 | 阿科亚生物科学股份有限公司 | Multispectral sample imaging |
| US20210010936A1 (en) * | 2019-07-11 | 2021-01-14 | Saudi Arabian Oil Company | Characterizing diesel contaminated with hydrocarbons |
| US11062439B2 (en) * | 2019-09-24 | 2021-07-13 | Halliburton Energy Services, Inc. | Automating microfacies analysis of petrographic images |
-
2020
- 2020-07-09 US US16/924,527 patent/US11126819B1/en active Active
-
2021
- 2021-07-09 WO PCT/US2021/070854 patent/WO2022011394A1/en not_active Ceased
-
2022
- 2022-12-21 SA SA522441847A patent/SA522441847B1/en unknown
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110295580A1 (en) * | 2010-05-28 | 2011-12-01 | Ingrain, Inc. | Method for obtaining consistent and integrated physical properties of porous media |
| DE102014102080A1 (en) * | 2014-02-19 | 2015-08-20 | Carl Zeiss Ag | Method for image acquisition and image acquisition system |
| US20190318467A1 (en) * | 2018-04-17 | 2019-10-17 | Saudi Arabian Oil Company | Automated analysis of petrographic thin section images using advanced machine learning techniques |
Non-Patent Citations (2)
| Title |
|---|
| APRILE ANNA ET AL: "Classification of mineral inclusions in ancient ceramics: comparing different modal analysis strategies", ARCHAEOLOGICAL AND ANTHROPOLOGICAL SCIENCES, SPRINGER BERLIN HEIDELBERG, BERLIN/HEIDELBERG, vol. 11, no. 6, 7 September 2018 (2018-09-07), pages 2557 - 2567, XP036805717, ISSN: 1866-9557, [retrieved on 20180907], DOI: 10.1007/S12520-018-0690-Y * |
| TANG DAVID G ET AL: "Machine learning for point counting and segmentation of arenite in thin section", MARINE AND PETROLEUM GEOLOGY, ELSEVIER, AMSTERDAM, NL, vol. 120, 11 June 2020 (2020-06-11), XP086243921, ISSN: 0264-8172, [retrieved on 20200611], DOI: 10.1016/J.MARPETGEO.2020.104518 * |
Also Published As
| Publication number | Publication date |
|---|---|
| US11126819B1 (en) | 2021-09-21 |
| SA522441847B1 (en) | 2024-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113435457B (en) | Image-based clastic rock composition identification method, device, terminal and medium | |
| EP3300001B1 (en) | Viewers and related methods, systems and circuits with patch gallery user interfaces for medical microscopy | |
| US8948494B2 (en) | Unbiased wafer defect samples | |
| CN111524132B (en) | Method, device and storage medium for identifying abnormal cells in sample to be detected | |
| CN109084955A (en) | Display screen quality determining method, device, electronic equipment and storage medium | |
| CN108961238A (en) | Display screen quality determining method, device, electronic equipment and storage medium | |
| RU2603979C1 (en) | Identification and selection of layers of fluid and fluid-saturated formations of one or more geological solid masses representing geological structure | |
| US20160275526A1 (en) | Time Based Anomaly Analysis in Digital Documents | |
| US10929972B2 (en) | Devices, systems and methods for automated quantitative scoring of digitized tissue images | |
| CN114581666B (en) | Rock sample intelligent identification method and system based on image deep learning | |
| US12406473B2 (en) | Method and system for enhancing online reflected light ferrograph image | |
| CN106796180B (en) | For diversity and the dynamic lattice of disfigurement discovery | |
| WO2023133512A1 (en) | Systems and methods for measuring physical lithological features based on calibrated photographs of rock particles | |
| CN116502171B (en) | Network security information dynamic detection system based on big data analysis algorithm | |
| Brigham et al. | A new metric for morphologic variability using landform shape classification via supervised machine learning | |
| Ro et al. | Scalable approach to create annotated disaster image database supporting AI-driven damage assessment | |
| Bhargava et al. | A study on potential of big visual data analytics in construction Arena | |
| US12400425B2 (en) | Automated thermal maturation estimation from palynological sample images | |
| JP2019075078A (en) | Construction site image determination device and construction site image determination program | |
| US11126819B1 (en) | Systems and methods for optimizing camera and microscope configurations for capturing thin section images | |
| CN119023181B (en) | Random vibration testing method and system | |
| US20250027409A1 (en) | Automated method and system to detect segment rock particles | |
| WO2019073615A1 (en) | Worksite image assessment device and worksite image assessment program | |
| CN118918351A (en) | Intelligent identification method, system, equipment and medium for core deposit structure | |
| Tolstaya et al. | Lithology prediction from drill cutting images using convolutional neural networks and automated dataset cleaning |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21758277 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 02.03.2023) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 21758277 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 522441847 Country of ref document: SA |
|
| WWG | Wipo information: grant in national office |
Ref document number: 522441847 Country of ref document: SA |