WO2017173500A1 - Method and test chart for testing operation of an image capture system - Google Patents
Method and test chart for testing operation of an image capture system Download PDFInfo
- Publication number
- WO2017173500A1 WO2017173500A1 PCT/AU2017/050305 AU2017050305W WO2017173500A1 WO 2017173500 A1 WO2017173500 A1 WO 2017173500A1 AU 2017050305 W AU2017050305 W AU 2017050305W WO 2017173500 A1 WO2017173500 A1 WO 2017173500A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- test chart
- edge
- image capture
- shapes
- capture system
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
Definitions
- the present invention relates to a method, test chart and system for testing operation of an electronic image capture system. Particularly, but not exclusively, the present invention relates a test chart for determining whether resolvable detail of an image captured with the electronic image capture system exceeds a minimum operational value corresponding to a sufficient value for the electronic image capture system to be used for analysing microbial growth in a solid culture medium.
- resolution of an image captured with an electronic image capture system is defined by the system's ability to capture and process finely spaced details, e.g. resolvable detail. That is, the resolution indicates the highest spatial frequency that any image capture system can produce.
- a more accurate metric of measuring the resolvable detail of a captured image is to use the spatial frequency response (SFR) of the electronic image capture system.
- SFR spatial frequency response
- the SFR can be used to assess contrast loss as spatial frequency increases. Generally, as the distance between visual elements decreases (i.e. the spatial frequency increases), the contrast between those elements decreases to a point whereby the difference between the elements can no longer be distinguished.
- the resolvable detail is dependent on several factors, including lighting, aperture, focus, lens quality, the number of photo-elements on the camera sensor, and any internal processing of the captured image such as compression and correction. Consequently, a reduction in resolvable detail of an image may indicate a change in any one of these factors.
- test charts include a series of visual elements which are analysed by an electronic image capture system to determine the SFR of a captured image of the chart.
- the chart In order for a test chart to be successfully utilised, the chart needs to be accurately aligned relative to the image capture device so that the generated image can be processed in the correct orientation. Consequently, the commonly used test charts for determining resolvable detail for an image capture system are rotationally variant.
- the test chart is rectangular in shape and has visual elements that are required to be imaged in a particular rotational orientation.
- one aspect of the present invention provides a method of testing operation of an electronic image capture system, the method including:
- test chart for the electronic image capture system under test, the test chart including: a background having a first colour; and at least one series of n number of shapes provided on the background, each of the shapes having an area with a second colour, and each of the shapes having at least a first edge adjacent to a second edge, wherein each of the n shapes in a series is provided on the background in an orientation such that either the first edge or the second edge of the at least one of the shapes has a rotation angle between 2 degrees and 88 degrees relative to a reference orientation of the test chart corresponding to the orientation of an image capture device of the electronic image capture system, and wherein n is at least 3; capturing an image of the test chart using the electronic image capture system;
- Another aspect of the present invention provides a system for testing operation of an electronic image capture system, the system including: a test chart for the electronic image capture system under test, the test chart including: a background having a first colour; and at least one series of n number of shapes provided on the background, each of the shapes having an area with a second colour, and each of the shapes having at least a first edge perpendicular to a second edge, wherein each of the n shapes in a series is provided on the background in an orientation such that either the first edge or the second edge of the at least one of the shapes has a rotation angle between 2 degrees and 88 degrees relative to a reference orientation of the test chart, and wherein n is at least 3; an image capture device of the electronic image capture system capturing an image of the test chart, wherein the reference orientation corresponds to the orientation of an image capture device of the electronic image capture system; and a processor of the electronic image capture system for measuring resolvable detail of the image by analysing the first and or the second edges of at least one of the shapes
- the test chart used for testing operation of the electronic image capture system is thus rotationally invariant and can be used in any orientation within 360 degrees of rotation.
- the test chart is rotationally symmetric, such as a circle.
- the test chart is disc shaped and the background and the shapes are provided on the circular planar surface of the disc.
- the transition from the first colour to the second colour is preferably defined by at least one straight edge and this edge is slanted relative to either vertical or horizontal relative to the orientation of the image capture device.
- each of the n shapes in the series has at least the first edge perpendicular to the second edge, and each of the n shapes in the series is provided on the background in an orientation that is rotated by an angle of (90/n) degrees of rotation relative to a successive shape in the series, and wherein n is at least 4.
- the n shapes are polygons as long as either the first edge or the second edge of the at least one of the shapes has a rotation angle greater than 2 degrees relative to the horizontal or vertical of the image capture device. It will be appreciated by those persons skilled in the art that shallow angles greater than 2 degrees representing near vertical and near horizontal can be used and preferably an angle closest to 5 degrees is used.
- the electronic image capture system under test is used for analysing microbial growth in a solid culture medium on a culture plate, and the minimum operational value is a sufficient value for the electronic image capture system to be used for this analysis.
- the system for testing operation of the electronic image capture system includes a support for supporting the test chart at a pre-determined location for the image capture device to capture the image, and wherein the system includes a frame for positioning the image capture device and the support relative to each other.
- the pre-determined location corresponds to a location of a culture plate when the electronic image capture system is used for analysing microbial growth on a solid culture medium in the culture plate.
- solid culture medium On a solid culture medium
- the word “on” is used to encompass microbial growth both upon the surface of the solid culture medium and within the solid culture medium.
- solid culture medium will hereinafter often be simply referred to as “medium” in the specification. For example, it will be appreciated that a
- microbiological sample hereinafter often referred to simply as a "sample”
- a sample can be dispensed either upon the surface of the medium or within the medium so that microbial growth can be grown following the inoculation and incubation of the medium with the sample. That is, the microbial growth on the medium results from the inoculation and incubation of the sample, such as a urine sample, an enteric sample, a blood sample, a lymph sample, a tissue sample, a water sample, a food sample or other relevant sample, on the medium.
- the sample such as a urine sample, an enteric sample, a blood sample, a lymph sample, a tissue sample, a water sample, a food sample or other relevant sample, on the medium.
- the medium will usually be, for example, agar and will usually be contained in a container such as a plate, and, in a more specific example, a Petri dish, which may have a lid.
- a container such as a plate, and, in a more specific example, a Petri dish, which may have a lid.
- the combination of the medium and the plate is hereinafter referred to throughout the specification as a "culture plate” which might sometimes be referred to in the art as an "agar plate".
- the electronic image capture system has been found, in an exemplary example, to provide sufficiently accurate images of microbial growth on the medium in order to provide a microbiological assessment.
- This assessment may be performed manually by a skilled laboratory technologist. Alternatively, the assessment may be automated and performed using a classifier that has been trained using a machine learning algorithm. Images obtained using the apparatus may be processed and used as input into the classifier.
- An example of an electronic image capture system, including such a classifier, is described in the Applicant's Australian patent
- the image capture device may be a digital camera and lens.
- a digital camera and lens For example, a high resolution digital colour camera in combination with an appropriate lens has been found to provide quality images of the plates.
- Image capture devices having many different specifications are suitable for the purpose as would be understood by the skilled addressee.
- the microbial growth may include, for example, one or more bacterial growths, fungal growths, viral plaques or protist growths and the growth may take the form of a colony, mycelium, hypha, plaque or other visible microbial structure.
- each microbial growth may be growth that originates from a single microbe (such as where a sample is applied to a medium in a diluted manner such that individual microbes are separated).
- the medium may include any medium which supports the growth of a microbe.
- a medium may contain one or more microbial nutrients including, for example, a carbon source, a nitrogen source, essential elements and/or essential vitamins.
- the medium will also typically contain a gelling agent including, for example, gelatine, agar, gellan gum, agarose or agargel.
- the use of a ring light for diffusely illuminating one side of the culture plate assists a classifier in distinguishing between light reflected from the medium (which may be classified as background) and microbial growth.
- the reference to a "side" of the culture plate is to be taken to refer to any side including front, back, left, right, top or bottom side of the culture plate. In a preferred
- the ring light diffusely illuminates the top of the culture plate, e.g. the surface of the medium on which microbial growth is present.
- the ring light also illuminates one side of the test chart for testing operation of the electronic image capture system.
- the ring light may include a plurality of LEDs arranged in a circular array and a diffuser associated with the LEDs.
- the LEDs may themselves produce diffuse light and a separate diffuser may not be required. LEDs may be evenly spaced around the array in a single ring or in multiple rings. In one
- the LEDs may be selectively illuminable so that, for example, only half or a smaller fraction of the ring light is activated at one time. This may provide angled lighting of the culture plate, and may be useful in highlighting surface topography of the medium. To ensure a uniform distribution of light intensity the number of LEDs in the array may be greater than 50, preferably greater than 180 so that a LED is spaced every 2 degrees. This is further assisted by the diffuser to smooth out the light distribution.
- the ring light may be a fluorescent light or a plurality of fibre optic sources with a diffuser.
- the ring light may be located relative to the support so that specular reflection of light from the ring light from a central surface of the medium or the test chart is at an angle that is not captured by the image capture device.
- the ring light may have a width or diameter of between 120 and 250 mm and may be positioned between 30 and 50 mm above the support.
- a culture plate or the test chart is typically circular, generally having a diameter of between 80 and 1 10 mm, light emitted from the LEDs will strike the central surface of the culture plate at such a low angle that it does not reflect into the camera lens. This prevents reflections of the LEDs from appearing in the image, producing a higher quality image for producing inputs to the classifier and hence a more accurate assessment and for measuring resolvable detail.
- the support ideally positions the culture plate and the test chart
- the image capture device may also capture the area about the culture plate or the test chart.
- the apparatus may be arranged to include in the area about the culture plate or the test chart, in the field of view of the camera, various optical test features, such as a focus target, colour correction patches or alignment guides.
- the centre of the test chart is located by the support within a desired tolerance of the optical axis of the image capture device.
- the shapes on the test chart are co-planar and the test chart is located by the support within a focal plane of the image capture device.
- the desired tolerance is, for example, 1 mm.
- the culture plate and the test chart to be imaged are positioned manually on the support by an operator, and the support includes a plurality of spaced apart fingers extending from a periphery of a circular hole supporting at least an edge of the culture plate or the test chart. The fingers thus define a position on the support such that the culture plate or test chart is precisely located in the field of view of the camera.
- the culture plate and the test chart to be imaged are positioned automatically, by a robotic placement device. In this case, the robotic device may be programmed to position the culture plate or the test chart in a predetermined position.
- the frame may be a rigid structure that positions the image capture device, support and ring light relative to each other.
- the frame may be constructed in multiple parts that are connected together by bolts, screws or any suitable connection means.
- the frame may be formed in one piece by the use of suitable metal working techniques or moulds. The frame may play a part in light proofing the system.
- the method further includes, in an embodiment, selecting the at least one of the shapes as having a desired orientation such that either the first edge or the second edge of the at least one of the shapes is within a range of rotation angles relative to a reference orientation of the test chart. Further, the range of rotation angles is between 2 and 90/n degrees of rotation relative to the reference orientation.
- the test chart is rotationally symmetric and, with reference to the above embodiment, the method further includes locating the reference orientation of the test chart by bisecting the test chart relative to the orientation of the image capture device.
- the method further includes determining a first region of interest of at least a portion of the first edge and a portion of the background adjacent the first edge. Also, the method further includes processing the first region of interest to characterise an edge Spatial Frequency Response (SFR) for the first edge, wherein the SFR is a SFR curve of spatial frequency values for pixel utilisation levels, and the SFR correlates to the resolvable detail for the electronic image capture system.
- SFR Spatial Frequency Response
- operational value for the electronic image capture system correlates to a minimum utilisation level of 10 line pairs per pixel at a spatial frequency value of 0.5 relative to the SFR curve.
- the method further includes determining a second region of interest of at least a portion of the second edge and a portion of the background adjacent the second edge, and processing the second region of interest to
- the method further includes averaging the edge Spatial
- SFR Frequency Response
- the shapes on the test chart are preferably squares having vertical edges corresponding to the first edge and horizontal edges corresponding to the second edge.
- the shapes are L shapes having perpendicular first and second edges.
- the shapes can be polygons with more than 2 edges.
- edge SFR is a measure of the image transition across the edge rather than along it; accordingly it is preferable to have a near vertical and near horizontal edge greater than 2 Q .
- the electronic image capture system analyses both the first and the second edge of each of the exemplary four shapes in the image having the desired orientation to determine whether the resolvable detail exceeds a minimum operational value for the electronic image capture system.
- one of either the first or the second edge of the shapes in the image can be analysed to determine whether the resolvable detail exceeds a minimum operational value for the electronic image capture system.
- the test chart includes a centrally-located visual marker for bisecting the test chart to locate the reference orientation of the test chart relative to the orientation of the image capture device.
- the centrally-located visual marker is a different colour to the background and is, for example, a circle that enables the system to bisect the test chart through the circle. Also, in the example, the circle enables the system to determine whether the image capture device is located centrally within a desired tolerance of the optical axis of the image capture device.
- the test chart includes a line provided on the background having a different colour than the first colour which bisects the test chart. Further, the test chart includes an orientation visual maker provided on the
- the orientation visual marker and the line enable the system to determine the orientation of the test chart.
- the test chart includes four planar-alignment visual markers provided equally distant from a centre of the test chart. Further, the four planar-alignment visual markers are provided on four of the squares that are equally distant from the centre of the test chart. The four planar-alignment visual markers are, for example, four dots in the corner squares of the test chart that can be used to check that the test chart is parallel to the imaging plane of the image capture device.
- the background is a light grey colour (e.g. 20% black) and the shapes are a dark grey colour (e.g. 80% black). That is, the colours of the test chart are monochromatic and in grey scale.
- the light grey colour can be used to detect irregularities in the electronic image capture system.
- the above mentioned four dots are white so as to be visible in the dark grey shapes and in the embodiment the line bisecting the test chart is also white. It will be appreciated by those persons skilled in the art that other colours can be used provided that the visual features are visible from the background by the electronic image capture system.
- Figure 1 is a top view of a test chart according to an embodiment of the present invention.
- Figure 2 is a top view of a test chart according to another embodiment of the present invention.
- Figure 3 is a top view of the test chart of Figure 2 showing a series of shapes according to an embodiment of the present invention
- Figure 4 is a top view of the test chart of Figure 2 showing shapes in different series according to an embodiment of the present invention.
- Figure 5 is a top view of a test chart with a 0 Q angle of rotation according to an embodiment of the present invention
- Figure 6 is a top view of a test chart with a 22.5 Q angle of rotation according to an embodiment of the present invention.
- Figure 7 is a top view of a test chart with a 45 Q angle of rotation according to an embodiment of the present invention
- Figure 8 is a top view of a test chart with a 67.5 Q angle of rotation according to an embodiment of the present invention ;
- Figure 9 is a top view of a region of interest of a shape of a test chart according to an embodiment of the present invention .
- Figure 1 0 is a graph of edge Spatial Frequency Responses (SFRs) for test charts under exemplary tests according to an embodiment of the present invention
- Figure 1 1 is a schematic diagram of an apparatus for use in analysing microbial growth on a solid culture medium in a culture plate according to an embodiment of the present invention.
- Figure 1 2 is a flow chart of a method of testing operation of an electronic image capture system according to an embodiment of the present invention.
- test chart 1 for testing operation of an electronic image capture system is shown in Figure 1 .
- the first colour is a light grey and the second colour is a dark grey.
- each of the shapes is a square with at least a first edge
- the squares perpendicular to a second edge; the squares have two vertical edges and two horizontal edges.
- Each of the four squares in the series 14 is provided on the background 1 2 in an orientation that is rotated by an angle of 22.5 Q of rotation relative to a successive square in the series 14. It can be seen that the first square 1 6 on the upper left hand side of the circular background 12 is rotated 85 Q from a horizontal axis of the test chart 1 , the second square 18 on the lower right hand side of the circular background 12 is rotated 62.5 Q from the horizontal axis, the third square 20 on the upper right hand side of the circular background 12 is rotated 40 Q from the horizontal axis, and the fourth square 22 on the lower left hand side of the circular background 1 2 is rotated 1 7.5 Q from the horizontal axis.
- the electronic image capture system captures an image of the test chart 1 using an image capture device of the system, measures resolvable detail of the image by analysing the vertical and the horizontal edges of the squares in the image to determine whether the resolvable detail exceeds a minimum operational value for the electronic image capture system.
- the electronic image capture system under test is used for analysing microbial growth in a solid culture medium on a culture plate, and the minimum operational value is a sufficient value for the electronic image capture system to be used for this analysis.
- the test chart 1 used for testing the operation of the electronic image capture system is rotationally invariant and is a circle.
- the test chart is disc shaped, like the above mentioned culture plate, and the background and the shapes are provided on the circular planar surface of the disc.
- at least one of the shapes has a desired orientation such that either the first edge or the second edge of the at least one of the shapes is within a range of shallow rotation angles relative to a reference orientation of the test chart of between 2 and 22.5 Q .
- the square 22 with its 17.5 Q angle from the horizontal axis has the desired orientation.
- At least one of the shapes 16 1 8 20 22 will have the desired orientation at any rotation of the circular test chart 1 . That is, either the first edge or the second edge of the shapes has a rotation angle between the limits of 2- and 88 Q relative to the reference orientation of the test chart which corresponds to the orientation of the image capture device of the system.
- the first and the second edges are straight and form the transition from the first colour to the second colour. Also, at least one of these edges is slanted relative to either the vertical or horizontal relative to the orientation of the image capture device as described above.
- a centrally-located visual marker 24 is also shown in the test chart 1 .
- the centrally-located visual marker can be used for the electronic image capture system to bisect the test chart 1 to locate the reference orientation of the test chart relative to the orientation of the image capture device.
- the centrally-located visual marker 24 is a different colour (e.g. black) to the background 1 2 so that it can be identified by the electronic image capture system.
- the test chart also includes a line 26 on the background having a different colour than the background 1 2 which bisects the test chart 1 and an orientation visual maker 28 provided on the
- the line 26 and the marker 28 can be used by the electronic image capture system to determine the orientation of the test chart 1 .
- the line 26 and the marker 28 are shown as white in the embodiment of the test chart 1 .
- test chart 10 for testing operation of an electronic image capture system is shown in Figures 2 to 8.
- This test chart 1 0 includes four further planar-alignment visual markers 30 provided equally distant from a centre of the test chart 10. These four planar-alignment visual markers 30 are provided on four of the squares that are equally distant from the centre of the test chart 1 0 as four white dots in the corner squares of the test chart 1 0 that can be used for the electronic image capture system to check that the test chart 1 0 is parallel to the imaging plane of an image capture device of the image capture system, which will be discussed in further detail below.
- Each of the four shapes in each of the series 14 32 34 36 has an area with a second colour, whereby the first colour is a light grey and the second colour is a dark grey.
- Each of the shapes is also a square with at least a first edge (e.g. vertical edge) perpendicular to a second edge (e.g. horizontal edge).
- Each of the four squares in each of the series 14 32 34 36 is provided on the background 1 2 in an orientation that is rotated by an angle of 22.5 Q of rotation relative to a successive square in the series 14. Accordingly, under test conditions, the electronic image capture system again captures an image of the test chart 1 0, measures resolvable detail of the image by analysing the vertical and the horizontal edges of the four squares in the image to determine whether the resolvable detail exceeds a minimum operational value for the electronic image capture system.
- At least one of the shapes will again have a desired orientation such that either the first edge or the second edge of the at least one of the shapes is within the range of rotation angles between 2 and 22.5 Q relative to the reference orientation of the test chart.
- this embodiment of the test chart 10 there are four squares across four different series with the same desired orientation and resolvable detail of the image is measured by analysing the first and the second edges of the four shapes in the image and determining whether the resolvable detail exceeds a minimum operational value for the electronic image capture system.
- Figure 3 shows an embodiment of the test chart 10 with the squares of the series 14 highlighted.
- the first square 16 on the upper left hand side of the circular background 12 is rotated 85 Q from a horizontal axis of the test chart 10
- the second square 18 on the lower right hand side of the circular background 12 is rotated 62.5 Q from the horizontal axis
- the third square 20 on the upper right hand side of the circular background 12 is rotated 40 Q from the horizontal axis
- the fourth square 22 on the lower left hand side of the circular background 12 is rotated 17.5 Q from the horizontal axis.
- Figure 4 shows an embodiment of the test chart 10 with squares having the same orientation across the different series 14 32 34 36 highlighted. It can be seen that the square 16 of the first series 14 is rotated 85 Q from a horizontal axis of the test chart 10. The square 38 of the second series 32 is also rotated 85 Q from a horizontal axis of the test chart 10. The square 40 of the third series 34 is also rotated 85 Q from a horizontal axis of the test chart 10. The square 42 of the fourth series 36 is also rotated 85 Q from a horizontal axis of the test chart 10.
- Figures 5 to 8 show the rotationally invariant test chart 10 being used across a number of orientations within 360 degrees of rotation.
- Figure 5 is at 0 Q of rotation
- Figure 6 at 22.5 Q of rotation
- Figure 7 is at 45 Q of rotation
- Figure 8 at 67.5 Q of rotation relative to a horizontal axis 44 of the test chart 10.
- four squares across four series are selected as having a desired orientation such that either the first edge or the second edge is within the desired shallow range of rotation angles of 2 and 22.5 Q .
- These four squares here are: square 16; square 38; square 40; and square 42.
- test chart 10 at the orientation of Figure 6 When the test chart 10 at the orientation of Figure 6 is used for testing operation of the electronic image capture system, four different squares across the four series are selected as having a desired orientation. These four squares here are: square 22; square 46; square 48; and square 50.
- test chart 10 at the orientation of Figure 7 When the test chart 10 at the orientation of Figure 7 is used for testing operation of the electronic image capture system, four different squares across the four series are selected as having a desired orientation. These four squares here are: square 22; square 52; square 54; and square 56.
- test chart 10 at the orientation of Figure 8 When the test chart 10 at the orientation of Figure 8 is used for testing operation of the electronic image capture system, four different squares across the four series are selected as having a desired orientation. These four squares here are: square 18; square 58; square 60; and square 62.
- test chart 10 is rotationally invariant and, in an
- Figure 1 1 shows an embodiment of a system 90 for testing operation of an electronic image capture system 100, the system 90 including at least the test chart 1 10, an image capture device 104 and a processor 138 of a computer 136 for measuring resolvable detail of the image captured with the electronic image capture system 100.
- the electronic image capture system 100 is generally used in analysing microbial growth on a solid culture medium in a culture plate 102.
- the system 100 is required to be tested at regular intervals to determine whether the resolvable detail exceeds a minimum operational value for the electronic image capture system corresponding to a sufficient value for the electronic image capture system to be used for analysing microbial growth.
- the electronic image capture system 100 further includes an image capture device 104 in the form of a high resolution digital camera 106 of machine vision quality with an appropriate fixed focal length lens 108.
- the camera 106 is positioned about 200mm above a ring light 1 10.
- the ring light 1 10 has a large diameter relative to the diameter of the plate 102 (e.g. agar plate). In this example, the ring light 1 10 has a diameter of 180mm.
- the ring light 1 10 contains several hundred white LEDs arranged in a circular array and a diffuser.
- the ring light 1 10 is positioned around 40mm above an opaque cover 1 12 that forms part of the frame 1 18, and thus about 30mm above the plate 102. The positioning of the ring light 1 10 so that light from the white LEDs impinge on the surface of the agar plate 102 at a low angle prevents a specular reflection of the LEDs from a central surface of the solid culture medium being captured by the image capture device 104.
- the lighting device 1 14 is located about 150mm below the opaque cover 1 12. This distance is chosen so that light from the ring light 1 10 falls on the baffles rather than the light 1 14, to reduce rear illumination of the plate 102.
- a support 1 16 for supporting the plate 102 in the direct field of view of the image capture device 104 is provided.
- the support 1 16 also supports the test chart 1 10 in the same manner.
- the support 1 16 is transparent to light and preferably includes a plurality of spaced apart fingers extending from a periphery of a circular hole supporting at least an edge of the culture plate 102. That is, the support 1 16 includes one or more positioning elements for positioning the plate 102 on the support 1 16 within the circular hole. Further, the support 1 16 includes a placement device configured to position the plate 102 in a position in the image capture system 100 to capture the image of the solid culture medium and any microbial growth. In another example, the support 1 16 is a transparent glass stage that is 3mm thick.
- the glass may be replaced if it becomes scratched over time.
- the support 1 16 includes, in another example, two or more triangle shaped transparent positioning elements for positioning the plate 102 on the support 1 16. The apexes of the triangles point towards the centre of the support for placement of the plate 102 so that the apexes touch the circumference of the plate 102.
- a frame 1 18 positions the image capture device 104, support 1 16, ring light 1 10 and lighting device 1 14 relative to each other.
- the frame 1 18 is made of an opaque material, such as sheet metal or plastic, which reduces the amount of light entering the system 100.
- the internal surfaces of the system 100 are blackened where possible to reduce reflection of light from the internal surfaces into the lens 108.
- the frame 1 18 includes a door 120 providing an access path for a human operator to place the plate 102 on the support 1 16.
- a robotic plate- handling device may use the access path to place the plate 102 precisely on the support 1 16 for imaging, and then to remove the plate to a designated output channel/slide.
- the plate may be placed in an output channel
- waste the plate showed a clear negative result
- reincubation required 3. identification of potentially pathogenic bacteria (the plate showed a positive result and requires review in accordance with regulations); or 4. for human review (the computer was unable to make a clear decision).
- the opaque cover 1 12 is an aluminium plate that extends across the width of the frame 1 18 and effectively splits the frame 1 18 into a top enclosure 122 and bottom enclosure 124.
- the opaque cover 1 12 includes a hole 126 to allow light from the lighting device 1 14 to transmit through to the plate 102.
- the width of the hole 126 is just slightly larger than the width of the plate 102 (which is 90mm in this example and is typically between 80 and 1 10mm) and is less than the diameter of the ring light 1 10. This prevents light emitted from the ring light 1 10 from reflecting from the bottom surface 128 of the frame 1 18 or the surface of the flat panel light 1 14 and back through the culture plate 102.
- the frame 1 18 also includes light baffles 130 positioned below the opaque cover 1 12.
- Means 131 for changing the position of the ring light 1 10 relative to the support 1 16 are also provided in the form of a rack and pinion assembly.
- the frame 1 18, opaque cover 1 12 and light baffles 130 define a cavity 132 such that the support 1 16 supports the plate 102 between the image capture device 104 and the cavity 132.
- the support 1 16 in the example of a glass stage seals the cavity 132 and prevents unwanted material from falling into the cavity 132.
- the opaque cover 1 12 prevents light from the ring light 1 10 from illuminating visible areas of the cavity 132. In this configuration, the cavity 132 looks like a black background.
- a side angle light 134 is used to illuminate the plate 102 from an angle to highlight any surface topography on the agar on the plate 102, such as dimples or a granular texture.
- An alternative to the side angle light 134 is to activate only some of the LEDs in the ring light 1 10, such that the plate 102 is illuminated from one direction only.
- a processing means such as a computer 136 is connected to the image capture device 104, the ring light 1 10 and the lighting device 1 14 via a physical or wireless interface.
- the computer 136 may include a processor 138 and memory 140 storing software 142 for activating the different components, capturing raw data and processing the data.
- a library of images, metadata and other information may be stored at the computer 136, or may be accessible at the computer 136 via a network.
- the library may be linked to a Laboratory Information Management System (LIMS) to access information about the patient and sample.
- LIMS Laboratory Information Management System
- An image acquisition process using the system 100 may be suitable for obtaining images for use in classifying microbial growth on the plate 102 using a trained machine learning classifier, or in training such a classifier.
- a manual process will be described, where many steps are performed by a human operator, but it will be appreciated that many of the steps of the process may be automated and performed in software or by a robotic device.
- an inoculated and incubated agar plate 102 is positioned on the support 1 16, within the spaced apart, by a user.
- Plates 102 are generally stored within a laboratory with the agar facing down (to prevent condensation on the lid from falling on to, and damaging, the agar surface), so positioning the plate 102 on the support may include removing a lid of the plate 102 and rotating the plate so that the agar is facing upwards.
- the software 142 is activated to begin the image capture process.
- the software 142 requires the user to scan a barcode on the plate 102, or enter a number manually.
- the barcode links to a sample ID, which links the plate to a particular sample and, via the LIMS, to a particular patient.
- a live video preview of the camera output appears in the window shown in Fig. 2(a). The user may adjust the location of the plate 102 or the focus or aperture of the lens 108 using the live video stream.
- test chart 10 being used to test the operation of the electronic image capture system 100 to determining whether the resolvable detail exceeds a minimum operational value for the electronic image capture system 100.
- an image of the test chart 1 10 is captured using the electronic image capture system so that resolvable detail of the image can be measured by analysing the first and or the second edges of at least one of the squares in the image. Further, the at least one square is selected as having a desired orientation such that either the first edge or the second edge is within a shallow range of rotation angles between 2 and 22.5 Q .
- Figure 9 shows a region of interest 64 of an edge 66 of one of the squares of the test chart 1 10 and it can be seen that the edge has a shallow angle relative to the horizontal axis.
- the edge 66 is an edge of the square 40 of the test chart 10.
- the region of interest 64 includes at least a portion of the first or the second edge and a portion of the background adjacent the first edge.
- the edge 66 is an edge of the square 40 of the test chart 10 and the region of interest 64 is of the first (horizontal) edge of the square 40.
- SFR SFR Response
- SFR Spatial Frequency Response
- the SFR algorithm is executed on each of the four sides, resulting in 16 measurements. These measurements are then combined and compared against a minimum utilisation level at a given spatial frequency value to obtain a pass or fail result for that test of the electronic image apparatus using the test chart 10.
- the measurements of the SFR are displayed as curves and are averaged to yield a single curve. That is, the edge Spatial Frequency Response (SFR) for the first and the second edges are averaged to generate an averaged SFR which is compared against the minimum operational value for the electronic image capture system 100 which correlates to a minimum utilisation level of 10 line pairs per pixel at a spatial frequency value of 0.5 relative to the SFR curve.
- SFR Spatial Frequency Response
- the SFR curves averaged in the above described way for six tests using the test chart 10 are shown in Figure 10 with respect to the minimum utilisation level of 10 line pairs per pixel at a spatial frequency value of 0.5.
- This minimum utilisation level of 10 line pairs per pixel at a spatial frequency value of 0.5 is a threshold value correlating to the designated minimum operational value for the electronic image capture system.
- the six tests of the electronic image capture system 100 are simulated tests with the camera 106 of the system 1 00 having its focussed changed to simulate it being out of focus. It can be seen that two tests displayed as the curves marked as "Focussed" passed the minimum threshold utilisation level of 10 line pairs per pixel at a spatial frequency value of 0.5.
- the resolvable detail for the electronic image capture system exceeds the minimum operational value for the electronic image capture system.
- the tests marked with focus levels -1 , -0.5, 1 and 0.5 fail the minimum threshold utilisation level of 10 line pairs per pixel at a spatial frequency value of 0.5.
- the code for the implementation of the testing operation to be implemented by the processor 138 of the computer 136 is broken into two separate pieces.
- a set of low-level functions is contained in a C++ class called SFRUtils.
- a set of higher-level functions is contained in a class called SFRChart. This class implements the square selection and region-of-interest (ROI) extraction for the test testing operation. Also, the ROIs are cropped from the image of the test chart taken using the electronic image capture system and passed down to SFRUtils.
- ROI region-of-interest
- the SFRUtils contains the low-level functions used to compute the SFR of a particular region.
- the key method in this class is processHorizontalROI which, when supplied an image of an ROI, produces the SFR for that region.
- the steps involved include: determining the location of the step between the two colours (e.g. light grey and dark grey) and fitting a line to it; using the line to straighten the edges and super-sample them, forming a 4x resolution 1 D image of the transition from dark to light grey; differentiating the image to form an edge-spread-function (ESF);
- ESF edge-spread-function
- step 1 to locate the transition from dark to light grey, the image is
- IRLS iteratively reweighted least squares
- the shift is performed by multiplying the difference by 4, converting to an integer and then adding the entire column to a vector 4 times the height of the image. Every column in the image is added in this fashion, the end result being a vector containing a 4x sampled 1 D copy of the edge. Each row is then divided by the number of samples which contributed to it.
- step 3 the 1 D version of the image is differentiated.
- a simple numeric differentiation is used where the next element is subtracted from the previous element, and then divided by two to give the derivative of the current element.
- step 4 the edge-spread-function (ESF) is now weighted with a hamming window to reduce the influence of elements towards the edge of the ESF, and focus on the inner elements around the transition itself.
- ESF edge-spread-function
- step 5 the absolute value of the discrete Fourier transform is computed to yield the SFR itself.
- the set of appropriate squares to be used can be determined as follows. A list is constructed of every possible ROI for the test chart 10, leading to 64 entries. Each ROI is rotated by the test chart 10 orientation that is determined as described above. The angle between reference orientation and the four cardinal directions is then taken. If the angle is greater than 2 Q and less than 1 1 .35 Q , a match has been found. The lower bound prevents the code from selecting squares which are close to horizontal or vertical.
- the test is repeated with a threshold of 22.5 Q .
- the bounding box for each one needs to be determined.
- the ROI list is determined, only the centre of each square is known, not the dimensions to be cropped from the original image.
- To compute the dimensions four points are constructed which span the ROI. The points are then rotated to the angle of the ROI and the span of the points in X and Y is computed. If the X span is bigger than Y, some padding is added to the Y axis to ensure enough pixels are available. If the Y span is bigger than X, padding is added to the X axis. The image within this region is then extracted to form the ROI.
- the edge pixels along the horizontal and vertical axis of the ROI are averaged together, to yield four averages. If the difference between the two horizontal edges is bigger than the two vertical edges, the image needs to be rotated. Similarly, if the middle pixel on the top row is brighter than the middle pixel on the bottom row, the image is upside down and needs to be flipped. Once the ROI has been cropped, it is fed to the SFR computation method.
- the camera 106 alignment is checked.
- the centre of the test chart 10 is a black circle.
- the camera 106 alignment may be checked by ensuring the centre pixel of the image is black when the test chart 10 is loaded in the system 100.
- Black is defined as having an intensity of less than 0.2.
- the image captured for the test chart 10 should not be colour corrected. Thus, image must be prepared for use.
- the white balance is easily computed, since the test chart 10 is grey overall.
- the average grey of the test chart 10 is 0.31 .
- the average colour of the area of the image covered by the test chart 10 is computed, and then mapped so that the average red, green and blue values are all 0.31 .
- the correct orientation of the test chart 10 can also be determined at this stage.
- the test chart 10 position in the system 100 can be used to determine the expected position of the white dot 28 in both possible orientations of the test chart 10 (the angle from the test chart 10 locating algorithm, and the same angle plus 180 Q ). The angle which gives the highest brightness in the expected position should be chosen.
- the method 200 including the steps of: providing 202 a test chart for the electronic image capture system under test.
- the test chart 1 10 as per the above embodiments includes background 12 and at least one series of n number of shapes provided on the background 12, each of the shapes having an area with a second colour, and each of the shapes having at least a first edge perpendicular to a second edge, wherein each of the n shapes in a series is provided on the background in an orientation that is rotated by an angle of (90/n) degrees of rotation relative to a successive shape in the series, and wherein n is at least 4.
- the method 200 further includes capturing 204 an image of the test chart 1 10 using the electronic image capture system; measuring 206 resolvable detail of the image by analysing the first and or the second edges of at least one of the shapes in the image; and determining 208 whether the resolvable detail exceeds a minimum operational value for the electronic image capture system.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2016901314 | 2016-04-08 | ||
AU2016901314A AU2016901314A0 (en) | 2016-04-08 | Method and test chart for testing operation of an image catpure system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017173500A1 true WO2017173500A1 (en) | 2017-10-12 |
Family
ID=60000542
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU2017/050305 WO2017173500A1 (en) | 2016-04-08 | 2017-04-07 | Method and test chart for testing operation of an image capture system |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2017173500A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115002450A (en) * | 2022-07-19 | 2022-09-02 | 立臻精密智造(昆山)有限公司 | Test card detection method and system |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120013760A1 (en) * | 2010-07-16 | 2012-01-19 | Stmicroelectronics (Research & Development) Limited | Characterization of image sensors |
US20130016222A1 (en) * | 2011-07-11 | 2013-01-17 | Qualcomm Incorporated | Automatic adaptive image sharpening |
-
2017
- 2017-04-07 WO PCT/AU2017/050305 patent/WO2017173500A1/en active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120013760A1 (en) * | 2010-07-16 | 2012-01-19 | Stmicroelectronics (Research & Development) Limited | Characterization of image sensors |
US20130016222A1 (en) * | 2011-07-11 | 2013-01-17 | Qualcomm Incorporated | Automatic adaptive image sharpening |
Non-Patent Citations (2)
Title |
---|
BOIANGIU, COSTIN-ANTON ET AL.: "Target validation and image calibration in scanning systems", PROCEEDINGS OF THE 1ST INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND PATTERN RECOGNITION (IPPR'13, 2013, Budapest, Hungary, XP055225443 * |
ZHANG, ZHENGYOU: "A flexible new technique for camera calibration", IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, vol. 22, no. 11, 2000, pages 1330 - 1334, XP055037019 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115002450A (en) * | 2022-07-19 | 2022-09-02 | 立臻精密智造(昆山)有限公司 | Test card detection method and system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2681303B1 (en) | Image capture and lighting apparatus | |
US9109194B2 (en) | Device for harvesting bacterial colony and method therefor | |
JP5997185B2 (en) | Method and software for analyzing microbial growth | |
US4975863A (en) | System and process for grain examination | |
KR101783836B1 (en) | Method for detecting microorganisms, device for detecting microorganisms and program | |
US7639862B2 (en) | Method and apparatus for quantifying pigment dispersion quality by paint drawdown | |
Paliwal et al. | Grain kernel identification using kernel signature | |
US10407708B2 (en) | Method and system for determining microorganism growth | |
US5817475A (en) | Automatic microbiological testing apparatus and method | |
WO2014167566A1 (en) | Apparatus for inspection and quality assurance of material samples | |
CN103257061B (en) | The preparation method of microscopic examination sample and the device for checking sample covering quality | |
JP2012080802A (en) | Method and device for fishing bacterial colony | |
CN111263817B (en) | Method and system for automated assessment of antibiotic susceptibility | |
US11009446B1 (en) | Plate reader observation methods and operation | |
WO2017173500A1 (en) | Method and test chart for testing operation of an image capture system | |
WO2017173501A1 (en) | Method and system for validating resolvable detail across a depth of field | |
CN107389511B (en) | Crop seed phenotype measuring method and portable device | |
Ramanathan et al. | Development of an Intelligent Robotized Machine Vision Automated System for Bacterial Growth Monitoring | |
Chatburn et al. | VAPI: low-cost, rapid automated visual inspection system for Petri plate analysis |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17778484 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17778484 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/02/2019) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17778484 Country of ref document: EP Kind code of ref document: A1 |