WO2019109184A1 - Système et procédé d'analyse d'un matériau chromogène - Google Patents

Système et procédé d'analyse d'un matériau chromogène Download PDF

Info

Publication number
WO2019109184A1
WO2019109184A1 PCT/CA2018/051557 CA2018051557W WO2019109184A1 WO 2019109184 A1 WO2019109184 A1 WO 2019109184A1 CA 2018051557 W CA2018051557 W CA 2018051557W WO 2019109184 A1 WO2019109184 A1 WO 2019109184A1
Authority
WO
WIPO (PCT)
Prior art keywords
chromogenic material
digital image
color
image
health condition
Prior art date
Application number
PCT/CA2018/051557
Other languages
English (en)
Inventor
Stéphane Chevigny
Olivier SIGOUIN
Bertrand GAUVREAU
Keven DUBÉ
Herimanitra RANAIVOSON
Original Assignee
9360-3561 Québec Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 9360-3561 Québec Inc. filed Critical 9360-3561 Québec Inc.
Publication of WO2019109184A1 publication Critical patent/WO2019109184A1/fr

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/75—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated
    • G01N21/77—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator
    • G01N21/78—Systems in which material is subjected to a chemical reaction, the progress or the result of the reaction being investigated by observing the effect on a chemical indicator producing a change of colour
    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K1/00—Housing animals; Equipment therefor
    • A01K1/01—Removal of dung or urine, e.g. from stables
    • A01K1/0107—Cat trays; Dog urinals; Toilets for pets
    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K29/00—Other apparatus for animal husbandry
    • A01K29/005—Monitoring or measuring activity, e.g. detecting heat or mating

Definitions

  • the present disclosure generally relates to a method and system for analysis of chromogenic material, and more particular relates to a method and system applying computer-implemented image processing to determine at least one color property of an image of the chromogenic material and to determine a presence of a suspected health condition.
  • Water-absorbent materials such as absorbent materials including polysaccharides can be employed in different fields.
  • water-absorbent materials can be used in pet litter, household articles, sealing materials, humectants for agricultural products for soil conditioning, oil-drilling, anti- condensation coatings, water-storing materials in agriculture/horticulture, absorbent paper products, bandages and surgical pads, disposable sanitary products (such as diapers, incontinence articles, feminine hygiene products, airlaids and absorbent dressings), wound dressings, or as chemical absorbents.
  • Water-absorbent materials can also be used as a support for diagnostic agents for humans or animals.
  • diagnostic agents incorporated into test strips, beads or particles, for detection purposes.
  • test strips consist of an absorbent carrier made from fibrous or non-woven material, in the simplest case filter paper, which is coated or impregnated with the detection reagents.
  • the detection reagents may include a chromogenic compound as an indicator, and a trigger compound to transform the chromogenic indicator into a chromogenically active compound in the presence of the compound to be detected.
  • feline urinary tract disease can be a serious condition for cats.
  • crystals of magnesium ammonium phosphate can precipitate in the cat's urinary tract and cause obstruction. If untreated, the obstruction can lead to intense pain and can often be fatal within days.
  • feline urinary tract disease symptoms such as bloody urine and urination discomfort and straining - cat owners often consult their veterinarian who may be able to provide treatments, which may be expensive.
  • many cats with feline urinary tract disease do not show any obvious symptoms, which is why this disease has been referred to as a“silent killer”.
  • diabetes Another example of a serious condition for cats is diabetes. Diabetes strikes about 1 in 400 cats and has become increasingly common. Symptoms of diabetes in cats are similar to those in humans, and about 80% to 95 % of diabetic cats experience something similar to type-2 diabetes in humans. Cats suffering of diabetes usually become severely insulin-dependent by the time symptoms are diagnosed. In cats suffering from type-2 diabetes, early treatment can sometimes lead to diabetic remission, in which the cat no longer needs injected insulin. If left untreated, the condition leads to increasingly weak cats, malnutrition, ketoacidosis and/or dehydration, and eventually death.
  • a computer-implemented method for analysis of chromogenic material comprises receiving at least one digital image of the chromogenic material; applying computer-implemented image processing to detect at least one region in the digital image corresponding to the chromogenic material; determining at least one color property within the at least one detected region; and determining a presence of a suspected health condition based on the at least one determined color property.
  • a computer-implemented system having at least one data storage device and at least one processor operably coupled to the at least one storage device.
  • the at least one processor is configured for receiving at least one digital image of the chromogenic material; applying computer-implemented image processing to detect at least one region in the digital image corresponding to the chromogenic material; determining at least one color property within the at least one detected region; and determining a presence of a suspected health condition based on the at least one determined color property.
  • a method for analyzing chromogenic material that is adapted to exhibit a color change when exposed to bodily excretion having a composition representative of a presence of a suspected health in a living subject, the chromogenic material being provided at a location susceptible to exposure to bodily excretion from the subject.
  • the method includes subsequent to the chromogenic material being exposed to the bodily excretion from the subject, capturing a digital image of the chromogenic material; and applying computer-implemented image processing to determine a presence of a suspected health condition in the subject based on color properties of the captured digital image.
  • Figure 1 illustrates a representation of an environment in which a method for analyzing chromogenic material is carried out according to one example embodiment
  • Figure 2 illustrates a schematic diagram of the operational modules of a chromogenic material analysis system according to one example embodiment
  • Figure 3A illustrates a first state of a user interface when implementing analysis of chromogenic material according to one exemplary embodiment
  • Figure 3B illustrates a second state of the user interface according to the exemplary embodiment
  • Figure 3C illustrates a third state of the user interface according to the exemplary embodiment
  • Figure 3D illustrates a fourth state of the user interface according to the exemplary embodiment
  • Figure 4A illustrates a fifth state of the user interface according to the exemplary embodiment
  • Figure 4B illustrates a sixth state of the user interface according to the exemplary embodiment
  • Figure 5 illustrates a flowchart of the operational steps of a method for analysis of chromogenic material according to an example embodiment
  • Figure 6 illustrates a flowchart of the operational steps of a method for carrying out simplified computer-implemented image processing of a digital image of chromogenic material to determine a presence of a suspected health condition in a living subject according to an example embodiment
  • Figure 7 illustrates a flowchart of the operational steps of a method for carrying out computer-implemented image processing of a digital image of chromogenic material to determine a presence of a suspected health condition in a subject according to an example embodiment
  • Figure 8 illustrates a flowchart of the operational steps of a method for carrying out computer-implemented image processing of a sequence of digital images of chromogenic material to determine a presence of a suspected health condition in a subject according to an example embodiment
  • Figure 9 illustrates a covered litter box having an integrated image capture device according to an example embodiment.
  • chromogenic material refers to a chromogenic water- absorbing material for detecting diseases or conditions, such as diseases or conditions related to the presence of blood in animal excretions, (e.g. urinary tract disease, hemorrhage or cancer) or diseases related to higher-than-normal levels of glucose in the animal excretions (e.g. diabetes).
  • diseases or conditions such as diseases or conditions related to the presence of blood in animal excretions, (e.g. urinary tract disease, hemorrhage or cancer) or diseases related to higher-than-normal levels of glucose in the animal excretions (e.g. diabetes).
  • the chromogenic material may be the material described according to various example embodiments in PCT application no. PCT/CA2016/051037, which is herein incorporated by reference in its entirety.
  • the chromogenic material can further be provided in the form of agglomerations, such as granules, disks, squares, or similar masses.
  • the granules may be suitable for use in combination with animal litter.
  • a granule for use with animal litter may consist essentially of the chromogenic material.
  • the granules can be formed of a mixture of the chromogenic material with other material used in animal litter.
  • the chromogenic material can be in the form of particles that are evenly distributed on a top surface of the animal litter or evenly distributed within the animal litter.
  • the chromogenic material can also be embedded within a finished article.
  • Such articles may be liquid absorbent, whereby the absorbed liquid contacts the chromogenic material to cause the color change therein.
  • the finished article may be a litter-training pad for puppies and small dogs (“puppy pad”), diapers, underwear for incontinence, incontinence pads.
  • the reaction in chromogenic material can be seen as a change in color on the surface of the finished article.
  • the chromogenic material can be material sold under the bliicareTM line of products, such as clumping litter and granules for litter, sold by IntersandTM.
  • the chromogenic material can also be, but not limited to, any one of the following commercially available products:
  • FIG. 1 therein illustrated is a representation of an environment in which a method for analyzing chromogenic material is carried out.
  • the chromogenic material Prior to the analyzing chromogenic material, the chromogenic material is provided at a location that is susceptible to exposure to bodily excretion from a living subject. As described elsewhere herein the chromogenic material is adapted to exhibit a color change when exposed to bodily excretion having a composition representative of a presence of a suspected health in the living subject.
  • the chromogenic material is placed at the, or within, litter used by that subject. Accordingly, the chromogenic material will come in contact with bodily excretion from the subject when the subject urinates onto the litter.
  • the providing of the chromogenic material at a location susceptible to exposure to bodily excretion from the subject represents a pre-analysis step that follows the typical use of suitable chromogenic material for detection of a presence of a suspected health in a living subject.
  • a digital image of the chromogenic material is captured.
  • the digital image can be captured by any suitable electronic device operable to generate a digital image of a scene, such as a digital camera, mobile telephone, smartphone, tablet, laptop, 2-in-1 laptop/tablet, virtual reality device, portable video game console, or a device for digitizing a printed image (ex: scanner).
  • a human user is operating a tablet to capture an image of chromogenic material in the form of granules provided in the litter.
  • the human user is capturing the image after the cat has completed urinating on the litter.
  • the human user is illustrated as capturing the image from a standing position. However it will be understood that the human user can take a different position, such a kneeling or crouched position, when capturing the image. This can allow the image capture device to be positioned closer to the chromogenic material when capturing an image of the scene.
  • the method for analysis of chromogenic material further comprises applying a computer-implemented image processing to determine a presence of a suspected health condition in the subject.
  • the image processing determines color properties of the captured digital image of the chromogenic material. In particular, color properties of regions of the captured digital image corresponding to the chromogenic material are determined.
  • the determination of the presence of the suspected health condition is carried out based on the color properties of the captured digital image.
  • One or more computer-implemented systems and methods operable to performed image processing to determine a presence of a suspected health condition described herein may be implemented in hardware or software, or a combination of both. However, preferably, these embodiments are implemented in computer programs executing on programmable computers, each comprising at least one processor, a data storage system (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
  • the programmable computer may be a programmable logic unit, a mainframe computer, server, and personal computer, cloud based program or system, laptop, personal data assistance, cellular telephone, smartphone, wearable device, tablet device, smart display devices (ex: Smart TVs), set-top box, video game console, portable video game devices, or virtual reality device.
  • Each program is preferably implemented in a high level procedural or object oriented programming and/or scripting language to communicate with a computer system.
  • the programs can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language.
  • Each such computer program is preferably stored on a storage media or a device readable by a general or special purpose programmable computer for configuring and operating the computer when the storage media or device is read by the computer to perform the procedures described herein.
  • the systems may be embedded within an operating system running on the programmable computer.
  • FIG. 2 therein illustrated is a schematic diagram of the operational modules of a chromogenic material analysis system 1 according to one example embodiment.
  • the chromogenic material analysis system 1 may be implemented in hardware or software of a combination of both.
  • Components of the system are herein presented as modules each being implementable in hardware or software or a combination of both.
  • the chromogenic material analysis system 1 includes an image processing module 8, a chromogenic material detection module 16, a color property detection module 24, a health condition determination module 32, an image review module 40, and an action selection module 48.
  • the chromogenic material analysis system 1 may be further in data communication with an image capture device 56 that is configured to capture representations of a scene as a digital image or a sequence of digital images.
  • the image capture device 56 includes a lens and an image sensor.
  • the image capture device 56 can also include capability to process the captured image before being outputted therefrom.
  • the image capture device 56 can be integrated within the chromogenic material analysis system 1.
  • the image capture device 56 can be the on board camera of a smartphone, tablet, laptop, portable video game console, personal data assistance or the like.
  • the image capture device 56 can be external to the chromogenic material analysis system 1.
  • the image capture device 56 can be another electronic device having a camera that transmits the captured digital image over a data transmission link to the chromogenic material analysis system 1.
  • a printed image can be digitized and then transmitted to the chromogenic material analysis system.
  • the chromogenic material having undergone color change appears within the captured one or more digital images as an image region having color properties that are different from the color in other regions surrounding that region.
  • the chromogenic material analysis system 1 may be further in data communication with an electronic display device 64 that is operable to display text and images viewable by a human user.
  • the chromogenic material analysis system 1 may be further in data communication with a communication module 72 that is operable for communicating data with an external device over any suitable data communications channel, such as the Internet.
  • the communication module 72 may be any module known in the art, such as a WI-FI adapter, LAN adapter, or adapter for cellular communications (ex: 3G, 4G, LTE, or the like).
  • the chromogenic material analysis system 1 can also be in data communication with a user interaction device 76.
  • the user interaction device 76 can be any device known in the art that allows a user to provide an input to the chromogenic material analysis system 1.
  • the user interaction device 76 may be any one of a keyboard, touchscreen, voice command, mouse, stylus pen, etc.
  • the chromogenic material analysis system 1 , the image capture device 56, the electronic display device 64, the communication module 72 and the user interaction device 76 can be implemented together within a single electronic user device.
  • the electronic user device is a portable device, such as a smartphone, tablet, laptop, portable video game console, personal data assistance or the like.
  • the chromogenic material analysis system 1 may be implemented as a mobile application or website being executed by the processor of the electronic user device.
  • the digital image captured can be a single digital image, or a sequence of digital images.
  • the sequence of digital images may be used for real-time display on the electronic display device 64 so that a user operating the image capture device can properly frame the scene being captured.
  • the real-time display on the electronic display device 64 can also be used to provide visual feedback of regions of interest corresponding to captured chromogenic material to be analyzed. It will be appreciated that real-time display of images to aid capture of a scene is commonly known as“live preview”.
  • the user operates the image capture device 56 in order to capture one or more digital images of chromogenic material found in a scene.
  • the image processing module 8 is configured to receive at least one digital image captured using the image capture device 56.
  • the image processing module 8 can apply standard photo editing techniques to the captured digital image. More particularly, the image processing module 8 can adjust the pixel values of the captured digital image so that the color represented by the pixel values sufficiently match the true color of the objects within the scene that is captured. It will be understood that in some embodiments, these photo editing techniques can be carried out within the image capture device or can be split between the image capture device and the image processing module 8 of the chromogenic material analysis system 1.
  • the chromogenic material detection module 16 is configured to detect at least one region of interest in the captured digital image that corresponds to the chromogenic material.
  • a captured scene can have a plurality of areas of chromogenic material.
  • the captured scene can be the animal litter and a plurality of granules of the chromogenic material located within the litter.
  • Each region of interest detected by the chromogenic material detection module 16 can correspond to one of the granules.
  • the captured scene can be the surface of the finished article having one or more spots exhibiting a color change from a reaction of the chromogenic material.
  • Each region of interest detected by the chromogenic material detection module 16 can correspond to one of the spots on the surface.
  • the chromogenic material detection module 16 can apply computer- implemented image processing techniques to detect the at least one region in the digital image corresponding to the chromogenic material. For example, the chromogenic material detection module 16 can apply blob detection in order to identify image regions that have color properties that are distinct from the color properties of surrounding areas. Other techniques, such as edge detection, can also be applied.
  • the chromogenic material detection module 16 can further filter the detected blobs based on their color properties to detect those regions of interest corresponding to the chromogenic material. It is known that the chromogenic material will exhibit a particular range of colors (ex: different shades of blue), and only detected blobs having color properties falling within this range of colors are further detected as regions of interest corresponding to the chromogenic material. [057]
  • the color property detection module 24 is configured to determine at least one color property for each of the at least one region of interest detected by the chromogenic material detection module 16.
  • the at least one color property for a given region of interest can be an average of the color values of the pixels of the capture image that make up the region of interest.
  • the average can be an arithmetic mean.
  • Alternative the at least one color property can simply be the color pixel value of individual pixels of the captured digital image.
  • the color property detection module 24 calculates the at least one color property in the HSV (Hue, saturation, value) color space. Accordingly, where the captured digital image of the chromogenic material is initially received in another color space (ex: RGB), a conversion to HSV may be carried out (ex: by the image processing module 8 or the color property detection module) prior to determining the at least one color property for each of the region of interest detected by the chromogenic material detection module 16.
  • the health condition determination module 32 is configured to determine a presence of a suspected health condition based on the at least one determined color property.
  • the at least one color property for a given region of interest consists of a color value for that region.
  • the color value may be a value calculated from the pixel values of the pixels in the region of interest.
  • at least one color threshold is predetermined, such as a particular shade of blue. Where the color value for the region exceeds the color threshold (ex: the determined color value is darker than the particular shade of blue), then it is determined that the region of interest indicates the presence of a suspected health condition.
  • a color range having an upper bound and a lower bound can be predetermined. For example, in the HSV color space, an upper bound and a lower bound can be determined for each of hue, saturation and value. Furthermore, the at least one color property for a given region of interest is a value expressed in the HSV color space. If each of the hue (H) value, saturation (S) value, and value (V) value falls within the range defined by the lower bound and the upper bound for each of H, S and V, then it is determined that the region of interest indicates the presence of a suspected health condition.
  • the color range corresponds to a range of colors that when present in the chromogenic material would be indicative of the presence of a suspected health condition.
  • a determination of the presence of a suspected health condition can be made for each region of interest detected by the chromogenic material detection module 16. As described elsewhere, the presence of a suspected health condition for one or more of the detected regions of interest can be displayed on the electronic display device 64 so that a user can make a decision as to whether further action is necessary. Additionally, or alternatively, a global determination of the presence of a suspected health condition can be made based on the number of regions of interest for which a positive presence of a suspected health condition was determined.
  • the detection of the regions of interest corresponding to chromogenic material within the captured scene the determination of the color property of the captured image and the determination of the presence of a health condition can be carried within a single step. Accordingly, each of a plurality of pixels of the captured image are compared with a predetermined color range.
  • the predetermined color range corresponds to a range of colors that when present in the chromogenic material would be indicative of the presence of a suspected health condition. This color range can also be defined in the HSV color spaced as described above.
  • the comparison of the pixel color values of pixels of the image with the predetermined color range generates a binary mask, wherein pixels of a first value correspond to those having color values falling outside the predetermined color range and pixels of a second value correspond to those having color values falling within the predetermined color range.
  • the binary mask constitutes the determined color properties of the captured digital image.
  • the presence of any pixels of the second value (pixels having values falling within the predetermined color range) provides an indication of the presence of a suspected health condition.
  • Groups of contiguous pixels having the second value correspond to regions of the digital image that correspond to the chromogenic material within the captured scene.
  • each image region surrounding an image pixel having a color value that falls within the predetermined color range is identified as a region of interest.
  • the detected regions of interest can be highlighted when providing a live preview.
  • the minimum size of a predefined shape (ex: a circle) that covers the entirety of that blob is determined.
  • This minimum size of each blob corresponds to a color property of the detected region of interest.
  • Blobs having a minimum coverage size that exceed a predetermined dimension threshold are determined as indicator zones that are indicative of a presence of a suspected health condition.
  • the predetermined dimension threshold can be a radius of 5 pixels. Blobs having a minimum coverage size that are less than this threshold are ignored (ex: these have high likelihood of being a false positive, such as pixels corresponding to shadow between two litter pellets). Blobs having a minimum coverage size that are greater than this predetermined dimension threshold are considered for determining a presence of the suspected health condition.
  • the determination of the presence of a suspected health condition is based on the at least one determined color property and at least one other property.
  • the other property can be a property defined by the user during a pre-configuration phase.
  • the user can select a type of chromogenic material (ex: agglomerations for animal litter, type of finished article), the species and breed of animal, age of animal, etc.
  • the color threshold or color range applied for making the determination of a presence of suspected health condition can be adjusted based on one or more of these defined properties. It will be appreciated that these properties defined by the user will typically remain unchanged across multiple instances of making the determination of the presence of a suspected health condition.
  • the at least one other property used in combination with the color property to make a determination of the presence of a suspected health condition can include a property that is defined on a per use basis. That is, this property can be different for each instance of the chromogenic material analysis and must be re- defined for each instance. As also described in PCT application no. PCT/CA2016/051037, it was observed that the color of the chromogenic material can change according to the amount of time it has absorbed a liquid, such as animal excretions. The other property that is re-defined on a per use basis can include an amount of time that the liquid has been absorbed into the chromogenic material.
  • a user interacting with the electronic chromogenic material analysis system 1 can interact with the user interaction device 76 to input the per-use property used for making the determination of the presence of suspected health condition.
  • the color threshold or color range applied for making the determination of a presence of suspected health condition can also be adjusted based on the property defined on the per use basis.
  • the health condition determination module 32 can be further configured to determine a type or degree of the suspected health condition.
  • the type or degree of the suspected health condition herein refers to categorizing the determination beyond a binary outcome of a presence of a suspected health condition or the non-presence of a suspected health condition.
  • the degree of the suspected health condition can be a level of severity of the suspected health condition.
  • the determination can provide the outcome of identifying the suspected presence of a specific disease (urinary tract disease, hemorrhage or cancer, higher-than normal levels of glucose).
  • a plurality of ranges of color values can be defined for the heath condition determination module 32.
  • a matrix of outcomes can be predefined.
  • the image review module 40 is configured to display the result of the determination of the presence of a suspected health condition for viewing by the user. More particularly, the image review module 40 generates a digital graphic that can be displayed on the electronic display device 64.
  • the image review module 40 generates a digital graphic that includes the received digital image that is used for making the determination of the presence of a suspected health condition.
  • the image review module 40 generates one or more first graphical elements that is overlaid within the received digital image.
  • First graphical elements may be overlaid at each region in the received digital image that was identified by the chromogenic material detection module 16 as corresponding to an area of chromogenic material within the captured scene.
  • the image review module 40 may further generate one or more second graphical elements overlaid within the received digital image.
  • the second graphical elements can visually indicate those regions of interest that have been determined as exhibiting a presence of a suspected health condition.
  • the digital graphic generated by the image review module 40 can be displayed on the electronic display device 64 for viewing by a user.
  • Action selection module 48 is configured to determine a recommended action in response to detecting the presence of a suspected condition.
  • the recommended action that is chosen is intended to address the presence of the suspected health condition.
  • Figure 3A illustrates an exemplary user interface 80 in a first state displayed on the electronic display device for implementing analysis of chromogenic material.
  • a user interacting with the electronic display device has not yet presented an image of chromogenic material for analysis. That is, a digital image of chromogenic material has not yet been received.
  • the first user interface 80 provides the user a first selectable option 82 of capturing an image using the image capture device 56 or a second selectable option 84 of selecting an already captured image to be uploaded.
  • An option 86 to change settings (ex: to define additional properties is also made available.
  • Figure 3B illustrates the user interface 80 in a second state displayed on the electronic display device for implementing analysis of chromogenic material.
  • An image of a pet litter is displayed in user interface 80 in the second state.
  • the image can be a still image that has just been captured using the image capture device 56 (ex: using the same device as the electronic display) or can be a still image that has been uploaded.
  • the screen capture shows one frame of the sequence of digital images for real-time display on the electronic display device (i.e. live preview).
  • one or more graphical elements in the form of highlighted regions 90 are overlaid on the displayed image of the chromogenic material.
  • the highlighted regions represent a pre-selection of to-be-analyzed regions. These regions can be selected by a user interacting with (ex: touching) the touchscreen device displaying the image of the chromogenic material. For example, the user touches regions of the image that correspond to the chromogenic material based on a visual inspection carried out by the user to make this pre-selection. This can also reduce the number of false positives that are detected and/or analyzed by the chromogenic material analysis system 1.
  • An interactive button 92 is further displayed.
  • the user can interactive with the interactive button 92 to cause the computer-implemented analysis of the chromogenic material captured in the image.
  • the pressing of the button 92 may indicate that the user has completed the pre-selection of to-be-analyzed regions. Additionally or alternatively, where the displayed image is a live preview, the pressing of the button 92 corresponds to the depressing of the shutter button of the image capture device and the instantaneous picture at the moment of the depressing is captured as the image for analysis.
  • the pre-selection of to-be-analyzed regions of the image of chromogenic material is received, such as by the chromogenic material analysis system.
  • the analysis of the chromogenic material that is carried out by the image processing module can then be limited to the pre-selection of to-be-analyzed regions.
  • the amount of image regions to be processed can be significantly reduced.
  • Figure 3C illustrates the user interface 80 in a third state displayed on the electronic display device for implementing analysis of chromogenic material.
  • the information of the user interface in the third state is displayed after computer- implemented image processing has been applied to detect one or more regions of the digital image corresponding to the chromogenic material and a presence of a suspected health condition has been determined.
  • Graphical elements 92 in the form of circles are overlaid on the displayed digital image of the chromogenic material and the litter. It will be appreciated that the circles 92 highlight areas of the digital image that contain chromogenic granules that are exhibit a color change after absorbing bodily excretions.
  • these areas of the digital image are ones that have a contiguous blob of pixels that have color values falling within the predetermined color range and that have dimensional properties (ex: minimum radius) that exceed the predetermined dimensional threshold. Accordingly, the graphical elements 92 highlight regions of the digital image that graphically indicate the presence of a suspected health condition.
  • a further textual message can be displayed to provide informational feedback to the user.
  • the message“Your pet may be sick. Please consult your veterinarian” is displayed.
  • Figure 3D illustrates the user interface 80 in a fourth state displayed on the electronic display device for implementing analysis of chromogenic material.
  • This user interface allows the user to enter information to identify the digital images that have been analyzed.
  • the digital images can be saved locally for review later.
  • the digital images may also be uploaded over a network to an external device, such as the cloud.
  • the digital images may be transmitted to a veterinarian for review.
  • the digital images may also be transmitted to a party carrying out research, such as on animal health.
  • Figure 4A illustrates the user interface 80 in a fifth state. It will be understood that the fifth state corresponds to another instance of analysis of chromogenic material.
  • Another image of a pet litter is displayed in the user interface 80.
  • Highlighted regions overlaid on the image display a pre-selection of to-be-analyzed regions (such as from user interacting with the touchscreen device displaying the digital image). It will be appreciated that the highlighted regions forming the pre- selection correspond to areas of the digital image containing chromogenic granules within the litter that have been exposed to bodily excretion from a pet.
  • Figure 4B illustrates the user interface 80 in a sixth state.
  • the information of the sixth state is displayed after computer-implemented image processing has been applied to detect one or more regions of the digital image of Figure 4A corresponding to chromogenic material.
  • the digital image does not contain any regions that have color properties and/or dimensional properties that would indicate the presence of suspected health conditions. Accordingly, the displayed digital image of chromogenic material does not have any graphical elements highlighting presence of suspected health condition.
  • Informational feedback in the form of a message “No anomalies detected. Your pet is healthy” is also displayed.
  • Figure 5 illustrates a flowchart of the operational steps of a method 150 for analysis of chromogenic material according to an example embodiment. As described elsewhere herein, the method 150 is carried out after providing the chromogenic material at a location susceptible to exposure to bodily excretion from a subject and after the chromogenic material has been exposed to the bodily excretion.
  • an image capture device is operated to capture a digital image of the chromogenic material.
  • a user can operate the image capture device 56 to direct it towards a scene having the chromogenic material.
  • the user can capture a digital image of animal litter having a plurality of granules of chromogenic material and in which an animal has made an excretion.
  • the computer-implemented image processing is applied to determine a presence of a suspected health condition in the subject based on color properties of the captured digital image.
  • Figure 6 illustrates a flowchart of the operational steps of a method 160 for carrying out a simplified computer-implemented image processing of a digital image of chromogenic material to determine a presence of a suspected health condition in the subject according to an example embodiment.
  • the method 160 may be performed at the electronic chromogenic material analysis system 1 as described herein.
  • At step 162 at least one digital image of chromogenic material is received.
  • the received captured image can further be processed at the image processing module 8, for example, to adjust the colors within the image.
  • each of a plurality of pixels of the captured image are compared with a predetermined color range. As described, elsewhere herein, the comparison generates a binary mask representing pixels having a color value falling with the predetermined color range and pixels having a color value falling outside the predetermined color range.
  • step 166 it is determined whether any pixels (or group of contiguous pixels) have color values falling within the predetermined color range. If such pixels are not found, which indicates a non-presence of a suspected health condition, the method proceeds to step 168 to display an indication of this non-presence on the electronic display device 64. For example, a textual message“no traces of blood detected”, or a similar message, can be displayed.
  • Figure 7 illustrates a flowchart of the operational steps of a method 200 for carrying out computer-implemented image processing of a digital image of chromogenic material to determine a presence of a suspected health condition in a subject according to an example embodiment.
  • the method 200 may be performed at the electronic chromogenic material analysis system 1 as described herein.
  • at step 204 at least one digital image of chromogenic material is received.
  • the received captured image can further be processed at the image processing module 8, for example, to adjust the colors within the image.
  • a pre-selection of to- be-analyzed regions can also be received.
  • a computer-implemented image processing is applied to detect at least one region of interest in the captured image corresponding to the chromogenic material.
  • the detection of the at least one region of interest can be carried out as described herein with reference to the chromogenic material detection module 16.
  • At step 212 at least one color property is determined for each of the at least one region of interest detected at step 208.
  • the determination of the at least one color property can be carried as described herein with reference to the color property detection module 24.
  • a determination is made as to whether there is an indication of the presence of a suspected health condition within that region of interest based on the at least one color property determined for that region at step 212.
  • the determination of the presence of a suspected health condition can be carried out in accordance with the description provided herein with reference to the health condition determination module 32.
  • step 220 it is determined whether a presence of suspected health condition was detected at step 216. If it is determined that there is a non-presence of a suspected health condition, the method 200 proceeds to step 224 to display an indication of this non-presence on the electronic display device 64. For example, a textual message“no traces of blood detected”, or a similar message, can be displayed.
  • step 220 if it is determined that there is a presence of a suspected health condition, the method proceeds to step 228 to display an indication of this presence of the suspected health condition on the electronic display device 64.
  • the displaying of this indication can be carried out in accordance with the description provided herein with reference to the image review module 40.
  • the method 200 may further include a step 232 of determining a recommended action in response to detecting the presence of a suspected health condition.
  • the recommended action that is chosen is intended to address the presence of the suspected health condition.
  • determining the recommended action includes recommending contacting an external service provider.
  • An option or user interface can be displayed on the electronic display device 64 to allow the user to contact the external service provider. For example, an interface can be presented to allow the user to make an appointment with the external service provider.
  • the external service provider can be any one of a veterinarian, food provider, supplement provider, medication provider, commerce offering accessories (ex: toys, pads, litters), animal care provider, insurers, researchers, etc.
  • the recommended action can be selected based on the suspected health condition. Accordingly, the recommended action is adapted to the suspected health condition. For example, the recommended action can determine a type of service provider adapted to provide the recommended action and a user interface can be presented to allow the user to contact that specific service provider. Alternatively, or additionally, the recommend action can determine a type of product (ex: supplement, food, accessory) to be consumed or used to address the health condition. A user interface can also be presented to allow the user to order the type of product from one or more retailers. [105] The determination of the recommended action can be carried out locally at the computing device implementing the chromogenic material analysis system 1. A plurality of recommended action options can be pre-stored within the chromogenic material analysis system as well as predefined conditions for selecting a recommended action based on the presence and/or type of suspected health condition.
  • step 232 can include uploading data information pertaining to the determination of the suspected health condition carried out at step 216 to an external device using the communication module 72.
  • the external device can be an external server or database.
  • the recommended action can be further determined at the external device and data information pertaining to the recommend action can be further received from the external device.
  • the determination of the recommended action at the external database can be made based on additional information for the user.
  • the external database can store information pertaining to the medical history of the user’s pet animal, such as a pre-existing health condition.
  • the recommended action can then be determined on the basis of the detected color property and information from the medical history. For example, it may be determined that the animal is at risk of re- lapse and the recommended action is chosen to address this risk.
  • the method 200 can further include uploading the digital image received at step 204 to an external party using the communication module 72.
  • the digital image can also be transmitted to that service provider. Accordingly, the external service provider can immediately receive the digital image and review it in order to make a further determination of the action to be offered.
  • the uploaded information can be encrypted to prevent theft of the sensitive information.
  • the uploaded digital image and any other information can be saved at the external service provider. Such information can be collected from a plurality of users to understand trends is use, which can be further used for targeted advertising, understanding development of future products. For example, this collected information can be used amongst veterinarians, researchers, developers of pet foods, developers of pet accessories and/or pet owners. Such information can be stored, shared and/or used to identify animals having a health condition or at risk of developing a health condition; and animals predisposed to a health condition. Collection, storage and treatment of the uploaded digital images of chromogenic material can be cloud-based.
  • FIG. 8 therein illustrated is a flowchart of the operational steps of a method 200’ for carrying out computer-implemented image processing of a sequence of images of chromogenic material to determine a presence of a suspected health condition in a subject according to an example embodiment.
  • a digital image in the sequence of the plurality of digital images of the chromogenic material is received.
  • a computer-implemented image processing is applied to attempt to detect at least one region of interest in the captured image received at step 204.
  • the image quality of the detected at least one region of interest is evaluated. More particularly, the image quality of the at least one region of interest is evaluated to determine whether it is sufficient to permit determining a presence of a suspected health condition. For example, where the chromogenic material is provided in the forms of granules to be used with animal litter, the size of the region of interest is evaluated to determine if they are sufficiently small or large.
  • One or more corrective actions can be further determined based on the image quality evaluation. The corrective actions correspond to suggestions or actions that the user using the image capture device 56 can carry out in order to improve the image quality to allow for better determination of the presence of a suspected health condition.
  • the corrective action determined at step 240 is displayed on the electronic display 64 to inform the user of the corrective action to be taken.
  • the corrective action to be taken may be displayed as a textual message, a graphical message (ex: an icon) or both.
  • the digital image received at step 204 can also be displayed, with the corrective action being overlaid over the displayed digital image.
  • step 248 it is determined whether a shutter-release button of the image capture device 56 has been depressed to capture a digital image.
  • the depressing of the shutter-release button of the image capture device 56 corresponds to the user making the selection of the current digital image within the sequence of the plurality of digital images as the digital image to be used for determining the presence of a suspected health condition.
  • the depressing of the shutter-release button also triggers an electronic indicator of the depressing, which electronic indicator can be received at the electronic chromogenic material analysis system 1 .
  • step 248 it is determined at step 248 whether the image quality evaluated at step 240 is sufficient to permit proper determination of the presence of a suspected health condition.
  • step 248 if a shutter-release button is not depressed or if the image quality evaluated at step 240 is insufficient, the method 200’ returns to step 204 to receive the next digital image in the sequence of digital images captured by the image capture device 56. Accordingly, it will be appreciated that steps 204, 208, 240, and 244 are repeated over time as new digital images are being captured.
  • the user can obtain a live preview of the scene being captured. This allows the user to adjust the capture of the scene in order to obtain a digital image that adequately allows for determination of the presence of a suspected health condition.
  • step 248 if a shutter-release button is depressed or if the image quality evaluated at step 240 is sufficient, the current digital image received within the current iteration of step 204 is selected as the digital image to be analyzed.
  • the method 200’ then proceeds to step 228, and optionally steps 232 and 236. It will be understood that steps 228, and optionally steps 232 and 236, are performed based on the current digital image in the same way as described herein with respect to method 200 of Figure 5.
  • the chromogenic material detection module 16, the color property detection module 24 and the health condition determination module 32 can be trained using machine learning. A large set of digital images of chromogenic material can be used to train these modules.
  • Each image of the set can be further identified prior to training as having a presence of a suspected health condition or having a non-presence of a suspected health condition.
  • the modules 16, 24, and 32 being trained using machine learning can be applied to analyse further captured digital images of chromogenic material and to determine whether the images show a presence of a suspected health condition. Accordingly, the detection of the presence of a suspected health condition from analysis of digital images of chromogenic material can be carried from application of artificial intelligence.
  • FIG. 9 therein illustrated is a perspective view of a covered litter box 300 having an integrated image capture device 304 according to an example embodiment.
  • the integrated image capture device 304 is installed on the inner surface of the cover member 308 of the covered litter box 300 and is oriented towards an upper surface of the litter tray 312.
  • a light can also be provided on the inner surface of the cover member 308 to illuminate the upper surface of the litter tray 312.
  • the integrated image capture device 304 is configured to intermittently capture an image of the litter in the litter tray 312, including any chromogenic material in the litter tray 312.
  • the integrated image capture device 304 further includes a communication module for transmitting digital images of the litter captured by the image capture device 304 to an external device.
  • the digital images can be transmitted over a standard transmission link such as Wi-Fi, cellular (3G, 4G, LTE, etc.) or the like.
  • the captured digital images can be received directly at a user device (ex: smartphone, tablet, laptop, desktop, video game console) from the image capture 304.
  • the user can then visualize the captured images.
  • Computer-implemented analysis of the chromogenic material according to various methods described herein can also be performed at the user device.
  • the captured digital images can be received at a remote server, such as a cloud-based server.
  • a remote server such as a cloud-based server.
  • Computer-implemented analysis of the chromogenic material according to various methods described herein can also be performed at the remote server. The user can then download the captured digital images and results of the analysis from the server.
  • the process of analyzing the color change in chromogenic material and making a determination as to the presence of a suspected health condition includes a certain degree of subjectivity for a human user.
  • Inexperienced consumers such as ones using chromogenic granules in animal litter to detect possible health condition in their animal pet, may feel uncomfortable to make such a judgment on their own.
  • the systems and methods described herein according to various example embodiments allow a user to use an automated and computer-implemented process in order to detect whether there is a presence of a suspected health condition.
  • the systems and methods provide a simple-to-use user experience while also eliminating the need for the human user to make a judgment call.

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Animal Husbandry (AREA)
  • Physics & Mathematics (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Plasma & Fusion (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Engineering & Computer Science (AREA)
  • Zoology (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

Un procédé et un système d'analyse de matériau chromogène comprennent la réception d'une image numérique de matériau chromogène, l'application d'un traitement d'image pour détecter au moins une région dans l'image numérique qui correspond au matériau chromogène, la détermination d'au moins une propriété de couleur à l'intérieur d'au moins une région détectée et la détermination d'une présence d'un état de santé suspecté sur la base d'au moins une propriété de couleur déterminée. Le matériau chromogène peut être des granules placés dans une litière pour animaux de compagnie de telle sorte qu'ils peuvent être exposés à des excrétions corporelles d'un animal de compagnie. Un procédé d'analyse d'un matériau chromogène consiste à fournir le matériau chromogène à un emplacement susceptible d'être exposé à une excrétion corporelle, à capturer une image numérique du matériau chromogène après exposition à l'excrétion corporelle et à appliquer un traitement d'image mis en œuvre par ordinateur pour déterminer une présence de l'état de santé suspecté sur la base de propriétés de couleur dans l'image numérique capturée.
PCT/CA2018/051557 2017-12-05 2018-12-05 Système et procédé d'analyse d'un matériau chromogène WO2019109184A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762594847P 2017-12-05 2017-12-05
US62/594,847 2017-12-05

Publications (1)

Publication Number Publication Date
WO2019109184A1 true WO2019109184A1 (fr) 2019-06-13

Family

ID=66750600

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2018/051557 WO2019109184A1 (fr) 2017-12-05 2018-12-05 Système et procédé d'analyse d'un matériau chromogène

Country Status (1)

Country Link
WO (1) WO2019109184A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102524375B1 (ko) * 2022-04-01 2023-04-21 (주)정보와생각 반려동물의 배설물 검사 시스템
CN116008289A (zh) * 2023-02-07 2023-04-25 浙江聚优非织造材料科技有限公司 一种非织造产品表面缺陷检测方法及系统
CN116008289B (zh) * 2023-02-07 2024-06-07 浙江聚优非织造材料科技有限公司 一种非织造产品表面缺陷检测方法及系统

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017165953A1 (fr) * 2016-04-01 2017-10-05 7905122 Canada Inc. Matériau absorbant l'eau et ses utilisations

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017165953A1 (fr) * 2016-04-01 2017-10-05 7905122 Canada Inc. Matériau absorbant l'eau et ses utilisations

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ANDREINI, P. ET AL.: "Automatic Image Analysis and Classification for Urinary Bacteria Infection Screening", INTERNATIONAL CONFERENCE ON IMAGE ANALYSIS AND PROCESSING (ICIAP 2015) , PART OF THE LECTURE NOTES IN COMPUTER SCIENCE BOOK SERIES, vol. 9279, 21 August 2015 (2015-08-21), pages 635 - 646, XP55615236 *
SANYAM, G. ET AL.: "Automated Colorimetric Analysis in Paper Based Sensors", 2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP, October 2014 (2014-10-01), pages 3607 - 3611, XP032967253, ISBN: 978-1-4799-5751-4 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102524375B1 (ko) * 2022-04-01 2023-04-21 (주)정보와생각 반려동물의 배설물 검사 시스템
CN116008289A (zh) * 2023-02-07 2023-04-25 浙江聚优非织造材料科技有限公司 一种非织造产品表面缺陷检测方法及系统
CN116008289B (zh) * 2023-02-07 2024-06-07 浙江聚优非织造材料科技有限公司 一种非织造产品表面缺陷检测方法及系统

Similar Documents

Publication Publication Date Title
Casey et al. Industrial food animal production and community health
Snyder et al. Use of patient-reported outcomes in clinical practice
EP3262396B1 (fr) Analyse de substance corporelle
Slager et al. Rhinitis associated with pesticide use among private pesticide applicators in the agricultural health study
Ngowi et al. Spatial clustering of porcine cysticercosis in Mbulu district, northern Tanzania
Buttlar et al. Dealing with the meat paradox: Threat leads to moral disengagement from meat consumption
Nema et al. A novel method for automated tracking and quantification of adult zebrafish behaviour during anxiety
CN104995500A (zh) 健康诊断系统和方法
CN101732057A (zh) 用于显示多能量数据的系统和方法
KR101977965B1 (ko) 애완 동물 관리 방법 및 애완 동물 관리 기능을 수행하는 사용자 단말기
CN105975981A (zh) 疫情监测方法及装置
WO2017115444A1 (fr) Système de surveillance de santé, procédé de surveillance de santé et programme de surveillance de santé
US9928586B2 (en) Devices and methods for determining menstrual blood loss
US20190212322A1 (en) Health monitoring system, health monitoring method, and health monitoring program
Kasradze et al. Rates and risk factors for human cutaneous anthrax in the country of Georgia: National surveillance data, 2008–2015
Galindo et al. Application of the hands-on donkey tool for assessing the welfare of working equids at Tuliman, Mexico
Rao et al. Small animal video tracking for activity and path analysis using a novel open-source multi-platform application (AnimApp)
JP2023501811A (ja) オブジェクトに対する観察情報の入力及び共有サービスを提供するための方法、及びコンピューターで判読可能な記録媒体
WO2019109184A1 (fr) Système et procédé d'analyse d'un matériau chromogène
Makinde et al. Opportunities for ACI in PLF: applying animal-and user-centred design to precision livestock farming
Ross et al. An evaluation of thermal imaging as a welfare monitoring tool for captive chimpanzees
Franco et al. Comparison of linear and non-linear decision boundaries to detect feedlot bloat using intensive data collection systems on Angus× Hereford steers
Vanhoudt et al. Broad-spectrum infrared thermography for detection of M2 digital dermatitis lesions on hind feet of standing dairy cattle
US20200279645A1 (en) Medical care support device, medical care support method, and medical care support program
van Schaik et al. The DECIDE project: from surveillance data to decision-support for farmers and veterinarians

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18885225

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18885225

Country of ref document: EP

Kind code of ref document: A1