CN116262035A - Jaundice detection device, image processing method thereof and storage medium - Google Patents

Jaundice detection device, image processing method thereof and storage medium Download PDF

Info

Publication number
CN116262035A
CN116262035A CN202111523026.0A CN202111523026A CN116262035A CN 116262035 A CN116262035 A CN 116262035A CN 202111523026 A CN202111523026 A CN 202111523026A CN 116262035 A CN116262035 A CN 116262035A
Authority
CN
China
Prior art keywords
color
image
light
jaundice
sclera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111523026.0A
Other languages
Chinese (zh)
Inventor
于钱
徐洪亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Minimally Invasive Digital Micro Medical Technology Co ltd
Original Assignee
Shanghai Minimally Invasive Digital Micro Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Minimally Invasive Digital Micro Medical Technology Co ltd filed Critical Shanghai Minimally Invasive Digital Micro Medical Technology Co ltd
Priority to CN202111523026.0A priority Critical patent/CN116262035A/en
Publication of CN116262035A publication Critical patent/CN116262035A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14Arrangements specially adapted for eye photography

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Pathology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Investigating Or Analysing Biological Materials (AREA)

Abstract

The invention provides a jaundice detection device, an image processing method thereof and a storage medium, wherein the jaundice detection device comprises a color correction module and a jaundice analysis module, the color correction module comprises a color correction card and a support assembly, the device is simple, the eyelid is conveniently opened and color calibration is provided through the color correction card with the support assembly, then the comparison analysis can be carried out on color blocks and sclera images in images shot by a camera to obtain a jaundice detection result, laboratory equipment is not required, blood drawing is not required, pain is not required, wound and infection risks are avoided, the device can be conveniently used by families and hospitals, and the detection cost is reduced. According to the invention, bilirubin level is estimated through the image of the sclera of the eye, and the problem that the jaundice detection result is inaccurate or inconsistent due to different complexion of a user can be avoided. And when using the camera to shoot, can carry out illumination light filling according to ambient light, strengthen jaundice detection accuracy, avoid because external light difference leads to the testing result deviation.

Description

Jaundice detection device, image processing method thereof and storage medium
Technical Field
The invention relates to the technical field of medical equipment, in particular to a jaundice detection device, an image processing method thereof and a storage medium.
Background
Jaundice is a common symptom and sign that occurs due to elevated serum bilirubin levels caused by bilirubin metabolic disorders, clinically manifested as yellow coloration of the sclera (one of the major components of the eye wall), mucous membranes (e.g., mucous membranes in the posterior portion of the soft palate, mucous membranes of the hard palate, etc.), skin and other tissues. The accurate detection of jaundice index (namely bilirubin level) can timely adjust the intervention or treatment scheme, and has important reference significance for diagnosing and treating illness and shortening the course of treatment.
The existing jaundice detection methods generally include the following methods:
(1) Laboratory examinations at hospitals were used to diagnose jaundice index. The method requires blood drawing, has wound and infection risk, and has pain;
(2) The percutaneous jaundice detector detects a jaundice index. The method requires the use of specialized equipment, which is expensive, and is difficult to use in a home only in a hospital or a specific institution.
(3) The jaundice index is detected (or predicted) using smartphone application software to take a picture of the chest. According to the method, only the chest is photographed, the color temperature difference of an external light source and the skin color difference of a measurement part can cause larger deviation of a measurement result, the detection result is inaccurate, and the consistency of the detection result is poor.
Disclosure of Invention
An object of the present invention is to provide a jaundice detection device, which can avoid blood drawing during jaundice detection, reduce detection cost, and improve detection convenience and accuracy of detection results.
Another object of the present invention is to provide an image processing method and a storage medium for a jaundice detection apparatus, which can improve the accuracy of the detection result.
In order to achieve the above object, the present invention provides a jaundice detection device, comprising:
the color correction module comprises a color correction card and a supporting component for supporting eyelids and separating upper and lower eyelids, wherein the color correction card is provided with a through hole for exposing sclera of an eye, a plurality of different color blocks are arranged on the front surface of the color correction card along the periphery of the through hole, and the supporting component is arranged on the back surface of the color correction card and is arranged on the periphery of the through hole;
the jaundice analysis module comprises a camera and an image analysis module, wherein the camera is used for shooting color blocks on the color correction card and the sclera of the eye in the through hole into an image, and the image analysis module is used for analyzing and comparing colors of the color blocks and the sclera of the eye in the corresponding image shot by the camera so as to obtain corresponding bilirubin level.
Optionally, the color patches on the color chart include at least gray color patches, magenta color patches and cyan color patches.
Optionally, the supporting component comprises at least two supporting legs, wherein the two supporting legs are symmetrically distributed on two sides of the through hole.
Alternatively, among all the support legs, the support leg for supporting the lower eyelid is longer than the support leg for supporting the upper eyelid.
Optionally, the jaundice analysis module further includes an illumination light supplementing module, where the illumination light supplementing module is configured to illuminate and supplement light to a photographed area according to an ambient light condition in the process of photographing an image by the camera.
Optionally, the illumination light filling module includes at least one LED light filling lamp, the illumination light filling module is used for in the in-process of camera shooting image, according to the condition of ambient light, control LED light filling lamp's switch and luminance, throw light on and the light filling to the region of being shot.
Optionally, the illumination light supplementing module comprises a display screen, and the display screen is used for displaying a background picture with corresponding colors and pure colors without patterns, and illuminating and supplementing light to a photographed area.
Optionally, the image processing module is further configured to determine whether each image captured by the camera meets a detection requirement, and further perform color correction on the image meeting the detection requirement, so as to analyze and compare the color of the color block and the color of the sclera of the eye in the image after the color correction.
Optionally, the image analysis module is disposed locally or on a cloud server.
Based on the same inventive concept, the invention also provides an image processing method of the jaundice detection device, which comprises the following steps:
illuminating and supplementing light to a shot area according to the condition of ambient light;
performing image shooting on each color block on the color correction card in the shot area after light filling and the sclera exposed by the through hole to obtain at least one image containing the color block and the sclera;
and carrying out image processing on the corresponding image obtained by shooting, and analyzing and comparing the color of the color block and the color of the sclera in the corresponding image after the image processing.
Optionally, the step of illuminating and supplementing light to the photographed area according to the condition of the ambient light includes: according to the condition of ambient light, controlling the on-off and brightness of LED light supplementing lamps around the shot area to illuminate and supplement light to the shot area; and/or displaying background pictures with different colors and pure colors and no patterns according to the condition of the ambient light so as to illuminate and supplement light to the shot area.
Optionally, when the shot area is illuminated and supplemented by displaying background images with different colors and pure colors and no patterns according to the condition of ambient light, the shot area after supplementing light for the different background images is shot to obtain a plurality of images which are illuminated by the different background images and contain color blocks and sclera;
and the steps of carrying out image processing on the corresponding image obtained by shooting and analyzing and comparing the color of the color block and the color of the sclera in the corresponding image after the image processing comprise the following steps: respectively carrying out color correction and analysis on the photographed images under the illumination of the plurality of different background pictures, selecting an optimal image after the color correction from the images as a corresponding image after the image processing, and further carrying out analysis and comparison on the color of the color block and the color of the sclera in the optimal image; or fusing and enhancing the photographed images under the illumination of the plurality of different background pictures to obtain enhanced images serving as corresponding images after the image processing, and further analyzing and comparing the color of the color block and the color of the sclera in the enhanced images.
Optionally, when capturing a plurality of images including color patches and sclera, determining whether each captured image meets a detection requirement, so as to select an image meeting the detection requirement from the captured images, and then performing image processing on at least one of the images meeting the detection requirement, so as to obtain a corresponding image after the image processing.
Based on the same inventive concept, the present invention also provides a storage medium having stored thereon a computer program for implementing the image processing method of the jaundice detection device of the present invention when executed by a processor.
Compared with the prior art, the technical scheme of the invention has at least one of the following beneficial effects:
1. the jaundice detection device comprises the color correction module and the jaundice analysis module, wherein the color correction module comprises the color correction card and the supporting component, the device is simple, the use of families and hospitals is convenient, and the detection cost is reduced.
2. The color correction card with the support component is used for conveniently opening the eyelid and providing color correction, and then color blocks and sclera images in images shot by the camera can be compared and analyzed to obtain a jaundice detection result, laboratory equipment is not required, blood drawing is not required, pain is avoided, and the jaundice detection device is free from wound and infection risk.
3. Bilirubin level is estimated through images of the sclera of eyes, and the problem that the jaundice detection result is inaccurate or inconsistent due to different complexion of a user is avoided.
4. When image shooting is carried out, illumination light supplementing can be carried out according to ambient light, jaundice detection accuracy is enhanced, and detection result deviation caused by external light difference is avoided.
Drawings
Fig. 1 is a schematic diagram illustrating an exemplary composition of a jaundice detection apparatus according to an embodiment of the present invention.
Fig. 2 is a schematic front view of another example of a color correction module in a jaundice detection apparatus according to an embodiment of the present invention.
Fig. 3 is a schematic top view of a color correction module in the jaundice detection apparatus shown in fig. 2.
Fig. 4 is a schematic diagram of a front view structure of a color correction module of the jaundice detection device shown in fig. 2 in a use process.
Fig. 5 is a schematic top view of a color correction module of the jaundice detection device shown in fig. 2 in a use process.
Fig. 6 is a schematic top view of a color correction module in a jaundice detection apparatus according to another embodiment of the invention.
Wherein reference numerals in the various figures are specifically as follows:
10-a color correction module; 101-a color correction card; 101 a-101 g-color lump; 1011-through holes; 102. 1021, 1022, 1023, 103, 1031, 1032, 1033-support legs; 102a, 103 a-the end of the support leg (i.e., the end of the support leg against the eyelid); 20-eyes; 201-lower eyelid; 202-upper eyelid; 203-sclera; θ—angle before use; θ' -angle after use.
Detailed Description
The technical scheme provided by the invention is further described in detail below with reference to the attached drawings and specific embodiments. The advantages and features of the present invention will become more apparent from the following description. It should be noted that the drawings are in a very simplified form and are all to a non-precise scale, merely for convenience and clarity in aiding in the description of embodiments of the invention. The term "and/or" is used herein in the sense of either or both.
Referring to fig. 1, an embodiment of the present invention provides a jaundice detection device, which includes a color correction module 10 and a jaundice analysis module 11.
The color correction module 10 includes a color correction card 101 and a supporting component for supporting the eyelids and separating the upper and lower eyelids, wherein a through hole 1011 for exposing the sclera of the eye (as shown in 203 in fig. 4 and 5, which may be simply referred to as sclera) is provided on the color correction card 101, a plurality of different color patches are disposed on the front surface of the color correction card 101 at the periphery of the through hole 1011, and the supporting component is disposed on the back surface of the color correction card 101 and at the periphery of the through hole 1011.
The shape of the color chart 101 may be any suitable shape, for example, a polygon such as a square, pentagon, hexagon or octagon, or an ellipse or a circle. The shape and size of the through-hole 1011 may be designed so as to satisfy the following conditions: (1) The camera in the jaundice analysis module 11 can be enabled to shoot the sclera of most people; (2) The area of each color block can be made large enough for subsequent color contrast analysis.
All color patches arranged on the color correction card 101 can be uniformly distributed around the through holes or unevenly distributed, and the color patches at least comprise 50% gray color patches, blue-green color patches and magenta color patches. Preferably, the color patches provided on the color chart 101 may further be provided with a yellow color patch, a black color patch, a white color patch, and at least one color patch other than the cyan color patch and the magenta color patch, so as to facilitate improvement of accuracy of the jaundice detection result, wherein each color patch may be selected from one of a blue color patch, a red color patch, a green color patch, a cyan color patch, an orange color patch, and a pink color patch.
In this embodiment, 8 color blocks 101a to 101g of different colors are uniformly disposed around the through hole 1011 on the front surface of the color correction card 101, and the shape and area of each of the 8 color blocks 101a to 101g are the same, and one of the 8 color blocks 101a to 101g is 50% gray, three of a blue-green color block and a magenta color block, and one of the three color blocks is black, one of the three color blocks is white, one of the three color blocks is yellow, and one of the three color blocks is orange.
In addition, in the present embodiment, the colors of any two color patches on the color chart 101 are different, but in other embodiments of the present invention, the colors of at least two color patches on the color chart 101 may be the same.
In this embodiment, two support legs 102 and 103 are disposed on the back surface of the color chart 101, the two support legs 102 and 103 are main parts of the support assembly, in a natural state (i.e. when not in use), an included angle θ between each support leg 102 and 103 and the back surface of the color chart 101 may be 90 degrees (i.e. the support legs 102 and 103 are perpendicular to the back surface of the color chart 101 as shown in fig. 1), an obtuse angle greater than 90 degrees (i.e. as shown in fig. 2) may also be provided, and the length of the support leg 102 is shorter than the length of the support leg 103, the support leg 102 is used for supporting the upper eyelid (as shown in fig. 4) of the eyelid 20, and the support leg 103 is used for supporting the lower eyelid (as shown in fig. 4) of the eyelid 20. The support ends 102a of the support legs 102 (i.e., the ends of the support legs 102 against the upper eyelid) and the support ends 103a of the support legs 103 (i.e., the ends of the support legs 103 against the lower eyelid) are smooth and have outwardly spaced apart heel brace structures to avoid damage to the eyelid.
The thickness of the support legs 102, 103 gives the whole color correction module 10 a certain rigidity and flexibility, which rigidity is expressed in that: in the process of shooting by the camera of the jaundice analysis module 11, the supporting legs 102 and 103 can firmly support the upper eyelid and the lower eyelid and cannot be broken, so that the sclera with more area is exposed; the flexibility is embodied in: the support legs 102, 103 can be relatively close together during the support of the support legs 102, 103 against the eyelid and can be counterbalanced with the positional restoring force and the pressure of the eyelid after support against the eyelid to achieve force balance.
The support legs 102 and 103 may be connected to the color chart 101 by an integrally formed fixed connection, a fixed connection by welding or bonding, or a damping connection with compressible and recoverable ability by a spring member or the like, so as to be able to open the eyelid and maintain the position of opening the eyelid.
In other embodiments of the present invention, the connection between the support legs 102, 103 and the color chart 101 may also be detachable, so as to replace the color chart 101 with other color patches, thereby realizing more accurate jaundice detection.
The color patches on the color chart 101 may be formed by applying corresponding pigments to the corresponding areas on the front surface of the color chart 101, or by attaching corresponding color patches to the corresponding areas on the front surface of the color chart 101.
In other embodiments of the present invention, referring to fig. 6, a greater number of support legs may be disposed on the back of the color chart 101, and the support legs are distributed on opposite sides of the through hole 1011 and disposed corresponding to the upper eyelid and the lower eyelid of the user's eye, so as to improve the stability of the color chart 10 during use. For example, three support legs 1021, 1022, 1023 for supporting the upper eyelid are provided on one side of the through-hole 1011, and three support legs 1031, 1032, 1033 for supporting the lower eyelid are provided on the other side of the through-hole 1011.
It should be understood that the color chart 101 may be a component integrally formed with all of the support legs, or the color chart 101 may be a component separately fabricated with respect to all of the support legs. Also, when the color chart 101 is a separately fabricated component with respect to all of the support legs, the ends of all of the support legs for connecting the color chart 101 may be integrally connected to each other so that all of the support legs form an integral support frame component, or any two of the support legs are separated from each other so that each of the support legs is a separate component.
With continued reference to fig. 1, in the present embodiment, the jaundice analysis module 11 includes a camera 111 and an image analysis module 112. The color blocks 101a to 101g on the front surface of the color chart 101 and the eye sclera exposed by the through hole 1011 can be simultaneously taken into the field of view of the camera 111, so that the camera 111 can be used for shooting one image from the front surface of the color chart 101 to the color blocks 101a to 101g on the color chart 101 and the eye sclera in the through hole 1011. The image analysis module 112 is configured to analyze and compare color blocks in the corresponding images captured by the camera 111 and colors of the sclera of the eye to obtain corresponding bilirubin levels, thereby completing jaundice detection.
In this embodiment, the jaundice analysis module 11 further includes an illumination light-compensating module 113, where the illumination light-compensating module 113 is configured to illuminate and compensate light of the photographed area (i.e. the through hole 1011 and the color blocks 101 a-101 g) of the color chart 101 according to the condition of ambient light in the process of photographing the image by the camera 111.
Optionally, the illumination light-compensating module 113 includes at least one LED light-compensating lamp (not shown), and during the process of capturing an image by the camera 111, the on-off and brightness of each LED light-compensating lamp are controlled according to the condition of ambient light, so as to illuminate and compensate light in the captured area. Alternatively, the illumination and light-compensating module 113 includes a display screen (not shown), which displays a background screen with a corresponding color and a pure color without patterns according to the condition of ambient light during the process of capturing an image by the camera 111, so as to illuminate and compensate light in the captured area.
In other embodiments of the present invention, the illumination and light-compensating module 113 may also have a display screen and at least one LED light-compensating lamp at the same time, so that the display screen may be selected to illuminate and compensate for the photographed area, the LED light-compensating lamp may be selected to illuminate and compensate for the photographed area, or the display screen and the LED light-compensating lamp may be selected to illuminate and compensate for the photographed area at the same time.
The image processing module 112 may have a jaundice detection application (i.e., a computer program) loaded thereon, so as to implement functions such as image quality determination, color correction, and comparison analysis.
In this embodiment, the image processing module 112 may be configured to determine whether each image captured by the camera 111 meets the detection requirement, and further perform color correction on the image meeting the detection requirement, so as to analyze and compare the color of the color block in the color corrected image with the color of the sclera of the eye, thereby obtaining the jaundice detection result.
In another embodiment of the present invention, when the illumination light compensating module 113 has a display screen, the illumination light compensating module 113 is configured to control the display screen to display background pictures with different colors and pure colors without patterns according to the condition of ambient light in the process of capturing images by the camera 111, so that the camera 111 captures images under illumination of a plurality of different background pictures. The image processing module 111 is configured to correct and analyze the images under the illumination of the plurality of different background pictures, and select an optimal corrected image from the images, so as to analyze and compare the color of the color block in the optimal image and the color of the sclera of the eye, thereby obtaining a jaundice detection result.
In another embodiment of the present invention, when the illumination light-compensating module 113 has a display screen, the image processing module 112 is configured to fuse and enhance images of the plurality of images of different background images captured by the camera 111, obtain an enhanced image (not shown), and further analyze and compare color blocks in the enhanced image with colors of sclera of eyes, thereby obtaining a jaundice detection result.
In this embodiment, the image analysis module 111 may be locally disposed or may be disposed on a cloud server. When the image analysis module 111 is disposed on the cloud server, each image captured by the camera 111 is uploaded to the cloud server, and then the cloud server analyzes and evaluates the images to obtain a jaundice detection result and returns the jaundice detection result to the local for the user (including the patient and/or doctor) to view.
The jaundice detection module 11 is integrated into a portable mobile device with a small size and convenient portability, and when the image analysis module 111 is disposed on the cloud server, the jaundice detection module 11 further needs to include a network communication module that is disposed locally and can communicate with the cloud server, so that a user can use the device conveniently, and the jaundice detection module 11 is formed by, for example, adopting front and rear cameras of the portable mobile device such as a smart phone and a PAD.
In addition, the jaundice detection module 11 may be designed as a new stand-alone medical device, or may be integrated into an existing portable mobile device such as a mobile phone, smart band, smart eye, blood glucose meter, oximeter, electronic blood pressure agent, etc.
The following results are shown in fig. 4 to 5, and take the example that the color correction module 10 has two support legs 102 and 103 as an example, to describe in detail the image acquisition and analysis process for implementing jaundice detection by the jaundice detection device of the present embodiment, specifically as follows:
firstly, the color chart 101 of the color chart 11 is placed in front of eyes of a user, the front surface of the color chart 101 faces the camera 111 of the jaundice detection module 11, the supporting end 102a of the short supporting leg 102 on the back surface of the color chart 101 is propped against the upper eyelid 202 of the eye 20, the supporting end 103a of the long supporting leg 103 on the back surface of the color chart 101 is propped against the lower eyelid 201 of the eye 20, the color chart 101 is slightly pressed, the supporting legs 102 and 103 deform, the upper eyelid 202 and the lower eyelid 201 of the eye 20 are propped up to a proper position, at this time, the included angle θ' between the supporting leg 102 or 103 and the back surface of the color chart 101 can be smaller or larger than the corresponding included angle θ before the use of the color chart 11, and the through hole 1011 of the color chart 101 exposes the sclera 203 of the eye 20. And at this time, the sclera 203 and the respective color patches 101 a-101 g on the front side of the color chart 101 are simultaneously brought into view of the camera 111 in the jaundice analysis assembly 11. Thereby determining a photographed region.
Then, the camera 111 of the jaundice analysis module 11 photographs the color patches 101a to 101g on the front surface of the color chart 101 in the visual field and the sclera 203 exposed through the through-hole 1011, thereby obtaining a corresponding image. And in each shooting process of the camera 111, the illumination light-compensating module 113 can be controlled to illuminate and compensate light to the shot area according to the condition of ambient light, so as to ensure the quality of the shot image. When the illumination light-compensating module 113 is an LED light-compensating lamp, the on-off and brightness of the LED light-compensating lamp can be controlled according to the ambient light conditions during the shooting process of the camera 111, so that the shot area has enough illuminance to ensure the quality of the shot image. When the illumination light-compensating module 113 is a display screen, in the shooting process of the camera 111, the purpose of illumination light compensation is achieved by displaying a pure-color non-pattern background on the display screen, and simultaneously, the purpose of illumination light compensation can be achieved by displaying pure-color non-image background pictures with different colors on the display screen in a time-sharing manner, so that the shot areas are respectively shot based on the background pictures with different colors, and a plurality of images with different color resolutions are obtained.
After the camera 111 finishes shooting, the jaundice detection application program in the image analysis module 112 first judges whether each image shot by the camera 111 meets the detection requirement, and an internal algorithm of the jaundice detection application program further performs color correction on the image meeting the detection requirement, and compares and analyzes colors of color blocks and sclera in the image after the color correction, so as to obtain (or evaluate) a corresponding bilirubin level, namely, a jaundice detection result is obtained.
Finally, the jaundice detection result can be fed back to the user in a display screen, a paper report or voice broadcasting mode and the like.
Of course, in other embodiments of the present invention, when the image processing film 112 is disposed on the cloud server, each image captured by the camera 111 may be uploaded to the cloud server, and then the image processing film 112 of the cloud server performs similar image processing and comparison analysis, and obtains a corresponding jaundice detection result, and further returns the obtained jaundice detection result to the local and timely feeds back to the user.
In addition, when the illumination light-compensating module 113 has a display screen and the camera shoots the shot region based on the solid-color non-image background images with different colors displayed on the display screen in a time-sharing manner, so as to obtain multiple images with different color resolutions, the local or cloud image processing module 112 may perform one-to-one color correction on each of the multiple images with different color resolutions, select an optimal image from the multiple images with different color resolutions, and further perform comparison and analysis on the color of the color block and the sclera in the optimal image to obtain a corresponding bilirubin level (i.e. obtain a jaundice detection result), or the local or cloud image processing module 112 may perform fusion and image enhancement on the multiple images with different color resolutions according to the color of the background image in the multiple images with different color resolutions, so as to obtain an enhanced image (i.e. multiple original images are synthesized into one enhanced image), and further perform comparison and analysis on the color block and the color of the sclera in the enhanced image to obtain a corresponding bilirubin level (i.e. obtain a jaundice detection result).
It should be understood that the supporting component in the above embodiments is described by taking a mechanism with a plurality of supporting legs as an example, but the technical solution of the present invention is not limited thereto, and the supporting component may be a hollow truncated cone-shaped structure, as long as the supporting component can support the color chart and separate the upper eyelid and the lower eyelid, so that the shot area includes each color lump on the color chart and the sclera exposed by the through hole of the color chart.
In summary, the jaundice detection device provided by the invention has a simple structure, does not need laboratory equipment, does not need blood drawing, has no pain, no wound or infection risk, can be conveniently used by families and hospitals, can reduce the cost of jaundice detection, evaluates bilirubin level through images of the sclera of eyes, and can also avoid the problem that the jaundice detection result is inaccurate or inconsistent due to different complexion of users. Further, when using the camera to shoot, can carry out illumination light filling according to ambient light, strengthen jaundice detection accuracy, avoid because external light difference leads to the testing result deviation.
In addition, based on the above-mentioned jaundice detection process, an embodiment of the present invention further provides an image processing method of a jaundice detection device, where the jaundice detection device is preferably, but not limited to, the jaundice detection device of the present invention.
The image processing method of the jaundice detection device of the present embodiment is implemented after determining a photographed area, where the photographed area includes each color lump on the color chart and a sclera exposed by a through hole of the color chart, and the method can be implemented by supporting the color chart by a supporting component and separating an upper eyelid and a lower eyelid. Specifically, the image processing method of the present embodiment includes the steps of:
firstly, illuminating and supplementing light to a shot area according to the condition of ambient light;
then, image shooting is carried out on each color lump on the color correction card in the shot area after light filling and the sclera exposed by the through hole so as to obtain at least one image containing the color lump and the sclera;
then, image processing is carried out on the corresponding image obtained by shooting, and analysis and comparison are carried out on the color blocks and the color of the sclera in the corresponding image after image processing.
Optionally, the step of illuminating and supplementing the photographed area according to the ambient light may include: according to the condition of ambient light, controlling the on-off and brightness of LED light supplementing lamps around the shot area to illuminate and supplement light to the shot area; and/or displaying background pictures with different colors and pure colors and no patterns according to the condition of the ambient light so as to illuminate and supplement light to the shot area.
When the shot area is illuminated and supplemented by the illumination according to the condition of the ambient light, the shot area after the light supplement of the different background images is imaged to obtain a plurality of images which are illuminated by the different background images and contain color blocks and sclera. Thus, the steps of performing image processing on the corresponding image obtained by shooting, and performing analysis and comparison on the color of the color block and the sclera in the corresponding image after the image processing may further include: respectively carrying out color correction and analysis on a plurality of images under the illumination of different background pictures, selecting an optimal image after the color correction from the images as a corresponding image after the image processing, and further carrying out analysis and comparison on the color of a color block and the color of a sclera in the optimal image; or fusing and enhancing the photographed images under the illumination of a plurality of different background pictures to obtain enhanced images serving as corresponding images after image processing, and further analyzing and comparing the color of the color block and the color of the sclera in the enhanced images.
Optionally, in the image processing method, when a plurality of images including color patches and sclera are obtained by shooting, it is first determined whether each of the shot images meets a detection requirement to select an image meeting the detection requirement therefrom, and then at least one of the selected images meeting the detection requirement is subjected to image processing to obtain a corresponding image after the image processing.
Based on the same inventive concept, an embodiment of the present invention further provides a storage medium, on which a computer program (which may be an instruction, an algorithm, or an encoding program, etc.) is stored, where the computer program, when executed by a processor, is configured to implement the image processing method of the jaundice detection apparatus according to the present invention. The storage medium may be any medium capable of containing, storing, transmitting, propagating or transmitting the computer program. For example, the storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium, specific examples of which include a magnetic storage device such as a magnetic tape or hard disk (HDD); optical storage devices such as Compact Discs (CDROM); a memory, such as a Random Access Memory (RAM) or a flash memory; and/or wired, wireless communication links.
In summary, the image processing method and the corresponding storage medium of the jaundice detection device of the present invention can perform illumination and light supplement according to ambient light during image capturing, perform image processing on the captured image, and compare and analyze color patches and sclera images in the corresponding image after image processing, thereby enhancing the jaundice detection accuracy and avoiding deviation of detection results due to external light difference. And the bilirubin level is estimated through the image of the sclera, so that the problem that the jaundice detection result is inaccurate or inconsistent due to different skin colors of users can be avoided.
The foregoing description is only illustrative of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention in any way, and any alterations and modifications made by those skilled in the art in light of the above disclosure shall fall within the scope of the present invention.

Claims (14)

1. A jaundice detection device, comprising:
the color correction module comprises a color correction card and a supporting component for supporting eyelids and separating upper and lower eyelids, wherein the color correction card is provided with a through hole for exposing sclera of an eye, a plurality of different color blocks are arranged on the front surface of the color correction card along the periphery of the through hole, and the supporting component is arranged on the back surface of the color correction card and is arranged on the periphery of the through hole;
the jaundice analysis module comprises a camera and an image analysis module, wherein the camera is used for shooting color blocks on the color correction card and the sclera of the eye in the through hole into an image, and the image analysis module is used for analyzing and comparing colors of the color blocks and the sclera of the eye in the corresponding image shot by the camera so as to obtain corresponding bilirubin level.
2. The jaundice detection apparatus of claim 1, wherein the color patches on the color chart comprise at least gray patches, magenta patches, and cyan patches.
3. The jaundice detection device of claim 1, wherein the support assembly comprises at least two support legs, wherein the two support legs are symmetrically disposed on both sides of the through hole.
4. A jaundice detection device of claim 3, wherein the support leg for supporting the lower eyelid is longer than the support leg for supporting the upper eyelid, among all the support legs.
5. The jaundice detection apparatus as in any one of claims 1-4, wherein the jaundice analysis module further comprises an illumination light-supplementing module, the illumination light-supplementing module being configured to illuminate and supplement light to a photographed area according to an ambient light condition during the process of photographing the image by the camera.
6. The jaundice detection apparatus of claim 5, wherein the illumination and light-compensating module comprises at least one LED light-compensating lamp, and the illumination and light-compensating module is configured to control on/off and brightness of the LED light-compensating lamp according to ambient light during the image capturing process by the camera, so as to illuminate and compensate light in the captured area.
7. The jaundice detection apparatus of claim 5, wherein the illumination and light-compensation module comprises a display screen, and the display screen is configured to display a background picture with a corresponding color and a pure color without a pattern, and illuminate and supplement light to the photographed area.
8. The jaundice detection apparatus of claim 6 or claim 7, wherein the image processing module is further configured to determine whether each image captured by the camera meets a detection requirement, and further perform color correction on the image that meets the detection requirement, so as to perform analysis and comparison on the color of the color patch in the color-corrected image and the color of the sclera of the eye.
9. The jaundice detection apparatus of claim 1, wherein the image analysis module is disposed locally or on a cloud server.
10. An image processing method of a jaundice detection apparatus, comprising:
illuminating and supplementing light to a shot area according to the condition of ambient light;
performing image shooting on each color block on the color correction card in the shot area after light filling and the sclera exposed by the through hole to obtain at least one image containing the color block and the sclera;
and carrying out image processing on the corresponding image obtained by shooting, and analyzing and comparing the color of the color block and the color of the sclera in the corresponding image after the image processing.
11. The image processing method according to claim 10, wherein the step of illuminating and supplementing the photographed area according to the condition of the ambient light includes: according to the condition of ambient light, controlling the on-off and brightness of LED light supplementing lamps around the shot area to illuminate and supplement light to the shot area; and/or displaying background pictures with different colors and pure colors and no patterns according to the condition of the ambient light so as to illuminate and supplement light to the shot area.
12. The image processing method according to claim 11, wherein when the photographed area is illuminated and supplemented with light by displaying background images of different colors and pure colors without patterns according to the condition of ambient light, the photographed area after the light supplement of the different background images is photographed to obtain a plurality of images which are illuminated by the different background images and include color patches and sclera;
and the steps of carrying out image processing on the corresponding image obtained by shooting and analyzing and comparing the color of the color block and the color of the sclera in the corresponding image after the image processing comprise the following steps: respectively carrying out color correction and analysis on the photographed images under the illumination of the plurality of different background pictures, selecting an optimal image after the color correction from the images as a corresponding image after the image processing, and further carrying out analysis and comparison on the color of the color block and the color of the sclera in the optimal image; or fusing and enhancing the photographed images under the illumination of the plurality of different background pictures to obtain enhanced images serving as corresponding images after the image processing, and further analyzing and comparing the color of the color block and the color of the sclera in the enhanced images.
13. The image processing method according to any one of claims 10 to 12, wherein when a plurality of images including patches and sclera are captured, it is first determined whether each of the captured images satisfies a detection requirement to select an image satisfying the detection requirement therefrom, and then at least one of the images selected to satisfy the detection requirement is subjected to image processing to obtain a corresponding image after the image processing.
14. A storage medium having stored thereon a computer program which, when executed by a processor, is adapted to carry out a method of image processing of a jaundice detection device according to any one of claims 10-13.
CN202111523026.0A 2021-12-13 2021-12-13 Jaundice detection device, image processing method thereof and storage medium Pending CN116262035A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111523026.0A CN116262035A (en) 2021-12-13 2021-12-13 Jaundice detection device, image processing method thereof and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111523026.0A CN116262035A (en) 2021-12-13 2021-12-13 Jaundice detection device, image processing method thereof and storage medium

Publications (1)

Publication Number Publication Date
CN116262035A true CN116262035A (en) 2023-06-16

Family

ID=86722103

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111523026.0A Pending CN116262035A (en) 2021-12-13 2021-12-13 Jaundice detection device, image processing method thereof and storage medium

Country Status (1)

Country Link
CN (1) CN116262035A (en)

Similar Documents

Publication Publication Date Title
US11766173B2 (en) Device and method for capturing, analyzing, and sending still and video images of the fundus during examination using an ophthalmoscope
US10842373B2 (en) Smartphone-based handheld ophthalmic examination devices
US11986244B2 (en) Wide field fundus camera with auto-montage at a single alignment
Yavuzer et al. Guidelines for standard photography in plastic surgery
CN104545787B (en) Wearable pupil light reflex measurement equipment
KR101998595B1 (en) Method and Apparatus for jaundice diagnosis based on an image
US9498118B2 (en) Handheld vision tester and calibration thereof
US10588486B2 (en) Multi-function video system with interchangeable medical tool
CN105852798B (en) Wide area fundus camera
Galdino et al. Digital photography for rhinoplasty
JP6096298B2 (en) Backlight correction method, apparatus and terminal
JP2009172181A (en) Health checkup method and health checkup apparatus
Edwards et al. Eyelid position measurement in Graves' ophthalmopathy: reliability of a photographic technique and comparison with a clinical technique
CN113259599B (en) Automatic exposure photographing method for fundus image, fundus camera and electronic equipment
CN109526123A (en) Breathe bootstrap technique, device, medical imaging equipment and storage medium
KR20140004469A (en) The supplementary photographing device and the health detecting method using both mobile phone and the device
US20180110409A1 (en) Visual field test method/perimeter using virtual reality glasses/headset and a smartphone or tablet or other portable device
TWI735177B (en) Cardiopulmonary resuscitation operation detection system, detection terminal and detection method
CN108836259B (en) Self-photographing type shared fundus photographing device
Hafiz et al. A new approach to non-mydriatic portable fundus imaging
CN208784706U (en) Fundus imaging optical system
CN116262035A (en) Jaundice detection device, image processing method thereof and storage medium
WO2021068387A1 (en) Non-contact vital sign detection device and system
CN111358424A (en) Fundus imaging brightness adjusting method and fundus camera
CN205810230U (en) Eyeball symptom model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination