CN112022084A - Fundus inspection system - Google Patents

Fundus inspection system Download PDF

Info

Publication number
CN112022084A
CN112022084A CN202010921267.XA CN202010921267A CN112022084A CN 112022084 A CN112022084 A CN 112022084A CN 202010921267 A CN202010921267 A CN 202010921267A CN 112022084 A CN112022084 A CN 112022084A
Authority
CN
China
Prior art keywords
fundus
server
user
information
fundus camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010921267.XA
Other languages
Chinese (zh)
Inventor
韩宇星
李婷
胡丁山
常献刚
张大磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Eaglevision Medical Technology Co Ltd
Original Assignee
Shanghai Eaglevision Medical Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Eaglevision Medical Technology Co Ltd filed Critical Shanghai Eaglevision Medical Technology Co Ltd
Priority to CN202010921267.XA priority Critical patent/CN112022084A/en
Publication of CN112022084A publication Critical patent/CN112022084A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14Arrangements specially adapted for eye photography
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0025Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device the arrangement consisting of a wireless interrogation device in combination with a device for optically marking the record carrier
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • G16H10/65ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records stored on portable record carriers, e.g. on smartcards, RFID tags or CD
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/20ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30041Eye; Retina; Ophthalmic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Abstract

The present invention provides a fundus inspection system, comprising: a user terminal for providing a personal identification; the fundus camera is used for acquiring the personal identification from the user terminal after receiving the starting instruction and sending the personal identification to the server; the server sends a starting instruction to the fundus camera after receiving the personal identification; the fundus camera enters a working state after receiving the starting instruction so that a user can control and shoot fundus pictures; the server is also used for storing the fundus picture and personal information in a correlated mode.

Description

Fundus inspection system
Technical Field
The invention relates to the field of ophthalmic medical instruments, in particular to a fundus inspection system.
Background
The fundus picture is an important image means for observing retina and diagnosing fundus diseases, and doctors can analyze and judge the severity of various diseases according to the fundus picture. The fundus camera for taking the fundus picture has a complex structure, comprises optical elements such as a lens group for imaging, an image processing module, a data communication module and the like, and needs to be transmitted to a computer for storage and display after the user fundus picture is taken. The fundus camera needs to be matched with a computer for use, so that the fundus camera can be called a fundus examination system, the application scene of the system is generally limited in medical institutions at present, for example, fundus photographing and examination can be realized through an information system of a hospital, and professional medical staff is needed to assist patients in photographing.
In order to improve the convenience of fundus examination, the prior art proposes to improve the structure of a fundus camera to miniaturize the fundus camera as much as possible, and proposes a plurality of technical schemes (automatic alignment) for automatically searching the pupil position by a lens, so that the shooting process is smoother, the shot fundus picture is clearer, and the like. However, the prior art ignores the problem of human-computer interaction, the fundus camera is not a common electronic device in daily life, and the camera is not suitable for arranging a display screen and a plurality of interaction devices to optimize the interactivity. Although having a lightweight structure and an automatic alignment function, the user is generally unaware of how to take a picture when facing the fundus camera, and even cannot activate the camera. Therefore, the existing fundus examination system is still difficult to be separated from a medical institution, so that the fundus picture is inconvenient to be shot by a user, the fundus picture of the user cannot be obtained in time, and the human-computer interaction performance needs to be improved.
Disclosure of Invention
In view of the above, the present invention provides a fundus inspection system, comprising:
a user terminal for providing a personal identification;
the fundus camera is used for acquiring the personal identification from the user terminal and sending the personal identification to the server;
the server is used for sending a starting instruction to the fundus camera after receiving the personal identification;
the fundus camera enters a working state after receiving the starting instruction so that a user can control and shoot fundus pictures; the server is also used for storing the fundus picture and personal information in a correlated mode.
Optionally, the server is configured to send an eye fundus examination invitation to the user terminal; the user terminal is used for acquiring personal information input by a user and responding to the fundus examination invitation; and the server sends the personal identification to the user terminal after receiving the response.
Optionally, the user terminal uses a two-dimensional code to represent the personal identifier; and a two-dimensional code scanning device is arranged on the fundus camera.
Optionally, the lens in the fundus camera for capturing a fundus image is also used for capturing the two-dimensional code.
Optionally, the fundus camera is provided with sensing means for sensing manipulation information resulting from manipulation of the fundus camera by a user.
Optionally, the fundus camera is used to send the manipulation information;
the server is used for receiving the control information to monitor whether the operation of the fundus camera by the user is correct or not, and sending corresponding prompt information to the fundus camera when the operation is judged to be wrong.
Optionally, the sensing device includes a light sensor for sensing ambient light to generate ambient light intensity information; and the server judges whether the environment where the eye fundus camera is located can take the eye fundus picture or not according to the light intensity information.
Optionally, the sensing device includes a distance measuring device, configured to detect a distance between an eyeball of the user and the lens to generate distance information; the server judges whether the fundus camera can take a fundus picture or not according to the distance information.
Optionally, the personal information comprises medical history information and/or symptom information;
the server detects the fundus picture according to the medical history information and/or the symptom information to obtain a detection result;
the user terminal is used for obtaining the detection result.
Optionally, the server is configured to determine the photographing quality of the fundus picture, and send a prompt message to the user terminal when it is determined that the photographing quality does not meet a preset standard, so as to prompt the user to re-operate the fundus camera to take the fundus picture thereof.
According to the fundus examination system provided by the invention, a user only needs to use the personal terminal to provide the personal identification, the server remotely starts the fundus camera to acquire the personal identification of the user, the server sends a starting instruction to wake the fundus camera to enter a working state after acquiring the personal identification, the user can shoot fundus pictures and store the shot fundus pictures in the server, and the user can use the personal terminal to acquire the self fundus pictures. The system converts the operation of the user on the eye fundus camera into the operation on the personal terminal, thereby reducing the difficulty of man-machine interaction and avoiding overhigh cost caused by arranging too many interaction devices in the eye fundus camera. As a service manufacturer, the fundus cameras can be deployed at a plurality of places, all the fundus cameras can be served simultaneously by deploying a small amount of server equipment remotely, professional medical staff do not need to intervene in a photographing scene, the system can be separated from a medical institution to be managed and used by ordinary staff, and popularization of examination on fundus health is facilitated.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a schematic view of a fundus inspection system in an embodiment of the present invention;
FIG. 2 is a timing diagram of a fundus inspection system according to an embodiment of the present invention;
FIG. 3 is a timing chart of another fundus inspection system in an embodiment of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The technical features mentioned in the different embodiments of the invention described below can be combined with each other as long as they do not conflict with each other.
As shown in fig. 1, an embodiment of the present invention provides a fundus inspection system, which includes a user terminal 1, a server 2, and a plurality of fundus cameras 3, wherein the user terminal 1 may be a portable mobile device, such as a personal smart phone; the server 2 is a dedicated device deployed by a service provider, and the server is a general term for a service device deployed at a remote location, and it should be understood by those skilled in the art that in practical application, a variety of servers, such as an IOT (Internet of Things) server, a data storage server, and the like, need to be set according to a use, so that the server described in the present application may be understood as a server or a cluster formed by a plurality of servers. The server 2 is connected to the terminal 1 and each fundus camera 3 through the internet. The fundus camera 3 is an electronic apparatus having an optical element, an imaging device, and a communication device. The system can adopt a self-photographing type fundus camera disclosed in Chinese patent document CN209826671U, so that a user can take self-photographing fundus pictures by holding or wearing the system.
The user terminal 1 is used to provide personal identification. The user needs to register when using the system for the first time, personal information of the user is filled in an interactive interface provided by the system and is submitted to the server 2 to establish a personal account, and the server 2 allocates a personal identification for the registered user, wherein the personal identification can be a string of numbers, letters or a combination of the numbers and the letters.
As a preferred embodiment, the server 2 sends an invitation to the user terminal 1 for a fundus examination, for example a corresponding invitation link may be displayed to the user by means of a web page, a public number, an application interface, etc. The user can choose to accept the invitation, and the user terminal 1 acquires personal information input by the user, such as basic information including the user name, age, sex and the like, and responds to the fundus examination invitation; after receiving the response (after receiving the personal information), the server 2 assigns a personal identifier to the user and transmits the personal identifier to the user terminal 1, and establishes a personal account.
The fundus camera 3 is used to acquire a personal identification from the user terminal 1 and transmit the personal identification to the server 2. The fundus camera 3 can obtain the personal identification from the user terminal 1 in various ways, such as communication via wireless network, bluetooth, short-range electromagnetic signal communication, etc., and accordingly, a sensor supporting this communication way is provided in the fundus camera 3, by which the personal identification in the user terminal 1 can be obtained.
As a preferred embodiment, the user terminal 1 represents the personal identification by displaying a two-dimensional code, and the fundus camera 3 is provided with a two-dimensional code scanning device, and the personal identification is obtained by scanning the two-dimensional code and analyzing. The two-dimensional code scanning device may be an independent scanning device disposed outside the camera housing, such as a camera dedicated to scanning two-dimensional codes. In order to improve the integration level and make the entire fundus camera simpler, the present embodiment uses the lens for taking the fundus image in the fundus camera to take the two-dimensional code. Specifically, the camera is in a standby state in which the focal length of the lens is suitable for photographing the size of the two-dimensional code displayed on the screen of the user terminal 1.
The server 2 transmits a start instruction to the fundus camera 3 after receiving the personal identification. In practical application, the server 2 will also verify the personal identifier, determine whether the received personal identifier is from a registered user, thereby verifying the user identity, and issue a start instruction after the verification is passed. In addition, since a plurality of fundus cameras 3 may exist simultaneously in the network, in order for the server 2 to determine to which camera the startup instruction should be sent, the fundus camera 3 also needs to send its device serial number to the server in order for the server 2 to determine its network address, physical address, and the like. The fundus camera 3 may transmit its own device serial number while transmitting the user personal identification, or may transmit the device serial number after waiting for the server 2 to verify the personal identification, and then wait for notification from the server 2.
The fundus camera 3 enters a working state after receiving the starting instruction, so that a user can take fundus pictures by operation. This is a remote wake-up process, where the user activates the fundus camera indirectly through the smartphone and server, rather than operating the fundus camera directly. According to the camera structure of the present embodiment, the user can take a picture of the fundus by himself after the camera is started, and then the fundus camera 3 transmits the picture of the fundus to the server 2. Of course, the present invention is not limited to the use of a self-photographing type fundus camera, and is applicable to the use of a large-sized fundus camera having a more complicated structure, or a fundus camera that requires others to hold to photograph a patient.
The server 2, after receiving the fundus picture, stores it in an account registered by the user, that is, stores the fundus picture and the personal information in association with each other. In practical application, the data storage server can be used, a user can access the server 2 to view the fundus picture of the user by using any terminal, and the server 2 can also actively send the fundus picture to the user terminal 1.
As shown in fig. 2, when the user uses the present system of the present embodiment, each device performs operations including:
S1A, the user terminal 1 provides personal identification and informs the server 2;
S2A, the fundus camera 3 acquires a personal identification from the user terminal 1;
S3A, the fundus camera 3 sends a personal identification to the server 2;
S4A, the server 2 sends a start instruction to the fundus camera 3;
S5A, the fundus camera 3 enters a working state after receiving the starting instruction, so that the user can take fundus pictures through operation;
S6A, the fundus camera 3 takes a fundus picture and sends it to the server 2;
S7A, the server 2 transmits the fundus picture to the user terminal 1, or stored in a user account in the server 2.
According to the fundus examination system provided by the embodiment of the invention, a user only needs to use the personal terminal to provide the personal identification, the server remotely starts the fundus camera to acquire the personal identification of the user, the server sends a starting instruction to wake the fundus camera to enter a working state after acquiring the personal identification, the user can shoot fundus pictures and store the shot fundus pictures in the server, and the user can use the personal terminal to acquire the fundus pictures of the user. The system converts the operation of the user on the eye fundus camera into the operation on the personal terminal, thereby reducing the difficulty of man-machine interaction and avoiding overhigh cost caused by arranging too many interaction devices in the eye fundus camera. As a service manufacturer, the fundus cameras can be deployed at a plurality of places, all the fundus cameras can be served simultaneously by deploying a small amount of server equipment remotely, professional medical staff do not need to intervene in a photographing scene, the system can be separated from a medical institution to be managed and used by ordinary staff, and popularization of examination on fundus health is facilitated.
For the self-timer type fundus camera, after being remotely started up by the server 2, the user may also be given more prompts in steps S2A, S5A to ensure that the photographing process proceeds smoothly. In a preferred embodiment, the fundus camera 3 is provided with a voice playing device for playing voice to guide the user to manipulate the fundus camera 3 according to the set flow. Specifically, the boot process of the present embodiment includes: step S2a1 of prompting the user to align the two-dimensional code displayed by the user terminal 1 with the lens of the fundus camera 3, or prompting the user to turn on a communication unit (wireless network, bluetooth, NFC, or the like) of the user terminal 1 so that the fundus camera 3 reads the personal identification; step S5a1 of prompting the user to place the fundus camera 3 in a darkroom or at no light; step S5A2, prompting a user to place eyes in a shooting position, and simultaneously amplifying eye sockets by using two hands to expose eyeball in front of a shooting opening to the maximum extent; step S5A3, prompting a user to rotate the eyeball according to the direction of the light source in the camera; in step S5a4, after taking a fundus picture of one eye is completed, the user is prompted to switch to the other eye.
Further, in order to ensure that the user can correctly manipulate the fundus camera 3 for self-photographing, the fundus camera 3 is also provided with a sensing device in a preferred embodiment to sense manipulation information generated by the user's manipulation of the fundus camera 3. For example, a light sensor for sensing ambient light to generate ambient light intensity information, which can be changed by a user's manipulation since the fundus camera 3 can be moved by the user, and/or a distance measuring device may be provided, and the ambient light intensity information is regarded as a kind of manipulation information.
The distance measuring device is used for detecting the distance between the eyeball of a user (a shot object) and the lens (the ocular lens of the eye ground camera) and generating distance information according to the distance, and specifically can be an infrared distance measuring device or a shooting distance measuring device, and the distance information is generated by detecting the distance between the eye and the ocular lens at a shooting position (near the ocular lens) of the eye ground camera 3. Since the user can adjust the positional relationship with the fundus camera 3 by himself, the distance information is regarded as a kind of manipulation information.
The fundus camera 3 can automatically judge whether the above-mentioned ambient light intensity information and distance information meet the set standard, and control the prompting process according to the above-mentioned information. Specifically, for example, in the step S5a1, the light sensor is activated and it is determined whether the ambient light intensity information is smaller than the set intensity value, when the ambient light intensity information is smaller than the set intensity value, the step S5a2 is executed to determine that the current environment meets the shooting requirement, otherwise, the step S5a1 is stopped, and the user is continuously prompted to adjust the shooting environment; for example, in step S5a2, the distance measuring device is activated to determine whether the distance information is between the upper threshold and the lower threshold, that is, whether the distance between the eye and the eyepiece is too close or too far, and when the distance information is between the upper threshold and the lower threshold, the current distance is considered to be in accordance with the shooting requirement, step S5A3 may be executed, otherwise, step S5a2 is stopped, and the user is prompted to change the distance between the eye and the eyepiece.
In a preferred embodiment, the above-described operation of determining the environment and the distance is performed by the server 2, that is, the fundus camera 3 is used only to acquire the manipulation information and transmit it to the server 2. The server 2 determines from the light intensity information whether the environment in which the fundus camera 3 is located can take a fundus picture, and determines from the distance information whether the fundus camera 3 can take a fundus picture. Performing the calculation remotely by the server 2 reduces the amount of calculation of the fundus camera 3, whereby it is possible to reduce the cost of the fundus camera 3 and improve portability.
The embodiment of the invention provides another fundus examination system which comprises a user terminal 1, a server 2 and a plurality of fundus cameras 3, and the fundus examination system is added with a function of detecting fundus pictures on the basis of the system of the embodiment. Specifically, after receiving the fundus picture, the server 2 of the present embodiment uses the trained machine learning model to identify (including classification, segmentation, and regression prediction) the fundus picture, and obtains and stores a detection result in an account registered by the user, where the detection result may be a segmentation result of an object of interest in the fundus picture, a classification result of a category to which the fundus picture belongs (for example, belonging to health or a certain disease), or a regression prediction result of a body index related to the fundus picture (for example, age, diopter, and the like). The user can use any terminal to access the server 2 to check the detection result of the user, and the server 2 can also actively send the detection result to the user terminal 1.
In order to make the detection performed by the server 2 more targeted, the personal information transmitted or confirmed by the user terminal 1 of the present embodiment includes medical history information and/or symptom information. Specifically, the medical history information includes several questions and options-whether there is diabetes, whether there is hypertension, whether there is cardiovascular and cerebrovascular disease, whether there is high myopia, whether there is history of eye surgery; symptom information includes several questions and options-whether vision is degraded, whether there is edema in the eyes, whether there is bleeding in the eyes, whether there is a symptom of a fissure.
When the server 2 receives the information, the detection mode of the fundus picture is determined according to the information, for example, the detection area is determined, or a suitable machine learning model is selected to detect the fundus picture, so that the detection result is more accurate. The reason for this is that, in order to comprehensively detect various possible fundus diseases, a service manufacturer may train a plurality of models for different disease types and a plurality of models for different regions of the fundus oculi, and at the same time, the service manufacturer may train a multi-disease identification model for some common ocular diseases, for example, a machine learning model disclosed in chinese patent document CN108596895A may realize multi-disease detection. The advantages of a plurality of models are different, for example, some models have more detailed identification aiming at the characteristics of diabetic retinopathy, and the severity grade of the pathological changes can be detected; some models are more comprehensive, and can screen various fundus diseases simultaneously; some models only detect the optic disc region and only identify glaucoma. In this case, the detection efficiency using all models for each fundus picture of the user is low, so the embodiment represents the actual situation of the user by the medical history information and/or symptom information, and the server selects a part of models for the actual situation of the user to recognize the fundus picture thereof, thereby improving the detection efficiency.
For example, when the personal information of the user shows that the user does not have any medical history or symptoms, a plurality of disease identification models can be used for roughly detecting some common disease features, and the detection by using a model for a certain disease is not needed; for example, when the user has diabetes mellitus in personal information, the fundus picture can be detected by using a model special for detecting characteristics of diabetic retinopathy, so that the detection result is more detailed.
The above example is only for clearly explaining how the server 2 performs the targeted detection, and is not limited to the model selection logic, and other selection strategies may be set in practical application.
In an alternative embodiment, the server 2 may further determine the photographing quality of the fundus picture, for example, the server 2 may perform stain/bright spot detection, exposure detection, sharpness detection, light leakage detection, local shadow detection, and the like on the fundus picture by using an image detection method disclosed in chinese patent document CN108346149A, and send a prompt message to the user terminal 1 when it is determined that the photographing quality does not meet the preset standard, so as to prompt the user to operate the fundus camera 3 again to take the fundus picture thereof.
As shown in fig. 3, when the user uses the present system of the present embodiment, each device performs operations including:
S1B, the user terminal 1 provides personal identification and informs the server 2;
S2B, the fundus camera 3 acquires a personal identification from the user terminal 1;
S3B, the fundus camera 3 sends a personal identification to the server 2;
S4B, the server 2 sends a start instruction to the fundus camera 3;
S5B, the fundus camera 3 enters a working state after receiving the starting instruction, so that the user can take fundus pictures through operation;
S6B, the fundus camera 3 takes a fundus picture and sends it to the server 2;
S7B, the server 2 detects the fundus picture to obtain the detection result, and the detection in the step comprises the detection of the fundus disease and the detection of the fundus picture quality.
S8B, the server 2 transmits the fundus picture and the detection result to the user terminal 1, or stored in a user account in the server 2.
The server in the fundus examination system provided by the embodiment of the invention detects the fundus picture to obtain the detection result about the disease, and the user can check the fundus picture and the detection result through the personal terminal, so that the user can efficiently and timely know the eye health state of the user, the convenience of ophthalmic examination is improved, and the detection result can be referred by medical staff, thereby saving the medical cost.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are within the scope of the invention.

Claims (10)

1. A fundus inspection system, comprising:
a user terminal for providing a personal identification;
the eye fundus camera is used for acquiring the personal identification from the user terminal and sending the personal identification to a server;
the server is used for sending a starting instruction to the fundus camera after receiving the personal identification;
the fundus camera enters a working state after receiving the starting instruction so that a user can control and shoot fundus pictures; the server is also used for storing the fundus picture and personal information in a correlated mode.
2. The system of claim 1, wherein the server is configured to send an eye fundus examination invitation to a user terminal; the user terminal is used for acquiring personal information input by a user and responding to the fundus examination invitation; and the server sends the personal identification to the user terminal after receiving the response.
3. The system of claim 1, wherein the user terminal characterizes the personal identifier using a two-dimensional code; and a two-dimensional code scanning device is arranged on the fundus camera.
4. The system of claim 3, wherein the lens in the fundus camera used to capture the fundus image is also used to capture the two-dimensional code.
5. A system according to claim 1, wherein the fundus camera is provided with sensing means for sensing manipulation information resulting from user manipulation of the fundus camera.
6. The system of claim 5, wherein the fundus camera is configured to transmit the manipulation information;
the server is used for receiving the control information to monitor whether the operation of the fundus camera by the user is correct or not, and sending corresponding prompt information to the fundus camera when the operation is judged to be wrong.
7. The system of claim 5, wherein the sensing device comprises a light sensor for sensing ambient light to generate ambient light intensity information; and the server judges whether the environment where the eye fundus camera is located can take the eye fundus picture or not according to the light intensity information.
8. The system of claim 5, wherein the sensing device comprises a distance measuring device for detecting a distance between an eyeball of the user and the lens to generate distance information; the server judges whether the fundus camera can take a fundus picture or not according to the distance information.
9. The system of claim 1, wherein the personal information includes medical history information and/or symptom information;
the server detects the fundus picture according to the medical history information and/or the symptom information to obtain a detection result;
the user terminal is used for obtaining the detection result.
10. The system according to claim 1 or 9, wherein the server is configured to determine the photographing quality of the fundus picture, and send a prompt message to the user terminal to prompt a user to re-operate the fundus camera to take a fundus picture thereof when it is determined that the photographing quality does not meet a preset standard.
CN202010921267.XA 2020-09-04 2020-09-04 Fundus inspection system Pending CN112022084A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010921267.XA CN112022084A (en) 2020-09-04 2020-09-04 Fundus inspection system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010921267.XA CN112022084A (en) 2020-09-04 2020-09-04 Fundus inspection system

Publications (1)

Publication Number Publication Date
CN112022084A true CN112022084A (en) 2020-12-04

Family

ID=73591485

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010921267.XA Pending CN112022084A (en) 2020-09-04 2020-09-04 Fundus inspection system

Country Status (1)

Country Link
CN (1) CN112022084A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115065771A (en) * 2022-05-23 2022-09-16 北京鹰瞳科技发展股份有限公司 Communication device, method and apparatus for interconnecting fundus camera and external terminal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106491076A (en) * 2017-01-06 2017-03-15 苏州微清医疗器械有限公司 Full-automatic fundus camera
CN206729873U (en) * 2017-01-06 2017-12-12 苏州微清医疗器械有限公司 Full-automatic fundus camera
CN111557639A (en) * 2020-06-05 2020-08-21 上海鹰瞳医疗科技有限公司 Fundus inspection system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106491076A (en) * 2017-01-06 2017-03-15 苏州微清医疗器械有限公司 Full-automatic fundus camera
CN206729873U (en) * 2017-01-06 2017-12-12 苏州微清医疗器械有限公司 Full-automatic fundus camera
CN111557639A (en) * 2020-06-05 2020-08-21 上海鹰瞳医疗科技有限公司 Fundus inspection system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115065771A (en) * 2022-05-23 2022-09-16 北京鹰瞳科技发展股份有限公司 Communication device, method and apparatus for interconnecting fundus camera and external terminal

Similar Documents

Publication Publication Date Title
US11766173B2 (en) Device and method for capturing, analyzing, and sending still and video images of the fundus during examination using an ophthalmoscope
US10945637B2 (en) Image based jaundice diagnosing method and apparatus and image based jaundice diagnosis assisting apparatus
KR101998595B1 (en) Method and Apparatus for jaundice diagnosis based on an image
KR20180014624A (en) System and Method for Iris Authentication
KR20180109109A (en) Method of recognition based on IRIS recognition and Electronic device supporting the same
CN110428410B (en) Fundus medical image processing method, device, equipment and storage medium
CN109285602B (en) Master module, system and method for self-checking a user's eyes
KR101789166B1 (en) Method and Apparatus for jaundice diagnosis based on an image, Assisting Apparatus for jaundice diagnosis based on an image
JP2002191559A (en) Corneal endotheliocyte analytic system
CN111481165A (en) Full-automatic intelligent fundus disease diagnosis system
CN112022084A (en) Fundus inspection system
CN111557639A (en) Fundus inspection system
JP2012161001A (en) Control system, face authentication system used with the control system, and portable terminal
US10667681B2 (en) Vision testing device
KR20220097585A (en) Ai-based cervical caner screening service system
CN210277126U (en) Full-automatic intelligent fundus disease diagnosis system
KR102448958B1 (en) Non-face-to-face specimen ampoule supply kiosk system and method therefor
US11918286B2 (en) Ophthalmic instrument, management method, and management device
WO2021068387A1 (en) Non-contact vital sign detection device and system
CN115019940A (en) Prediction method and device of digestive tract diseases based on eye images and electronic equipment
JP6379374B1 (en) Composite server device for remote evaluation of capillaries and capillary evaluation program
US20210121059A1 (en) Ophthalmic instrument, management device, and method for managing an ophthalmic instrument
KR102189783B1 (en) Diagnosis name marking method of bppv
US20210113147A1 (en) Jaundice diagnosis patch, patch authentication system, and jaundice diagnosis method using the same
JP2020042356A (en) Medical information processing program, and medical information processing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201204