WO2021146941A1 - Disease location acquisition method, apparatus, device and computer readable storage medium - Google Patents

Disease location acquisition method, apparatus, device and computer readable storage medium Download PDF

Info

Publication number
WO2021146941A1
WO2021146941A1 PCT/CN2020/073580 CN2020073580W WO2021146941A1 WO 2021146941 A1 WO2021146941 A1 WO 2021146941A1 CN 2020073580 W CN2020073580 W CN 2020073580W WO 2021146941 A1 WO2021146941 A1 WO 2021146941A1
Authority
WO
WIPO (PCT)
Prior art keywords
disease
data
location
dimensional
classification information
Prior art date
Application number
PCT/CN2020/073580
Other languages
French (fr)
Chinese (zh)
Inventor
白桦
颜永阳
王雨楠
杨立民
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to PCT/CN2020/073580 priority Critical patent/WO2021146941A1/en
Priority to CN202080000061.1A priority patent/CN113728398A/en
Publication of WO2021146941A1 publication Critical patent/WO2021146941A1/en

Links

Images

Classifications

    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • This application relates to the field of computer human-computer interaction technology. Specifically, this application relates to a method, device, equipment, computer-readable storage medium, and electronic equipment for obtaining the location of human diseases.
  • the present disclosure is made in view of the above-mentioned problems.
  • the present disclosure provides a method, device, equipment, computer-readable storage medium, and electronic equipment for acquiring the location of human diseases.
  • a method for acquiring a disease location including: acquiring element characteristics of the disease data through disease data; and acquiring the disease using multiple disease location models based on the element characteristics of the disease data The three-dimensional position of the disease, wherein the multiple disease position models respectively correspond to different three-dimensional positions of the body.
  • the multiple disease location models correspond to multiple human organs, and each model includes at least one tag corresponding to it, and the multiple disease location models are used based on the element characteristics of the disease data.
  • Obtaining the three-dimensional location of the disease includes: corresponding element features of the disease data to at least one label in the multiple disease location models to obtain the three-dimensional location of the disease.
  • the method further includes: obtaining a corrected three-dimensional position of the disease through a first neural network based on the disease data, wherein the first neural network is obtained through training data training,
  • the training data includes feature data and identification tags, the feature data includes multiple disease information, the identification tags include three-dimensional positions corresponding to the multiple disease information, and the multiple disease information includes multiple disease information.
  • Disease data includes: obtaining a corrected three-dimensional position of the disease through a first neural network based on the disease data, wherein the first neural network is obtained through training data training,
  • the training data includes feature data and identification tags, the feature data includes multiple disease information, the identification tags include three-dimensional positions corresponding to the multiple disease information, and the multiple disease information includes multiple disease information.
  • the method further includes: when the element feature of the disease data cannot correspond to at least one of the multiple disease location models, obtaining the disease through a second neural network based on the disease data
  • the second neural network is obtained by training with training data
  • the training data includes feature data and identification tags
  • the feature data includes disease classification information that is different from the disease classification information
  • the identification label includes the three-dimensional position corresponding to the disease classification information included in the feature data.
  • the multiple disease location models are obtained by dividing the disease classification information based on different three-dimensional locations of the body.
  • the disease classification information corresponds to different disease names, and each disease classification information contains at least one name tag corresponding to the disease classification information.
  • the method further includes: matching element characteristics of the disease data to At least one name tag of the disease classification information to obtain the disease name corresponding to the disease data.
  • the disease data is obtained from one or more of health assessment, physical examination report, health data, and peripheral input.
  • the three-dimensional position is highlighted on the three-dimensional human body structure.
  • a device for acquiring a disease location including: an element feature acquiring unit for acquiring element features of the disease data through disease data; and a three-dimensional location acquiring unit for acquiring disease data based on the disease data. Using multiple disease location models to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
  • the multiple disease location models correspond to multiple human organs, and each model contains at least one tag corresponding to it, and the three-dimensional location acquisition unit corresponds to the element characteristics of the disease data to all the human organs. At least one label in the multiple disease location models to obtain the three-dimensional location of the disease.
  • the device further includes: a three-dimensional position obtaining unit obtains the corrected three-dimensional position of the disease through a first neural network based on the disease data, wherein the first neural network is trained through training data Obtained, the training data includes feature data and identification tags, the feature data includes multiple disease information, the identification tags include three-dimensional positions corresponding to the multiple disease information, and the multiple disease information includes multiple Disease data for different diseases.
  • the device further includes: when the element feature of the disease data cannot correspond to at least one of the multiple disease position models, the three-dimensional position acquisition unit is based on the disease data through the second nerve
  • the network obtains the three-dimensional position of the disease, wherein the second neural network is obtained by training with training data, the training data includes feature data and identification tags, and the feature data includes diseases that are different from the disease classification information Classification information, and the identification label includes a three-dimensional position corresponding to the disease classification information included in the characteristic data.
  • the multiple disease location models are obtained by dividing the disease classification information based on different three-dimensional locations of the body.
  • the disease classification information corresponds to different disease names, and each disease classification information contains at least one name tag corresponding to it, and the three-dimensional position acquisition unit matches the element characteristics of the disease data to At least one name tag of the disease classification information to obtain the disease name corresponding to the disease data.
  • the three-dimensional position obtaining unit after obtaining the three-dimensional position of the disease, the three-dimensional position obtaining unit highlights the three-dimensional position on the three-dimensional human body structure.
  • a disease location acquisition device including: a processor; and a memory, in which computer-readable instructions are stored, wherein the disease location is executed when the computer-readable instructions are executed by the processor
  • An acquiring method comprising: acquiring element characteristics of the disease data through disease data; and acquiring the three-dimensional position of the disease using multiple disease location models based on the element characteristics of the disease data, wherein the multiple diseases The position models respectively correspond to different three-dimensional positions of the body.
  • a computer-readable storage medium for storing a computer-readable program, which causes a computer to execute the disease location acquisition method as described above.
  • an electronic device including the above-mentioned disease location acquisition device and a display interface; wherein the display interface is configured to display a three-dimensional human body model, and the three-dimensional human body model uses the above-mentioned disease location acquisition method.
  • the disease classification information is displayed at the obtained three-dimensional position, and the organ corresponding to the obtained three-dimensional position is highlighted.
  • a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. Three-dimensional position, so as to realize the 3D display of the disease on the 3D model, to more accurately show the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
  • Fig. 1 shows a flowchart of a method for acquiring a disease location according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram outlining an application scenario of a training method of a neural network model according to an embodiment of the present disclosure
  • Fig. 3 shows a flowchart of a method for acquiring a disease location according to another embodiment of the present disclosure
  • FIG. 4 shows a schematic diagram of an example of acquiring a disease location according to an embodiment of the present disclosure
  • Fig. 5 shows a schematic diagram of a display interface for displaying human body information according to an embodiment of the present disclosure
  • Fig. 6 shows a schematic diagram of a display interface for disease display according to an embodiment of the present disclosure
  • FIG. 7 shows a block diagram of a device for acquiring a disease location according to an embodiment of the present disclosure
  • Fig. 8 shows a block diagram of a disease location acquiring device according to an embodiment of the present disclosure
  • FIG. 9 shows a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
  • FIG. 10 shows a schematic diagram of a storage medium according to an embodiment of the present disclosure.
  • first”, “second” and similar words used in the present disclosure do not indicate any order, quantity, or importance, but are only used to distinguish different components.
  • “including” or “including” and other similar words mean that the element or item appearing before the word covers the element or item listed after the word and their equivalents, but does not exclude other elements or items.
  • Similar words such as “connected” or “connected” are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up”, “Down”, “Left”, “Right”, etc. are only used to indicate the relative position relationship. When the absolute position of the described object changes, the relative position relationship may also change accordingly.
  • the International Classification of Diseases is a unified international classification for various diseases in order to analyze the differences in the health status of the populations of the world and the cause of death. It is very important for clinical application and management to assign the correct ICD10 code to each patient according to the diagnosis (that is, to add the ICD10 code to the patient's medical record). However, assigning the correct ICD10 code to the patient when visiting a doctor only finds the 2D position of the corresponding disease or disease for the visiting patient, but cannot accurately locate the 3D position of the disease, and cannot show the user accurate medical icons. Cause user misunderstanding.
  • ICD10 codes are organized in a hierarchical structure, where the upper code represents a wide range of disease categories, and the lower code represents more specific diseases. Therefore, when the coder matches the diagnosis description to an overly broad code instead of a more specific code, a wrong code will also occur, which makes it more difficult to locate the disease location.
  • the present disclosure provides a disease location acquisition method, which creates a disease location model based on different three-dimensional locations, and then obtains the three-dimensional location of the disease by mapping the acquired disease data to the disease location model, thereby realizing the disease on the 3D model 3D display to more accurately display disease information to users and improve user experience.
  • At least one embodiment of the present disclosure provides a method for acquiring a disease location, a device for acquiring a disease location, a device for acquiring a disease location, and a computer-readable storage medium.
  • the following is a non-limiting description of the disease location acquisition provided according to at least one embodiment of the present disclosure through several examples and embodiments. As described below, these specific examples and embodiments are different if they do not conflict with each other. The features can be combined with each other to obtain new examples and embodiments, and these new examples and embodiments also fall within the protection scope of the present disclosure.
  • FIGS. 1-4 a method for acquiring a disease location according to an embodiment of the present disclosure will be described with reference to FIGS. 1-4.
  • This method can be automatically completed by a computer or the like.
  • the method can be applied to display the three-dimensional position of human diseases and so on.
  • the method for acquiring the disease location can be implemented in software, hardware, firmware or any combination thereof, loaded and executed by a processor in a device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, and a network server.
  • the method for obtaining the location of the disease is applicable to a computing device that includes any electronic device with computing functions, such as a mobile phone, a laptop, a tablet, a desktop computer, a web server, etc., which can load and execute the disease
  • the location acquisition method is not limited in the embodiment of the present disclosure.
  • the computing device may include a central processing unit (CPU) or a graphics processing unit (Graphics Processing Unit, GPU) and other forms of processing units, storage units, etc.
  • CPU central processing unit
  • GPU Graphics Processing Unit
  • the computing device is also installed with an operating system, an application programming interface (for example, OpenGL (Open Graphics Library), Metal, etc.), etc., and the method for acquiring the disease location provided in the embodiments of the present disclosure is implemented by running code or instructions.
  • the computing device may also include a display component, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, and a quantum dot light emitting diode (Quantum Dot Light Emitting).
  • Diode, QLED display screens, projection components, VR head-mounted display devices (for example, VR helmets, VR glasses), etc., which are not limited in the embodiments of the present disclosure.
  • the display part can display the object to be displayed.
  • the method for acquiring the location of the disease includes the following steps S101 to S102.
  • step S101 the element characteristics of the disease data are acquired through the disease data.
  • step S102 based on the element characteristics of the disease data, multiple disease location models are used to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
  • the disease data may be data related to the user's current disease, which contains a language description of the disease, which can be obtained from the user's personal health information.
  • the user's disease data can be obtained from analyzing one or more of health assessment, physical examination report, health data, and peripheral input.
  • the disease data may be data related to the current disease in the main complaint of a given medical record (or health data), current medical history, past history, and diagnosis results given by a doctor.
  • the disease data can be handwritten data, and the data required in the disease data can be obtained through OCR or manual reading; it can also be electronic disease data, which can be exported through the electronic disease data management platform data.
  • multiple disease location models are obtained by dividing disease classification information based on different three-dimensional locations of the body.
  • the disease classification information can be ICD10 or other suitable disease classification databases, which is not limited here.
  • the disease classification information may correspond to different disease names, and each disease classification information contains at least one name tag corresponding to it.
  • the element characteristics of the disease data may be matched to at least one of the disease classification information.
  • the name tag obtains the disease name corresponding to the disease data.
  • diabetes in the disease classification information corresponds to label 1
  • the disease data is matched to label 1 in the disease classification information, so that the disease name corresponding to the disease data is diabetes.
  • the element characteristics of the disease data can be represented by a vector representation or a word vector of each element of the disease data.
  • a neural network can be used to obtain the probability of matching each disease in the disease classification information to the disease data. If the probability is greater than a predetermined threshold, the disease in the disease classification information corresponding to the probability is matched to the disease data. To get the name of the disease.
  • a disease location model can be obtained based on ICD10.
  • 13904 diseases in the ICD10 can be integrated and analyzed, and the ICD10 can be divided into multiple disease location models based on different human organs or tissues, so as to map the diseases to the 3D model.
  • the ICD 10 can be divided into multiple disease location models through a classifier (such as clustering, support vector machine (SVM), K-nearest neighbor algorithm) or neural network, where different disease location models correspond to different human organs or tissues.
  • SVM support vector machine
  • K-nearest neighbor algorithm K-nearest neighbor algorithm
  • multiple disease location models correspond to multiple human organs, and each model includes at least one label corresponding to it.
  • the disease classification information can be divided into multiple disease location models according to organs such as heart, liver, spleen, lung, and kidney, and each disease location model corresponds to labels such as heart, liver, spleen, lung, and kidney.
  • the label of each disease location model may also include sub-labels.
  • the "heart” tag may contain subtags "left atrium”, “left ventricle”, “right atrium”, “right ventricle” and so on.
  • step S102 based on the element features of the disease data, using multiple disease location models to obtain the three-dimensional location of the disease may include: corresponding the element features of the disease data to those in the multiple disease location models. At least one tag to obtain the three-dimensional location of the disease.
  • each tag can correspond to a code
  • each subtag can also correspond to a code.
  • the code for labeling myasthenia gravis is G80.001
  • the code for labeling the esophagus is I95
  • the code for esophageal varices is I95.5.
  • the disease data is "the test tube cavity is not significantly narrowed, the gastroscope can pass, and the lower esophageal varices can be seen"
  • the disease data is matched to the disease location model according to the element feature "lower esophageal vein” in the disease data The code of I95.5, so that the three-dimensional position of the disease can be obtained as "esophagus, esophageal vein”.
  • the above process of matching disease data to the encoding of the disease location model can be automatically completed by a computer.
  • the technical effect of matching the disease data to the encoding of the disease location model can also be achieved through a neural network or other methods, which will not be repeated here.
  • the disease After obtaining the three-dimensional position of the disease, the disease can be displayed on the organ position corresponding to the three-dimensional human body model in the display interface of the electronic device to realize human-computer interaction.
  • the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
  • a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. Three-dimensional position, so as to realize the 3D display of the disease on the 3D model, to more accurately show the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
  • the neural network model can be used to analyze the disease data to obtain the corrected three-dimensional position of the disease.
  • a neural network can be directly used to obtain the three-dimensional location of the disease.
  • Neural network is a large-scale, multi-parameter optimization tool. Relying on a large amount of training data, deep neural networks can learn hidden features that are difficult to summarize in the data, thereby completing a number of complex tasks, such as face detection, image semantic segmentation, text summary extraction, object detection, motion tracking, natural language translation Wait.
  • Obtaining the vector representation of the text through the word vector refers to expressing each word in the text as a single vector, and generating a vector representation of the text through a high degree of summary and abstraction.
  • Techniques based on neural network models can be used in, for example, medical disease location processing, so as to automatically process disease data.
  • FIG. 2 An application scenario of a training method of a neural network model according to an embodiment of the present disclosure is schematically described with reference to FIG. 2.
  • a neural network model 20 is used to receive an input 10, and the input 10 performs feature extraction processing, and based on the extracted features, an output 30 is generated.
  • the input 10 may be, for example, an image, video, or natural language text waiting to be processed.
  • the neural network model 20 performs image semantic segmentation, object detection, motion tracking, natural language translation and other processing on the input 10 to generate the output 30.
  • the neural network model 20 can be embedded in a terminal device or a server to process input.
  • the neural network model 20 may be trained according to the training method shown in FIG. 3.
  • Fig. 3 is a flowchart of a method for acquiring a disease location according to another embodiment of the present disclosure. As shown in FIG. 3, the method for acquiring the location of the disease includes the following steps S201 to S203.
  • step S201 the element characteristics of the disease data are acquired through the disease data.
  • step S202 based on the element characteristics of the disease data, multiple disease location models are used to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
  • step S203 based on the disease data, the corrected three-dimensional position of the disease is obtained through the first neural network.
  • step S203 the corrected three-dimensional position of the disease may be obtained through the first neural network based on the disease data.
  • the first neural network is obtained by training with training data
  • the training data includes feature data and identification tags
  • the feature data includes multiple disease information
  • the identification tags include three-dimensional positions corresponding to the multiple disease information
  • the plurality of disease information includes disease data of a plurality of different diseases.
  • the first neural network may be Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), Back Propagation (BP), Linear Neural Network, etc. Do restrictions.
  • CNN Convolutional Neural Networks
  • RNN Recurrent Neural Network
  • BP Back Propagation
  • Linear Neural Network etc. Do restrictions.
  • multiple disease information may be obtained from analyzing one or more of health assessment, physical examination report, health data, and peripheral input, and the three-dimensional location corresponding to the multiple disease information may be more detailed location information manually labeled.
  • the three-dimensional position corresponding to the disease data can be corrected, so that the obtained three-dimensional position is more accurate.
  • the training data may include feature data and an identification label, the feature data including a plurality of disease information and disease classification information, and the identification label includes a three-dimensional position corresponding to the plurality of disease information and corresponding to the disease classification information.
  • the three-dimensional location information It should be realized that in addition to the disease classification information and its corresponding three-dimensional position in the training data, multiple disease information and their corresponding three-dimensional positions are newly added, thereby increasing the types and scope of disease positions. Therefore, when the disease location model corresponding to the disease data is inaccurate, the first neural network trained with more training data can be used to correct the three-dimensional location of the disease data.
  • the first neural network can be directly used to obtain the three-dimensional location of the disease based on the disease data. Since the trained neural network has a predictive function, when the disease data cannot correspond to at least one of the disease location models, the three-dimensional position of the disease can be obtained through the neural network with the predictive function.
  • the three-dimensional position of the disease after obtaining the three-dimensional position of the disease, it can be displayed on the corresponding organ model to achieve human-computer interaction.
  • the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
  • a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. 3D position, and then use neural network to analyze the disease data to obtain the corrected 3D position of the disease, so as to realize the 3D display of the disease on the 3D model, to more accurately show the disease information to the user, and to improve the interaction between the disease and abnormal indicators Display effect, improve efficiency and user experience.
  • the three-dimensional location of the disease can be directly obtained by a second neural network trained using training data different from the disease classification information.
  • the element characteristics of some disease data may not correspond to the existing disease location model.
  • the second neural network can be trained through training data composed of other disease classification information or disease location models, and the second neural network can be used. The network obtains the three-dimensional position of the disease.
  • the second neural network is obtained by training with training data
  • the training data includes feature data and identification tags
  • the feature data includes disease classification information different from the disease classification information
  • the identification tags include the same as the feature data.
  • the second neural network may also be Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), Back Propagation (BP), Linear Neural Network, etc., here No restrictions.
  • CNN Convolutional Neural Networks
  • RNN Recurrent Neural Network
  • BP Back Propagation
  • Linear Neural Network etc., here No restrictions.
  • the training data uses disease classification information different from the disease classification information, thereby increasing the type and range of disease locations. Therefore, when the disease data cannot correspond to at least one of the multiple disease location models, the three-dimensional location of the disease can be directly obtained through the second neural network.
  • the three-dimensional position of the disease after obtaining the three-dimensional position of the disease, it can be displayed on the corresponding organ model to achieve human-computer interaction.
  • the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
  • a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model.
  • the three-dimensional position when the disease data cannot correspond to at least one of the multiple disease position models, based on the disease data, the three-dimensional position of the disease is directly obtained through the second neural network to obtain the three-dimensional position of the disease, thereby Realize the 3D display of the disease on the 3D model to more accurately show the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
  • FIGS. 1-3 After the disease location acquisition method according to the embodiment of the present disclosure is described above through FIGS. 1-3, the following describes an example of the disease location acquisition according to the embodiment of the present disclosure based on FIG. 4.
  • Fig. 4 shows a schematic diagram of an example of acquiring the location of a disease according to an embodiment of the present disclosure.
  • the disease data may be obtained from one or more of the health assessment 51, the physical examination report 52, the health data 53, and the peripheral input 54.
  • the element characteristics of the disease data are obtained from the disease data, and then the element characteristics of the disease data are mapped to the disease classification information 55 to obtain the disease name corresponding to the disease data.
  • the multiple disease location models 56 are obtained through the disease classification information 55, the element characteristics of the disease data can be mapped to the multiple disease location models 56 to obtain the three-dimensional location of the disease, thereby achieving 3D display.
  • the disease classification information contains various descriptions of the disease, based on the element characteristics of the disease data, the disease location acquisition method can also be used to obtain the disease or problem corresponding to the disease data.
  • the disease information display method provided in this application generally runs through electronic equipment to realize information interaction with the user. After turning on the electronic equipment to enter the display interface of disease information display (for example, the digital human body APP), the initial display on the display interface is usually A complete three-dimensional human body model is generally presented as a three-dimensional human body image that is upright and in a natural stretched state. In addition, highlight the diseased organ in the place where the disease is detected so that the patient can understand it.
  • disease information display for example, the digital human body APP
  • FIG. 5 is a schematic diagram of a display interface for displaying human body information according to an embodiment of the disclosure.
  • FIG. 6 is a schematic diagram of a display interface for displaying diseases according to an embodiment of the disclosure.
  • the curve includes at least one of the following: elliptical arc and spiral; the elliptical arc surrounds the position of the chest cavity of the three-dimensional human model; the spiral extends from the foot of the three-dimensional human model to the head of the three-dimensional human model; curve and display
  • the interface is relatively static.
  • the curve can also be another form of geometric curve that can surround the three-dimensional human body model. It can be one or two parallel displayed at a certain interval, or when the curve is a spiral line, it can appear as a double helix structure. Of course, the quantity It can even be 3, 4, etc., which can be set according to actual needs.
  • the human body information tags correspond to different parts of the three-dimensional human body model. Different parts of the three-dimensional human body model can be determined according to multiple classifications.
  • the human body information label includes at least one of the following: human organ category information, Human body system category information or human body parameter information; the distance between adjacent human body information labels on the curve is equal.
  • human organ category information is classified according to organs, including heart, liver, spleen, lung, kidney, etc., and according to human system categories, including circulatory system, digestive system, respiratory system, reproductive system, immune system, etc., or according to Partial classification, including head, chest, upper and lower limbs, etc. It even includes other human body parameter information related to human health, such as health history data, trauma data, etc.
  • human body information labels are set along the curve.
  • the human body information labels on the curve are of different sizes, but the distance between adjacent human body information labels on the curve is equal. As it gets farther and farther from the middle position, the human body information label gradually becomes smaller.
  • the human body information labels can also be set to different states.
  • the curve includes a preset prominent area and a preset non-highlighted area.
  • On the display interface displaying the three-dimensional human body model at least one curve surrounding the human body model is displayed, and a number of human body information labels are set on the curve, specifically including: if the human body information label moves to the preset highlight area, the human body information label is enlarged and displayed, and Set the human body information label to the activated state; if the human body information label moves to the preset non-protruding area, the human body information label is reduced to be displayed, and the human body information label is set to the inactive state.
  • the human body information label can move on the curve, and at a specific position of the curve, for example, on the curve segment close to the central axis of the three-dimensional human body model, the human body information label moves to this preset highlight area, then the human body information label is activated , The appearance is shown in an enlarged state, can be selected, and the next operation is performed accordingly, the other areas are the preset non-protruding areas, and the human body information tags in the preset non-protruding areas are in the inactive state, so compare them accordingly. Small size display.
  • the process of zooming in and out is also displayed on the display interface, which can form a vivid three-dimensional dynamic process and improve the user's immersion in human-computer interaction.
  • the characteristics of changing the brightness and color of the human body information label can also be added.
  • the corresponding position of the three-dimensional human body model is highlighted, so as to realize the 3D display of the disease on the 3D model, so as to show the user more accurately Disease information to enhance user experience.
  • FIG. 7 is a functional block diagram illustrating a disease location acquiring device according to an embodiment of the present disclosure.
  • a disease location acquiring device 1000 according to an embodiment of the present disclosure includes an element feature acquiring unit 1001 and a three-dimensional location acquiring unit 1002.
  • the above-mentioned modules can respectively execute the steps of the method for acquiring the location of the disease according to the embodiment of the present disclosure as described above with reference to FIGS. 1 to 3.
  • these unit modules can be implemented in various ways by hardware alone, software alone, or a combination thereof, and the present disclosure is not limited to any one of them.
  • CPU central processing unit
  • GPU image processor
  • TPU tensor processor
  • FPGA field programmable logic gate array
  • Processing units and corresponding computer instructions implement these units.
  • the element feature acquiring unit 1001 is configured to acquire the element feature of the disease data through the disease data.
  • the disease data may be data related to the user's current disease, which may be obtained from the user's personal health information.
  • the user's disease data can be obtained from analyzing one or more of health assessment, physical examination report, health data, and peripheral input.
  • the three-dimensional position acquiring unit 1002 is configured to acquire the three-dimensional position of the disease using multiple disease location models based on the element characteristics of the disease data, wherein the multiple disease location models respectively correspond to different three-dimensional positions of the body.
  • multiple disease location models are obtained by dividing disease classification information based on different three-dimensional locations of the body.
  • the disease classification information can be ICD10 or other suitable disease classification databases, which is not limited here.
  • the disease classification information may correspond to different disease names, and each disease classification information contains at least one name tag corresponding to it.
  • the element characteristics of the disease data may be matched to at least one of the disease classification information.
  • the name tag obtains the disease name corresponding to the disease data.
  • a disease location model can be obtained based on ICD10.
  • the diseases in the ICD10 can be integrated and analyzed, and the ICD10 can be divided into multiple disease location models based on different human organs or tissues, so as to map the diseases to the 3D model.
  • the three-dimensional position obtaining unit 1002 may correspond the element feature of the disease data to at least one label in the multiple disease position models to obtain the three-dimensional position of the disease.
  • the above process of matching disease data to the encoding of the disease location model can be automatically completed by a computer.
  • the technical effect of matching the disease data to the encoding of the disease location model can also be achieved through a neural network or other methods, which will not be repeated here.
  • the three-dimensional position of the disease After obtaining the three-dimensional position of the disease, it can be displayed on the corresponding organ model to realize human-computer interaction. For example, the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
  • the three-dimensional position acquiring unit 1002 can use the neural network to analyze the disease data to obtain the corrected three-dimensional position of the disease.
  • the three-dimensional position obtaining unit 1002 may obtain the corrected three-dimensional position of the disease through the first neural network based on the disease data.
  • the first neural network is obtained by training with training data
  • the training data includes feature data and identification tags
  • the feature data includes multiple disease information
  • the identification tags include three-dimensional positions corresponding to the multiple disease information
  • the plurality of disease information includes disease data of a plurality of different diseases.
  • the three-dimensional position obtaining unit 1002 may directly obtain the three-dimensional position of the disease through the first neural network.
  • the three-dimensional position obtaining unit 1002 may obtain the three-dimensional position of the disease through a second neural network based on the disease data.
  • the second neural network is obtained by training with training data.
  • the training data includes feature data and identification labels
  • the feature data includes disease classification information that is different from the disease classification information
  • the identification labels include diseases that are different from those included in the feature data.
  • the three-dimensional position corresponding to the classification information, and the plurality of disease information includes disease data of a plurality of different diseases.
  • a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. Three-dimensional position.
  • the three-dimensional position acquiring unit 1002 can then use the neural network to analyze the disease data to obtain the corrected three-dimensional position of the disease.
  • the three-dimensional location obtaining unit 1002 may also directly obtain the three-dimensional location of the disease through the first neural network or the second neural network based on the disease data. , So as to realize the 3D display of the disease on the 3D model, to more accurately display the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
  • FIG. 8 is a schematic diagram of a disease location acquiring device 2000 according to an embodiment of the present disclosure. Since the disease location acquisition device of this embodiment has the same details as the method described above with reference to FIG. 1, for the sake of simplicity, detailed description of the same content is omitted here.
  • the disease location acquisition device 2000 includes a processor 210, a memory 220, and one or more computer program modules 221.
  • the processor 210 and the memory 220 are connected through a bus system 230.
  • one or more computer program modules 221 are stored in the memory 220.
  • one or more computer program modules 221 include instructions for executing the disease location acquisition method provided by any embodiment of the present disclosure.
  • instructions in one or more computer program modules 221 may be executed by the processor 210.
  • the bus system 230 may be a commonly used serial or parallel communication bus, etc., which is not limited in the embodiments of the present disclosure.
  • the processor 210 may be a central processing unit (CPU), a digital signal processor (DSP), an image processor (GPU), or other forms of processing units with data processing capabilities and/or instruction execution capabilities, and may be general-purpose processing units.
  • CPU central processing unit
  • DSP digital signal processor
  • GPU image processor
  • the memory 220 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory.
  • the volatile memory may include random access memory (RAM) and/or cache memory (cache), for example.
  • the non-volatile memory may include read-only memory (ROM), hard disk, flash memory, etc., for example.
  • One or more computer program instructions may be stored on a computer-readable storage medium, and the processor 210 may run the program instructions to implement the functions (implemented by the processor 210) and/or other desired functions in the embodiments of the present disclosure, For example, how to obtain the location of the disease.
  • the computer-readable storage medium can also store various application programs and various data, such as element characteristics of disease data, disease location models, and various data used and/or generated by the application programs.
  • the embodiment of the present disclosure does not provide all the components of the disease location acquisition device 2000.
  • those skilled in the art can provide and set other unshown component units according to specific needs, which are not limited in the embodiments of the present disclosure.
  • the disease location acquiring device 1000 and the disease location acquiring device 2000 can be used in various appropriate electronic devices.
  • FIG. 9 is a schematic structural diagram of an electronic device provided by at least one embodiment of the present disclosure.
  • Terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc.
  • the electronic device shown in FIG. 9 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
  • the electronic device includes the disease location acquiring device 1000 provided by any embodiment of the present disclosure and a display interface (for example, the output device 307 shown in FIG. 9); wherein the display interface is configured to display a three-dimensional human body model,
  • the three-dimensional human body model displays disease classification information at the three-dimensional position obtained by the above-mentioned disease position acquisition method, and highlights the organ corresponding to the obtained three-dimensional position.
  • the electronic device 300 includes a processing device (such as a central processing unit, a graphics processor, etc.) 301, which can be based on a program stored in a read-only memory (ROM) 302 or from a storage device.
  • the device 308 loads a program in a random access memory (RAM) 303 to perform various appropriate actions and processing.
  • RAM random access memory
  • various programs and data required for the operation of the computer system are also stored.
  • the processing device 301, the ROM 302, and the RAM 303 are connected by the bus 304 here.
  • An input/output (I/O) interface 305 is also connected to the bus 304.
  • the following components can be connected to the I/O interface 305: including input devices 306 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including input devices such as liquid crystal displays (LCD), speakers, vibration
  • the output device 307 of the device, etc. includes a storage device 308 such as a magnetic tape, a hard disk, etc.; and a communication device 309 including a network interface card such as a LAN card, a modem, and the like.
  • the communication device 309 may allow the electronic device 300 to perform wireless or wired communication with other devices to exchange data, and perform communication processing via a network such as the Internet.
  • the driver 310 is also connected to the I/O interface 305 as needed.
  • FIG. 9 shows the electronic device 300 including various devices, it should be understood that it is not required to implement or include all of the illustrated devices. More or fewer devices may be implemented alternatively or included.
  • the electronic device 300 may further include a peripheral interface (not shown in the figure) and the like.
  • the peripheral interface can be various types of interfaces, such as a USB interface, a lightning interface, and the like.
  • the communication device 309 can communicate with a network and other devices through wireless communication, such as the Internet, an intranet, and/or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and/or a metropolitan area network (MAN).
  • wireless communication such as the Internet, an intranet, and/or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and/or a metropolitan area network (MAN).
  • LAN wireless local area network
  • MAN metropolitan area network
  • Wireless communication can use any of a variety of communication standards, protocols and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA) , Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wi-Fi (e.g. based on IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n standards), voice transmission based on Internet protocol (VoIP), Wi-MAX, protocols used for e-mail, instant messaging and/or short message service (SMS), or any other suitable communication protocol.
  • GSM Global System for Mobile Communications
  • EDGE Enhanced Data GSM Environment
  • W-CDMA Wideband Code Division Multiple Access
  • CDMA Code Division Multiple Access
  • TDMA Time Division Multiple Access
  • Wi-Fi e.g. based on IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n standards
  • VoIP Internet protocol
  • Wi-MAX
  • the electronic device can be any device such as a mobile phone, a tablet computer, a notebook computer, an e-book, a game console, a television, a digital photo frame, a navigator, etc., or can be any combination of electronic devices and hardware. This is not limited.
  • an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart.
  • the computer program may be downloaded and installed from the network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302.
  • the processing device 301 the above-mentioned disease location acquisition function defined in the method of the embodiment of the present disclosure is executed.
  • the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above.
  • Computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein.
  • This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
  • the computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
  • the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
  • the client and server can communicate with any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium.
  • Communication e.g., communication network
  • Examples of communication networks include local area networks (“LAN”), wide area networks (“WAN”), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.
  • the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
  • the above-mentioned computer-readable medium carries one or more programs.
  • the electronic device obtains at least two Internet protocol addresses; A node evaluation request for an Internet Protocol address, the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; the obtained Internet Protocol address Indicates the edge node in the content distribution network.
  • the aforementioned computer-readable medium carries one or more programs, and when the aforementioned one or more programs are executed by the electronic device, the electronic device: receives a node evaluation request including at least two Internet Protocol addresses; Among at least two Internet Protocol addresses, an Internet Protocol address is selected; the selected Internet Protocol address is returned; the received Internet Protocol address indicates an edge node in the content distribution network.
  • the computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or a combination thereof.
  • the above-mentioned programming languages include but are not limited to object-oriented programming languages such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages.
  • the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
  • the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).
  • LAN local area network
  • WAN wide area network
  • exemplary types of hardware logic components include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
  • FPGA Field Programmable Gate Array
  • ASIC Application Specific Integrated Circuit
  • ASSP Application Specific Standard Product
  • SOC System on Chip
  • CPLD Complex Programmable Logical device
  • a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device.
  • the machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • the machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing.
  • machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM compact disk read-only memory
  • magnetic storage device or any suitable combination of the above.
  • FIG. 10 is a schematic diagram of a storage medium provided by at least one embodiment of the present disclosure.
  • the storage medium 400 non-transitory stores computer-readable instructions 401, and when the non-transitory computer-readable instructions are executed by a computer (including a processor), any one of the embodiments of the present disclosure can be executed. How to get the location of the disease.
  • the storage medium may be any combination of one or more computer-readable storage media.
  • one computer-readable storage medium contains computer-readable program code for determining the number of display faces of the sub-model, and another computer-readable storage medium
  • the medium contains computer-readable program code that determines the location of the disease.
  • the computer can execute the program code stored in the computer storage medium, and execute, for example, the disease location acquisition method provided in any embodiment of the present disclosure.
  • the storage medium may include a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), Portable compact disk read-only memory (CD-ROM), flash memory, or any combination of the foregoing storage media may also be other suitable storage media.
  • RAM random access memory
  • ROM read-only memory
  • EPROM erasable programmable read-only memory
  • CD-ROM Portable compact disk read-only memory
  • flash memory or any combination of the foregoing storage media may also be other suitable storage media.

Abstract

A human disease location acquisition method, an apparatus, a device and a computer readable storage medium. Said method comprises: acquiring element features of disease data by means of the disease data (S101); and acquiring, on the basis of the element features of the disease data, a three-dimensional location of the disease by using a plurality of disease location models, the plurality of disease location models respectively corresponding to different three-dimensional locations of a body (S102). By means of said method, the display of a disease on a 3D model can be implemented, so that disease information is displayed to a user more accurately, improving the interactive display effect of a disease and an abnormal indicator, and improving the efficiency and user experience.

Description

疾病位置获取方法、装置、设备以及计算机可读存储介质Disease location acquisition method, device, equipment and computer readable storage medium 技术领域Technical field
本申请涉及计算机人机交互技术领域,具体而言,本申请涉及一种人体疾病位置获取方法、装置、设备、计算机可读存储介质及电子设备。This application relates to the field of computer human-computer interaction technology. Specifically, this application relates to a method, device, equipment, computer-readable storage medium, and electronic equipment for obtaining the location of human diseases.
背景技术Background technique
健康始终是人们关注的重要议题,随着计算机技术以及通信技术的发展,人体疾病和检查异常多以二维(2D)的形式展示在显示界面中。但是由于2D存在维度限制,无法展示三维(3D)复杂的穿插结构和构造,因此不能快速定位病变部位和异常,使得不能向用户展示准确的医学图示,造成用户误解。Health has always been an important issue that people pay attention to. With the development of computer technology and communication technology, human diseases and examination abnormalities are mostly displayed in the form of two-dimensional (2D) in the display interface. However, due to the dimensional limitation of 2D, it is impossible to display three-dimensional (3D) complex interspersed structures and structures, and therefore cannot quickly locate lesions and abnormalities, which makes it impossible to display accurate medical diagrams to users, causing users to misunderstand.
发明内容Summary of the invention
鉴于上述问题而提出了本公开。本公开提供了一种人体疾病位置获取方法、装置、设备、计算机可读存储介质及电子设备。The present disclosure is made in view of the above-mentioned problems. The present disclosure provides a method, device, equipment, computer-readable storage medium, and electronic equipment for acquiring the location of human diseases.
根据本公开的一个方面,提供了一种疾病位置获取方法,包括:通过疾病数据获取所述疾病数据的元素特征;以及基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。According to one aspect of the present disclosure, there is provided a method for acquiring a disease location, including: acquiring element characteristics of the disease data through disease data; and acquiring the disease using multiple disease location models based on the element characteristics of the disease data The three-dimensional position of the disease, wherein the multiple disease position models respectively correspond to different three-dimensional positions of the body.
根据本公开的一个示例,所述多个疾病位置模型对应于多个人体器官,且每个模型包含与其对应的至少一个标签,所述基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置包括:将所述疾病数据的元素特征对应到所述多个疾病位置模型中的至少一个标签,以获得所述疾病的三维位置。According to an example of the present disclosure, the multiple disease location models correspond to multiple human organs, and each model includes at least one tag corresponding to it, and the multiple disease location models are used based on the element characteristics of the disease data. Obtaining the three-dimensional location of the disease includes: corresponding element features of the disease data to at least one label in the multiple disease location models to obtain the three-dimensional location of the disease.
根据本公开的一个示例,所述方法还包括:基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置,其中,所述第一神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括多个疾病信息,所述识别标签包括与所述多个疾病信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。According to an example of the present disclosure, the method further includes: obtaining a corrected three-dimensional position of the disease through a first neural network based on the disease data, wherein the first neural network is obtained through training data training, The training data includes feature data and identification tags, the feature data includes multiple disease information, the identification tags include three-dimensional positions corresponding to the multiple disease information, and the multiple disease information includes multiple disease information. Disease data.
根据本公开的一个示例,所述方法还包括:在疾病数据的元素特征无法 对应到所述多个疾病位置模型中的至少一个时,基于所述疾病数据,通过第二神经网络获得所述疾病的三维位置,其中,所述第二神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括与所述疾病分类信息不同的疾病分类信息,所述识别标签包括特征数据中包括的疾病分类信息对应的三维位置。According to an example of the present disclosure, the method further includes: when the element feature of the disease data cannot correspond to at least one of the multiple disease location models, obtaining the disease through a second neural network based on the disease data Wherein the second neural network is obtained by training with training data, the training data includes feature data and identification tags, the feature data includes disease classification information that is different from the disease classification information, and The identification label includes the three-dimensional position corresponding to the disease classification information included in the feature data.
根据本公开的一个示例,所述多个疾病位置模型是通过疾病分类信息基于身体的不同的三维位置划分得到的。According to an example of the present disclosure, the multiple disease location models are obtained by dividing the disease classification information based on different three-dimensional locations of the body.
根据本公开的一个示例,所述疾病分类信息对应于不同的疾病名称,且每个疾病分类信息包含与其对应的至少一个名称标签,所述方法还包括:将所述疾病数据的元素特征匹配到所述疾病分类信息的至少一个名称标签以获得所述疾病数据对应的疾病名称。According to an example of the present disclosure, the disease classification information corresponds to different disease names, and each disease classification information contains at least one name tag corresponding to the disease classification information. The method further includes: matching element characteristics of the disease data to At least one name tag of the disease classification information to obtain the disease name corresponding to the disease data.
根据本公开的一个示例,所述疾病数据是从健康测评、体检报告、健康数据和外设输入中的一个或多个中获得的。According to an example of the present disclosure, the disease data is obtained from one or more of health assessment, physical examination report, health data, and peripheral input.
根据本公开的一个示例,在获得所述疾病的三维位置后,在三维人体结构上高亮显示所述三维位置。According to an example of the present disclosure, after obtaining the three-dimensional position of the disease, the three-dimensional position is highlighted on the three-dimensional human body structure.
根据本公开的一个方面,提供了一种疾病位置获取装置,包括:元素特征获取单元,用于通过疾病数据获取所述疾病数据的元素特征;以及三维位置获取单元,用于基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。According to one aspect of the present disclosure, there is provided a device for acquiring a disease location, including: an element feature acquiring unit for acquiring element features of the disease data through disease data; and a three-dimensional location acquiring unit for acquiring disease data based on the disease data. Using multiple disease location models to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
根据本公开的一个示例,所述多个疾病位置模型对应于多个人体器官,且每个模型包含与其对应的至少一个标签,所述三维位置获取单元将所述疾病数据的元素特征对应到所述多个疾病位置模型中的至少一个标签,以获得所述疾病的三维位置。According to an example of the present disclosure, the multiple disease location models correspond to multiple human organs, and each model contains at least one tag corresponding to it, and the three-dimensional location acquisition unit corresponds to the element characteristics of the disease data to all the human organs. At least one label in the multiple disease location models to obtain the three-dimensional location of the disease.
根据本公开的一个示例,该装置还包括:三维位置获取单元基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置,其中,所述第一神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括多个疾病信息,所述识别标签包括与所述多个疾病信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。According to an example of the present disclosure, the device further includes: a three-dimensional position obtaining unit obtains the corrected three-dimensional position of the disease through a first neural network based on the disease data, wherein the first neural network is trained through training data Obtained, the training data includes feature data and identification tags, the feature data includes multiple disease information, the identification tags include three-dimensional positions corresponding to the multiple disease information, and the multiple disease information includes multiple Disease data for different diseases.
根据本公开的一个示例,该装置还包括:在疾病数据的元素特征无法对应到所述多个疾病位置模型中的至少一个时,所述三维位置获取单元基于所 述疾病数据,通过第二神经网络获得所述疾病的三维位置,其中,所述第二神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括与所述疾病分类信息不同的疾病分类信息,所述识别标签包括与所述特征数据中包括的疾病分类信息对应的三维位置。According to an example of the present disclosure, the device further includes: when the element feature of the disease data cannot correspond to at least one of the multiple disease position models, the three-dimensional position acquisition unit is based on the disease data through the second nerve The network obtains the three-dimensional position of the disease, wherein the second neural network is obtained by training with training data, the training data includes feature data and identification tags, and the feature data includes diseases that are different from the disease classification information Classification information, and the identification label includes a three-dimensional position corresponding to the disease classification information included in the characteristic data.
根据本公开的一个示例,所述多个疾病位置模型是通过疾病分类信息基于身体的不同的三维位置划分得到的。According to an example of the present disclosure, the multiple disease location models are obtained by dividing the disease classification information based on different three-dimensional locations of the body.
根据本公开的一个示例,所述疾病分类信息对应于不同的疾病名称,且每个疾病分类信息包含与其对应的至少一个名称标签,所述三维位置获取单元将所述疾病数据的元素特征匹配到所述疾病分类信息的至少一个名称标签以获得所述疾病数据对应的疾病名称。According to an example of the present disclosure, the disease classification information corresponds to different disease names, and each disease classification information contains at least one name tag corresponding to it, and the three-dimensional position acquisition unit matches the element characteristics of the disease data to At least one name tag of the disease classification information to obtain the disease name corresponding to the disease data.
根据本公开的一个示例,所述三维位置获取单元在获得所述疾病的三维位置后,在三维人体结构上高亮显示所述三维位置。According to an example of the present disclosure, after obtaining the three-dimensional position of the disease, the three-dimensional position obtaining unit highlights the three-dimensional position on the three-dimensional human body structure.
根据本公开的一个方面,提供了一种疾病位置获取设备,包括:处理器;以及存储器,其中存储计算机可读指令,其中,在所述计算机可读指令被所述处理器运行时执行疾病位置获取方法,所述方法包括:通过疾病数据获取所述疾病数据的元素特征;以及基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。According to one aspect of the present disclosure, there is provided a disease location acquisition device, including: a processor; and a memory, in which computer-readable instructions are stored, wherein the disease location is executed when the computer-readable instructions are executed by the processor An acquiring method, the method comprising: acquiring element characteristics of the disease data through disease data; and acquiring the three-dimensional position of the disease using multiple disease location models based on the element characteristics of the disease data, wherein the multiple diseases The position models respectively correspond to different three-dimensional positions of the body.
根据本公开的一个方面,提供了一种用于存储计算机可读程序的计算机可读存储介质,所述程序使得计算机执行如上所述的疾病位置获取方法。According to one aspect of the present disclosure, there is provided a computer-readable storage medium for storing a computer-readable program, which causes a computer to execute the disease location acquisition method as described above.
根据本公开的一个方面,提供了一种电子设备,包括上述疾病位置获取装置和显示界面;其中,所述显示界面被配置为显示三维人体模型,所述三维人体模型在采用上述疾病位置获取方法得到的三维位置处显示疾病分类信息,并高亮显示得到的三维位置对应的器官。According to one aspect of the present disclosure, there is provided an electronic device including the above-mentioned disease location acquisition device and a display interface; wherein the display interface is configured to display a three-dimensional human body model, and the three-dimensional human body model uses the above-mentioned disease location acquisition method. The disease classification information is displayed at the obtained three-dimensional position, and the organ corresponding to the obtained three-dimensional position is highlighted.
在本公开的上述方面中,提出了一种疾病位置获取方法,具体来说,本公开基于不同的三维位置创建疾病位置模型,然后通过将获得的疾病数据映射到疾病位置模型中来获得疾病的三维位置,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升疾病和异常指标的交互展示效果,提升效率以及用户体验。In the above aspects of the present disclosure, a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. Three-dimensional position, so as to realize the 3D display of the disease on the 3D model, to more accurately show the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
附图说明Description of the drawings
通过结合附图对本公开实施例进行更详细的描述,本公开的上述以及其它目的、特征和优势将变得更加明显。附图用来提供对本公开实施例的进一步理解,并且构成说明书的一部分,与本公开实施例一起用于解释本公开,并不构成对本公开的限制。在附图中,相同的参考标号通常代表相同部件或步骤。Through a more detailed description of the embodiments of the present disclosure in conjunction with the accompanying drawings, the above and other objectives, features, and advantages of the present disclosure will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the present disclosure, and constitute a part of the specification, and are used to explain the present disclosure together with the embodiments of the present disclosure, and do not constitute a limitation to the present disclosure. In the drawings, the same reference numerals generally represent the same components or steps.
图1示出了根据本公开实施例的疾病位置获取方法的流程图;Fig. 1 shows a flowchart of a method for acquiring a disease location according to an embodiment of the present disclosure;
图2是概述根据本公开实施例的神经网络模型的训练方法的应用场景的示意图;2 is a schematic diagram outlining an application scenario of a training method of a neural network model according to an embodiment of the present disclosure;
图3示出了根据本公开另一实施例的疾病位置获取方法的流程图;Fig. 3 shows a flowchart of a method for acquiring a disease location according to another embodiment of the present disclosure;
图4示出了根据本公开实施例的疾病位置获取示例的示意图;FIG. 4 shows a schematic diagram of an example of acquiring a disease location according to an embodiment of the present disclosure;
图5示出了根据本公开实施例的人体信息展示的显示界面示意图;Fig. 5 shows a schematic diagram of a display interface for displaying human body information according to an embodiment of the present disclosure;
图6示出了根据本公开实施例的疾病展示的显示界面示意图;Fig. 6 shows a schematic diagram of a display interface for disease display according to an embodiment of the present disclosure;
图7示出了根据本公开实施例的疾病位置获取装置的框图;FIG. 7 shows a block diagram of a device for acquiring a disease location according to an embodiment of the present disclosure;
图8示出了根据本公开实施例的疾病位置获取设备的框图;Fig. 8 shows a block diagram of a disease location acquiring device according to an embodiment of the present disclosure;
图9示出了根据本公开实施例的电子设备的结构示意图;以及FIG. 9 shows a schematic structural diagram of an electronic device according to an embodiment of the present disclosure; and
图10示出了根据本公开实施例的存储介质的示意图。FIG. 10 shows a schematic diagram of a storage medium according to an embodiment of the present disclosure.
具体实施方式Detailed ways
下面将结合本公开实施例中的附图,对本公开实施例中的技术方案进行清楚、完整地描述。显然,所描述的实施例仅是本公开一部分的实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例,都属于本公开保护的范围。The technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.
本公开中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。同样,“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同,而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电性的连接,不管是直接的还是间接的。“上”、“下”、“左”、“右”等仅用于表示相对位置关系,当被描述对象的绝对位置改变后,则该相对位置关系也可能相应地改变。The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity, or importance, but are only used to distinguish different components. Similarly, "including" or "including" and other similar words mean that the element or item appearing before the word covers the element or item listed after the word and their equivalents, but does not exclude other elements or items. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "Down", "Left", "Right", etc. are only used to indicate the relative position relationship. When the absolute position of the described object changes, the relative position relationship may also change accordingly.
本申请中使用了流程图用来说明根据本申请的实施例的方法的步骤。应当理解的是,前面或后面的步骤不一定按照顺序来精确的进行。相反,可以按照倒序或同时处理各种步骤。同时,也可以将其他操作添加到这些过程中,或 从这些过程移除某一步或数步。In this application, a flowchart is used to illustrate the steps of the method according to the embodiment of the application. It should be understood that the preceding or following steps are not necessarily performed in precise order. Instead, the various steps can be processed in reverse order or simultaneously. At the same time, you can also add other operations to these processes, or remove a step or several steps from these processes.
国际疾病分类(ICD10)是为了对世界各国人口的健康状况和分析死因的差别面对各种疾病作出的国际通用的统一分类。根据诊断情况为每位就诊病人分配正确的ICD10编码(即将ICD10编码添加到就诊病人的病历上)对临床应用和管理来说非常重要。但是在患者就诊时为其分配正确的ICD10编码仅仅为就诊病人找到对应的疾病或疾病的2D位置,但是无法精确定位到其疾病的3D位置,也就不能向用户展示准确的医学图示,容易造成用户误解。此外,在分配编码时,医疗编码人员需要查阅医生使用文本短语和句子描述的诊断以及电子病历中的其它信息,然后再按照编码指导以人工的方式分配合适的ICD10编码,在这个过程中容易出现多种错误,由此使得定位疾病位置也发生错误。例如,医生在写诊断描述时常常使用缩写和同义词,这会导致编码人员在将ICD10编码与这些缩写和同义词匹配时出现混淆和不准确的情况。The International Classification of Diseases (ICD10) is a unified international classification for various diseases in order to analyze the differences in the health status of the populations of the world and the cause of death. It is very important for clinical application and management to assign the correct ICD10 code to each patient according to the diagnosis (that is, to add the ICD10 code to the patient's medical record). However, assigning the correct ICD10 code to the patient when visiting a doctor only finds the 2D position of the corresponding disease or disease for the visiting patient, but cannot accurately locate the 3D position of the disease, and cannot show the user accurate medical icons. Cause user misunderstanding. In addition, when assigning codes, medical coders need to consult the doctor’s diagnosis using text phrases and sentences as well as other information in the electronic medical record, and then manually assign appropriate ICD10 codes according to the coding instructions. This is easy to happen in this process. A variety of errors have caused errors in locating the location of the disease. For example, doctors often use abbreviations and synonyms when writing diagnosis descriptions, which can lead to confusion and inaccuracy when coders match ICD10 codes with these abbreviations and synonyms.
此外,ICD10编码是以分层的结构组织的,其中上层编码表示范围宽泛的疾病类别,下层编码表示更特定的疾病。因此,当编码人员将诊断描述匹配到了一个过于宽泛的编码,而不是更加特定的编码的情况下,也会出现误编码,从而使得定位疾病位置变得更加困难。In addition, ICD10 codes are organized in a hierarchical structure, where the upper code represents a wide range of disease categories, and the lower code represents more specific diseases. Therefore, when the coder matches the diagnosis description to an overly broad code instead of a more specific code, a wrong code will also occur, which makes it more difficult to locate the disease location.
本公开提供了一种疾病位置获取方法,其基于不同的三维位置创建疾病位置模型,然后通过将获得的疾病数据映射到疾病位置模型中来获得疾病的三维位置,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升用户体验。The present disclosure provides a disease location acquisition method, which creates a disease location model based on different three-dimensional locations, and then obtains the three-dimensional location of the disease by mapping the acquired disease data to the disease location model, thereby realizing the disease on the 3D model 3D display to more accurately display disease information to users and improve user experience.
下面结合附图对本公开的实施例及其示例进行详细说明。The embodiments and examples of the present disclosure will be described in detail below with reference to the accompanying drawings.
本公开的至少一个实施例提供了一种疾病位置获取方法、疾病位置获取装置、疾病位置获取设备和计算机可读存储介质。下面通过几个示例和实施例对根据本公开的至少一个实施例提供的疾病位置获取进行非限制性说明,如下面所描述的,在不相互抵触的情况下,这些具体示例和实施例中不同特征可以相互组合,从而得到新的示例和实施例,这些新的示例和实施例也都属于本公开保护的范围。At least one embodiment of the present disclosure provides a method for acquiring a disease location, a device for acquiring a disease location, a device for acquiring a disease location, and a computer-readable storage medium. The following is a non-limiting description of the disease location acquisition provided according to at least one embodiment of the present disclosure through several examples and embodiments. As described below, these specific examples and embodiments are different if they do not conflict with each other. The features can be combined with each other to obtain new examples and embodiments, and these new examples and embodiments also fall within the protection scope of the present disclosure.
下面参照图1-4描述根据本公开实施例的疾病位置获取方法。首先,参照图1来描述根据本公开实施例的疾病位置获取方法。该方法可以由计算机等自动完成。例如,该方法可以应用于展示人体疾病的三维位置等。例如,该疾病位置获取方法可以以软件、硬件、固件或其任意组合的方式实现,由例如 手机、平板电脑、笔记本电脑、桌面电脑、网络服务器等设备中的处理器加载并执行。Hereinafter, a method for acquiring a disease location according to an embodiment of the present disclosure will be described with reference to FIGS. 1-4. First, a method for acquiring a disease location according to an embodiment of the present disclosure will be described with reference to FIG. 1. This method can be automatically completed by a computer or the like. For example, the method can be applied to display the three-dimensional position of human diseases and so on. For example, the method for acquiring the disease location can be implemented in software, hardware, firmware or any combination thereof, loaded and executed by a processor in a device such as a mobile phone, a tablet computer, a notebook computer, a desktop computer, and a network server.
例如,该疾病位置获取方法适用于一计算装置,该计算装置是包括具有计算功能的任何电子设备,例如可以为手机、笔记本电脑、平板电脑、台式计算机、网络服务器等,可以加载并执行该疾病位置获取方法,本公开的实施例对此不作限制。例如,该计算装置可以包括中央处理单元(Central Processing Unit,CPU)或图形处理单元(Graphics Processing Unit,GPU)等具有数据处理能力和/或指令执行能力的其它形式的处理单元、存储单元等,该计算装置上还安装有操作系统、应用程序编程接口(例如,OpenGL(Open Graphics Library)、Metal等)等,通过运行代码或指令的方式实现本公开实施例提供的疾病位置获取方法。例如,该计算装置还可以包括显示部件,该显示部件例如为液晶显示屏(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light Emitting Diode,OLED)显示屏、量子点发光二极管(Quantum Dot Light Emitting Diode,QLED)显示屏、投影部件、VR头戴式显示设备(例如VR头盔、VR眼镜)等,本公开的实施例对此不作限制。例如,该显示部件可以显示待显示对象。For example, the method for obtaining the location of the disease is applicable to a computing device that includes any electronic device with computing functions, such as a mobile phone, a laptop, a tablet, a desktop computer, a web server, etc., which can load and execute the disease The location acquisition method is not limited in the embodiment of the present disclosure. For example, the computing device may include a central processing unit (CPU) or a graphics processing unit (Graphics Processing Unit, GPU) and other forms of processing units, storage units, etc. that have data processing capabilities and/or instruction execution capabilities, The computing device is also installed with an operating system, an application programming interface (for example, OpenGL (Open Graphics Library), Metal, etc.), etc., and the method for acquiring the disease location provided in the embodiments of the present disclosure is implemented by running code or instructions. For example, the computing device may also include a display component, such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, and a quantum dot light emitting diode (Quantum Dot Light Emitting). Diode, QLED) display screens, projection components, VR head-mounted display devices (for example, VR helmets, VR glasses), etc., which are not limited in the embodiments of the present disclosure. For example, the display part can display the object to be displayed.
如图1所示,该疾病位置获取方法包括以下的步骤S101-步骤S102。As shown in Fig. 1, the method for acquiring the location of the disease includes the following steps S101 to S102.
在步骤S101,通过疾病数据获取所述疾病数据的元素特征。In step S101, the element characteristics of the disease data are acquired through the disease data.
在步骤S102,基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。In step S102, based on the element characteristics of the disease data, multiple disease location models are used to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
对于步骤S101,例如,疾病数据可以是与用户的当前疾病有关的数据,其包含对疾病的语言描述,其可以从用户的个人健康信息中获取。例如,从解析健康测评、体检报告、健康数据和外设输入的一个或多个来获得用户的疾病数据。例如,疾病数据可以是给定的病历(或健康数据)的主诉、现病史、既往史以及医生给出的诊断结果等中与当前疾病有关的数据。在本公开的实施例中,疾病数据可以是手写数据,通过OCR或人工阅读的方法获取疾病数据中所需的数据;还可以是电子疾病数据,可以通过电子疾病数据的管理平台导出所需的数据。For step S101, for example, the disease data may be data related to the user's current disease, which contains a language description of the disease, which can be obtained from the user's personal health information. For example, the user's disease data can be obtained from analyzing one or more of health assessment, physical examination report, health data, and peripheral input. For example, the disease data may be data related to the current disease in the main complaint of a given medical record (or health data), current medical history, past history, and diagnosis results given by a doctor. In the embodiments of the present disclosure, the disease data can be handwritten data, and the data required in the disease data can be obtained through OCR or manual reading; it can also be electronic disease data, which can be exported through the electronic disease data management platform data.
例如,多个疾病位置模型是通过疾病分类信息基于身体的不同的三维位置划分得到的。例如,疾病分类信息可以是ICD10,也可以是其他合适的疾病 分类库,这里不做限制。For example, multiple disease location models are obtained by dividing disease classification information based on different three-dimensional locations of the body. For example, the disease classification information can be ICD10 or other suitable disease classification databases, which is not limited here.
例如,疾病分类信息可以对应于不同的疾病名称,且每个疾病分类信息包含与其对应的至少一个名称标签,此时,可以将所述疾病数据的元素特征匹配到所述疾病分类信息的至少一个名称标签以获得所述疾病数据对应的疾病名称。例如,疾病分类信息中的糖尿病对应于标签1,那么在疾病数据的元素特征与糖尿病对应的情况下将该疾病数据匹配到疾病分类信息中的标签1,从而获得该疾病数据对应的疾病名称为糖尿病。For example, the disease classification information may correspond to different disease names, and each disease classification information contains at least one name tag corresponding to it. In this case, the element characteristics of the disease data may be matched to at least one of the disease classification information. The name tag obtains the disease name corresponding to the disease data. For example, diabetes in the disease classification information corresponds to label 1, then when the element characteristics of the disease data correspond to diabetes, the disease data is matched to label 1 in the disease classification information, so that the disease name corresponding to the disease data is diabetes.
对于步骤S101,例如,疾病数据的元素特征可以由疾病数据的各个元素的向量表示或字向量表示。例如,可以利用神经网络获取将疾病分类信息中的各个疾病匹配到疾病数据中的概率,若概率大于预定阈值,则将所述概率对应的疾病分类信息中的该疾病匹配到所述疾病数据中,从而获取所述疾病的名称。For step S101, for example, the element characteristics of the disease data can be represented by a vector representation or a word vector of each element of the disease data. For example, a neural network can be used to obtain the probability of matching each disease in the disease classification information to the disease data. If the probability is greater than a predetermined threshold, the disease in the disease classification information corresponding to the probability is matched to the disease data. To get the name of the disease.
应当认识到,上述根据疾病数据获取疾病名称的方法不限于此,还可以采用其他有效的方法获取疾病名称,这里不再赘述。It should be realized that the above method of obtaining disease names based on disease data is not limited to this, and other effective methods can also be used to obtain disease names, which will not be repeated here.
此外,由于在患者就诊时为其分配正确的疾病分类信息编码或标签仅仅为就诊病人找到对应的疾病或者2D位置,但是无法精确定位到其疾病的3D位置。为此,可以基于疾病分类信息,获取多个疾病位置模型,所述多个疾病位置模型分别对应于身体的不同的三维位置。例如,可以基于ICD10得到疾病位置模型。例如,可以整合分析ICD10中的13904例疾病,基于不同的人体器官或组织将ICD10划分为多个疾病位置模型,从而将疾病对应到3D模型上。例如,可以通过分类器(诸如聚类、支持向量机(SVM)、K近邻算法)或者神经网络将ICD10划分为多个疾病位置模型,其中不同的疾病位置模型对应不同的人体器官或组织。In addition, because the correct disease classification information code or label is assigned to the patient when the patient visits a doctor, only the corresponding disease or 2D position of the patient can be found, but the 3D position of the disease cannot be accurately located. To this end, based on the disease classification information, multiple disease location models can be obtained, the multiple disease location models respectively corresponding to different three-dimensional locations of the body. For example, a disease location model can be obtained based on ICD10. For example, 13904 diseases in the ICD10 can be integrated and analyzed, and the ICD10 can be divided into multiple disease location models based on different human organs or tissues, so as to map the diseases to the 3D model. For example, the ICD 10 can be divided into multiple disease location models through a classifier (such as clustering, support vector machine (SVM), K-nearest neighbor algorithm) or neural network, where different disease location models correspond to different human organs or tissues.
例如,多个疾病位置模型对应于多个人体器官,且每个模型包含与其对应的至少一个标签。例如,可以按照心、肝、脾、肺、肾等器官将疾病分类信息划分为多个疾病位置模型,各个疾病位置模型分别对应于心、肝、脾、肺、肾等标签。各个疾病位置模型的标签还可以包含子标签。例如,“心”标签可以包含子标签“左心房”、“左心室”、“右心房”、“右心室”等。For example, multiple disease location models correspond to multiple human organs, and each model includes at least one label corresponding to it. For example, the disease classification information can be divided into multiple disease location models according to organs such as heart, liver, spleen, lung, and kidney, and each disease location model corresponds to labels such as heart, liver, spleen, lung, and kidney. The label of each disease location model may also include sub-labels. For example, the "heart" tag may contain subtags "left atrium", "left ventricle", "right atrium", "right ventricle" and so on.
例如,步骤S102中的基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置可以包括:将所述疾病数据的元素特征对应到所述多个疾病位置模型中的至少一个标签,以获得所述疾病的三维位置。For example, in step S102, based on the element features of the disease data, using multiple disease location models to obtain the three-dimensional location of the disease may include: corresponding the element features of the disease data to those in the multiple disease location models. At least one tag to obtain the three-dimensional location of the disease.
例如,每个标签可以对应一个编码,每个子标签也可以对应一个编码。例如,在ICD10对应的疾病位置模型中,标签重症肌无力的编码为G80.001,标签食道的编码为I95,食管静脉曲张(食道的子标签)的编码为I95.5。例如,在疾病数据为“试管腔无明显狭窄,胃镜可通过,可见食管下端静脉曲张”的情况下,根据该疾病数据中的元素特征“食管下端静脉”,将疾病数据匹配到疾病位置模型的编码I95.5,从而可以得到该疾病的三维位置为“食道,食道静脉”。For example, each tag can correspond to a code, and each subtag can also correspond to a code. For example, in the disease location model corresponding to ICD10, the code for labeling myasthenia gravis is G80.001, the code for labeling the esophagus is I95, and the code for esophageal varices (a subtag of the esophagus) is I95.5. For example, if the disease data is "the test tube cavity is not significantly narrowed, the gastroscope can pass, and the lower esophageal varices can be seen", the disease data is matched to the disease location model according to the element feature "lower esophageal vein" in the disease data The code of I95.5, so that the three-dimensional position of the disease can be obtained as "esophagus, esophageal vein".
应当认识到,上述将疾病数据匹配到疾病位置模型的编码的过程可以通过计算机自动完成。例如,也可以通过神经网络或者其他方法实现将疾病数据匹配到疾病位置模型的编码的技术效果,这里不再赘述。It should be recognized that the above process of matching disease data to the encoding of the disease location model can be automatically completed by a computer. For example, the technical effect of matching the disease data to the encoding of the disease location model can also be achieved through a neural network or other methods, which will not be repeated here.
在获得疾病的三维位置之后,可以在与电子设备的显示界面中的人体三维模型对应的器官位置上显示疾病以实现人机交互。例如,可以在三维人体结构上高亮显示疾病的三维位置,或者通过引擎在移动设备的显示界面上显示疾病的三维位置。After obtaining the three-dimensional position of the disease, the disease can be displayed on the organ position corresponding to the three-dimensional human body model in the display interface of the electronic device to realize human-computer interaction. For example, the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
在本公开的上述方面中,提出了一种疾病位置获取方法,具体来说,本公开基于不同的三维位置创建疾病位置模型,然后通过将获得的疾病数据映射到疾病位置模型中来获得疾病的三维位置,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升疾病和异常指标的交互展示效果,提升效率以及用户体验。In the above aspects of the present disclosure, a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. Three-dimensional position, so as to realize the 3D display of the disease on the 3D model, to more accurately show the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
进一步,针对上述对应到疾病模型的疾病数据,可以再利用神经网络模型对疾病数据进行分析,以得到疾病的修正的三维位置。此外,在疾病数据的元素特征无法对应到所述多个疾病位置模型中的至少一个时,基于所述疾病数据,可以直接利用神经网络获得所述疾病的三维位置。Further, for the disease data corresponding to the disease model, the neural network model can be used to analyze the disease data to obtain the corrected three-dimensional position of the disease. In addition, when the element characteristics of the disease data cannot correspond to at least one of the multiple disease location models, based on the disease data, a neural network can be directly used to obtain the three-dimensional location of the disease.
神经网络是一种大规模、多参数优化的工具。依靠大量的训练数据,深度神经网络能够学习出数据中难以总结的隐藏特征,从而完成多项复杂的任务,如人脸检测、图像语义分割、文本摘要提取、物体检测、动作追踪、自然语言翻译等。通过字向量获取文本的向量表示指的是将文本中的每个字表示成单个向量,通过进行高度的总结概括和抽象,生成文本的向量表示。可以将基于神经网络模型的技术用于诸如医学疾病位置处理中,从而对于疾病数据自动进行处理。Neural network is a large-scale, multi-parameter optimization tool. Relying on a large amount of training data, deep neural networks can learn hidden features that are difficult to summarize in the data, thereby completing a number of complex tasks, such as face detection, image semantic segmentation, text summary extraction, object detection, motion tracking, natural language translation Wait. Obtaining the vector representation of the text through the word vector refers to expressing each word in the text as a single vector, and generating a vector representation of the text through a high degree of summary and abstraction. Techniques based on neural network models can be used in, for example, medical disease location processing, so as to automatically process disease data.
参照图2示意性地描述根据本公开实施例的神经网络模型的训练方法的应用场景。An application scenario of a training method of a neural network model according to an embodiment of the present disclosure is schematically described with reference to FIG. 2.
如图2所示,根据本公开实施例的神经网络模型20用于接收输入10,并且所述输入10执行特征提取处理,基于提取的特征,生成输出30。在本公开的实施例中,所述输入10例如可以是图像、视频、自然语言文本等待处理的对象。所述神经网络模型20对所述输入10执行图像语义分割、物体检测、动作追踪、自然语言翻译等处理,以生成所述输出30。该神经网络模型20可以嵌入在终端设备或者服务器中以对输入进行处理。As shown in FIG. 2, a neural network model 20 according to an embodiment of the present disclosure is used to receive an input 10, and the input 10 performs feature extraction processing, and based on the extracted features, an output 30 is generated. In the embodiment of the present disclosure, the input 10 may be, for example, an image, video, or natural language text waiting to be processed. The neural network model 20 performs image semantic segmentation, object detection, motion tracking, natural language translation and other processing on the input 10 to generate the output 30. The neural network model 20 can be embedded in a terminal device or a server to process input.
在本公开的一个实施例中,所述神经网络模型20可以根据图3所示的训练方法进行训练。In an embodiment of the present disclosure, the neural network model 20 may be trained according to the training method shown in FIG. 3.
如图3所示为根据本公开另一实施例的疾病位置获取方法的流程图。如图3所示,该疾病位置获取方法包括以下的步骤S201-步骤S203。Fig. 3 is a flowchart of a method for acquiring a disease location according to another embodiment of the present disclosure. As shown in FIG. 3, the method for acquiring the location of the disease includes the following steps S201 to S203.
在步骤S201,通过疾病数据获取所述疾病数据的元素特征。In step S201, the element characteristics of the disease data are acquired through the disease data.
在步骤S202,基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。In step S202, based on the element characteristics of the disease data, multiple disease location models are used to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
在步骤S203,基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置。In step S203, based on the disease data, the corrected three-dimensional position of the disease is obtained through the first neural network.
由于步骤S201-S202与上述参照图1所述的步骤S101-S102所述的步骤相同,这里不再赘述。Since the steps S201-S202 are the same as the steps described above with reference to the steps S101-S102 described in FIG. 1, they will not be repeated here.
下面,在步骤S203中,可以基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置。Next, in step S203, the corrected three-dimensional position of the disease may be obtained through the first neural network based on the disease data.
例如,第一神经网络是通过训练数据训练获得的,训练数据包括特征数据和识别标签,所述特征数据包括多个疾病信息,所述识别标签包括与所述多个疾病信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。For example, the first neural network is obtained by training with training data, the training data includes feature data and identification tags, the feature data includes multiple disease information, and the identification tags include three-dimensional positions corresponding to the multiple disease information, The plurality of disease information includes disease data of a plurality of different diseases.
例如,第一神经网络可以是卷积神经网络(Convolutional Neural Networks,CNN)、循环神经网络(Recurrent Neural Network,RNN)、反向学习神经网络(Back Propagation,BP)、线性神经网络等,这里不做限制。For example, the first neural network may be Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), Back Propagation (BP), Linear Neural Network, etc. Do restrictions.
例如,多个疾病信息可以是从解析健康测评、体检报告、健康数据和外设输入的一个或多个得到的,多个疾病信息对应的三维位置可以是人工标注的更详细的位置信息。通过利用标注了更详细的位置信息的多个疾病信息对第一神经网络进行训练,可以修正疾病数据对应的三维位置,使得得到的三维 位置更精确。For example, multiple disease information may be obtained from analyzing one or more of health assessment, physical examination report, health data, and peripheral input, and the three-dimensional location corresponding to the multiple disease information may be more detailed location information manually labeled. By training the first neural network with multiple disease information marked with more detailed position information, the three-dimensional position corresponding to the disease data can be corrected, so that the obtained three-dimensional position is more accurate.
可替代地,训练数据可以包括特征数据和识别标签,所述特征数据包括多个疾病信息和疾病分类信息,所述识别标签包括与所述多个疾病信息对应的三维位置和与疾病分类信息对应的三维位置信息。应该认识到,训练数据中除了疾病分类信息和其对应的三维位置之外,新增了多个疾病信息和其对应的三维位置,由此增加了疾病位置的种类以及范围。因此,在与疾病数据对应的疾病位置模型不准确的情况下,利用经过更多训练数据进行训练的第一神经网络,可以对疾病数据的三维位置进行修正。Alternatively, the training data may include feature data and an identification label, the feature data including a plurality of disease information and disease classification information, and the identification label includes a three-dimensional position corresponding to the plurality of disease information and corresponding to the disease classification information. The three-dimensional location information. It should be realized that in addition to the disease classification information and its corresponding three-dimensional position in the training data, multiple disease information and their corresponding three-dimensional positions are newly added, thereby increasing the types and scope of disease positions. Therefore, when the disease location model corresponding to the disease data is inaccurate, the first neural network trained with more training data can be used to correct the three-dimensional location of the disease data.
此外,在疾病数据的元素特征无法对应到疾病位置模型中的至少一个时,可以基于所述疾病数据,直接利用上述第一神经网络获得所述疾病的三维位置。由于经过训练的神经网络具备预测功能,因此,在疾病数据无法对应到疾病位置模型中的至少一个时,可以通过具备预测功能的神经网络得到疾病的三维位置。In addition, when the element characteristics of the disease data cannot correspond to at least one of the disease location models, the first neural network can be directly used to obtain the three-dimensional location of the disease based on the disease data. Since the trained neural network has a predictive function, when the disease data cannot correspond to at least one of the disease location models, the three-dimensional position of the disease can be obtained through the neural network with the predictive function.
同样地,在获得疾病的三维位置之后,可以在对应的器官模型上进行显示以实现人机交互。例如,可以在三维人体结构上高亮显示疾病的三维位置,或者通过引擎在移动设备的显示界面上显示疾病的三维位置。Similarly, after obtaining the three-dimensional position of the disease, it can be displayed on the corresponding organ model to achieve human-computer interaction. For example, the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
在本公开的上述方面中,提出了一种疾病位置获取方法,具体来说,本公开基于不同的三维位置创建疾病位置模型,然后通过将获得的疾病数据映射到疾病位置模型中来获得疾病的三维位置,然后利用神经网络对疾病数据进行分析,以得到疾病的修正的三维位置,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升疾病和异常指标的交互展示效果,提升效率以及用户体验。In the above aspects of the present disclosure, a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. 3D position, and then use neural network to analyze the disease data to obtain the corrected 3D position of the disease, so as to realize the 3D display of the disease on the 3D model, to more accurately show the disease information to the user, and to improve the interaction between the disease and abnormal indicators Display effect, improve efficiency and user experience.
可替代地,在疾病数据的元素特征无法对应到所述多个疾病位置模型中的至少一个时,可以直接通过利用与疾病分类信息不同的训练数据训练的第二神经网络获得疾病的三维位置。Alternatively, when the element feature of the disease data cannot correspond to at least one of the multiple disease location models, the three-dimensional location of the disease can be directly obtained by a second neural network trained using training data different from the disease classification information.
例如,有些疾病数据的元素特征可能无法对应到现有的疾病位置模型中,此时可以通过由其他疾病分类信息或疾病位置模型组成的训练数据来训练第二神经网络,并利用该第二神经网络获得所述疾病的三维位置。For example, the element characteristics of some disease data may not correspond to the existing disease location model. At this time, the second neural network can be trained through training data composed of other disease classification information or disease location models, and the second neural network can be used. The network obtains the three-dimensional position of the disease.
例如,第二神经网络是通过训练数据训练获得的,训练数据包括特征数据和识别标签,所述特征数据包括与所述疾病分类信息不同的疾病分类信息,所述识别标签包括与所述特征数据中包括的疾病分类信息对应的三维位置。For example, the second neural network is obtained by training with training data, the training data includes feature data and identification tags, the feature data includes disease classification information different from the disease classification information, and the identification tags include the same as the feature data. The three-dimensional position corresponding to the disease classification information included in.
例如,第二神经网络也可以是卷积神经网络(Convolutional Neural Networks,CNN)、循环神经网络(Recurrent Neural Network,RNN)、反向学习神经网络(Back Propagation,BP)、线性神经网络等,这里不做限制。For example, the second neural network may also be Convolutional Neural Networks (CNN), Recurrent Neural Network (RNN), Back Propagation (BP), Linear Neural Network, etc., here No restrictions.
例如,训练数据中使用了与疾病分类信息不同的疾病分类信息,由此增加了疾病位置的种类以及范围。因此,在疾病数据无法对应到所述多个疾病位置模型中的至少一个时,可以直接通过第二神经网络获得疾病的三维位置。For example, the training data uses disease classification information different from the disease classification information, thereby increasing the type and range of disease locations. Therefore, when the disease data cannot correspond to at least one of the multiple disease location models, the three-dimensional location of the disease can be directly obtained through the second neural network.
同样地,在获得疾病的三维位置之后,可以在对应的器官模型上进行显示以实现人机交互。例如,可以在三维人体结构上高亮显示疾病的三维位置,或者通过引擎在移动设备的显示界面上显示疾病的三维位置。Similarly, after obtaining the three-dimensional position of the disease, it can be displayed on the corresponding organ model to achieve human-computer interaction. For example, the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
在本公开的上述方面中,提出了一种疾病位置获取方法,具体来说,本公开基于不同的三维位置创建疾病位置模型,然后通过将获得的疾病数据映射到疾病位置模型中来获得疾病的三维位置,在疾病数据无法对应到所述多个疾病位置模型中的至少一个时,基于所述疾病数据,通过第二神经网络直接获得所述疾病的三维位置,以得到疾病的三维位置,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升疾病和异常指标的交互展示效果,提升效率以及用户体验。In the above aspects of the present disclosure, a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. The three-dimensional position, when the disease data cannot correspond to at least one of the multiple disease position models, based on the disease data, the three-dimensional position of the disease is directly obtained through the second neural network to obtain the three-dimensional position of the disease, thereby Realize the 3D display of the disease on the 3D model to more accurately show the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
在上述通过图1-3描述了根据本公开实施例的疾病位置获取方法后,下面基于图4描述根据本公开实施例的疾病位置获取示例。After the disease location acquisition method according to the embodiment of the present disclosure is described above through FIGS. 1-3, the following describes an example of the disease location acquisition according to the embodiment of the present disclosure based on FIG. 4.
图4示出了根据本公开实施例的疾病位置获取示例的示意图。如图4所示,首先,获取疾病数据,疾病数据包含对疾病的语言描述。该疾病数据可以是从健康测评51、体检报告52、健康数据53和外设输入54中的一个或多个中获得的。接下来,通过疾病数据获取所述疾病数据的元素特征,然后将该疾病数据的元素特征映射到疾病分类信息55,以获得所述疾病数据对应的疾病名称。由于多个疾病位置模型56是通过疾病分类信息55获取的,所以可以将疾病数据的元素特征对应到多个疾病位置模型56中,以获得疾病的三维位置,从而实现3D展示。此外,由于疾病分类信息中包含对疾病的各种描述,因此,基于所述疾病数据的元素特征,利用该疾病位置获取方法还可以获得疾病数据对应的疾病或问题57、对应的异常信息所述的系统/部位58、健康指数59等信息。Fig. 4 shows a schematic diagram of an example of acquiring the location of a disease according to an embodiment of the present disclosure. As shown in Figure 4, first, get disease data, which contains the language description of the disease. The disease data may be obtained from one or more of the health assessment 51, the physical examination report 52, the health data 53, and the peripheral input 54. Next, the element characteristics of the disease data are obtained from the disease data, and then the element characteristics of the disease data are mapped to the disease classification information 55 to obtain the disease name corresponding to the disease data. Since the multiple disease location models 56 are obtained through the disease classification information 55, the element characteristics of the disease data can be mapped to the multiple disease location models 56 to obtain the three-dimensional location of the disease, thereby achieving 3D display. In addition, since the disease classification information contains various descriptions of the disease, based on the element characteristics of the disease data, the disease location acquisition method can also be used to obtain the disease or problem corresponding to the disease data. System/site 58, health index 59 and other information.
本申请提供的疾病信息展示方法一般通过电子设备运行,实现与用户的信息交互,在打开电子设备进入疾病信息展示的显示界面(例如,数字人体 APP)后,初始展现在显示界面上的通常是完整的三维人体模型,一般呈现为直立且处于自然伸展状态的三维人体图像。另外,在检测出疾病的地方高亮显示该疾病器官以便于患者了解。The disease information display method provided in this application generally runs through electronic equipment to realize information interaction with the user. After turning on the electronic equipment to enter the display interface of disease information display (for example, the digital human body APP), the initial display on the display interface is usually A complete three-dimensional human body model is generally presented as a three-dimensional human body image that is upright and in a natural stretched state. In addition, highlight the diseased organ in the place where the disease is detected so that the patient can understand it.
下面参照图5-6描述根据本公开实施例的人体信息展示的显示界面。图5为本公开实施例的人体信息展示的显示界面示意图。图6为本公开实施例的疾病展示的显示界面示意图。The display interface for displaying human body information according to an embodiment of the present disclosure will be described below with reference to FIGS. 5-6. FIG. 5 is a schematic diagram of a display interface for displaying human body information according to an embodiment of the disclosure. FIG. 6 is a schematic diagram of a display interface for displaying diseases according to an embodiment of the disclosure.
如图5所示,在显示有三维人体模型的显示界面上,显示至少一条围绕三维人体模型的曲线,曲线上设置有若干人体信息标签,在某些可行的实施方式中,如图5所示,曲线包括以下至少一种:椭圆弧线、螺旋线;椭圆弧线围绕在三维人体模型的胸腔位置处;螺旋线由三维人体模型的脚部螺旋延伸到三维人体模型的头部;曲线与显示界面相对静止。曲线也可以是其他形式的能够围绕三维人体模型的几何曲线,具体可以是一条,也可以是2条以一定间距平行显示,或者当曲线是螺旋线时,可以呈现为双螺旋结构,当然,数量甚至可以是3条、4条等,根据实际需要具体设置。As shown in Figure 5, on the display interface displaying the three-dimensional human body model, at least one curve surrounding the three-dimensional human body model is displayed, and several human body information labels are set on the curve. In some feasible implementations, as shown in Figure 5 , The curve includes at least one of the following: elliptical arc and spiral; the elliptical arc surrounds the position of the chest cavity of the three-dimensional human model; the spiral extends from the foot of the three-dimensional human model to the head of the three-dimensional human model; curve and display The interface is relatively static. The curve can also be another form of geometric curve that can surround the three-dimensional human body model. It can be one or two parallel displayed at a certain interval, or when the curve is a spiral line, it can appear as a double helix structure. Of course, the quantity It can even be 3, 4, etc., which can be set according to actual needs.
再者,人体信息标签对应着三维人体模型不同部分,三维人体模型的不同部分可以按照多种分类确定,在某些可行的实施方式中,人体信息标签包括以下至少一种:人体器官类别信息、人体系统类别信息或人体参数信息;曲线上相邻人体信息标签的间距相等。例如,人体器官类别信息按照器官进行分类,包括心、肝、脾、肺、肾等,按照人体系统类别进行分类,包括循环系统、消化系统、呼吸系统、生殖系统、免疫系统等,也可按照局部进行分类,包括头部、胸部、上下肢等。甚至还包括其他与人体健康相关的人体参数信息,比如健康历史数据、外伤数据等。这些人体信息标签顺延曲线设置,为形成立体效果,在曲线上的人体信息标签大小不一,但相邻人体信息标签在曲线上的间距相等,例如处于中间位置的人体信息标签较大,而随着离中间位置越来越远,人体信息标签逐渐变小。Furthermore, the human body information tags correspond to different parts of the three-dimensional human body model. Different parts of the three-dimensional human body model can be determined according to multiple classifications. In some feasible implementations, the human body information label includes at least one of the following: human organ category information, Human body system category information or human body parameter information; the distance between adjacent human body information labels on the curve is equal. For example, human organ category information is classified according to organs, including heart, liver, spleen, lung, kidney, etc., and according to human system categories, including circulatory system, digestive system, respiratory system, reproductive system, immune system, etc., or according to Partial classification, including head, chest, upper and lower limbs, etc. It even includes other human body parameter information related to human health, such as health history data, trauma data, etc. These human body information labels are set along the curve. In order to form a three-dimensional effect, the human body information labels on the curve are of different sizes, but the distance between adjacent human body information labels on the curve is equal. As it gets farther and farther from the middle position, the human body information label gradually becomes smaller.
当然,也可将人体信息标签设置为不同状态,在某些可行的实施方式中,曲线包括预设凸显区域和预设非凸显区域。在显示有三维人体模型的显示界面上,显示至少一条围绕人体模型的曲线,曲线上设置有若干人体信息标签,具体包括:若人体信息标签移动至预设凸显区域,放大显示人体信息标签,并将人体信息标签设置为激活状态;若人体信息标签移动至预设非凸显区域,缩小显示人体信息标签,并将人体信息标签设置为非激活状态。Of course, the human body information labels can also be set to different states. In some feasible implementation manners, the curve includes a preset prominent area and a preset non-highlighted area. On the display interface displaying the three-dimensional human body model, at least one curve surrounding the human body model is displayed, and a number of human body information labels are set on the curve, specifically including: if the human body information label moves to the preset highlight area, the human body information label is enlarged and displayed, and Set the human body information label to the activated state; if the human body information label moves to the preset non-protruding area, the human body information label is reduced to be displayed, and the human body information label is set to the inactive state.
人体信息标签可在曲线上移动,并且在曲线的特定位置上,例如在靠近三维人体模型中轴线的曲线段上,人体信息标签移动到这一预设凸显区域,则该人体信息标签为激活状态,外形上呈现为放大状态,能够被选择,并据以执行下一步操作,其他区域为预设非凸显区域,处于该预设非凸显区域的人体信息标签则为非激活状态,则相应以较小尺寸显示,在人体信息标签的移动过程中,将放大和缩小的过程也在显示界面上显示,能够形成生动的立体动态过程,提高用户在进行人机交互时的沉浸感。当然,除了通过放大或缩小的外形变化之外,也可增加使人体信息标签的亮度和颜色的处于变化状态的特性。The human body information label can move on the curve, and at a specific position of the curve, for example, on the curve segment close to the central axis of the three-dimensional human body model, the human body information label moves to this preset highlight area, then the human body information label is activated , The appearance is shown in an enlarged state, can be selected, and the next operation is performed accordingly, the other areas are the preset non-protruding areas, and the human body information tags in the preset non-protruding areas are in the inactive state, so compare them accordingly. Small size display. During the movement of the human body information label, the process of zooming in and out is also displayed on the display interface, which can form a vivid three-dimensional dynamic process and improve the user's immersion in human-computer interaction. Of course, in addition to the shape change by zooming in or zooming out, the characteristics of changing the brightness and color of the human body information label can also be added.
在通过本公开所述的方法检测到疾病的位置之后,如图6所示,在三维人体模型的对应位置高亮显示,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升用户体验。After the location of the disease is detected by the method described in the present disclosure, as shown in FIG. 6, the corresponding position of the three-dimensional human body model is highlighted, so as to realize the 3D display of the disease on the 3D model, so as to show the user more accurately Disease information to enhance user experience.
以上,参照附图描述了根据本发明实施例的疾病位置获取方法。以下,将描述根据本公开实施例的疾病位置获取装置。Above, the method for acquiring the location of a disease according to an embodiment of the present invention has been described with reference to the accompanying drawings. Hereinafter, a disease location acquiring device according to an embodiment of the present disclosure will be described.
图7是图示根据本公开实施例的疾病位置获取装置的功能框图。如图7所示,根据本公开实施例的疾病位置获取装置1000包括元素特征获取单元1001和三维位置获取单元1002。上述各模块可以分别执行如上参照图1到图3描述的根据本公开的实施例的疾病位置获取方法的各个步骤。本领域的技术人员理解:这些单元模块可以单独由硬件、单独由软件或者由其组合以各种方式实现,并且本公开不限于它们的任何一个。例如,可以通过中央处理单元(CPU)、图像处理器(GPU)、张量处理器(TPU)、现场可编程逻辑门阵列(FPGA)或者具有数据处理能力和/或指令执行能力的其它形式的处理单元以及相应计算机指令来实现这些单元。FIG. 7 is a functional block diagram illustrating a disease location acquiring device according to an embodiment of the present disclosure. As shown in FIG. 7, a disease location acquiring device 1000 according to an embodiment of the present disclosure includes an element feature acquiring unit 1001 and a three-dimensional location acquiring unit 1002. The above-mentioned modules can respectively execute the steps of the method for acquiring the location of the disease according to the embodiment of the present disclosure as described above with reference to FIGS. 1 to 3. Those skilled in the art understand that these unit modules can be implemented in various ways by hardware alone, software alone, or a combination thereof, and the present disclosure is not limited to any one of them. For example, a central processing unit (CPU), an image processor (GPU), a tensor processor (TPU), a field programmable logic gate array (FPGA), or other forms of data processing capabilities and/or instruction execution capabilities can be used. Processing units and corresponding computer instructions implement these units.
元素特征获取单元1001用于通过疾病数据获取所述疾病数据的元素特征。The element feature acquiring unit 1001 is configured to acquire the element feature of the disease data through the disease data.
例如,疾病数据可以是与用户的当前疾病有关的数据,其可以从用户的个人健康信息中获取。例如,从解析健康测评、体检报告、健康数据和外设输入的一个或多个来获得用户的疾病数据。For example, the disease data may be data related to the user's current disease, which may be obtained from the user's personal health information. For example, the user's disease data can be obtained from analyzing one or more of health assessment, physical examination report, health data, and peripheral input.
三维位置获取单元1002用于基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。The three-dimensional position acquiring unit 1002 is configured to acquire the three-dimensional position of the disease using multiple disease location models based on the element characteristics of the disease data, wherein the multiple disease location models respectively correspond to different three-dimensional positions of the body.
例如,多个疾病位置模型是通过疾病分类信息基于身体的不同的三维位 置划分得到的。例如,疾病分类信息可以是ICD10,也可以是其他合适的疾病分类库,这里不做限制。例如,疾病分类信息可以对应于不同的疾病名称,且每个疾病分类信息包含与其对应的至少一个名称标签,此时,可以将所述疾病数据的元素特征匹配到所述疾病分类信息的至少一个名称标签以获得所述疾病数据对应的疾病名称。For example, multiple disease location models are obtained by dividing disease classification information based on different three-dimensional locations of the body. For example, the disease classification information can be ICD10 or other suitable disease classification databases, which is not limited here. For example, the disease classification information may correspond to different disease names, and each disease classification information contains at least one name tag corresponding to it. In this case, the element characteristics of the disease data may be matched to at least one of the disease classification information. The name tag obtains the disease name corresponding to the disease data.
例如,可以基于ICD10得到疾病位置模型。例如,可以整合分析ICD10中的疾病,基于不同的人体器官或组织将ICD10划分为多个疾病位置模型,从而将疾病对应到3D模型上。For example, a disease location model can be obtained based on ICD10. For example, the diseases in the ICD10 can be integrated and analyzed, and the ICD10 can be divided into multiple disease location models based on different human organs or tissues, so as to map the diseases to the 3D model.
例如,三维位置获取单元1002可以将所述疾病数据的元素特征对应到所述多个疾病位置模型中的至少一个标签,以获得所述疾病的三维位置。For example, the three-dimensional position obtaining unit 1002 may correspond the element feature of the disease data to at least one label in the multiple disease position models to obtain the three-dimensional position of the disease.
应当认识到,上述将疾病数据匹配到疾病位置模型的编码的过程可以通过计算机自动完成。例如,也可以通过神经网络或者其他方法实现将疾病数据匹配到疾病位置模型的编码的技术效果,这里不再赘述。It should be recognized that the above process of matching disease data to the encoding of the disease location model can be automatically completed by a computer. For example, the technical effect of matching the disease data to the encoding of the disease location model can also be achieved through a neural network or other methods, which will not be repeated here.
在获得疾病的三维位置之后,可以在对应的器官模型上进行显示以实现人机交互。例如,可以在三维人体结构上高亮显示疾病的三维位置,或者通过引擎在移动设备的显示界面上显示疾病的三维位置。After obtaining the three-dimensional position of the disease, it can be displayed on the corresponding organ model to realize human-computer interaction. For example, the three-dimensional position of the disease can be highlighted on the three-dimensional human body structure, or the three-dimensional position of the disease can be displayed on the display interface of the mobile device through the engine.
进一步,三维位置获取单元1002可以再利用神经网络对疾病数据进行分析,以得到疾病的修正的三维位置。Further, the three-dimensional position acquiring unit 1002 can use the neural network to analyze the disease data to obtain the corrected three-dimensional position of the disease.
例如,三维位置获取单元1002可以基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置。例如,第一神经网络是通过训练数据训练获得的,训练数据包括特征数据和识别标签,所述特征数据包括多个疾病信息,所述识别标签包括与所述多个疾病信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。For example, the three-dimensional position obtaining unit 1002 may obtain the corrected three-dimensional position of the disease through the first neural network based on the disease data. For example, the first neural network is obtained by training with training data, the training data includes feature data and identification tags, the feature data includes multiple disease information, and the identification tags include three-dimensional positions corresponding to the multiple disease information, The plurality of disease information includes disease data of a plurality of different diseases.
可替代地,在疾病数据无法对应到所述多个疾病位置模型中的至少一个时,三维位置获取单元1002可以直接通过第一神经网络获得疾病的三维位置。Alternatively, when the disease data cannot correspond to at least one of the multiple disease position models, the three-dimensional position obtaining unit 1002 may directly obtain the three-dimensional position of the disease through the first neural network.
可替代地,三维位置获取单元1002可以基于所述疾病数据,通过第二神经网络获得所述疾病的三维位置。Alternatively, the three-dimensional position obtaining unit 1002 may obtain the three-dimensional position of the disease through a second neural network based on the disease data.
例如,第二神经网络是通过训练数据训练获得的,训练数据包括特征数据和识别标签,所述特征数据包括与疾病分类信息不同的疾病分类信息,所述识别标签包括与特征数据中包括的疾病分类信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。For example, the second neural network is obtained by training with training data. The training data includes feature data and identification labels, the feature data includes disease classification information that is different from the disease classification information, and the identification labels include diseases that are different from those included in the feature data. The three-dimensional position corresponding to the classification information, and the plurality of disease information includes disease data of a plurality of different diseases.
在本公开的上述方面中,提出了一种疾病位置获取方法,具体来说,本公开基于不同的三维位置创建疾病位置模型,然后通过将获得的疾病数据映射到疾病位置模型中来获得疾病的三维位置。三维位置获取单元1002可以再利用神经网络对疾病数据进行分析,以得到疾病的修正的三维位置。在疾病数据无法对应到所述多个疾病位置模型中的至少一个时,三维位置获取单元1002还可以基于所述疾病数据,通过第一神经网络或者第二神经网络直接获得所述疾病的三维位置,从而实现疾病在3D模型上的3D展示,以更准确地向用户展示疾病信息,提升疾病和异常指标的交互展示效果,提升效率以及用户体验。In the above aspects of the present disclosure, a method for acquiring disease location is proposed. Specifically, the present disclosure creates a disease location model based on different three-dimensional locations, and then maps the acquired disease data to the disease location model to obtain the disease location model. Three-dimensional position. The three-dimensional position acquiring unit 1002 can then use the neural network to analyze the disease data to obtain the corrected three-dimensional position of the disease. When the disease data cannot correspond to at least one of the multiple disease location models, the three-dimensional location obtaining unit 1002 may also directly obtain the three-dimensional location of the disease through the first neural network or the second neural network based on the disease data. , So as to realize the 3D display of the disease on the 3D model, to more accurately display the disease information to the user, improve the interactive display effect of the disease and abnormal indicators, and improve the efficiency and user experience.
下面将参照图8描述根据本公开实施例的疾病位置获取设备。图8是根据本公开实施例的疾病位置获取设备2000的示意图。由于本实施例的疾病位置获取设备与在上文中参照图1描述的方法的细节相同,因此在这里为了简单起见,省略对相同内容的详细描述。Hereinafter, a disease location acquisition device according to an embodiment of the present disclosure will be described with reference to FIG. 8. FIG. 8 is a schematic diagram of a disease location acquiring device 2000 according to an embodiment of the present disclosure. Since the disease location acquisition device of this embodiment has the same details as the method described above with reference to FIG. 1, for the sake of simplicity, detailed description of the same content is omitted here.
如图8所示,该疾病位置获取设备2000包括处理器210、存储器220以及一个或多个计算机程序模块221。As shown in FIG. 8, the disease location acquisition device 2000 includes a processor 210, a memory 220, and one or more computer program modules 221.
例如,处理器210与存储器220通过总线系统230连接。例如,一个或多个计算机程序模块221被存储在存储器220中。例如,一个或多个计算机程序模块221包括用于执行本公开任一实施例提供的疾病位置获取方法的指令。例如,一个或多个计算机程序模块221中的指令可以由处理器210执行。例如,总线系统230可以是常用的串行、并行通信总线等,本公开的实施例对此不作限制。For example, the processor 210 and the memory 220 are connected through a bus system 230. For example, one or more computer program modules 221 are stored in the memory 220. For example, one or more computer program modules 221 include instructions for executing the disease location acquisition method provided by any embodiment of the present disclosure. For example, instructions in one or more computer program modules 221 may be executed by the processor 210. For example, the bus system 230 may be a commonly used serial or parallel communication bus, etc., which is not limited in the embodiments of the present disclosure.
例如,该处理器210可以是中央处理单元(CPU)、数字信号处理器(DSP)、图像处理器(GPU)或者具有数据处理能力和/或指令执行能力的其它形式的处理单元,可以为通用处理器或专用处理器,并且可以控制疾病位置获取设备2000中的其它组件以执行期望的功能。For example, the processor 210 may be a central processing unit (CPU), a digital signal processor (DSP), an image processor (GPU), or other forms of processing units with data processing capabilities and/or instruction execution capabilities, and may be general-purpose processing units. A processor or a dedicated processor, and can control other components in the disease location acquisition device 2000 to perform desired functions.
存储器220可以包括一个或多个计算机程序产品,该计算机程序产品可以包括各种形式的计算机可读存储介质,例如易失性存储器和/或非易失性存储器。该易失性存储器例如可以包括随机存取存储器(RAM)和/或高速缓冲存储器(cache)等。该非易失性存储器例如可以包括只读存储器(ROM)、硬盘、闪存等。在计算机可读存储介质上可以存储一个或多个计算机程序指令,处理器210可以运行该程序指令,以实现本公开实施例中(由处理器210实 现)的功能以及/或者其它期望的功能,例如疾病位置获取方法等。在该计算机可读存储介质中还可以存储各种应用程序和各种数据,例如疾病数据的元素特征、疾病位置模型以及应用程序使用和/或产生的各种数据等。The memory 220 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include random access memory (RAM) and/or cache memory (cache), for example. The non-volatile memory may include read-only memory (ROM), hard disk, flash memory, etc., for example. One or more computer program instructions may be stored on a computer-readable storage medium, and the processor 210 may run the program instructions to implement the functions (implemented by the processor 210) and/or other desired functions in the embodiments of the present disclosure, For example, how to obtain the location of the disease. The computer-readable storage medium can also store various application programs and various data, such as element characteristics of disease data, disease location models, and various data used and/or generated by the application programs.
需要说明的是,为表示清楚、简洁,本公开实施例并没有给出该疾病位置获取设备2000的全部组成单元。为实现疾病位置获取设备2000的必要功能,本领域技术人员可以根据具体需要提供、设置其他未示出的组成单元,本公开的实施例对此不作限制。It should be noted that, for the sake of clarity and conciseness, the embodiment of the present disclosure does not provide all the components of the disease location acquisition device 2000. In order to realize the necessary functions of the disease location acquisition device 2000, those skilled in the art can provide and set other unshown component units according to specific needs, which are not limited in the embodiments of the present disclosure.
关于不同实施例中的疾病位置获取装置1000和疾病位置获取设备2000的技术效果可以参考本公开的实施例中提供的疾病位置获取方法的技术效果,这里不再赘述。Regarding the technical effects of the disease location acquiring device 1000 and the disease location acquiring device 2000 in different embodiments, reference may be made to the technical effects of the disease location acquiring method provided in the embodiments of the present disclosure, which will not be repeated here.
疾病位置获取装置1000和疾病位置获取设备2000可以用于各种适当的电子设备。The disease location acquiring device 1000 and the disease location acquiring device 2000 can be used in various appropriate electronic devices.
图9为本公开至少一实施例提供的一种电子设备的结构示意图。本公开实施例中的终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图9示出的电子设备仅仅是一个示例,不应对本公开实施例的功能和使用范围带来任何限制。FIG. 9 is a schematic structural diagram of an electronic device provided by at least one embodiment of the present disclosure. Terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (e.g. Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 9 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
例如,该电子设备,包括本公开任一实施例提供的疾病位置获取装置1000和显示界面(例如,图9所示的输出装置307);其中,显示界面被配置为显示三维人体模型,所述三维人体模型在采用上述疾病位置获取方法得到的三维位置处显示疾病分类信息,并高亮显示得到的三维位置对应的器官。For example, the electronic device includes the disease location acquiring device 1000 provided by any embodiment of the present disclosure and a display interface (for example, the output device 307 shown in FIG. 9); wherein the display interface is configured to display a three-dimensional human body model, The three-dimensional human body model displays disease classification information at the three-dimensional position obtained by the above-mentioned disease position acquisition method, and highlights the organ corresponding to the obtained three-dimensional position.
例如,如图9所示,在一些示例中,电子设备300包括处理装置(例如中央处理器、图形处理器等)301,其可以根据存储在只读存储器(ROM)302中的程序或者从存储装置308加载到随机访问存储器(RAM)303中的程序而执行各种适当的动作和处理。在RAM 303中,还存储有计算机系统操作所需的各种程序和数据。处理装置301、ROM302以及RAM303通过总线304被此相连。输入/输出(I/O)接口305也连接至总线304。For example, as shown in FIG. 9, in some examples, the electronic device 300 includes a processing device (such as a central processing unit, a graphics processor, etc.) 301, which can be based on a program stored in a read-only memory (ROM) 302 or from a storage device. The device 308 loads a program in a random access memory (RAM) 303 to perform various appropriate actions and processing. In the RAM 303, various programs and data required for the operation of the computer system are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected by the bus 304 here. An input/output (I/O) interface 305 is also connected to the bus 304.
例如,以下部件可以连接至I/O接口305:包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置306;包括诸如液晶显示器(LCD)、扬声器、振动器等的输出装置307:包括例如磁带、硬 盘等的存储装置308;以及包括诸如LAN卡、调制解调器等的网络接口卡的通信装置309。通信装置309可以允许电子设备300与其他设备进行无线或有线通信以交换数据,经由诸如因特网的网络执行通信处理。驱动器310也根据需要连接至I/O接口305。可拆卸介质311,诸如磁盘、光盘、磁光盘、半导体存储器等等,根据需要安装在驱动器310上,以便于从其上读出的计算机程序根据需要被安装入存储装置309。虽然图9示出了包括各种装置的电子设备300,但是应理解的是,并不要求实施或包括所有示出的装置。可以替代地实施或包括更多或更少的装置。For example, the following components can be connected to the I/O interface 305: including input devices 306 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including input devices such as liquid crystal displays (LCD), speakers, vibration The output device 307 of the device, etc.: includes a storage device 308 such as a magnetic tape, a hard disk, etc.; and a communication device 309 including a network interface card such as a LAN card, a modem, and the like. The communication device 309 may allow the electronic device 300 to perform wireless or wired communication with other devices to exchange data, and perform communication processing via a network such as the Internet. The driver 310 is also connected to the I/O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed, so that the computer program read from it can be installed into the storage device 309 as needed. Although FIG. 9 shows the electronic device 300 including various devices, it should be understood that it is not required to implement or include all of the illustrated devices. More or fewer devices may be implemented alternatively or included.
例如,该电子设备300还可以进一步包括外设接口(图中未示出)等。该外设接口可以为各种类型的接口,例如为USB接口、闪电(lighting)接口等。该通信装置309可以通过无线通信来与网络和其他设备进行通信,该网络例如为因特网、内部网和/或诸如蜂窝电话网络之类的无线网络、无线局域网(LAN)和/或城域网(MAN)。无线通信可以使用多种通信标准、协议和技术中的任何一种,包括但不局限于全球移动通信系统(GSM)、增强型数据GSM环境(EDGE)、宽带码分多址(W-CDMA)、码分多址(CDMA)、时分多址(TDMA)、蓝牙、Wi-Fi(例如基于IEEE 802.11a、IEEE 802.11b、IEEE 802.11g和/或IEEE 802.11n标准)、基于因特网协议的语音传输(VoIP)、Wi-MAX,用于电子邮件、即时消息传递和/或短消息服务(SMS)的协议,或任何其他合适的通信协议。For example, the electronic device 300 may further include a peripheral interface (not shown in the figure) and the like. The peripheral interface can be various types of interfaces, such as a USB interface, a lightning interface, and the like. The communication device 309 can communicate with a network and other devices through wireless communication, such as the Internet, an intranet, and/or a wireless network such as a cellular telephone network, a wireless local area network (LAN), and/or a metropolitan area network ( MAN). Wireless communication can use any of a variety of communication standards, protocols and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), Wideband Code Division Multiple Access (W-CDMA) , Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Wi-Fi (e.g. based on IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11n standards), voice transmission based on Internet protocol (VoIP), Wi-MAX, protocols used for e-mail, instant messaging and/or short message service (SMS), or any other suitable communication protocol.
例如,电子设备可以为手机、平板电脑、笔记本电脑、电子书、游戏机、电视机、数码相框、导航仪等任何设备,也可以为任意的电子设备及硬件的组合,本公开的实施例对此不作限制。For example, the electronic device can be any device such as a mobile phone, a tablet computer, a notebook computer, an e-book, a game console, a television, a digital photo frame, a navigator, etc., or can be any combination of electronic devices and hardware. This is not limited.
例如,根据本公开的实施例,上文参考流程图描述的过程可以被实现为计算机软件程序。例如,本公开的实施例包括一种计算机程序产品,其包括承载在非暂态计算机可读介质上的计算机程序,该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中,该计算机程序可以通过通信装置309从网络上被下载和安装,或者从存储装置308被安装,或者从ROM302被安装。在该计算机程序被处理装置301执行时,执行本公开实施例的方法中限定的上述疾病位置获取功能。For example, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. When the computer program is executed by the processing device 301, the above-mentioned disease location acquisition function defined in the method of the embodiment of the present disclosure is executed.
需要说明的是,本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介 质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开的实施例中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开的实施例中,计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:电线、光缆、RF(射频)等等,或者上述的任意合适的组合。It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In the embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In the embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium. The computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device . The program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (Radio Frequency), etc., or any suitable combination of the above.
在一些实施方式中,客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol,超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信,并且可以与任意形式或介质的数字数据通信(例如,通信网络)互连。通信网络的示例包括局域网(“LAN”),广域网(“WAN”),网际网(例如,互联网)以及端对端网络(例如,ad hoc端对端网络),以及任何当前已知或未来研发的网络。In some embodiments, the client and server can communicate with any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. Communication (e.g., communication network) interconnects. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any currently known or future research and development network of.
上述计算机可读介质可以是上述电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被该电子设备执行时,使得该电子设备:获取至少两个网际协议地址;向节点评价设备发送包括所述至少两个网际协议地址的节点评价请求,所述节点评价设备从所述至少两个网际协议地址中,选取网际协议地址并返回;接收所述节点评价设备返回的网际协议地址;所获取的网际协议地址指示内容分发网络中的边缘节点。The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: obtains at least two Internet protocol addresses; A node evaluation request for an Internet Protocol address, the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; the obtained Internet Protocol address Indicates the edge node in the content distribution network.
或者,上述计算机可读介质承载有一个或者多个程序,当上述一个或者 多个程序被该电子设备执行时,使得该电子设备:接收包括至少两个网际协议地址的节点评价请求;从所述至少两个网际协议地址中,选取网际协议地址;返回选取出的网际协议地址;接收到的网际协议地址指示内容分发网络中的边缘节点。Alternatively, the aforementioned computer-readable medium carries one or more programs, and when the aforementioned one or more programs are executed by the electronic device, the electronic device: receives a node evaluation request including at least two Internet Protocol addresses; Among at least two Internet Protocol addresses, an Internet Protocol address is selected; the selected Internet Protocol address is returned; the received Internet Protocol address indicates an edge node in the content distribution network.
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码,上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。The computer program code used to perform the operations of the present disclosure can be written in one or more programming languages or a combination thereof. The above-mentioned programming languages include but are not limited to object-oriented programming languages such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如,非限制性地,可以使用的示范类型的硬件逻辑部件包括:现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。The functions described above in this document may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logical device (CPLD) and so on.
在本公开的各个实施例中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In various embodiments of the present disclosure, a machine-readable medium may be a tangible medium, which may contain or store a program for use by the instruction execution system, apparatus, or device or in combination with the instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
本公开至少一实施例还提供一种存储介质。图10为本公开至少一实施例提供的一种存储介质的示意图。例如,如图10所示,该存储介质400非暂时性地存储计算机可读指令401,当非暂时性计算机可读指令由计算机(包括处理器)执行时可以执行本公开任一实施例提供的疾病位置获取方法。At least one embodiment of the present disclosure also provides a storage medium. FIG. 10 is a schematic diagram of a storage medium provided by at least one embodiment of the present disclosure. For example, as shown in FIG. 10, the storage medium 400 non-transitory stores computer-readable instructions 401, and when the non-transitory computer-readable instructions are executed by a computer (including a processor), any one of the embodiments of the present disclosure can be executed. How to get the location of the disease.
例如,该存储介质可以是一个或多个计算机可读存储介质的任意组合, 例如一个计算机可读存储介质包含确定该子模型的显示面数的计算机可读的程序代码,另一个计算机可读存储介质包含确定疾病位置的计算机可读的程序代码。例如,当该程序代码由计算机读取时,计算机可以执行该计算机存储介质中存储的程序代码,执行例如本公开任一实施例提供的疾病位置获取方法。For example, the storage medium may be any combination of one or more computer-readable storage media. For example, one computer-readable storage medium contains computer-readable program code for determining the number of display faces of the sub-model, and another computer-readable storage medium The medium contains computer-readable program code that determines the location of the disease. For example, when the program code is read by a computer, the computer can execute the program code stored in the computer storage medium, and execute, for example, the disease location acquisition method provided in any embodiment of the present disclosure.
例如,存储介质可以包括智能电话的存储卡、平板电脑的存储部件、个人计算机的硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM)、便携式紧致盘只读存储器(CD-ROM)、闪存、或者上述存储介质的任意组合,也可以为其他适用的存储介质。For example, the storage medium may include a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), Portable compact disk read-only memory (CD-ROM), flash memory, or any combination of the foregoing storage media may also be other suitable storage media.
有以下几点需要说明:The following points need to be explained:
(1)本公开实施例附图只涉及到与本公开实施例涉及到的结构,其他结构可参考通常设计。(1) The drawings of the embodiments of the present disclosure only refer to the structures related to the embodiments of the present disclosure, and other structures can refer to the usual design.
(2)在不冲突的情况下,本公开的实施例及实施例中的特征可以相互组合以得到新的实施例。(2) In the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.
以上所述仅是本公开的示范性实施方式,而非用于限制本公开的保护范围,本公开的保护范围由所附的权利要求确定。The above are only exemplary implementations of the present disclosure, and are not used to limit the protection scope of the present disclosure, which is determined by the appended claims.

Claims (18)

  1. 一种疾病位置获取方法,包括:A method for obtaining the location of a disease, including:
    通过疾病数据获取所述疾病数据的元素特征;以及Obtain the element characteristics of the disease data through the disease data; and
    基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。Based on the element characteristics of the disease data, multiple disease location models are used to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
  2. 根据权利要求1所述的方法,其中,所述多个疾病位置模型对应于多个人体器官,且每个模型包含与其对应的至少一个标签,The method according to claim 1, wherein the multiple disease location models correspond to multiple human organs, and each model contains at least one label corresponding to it,
    所述基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置包括:The obtaining the three-dimensional position of the disease by using multiple disease position models based on the element characteristics of the disease data includes:
    将所述疾病数据的元素特征对应到所述多个疾病位置模型中的至少一个标签,以获得所述疾病的三维位置。The element feature of the disease data is corresponding to at least one label in the multiple disease location models to obtain the three-dimensional location of the disease.
  3. 根据权利要求2所述的方法,还包括:The method according to claim 2, further comprising:
    基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置,Based on the disease data, the corrected three-dimensional position of the disease is obtained through the first neural network,
    其中,所述第一神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括多个疾病信息,所述识别标签包括与所述多个疾病信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。Wherein, the first neural network is obtained by training with training data, the training data includes feature data and identification tags, the feature data includes multiple disease information, and the identification tags include information corresponding to the multiple disease information. The three-dimensional position of the disease information includes disease data of a plurality of different diseases.
  4. 根据权利要求2所述的方法,还包括:The method according to claim 2, further comprising:
    在疾病数据的元素特征无法对应到所述多个疾病位置模型中的至少一个时,基于所述疾病数据,通过第二神经网络获得所述疾病的三维位置,When the element characteristics of the disease data cannot correspond to at least one of the multiple disease location models, based on the disease data, obtain the three-dimensional location of the disease through a second neural network,
    其中,所述第二神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括与所述疾病分类信息不同的疾病分类信息,所述识别标签包括与所述特征数据中包括的疾病分类信息对应的三维位置。Wherein, the second neural network is obtained by training with training data, the training data includes feature data and identification labels, the feature data includes disease classification information different from the disease classification information, and the identification labels include The three-dimensional position corresponding to the disease classification information included in the feature data.
  5. 根据权利要求1-4任一项所述的方法,其中,所述多个疾病位置模型是通过疾病分类信息基于身体的不同的三维位置划分得到的。The method according to any one of claims 1 to 4, wherein the multiple disease location models are obtained by dividing the disease classification information based on different three-dimensional locations of the body.
  6. 根据权利要求5所述的方法,其中,所述疾病分类信息对应于不同的疾病名称,且每个疾病分类信息包含与其对应的至少一个名称标签,所述方法还包括:The method according to claim 5, wherein the disease classification information corresponds to different disease names, and each disease classification information contains at least one name tag corresponding to the disease classification information, and the method further comprises:
    将所述疾病数据的元素特征匹配到所述疾病分类信息的至少一个名称标 签以获得所述疾病数据对应的疾病名称。Matching the element characteristics of the disease data to at least one name label of the disease classification information to obtain the disease name corresponding to the disease data.
  7. 根据权利要求6所述的方法,其中,The method of claim 6, wherein:
    所述疾病数据是从健康测评、体检报告、健康数据和外设输入中的一个或多个中获得的。The disease data is obtained from one or more of health assessment, physical examination report, health data and peripheral input.
  8. 根据权利要求6所述的方法,其中,The method of claim 6, wherein:
    在获得所述疾病的三维位置后,在三维人体结构上高亮显示所述三维位置。After obtaining the three-dimensional position of the disease, highlight the three-dimensional position on the three-dimensional human body structure.
  9. 一种疾病位置获取装置,包括:A device for acquiring disease location, including:
    元素特征获取单元,用于通过疾病数据获取所述疾病数据的元素特征;以及An element feature acquisition unit for acquiring the element feature of the disease data through the disease data; and
    三维位置获取单元,用于基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。The three-dimensional position acquiring unit is configured to acquire the three-dimensional position of the disease using multiple disease location models based on the element characteristics of the disease data, wherein the multiple disease location models respectively correspond to different three-dimensional positions of the body.
  10. 根据权利要求9所述的装置,其中,所述多个疾病位置模型对应于多个人体器官,且每个模型包含与其对应的至少一个标签,所述三维位置获取单元将所述疾病数据的元素特征对应到所述多个疾病位置模型中的至少一个标签,以获得所述疾病的三维位置。The device according to claim 9, wherein the multiple disease location models correspond to multiple human organs, and each model contains at least one tag corresponding to it, and the three-dimensional location acquisition unit integrates elements of the disease data The feature corresponds to at least one label in the multiple disease location models to obtain the three-dimensional location of the disease.
  11. 根据权利要求10所述的装置,还包括:The device according to claim 10, further comprising:
    三维位置获取单元基于所述疾病数据,通过第一神经网络获得所述疾病的修正的三维位置,The three-dimensional position obtaining unit obtains the corrected three-dimensional position of the disease through the first neural network based on the disease data,
    其中,所述第一神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括多个疾病信息,所述识别标签包括与所述多个疾病信息对应的三维位置,所述多个疾病信息包含多个不同疾病的疾病数据。Wherein, the first neural network is obtained by training with training data, the training data includes feature data and identification tags, the feature data includes multiple disease information, and the identification tags include information corresponding to the multiple disease information. The three-dimensional position of the disease information includes disease data of a plurality of different diseases.
  12. 根据权利要求10所述的装置,还包括:The device according to claim 10, further comprising:
    在疾病数据的元素特征无法对应到所述多个疾病位置模型中的至少一个时,所述三维位置获取单元基于所述疾病数据,通过第二神经网络获得所述疾病的三维位置,When the element feature of the disease data cannot correspond to at least one of the multiple disease location models, the three-dimensional location acquiring unit obtains the three-dimensional location of the disease through a second neural network based on the disease data,
    其中,所述第二神经网络是通过训练数据训练获得的,所述训练数据包括特征数据和识别标签,所述特征数据包括与所述疾病分类信息不同的疾病分类信息,所述识别标签包括与所述特征数据中包括的疾病分类信息对应的 三维位置。Wherein, the second neural network is obtained by training with training data, the training data includes feature data and identification labels, the feature data includes disease classification information different from the disease classification information, and the identification labels include and The three-dimensional position corresponding to the disease classification information included in the feature data.
  13. 根据权利要求9-12任一项所述的装置,其中,所述多个疾病位置模型是通过疾病分类信息基于身体的不同的三维位置划分得到的。The device according to any one of claims 9-12, wherein the multiple disease location models are obtained by dividing the disease classification information based on different three-dimensional locations of the body.
  14. 根据权利要求10所述的装置,其中,所述疾病分类信息对应于不同的疾病名称,且每个疾病分类信息包含与其对应的至少一个名称标签,所述三维位置获取单元将所述疾病数据的元素特征匹配到所述疾病分类信息的至少一个名称标签以获得所述疾病数据对应的疾病名称。The device according to claim 10, wherein the disease classification information corresponds to different disease names, and each disease classification information contains at least one name tag corresponding to the disease classification information, and the three-dimensional position acquisition unit combines the disease data with The element feature is matched to at least one name tag of the disease classification information to obtain the disease name corresponding to the disease data.
  15. 根据权利要求14所述的装置,其中,The device according to claim 14, wherein:
    所述三维位置获取单元在获得所述疾病的三维位置后,在三维人体结构上高亮显示所述三维位置。After obtaining the three-dimensional position of the disease, the three-dimensional position obtaining unit highlights the three-dimensional position on the three-dimensional human body structure.
  16. 一种疾病位置获取设备,包括:A disease location acquisition device, including:
    处理器;以及Processor; and
    存储器,其中存储计算机可读指令,Memory, in which computer-readable instructions are stored,
    其中,在所述计算机可读指令被所述处理器运行时执行疾病位置获取方法,所述方法包括:Wherein, when the computer-readable instruction is executed by the processor, the method for acquiring the disease location is executed, and the method includes:
    通过疾病数据获取所述疾病数据的元素特征;以及Obtain the element characteristics of the disease data through the disease data; and
    基于所述疾病数据的元素特征,利用多个疾病位置模型获取所述疾病的三维位置,其中所述多个疾病位置模型分别对应于身体的不同的三维位置。Based on the element characteristics of the disease data, multiple disease location models are used to obtain the three-dimensional location of the disease, wherein the multiple disease location models respectively correspond to different three-dimensional locations of the body.
  17. 一种用于存储计算机可读程序的计算机可读存储介质,所述程序使得计算机执行如权利要求1-8任一项所述的疾病位置获取方法。A computer-readable storage medium for storing a computer-readable program, the program causing a computer to execute the method for acquiring the disease location according to any one of claims 1-8.
  18. 一种电子设备,包括:权利要求9-15任一项所述的疾病位置获取装置和显示界面;An electronic device, comprising: the disease location acquiring device according to any one of claims 9-15 and a display interface;
    其中,所述显示界面被配置为显示三维人体模型,所述三维人体模型在采用所述权利要求1-9中任一项所述的疾病位置获取方法得到的三维位置处显示疾病分类信息,并高亮显示得到的三维位置对应的器官。Wherein, the display interface is configured to display a three-dimensional human body model, the three-dimensional human body model displays disease classification information at a three-dimensional position obtained by using the disease position acquisition method according to any one of claims 1-9, and Highlight the organ corresponding to the obtained three-dimensional position.
PCT/CN2020/073580 2020-01-21 2020-01-21 Disease location acquisition method, apparatus, device and computer readable storage medium WO2021146941A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2020/073580 WO2021146941A1 (en) 2020-01-21 2020-01-21 Disease location acquisition method, apparatus, device and computer readable storage medium
CN202080000061.1A CN113728398A (en) 2020-01-21 2020-01-21 Disease position acquisition method, device, equipment and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/073580 WO2021146941A1 (en) 2020-01-21 2020-01-21 Disease location acquisition method, apparatus, device and computer readable storage medium

Publications (1)

Publication Number Publication Date
WO2021146941A1 true WO2021146941A1 (en) 2021-07-29

Family

ID=76991759

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/073580 WO2021146941A1 (en) 2020-01-21 2020-01-21 Disease location acquisition method, apparatus, device and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN113728398A (en)
WO (1) WO2021146941A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114388085A (en) * 2021-11-23 2022-04-22 皖南医学院第一附属医院(皖南医学院弋矶山医院) Real-time intelligent auxiliary ICD coding method and system based on medical record

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106021920A (en) * 2016-05-17 2016-10-12 华南师范大学 Automatic diagnosis oriented medical data processing system and device based on neural network
CN106909778A (en) * 2017-02-09 2017-06-30 北京市计算中心 A kind of Multimodal medical image recognition methods and device based on deep learning
CN109447183A (en) * 2018-11-27 2019-03-08 东软集团股份有限公司 Model training method, device, equipment and medium
CN109741806A (en) * 2019-01-07 2019-05-10 北京推想科技有限公司 A kind of Medical imaging diagnostic reports auxiliary generating method and its device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106021920A (en) * 2016-05-17 2016-10-12 华南师范大学 Automatic diagnosis oriented medical data processing system and device based on neural network
CN106909778A (en) * 2017-02-09 2017-06-30 北京市计算中心 A kind of Multimodal medical image recognition methods and device based on deep learning
CN109447183A (en) * 2018-11-27 2019-03-08 东软集团股份有限公司 Model training method, device, equipment and medium
CN109741806A (en) * 2019-01-07 2019-05-10 北京推想科技有限公司 A kind of Medical imaging diagnostic reports auxiliary generating method and its device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114388085A (en) * 2021-11-23 2022-04-22 皖南医学院第一附属医院(皖南医学院弋矶山医院) Real-time intelligent auxiliary ICD coding method and system based on medical record

Also Published As

Publication number Publication date
CN113728398A (en) 2021-11-30

Similar Documents

Publication Publication Date Title
US11657044B2 (en) Semantic parsing engine
CN110738263B (en) Image recognition model training method, image recognition method and image recognition device
CN111863170A (en) Method, device and system for generating electronic medical record information
US11288279B2 (en) Cognitive computer assisted attribute acquisition through iterative disclosure
CN109074165A (en) Brain activity based on user and stare modification user interface
CN110472251A (en) Method, the method for statement translation, equipment and the storage medium of translation model training
US11900594B2 (en) Methods and systems for displaying a region of interest of a medical image
TW202040587A (en) Image segmentation method and apparatus, electronic device and storage medium
CN108369585B (en) Method for providing translation service and electronic device thereof
WO2020242641A1 (en) Method and system of detecting data imbalance in a dataset used in machine-learning
US20210240931A1 (en) Visual question answering using on-image annotations
CN108024763B (en) Activity information providing method and electronic device supporting the same
US10311613B2 (en) Electronic device for processing image and method for controlling thereof
US20160253318A1 (en) Apparatus and method for processing text
WO2021195670A1 (en) Location mapping for large scale augmented-reality
CN111091010A (en) Similarity determination method, similarity determination device, network training device, network searching device and storage medium
CN114765075A (en) Medicine recommendation method, device and system, electronic equipment and storage medium
CN112970013A (en) Electronic device and control method thereof
CN108536725A (en) Electronic equipment and its method that information is provided
WO2021146941A1 (en) Disease location acquisition method, apparatus, device and computer readable storage medium
US20230162844A1 (en) Patient provider matching system
US10409623B2 (en) Graphical user interface for localizing a computer program using context data captured from the computer program
CN107402659A (en) Electronic equipment and the method for receiving its user input
CN110489563B (en) Method, device, equipment and computer readable storage medium for representing graph structure
US20230125321A1 (en) User-guided structured document modeling

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20915424

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20915424

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27.03.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20915424

Country of ref document: EP

Kind code of ref document: A1