CN109192261B

CN109192261B - Information processing method and device, electronic device and storage medium

Info

Publication number: CN109192261B
Application number: CN201810955445.3A
Authority: CN
Inventors: 宋涛
Original assignee: Shanghai Sensetime Intelligent Technology Co Ltd
Current assignee: Shanghai Sensetime Intelligent Technology Co Ltd
Priority date: 2018-08-21
Filing date: 2018-08-21
Publication date: 2023-03-24
Anticipated expiration: 2038-08-21
Also published as: CN109192261A

Abstract

The embodiment of the invention discloses an information processing method and device, electronic equipment and a storage medium. The information processing method comprises the following steps: acquiring preset information of the displayed medical image; and dynamically generating a first template for medical report writing according to the preset information.

Description

Information processing method and device, electronic device and storage medium

Technical Field

The present invention relates to the field of information technologies, and in particular, to an information processing method and apparatus, an electronic device, and a storage medium.

Background

In the related art, there are roughly two ways of generating medical reports:

the first method comprises the following steps:

the doctor writes the medical report by hand or records the medical report by the computer according to the recording habit of the doctor, and the mode has low efficiency on one hand and different doctors have different writing habits on the other hand, so that unified management and data integration are not convenient.

And the second method comprises the following steps:

hospitals give certain writing formats, and doctors perform handwriting or computer input according to the general writing formats. However, since a doctor needs to manually input a lot of characters, the efficiency of generating a medical report is still low, and when a doctor generates a medical report while diagnosing it, it is still necessary to separate a relatively large amount of effort for generating a medical report.

Disclosure of Invention

The embodiment of the invention provides an information processing method and device, electronic equipment and a storage medium.

The technical scheme of the invention is realized as follows: an information processing method comprising:

acquiring preset information of the displayed medical image;

and dynamically generating a first template for medical report writing according to the preset information.

Based on the above scheme, the dynamically generating a first template for medical report composition according to the preset information includes:

selecting a first template from a plurality of candidate templates according to the preset information;

and dynamically adjusting the first template to obtain a second template according to the preset information.

Based on the above solution, the selecting the first template from the multiple candidate templates according to the preset information includes at least one of the following:

selecting a first template matched with the type information from the alternative templates according to the type information of the medical image;

selecting a first template matched with the part characteristics from the alternative templates according to the part characteristics of the part acquired by the medical image;

according to the focus information of the medical image, selecting a first template matched with the focus information from the alternative templates;

and selecting the first template from the alternative templates according to the diagnosis auxiliary information formed after the medical image is identified.

Based on the above scheme, the dynamically adjusting the first template to generate a second template according to the preset information includes at least one of the following:

deleting unnecessary content modules in the first template according to the preset information to generate the second template;

deleting unnecessary content items in the first template according to the preset information to generate the second template, wherein one content module comprises: one or more of the content items;

adding necessary content modules to the first template according to the preset information to generate a second template;

adding necessary content items to the first template according to the preset information to generate a second template;

according to the preset information, adjusting position information between content modules in the first template to generate a second template;

adjusting position information among content items in the first template according to the preset information to generate a second template;

adjusting the display parameters of the content module in the first template according to the preset information to generate a second template containing at least two display parameters;

and adjusting the display parameters of the content items in the first template according to the preset information to generate a second template comprising at least two display parameters.

determining a basic content module according to a basic framework of the medical report;

selecting a required adaptive content module from a content module library according to the preset information of the medical image;

and combining the basic content module and the adaptive content module according to a preset combination strategy to generate the first template.

Based on the above scheme, the selecting a required adaptive content module from a content module library according to the preset information of the medical image includes at least one of the following:

selecting an adaptive content module matched with the type information from the content module library according to the type information of the medical image;

selecting an adaptive content module matched with the part characteristics from the content module library according to the part characteristics of the part acquired by the medical image;

selecting an adaptive content module matched with the focus information from the content module library according to the focus information of the medical image;

and selecting the adaptive content module from the content module library according to the diagnosis auxiliary information formed after the medical image is identified.

Based on the above scheme, the method further comprises:

deleting the existing content items of the selected adaptive content module according to the preset information, wherein one content module comprises one or more content items;

adding content items to the adaptive content module according to the preset information;

determining the sequencing of the content items in the adaptive content module according to the preset information;

and determining the display parameters of the content items in the adaptive content module according to the preset information.

Based on the above scheme, the combining the basic content module and the adaptive content module to generate the first template according to a preset combining policy includes at least one of:

combining the basic content module and the adaptive content module according to a preset sequence;

arranging the adaptive content modules according to the relevance of the content modules; wherein the base content module is located before or after each of the adapted content modules.

Based on the above scheme, the method further comprises: generating a medical report based on the first template.

Based on the above scheme, the generating a medical report based on the first template includes:

displaying the first template;

displaying a first operation control on a content module of the first template;

generating a third template based on the first operation acted on the first operation control;

generating the medical report based on the second template.

Based on the above scheme, the method further comprises:

determining alternative information according to the preset information of the medical image;

displaying the alternative information and a second operation control at a blank position of a template to be filled;

and writing the alternative information into the template blank based on the second operation of the second operation control.

Based on the above scheme, the method further comprises:

highlighting a selection control of the first template or a second template according to a preset mode, wherein the second template is generated based on the first template;

the generating a medical report based on the first template comprises:

determining to generate the medical report based on the first template or the second template if a confirmation operation acting on the selection control is detected.

Based on the above scheme, the method further comprises:

and if the preset conditions are met, generating a custom template.

Based on the above scheme, the preset conditions include at least one of the following conditions:

if the confirmation operation acting on the selection control is not detected within the preset time;

detecting a denial operation acting on the selection control;

a third operation is detected that acts on the custom template control.

Based on the above scheme, if the preset condition is met, generating a custom template, including:

starting a natural language analysis processing component, and analyzing the natural language received from the man-machine interaction interface;

and generating the self-defined template according to the analysis result of the natural language.

Based on the above scheme, the generating a medical report based on the first template includes at least one of:

filling blanks in attributes of the first template marks or the second template according to attribute information in the identification result of the medical images, and automatically writing the attribute information, wherein the second template is generated based on the first template;

filling blank spaces in the quantification of the first template, the second template or the user-defined template according to quantification information in the identification result of the medical image, and automatically writing the quantification information;

filling blanks in medical staff information of medical staff of the first template, the second template or the user-defined template according to a login account or a treatment record of a diagnosis and treatment report, and automatically writing the medical staff information;

and filling blanks in the information of the medical staff of the first template, the second template or the user-defined template according to the information of the medical staff corresponding to the medical image, and automatically writing the information of the medical staff.

An information processing apparatus comprising:

the acquisition module is used for acquiring preset information of the displayed medical image;

and the generating module is used for dynamically generating a first template for writing the medical report according to the preset information.

Based on the above scheme, the generating module includes:

the first selection unit is used for selecting a first template from a plurality of candidate templates according to the preset information;

and the adjusting unit is used for dynamically adjusting the first template to obtain a second template according to the preset information.

Based on the foregoing solution, the first selecting unit is specifically configured to execute at least one of:

Based on the foregoing solution, the adjusting unit is specifically configured to execute at least one of the following:

adjusting position information among content modules in the first template according to the preset information to generate a second template;

Based on the above scheme, the generating module includes:

the determination unit is used for determining a basic content module according to the basic framework of the medical report;

the second selection unit is used for selecting a required adaptive content module from a content module library according to the preset information of the medical image;

and the combination unit is used for combining the basic content module and the adaptive content module according to a preset combination strategy to generate the first template.

Based on the foregoing solution, the second selecting unit is specifically configured to execute at least one of:

Based on the above scheme, the apparatus further comprises: an item adjustment module;

the adjusting module is specifically configured to execute at least one of:

Based on the above scheme, the combining unit is specifically configured to perform at least one of:

Based on the above scheme, the apparatus further comprises:

a report generation module to generate a medical report based on the first template.

Based on the scheme, the report generation module is specifically used for displaying the first template; displaying a first operation control on a content module of the first template; generating a third template based on the first operation acted on the first operation control; generating the medical report based on the third template.

Based on the above scheme, the apparatus further comprises:

the determining module is used for determining alternative information according to the preset information of the medical image;

the first control module is used for displaying the alternative information and the second operation control in a blank position of a template to be filled;

and the writing module is used for writing the alternative information into the blank of the template based on the second operation of the second operation control.

Based on the above scheme, the apparatus further comprises:

the second control module is used for highlighting the selection control of the first template or the second template according to a preset mode, wherein the second template is generated based on the first template;

the report generation module is specifically configured to determine to generate the medical report based on the first template or the second template if a confirmation operation acting on the selection control is detected.

Based on the above scheme, the apparatus further comprises:

and the custom module is used for generating a custom template if the preset conditions are met.

detecting a denial operation acting on the selection control;

a third operation is detected that acts on the custom template control.

Based on the above scheme, the report generating module is specifically configured to execute at least one of:

An electronic device, comprising:

the display module is used for displaying information;

a memory for information storage;

and the processor is respectively connected with the display module and the memory, is used for controlling the information display of the display module and the information storage of the memory by executing the computer executable instructions stored in the memory, and is also used for executing the information processing method provided by any item.

A computer-readable storage medium having stored thereon computer-executable instructions; the computer executable instructions, when processed, enable the information processing method provided by any of the preceding.

The information processing method and device, the electronic device and the storage medium provided by the embodiment of the invention can automatically determine the first template for generating the medical report according to the currently displayed medical image. As such, a first template automatically generated by the electronic device, and then a medical report generated based on the first template; is formed using a standardized data structure; manually entering a medical report with respect to a physician; the standardized data structure defines a first template such that the generated medical report is also constructed using the standardized data structure; and storage and universal identification of subsequent data are facilitated. On the other hand, when the medical image is displayed, the electronic equipment automatically acquires the information of the medical image according to the displayed medical image to determine the first template, so that the intelligentization is high, medical staff can conveniently generate a medical report based on the first template after reading the medical image, and the information required to be input by the medical staff is reduced; on the other hand, doctors can conveniently see and record at the same time to synchronously generate medical reports, and medical staff can conveniently have more energy for diagnosis due to less information input by the medical staff.

Drawings

Fig. 1 is a schematic flowchart of a first information processing method according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating a second information processing method according to an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating a template determination process according to an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a template provided in an embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solution of the present invention is further described in detail with reference to the drawings and specific embodiments.

As shown in fig. 1, the present embodiment provides an information processing method, including:

step S110: acquiring preset information of the displayed medical image;

step S120: and dynamically generating a first template for medical report writing according to the preset information.

The embodiment provides an information processing method which can be applied to various electronic devices, such as various terminal devices which can be operated by medical staff. The terminal device may include: mobile terminal and fixed terminal. The mobile terminal may include: various portable and portable electronic devices such as a notebook computer, a notebook computer and tablet computer integrated device, a tablet computer and a mobile phone. The fixed terminal may include: a desktop computer, a fixed terminal connected with the medical equipment and positioned in a diagnosis and treatment room, and the like.

In this embodiment, the displayed medical image may include: the medical image displayed by the electronic device and/or the projected medical image. The projection here may include: projection onto a projection area such as a projection screen or a projection wall; the method can also comprise the following steps: a projection projected into the eye of the user.

The medical images include, but are not limited to: computed Tomography (CT) images, magnetic Resonance Imaging (MRI), X-ray (XR) images. In summary, the images pointed by the medical images in the embodiment can be various images related to medical diagnosis, and the images can be specifically divided into: a static single image, which may also include: dynamic image video.

The preset information of the medical image may include:

the preset information of the medical image may include at least one of the following:

attribute information describing attributes of the medical image;

content information describing the content of the medical image.

The attribute information may include: one or more of the type of medical image, imaging principle, number of images, imaging frequency, imaging parameter, information of organization such as hospital and department for taking medical image, and information such as shooting parameter.

The content information may include: one or more of information related to imaging content, such as acquisition object and focus information of the medical image.

In this embodiment, the electronic device automatically generates a template suitable for the current medical report writing according to the preset information of the medical image displayed by the electronic device, so as to only possibly reduce redundant information and the like in the medical report.

The electronic equipment can determine whether the medical report needs to be generated currently according to the medical image displayed by the electronic equipment. If there is a need to generate a medical report, the templates used for the medical report are automatically determined prior to generating the medical report. In this embodiment, the first template may include: the medical report includes content modules, layout between modules, and type of medical report. The medical report may be a text file or a multimedia file.

In this embodiment, in step S110, the first template or the content combined into the first template may be dynamically selected based on a keyword matching manner according to keywords in various preset information of the medical image. For example, keywords are extracted from various preset information of medical images by using a natural language analysis algorithm. There are various ways to extract the keywords, and this is not illustrated here.

In step S120, the electronic device automatically determines the first template without requiring medical staff to input a medical report manually or selecting a template by the medical staff, which obviously simplifies the work of the medical staff and improves the work efficiency of the medical staff.

For example, the electronic device currently displays medical images based on user operations; the electronic equipment can determine that the medical report needs to be generated in the background; the automatic determination of the first template for generating the medical report is initiated.

For example, in some embodiments, the electronic device determines that the login account used in currently displaying the medical image is a specific account, automatically determines in the background whether there is a need to generate a medical report, and automatically generates the first template if there is a need to generate a medical report.

Judging that the login account used for currently displaying the medical image is as follows: account numbers of the primary physicians determined in the database; if the login account used for currently displaying the medical image is the account of the main doctor, whether a medical report corresponding to the medical image is generated or not is determined, if the medical report is not generated, the requirement for generating the medical report is determined, and the electronic equipment automatically determines the first template in the background. Thus, when the doctor finishes viewing the medical image, the first template is generated, and the doctor can write the medical report based on the first template.

After step S120, the electronic device presents or recommends the first template. For example, after the electronic device is instructed by a user to quit the display of the medical image in the foreground, the display page of the first template is directly switched to for displaying; or, displaying a template recommendation interface; displaying the first template on the target recommendation interface; or, a template selection interface is displayed, and the first template is displayed at the top of the selection interface; or the first template is displayed by directly adopting the display parameters which are not used for other default templates, so that the first template and the other default templates are displayed in a distinguishing way, and the recommendation of the first template is realized.

The presentation parameters may include at least one of:

display parameters at the time of display;

projection parameters during projection;

printing parameters at the time of printing.

If the display parameters are different, the display effect is different; and if the projection parameters are different, the projection effect is different. And the printing effect is different when the printing parameters are different.

In some embodiments, the display parameters, the projection parameters, and the printing parameters may correspond to one set of display parameters or different display parameters.

In some embodiments, the number of the first templates may be 1, or may be multiple; a plurality of first templates for further selection by the physician.

The first template may be generated according to a standardized data structure in step S120, so that, in step S120, due to the use of the first template, compared with the writing of a medical report by each medical staff according to the writing habit thereof, it is equivalent to the realization of the unification or standardization of the format or the included content of the medical report, on one hand, the unification management of the medical report and the mutual circulation among different medical staff; on the other hand, the unification and the labeling of the data structure of the medical report background database are facilitated, so that the data management is better realized, for example, unified compression processing, general retrieval of medical reports and the like; the efficiency of storing and utilizing the medical report is improved.

In some embodiments, as shown in fig. 2, the step S120 may include:

step S1201: selecting a first template from a plurality of candidate templates according to the preset information;

step S1202: and dynamically adjusting the first template to obtain a second template according to the preset information.

In this embodiment, the electronic device may obtain a plurality of candidate templates from a local database or a connected database, and then automatically select one or more first templates adapted to the medical image from the plurality of candidate templates according to preset content of the displayed medical image. In this embodiment, one or more templates selected from the candidate templates are capable of satisfying the requirements of the medical report based on the medical image diagnosis.

Since a plurality of candidate templates are configured in advance, and the candidate templates are standardized templates, it is obvious that the medical report generated by using the templates in the candidate templates definitely conforms to the specific standardized data structure of the background database. The first template is selected from the plurality of candidate templates, and the candidate templates are generated in advance, so that the efficiency is high.

After a first template is selected from a plurality of templates, the first template is dynamically adjusted according to preset information to obtain a second template.

In some embodiments, the step S1202 may include at least one of:

For example, medical images may be classified into different types according to imaging principles, such as CT images, MRI images, XR images, and the like; different medical images may correspond to a particular type of medical diagnosis, and as such, the same type of medical image may correspond to the same type of medical report, and as such, the same template may be employed.

An MRI template adapted to the MRI image, the MRI template may include: a content module for importing MRI images and/or a content module for writing the film-viewing result of MRI. For example, the MRI templates may include: tumor templates for tumor medical reports for tumor diagnosis.

For example, when a bone diagnosis is performed using a CT image, a bone medical report is made in accordance with the CT image.

The medical image can be identified by using a machine learning model such as a neural network, and an imaging object of the medical image can be identified, for example, the first template is determined for an object collected by the head, the chest, the abdominal cavity, the upper limbs, the lower limbs and the like of a human body.

The lesion information may be: information describing a lesion in the medical image, the lesion may be: the diseased part of the body is called diseased tissue for short. For example, the lesion information may include: describing one or more of lesion tissue type, lesion extent, lesion type information.

In this manner, an appropriate first template may be selected from a plurality of candidate templates based on lesion information to generate the medical report. Taking a tumor as an example, the first template is selected from a plurality of candidate templates according to the organ where the tumor tissue is located, the benign and malignant of the tumor, and the tumor stage of the malignant tumor.

The diagnostic assistance information may include: after the medical image is processed by a machine learning model such as a neural network, various information for assisting the diagnosis of medical staff is automatically generated by the learning model. For example, the auxiliary diagnostic information includes, but is not limited to: geometric characteristics of the lesion tissue, lesion degree information of the lesion tissue, device diagnosis information, and the like.

The geometric features may include: size characteristics and shape characteristics of lesion tissues.

The size characteristics describe the size of the lesion tissue in different directions, e.g., length, width, height, area or volume, etc.

The shape feature may be a feature that describes the shape of the lesion site within the lesion tissue, throughout the entirety of the lesion tissue.

The device diagnostic information may include: and the electronic equipment provides disease condition evaluation information according to the geometric characteristics of the diseased tissue and the diseased degree information.

In short, the electronic device acquires one or more of various preset information of the currently displayed medical image, and comprehensively selects the first template matched with the current medical image.

In some embodiments, the dynamic adjustment of step S1202 may include any one of the following ways:

the first method is as follows: the step S1202 may include: deleting unnecessary content modules in the first template according to the preset information to generate the second template;

the second method comprises the following steps: the step S1202 may include: deleting unnecessary content items in the first template according to the preset information to generate the second template, wherein one content module comprises: one or more of the content items;

the third method comprises the following steps: the step S1202 may include: adding necessary content modules to the first template according to the preset information to generate a second template;

the method is as follows: the step S1202 may include: adding necessary content items to the first template according to the preset information to generate a second template;

a fifth mode; the step S1202 may include: adjusting position information among content modules in the first template according to the preset information to generate a second template;

the method six: the step S1202 may include: according to the preset information, adjusting position information among content items in the first template to generate a second template;

the method is as follows: the step S1202 may include: adjusting the display parameters of the content module in the first template according to the preset information to generate a second template containing at least two display parameters;

the method eight: the step S1202 may include:

Both the first template and the second template may consist of a plurality of content modules, and one content module may consist of one or more content items. Here, dynamically adjusting the first template may include: adjusting the granularity by using the content module and/or adjusting the granularity by using the content item; thus the dynamic adjustment of the first template may be based on module granularity as well as on item granularity.

In a first mode, the alternative template may be a first type template, and the first type template may include: templates for all or most of the content modules required for the medical report, so that unnecessary content modules can be dynamically deleted according to the current requirement each time the first template is generated, thereby reducing redundant information of the generated medical report.

In mode two, some content items in a selected content module may not be currently needed; for example, in one detection process, if the content item a is not detected currently by the doctor, the content item a may be deleted. For another example, in order to reduce redundant information, one content module originally includes all content entries, but only the content entry corresponding to the index abnormality may need to be retained in the diagnostic report, and then the content entry corresponding to the index abnormality may be deleted.

In the third mode, the alternative template may be a second type template; the second type template may include: the template of the basic content module required by the current type template or the template of the content module required under most conditions is included, so that when the first template is generated at this time, the required content module can be added according to the preset information of the medical image.

In the fourth mode, an addable content item is also added to the content module corresponding to the selected template.

In the fifth and sixth modes, for example, the content modules or content items on which lesion tissues of different lesion degrees should be emphasized are different; dynamically adjusting the location information between content templates or content items is equivalent to adjusting the layout of different content modules or content items on the medical report. For example, the content modules or content items to be viewed side by side need to be adjusted to adjacent positions, for example, two content modules or content items to be viewed simultaneously are arranged side by side or front and back adjacently. For another example, the content module or content item needing emphasis is inserted into a position most convenient for the user to view, for example, a first page of the template, a middle position of the first page, and the like.

In the seventh mode and the eighth mode, different content items or content modules are displayed in a differentiated manner by setting different display parameters, so that different content modules and content items are distinguished in a visual effect, and a subsequent reader is attracted to focus on the content needing attention.

For example, in the present embodiment, through setting at least two presentation parameters, the differentiation of the presentation styles of different content items in different modules or a single content module is substantially achieved, so as to differentiate the information displaying different importance levels or priority levels.

In this embodiment, the display parameters may determine display characteristics or projection characteristics or post-print characteristics of the generated medical report based on the second template.

In this way, by differentiating the display parameters, the presentation effect of the medical report generated based on the second template is differentiated, and by the differentiated presentation, the reader of the medical report can quickly grasp important or important attention-required information in the medical report.

In some embodiments, as shown in fig. 3, the step S120 may include:

step S1211: determining a basic content module according to a basic framework of the medical report;

step S1212: selecting a required adaptive content module from a content module library according to the preset information of the medical image;

step S1213: and combining the basic content module and the adaptive content module according to a preset combination strategy to generate the first template.

In some embodiments, the first template is dynamically generated, rather than being selected from an already organized candidate template. Various content modules are stored in a local database of the electronic device or a connected remote database.

In step S1212, a basic content module is determined from the basic framework of the medical report. The base content module may include at least one of:

the system comprises a medical staff information module, a medical staff information module and a medical image information module.

The medical staff information module can comprise: adding the treatment time of the patient, the hospital, the treatment number, the medical insurance number and the identity information of the patient.

The medical staff information may include: basic identity information such as the number and name of the doctor participating in the diagnosis.

The medical image information may include, but is not limited to, at least one of the following: the type and name of the medical image, the key segment captured in the medical image, the acquisition path of the original medical image (e.g., uniform resource address (URL) of original medical image viewing), etc.

The adaptive content module can comprise other content modules besides the content module required by the basic frame of the medical image.

And the electronic equipment combines the content modules according to a preset combination strategy to generate the first template.

Combining the content modules includes: and typesetting the basic content module and the adaptive content module to generate a first template to be filled.

The preset combination strategy can be configured in the electronic device in advance, or the electronic device selects from a plurality of combination strategies according to preset information of the current medical image.

For example, the preset combination policy may include: the priority policy can be used for preferentially laying out the content module needing to be emphasized and then laying out other content modules.

For example, the preset combination policy may include: and the general combination strategy combines the selected basic content module and the adaptive content module according to the content arrangement sequence of the general medical report.

In short, the preset combination strategy has various types, and is not limited to any one of the above.

In some embodiments, the step S1212 may include at least one of:

according to the focus information of the medical image, selecting an adaptive content module matched with the focus information from the content module library;

In some embodiments, the method further comprises:

In some embodiments, the combining the basic content module and the adapted content module according to a preset combining policy to generate the first template includes at least one of:

The relevance of the content module may include:

content associations between content modules;

the time sequence relevance of the medical procedure corresponding to the content module.

For example, if a diagnostic result is generated and the contents of the content module a and the content module B are combined, there is a content correlation between the content module a and the content module B.

For example, the doctor takes a plurality of medical images, and the content modules corresponding to different medical images have the time sequence relevance according to the taking time sequence of the medical images.

In some embodiments, the adapted content modules having relevance are ordered adjacently or side-by-side in the first template.

When none of the plurality of adapted content modules has relevance, the adapted content modules may be randomly ordered.

The medical report may include, but is not limited to, at least one of: physical examination report, pathological examination report, and assay report.

In some embodiments, the step S110 may include:

and selecting a first template from a plurality of alternative templates according to the displayed preset information of the medical image.

In this embodiment, the electronic device automatically selects an appropriate first template from the candidate templates according to preset information of the medical image displayed by the electronic device to generate the medical report.

In some embodiments, the method further comprises:

and if the adaptive content module is selected, adjusting the content items in the basic content module and/or the adaptive content module according to the preset information. The adjustment of the content item may comprise: deletion of content items, addition of content items, replacement of content items of the same type, etc. Of course, the above is merely an example, and in any case, when generating the first template, the first template may be dynamically generated according to the module granularity or the project granularity as required.

In other embodiments, the method further comprises: generating a medical report based on the first template.

Generating a medical report herein may include: the medical report is generated automatically or based on input from a doctor.

The generating a medical report based on the first template may include:

displaying the first template;

displaying a first operation control on a content module of the first template;

generating the medical report based on the third template.

The presentation herein may include: displaying or projecting the first template. The first operation control is displayed on the content module of the first template while the first template is displayed, so that the input personnel of the medical report can delete, add and modify the corresponding content module to generate a third template according to the current requirement by acting on the first operation of the first operation control, and thus, the input personnel are endowed with certain template custom authority.

In this embodiment, the medical report is generated based on the third template, and the medical report thus generated is still a standard template recognizable by the database.

In some embodiments, the method further comprises:

In this embodiment, the electronic device not only automatically or assisted in generating the template of the medical report, but also obtains the candidate information to be filled in.

In one aspect, the candidate information is generated in a standardized format, such that if the candidate information is confirmed to be filled in the template to generate the medical report, the candidate information must be in a standardized data format or standardized expressed standard information that can be recognized by the device.

On the other hand, in the embodiment, the second operation control is displayed in the blank of the template of the content to be filled, and an input person (for example, a doctor) of the medical report can write the alternative information into the corresponding blank through one-button operation according to the requirement, so that the input person does not need to input the content quantity by purely manual operation, the user operation is simplified, and the generation efficiency of the medical report is improved.

On the other hand, due to the display of the second operation control, if the input personnel think that the alternative information is not suitable or not accurate enough, more accurate or suitable contents can be written in the medical report through manual input, and therefore, the manual input of the input personnel is facilitated.

In a word, the generation requirements of different medical reports under different scenes are met through the display of the alternative information and the second operation control.

In some embodiments, the method further comprises:

the generating a medical report based on the first template may include: determining to generate the medical report based on the first template or the second template if a confirmation operation acting on the selection control is detected.

In this embodiment, the electronic device may finally determine the first template or the second template selected based on the first template.

In the present embodiment, the first template or the second template is not directly selected and output, but is selected on a template selection interface or a generation interface of a medical report.

The template selection interface may present an interface for various templates to choose from, such as a template list interface.

In some embodiments, the highlighting may include: highlighting a selection control of the first template or the second template, the selection control may be: a thumbnail of the first template or the second template.

In other embodiments, the highlighting may include: if a plurality of templates are displayed in an overlapping manner, the first template or the second template is displayed at the top, so that the first template or the second template is displayed once entering a template selection interface or a medical report generation interface.

In still other embodiments, the highlighting may comprise: and if the thumbnails or the selection controls of the plurality of templates are displayed in parallel, displaying the thumbnails or the selection controls of the first template or the second template according to display parameters different from those of the thumbnails or the selection controls of other templates.

In some embodiments, the method further comprises: and if the preset conditions are met, generating a self-defined template.

If the medical personnel think that the current situation is not suitable for adopting any one of the pre-defined or dynamically generated templates, the template can be self-defined.

It is noted that in some embodiments, the custom template is also composed of a standardized data structure, which facilitates uniform management of the medical report generated based on the custom template by the background, and improves the universality of the medical report generated based on the custom template.

In some embodiments, the foot preset condition comprises at least one of:

detecting a denial operation acting on the selection control;

a third operation is detected that acts on the custom template control.

For example, no confirmation operation for selecting the control is detected within a preset time, such as 5, 10, or 15. The starting moment of the preset time is the moment of displaying the selection control; the electronic device may assume that the medical person does not select the recommended first template or second template.

The selection control may include: a confirmation control to indicate selection of the first template or the second template, and/or a denial control to indicate non-selection of the first template or the second template. If the denial operation actively input by the medical staff and acting on the denial control is detected, the fact that the medical staff do not want to select the first template or the second template and want to self-define the template is indicated.

In other embodiments, a custom module control of the custom template is further arranged on the template selection interface or the generation interface of the medical report, and if a third operation acting on the control is detected, the fact that the medical staff want to customize the template can be determined.

In this embodiment, the electronic device starts the natural language analysis processing component when determining that the template needs to be customized. The natural language analysis component herein may be a functional component having a natural language analysis function, may correspond to a plug-in or component embedded in an operating system, or a specific application installed in an operating system.

For example, a user inputs natural language through voice or manually, key information is identified through analysis and decoding of the natural language, and a custom template is automatically generated according to the key information.

For example, according to the key information, a corresponding content module can be selected from a content template library to construct the custom template.

For another example, a content module containing the key information is selected according to the key information.

For another example, the content module is generated according to the generation strategy of the template content and in combination with the key information.

If the content modules which need to be contained in the custom module are determined, the content modules can be combined, and the custom template is finally generated. For example, the custom module is generated according to the aforementioned preset combination policy. For example, the content modules contained in the same custom template can be divided into: the basic content module and the custom content module can be sorted from front to back in the custom template according to the time sequence of the generation of the custom content module aiming at the combination of the custom content module.

Specifically, if the preset condition is met, generating a custom template, including:

In some embodiments, generating the medical report based on the first template may include at least one of:

Therefore, once the generation template of the medical report is determined, the electronic equipment can automatically write the determined information which can be automatically filled in into the corresponding position of the template, so that the information content required to be input or selected by a user is reduced, the generation efficiency of the medical report is improved, and manual errors such as manual input are reduced.

The quantization information may include: various information that can be digitized. The quantization information may include: number of diseased cells, size characteristics of diseased cells; as another example, various assay data.

Fig. 4 is a schematic diagram of a first template, a second template or a custom template provided in this embodiment; in fig. 4, a theme module, a medical staff information module, and a medical staff information module are shown. These three content modules may be the aforementioned basic content modules; the content modules 1 to 4 in fig. 4 may be adapted content modules. In fig. 4, 4 content modules are illustrated as an example; in essence, the number of the content modules in the first template or the second template can be set according to the current diagnosis and treatment requirement.

In the foregoing embodiments, the dynamic adjustment of the first module and the dynamic generation of the second module are performed by using a content module as a granularity, and in other embodiments, the dynamic adjustment of the first module and the dynamic generation of the second module may also be performed by using a content item as a granularity. One said content module may comprise a plurality of content items. In some embodiments, the desired content module and/or content item may be determined from the medical image. If the dynamic adjustment of the first template and the dynamic generation of the second template are performed with the content item as granularity, the generated medical report has less redundant information and more accurate content description according to the dynamic adjustment or the dynamic generation of the content item.

In some embodiments, the theme module, the medical staff information module, and the medical staff information module in fig. 4 may be automatically filled in through information interaction with other devices, sources of medical images, and the like.

Of course, fig. 4 is an example of the first template, the second template, or the custom template, and the specific implementation is not limited to the above example.

As shown in fig. 5, the present embodiment provides an information processing apparatus including:

an obtaining module 110, configured to obtain preset information of a displayed medical image;

a generating module 120, configured to dynamically generate a first template for medical report composition according to the preset information.

In some embodiments, the obtaining module 110 and the generating module 120 may correspond to program modules, and the program modules, when executed by the processor, can obtain the preset information and dynamically generate the first template.

In other embodiments, the obtaining module 110 and the generating module 120 may be composed of a hardware structure and a software module; the hardware structure and the software module jointly realize the acquisition of preset information and the dynamic generation of the first template. For example, the obtaining module 110 and the generating module 120 correspond to a programmable array; the programmable array may include: a field programmable array or a complex programmable array.

In still other embodiments, the generating module 120 comprises:

In some further embodiments, the first selecting unit is specifically configured to perform at least one of:

In some further embodiments, the adjusting unit is specifically configured to perform at least one of:

In some further embodiments, the generating module 120 includes:

In some further embodiments, the second selecting unit is specifically configured to perform at least one of:

In still other embodiments, the apparatus further comprises: an item adjustment module;

the adjusting module is specifically configured to execute at least one of:

In still other embodiments, the apparatus further comprises:

In some further embodiments, the report generation module is specifically configured to display the first template; displaying a first operation control on a content module of the first template; generating a third template based on the first operation acted on the first operation control; generating the medical report based on the third template.

In still other embodiments, the apparatus further comprises:

In still other embodiments, the foot preset condition includes at least one of:

detecting a denial operation acting on the selection control;

a third operation is detected that acts on the custom template control.

In some further embodiments, the generating a custom template if the preset condition is met includes:

Several specific examples are provided below in connection with any of the embodiments described above:

at present, hospitals generally have corresponding information systems (such as PACS, RIS, HIS and the like), so that the whole process can be completely finished on a computer.

In addition, in order to improve the efficiency of writing medical reports by doctors and reduce the number of characters required to be input by doctors, the existing information-based related software generally provides the function of a medical report template, and a doctor only needs to interactively select a corresponding template through a mouse or a keyboard according to a diagnosis conclusion of the doctor and then input and modify a small amount of characters on the template according to different conditions of specific patients.

Therefore, the current flow of writing medical reports by general doctors is generally as follows:

1. selecting modalities for medical imaging, e.g. CT, MRI, XR, etc

2. Selecting the part of the examination to which the image corresponds, e.g. head examination, chest examination, abdomen examination, leg examination, etc

3. Selecting a report template corresponding to the disease type, such as a health template, a template with pathological changes on the head (different templates such as tumors, cerebral hemorrhage, cerebral apoplexy, cerebral trauma and the like), a template with diseases on the lung (different templates such as emphysema, pneumonia, lung tumors, pulmonary nodules and the like), a template with heart diseases (different templates such as cardiovascular stenosis, vascular plaque, coronary heart disease and the like), a template with abdominal diseases (different templates such as various diseases of the liver, various diseases of the kidney, intestinal tumor diseases and the like), a different template with trauma or fracture and the like

4. After the template is selected, the doctor modifies the content of the template according to specific situations (such as adding and deleting, for example, severity description, for example, quantitative result description, and the like), and finally completes the writing and submission of the medical report.

The former three steps of operation often need to select the required template through repeated click interaction and search of doctors, and the medical report begins to be written, so that the efficiency is very underground.

The method is based on the latest artificial intelligent medical image auxiliary diagnosis and analysis algorithm, a background automatically identifies and analyzes the target image, when a doctor needs to write a report, one or more templates which are most matched with the image situation are intelligently recommended to the doctor according to the result of the algorithm analysis, and the recommended modes include but are not limited to a specific area (such as a top area or an independent recommended template list area) which is placed in a template list, a specific color/font and other prompting modes with distinction degree, and the like.

The preceding steps of the invention also include, but are not limited to, automatic recognition and categorization of report templates, including, but not limited to, the following: 1. for the template which adopts the default of the system, the classification can be carried out through the default label; 2. if the template is modified by the doctor through self-definition, a natural language processing algorithm is automatically called, relevant keywords in the template are analyzed and extracted to serve as classification labels (including but not limited to image types, parts, specific disease types and other relevant keywords) of the template, besides, the non-operation also includes but not limited to extraction of the content and the position of quantitative analysis results needing to be filled in the preset template or the doctor-defined template, and automatic filling of the quantitative analysis results of the lesion area obtained through automatic algorithm calculation or manual doctor interaction is facilitated subsequently.

The subsequent steps of the invention also include, but are not limited to, after the doctor selects the template he wants, extracting the key contents to be filled in (including, but not limited to, final qualitative diagnosis results of the lesion (such as benign, malignant, tumor or inflammation, etc.), quantitative analysis results (such as tumor size and position, lesion severity grade), etc.) through the natural language processing algorithm in the previous steps, and automatically filling the results of the algorithm identification and analysis and the results of the manual measurement of the doctor to the corresponding positions of the template, thus maximally improving the work efficiency of the whole image diagnosis and report writing of the doctor.

The interaction times and time for searching and selecting a proper report template when a doctor writes a medical report are reduced, and the overall working efficiency of the doctor is improved.

Through the auxiliary diagnosis and analysis algorithm of the artificial intelligent medical image, the background automatically identifies the type, the part, the contained focus and other information of the medical image to be diagnosed, and matches the information with the medical report template.

As shown in fig. 6, an embodiment of the present application provides an image processing apparatus including:

the display module can comprise various types of displays or modules which can display visual information, such as a projection module and the like;

a memory for storing information;

and the processor is connected with the memory and used for realizing the information processing method provided by one or more of the technical schemes, for example, one or more of the methods shown in fig. 1 to 3, by executing the computer-executable instructions stored on the memory.

The memory can be various types of memories, such as random access memory, read only memory, flash memory, and the like. The memory may be used for information storage, e.g., storing computer-executable instructions, etc. The computer-executable instructions may be various program instructions, such as object program instructions and/or source program instructions, and the like.

The processor may be various types of processors, such as a central processing unit, a microprocessor, a digital signal processor, a programmable array, a digital signal processor, an application specific integrated circuit, or an image processor, among others.

The processor may be connected to the memory via a bus. The bus may be an integrated circuit bus, or the like.

In some embodiments, the terminal device may further include: a communication interface, which may include: a network interface, e.g., a local area network interface, a transceiver antenna, etc. The communication interface is also connected with the processor and can be used for information transceiving.

In some embodiments, the terminal device further comprises a human-computer interaction interface, for example, the human-computer interaction interface may comprise various input and output devices, such as a keyboard, a touch screen, and the like.

The embodiment of the application provides a computer storage medium, wherein computer executable codes are stored in the computer storage medium; the computer executable code, when executed, is capable of implementing an information processing method provided by one or more of the foregoing technical solutions, for example, one or more of the methods shown in fig. 1 to 3.

The storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various media capable of storing program codes. The storage medium may be a non-transitory storage medium.

An embodiment of the present application provides a computer program product comprising computer executable instructions; the computer-executable instructions, when executed, enable the video processing methods provided by any of the implementations described above, e.g., one or more of the methods shown in fig. 1-3.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. An information processing method characterized by comprising:

acquiring preset information of the displayed medical image; the preset information is used for describing the content and the attribute of the medical image;

combining the basic content module and the adaptive content module according to a preset combination strategy to generate a first template;

according to the preset information, dynamically adjusting the first template by taking a content module as an adjustment granularity to obtain a second template;

the combining the basic content module and the adaptive content module to generate a first template according to a preset combining strategy includes at least one of the following steps:

arranging the adaptive content modules according to the relevance of the content modules; wherein the basic content module is located before or after each of the adapted content modules;

and dynamically adjusting the first template to obtain a second template by taking a content module as an adjustment granularity according to the preset information, wherein the second template comprises at least one of the following:

2. The method of claim 1,

the selecting a first template from a plurality of candidate templates according to the preset information includes at least one of:

3. The method of claim 1,

the selecting of the required adaptive content module from the content module library according to the preset information of the medical image comprises at least one of the following steps:

4. The method of claim 3, further comprising:

5. An information processing apparatus characterized by comprising:

the acquisition module is used for acquiring preset information of the displayed medical image; the preset information is used for describing the content and the attribute of the medical image;

a generation module comprising:

the combination unit is used for combining the basic content module and the adaptive content module according to a preset combination strategy to generate a first template;

the adjusting unit is used for dynamically adjusting the first template by taking a content module as an adjusting granularity according to the preset information to obtain a second template;

the combining unit is specifically configured to perform at least one of:

the adjusting unit is specifically configured to execute at least one of:

6. The apparatus according to claim 5, wherein the information processing apparatus further comprises a first selection unit;

the first selecting unit is specifically configured to execute at least one of:

selecting a first template matched with the type information from alternative templates according to the type information of the medical image;

7. The apparatus of claim 6,

the second selecting unit is specifically configured to execute at least one of:

8. The apparatus of claim 7, further comprising: an item adjustment module;

the adjusting module is specifically configured to execute at least one of:

9. An electronic device, comprising:

the display module is used for displaying information;

a memory for information storage;

a processor, connected to the display module and the memory, respectively, for controlling the information display of the display module and the information storage of the memory by executing the computer-executable instructions stored on the memory, and further for performing the method provided by any one of claims 1 to 4.

10. A computer-readable storage medium having stored thereon computer-executable instructions; the computer-executable instructions, when processed, are capable of implementing the methods provided in any one of claims 1 to 4.