CN106529115A - Information processing device, information processing method, and information processing system - Google Patents
Information processing device, information processing method, and information processing system Download PDFInfo
- Publication number
- CN106529115A CN106529115A CN201610807491.XA CN201610807491A CN106529115A CN 106529115 A CN106529115 A CN 106529115A CN 201610807491 A CN201610807491 A CN 201610807491A CN 106529115 A CN106529115 A CN 106529115A
- Authority
- CN
- China
- Prior art keywords
- information
- region
- medical imaging
- viewing area
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G06F19/321—
Abstract
The invention provides an information processing device, an information processing method, and an information processing system. The information processing device comprises a report acquisition unit, a related area acquisition unit, a determining unit, and a control display unit. The report acquisition unit is suitable for acquiring report information, which comprises a concerned area of a medial image and annotation information related to the concerned area. The related area is used to acquire the area related to the concerned area in the medical image. The determining unit is used to determine the display position of the display area of the annotation information, and is used to prevent the display area of the annotation information overlapped with the related area. The display control unit is used to display the medical image of the annotation information, and then the annotation information is displayed on the display position determined by the display area of the display unit.
Description
Technical field
The present invention relates to a kind of information processor, information processing method and information processing system, and especially, relate to
And a kind of medical imaging Display Technique.
Background technology
In medical scene, using medical imaging apparatus, such as X ray CT (computed tomography) device, MRI (cores
Nuclear magnetic resonance) device or PET (positron emission computerized tomography) device etc., carry out the shooting to patient.CT is Computed
The abbreviation of Tomography, MRI are the abbreviations of Magnetic Resonance Imaging, and PET is Positron
The abbreviation of Emission Tomography.By to by image it is obtaining, and be saved within the hospital in scheduled time slot
View data in data server carries out various image procossings to create medical imaging.For the diagnostic imaging of doctor is operated,
Target medical imaging is searched for using medical image display apparatus (also referred to as browser), and target medical imaging is included in prison
On visual organ, and using medical image display apparatus various functions carrying out diagnostic imaging.Doctor records the knot of diagnostic imaging
Fruit is reported as explaining.
When reporting with reference to the explanation for being recorded, user is with reference to it simultaneously by medical imaging and the description content for explaining report
It is associated.However, being difficult to sometimes easily specify the position in the medical imaging represented by the description content for explaining report.This
Outward, user while two information (i.e. medical imaging and explanation report) are associated with each other need the time to carry out reference and explains
Report.
Japanese Unexamined Patent Publication 2011-083590 publications describe the pathological changes explained described in report are displayed in medical imaging
The information in portion.According to the arrangement, explain that the character string in report is linked with the position in the medical imaging by string representation,
And character string is displayed near the position.Therefore, user correctly can be grasped by the character string explained described in report
Position in represented medical imaging, and correctly the time can need not be spent with reference to report is explained.
However, in the arrangement of Japanese Unexamined Patent Publication 2011-083590 publications, the character string that shows in medical imaging is determined
Position, without considering anatomical structure or explaining the content of report.For this reason, character string is superimposed upon medical imaging sometimes
On dissection critical positions or to the position in the related medical imaging of content for explaining report.In this case, Yong Hunan
To confirm anatomical structure in medical imaging or explain the content of report.
The content of the invention
The present invention allows for the problems referred to above and makes, and provide one kind more easily can grasp medical imaging with
Explain the technology of the corresponding relation between report.
According to an aspect of the present invention, a kind of information processor includes:Report acquisition unit, which is suitable to obtain report
Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase
Area acquisition unit is closed, which is suitable to obtain the region related to the region-of-interest in the medical imaging;Determining unit, its
Be adapted to determine that the display location of the viewing area of the annotation information, so as not to make the viewing area of the annotation information with
The relevant range overlaps;And display control unit, which is suitable to show the medical imaging for including the annotation information so that
The annotation information is shown at display location determined by the viewing area on display unit.
According to a further aspect in the invention, a kind of information processor includes:Report acquisition unit, which is suitable to obtain report
Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase
Area acquisition unit is closed, which is suitable to the character string included based on the annotation information, obtain the correlation in the medical imaging
Region;Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information
The viewing area and the relevant range it is overlapping;And display control unit, which is suitable to show includes the annotation information
Medical imaging so that at display location determined by the viewing area on the display unit show it is described annotation letter
Breath.
According to another aspect of the invention, a kind of information processing system includes:Report acquisition unit, which is suitable to obtain report
Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase
Area acquisition unit is closed, which is suitable to obtain the region related to the region-of-interest in the medical imaging;Determining unit, its
Be adapted to determine that the display location of the viewing area of the annotation information, so as not to make the viewing area of the annotation information with
The relevant range overlaps;And display control unit, which is suitable to show the medical imaging for including the annotation information so that
The annotation information is shown at display location determined by the viewing area on display unit.
According to another aspect of the invention, a kind of information processing system includes:Report acquisition unit, which is suitable to obtain report
Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase
Area acquisition unit is closed, which is suitable to the character string included based on the annotation information, obtain the correlation in the medical imaging
Region;Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information
The viewing area and the relevant range it is overlapping;And display control unit, which is suitable to show includes the annotation information
Medical imaging so that at display location determined by the viewing area on the display unit show it is described annotation letter
Breath.
According to another aspect of the invention, a kind of information processing method includes:Report information is obtained by report acquisition unit,
The annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;By related area
Domain acquiring unit obtains the region related to the region-of-interest in the medical imaging;The annotation is determined by determining unit
The display location of the viewing area of information, so as not to hand over the viewing area of the annotation information and the relevant range
It is folded;And the medical imaging including the annotation information is shown by display control unit so that on the display unit described aobvious
Show.
According to another aspect of the invention, a kind of information processing method includes:Report information is obtained by report acquisition unit,
The annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;By related area
The character string that domain acquiring unit is included based on the annotation information, obtains the relevant range in the medical imaging;By determining
Unit determines the display location of the viewing area of the annotation information, so as not to make the viewing area of the annotation information with
The relevant range overlaps;And the medical imaging including the annotation information is shown by display control unit so that showing
The annotation information is shown at display location determined by the viewing area on unit.
By the description of following (referring to the drawings) to exemplary embodiment, further characteristic of the invention will be clear from.
Description of the drawings
Fig. 1 is the block diagram of the arrangement for illustrating medical image system;
Fig. 2 is the flow chart for illustrating the processing procedure of medical image system;
Fig. 3 is the figure for illustrating the example for explaining that report creates picture;
Fig. 4 is the figure of the example for illustrating medical imaging and character string display region;
Fig. 5 A, Fig. 5 B, Fig. 5 C and Fig. 5 D are the examples of the character string display region for illustrating Overlapping display in medical imaging
Figure;
Fig. 6 is the figure for illustrating example that the display location of character string display region is uniquely identified;
Fig. 7 A and Fig. 7 B are to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;
Fig. 8 is the figure of the scope for schematically showing sectioning image and showing character string;
Fig. 9 A, Fig. 9 B and Fig. 9 C are to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;
Figure 10 A and Figure 10 B are the figures of the scope for schematically showing sectioning image and showing character string;
Figure 11 is for illustrating present image, past image and subtracting the figure of shadow (subtraction) image;
Figure 12 is to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;
Figure 13 A, Figure 13 B and Figure 13 C are to illustrate that character string display region is applied the example being displayed in medical imaging
Figure;
Figure 14 is the figure for illustrating the relation between keyword and acquisition region;
Figure 15 is to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;And
Figure 16 is the figure of the detailed display example for illustrating image display area.
Specific embodiment
Now, embodiments of the invention are described with reference to the accompanying drawings.However, the scope of the present invention is not limited to following arrangement showing
Example.
(medical image system)
Fig. 1 be illustrate it is (medical including the medical image system of medical image display apparatus according to an embodiment of the invention
Image display system) integral arrangement block diagram.Include that medical imaging shows as the medical image system of information processing system
Device 10 and data base 22.These devices connect via communicator, so as to communicate with one another.In this embodiment, will retouch
State the example that communicator is formed by LAN (LAN) 21.However, it is possible to by radio communication device (for example, WLAN) or public affairs
Common communication network forms communicator.
Data base 22 manages test information, such as medical imaging and explanation report.Data base 22 is by medical imaging and explanation
Report is kept securely in association.Medical image display apparatus 10 obtain the medical imaging or solution managed by data base 22 via LAN 21
Release report.
Include communication IF (interface) 31, ROM (read-only storage as the medical image display apparatus 10 of information processor
Device) 32, RAM (random access memory) 33, memory element 34, operating unit 35, display unit 36 and control unit 37, make
For its functional part.Communication IF 31 is realized for example, by LAN card, and (for example, is counted via the control external device (ED)s of LAN 21
According to communication of the storehouse 22) and between medical image display apparatus 10.ROM 32 is deposited by the read-only of the realizations such as nonvolatile memory
Reservoir, and store various programs etc..RAM 33 is and the interim storage by the writable memory of the realizations such as volatile memory
Various information.Memory element 34 is the storage device realized by such as HDD (hard disk drive), and stores various information.Behaviour
Make unit 35 for example by keyboard or pointer device to realize, and user instruction is input into device.Display unit 36 is for example by showing
Show device to realize, and various information are shown to user (for example, doctor).For example by CPU, (central authorities process single control unit 37
Unit) realizing, and the process of overall control medical image display apparatus 10.
Control unit 37 include medical imaging acquiring unit 41, explain report acquisition unit 42, keyword extraction unit 43,
Area acquisition unit 44, display location determining unit 45 and display processing unit 46, as its functional part.Medical imaging is obtained
Unit 41 is taken according to the user operation being input into by operating unit 35, via communication IF 31 and LAN 21, institute is obtained from data base 22
The medical imaging of the patient of care.Medical imaging output is arrived area acquisition unit 44, shows position by medical imaging acquiring unit 41
Put determining unit 45 and display processing unit 46.
Report acquisition unit 42 is explained according to the user operation being input into by operating unit 35, via communication IF 31 and LAN
21, obtain from data base 22 and explain report (report information).Note, explain that report is and is obtained by medical imaging acquiring unit 41
Medical imaging it is corresponding explanation report, and after a while will description create explain report method detailed.Additionally, report information
It is the region-of-interest and the annotation information being associated with region-of-interest in the medical imaging for include subject (for example, patient)
Information.Report information is the subset of the information for explaining that report includes or explains report itself.Explain that report is not only included by solving
Release doctor be registered in explain report server in explanation report, also including be input to explain report editing pictures, registration
Front or under editor explanation is reported.In this case, above-mentioned report information be under editor explanation report include
Information, the information is the region-of-interest in the medical imaging for include subject and the annotation information being associated with region-of-interest
Information.
Part or all of the explanation report of acquisition is output to keyword extraction unit 43, display location determining unit
45 and display processing unit 46.
Keyword extraction unit 43 carries out process described later for the explanation report obtained by explanation report acquisition unit 42,
So as to extract keyword.Keyword extraction unit 43 is by the keyword for being extracted output to area acquisition unit 44.
Area acquisition unit 44 as relevant range acquiring unit is based on the key obtained by keyword extraction unit 43
Word, the medical imaging for being obtained by medical imaging acquiring unit 41 carry out process described later, so as to obtain in medical imaging
Anatomic region.Area acquisition unit 44 is by acquired anatomic region output to display location determining unit 45.
Display location determining unit 45 in the medical imaging obtained by medical imaging acquiring unit 41, it is determined that to by explaining
The display location shown by character string in the explanation report that report acquisition unit 42 is obtained.Here, explaining the word in report
Symbol string represents part or all of the text described in explanation report.Note, based on medical imaging, explain report and by
Part or all for the region that area acquisition unit 44 is obtained, determines display location by process described later.Display location
Display processing unit 46 is arrived in the display location output by determined by of determining unit 45.
Display processing unit 46 is included the medical imaging obtained by medical imaging acquiring unit 41 on display unit 36,
Simultaneously the character string in the explanation report obtained by explanation report acquisition unit 42 is superimposed upon by display location determining unit 45
It is determined that display location on.
Note, at least some in the unit provided in control unit 37 may be implemented as independent equipment.It is optional
Ground, unit may be implemented as the software (computer program) for realizing function.In this case, realize the software of function
Can be operated via network (such as cloud) on the server.In this embodiment, will describe by software in home environment
Realize the example of unit.
(processing procedure)
Next, reference Fig. 2 to Fig. 4 to be described the overall process process of the control unit 37 according to the embodiment.For example,
Below, by mesh will be described as to the medical imaging that the chest area of subject is shot and created by X ray CT device
Mark.However, target medical imaging not limited to this.
Fig. 2 is the flow chart of the process carried out by control unit 37.In step s 201, medical imaging acquiring unit 41
According to the user operation being input into by operating unit 35, medical imaging is read from data base 22 via communication IF 31 and LAN 21.
In step S202, explain report acquisition unit 42 via communication IF 31 and LAN 21, from data base 22 obtain with
The corresponding explanation report of the medical imaging that reads in step s 201.In this embodiment, in the following manner creating solution
Release report and will explain that report is registered in data base 22.
Fig. 3 shows that explanation report creates picture 300, reports the example for creating picture as explaining.Figure shown in Fig. 3
As viewing area 310 represents the picture area for showing medical imaging.Note, for the doctor shown in image display area 310
With image, the various functions of perusing medical images device (zoom in/out function, concentration value translation function such as to whole image,
Display location translation functions, figure describe function and concentration value measurement function etc.) it is available.Report display area 320 is
The result that the medical imaging of user is explained is described as into the picture area of text.In the following, it is described that the text of explanation results will
It is referred to as explaining text (annotation information).In figure 3, " solid nodules are observed in right lung S2 regions " and is described as be in report
Explanation text in viewing area 320.Button 321 is concern position settings button.By select button 321, can arrange and work as
Position (hereinafter referred to as paying close attention to position) when text is explained in description in the medical imaging of user's concern.By × represent symbol
Numbers 311 show the concern position arranged by user.Note, it can be the pixel or voxel in image to pay close attention to position, Huo Zheke
Being the region for including multiple pixels or voxel.Hereinafter, the position arranged by user or region are referred to as into region-of-interest.Note
Meaning, when user is provided with concern position by operating input, can be by medical image system by set position of paying close attention to
Information and the information with the corresponding region with regard to lesion in concern position, as region-of-interest information managing.
Will be described in explaining the example of report creation method.User reads medical imaging to be explained from data base 22,
And including in image display area 310.Various functions of the user using perusing medical images device as above, in detail
Observation medical imaging.User observes result described in report display area 320, used as explanation text.In figure 3, solve annotations
Originally it is described as free text.It may, however, also be structured text.Then, user's select button 321 come arrange for explain
The concern position of text.Concern position is set using 35 (not shown) of operating unit.For example, user is by using pointer device
Concern position is clicked on, concern position is set.Concern position method to set up is certainly not limited to this, and any method is all available
, as long as the positional information (hereinafter referred to as paying close attention to positional information) for paying close attention to position can be specified.Concern position
Confidence breath is including the coordinate figure in such as medical imaging.In figure 3, symbol 311 is depicted on set concern position.So
And, concern positional information is recorded in medical image display apparatus 10, it is not always necessary to which the symbol of position is paid close attention in description
Number.Medical image display apparatus 10 will explain that text and concern positional information (or region-of-interest information) are stored in number in association
According in storehouse 22.Therefore, in step S202, read and explain text and concern positional information, as explanation report.
In step S203, keyword extraction unit 43 passes through keyword match, from the explanation read in step S202
Text, extracts the keyword for pre-setting.In this embodiment, keyword is the character string for representing anatomic information, such as in doctor
With the Organ naming shown in image.Example is brain, cerebellum, eyeball, nose, tooth, lung, bronchus, heart, liver, spleen, pancreas
Dirty, stomach, large intestine, small intestinal, jejunum, ileum, rectum, prostate, uterus, forearm, upper arm, thigh, lower lower limb, breast, muscle, bone
Bone, spinal column, celestial bone, coccyx and pelvis.Organ naming described here is only example certainly, the invention is not restricted to this.Close
Key word is not limited to Organ naming, and can be arbitrary string, as long as the position in medical imaging can be specified.Under
Face will describe as shown in Figure 3, " solid nodules are observed in right lung S2 regions " and be described as explaining the explanation text of report
Example.In this case, " lung " is extracted as keyword.It is alternatively possible to arrange and extract tighter specify
" right lung " of the position in medical imaging or " right lung S2 ".Note, here extracts keyword by keyword match, but
Can also be extracted using additive method (such as known natural language processing).
In step S204, area acquisition unit 44 is extracted from the medical imaging for obtaining in step s 201 and in step
The corresponding anatomic region of the keyword that extracts in S203, and the region is obtained as the region relevant with region-of-interest.Will
The situation that " lung " in step S203 is extracted as keyword is described in, as an example.In this example, area acquisition unit 44 from
Medical imaging obtains lung areas.More specifically, using smoothing filter, carry out from the medical imaging for obtaining in step s 201
Noise remove.Next, for the pixel value of medical imaging, using predetermined threshold (for example, HU values:- 200) carry out at binaryzation
Reason, so as to medical imaging is separated into interior zone and perimeter.Using another threshold value (for example, HU values:- 500) will separate
Interior zone be separated into lung areas and other regions, so as to extracting and obtaining lung areas.Note, at anatomic region extraction
Reason only needs to extract predetermined region from the medical imaging for reading, and is not limited to the method.It is, for example possible to use other devices
Official's dividing processing (such as pattern-cutting method) is extracting anatomic region.
In step S205, Overlapping display in the 45 pairs of medical imagings for reading in step s 201 of display location determining unit
The some or all of display location of the character string of the explanation text read in being formed in step S202 is determined.In the reality
Apply in example, viewing area is confirmed as not making the viewing area of explanation text overlap with anatomic region.Will be with reference to Fig. 4, Fig. 5 A, figure
5B, Fig. 5 C and Fig. 5 D describe display location and determine method.Medical imaging 410 shown in Fig. 4 is represented
Medical imaging.In this example, medical imaging is axial direction (level) image shot by chest X-ray CT devices, and is cut
Piece position is the position in step S202 arranging concern position.Hereinafter, the image at the slice position will be claimed
To pay close attention to sectioning image.Dotted line 411 represents the boundary line between the lung field in medical imaging 410 and outside.Symbol 412 represents disease
Change portion (tuberosity).Character string display region 420 represents the word of the explanation text (annotation information) read in being displayed in step S202
The region of some or all character strings (will hereinafter being referred to as showing character string) of symbol string (will hereinafter be referred to as character
String viewing area).In this embodiment, character string display region 420 has predetermined size and shape.In this case,
If there are many display character strings relative to character string display region, can show all in character string display region
Display character string.In this case, as by represented by character string display region 421, it is possible to use scroll bar 422 is rolled
It is dynamic to show character string.As, by represented by character string display region 423, shown, the font of character string can be changed in character
String shows all of display character string in viewing area.It is alternatively possible to hide show character string in, word cannot be displayed on
Character string in symbol string viewing area, or plucking for display character string can be automatically generated using known natural language processing
Want and shown.
Character string display region 420 is described below and is applied situation about being displayed in medical imaging 410.Note, will say
Bright following example, wherein, in step S203, " lung " is extracted as the keyword for explaining text, and obtains in step S204
Take the lung areas in medical imaging 410.
Display location determining unit 45 is based on predetermined condition (hereinafter referred to as display location determines condition), determines word
The display location of symbol string viewing area 420.Display location will be given and determine that " whole character string display region is located at medical figure to condition
As internal " and " character string display region is not overlapping with the inside in the region extracted based on the keyword for explaining text " show
Example, is described.In this case, the display location of character string display region 420 is confirmed as inside medical imaging 410
And the region outside dotted line 411.Fig. 5 A, Fig. 5 B, Fig. 5 C and Fig. 5 D show the example of display location.In Fig. 5 A and Fig. 5 B,
The display location of character string display region 420 is located inside medical imaging 410 and outside dotted line 411.Therefore, in Fig. 5 A and Fig. 5 B
The display location of shown character string display region is qualified appropriate display location.In figure 5 c, character string display
The display location in region 420 is located at outside dotted line 411, but is positioned partially at outside medical imaging 410.Therefore, shown in Fig. 5 C
The display location of character string display region be ineligible unsuitable display location.In figure 5d, character string display
The display location in region 420 is located inside medical imaging 410 and inside dotted line 411.Therefore, character string shown in Fig. 5 D shows
The display location for showing region is ineligible unsuitable display location.
Only condition is determined by two above-mentioned display locations, it is impossible to uniquely determine the display position of character string display region
Put.Therefore, in the above-mentioned example, the display location of character string display region can meet above-mentioned display location to determine
Any position in the medical imaging of condition.In order to uniquely determine the display location of character string display region, it is additionally provided in
Display locations such as " the distance between center of concern position and character string display region become most short " determines condition.Fig. 6
Show the example using medical imaging 410 and character string display region 420.The concern position that calculating is obtained in step S202
413 the distance between with the center 421 of character string display region 420.Character string display region 420 is displayed on such position
Put, i.e. while meeting other display locations and determining condition, make the distance between center most short.
In step S206, in the character string of the explanation text that display processing unit 46 is obtained in being included within step S202
Some or all of character string display region, at the display location determined in step S205, superposition obtain in step s 201
In the medical imaging for taking.Display processing unit 46 carries out display control, with display unit 36 to be superimposed with including solution annotations
The medical imaging of this character string display region is shown.
As described above, according to the medical image display apparatus 10 of the embodiment, being obtained in that following effect.That is, when will solution
It is when some or all Overlapping displays in the character string of annotations sheet are in medical imaging, aobvious to determine according to the content for explaining text
Show position.The area closely related with the content of text is explained of medical imaging is displayed in therefore, it is possible to avoid character string from being applied
On domain.For this reason, even if when viewing is superimposed with the medical imaging of character string, also without prejudice to user confirms character string
Content, and allow users to more easily grasp medical imaging and explain the corresponding relation between report.
If in conference system etc., the user in addition to exponent is then solved to removing with reference to report and medical imaging is explained
For user beyond the person of releasing, it is generally difficult to understand the content for explaining report.Equally in this case, when the solution for explaining report
Annotations sheet together with medical imaging, when being displayed at the overlapping position in not related to region-of-interest region, then except solution
User beyond the person of releasing can more easily grasp medical imaging and explain the corresponding relation between report.In the present embodiment,
Due to determining the display location of character string display region in the region by occupied by medical imaging, so explaining that text is shown
Near the corresponding region of medical imaging, and can readily recognize between explanation text and the corresponding region of medical imaging
Relation.
Note, in this embodiment, it is considered to do not make character string display region and and the concern of explanation text (annotation information)
The related region in region overlaps.Have been described with including that the anatomic region of region-of-interest is acquired as the area related to region-of-interest
The example in domain.However, relevant range not limited to this.That is, relevant range can be when browse explain text when be referred to, by
The arbitrary portion region in the region occupied by subject in medical imaging.For example, when for right lung disease establishment explanation text
When, when it is determined that explaining the display location of text, the region occupied by right lung open country not only can be considered, it is also contemplated that by can be with
The region that related other organs (for example, left lung field and bronchus) of disease are occupied.For diseases such as the cancers that may be shifted
Disease, the region that disease present in region-of-interest may be transferred to can be acquired as relevant range.Alternatively, away from concern position
The scope of preset distance (for example, 10 centimetres) can be acquired as relevant range.
Additionally, according to the modification for explaining text (annotation information), display location determining unit 45 can change explanation text
Character string display region display location, and display processing unit 46 can be shown after the change on display unit 36
The amended medical imaging for explaining text is superimposed with display location.Change explanation text when the modification according to explanation text
Display location of the character string display region in medical imaging when, user always easily can grasp explanation text with it is corresponding
Corresponding relation between the region of medical imaging of text is explained.
According to by area acquisition unit 44 from explaining extraction of the character string that includes of text to keyword, display processing list
Unit 46 can show the part corresponding with the keyword in character string, to distinguish with other character strings.It is, for example possible to use
The character color different from other parts or background color are showing the part corresponding with keyword.Under the part can be added
Rule, shown using different fonts, or highlighting.This allows users to identify the pass for explaining that text includes at a glance
Key word, and easily grasp the content for explaining text.
In this embodiment, it has been described that determine solution annotations based on the keyword of character string that text includes is explained
The example of the display location of this character string display region.However, it is not necessary to the character for explaining text is always determined based on keyword
The display location of string viewing area, as long as explaining that the character string display region of text is not overlapping with the relevant range of region-of-interest i.e.
Can.For example, relevant range can be used as by the position acquisition anatomic region based on the region-of-interest in medical imaging, is determined
Explain the display location of the character string display region of text.Alternatively, if anatomic region cannot be obtained based on character string, as
In the case where explaining that text does not include keyword, anatomical area can be obtained based on the position of the region-of-interest in medical imaging
Domain.Therefore, explain text can be shown as not with the case where key word is not used, with high probability with will be together with solution
Annotations is originally overlapped by the anatomic region of reference together, and can more easily be grasped medical imaging and be explained right between report
Should be related to.
The image file including the medical imaging for explaining text and display location information, display location information table can be created
Show the display location of the character string display region determined by display location determining unit 45.Therefore, as long as device being capable of loading figure
As file, even the device of the function not with the medical image display apparatus 10 according to the embodiment, it is also possible to read figure
As file and it is output to display to show the relation between text and corresponding region explained.For example, the lattice of image file
Formula can be DICOM.The information of the region-of-interest explanation text (annotation information) corresponding with region-of-interest and showing is explained
The information of the viewing area of text (annotation information), is included in DICOM image files.Annotation information and the letter of viewing area
Breath is retained as the data corresponding with the annotation of the GSPS for for example being defined by DICOM.It is in present condition that GSPS is gray scale soft copy
The abbreviation of (Grayscale Softcopy Presentation State).Show that above-mentioned explanation text (annotation information) shows
The information of the sectioning image in region is also included in DICOM image files.
The character string display region for explaining text can be moved according to the operation input of user.For example, it is assumed that being made that
Character string display region (the first viewing area) is moved to overlapping with the relevant range of region-of-interest (the second viewing area)
The operation input of position.In this case, the display location of at least one of the first viewing area and the second viewing area,
It is confirmed as not making the first viewing area and the second viewing area overlap each other.This is prevented from the character string display for explaining text
Region is overlapping with relevant range before and after the movement of character string display region of text is explained, and clearly can show
Show medical imaging and explain the corresponding relation between text.
In the above-described embodiments, as will in step S203 from explain Text Feature Extraction keyword, pre-set expression
The character string of anatomic information (Organ naming that such as will be shown in medical imaging).However, the keyword for pre-setting is not limited
In this.For example, disease name, tuberosity, cancer, pneumonia, emphysema or mycobacterial diseaseses etc. can be set.
Here, the character string display region being described in reference picture 7A in the case that " tuberosity " is arranged to crucial word shows
Location determining method.Medical imaging 410, dotted line 411 and black circle 412 in Fig. 7 A with it is identical shown in Fig. 4.
In step S202, " solid nodules are observed in right lung S2 regions " is acquired as explaining text.In step
In S203, as " tuberosity " is arranged to crucial word, so from explanation Text Feature Extraction " tuberosity ".In step S204, from medical
Image obtains the region of " tuberosity ".Processed by the region segmentation of pattern cut process etc., carry out the region of tuberosity
Extract.
In step S205, such as in the above-described embodiments, display location determines that condition is arranged to " whole character string display
Region is located inside medical imaging " and " character string display region not with the keyword based on explanation text and the region extracted
It is internal overlapping ".In this case, the display location of character string display region is confirmed as inside medical imaging 410 and black circle
Region outside 412.Condition is determined according to display location, different from above-described embodiment, display location can be located in dotted line 411
Portion or outside.In fig. 7, the display location of character string display region is located inside medical imaging 410 and outside black circle 412.Cause
This, the display location of the character string display region shown in Fig. 7 A is qualified appropriate display location.
Reference picture 7B is described into another example, wherein, " pneumonia " is arranged to crucial word.Shadow region 414 in Fig. 7 B
Represent the region that pneumonia image is extracted in medical imaging.In step S202, " interstitial pneumonia is observed at the back side of left lung
Earlier picture " be acquired as explain text.In step S203, as " pneumonia " is arranged to crucial word, so from explanation
Text Feature Extraction " pneumonia ".In step S204, the region of " pneumonia " is obtained from medical imaging.For example, by prestoring expression lung
Scorching textured pattern, and the region with the textured pattern in medical imaging is extracted, extract the region of pneumonia.Also can
By known method, the extraction process of the disease area with the specific pattern in organ is performed.In step S205, such as
In the above-described embodiments, display location determine condition be arranged to " whole character string display region be located at medical imaging inside " and
" character string display region is not overlapped with the inside in the region extracted based on the keyword for explaining text ".In this case,
The display location of character string display region is confirmed as inside medical imaging 410 and the region outside shadow region 414.In Fig. 7 B
In, the display location of character string display region is located inside medical imaging 410 and outside shadow region 414.Therefore, institute in Fig. 7 B
The display location of the character string display region for showing is qualified appropriate display location.
As described above, when explanation text is shown as area not with the disease having based on keyword (such as disease name)
When domain overlaps, the corresponding relation explained between text and the region-of-interest of medical imaging can be more easily grasped.Note, it is above-mentioned
The keyword for pre-setting be only example, and be not limited to these examples.
In the above-described embodiments, in step S205, the aobvious of character string display region is determined only for concern sectioning image
Show position.But, it might even be possible to display location is determined to the image at another slice position.Will be with reference to Fig. 8 descriptions even to another
Image at one slice position determines the situation of the display location of character string display region.With reference to Fig. 8, reference 801 to 807
The medical imaging at slice position is represented, and image 804 is concern sectioning image.
Fig. 8 shows following example, wherein, to slice position the cutting in preset range with concern sectioning image
Medical imaging at piece position, determines the display location of character string display region.Can use to for example " in concern sectioning image
Slice position front and back in each on two slice positions " fixed value, determine preset range.This
In the case of, the medical imaging to 802 to 806 place of slice position in Fig. 8 determines the display location of character string display region.Make
For another example, can arrange and determine the aobvious of character string display region based on the size in the region extracted in step S204
Show the scope of the slice position of position.If more specifically, the size very little in the region extracted, arranges narrow scope.Such as
The size in the region extracted by fruit is very big, then arrange wide scope.Alternatively, user can arrange scope manually.
Can use position is shown with the display location identical for character string display region is determined to paying close attention to sectioning image
Determination condition is put, the display location of the character string display region at another slice position is determined.Word at each slice position
Symbol string viewing area display location, can with concern sectioning image on it is identical.In this case, according to slice position,
The intra-zone that character string display region is extracted in being displayed on step S204, so being unsatisfactory for display location determines bar
Part.In this case, display location determine condition be arranged to " whole character string display region be located at medical imaging inside ",
" character string display region is not overlapped with the inside in the region extracted based on the keyword for explaining text " and " display location pair
All slice positions are identical ".Therefore, the display location of character string display region does not change between slice position, and can
The region of the medical imaging closely related with the content of text is explained is avoided to be arranged to display location.
As described above, when medical imaging to be shown is included from multiple sectioning images that same subject is obtained, showing
Position determination unit 45 is from the plurality of sectioning image, it is determined that showing the slice map of the character string display region for including explaining text
Picture.Then, display processing unit 46 will include on the sectioning image determined by including the character string display region for explaining text.
Therefore, according to the embodiment, due to being displayed in the character string shown in medical imaging at multiple slice positions, so user's energy
Enough more easily identification strings.
In this embodiment, the explanation text that display processing unit 46 pairs is associated with region-of-interest, together with perpendicular to
Shown together with each sectioning image of the predetermined distance interior presence of region-of-interest on the direction in the section of sectioning image.
For this reason, even if disease is distributed in three dimensions, user also can easily grasp and explain text with the area with disease
Corresponding relation between domain.
In the above-described embodiments, the position of the preferred coordinates in expression medical imaging is recorded and is used as explaining report
Concern positional information.However, concern positional information not limited to this.For example, user can concern position be set to scope (under
It is referred to as paying close attention to scope in text).More specifically, arranging ROI (Region Of Interest, region-of-interest) or VOI (Volume
Of Interest, pay close attention to volume).
Reference picture 9A, Fig. 9 B and Fig. 9 C is described the example for arranging ROI.Medical imaging 410 in Fig. 9 A, Fig. 9 B and Fig. 9 C
With dotted line 411 with it is identical in Fig. 4.ROI is set to by user with the concern scope for explaining that text is corresponding of medical imaging
415.Description character string display region display location in this case is determined into method.
The process of step S201 to S204 with it is identical in above-described embodiment.In figure 9 a, the display in step S205
Position determine condition be arranged to " whole character string display region be located at medical imaging inside " and " character string display region not with
The inside of the concern band of position overlaps ".In this case, the display location of character string display region is confirmed as medical imaging
Region inside 410 and outside ROI415.Different from above-described embodiment, display location can be located inside or outside dotted line 411.
In figure 9 a, the display location of character string display region is located inside medical imaging 410 and outside ROI 415.Therefore, in Fig. 9 A
The display location of shown character string display region is qualified appropriate display location.Note, if in step S205
In the condition that pre-sets do not use the information of the anatomic region in medical imaging, then as in figure 9 a, step can be omitted
The process of S203 and S204.
Used as another example, it is as follows that the display location in step S205 determines that condition is set.That is, display location determines
Condition is arranged to " whole character string display region is located inside medical imaging ", " does not explain with being based on character string display region
The keyword of text and the inside in region extracted overlaps " and " character string display region inside not with the concern band of position
It is overlapping ".In this case, the display location of character string display region 420 be confirmed as inside medical imaging 410, dotted line 411
Region outside outside and ROI 415.In figures 9 b and 9, the display location of character string display region be located at medical imaging 410 inside,
Outside dotted line 411 and outside ROI 415.Therefore, the display location of the character string display region shown in Fig. 9 B is eligible
Appropriate display location.According to above-mentioned condition, the edge at the edge and ROI of character string display region may be continuous, and can
ROI can be difficult to see that.In this case, to determine that condition is set as follows for display location.That is, display location determines that condition is set
Be set to " whole character string display region be located at medical imaging inside ", " character string display region not with based on the pass for explaining text
Key word and the inside in region extracted overlaps " and " character string display region is located at outside the concern band of position with preset distance
Portion ".The preset distance can be predefined or is arranged by user.In Fig. 9 C, the display location of character string display region is located at
Inside medical imaging 410, outside dotted line 411 and with preset distance outside ROI 415.Therefore, the character string shown in Fig. 9 C
The display location of viewing area is qualified appropriate display location.
When user be not by ROI but by VOI be set to pay close attention to scope when, can by with for ROI identical at
Reason, determines the display location of character string display region in concern sectioning image.Such as in the above-described embodiments, when it is determined that predetermined model
During the display location of the character string display region at multiple slice positions in enclosing, the slice position for arranging VOI can be set
For scope.Reference picture 10A and Figure 10 B are described at multiple slice positions the situation for determining display location.Reference picture 10A and figure
10B, reference 1001 to 1007 represent the medical imaging at slice position, and image 1004 is concern sectioning image.Will
Description VOI is arranged on the example in the medical imaging at 1003 to 1005 place of slice position.In this case, slice position
1003 to 1005 are arranged to scope.As another example, can be by the section position from the slice position in setting VOI slightly before
Put, to the scope in the slice position slice position after a while for arranging VOI, be set to show the scope of character string display region.
Figure 10 B show following example, wherein, by from second preceding slice position, to the slice position for arranging VOI
One slice position is set to scope.In this case, slice position 1001 to 1006 is arranged to scope.
Figure 16 is the figure of the detailed display example for illustrating the image display area 310 shown in Fig. 3.In figure 16, pass through
The method of reference picture 9C description, determines the display location of character string display region.
With reference to Figure 16, image display area 310 includes following subregion.Test list 1601 is in a listing format showing
It is shown as the region of all tests (test of current and past) of the patient of current test target.Thumbnail list 1602 be with
Thumbnail list form is showing the institute that includes of test selected by the test list that user is shown from test list 1601
There is the region of image.Each image that test includes can be a sectioning image or by multiple sectioning images are formed one be
Row image (3D rendering).The image that thumbnail is created typically by a sectioning image is reduced.In order to by a series of images
Thumbnail is created, the presentation graphics (for example, slice position is located at the sectioning image at center) in a series of images is contracted
It is little.
Toolbar 1603 is the region for arranging and showing multiple buttons (icon).When pressing on user's select tools hurdle 1603
During button, function (for example, the change of image display format, graphic plotting or the character string display area for being associated with the button in advance is performed
Draw in domain).Image/lookup (finding) shows that segment 1604 is that display image shows segment 1605 (being described later on), searches row
The region of information list (CAD lists) 1607 is supported in table 1606 and diagnosis.
Can show according to user instruction that the image/lookup of to predetermined upper limit quantity shows segment 1604.Figure
16 show the example that 4 images/lookup display segment 1604 is shown with 2 × 2 layout patterns.Image shows that segment 1605 is aobvious
Show the region of the image corresponding with the thumbnail selected by user.The image that image is shown in showing segment 1605, Neng Gougen
The change to shown slice position, image translation/amplification/rotation or concentration value conversion etc. is experienced according to user instruction
Operation.Furthermore it is possible to according to user instruction, carry out showing image the graphic plotting or figure of the image shown in segment 1605
Delete.In figure 16 in shown example, user draws the concern around image using the operating unit 35 of mouse etc.
The oval logo in region (ROI).The method described using reference picture 9C is showing character string display region.User can use all
The such as operating unit 35 of keyboard etc., be input into or editing character string viewing area in arbitrary string (will hereinafter be claimed
To search).
It is to show that the image that shows is (to a series of in segment 1605 being displayed in image in a listing format to search list 1606
For image, be multiple sectioning images) on the region of all lookups arranged.When user selects to show in list 1606 is searched
Any lookup when, be disposed with selected lookup sectioning image be displayed on image show segment 1605 in.CAD lists
1607 is to support what information acquisition unit (not shown) obtained by the diagnosis arranged in control unit 37 to show in a listing format
The region of all diagnosis support information.Also diagnosis support information can be obtained for the ROI that specified by user, or can be by controlling
The ROI testing equipments (not shown) arranged in unit processed 37 is obtaining.When user select show in CAD lists 1607 it is any
During diagnosis support information, sectioning image present in the ROI corresponding with selected diagnosis support information is displayed on image
In showing segment 1605.
As described above, in this embodiment, as the character string display region for explaining text is determined based on ROI or VOI
Display location, so user can easily grasp explain between text and the region-of-interest in medical imaging corresponding closing
System.
In the above-described embodiments, by medical imaging and the explanation report corresponding with medical imaging, determine that character string shows
Show the display location in region.However, it is possible to by the medical imaging and the explanation corresponding with those medical imagings of multiple time points
Report, determines the display location of character string display region.It is, for example possible to use the past medical imaging of same patient or solution
Release report.
By with reference to Figure 11 and Figure 12 descriptions are by the medical imaging of multiple time points or explain report to determine character string display
The situation of the display location in region.With reference to Figure 11, medical imaging (present image) 1110 is and the explanation text by user writing
Corresponding medical imaging, and be displayed in character string display region 1100.Medical imaging (past image) 1120 be
The image of the same patient that the time point before the shooting time of medical imaging 1110 shoots.Subtraction image 1130 is medical imaging
Subtraction image between 1110 and medical imaging 1120.Can be by using such as FFD (Free-Form
Deformation, Free Transform) etc. deformation registration process deformed between medical imaging 1110 and medical imaging 1120
Alignment, and carry out subtracting shadow process between the two images, generate subtraction image.Shadow region on subtraction image 1130
1131 is the region each with the difference between present image 1110 and past image 1120.Shadow region shown in Figure 12
1200 represent the position on the present image 1110 corresponding with the shadow region 1131 on subtraction image 1130.
In step s 201, read current medical imaging 1110.In step S202, sensing pin is created to medical imaging 1110
The explanation report built.The example being described below, wherein, created explanation report in explanation text be " compared with last time,
Pulmonary module is increased as overall ", this is displayed in the character string display region 1100 shown in Figure 11.In step S203
In, " compared with last time ", " relative to before ", " compared with before " are pre-set to will be from the key for explaining Text Feature Extraction
Word.In this case, as " compared with last time " is arranged to crucial word, so from explanation Text Feature Extraction " with last time phase
Than ".Note, the above-mentioned keyword for pre-setting is only example, and if they be assumed to be it is medical with past
The character string that image is compared, created in text is explained with the time by user, then be not limited to these examples.
In step S204, image 1120 in the past is read, and subtraction image 1130 is generated using said method.Acquisition has
(for example, shadow region is 1131) not less than the region on the subtraction image of predetermined threshold to subtract shadow value.Can pre-set and subtract shadow value
Threshold value, or user can arrange arbitrary value.In step S205, display location determines that condition is arranged to " whole character
String viewing area be located at medical imaging inside " and " character string display region not with based on explanation text keyword and extract
The inside in region overlaps ".In this case, the display location of character string display region is confirmed as in medical imaging 1110
Outside shadow region 1200 in portion and the present image 1110 corresponding with the position of the shadow region 1131 on subtraction image
Region.In fig. 12, the display location of character string display region is located inside medical imaging 1110 and outside shadow region 1200
Portion.Therefore, the display location of the character string display region 1100 shown in Figure 12 is qualified appropriate display location.
As described above, in this embodiment, the subtraction image between medical imaging and another medical imaging, and base are obtained
In the pixel value of subtraction image, it is determined that explaining the display location of the character string display region of text.Therefore, show for diagnosis
Important region (for example, the part of disease extension), while present and the corresponding relation for explaining text, so as to promote doctor to make
Diagnosis.
In the above-described embodiments, it is with predefined size and shape to describe the character string display region in step S205
The example in region.However, according to the display location of character string display region, the amount of character string to be shown, wanting Overlapping display
Medical imaging, the region extracted etc., the size or shape of character string display region can be varied depending on.
Reference picture 13A, Figure 13 B and Figure 13 C is described to this.In step s 201, read medical imaging 1300.
In step S202, the explanation report that sensing pin is created to medical imaging 1300.The example being described below, wherein, created
Explain that the explanation text in report is " solid nodules to be observed in right lung S2 regions.Tuberosity has irregularly shaped and wraps
Spike body (spicula) is included, pulmonary carcinoma is suspected first ", this is displayed in the character string display region 1302 shown in Figure 13 A.
In step S203, from explanation Text Feature Extraction " lung " as keyword.In step S204, extract and close from medical imaging 1300
The corresponding lung areas 1301 of key word.In step S205, such as in the above-described embodiments, display location determines that condition is set
For " whole character string display region be located at medical imaging inside " and " character string display region not with the key based on explanation text
Word and the inside in region extracted overlaps ".
Figure 13 A show following example, wherein, due to character string display region 1302 very greatly, so in medical imaging
In there is no the position for meeting that display location determines condition, and character string display region can not be adapted in medical imaging.
In such a case, it is possible to there is no the region that can show character string display region to user's warning.Alternatively, such as by scheming
Represented by character string display region 1303 shown in 13B, as the size of character string display region can be narrowed to
Size, i.e. enable to meet display location and determine that the position of condition is present in medical imaging.In Figure 13 B, in character string
The font size of the explanation text shown in viewing area is reduced, so as to include meeting aobvious character string display region 1303
Show that position is determined at the position of condition, and the immovable content for explaining text.
As another example, by the example shown in description Figure 13 C.In this case, in step S203, from explanation
Text Feature Extraction " right lung " is used as keyword.In step S204, right lung region 1305 is extracted.In step S205, such as upper
State in embodiment, display location determines that condition is arranged to " whole character string display region is located inside medical imaging " and " word
Symbol string viewing area is not overlapped with the inside in the region extracted based on the keyword for explaining text ".In this example, with figure
Character string display region 1302 shown in 13A is compared, and the character string display region 1304 shown in Figure 13 C is by changing its shape
Shape, is displayed on and meets display location and determine at the position of condition.
According to the embodiment, the distribution of the relevant range included based on medical imaging changes character string display region
Size or shape, so as to character string display region is included in medical imaging.Therefore, it is possible to amount or size with explanation text
Independently, the corresponding relation explained between text and region-of-interest is shown.
In the above-described embodiments, obtain corresponding with the keyword extracted in step S203 in step S204
A region in medical imaging, and the region is determined into condition as display location in step S205.However, it is possible to correspondence
The multiple regions in medical imaging are obtained in a keyword, and these regions are determined into condition as display location.
To determine with reference to Figure 14 and Figure 15.Figure 14 is illustrated that in step S203 from the default of explanation Text Feature Extraction
Keyword and in step S204 corresponding to keyword obtain region between relation table information example figure.For example,
With reference to Figure 14, if from Text Feature Extraction " brain " is explained as keyword in step S203, obtaining " big in step S204
Brain " region and " cerebellum " region.As another example, if from explanation Text Feature Extraction " lung " as crucial in step S203
Word, then obtain " right lung is wild " region, " left lung field " region and " bronchus " region in step S204.In the table information, with
The associated character string of region-of-interest in the medical imaging of subject and represent anatomic region type character string, thus by
It is associated with each other.
Figure 15 is shown when the extraction " lung " in step S203, and " right lung is wild " region, " a left side are obtained in step S204
When lung field " region and " bronchus " region, the example of character string display region is shown in medical imaging.More specifically, in step
In rapid S201, medical imaging 1500 is read.In step S202, the explanation report that sensing pin is created to medical imaging 1500.Will
The example being described as follows, wherein, the explanation text in the explanation report for being created is " reality knot to be observed in right lung S2 regions
Section ", this is displayed in the character string display region 1504 shown in Figure 15.
In step S203, from explanation Text Feature Extraction " lung " as keyword.In step S204, take up a job as a doctor with reference to Figure 12 and use
Image 1500 extracts the right lung region 1501 corresponding with keyword, left lung region 1502 and bronchiolar region 1503.In step
In rapid S205, such as in the above-described embodiments, display location determines that condition is arranged to that " whole character string display region is located at medical
Inside image ", " character string display region is not overlapped with the inside in region extracted based on the keyword for explaining text ".At this
In the case of kind, the display location of character string display region 1504 is confirmed as inside medical imaging 1500, outside right lung region 1501
Region outside portion, left lung region 1502 and outside bronchiolar region 1503.In fig .15, the display position of character string display region
Outside inside medical imaging 1500 and right lung region 1501, left lung region 1502 and bronchiolar region 1503.Therefore, scheme
The display location of the character string display region 1504 shown in 15 is qualified appropriate display location.
In this embodiment, it is also contemplated that with the corresponding region of keyword explained in text in terms of dissection or medical science
The closely related another region of aspect, determines the display location of character string display region.Therefore, user more easily can know
Other text strings.
Note, explain that report can include the multiple region-of-interests in medical imaging and be associated with these region-of-interests
Multiple explanations text (annotation information), and display location determining unit 45 can be directed to multiple explanation texts, it is determined that not each other
The display location of overlapping character string display region.This makes it possible to multiple region-of-interests and corresponding explanation text (annotation
Information) it is simultaneously displayed in a medical imaging and does not overlap.
In the above-described embodiments, in step S206, display processing unit 46 shows on display unit 36 and is superimposed upon doctor
With the character string on image.However, it is possible to create and show the medical imaging that character string is embedded directly within.
The process of step S201 to S205 with it is identical in above-described embodiment.In step S206, the second medical figure is created
Picture, wherein, some or all in the character string of the explanation text obtained in step S202 are embedded into and read in step s 201
At display location in the medical imaging for going out, determining in step S205.Second medical imaging is displayed on display unit 36
On.
As described above, in this embodiment, generation is disposed with explanation text at the display location of character string display region
New medical imaging.New medical imaging is displayed on display unit 36, used as including the medical imaging for explaining text.Cause
This, can show which medical imaging and explain the corresponding relation between text, without being superimposed on medical imaging such as character string
On situation make explanation text overlay in relevant range.
In the above-described embodiments, the unit of medical image display apparatus 10 is realized by software in home environment.So
And, following server-client system can be formed, wherein, the work(of the control unit 37 in medical image display apparatus 10
At least some in energy is performed using LAN by server.
For example, it is contemplated that the medical imaging acquiring unit 41 with big amount of calculation, explanation report acquisition unit 42, keyword
Place's reason server of extraction unit 43, area acquisition unit 44 and display location determining unit 45 is realizing.Carry out to
Family finally shows that the process of the display processing unit 46 of the process of medical imaging can be realized in client-side.More specifically, working as
When client-side selects Case No from list (not shown), selected Case No is sent to server via LAN.
In server side, medical imaging is obtained based on selected Case No and report is explained, and above-mentioned process is carried out with final
It is determined that explaining the display location (step S201 to S205) of text.Next, medical imaging, explanation are reported, are explained by server
Text is conciliate the display location of annotations sheet and is sent to client-side.In client-side, medical imaging is shown based on the content for sending
Conciliate annotations sheet (step S206).
According to the embodiment, even if the computing resource very little on client-side, it is also possible to clearly illustrated using server
Corresponding relation between medical imaging and explanation text.
As described above, in various embodiments of the present invention, obtain concern position in medical imaging or concern scope, with
And for paying close attention to the explanation text (annotation information) of position or concern scope.Annotation information is determined based on the content of character string
The display location of (character string etc.) in medical imaging.Character string display is existed based on the content of character string therefore, it is possible to work as
Display location, and the display location by character string Overlapping display in medical imaging are determined when in medical imaging.Therefore, it is possible to
Avoid to be superimposed upon in medical imaging at the important position in terms of dissection of character string, or in the position related to the content of character string
The place of putting is superimposed upon in medical imaging.Therefore, it is possible to provide a kind of display and without prejudice to user confirms the content of character string
Medical imaging Display Technique.
According to the present invention, user can more easily grasp medical imaging and explain the corresponding relation between report.
Other embodiment
(also can also more completely be referred to as " non-transitory computer can in storage medium by reading and performing record
Read storage medium ") on computer executable instructions (for example, one or more programs) performing in above-described embodiment
It is individual or more function and/or including for performing one of the one or more function in above-described embodiment
Or the computer of the system or device of more circuits (for example, special IC (ASIC)), realize the enforcement of the present invention
Example, and it is possible to can using the computer for for example being read by the computer by system or device and perform from storage medium
Execute instruction is performing the one or more function in above-described embodiment and/or control one or more circuits
Method to perform the one or more function in above-described embodiment, realizes embodiments of the invention.Computer can be with
Including one or more processors (for example, CPU (CPU), microprocessing unit (MPU)), and can include dividing
The computer opened or the network of separate processor, to read and perform computer executable instructions.Computer executable instructions
Computer can be provided to from network or storage medium for example.Storage medium can include such as hard disk, random access memory
Device (RAM), read only memory (ROM), the memorizer of distributed computing system, CD (such as compact disk (CD), digital universal
CD (DVD) or Blu-ray Disc (BD)TM), one of flash memory device and storage card etc. or more.
Embodiments of the invention can also be realized by following method, i.e. by network or various storage mediums
The software (program) of function for performing above-described embodiment is supplied to into system or device, the computer of the system or device or in
The method that Central Processing Unit (CPU), microprocessing unit (MPU) read simultaneously configuration processor.
Although with reference to exemplary embodiment, invention has been described, but it is to be understood that the invention is not restricted to institute public
The exemplary embodiment opened.Most wide explanation should be given to scope of the following claims, so which covers all these changes
The 26S Proteasome Structure and Function of type example and equivalent.
Claims (24)
1. a kind of information processor, described information processing meanss include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with
The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to obtain the region related to the region-of-interest in the medical imaging;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, not make the annotation information
The viewing area is overlapping with the relevant range;And
Display control unit, which is suitable to show includes the medical imaging of the annotation information so that on the display unit described
The annotation information is shown at display location determined by viewing area.
2. information processor according to claim 1, wherein, the determining unit is repaiied according to the annotation information
Change, change the display location of the viewing area, and
The display control unit will include the medical imaging of the annotation information, after being displayed in the change of the viewing area
At display location.
3. information processor according to claim 1, wherein, the relevant range acquiring unit is obtained includes the pass
Used as the relevant range, the anatomic region is the region that patient is occupied in the medical imaging to the anatomic region in note region
Subregion.
4. information processor according to claim 3, wherein, the relevant range acquiring unit is also obtained and the solution
Other related anatomic regions of region are cutd open as the relevant range.
5. information processor according to claim 3, wherein, the relevant range acquiring unit is based on the annotation letter
Breath, obtains the anatomic region as the relevant range.
6. information processor according to claim 5, wherein, the relevant range acquiring unit is from the annotation information
The text string extracting keyword for including, and the anatomic region is obtained based on the keyword.
7. information processor according to claim 6, wherein, the relevant range acquiring unit is based on table acquisition of information
The anatomic region is associated with the character string and the solution of the region-of-interest in the table information as the relevant range
The type for cuing open region is associated with each other.
8. information processor according to claim 6, wherein, according to by the relevant range acquiring unit from the note
Extraction of the character string that the information of releasing includes to the keyword, the display control unit will be corresponding with the keyword
Part is shown in the way of being distinguished with other character strings.
9. information processor according to claim 6, wherein, the relevant range acquiring unit extracts Organ naming
And/or disease name is used as the keyword.
10. information processor according to claim 3, wherein, the relevant range acquiring unit is based on described medical
The position of the region-of-interest in image, obtains the anatomic region.
11. information processors according to claim 10, wherein, in the character string included based on the annotation information
In the case of the anatomic region cannot be obtained, the relevant range acquiring unit based on the medical imaging in the concern
The position in region, obtains the anatomic region.
12. information processors according to claim 1, wherein, medical imaging to be shown includes from same patient obtaining
The multiple sectioning images for taking,
The determining unit is also from the plurality of sectioning image, it is determined that the sectioning image that will be shown together with the annotation information,
And
The display control unit includes the annotation information in the viewing area of sectioning image determined by.
13. information processors according to claim 1, wherein, medical imaging to be shown includes from same patient obtaining
The multiple sectioning images for taking, and
The annotation information that the display control unit will be associated with the region-of-interest, together with perpendicular to the sectioning image
Section direction on each sectioning image for existing in the region-of-interest preset distance show together.
14. information processors according to claim 1, described information processing meanss also include image acquisition unit, institute
State image acquisition unit to be suitable to obtain the subtraction image between the medical imaging and other medical imagings,
Wherein, pixel value of the determining unit based on the subtraction image, determines the display location of the viewing area.
15. information processors according to claim 1, wherein, the determining unit determines the institute of the viewing area
State display location so that the display location is included in the region occupied by the medical imaging.
16. information processors according to claim 1, described information processing meanss also include signal generating unit, the life
It is suitable to generate into unit and the note is disposed with the viewing area shown by the display location determined by the determining unit
The new medical imaging of information is released,
Wherein, the display control unit shows the new medical imaging, used as the medical imaging including the annotation information.
17. information processors according to claim 1, described information processing meanss also include creating unit, the wound
Build unit to be suitable to create the image file of medical imaging, described image file includes the annotation information and represents by described true
The area information of the viewing area that order unit determines.
18. information processors according to claim 1, wherein, during the report information includes the medical imaging
Multiple region-of-interests and with the associated plurality of annotation information of the region-of-interest, and
Viewing area of the determining unit for the plurality of annotation information, it is determined that the display location not overlapped each other.
19. information processors according to claim 1, described information processing meanss also include mobile unit, the shifting
Moving cell is suitable to be input into according to the operation of user, the viewing area of the movement annotation information,
Wherein, in the situation for being made that the operation input that the first viewing area is moved to the position overlapped with the second viewing area
Under, the determining unit determines the display location of at least one of first viewing area and second viewing area,
First viewing area and second viewing area is not made to overlap each other.
A kind of 20. information processors, described information processing meanss include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with
The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to the character string included based on the annotation information, obtains in the medical imaging
Relevant range;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information
The viewing area and the relevant range it is overlapping;And
Display control unit, which is suitable to show the medical imaging for including the annotation information so that the annotation information is shown
At display location determined by the viewing area on the display unit.
A kind of 21. information processing systems, described information processing system include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with
The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to obtain the region related to the region-of-interest in the medical imaging;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information
The viewing area and the relevant range it is overlapping;And
Display control unit, which is suitable to show the medical imaging for including the annotation information so that the annotation information is shown
At display location determined by the viewing area on the display unit.
A kind of 22. information processing systems, described information processing system include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with
The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to the character string included based on the annotation information, obtains in the medical imaging
Relevant range;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information
The viewing area and the relevant range it is overlapping;And
Display control unit, which is suitable to show includes the medical imaging of the annotation information so that on the display unit described
The annotation information is shown at display location determined by viewing area.
A kind of 23. information processing methods, described information processing method include:
By report acquisition unit obtain report information, the report information include the region-of-interest in medical imaging and with the pass
The associated annotation information in note region;
The region related to the region-of-interest in the medical imaging is obtained by relevant range acquiring unit;
The display location of the viewing area of the annotation information is determined by determining unit, so as not to make described in the annotation information
Viewing area is overlapping with the relevant range;And
Medical imaging including the annotation information is shown by display control unit so that the viewing area on the display unit
The annotation information is shown at display location determined by domain.
A kind of 24. information processing methods, described information processing method include:
By report acquisition unit obtain report information, the report information include the region-of-interest in medical imaging and with the pass
The associated annotation information in note region;
The character string included based on the annotation information by relevant range acquiring unit, obtains the correlation in the medical imaging
Region;
The display location of the viewing area of the annotation information is determined by determining unit, so as not to make described in the annotation information
Viewing area is overlapping with the relevant range;And
Medical imaging including the annotation information is shown by display control unit so that the viewing area on the display unit
The annotation information is shown at display location determined by domain.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015177914 | 2015-09-09 | ||
JPJP2015-177914 | 2015-09-09 | ||
JPJP2016-080480 | 2016-04-13 | ||
JP2016080480A JP6827706B2 (en) | 2015-09-09 | 2016-04-13 | Information processing equipment and its methods, information processing systems, computer programs |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106529115A true CN106529115A (en) | 2017-03-22 |
CN106529115B CN106529115B (en) | 2019-10-15 |
Family
ID=58319786
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610807491.XA Active CN106529115B (en) | 2015-09-09 | 2016-09-07 | Information processing unit, information processing method |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6827706B2 (en) |
CN (1) | CN106529115B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109461494A (en) * | 2018-10-29 | 2019-03-12 | 北京青燕祥云科技有限公司 | A kind of RIS platform and image assistant diagnostic system example method of data synchronization |
CN109637628A (en) * | 2017-10-06 | 2019-04-16 | 佳能株式会社 | Information processing unit, method and non-transient computer-readable storage media |
CN111627508A (en) * | 2020-04-29 | 2020-09-04 | 数坤(北京)网络科技有限公司 | Medical image reading method and device and computer readable medium |
CN111681739A (en) * | 2020-06-15 | 2020-09-18 | 杭州依图医疗技术有限公司 | Pathological information display method and computer-readable storage medium |
CN112562042A (en) * | 2020-12-24 | 2021-03-26 | 凌云光技术股份有限公司 | Display method and device for editing and analyzing image detection text in real time |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6987551B2 (en) * | 2017-07-03 | 2022-01-05 | キヤノンメディカルシステムズ株式会社 | Medical image processing equipment |
JP7086630B2 (en) * | 2018-02-09 | 2022-06-20 | キヤノン株式会社 | Information processing equipment, information processing methods, and programs |
JP7171271B2 (en) * | 2018-07-04 | 2022-11-15 | キヤノンメディカルシステムズ株式会社 | Medical information display device |
WO2020105415A1 (en) * | 2018-11-23 | 2020-05-28 | 富士フイルム株式会社 | Medical information display device, method, and program, and graphic user interface for displaying medical information |
KR102216697B1 (en) * | 2020-02-28 | 2021-02-17 | 주식회사 루닛 | Medical image apparatus and method for processing medical image |
JP7394959B2 (en) * | 2020-03-05 | 2023-12-08 | 富士フイルム株式会社 | Medical image processing device, medical image processing method and program, medical image display system |
WO2022070528A1 (en) * | 2020-09-29 | 2022-04-07 | 富士フイルム株式会社 | Medical image processing device, method, and program |
JP7418018B2 (en) * | 2021-11-12 | 2024-01-19 | iSurgery株式会社 | Diagnostic support equipment and computer programs |
WO2023199957A1 (en) * | 2022-04-12 | 2023-10-19 | 富士フイルム株式会社 | Information processing device, information processing method, and information processing program |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050107690A1 (en) * | 2003-11-13 | 2005-05-19 | Konica Minolta Medical & Graphic, Inc. | Medical image interpretation system and interpretation report generating method |
JP2006255021A (en) * | 2005-03-15 | 2006-09-28 | Toshiba Corp | Image display device and method |
CN101053521A (en) * | 2006-04-12 | 2007-10-17 | 株式会社东芝 | Medical image display apparatus |
WO2011033769A1 (en) * | 2009-09-17 | 2011-03-24 | 富士フイルム株式会社 | Medical image display device, method, and program |
CN103941855A (en) * | 2013-01-22 | 2014-07-23 | 株式会社东芝 | Medical image reference apparatus and method |
CN104011787A (en) * | 2011-12-26 | 2014-08-27 | 佳能株式会社 | Image processing apparatus, control method for the same, image processing system, and program |
CN104281683A (en) * | 2014-09-30 | 2015-01-14 | 深圳华声医疗技术有限公司 | Medical image retrieval method and medical image sharing method |
CN104584018A (en) * | 2012-08-22 | 2015-04-29 | 皇家飞利浦有限公司 | Automatic detection and retrieval of prior annotations relevant for imaging study for efficient viewing and reporting |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5987345A (en) * | 1996-11-29 | 1999-11-16 | Arch Development Corporation | Method and system for displaying medical images |
JP4897293B2 (en) * | 2006-01-11 | 2012-03-14 | 株式会社日立メディコ | Medical image display device |
JP2007282771A (en) * | 2006-04-14 | 2007-11-01 | Konica Minolta Medical & Graphic Inc | Medical information processor, and program |
JP2009018048A (en) * | 2007-07-12 | 2009-01-29 | Fujifilm Corp | Medical image display, method and program |
JP5062477B2 (en) * | 2007-11-20 | 2012-10-31 | よこはまティーエルオー株式会社 | Medical image display device |
JP5317558B2 (en) * | 2008-07-07 | 2013-10-16 | 株式会社東芝 | Medical information creation device |
JP2010057902A (en) * | 2008-08-06 | 2010-03-18 | Toshiba Corp | Report generation support apparatus, report generation support system, and medical image referring apparatus |
JP5203858B2 (en) * | 2008-09-01 | 2013-06-05 | 富士フイルム株式会社 | MEDICAL IMAGE DISPLAY DEVICE, MEDICAL IMAGE DISPLAY METHOD, AND MEDICAL IMAGE DISPLAY PROGRAM |
JP2010057684A (en) * | 2008-09-03 | 2010-03-18 | Fujifilm Corp | Medical image display, medical image displaying method, and medical image displaying program |
JP5624308B2 (en) * | 2008-11-21 | 2014-11-12 | 株式会社東芝 | Image processing apparatus and image processing method |
JP5455470B2 (en) * | 2009-07-02 | 2014-03-26 | 株式会社東芝 | Medical image interpretation system |
JP5523891B2 (en) * | 2009-09-30 | 2014-06-18 | 富士フイルム株式会社 | Lesion region extraction device, its operating method and program |
JP2012040044A (en) * | 2010-08-12 | 2012-03-01 | Toshiba Corp | Medical image display device |
WO2012049741A1 (en) * | 2010-10-13 | 2012-04-19 | 株式会社日立製作所 | Medical image display device, medical information management server |
JP5644607B2 (en) * | 2011-03-17 | 2014-12-24 | 富士通株式会社 | Information providing program, information providing apparatus, and information providing method |
JP5746908B2 (en) * | 2011-05-06 | 2015-07-08 | 株式会社東芝 | Medical image processing device |
WO2013001678A1 (en) * | 2011-06-30 | 2013-01-03 | パナソニック株式会社 | Apparatus for searching for analogous cases and apparatus for preparing relevance database, as well as method for searching for analogous cases and method for preparing relevance database |
WO2013076930A1 (en) * | 2011-11-25 | 2013-05-30 | パナソニック株式会社 | Medical image compression device, medical image compressing method, and prediction knowledge database creation device |
JP6080249B2 (en) * | 2012-09-13 | 2017-02-15 | 富士フイルム株式会社 | Three-dimensional image display apparatus and method, and program |
WO2014053986A2 (en) * | 2012-10-01 | 2014-04-10 | Koninklijke Philips N.V. | Multi-study medical image navigation |
JP2015095050A (en) * | 2013-11-11 | 2015-05-18 | 株式会社東芝 | Radiograph interpretation report creation device |
JP6595193B2 (en) * | 2014-03-11 | 2019-10-23 | キヤノンメディカルシステムズ株式会社 | Interpretation report creation device and interpretation report creation system |
-
2016
- 2016-04-13 JP JP2016080480A patent/JP6827706B2/en active Active
- 2016-09-07 CN CN201610807491.XA patent/CN106529115B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050107690A1 (en) * | 2003-11-13 | 2005-05-19 | Konica Minolta Medical & Graphic, Inc. | Medical image interpretation system and interpretation report generating method |
JP2006255021A (en) * | 2005-03-15 | 2006-09-28 | Toshiba Corp | Image display device and method |
CN101053521A (en) * | 2006-04-12 | 2007-10-17 | 株式会社东芝 | Medical image display apparatus |
WO2011033769A1 (en) * | 2009-09-17 | 2011-03-24 | 富士フイルム株式会社 | Medical image display device, method, and program |
CN102497805A (en) * | 2009-09-17 | 2012-06-13 | 富士胶片株式会社 | Medical image display device, method, and program |
CN104011787A (en) * | 2011-12-26 | 2014-08-27 | 佳能株式会社 | Image processing apparatus, control method for the same, image processing system, and program |
CN104584018A (en) * | 2012-08-22 | 2015-04-29 | 皇家飞利浦有限公司 | Automatic detection and retrieval of prior annotations relevant for imaging study for efficient viewing and reporting |
CN103941855A (en) * | 2013-01-22 | 2014-07-23 | 株式会社东芝 | Medical image reference apparatus and method |
CN104281683A (en) * | 2014-09-30 | 2015-01-14 | 深圳华声医疗技术有限公司 | Medical image retrieval method and medical image sharing method |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109637628A (en) * | 2017-10-06 | 2019-04-16 | 佳能株式会社 | Information processing unit, method and non-transient computer-readable storage media |
CN109461494A (en) * | 2018-10-29 | 2019-03-12 | 北京青燕祥云科技有限公司 | A kind of RIS platform and image assistant diagnostic system example method of data synchronization |
CN111627508A (en) * | 2020-04-29 | 2020-09-04 | 数坤(北京)网络科技有限公司 | Medical image reading method and device and computer readable medium |
CN111627508B (en) * | 2020-04-29 | 2021-05-11 | 数坤(北京)网络科技有限公司 | Medical image reading method and device and computer readable medium |
CN111681739A (en) * | 2020-06-15 | 2020-09-18 | 杭州依图医疗技术有限公司 | Pathological information display method and computer-readable storage medium |
CN112562042A (en) * | 2020-12-24 | 2021-03-26 | 凌云光技术股份有限公司 | Display method and device for editing and analyzing image detection text in real time |
Also Published As
Publication number | Publication date |
---|---|
JP2017051591A (en) | 2017-03-16 |
CN106529115B (en) | 2019-10-15 |
JP6827706B2 (en) | 2021-02-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106529115B (en) | Information processing unit, information processing method | |
US10460838B2 (en) | Automated anatomically-based reporting of medical images via image annotation | |
CN105167793B (en) | Image display device, display control unit and display control method | |
US10181187B2 (en) | Information processing apparatus, method thereof, information processing system, and computer-readable storage medium that display a medical image with comment information | |
CN106560827B (en) | Control method | |
US8625867B2 (en) | Medical image display apparatus, method, and program | |
US10282840B2 (en) | Image reporting method | |
US20180060535A1 (en) | Updating probabilities of conditions based on annotations on medical images | |
EP3100209B1 (en) | Extraction of information from an image and inclusion thereof in a clinical report | |
RU2493593C2 (en) | Method of extracting data from set of data of medical images | |
US10729396B2 (en) | Tracking anatomical findings within medical images | |
CN110050281A (en) | Learn the annotation of the object in image | |
US20190150870A1 (en) | Classification of a health state of tissue of interest based on longitudinal features | |
CN112885453A (en) | Method and system for identifying pathological changes in subsequent medical images | |
JP6824845B2 (en) | Image processing systems, equipment, methods and programs | |
KR20150125436A (en) | Apparatus and method for providing additional information according to each region of interest | |
US8238999B2 (en) | Method for display of at least one medical finding | |
US20180060488A1 (en) | Customizing annotations on medical images | |
US20180064409A1 (en) | Simultaneously displaying medical images | |
US20180060534A1 (en) | Verifying annotations on medical images using stored rules | |
JP2017534316A (en) | Image report annotation identification | |
CN106250665A (en) | Information processor, information processing method and information processing system | |
CN107632997B (en) | Determining a group of images from a set of signatures | |
JP6797858B2 (en) | Medical image display device, display control device and display control method, program | |
US20230410305A1 (en) | Information management apparatus, method, and program and information processing apparatus, method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |