CN106529115A - Information processing device, information processing method, and information processing system - Google Patents

Information processing device, information processing method, and information processing system Download PDF

Info

Publication number
CN106529115A
CN106529115A CN201610807491.XA CN201610807491A CN106529115A CN 106529115 A CN106529115 A CN 106529115A CN 201610807491 A CN201610807491 A CN 201610807491A CN 106529115 A CN106529115 A CN 106529115A
Authority
CN
China
Prior art keywords
information
region
medical imaging
viewing area
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610807491.XA
Other languages
Chinese (zh)
Other versions
CN106529115B (en
Inventor
久保武
青山岳人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN106529115A publication Critical patent/CN106529115A/en
Application granted granted Critical
Publication of CN106529115B publication Critical patent/CN106529115B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G06F19/321

Abstract

The invention provides an information processing device, an information processing method, and an information processing system. The information processing device comprises a report acquisition unit, a related area acquisition unit, a determining unit, and a control display unit. The report acquisition unit is suitable for acquiring report information, which comprises a concerned area of a medial image and annotation information related to the concerned area. The related area is used to acquire the area related to the concerned area in the medical image. The determining unit is used to determine the display position of the display area of the annotation information, and is used to prevent the display area of the annotation information overlapped with the related area. The display control unit is used to display the medical image of the annotation information, and then the annotation information is displayed on the display position determined by the display area of the display unit.

Description

Information processor, information processing method and information processing system
Technical field
The present invention relates to a kind of information processor, information processing method and information processing system, and especially, relate to And a kind of medical imaging Display Technique.
Background technology
In medical scene, using medical imaging apparatus, such as X ray CT (computed tomography) device, MRI (cores Nuclear magnetic resonance) device or PET (positron emission computerized tomography) device etc., carry out the shooting to patient.CT is Computed The abbreviation of Tomography, MRI are the abbreviations of Magnetic Resonance Imaging, and PET is Positron The abbreviation of Emission Tomography.By to by image it is obtaining, and be saved within the hospital in scheduled time slot View data in data server carries out various image procossings to create medical imaging.For the diagnostic imaging of doctor is operated, Target medical imaging is searched for using medical image display apparatus (also referred to as browser), and target medical imaging is included in prison On visual organ, and using medical image display apparatus various functions carrying out diagnostic imaging.Doctor records the knot of diagnostic imaging Fruit is reported as explaining.
When reporting with reference to the explanation for being recorded, user is with reference to it simultaneously by medical imaging and the description content for explaining report It is associated.However, being difficult to sometimes easily specify the position in the medical imaging represented by the description content for explaining report.This Outward, user while two information (i.e. medical imaging and explanation report) are associated with each other need the time to carry out reference and explains Report.
Japanese Unexamined Patent Publication 2011-083590 publications describe the pathological changes explained described in report are displayed in medical imaging The information in portion.According to the arrangement, explain that the character string in report is linked with the position in the medical imaging by string representation, And character string is displayed near the position.Therefore, user correctly can be grasped by the character string explained described in report Position in represented medical imaging, and correctly the time can need not be spent with reference to report is explained.
However, in the arrangement of Japanese Unexamined Patent Publication 2011-083590 publications, the character string that shows in medical imaging is determined Position, without considering anatomical structure or explaining the content of report.For this reason, character string is superimposed upon medical imaging sometimes On dissection critical positions or to the position in the related medical imaging of content for explaining report.In this case, Yong Hunan To confirm anatomical structure in medical imaging or explain the content of report.
The content of the invention
The present invention allows for the problems referred to above and makes, and provide one kind more easily can grasp medical imaging with Explain the technology of the corresponding relation between report.
According to an aspect of the present invention, a kind of information processor includes:Report acquisition unit, which is suitable to obtain report Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase Area acquisition unit is closed, which is suitable to obtain the region related to the region-of-interest in the medical imaging;Determining unit, its Be adapted to determine that the display location of the viewing area of the annotation information, so as not to make the viewing area of the annotation information with The relevant range overlaps;And display control unit, which is suitable to show the medical imaging for including the annotation information so that The annotation information is shown at display location determined by the viewing area on display unit.
According to a further aspect in the invention, a kind of information processor includes:Report acquisition unit, which is suitable to obtain report Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase Area acquisition unit is closed, which is suitable to the character string included based on the annotation information, obtain the correlation in the medical imaging Region;Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information The viewing area and the relevant range it is overlapping;And display control unit, which is suitable to show includes the annotation information Medical imaging so that at display location determined by the viewing area on the display unit show it is described annotation letter Breath.
According to another aspect of the invention, a kind of information processing system includes:Report acquisition unit, which is suitable to obtain report Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase Area acquisition unit is closed, which is suitable to obtain the region related to the region-of-interest in the medical imaging;Determining unit, its Be adapted to determine that the display location of the viewing area of the annotation information, so as not to make the viewing area of the annotation information with The relevant range overlaps;And display control unit, which is suitable to show the medical imaging for including the annotation information so that The annotation information is shown at display location determined by the viewing area on display unit.
According to another aspect of the invention, a kind of information processing system includes:Report acquisition unit, which is suitable to obtain report Information, the annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;Phase Area acquisition unit is closed, which is suitable to the character string included based on the annotation information, obtain the correlation in the medical imaging Region;Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information The viewing area and the relevant range it is overlapping;And display control unit, which is suitable to show includes the annotation information Medical imaging so that at display location determined by the viewing area on the display unit show it is described annotation letter Breath.
According to another aspect of the invention, a kind of information processing method includes:Report information is obtained by report acquisition unit, The annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;By related area Domain acquiring unit obtains the region related to the region-of-interest in the medical imaging;The annotation is determined by determining unit The display location of the viewing area of information, so as not to hand over the viewing area of the annotation information and the relevant range It is folded;And the medical imaging including the annotation information is shown by display control unit so that on the display unit described aobvious Show.
According to another aspect of the invention, a kind of information processing method includes:Report information is obtained by report acquisition unit, The annotation information that the report information is included the region-of-interest in medical imaging and is associated with the region-of-interest;By related area The character string that domain acquiring unit is included based on the annotation information, obtains the relevant range in the medical imaging;By determining Unit determines the display location of the viewing area of the annotation information, so as not to make the viewing area of the annotation information with The relevant range overlaps;And the medical imaging including the annotation information is shown by display control unit so that showing The annotation information is shown at display location determined by the viewing area on unit.
By the description of following (referring to the drawings) to exemplary embodiment, further characteristic of the invention will be clear from.
Description of the drawings
Fig. 1 is the block diagram of the arrangement for illustrating medical image system;
Fig. 2 is the flow chart for illustrating the processing procedure of medical image system;
Fig. 3 is the figure for illustrating the example for explaining that report creates picture;
Fig. 4 is the figure of the example for illustrating medical imaging and character string display region;
Fig. 5 A, Fig. 5 B, Fig. 5 C and Fig. 5 D are the examples of the character string display region for illustrating Overlapping display in medical imaging Figure;
Fig. 6 is the figure for illustrating example that the display location of character string display region is uniquely identified;
Fig. 7 A and Fig. 7 B are to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;
Fig. 8 is the figure of the scope for schematically showing sectioning image and showing character string;
Fig. 9 A, Fig. 9 B and Fig. 9 C are to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;
Figure 10 A and Figure 10 B are the figures of the scope for schematically showing sectioning image and showing character string;
Figure 11 is for illustrating present image, past image and subtracting the figure of shadow (subtraction) image;
Figure 12 is to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;
Figure 13 A, Figure 13 B and Figure 13 C are to illustrate that character string display region is applied the example being displayed in medical imaging Figure;
Figure 14 is the figure for illustrating the relation between keyword and acquisition region;
Figure 15 is to illustrate that character string display region is applied the figure of the example being displayed in medical imaging;And
Figure 16 is the figure of the detailed display example for illustrating image display area.
Specific embodiment
Now, embodiments of the invention are described with reference to the accompanying drawings.However, the scope of the present invention is not limited to following arrangement showing Example.
(medical image system)
Fig. 1 be illustrate it is (medical including the medical image system of medical image display apparatus according to an embodiment of the invention Image display system) integral arrangement block diagram.Include that medical imaging shows as the medical image system of information processing system Device 10 and data base 22.These devices connect via communicator, so as to communicate with one another.In this embodiment, will retouch State the example that communicator is formed by LAN (LAN) 21.However, it is possible to by radio communication device (for example, WLAN) or public affairs Common communication network forms communicator.
Data base 22 manages test information, such as medical imaging and explanation report.Data base 22 is by medical imaging and explanation Report is kept securely in association.Medical image display apparatus 10 obtain the medical imaging or solution managed by data base 22 via LAN 21 Release report.
Include communication IF (interface) 31, ROM (read-only storage as the medical image display apparatus 10 of information processor Device) 32, RAM (random access memory) 33, memory element 34, operating unit 35, display unit 36 and control unit 37, make For its functional part.Communication IF 31 is realized for example, by LAN card, and (for example, is counted via the control external device (ED)s of LAN 21 According to communication of the storehouse 22) and between medical image display apparatus 10.ROM 32 is deposited by the read-only of the realizations such as nonvolatile memory Reservoir, and store various programs etc..RAM 33 is and the interim storage by the writable memory of the realizations such as volatile memory Various information.Memory element 34 is the storage device realized by such as HDD (hard disk drive), and stores various information.Behaviour Make unit 35 for example by keyboard or pointer device to realize, and user instruction is input into device.Display unit 36 is for example by showing Show device to realize, and various information are shown to user (for example, doctor).For example by CPU, (central authorities process single control unit 37 Unit) realizing, and the process of overall control medical image display apparatus 10.
Control unit 37 include medical imaging acquiring unit 41, explain report acquisition unit 42, keyword extraction unit 43, Area acquisition unit 44, display location determining unit 45 and display processing unit 46, as its functional part.Medical imaging is obtained Unit 41 is taken according to the user operation being input into by operating unit 35, via communication IF 31 and LAN 21, institute is obtained from data base 22 The medical imaging of the patient of care.Medical imaging output is arrived area acquisition unit 44, shows position by medical imaging acquiring unit 41 Put determining unit 45 and display processing unit 46.
Report acquisition unit 42 is explained according to the user operation being input into by operating unit 35, via communication IF 31 and LAN 21, obtain from data base 22 and explain report (report information).Note, explain that report is and is obtained by medical imaging acquiring unit 41 Medical imaging it is corresponding explanation report, and after a while will description create explain report method detailed.Additionally, report information It is the region-of-interest and the annotation information being associated with region-of-interest in the medical imaging for include subject (for example, patient) Information.Report information is the subset of the information for explaining that report includes or explains report itself.Explain that report is not only included by solving Release doctor be registered in explain report server in explanation report, also including be input to explain report editing pictures, registration Front or under editor explanation is reported.In this case, above-mentioned report information be under editor explanation report include Information, the information is the region-of-interest in the medical imaging for include subject and the annotation information being associated with region-of-interest Information.
Part or all of the explanation report of acquisition is output to keyword extraction unit 43, display location determining unit 45 and display processing unit 46.
Keyword extraction unit 43 carries out process described later for the explanation report obtained by explanation report acquisition unit 42, So as to extract keyword.Keyword extraction unit 43 is by the keyword for being extracted output to area acquisition unit 44.
Area acquisition unit 44 as relevant range acquiring unit is based on the key obtained by keyword extraction unit 43 Word, the medical imaging for being obtained by medical imaging acquiring unit 41 carry out process described later, so as to obtain in medical imaging Anatomic region.Area acquisition unit 44 is by acquired anatomic region output to display location determining unit 45.
Display location determining unit 45 in the medical imaging obtained by medical imaging acquiring unit 41, it is determined that to by explaining The display location shown by character string in the explanation report that report acquisition unit 42 is obtained.Here, explaining the word in report Symbol string represents part or all of the text described in explanation report.Note, based on medical imaging, explain report and by Part or all for the region that area acquisition unit 44 is obtained, determines display location by process described later.Display location Display processing unit 46 is arrived in the display location output by determined by of determining unit 45.
Display processing unit 46 is included the medical imaging obtained by medical imaging acquiring unit 41 on display unit 36, Simultaneously the character string in the explanation report obtained by explanation report acquisition unit 42 is superimposed upon by display location determining unit 45 It is determined that display location on.
Note, at least some in the unit provided in control unit 37 may be implemented as independent equipment.It is optional Ground, unit may be implemented as the software (computer program) for realizing function.In this case, realize the software of function Can be operated via network (such as cloud) on the server.In this embodiment, will describe by software in home environment Realize the example of unit.
(processing procedure)
Next, reference Fig. 2 to Fig. 4 to be described the overall process process of the control unit 37 according to the embodiment.For example, Below, by mesh will be described as to the medical imaging that the chest area of subject is shot and created by X ray CT device Mark.However, target medical imaging not limited to this.
Fig. 2 is the flow chart of the process carried out by control unit 37.In step s 201, medical imaging acquiring unit 41 According to the user operation being input into by operating unit 35, medical imaging is read from data base 22 via communication IF 31 and LAN 21.
In step S202, explain report acquisition unit 42 via communication IF 31 and LAN 21, from data base 22 obtain with The corresponding explanation report of the medical imaging that reads in step s 201.In this embodiment, in the following manner creating solution Release report and will explain that report is registered in data base 22.
Fig. 3 shows that explanation report creates picture 300, reports the example for creating picture as explaining.Figure shown in Fig. 3 As viewing area 310 represents the picture area for showing medical imaging.Note, for the doctor shown in image display area 310 With image, the various functions of perusing medical images device (zoom in/out function, concentration value translation function such as to whole image, Display location translation functions, figure describe function and concentration value measurement function etc.) it is available.Report display area 320 is The result that the medical imaging of user is explained is described as into the picture area of text.In the following, it is described that the text of explanation results will It is referred to as explaining text (annotation information).In figure 3, " solid nodules are observed in right lung S2 regions " and is described as be in report Explanation text in viewing area 320.Button 321 is concern position settings button.By select button 321, can arrange and work as Position (hereinafter referred to as paying close attention to position) when text is explained in description in the medical imaging of user's concern.By × represent symbol Numbers 311 show the concern position arranged by user.Note, it can be the pixel or voxel in image to pay close attention to position, Huo Zheke Being the region for including multiple pixels or voxel.Hereinafter, the position arranged by user or region are referred to as into region-of-interest.Note Meaning, when user is provided with concern position by operating input, can be by medical image system by set position of paying close attention to Information and the information with the corresponding region with regard to lesion in concern position, as region-of-interest information managing.
Will be described in explaining the example of report creation method.User reads medical imaging to be explained from data base 22, And including in image display area 310.Various functions of the user using perusing medical images device as above, in detail Observation medical imaging.User observes result described in report display area 320, used as explanation text.In figure 3, solve annotations Originally it is described as free text.It may, however, also be structured text.Then, user's select button 321 come arrange for explain The concern position of text.Concern position is set using 35 (not shown) of operating unit.For example, user is by using pointer device Concern position is clicked on, concern position is set.Concern position method to set up is certainly not limited to this, and any method is all available , as long as the positional information (hereinafter referred to as paying close attention to positional information) for paying close attention to position can be specified.Concern position Confidence breath is including the coordinate figure in such as medical imaging.In figure 3, symbol 311 is depicted on set concern position.So And, concern positional information is recorded in medical image display apparatus 10, it is not always necessary to which the symbol of position is paid close attention in description Number.Medical image display apparatus 10 will explain that text and concern positional information (or region-of-interest information) are stored in number in association According in storehouse 22.Therefore, in step S202, read and explain text and concern positional information, as explanation report.
In step S203, keyword extraction unit 43 passes through keyword match, from the explanation read in step S202 Text, extracts the keyword for pre-setting.In this embodiment, keyword is the character string for representing anatomic information, such as in doctor With the Organ naming shown in image.Example is brain, cerebellum, eyeball, nose, tooth, lung, bronchus, heart, liver, spleen, pancreas Dirty, stomach, large intestine, small intestinal, jejunum, ileum, rectum, prostate, uterus, forearm, upper arm, thigh, lower lower limb, breast, muscle, bone Bone, spinal column, celestial bone, coccyx and pelvis.Organ naming described here is only example certainly, the invention is not restricted to this.Close Key word is not limited to Organ naming, and can be arbitrary string, as long as the position in medical imaging can be specified.Under Face will describe as shown in Figure 3, " solid nodules are observed in right lung S2 regions " and be described as explaining the explanation text of report Example.In this case, " lung " is extracted as keyword.It is alternatively possible to arrange and extract tighter specify " right lung " of the position in medical imaging or " right lung S2 ".Note, here extracts keyword by keyword match, but Can also be extracted using additive method (such as known natural language processing).
In step S204, area acquisition unit 44 is extracted from the medical imaging for obtaining in step s 201 and in step The corresponding anatomic region of the keyword that extracts in S203, and the region is obtained as the region relevant with region-of-interest.Will The situation that " lung " in step S203 is extracted as keyword is described in, as an example.In this example, area acquisition unit 44 from Medical imaging obtains lung areas.More specifically, using smoothing filter, carry out from the medical imaging for obtaining in step s 201 Noise remove.Next, for the pixel value of medical imaging, using predetermined threshold (for example, HU values:- 200) carry out at binaryzation Reason, so as to medical imaging is separated into interior zone and perimeter.Using another threshold value (for example, HU values:- 500) will separate Interior zone be separated into lung areas and other regions, so as to extracting and obtaining lung areas.Note, at anatomic region extraction Reason only needs to extract predetermined region from the medical imaging for reading, and is not limited to the method.It is, for example possible to use other devices Official's dividing processing (such as pattern-cutting method) is extracting anatomic region.
In step S205, Overlapping display in the 45 pairs of medical imagings for reading in step s 201 of display location determining unit The some or all of display location of the character string of the explanation text read in being formed in step S202 is determined.In the reality Apply in example, viewing area is confirmed as not making the viewing area of explanation text overlap with anatomic region.Will be with reference to Fig. 4, Fig. 5 A, figure 5B, Fig. 5 C and Fig. 5 D describe display location and determine method.Medical imaging 410 shown in Fig. 4 is represented Medical imaging.In this example, medical imaging is axial direction (level) image shot by chest X-ray CT devices, and is cut Piece position is the position in step S202 arranging concern position.Hereinafter, the image at the slice position will be claimed To pay close attention to sectioning image.Dotted line 411 represents the boundary line between the lung field in medical imaging 410 and outside.Symbol 412 represents disease Change portion (tuberosity).Character string display region 420 represents the word of the explanation text (annotation information) read in being displayed in step S202 The region of some or all character strings (will hereinafter being referred to as showing character string) of symbol string (will hereinafter be referred to as character String viewing area).In this embodiment, character string display region 420 has predetermined size and shape.In this case, If there are many display character strings relative to character string display region, can show all in character string display region Display character string.In this case, as by represented by character string display region 421, it is possible to use scroll bar 422 is rolled It is dynamic to show character string.As, by represented by character string display region 423, shown, the font of character string can be changed in character String shows all of display character string in viewing area.It is alternatively possible to hide show character string in, word cannot be displayed on Character string in symbol string viewing area, or plucking for display character string can be automatically generated using known natural language processing Want and shown.
Character string display region 420 is described below and is applied situation about being displayed in medical imaging 410.Note, will say Bright following example, wherein, in step S203, " lung " is extracted as the keyword for explaining text, and obtains in step S204 Take the lung areas in medical imaging 410.
Display location determining unit 45 is based on predetermined condition (hereinafter referred to as display location determines condition), determines word The display location of symbol string viewing area 420.Display location will be given and determine that " whole character string display region is located at medical figure to condition As internal " and " character string display region is not overlapping with the inside in the region extracted based on the keyword for explaining text " show Example, is described.In this case, the display location of character string display region 420 is confirmed as inside medical imaging 410 And the region outside dotted line 411.Fig. 5 A, Fig. 5 B, Fig. 5 C and Fig. 5 D show the example of display location.In Fig. 5 A and Fig. 5 B, The display location of character string display region 420 is located inside medical imaging 410 and outside dotted line 411.Therefore, in Fig. 5 A and Fig. 5 B The display location of shown character string display region is qualified appropriate display location.In figure 5 c, character string display The display location in region 420 is located at outside dotted line 411, but is positioned partially at outside medical imaging 410.Therefore, shown in Fig. 5 C The display location of character string display region be ineligible unsuitable display location.In figure 5d, character string display The display location in region 420 is located inside medical imaging 410 and inside dotted line 411.Therefore, character string shown in Fig. 5 D shows The display location for showing region is ineligible unsuitable display location.
Only condition is determined by two above-mentioned display locations, it is impossible to uniquely determine the display position of character string display region Put.Therefore, in the above-mentioned example, the display location of character string display region can meet above-mentioned display location to determine Any position in the medical imaging of condition.In order to uniquely determine the display location of character string display region, it is additionally provided in Display locations such as " the distance between center of concern position and character string display region become most short " determines condition.Fig. 6 Show the example using medical imaging 410 and character string display region 420.The concern position that calculating is obtained in step S202 413 the distance between with the center 421 of character string display region 420.Character string display region 420 is displayed on such position Put, i.e. while meeting other display locations and determining condition, make the distance between center most short.
In step S206, in the character string of the explanation text that display processing unit 46 is obtained in being included within step S202 Some or all of character string display region, at the display location determined in step S205, superposition obtain in step s 201 In the medical imaging for taking.Display processing unit 46 carries out display control, with display unit 36 to be superimposed with including solution annotations The medical imaging of this character string display region is shown.
As described above, according to the medical image display apparatus 10 of the embodiment, being obtained in that following effect.That is, when will solution It is when some or all Overlapping displays in the character string of annotations sheet are in medical imaging, aobvious to determine according to the content for explaining text Show position.The area closely related with the content of text is explained of medical imaging is displayed in therefore, it is possible to avoid character string from being applied On domain.For this reason, even if when viewing is superimposed with the medical imaging of character string, also without prejudice to user confirms character string Content, and allow users to more easily grasp medical imaging and explain the corresponding relation between report.
If in conference system etc., the user in addition to exponent is then solved to removing with reference to report and medical imaging is explained For user beyond the person of releasing, it is generally difficult to understand the content for explaining report.Equally in this case, when the solution for explaining report Annotations sheet together with medical imaging, when being displayed at the overlapping position in not related to region-of-interest region, then except solution User beyond the person of releasing can more easily grasp medical imaging and explain the corresponding relation between report.In the present embodiment, Due to determining the display location of character string display region in the region by occupied by medical imaging, so explaining that text is shown Near the corresponding region of medical imaging, and can readily recognize between explanation text and the corresponding region of medical imaging Relation.
Note, in this embodiment, it is considered to do not make character string display region and and the concern of explanation text (annotation information) The related region in region overlaps.Have been described with including that the anatomic region of region-of-interest is acquired as the area related to region-of-interest The example in domain.However, relevant range not limited to this.That is, relevant range can be when browse explain text when be referred to, by The arbitrary portion region in the region occupied by subject in medical imaging.For example, when for right lung disease establishment explanation text When, when it is determined that explaining the display location of text, the region occupied by right lung open country not only can be considered, it is also contemplated that by can be with The region that related other organs (for example, left lung field and bronchus) of disease are occupied.For diseases such as the cancers that may be shifted Disease, the region that disease present in region-of-interest may be transferred to can be acquired as relevant range.Alternatively, away from concern position The scope of preset distance (for example, 10 centimetres) can be acquired as relevant range.
Additionally, according to the modification for explaining text (annotation information), display location determining unit 45 can change explanation text Character string display region display location, and display processing unit 46 can be shown after the change on display unit 36 The amended medical imaging for explaining text is superimposed with display location.Change explanation text when the modification according to explanation text Display location of the character string display region in medical imaging when, user always easily can grasp explanation text with it is corresponding Corresponding relation between the region of medical imaging of text is explained.
According to by area acquisition unit 44 from explaining extraction of the character string that includes of text to keyword, display processing list Unit 46 can show the part corresponding with the keyword in character string, to distinguish with other character strings.It is, for example possible to use The character color different from other parts or background color are showing the part corresponding with keyword.Under the part can be added Rule, shown using different fonts, or highlighting.This allows users to identify the pass for explaining that text includes at a glance Key word, and easily grasp the content for explaining text.
In this embodiment, it has been described that determine solution annotations based on the keyword of character string that text includes is explained The example of the display location of this character string display region.However, it is not necessary to the character for explaining text is always determined based on keyword The display location of string viewing area, as long as explaining that the character string display region of text is not overlapping with the relevant range of region-of-interest i.e. Can.For example, relevant range can be used as by the position acquisition anatomic region based on the region-of-interest in medical imaging, is determined Explain the display location of the character string display region of text.Alternatively, if anatomic region cannot be obtained based on character string, as In the case where explaining that text does not include keyword, anatomical area can be obtained based on the position of the region-of-interest in medical imaging Domain.Therefore, explain text can be shown as not with the case where key word is not used, with high probability with will be together with solution Annotations is originally overlapped by the anatomic region of reference together, and can more easily be grasped medical imaging and be explained right between report Should be related to.
The image file including the medical imaging for explaining text and display location information, display location information table can be created Show the display location of the character string display region determined by display location determining unit 45.Therefore, as long as device being capable of loading figure As file, even the device of the function not with the medical image display apparatus 10 according to the embodiment, it is also possible to read figure As file and it is output to display to show the relation between text and corresponding region explained.For example, the lattice of image file Formula can be DICOM.The information of the region-of-interest explanation text (annotation information) corresponding with region-of-interest and showing is explained The information of the viewing area of text (annotation information), is included in DICOM image files.Annotation information and the letter of viewing area Breath is retained as the data corresponding with the annotation of the GSPS for for example being defined by DICOM.It is in present condition that GSPS is gray scale soft copy The abbreviation of (Grayscale Softcopy Presentation State).Show that above-mentioned explanation text (annotation information) shows The information of the sectioning image in region is also included in DICOM image files.
The character string display region for explaining text can be moved according to the operation input of user.For example, it is assumed that being made that Character string display region (the first viewing area) is moved to overlapping with the relevant range of region-of-interest (the second viewing area) The operation input of position.In this case, the display location of at least one of the first viewing area and the second viewing area, It is confirmed as not making the first viewing area and the second viewing area overlap each other.This is prevented from the character string display for explaining text Region is overlapping with relevant range before and after the movement of character string display region of text is explained, and clearly can show Show medical imaging and explain the corresponding relation between text.
In the above-described embodiments, as will in step S203 from explain Text Feature Extraction keyword, pre-set expression The character string of anatomic information (Organ naming that such as will be shown in medical imaging).However, the keyword for pre-setting is not limited In this.For example, disease name, tuberosity, cancer, pneumonia, emphysema or mycobacterial diseaseses etc. can be set.
Here, the character string display region being described in reference picture 7A in the case that " tuberosity " is arranged to crucial word shows Location determining method.Medical imaging 410, dotted line 411 and black circle 412 in Fig. 7 A with it is identical shown in Fig. 4.
In step S202, " solid nodules are observed in right lung S2 regions " is acquired as explaining text.In step In S203, as " tuberosity " is arranged to crucial word, so from explanation Text Feature Extraction " tuberosity ".In step S204, from medical Image obtains the region of " tuberosity ".Processed by the region segmentation of pattern cut process etc., carry out the region of tuberosity Extract.
In step S205, such as in the above-described embodiments, display location determines that condition is arranged to " whole character string display Region is located inside medical imaging " and " character string display region not with the keyword based on explanation text and the region extracted It is internal overlapping ".In this case, the display location of character string display region is confirmed as inside medical imaging 410 and black circle Region outside 412.Condition is determined according to display location, different from above-described embodiment, display location can be located in dotted line 411 Portion or outside.In fig. 7, the display location of character string display region is located inside medical imaging 410 and outside black circle 412.Cause This, the display location of the character string display region shown in Fig. 7 A is qualified appropriate display location.
Reference picture 7B is described into another example, wherein, " pneumonia " is arranged to crucial word.Shadow region 414 in Fig. 7 B Represent the region that pneumonia image is extracted in medical imaging.In step S202, " interstitial pneumonia is observed at the back side of left lung Earlier picture " be acquired as explain text.In step S203, as " pneumonia " is arranged to crucial word, so from explanation Text Feature Extraction " pneumonia ".In step S204, the region of " pneumonia " is obtained from medical imaging.For example, by prestoring expression lung Scorching textured pattern, and the region with the textured pattern in medical imaging is extracted, extract the region of pneumonia.Also can By known method, the extraction process of the disease area with the specific pattern in organ is performed.In step S205, such as In the above-described embodiments, display location determine condition be arranged to " whole character string display region be located at medical imaging inside " and " character string display region is not overlapped with the inside in the region extracted based on the keyword for explaining text ".In this case, The display location of character string display region is confirmed as inside medical imaging 410 and the region outside shadow region 414.In Fig. 7 B In, the display location of character string display region is located inside medical imaging 410 and outside shadow region 414.Therefore, institute in Fig. 7 B The display location of the character string display region for showing is qualified appropriate display location.
As described above, when explanation text is shown as area not with the disease having based on keyword (such as disease name) When domain overlaps, the corresponding relation explained between text and the region-of-interest of medical imaging can be more easily grasped.Note, it is above-mentioned The keyword for pre-setting be only example, and be not limited to these examples.
In the above-described embodiments, in step S205, the aobvious of character string display region is determined only for concern sectioning image Show position.But, it might even be possible to display location is determined to the image at another slice position.Will be with reference to Fig. 8 descriptions even to another Image at one slice position determines the situation of the display location of character string display region.With reference to Fig. 8, reference 801 to 807 The medical imaging at slice position is represented, and image 804 is concern sectioning image.
Fig. 8 shows following example, wherein, to slice position the cutting in preset range with concern sectioning image Medical imaging at piece position, determines the display location of character string display region.Can use to for example " in concern sectioning image Slice position front and back in each on two slice positions " fixed value, determine preset range.This In the case of, the medical imaging to 802 to 806 place of slice position in Fig. 8 determines the display location of character string display region.Make For another example, can arrange and determine the aobvious of character string display region based on the size in the region extracted in step S204 Show the scope of the slice position of position.If more specifically, the size very little in the region extracted, arranges narrow scope.Such as The size in the region extracted by fruit is very big, then arrange wide scope.Alternatively, user can arrange scope manually.
Can use position is shown with the display location identical for character string display region is determined to paying close attention to sectioning image Determination condition is put, the display location of the character string display region at another slice position is determined.Word at each slice position Symbol string viewing area display location, can with concern sectioning image on it is identical.In this case, according to slice position, The intra-zone that character string display region is extracted in being displayed on step S204, so being unsatisfactory for display location determines bar Part.In this case, display location determine condition be arranged to " whole character string display region be located at medical imaging inside ", " character string display region is not overlapped with the inside in the region extracted based on the keyword for explaining text " and " display location pair All slice positions are identical ".Therefore, the display location of character string display region does not change between slice position, and can The region of the medical imaging closely related with the content of text is explained is avoided to be arranged to display location.
As described above, when medical imaging to be shown is included from multiple sectioning images that same subject is obtained, showing Position determination unit 45 is from the plurality of sectioning image, it is determined that showing the slice map of the character string display region for including explaining text Picture.Then, display processing unit 46 will include on the sectioning image determined by including the character string display region for explaining text. Therefore, according to the embodiment, due to being displayed in the character string shown in medical imaging at multiple slice positions, so user's energy Enough more easily identification strings.
In this embodiment, the explanation text that display processing unit 46 pairs is associated with region-of-interest, together with perpendicular to Shown together with each sectioning image of the predetermined distance interior presence of region-of-interest on the direction in the section of sectioning image. For this reason, even if disease is distributed in three dimensions, user also can easily grasp and explain text with the area with disease Corresponding relation between domain.
In the above-described embodiments, the position of the preferred coordinates in expression medical imaging is recorded and is used as explaining report Concern positional information.However, concern positional information not limited to this.For example, user can concern position be set to scope (under It is referred to as paying close attention to scope in text).More specifically, arranging ROI (Region Of Interest, region-of-interest) or VOI (Volume Of Interest, pay close attention to volume).
Reference picture 9A, Fig. 9 B and Fig. 9 C is described the example for arranging ROI.Medical imaging 410 in Fig. 9 A, Fig. 9 B and Fig. 9 C With dotted line 411 with it is identical in Fig. 4.ROI is set to by user with the concern scope for explaining that text is corresponding of medical imaging 415.Description character string display region display location in this case is determined into method.
The process of step S201 to S204 with it is identical in above-described embodiment.In figure 9 a, the display in step S205 Position determine condition be arranged to " whole character string display region be located at medical imaging inside " and " character string display region not with The inside of the concern band of position overlaps ".In this case, the display location of character string display region is confirmed as medical imaging Region inside 410 and outside ROI415.Different from above-described embodiment, display location can be located inside or outside dotted line 411. In figure 9 a, the display location of character string display region is located inside medical imaging 410 and outside ROI 415.Therefore, in Fig. 9 A The display location of shown character string display region is qualified appropriate display location.Note, if in step S205 In the condition that pre-sets do not use the information of the anatomic region in medical imaging, then as in figure 9 a, step can be omitted The process of S203 and S204.
Used as another example, it is as follows that the display location in step S205 determines that condition is set.That is, display location determines Condition is arranged to " whole character string display region is located inside medical imaging ", " does not explain with being based on character string display region The keyword of text and the inside in region extracted overlaps " and " character string display region inside not with the concern band of position It is overlapping ".In this case, the display location of character string display region 420 be confirmed as inside medical imaging 410, dotted line 411 Region outside outside and ROI 415.In figures 9 b and 9, the display location of character string display region be located at medical imaging 410 inside, Outside dotted line 411 and outside ROI 415.Therefore, the display location of the character string display region shown in Fig. 9 B is eligible Appropriate display location.According to above-mentioned condition, the edge at the edge and ROI of character string display region may be continuous, and can ROI can be difficult to see that.In this case, to determine that condition is set as follows for display location.That is, display location determines that condition is set Be set to " whole character string display region be located at medical imaging inside ", " character string display region not with based on the pass for explaining text Key word and the inside in region extracted overlaps " and " character string display region is located at outside the concern band of position with preset distance Portion ".The preset distance can be predefined or is arranged by user.In Fig. 9 C, the display location of character string display region is located at Inside medical imaging 410, outside dotted line 411 and with preset distance outside ROI 415.Therefore, the character string shown in Fig. 9 C The display location of viewing area is qualified appropriate display location.
When user be not by ROI but by VOI be set to pay close attention to scope when, can by with for ROI identical at Reason, determines the display location of character string display region in concern sectioning image.Such as in the above-described embodiments, when it is determined that predetermined model During the display location of the character string display region at multiple slice positions in enclosing, the slice position for arranging VOI can be set For scope.Reference picture 10A and Figure 10 B are described at multiple slice positions the situation for determining display location.Reference picture 10A and figure 10B, reference 1001 to 1007 represent the medical imaging at slice position, and image 1004 is concern sectioning image.Will Description VOI is arranged on the example in the medical imaging at 1003 to 1005 place of slice position.In this case, slice position 1003 to 1005 are arranged to scope.As another example, can be by the section position from the slice position in setting VOI slightly before Put, to the scope in the slice position slice position after a while for arranging VOI, be set to show the scope of character string display region. Figure 10 B show following example, wherein, by from second preceding slice position, to the slice position for arranging VOI One slice position is set to scope.In this case, slice position 1001 to 1006 is arranged to scope.
Figure 16 is the figure of the detailed display example for illustrating the image display area 310 shown in Fig. 3.In figure 16, pass through The method of reference picture 9C description, determines the display location of character string display region.
With reference to Figure 16, image display area 310 includes following subregion.Test list 1601 is in a listing format showing It is shown as the region of all tests (test of current and past) of the patient of current test target.Thumbnail list 1602 be with Thumbnail list form is showing the institute that includes of test selected by the test list that user is shown from test list 1601 There is the region of image.Each image that test includes can be a sectioning image or by multiple sectioning images are formed one be Row image (3D rendering).The image that thumbnail is created typically by a sectioning image is reduced.In order to by a series of images Thumbnail is created, the presentation graphics (for example, slice position is located at the sectioning image at center) in a series of images is contracted It is little.
Toolbar 1603 is the region for arranging and showing multiple buttons (icon).When pressing on user's select tools hurdle 1603 During button, function (for example, the change of image display format, graphic plotting or the character string display area for being associated with the button in advance is performed Draw in domain).Image/lookup (finding) shows that segment 1604 is that display image shows segment 1605 (being described later on), searches row The region of information list (CAD lists) 1607 is supported in table 1606 and diagnosis.
Can show according to user instruction that the image/lookup of to predetermined upper limit quantity shows segment 1604.Figure 16 show the example that 4 images/lookup display segment 1604 is shown with 2 × 2 layout patterns.Image shows that segment 1605 is aobvious Show the region of the image corresponding with the thumbnail selected by user.The image that image is shown in showing segment 1605, Neng Gougen The change to shown slice position, image translation/amplification/rotation or concentration value conversion etc. is experienced according to user instruction Operation.Furthermore it is possible to according to user instruction, carry out showing image the graphic plotting or figure of the image shown in segment 1605 Delete.In figure 16 in shown example, user draws the concern around image using the operating unit 35 of mouse etc. The oval logo in region (ROI).The method described using reference picture 9C is showing character string display region.User can use all The such as operating unit 35 of keyboard etc., be input into or editing character string viewing area in arbitrary string (will hereinafter be claimed To search).
It is to show that the image that shows is (to a series of in segment 1605 being displayed in image in a listing format to search list 1606 For image, be multiple sectioning images) on the region of all lookups arranged.When user selects to show in list 1606 is searched Any lookup when, be disposed with selected lookup sectioning image be displayed on image show segment 1605 in.CAD lists 1607 is to support what information acquisition unit (not shown) obtained by the diagnosis arranged in control unit 37 to show in a listing format The region of all diagnosis support information.Also diagnosis support information can be obtained for the ROI that specified by user, or can be by controlling The ROI testing equipments (not shown) arranged in unit processed 37 is obtaining.When user select show in CAD lists 1607 it is any During diagnosis support information, sectioning image present in the ROI corresponding with selected diagnosis support information is displayed on image In showing segment 1605.
As described above, in this embodiment, as the character string display region for explaining text is determined based on ROI or VOI Display location, so user can easily grasp explain between text and the region-of-interest in medical imaging corresponding closing System.
In the above-described embodiments, by medical imaging and the explanation report corresponding with medical imaging, determine that character string shows Show the display location in region.However, it is possible to by the medical imaging and the explanation corresponding with those medical imagings of multiple time points Report, determines the display location of character string display region.It is, for example possible to use the past medical imaging of same patient or solution Release report.
By with reference to Figure 11 and Figure 12 descriptions are by the medical imaging of multiple time points or explain report to determine character string display The situation of the display location in region.With reference to Figure 11, medical imaging (present image) 1110 is and the explanation text by user writing Corresponding medical imaging, and be displayed in character string display region 1100.Medical imaging (past image) 1120 be The image of the same patient that the time point before the shooting time of medical imaging 1110 shoots.Subtraction image 1130 is medical imaging Subtraction image between 1110 and medical imaging 1120.Can be by using such as FFD (Free-Form Deformation, Free Transform) etc. deformation registration process deformed between medical imaging 1110 and medical imaging 1120 Alignment, and carry out subtracting shadow process between the two images, generate subtraction image.Shadow region on subtraction image 1130 1131 is the region each with the difference between present image 1110 and past image 1120.Shadow region shown in Figure 12 1200 represent the position on the present image 1110 corresponding with the shadow region 1131 on subtraction image 1130.
In step s 201, read current medical imaging 1110.In step S202, sensing pin is created to medical imaging 1110 The explanation report built.The example being described below, wherein, created explanation report in explanation text be " compared with last time, Pulmonary module is increased as overall ", this is displayed in the character string display region 1100 shown in Figure 11.In step S203 In, " compared with last time ", " relative to before ", " compared with before " are pre-set to will be from the key for explaining Text Feature Extraction Word.In this case, as " compared with last time " is arranged to crucial word, so from explanation Text Feature Extraction " with last time phase Than ".Note, the above-mentioned keyword for pre-setting is only example, and if they be assumed to be it is medical with past The character string that image is compared, created in text is explained with the time by user, then be not limited to these examples.
In step S204, image 1120 in the past is read, and subtraction image 1130 is generated using said method.Acquisition has (for example, shadow region is 1131) not less than the region on the subtraction image of predetermined threshold to subtract shadow value.Can pre-set and subtract shadow value Threshold value, or user can arrange arbitrary value.In step S205, display location determines that condition is arranged to " whole character String viewing area be located at medical imaging inside " and " character string display region not with based on explanation text keyword and extract The inside in region overlaps ".In this case, the display location of character string display region is confirmed as in medical imaging 1110 Outside shadow region 1200 in portion and the present image 1110 corresponding with the position of the shadow region 1131 on subtraction image Region.In fig. 12, the display location of character string display region is located inside medical imaging 1110 and outside shadow region 1200 Portion.Therefore, the display location of the character string display region 1100 shown in Figure 12 is qualified appropriate display location.
As described above, in this embodiment, the subtraction image between medical imaging and another medical imaging, and base are obtained In the pixel value of subtraction image, it is determined that explaining the display location of the character string display region of text.Therefore, show for diagnosis Important region (for example, the part of disease extension), while present and the corresponding relation for explaining text, so as to promote doctor to make Diagnosis.
In the above-described embodiments, it is with predefined size and shape to describe the character string display region in step S205 The example in region.However, according to the display location of character string display region, the amount of character string to be shown, wanting Overlapping display Medical imaging, the region extracted etc., the size or shape of character string display region can be varied depending on.
Reference picture 13A, Figure 13 B and Figure 13 C is described to this.In step s 201, read medical imaging 1300. In step S202, the explanation report that sensing pin is created to medical imaging 1300.The example being described below, wherein, created Explain that the explanation text in report is " solid nodules to be observed in right lung S2 regions.Tuberosity has irregularly shaped and wraps Spike body (spicula) is included, pulmonary carcinoma is suspected first ", this is displayed in the character string display region 1302 shown in Figure 13 A. In step S203, from explanation Text Feature Extraction " lung " as keyword.In step S204, extract and close from medical imaging 1300 The corresponding lung areas 1301 of key word.In step S205, such as in the above-described embodiments, display location determines that condition is set For " whole character string display region be located at medical imaging inside " and " character string display region not with the key based on explanation text Word and the inside in region extracted overlaps ".
Figure 13 A show following example, wherein, due to character string display region 1302 very greatly, so in medical imaging In there is no the position for meeting that display location determines condition, and character string display region can not be adapted in medical imaging. In such a case, it is possible to there is no the region that can show character string display region to user's warning.Alternatively, such as by scheming Represented by character string display region 1303 shown in 13B, as the size of character string display region can be narrowed to Size, i.e. enable to meet display location and determine that the position of condition is present in medical imaging.In Figure 13 B, in character string The font size of the explanation text shown in viewing area is reduced, so as to include meeting aobvious character string display region 1303 Show that position is determined at the position of condition, and the immovable content for explaining text.
As another example, by the example shown in description Figure 13 C.In this case, in step S203, from explanation Text Feature Extraction " right lung " is used as keyword.In step S204, right lung region 1305 is extracted.In step S205, such as upper State in embodiment, display location determines that condition is arranged to " whole character string display region is located inside medical imaging " and " word Symbol string viewing area is not overlapped with the inside in the region extracted based on the keyword for explaining text ".In this example, with figure Character string display region 1302 shown in 13A is compared, and the character string display region 1304 shown in Figure 13 C is by changing its shape Shape, is displayed on and meets display location and determine at the position of condition.
According to the embodiment, the distribution of the relevant range included based on medical imaging changes character string display region Size or shape, so as to character string display region is included in medical imaging.Therefore, it is possible to amount or size with explanation text Independently, the corresponding relation explained between text and region-of-interest is shown.
In the above-described embodiments, obtain corresponding with the keyword extracted in step S203 in step S204 A region in medical imaging, and the region is determined into condition as display location in step S205.However, it is possible to correspondence The multiple regions in medical imaging are obtained in a keyword, and these regions are determined into condition as display location.
To determine with reference to Figure 14 and Figure 15.Figure 14 is illustrated that in step S203 from the default of explanation Text Feature Extraction Keyword and in step S204 corresponding to keyword obtain region between relation table information example figure.For example, With reference to Figure 14, if from Text Feature Extraction " brain " is explained as keyword in step S203, obtaining " big in step S204 Brain " region and " cerebellum " region.As another example, if from explanation Text Feature Extraction " lung " as crucial in step S203 Word, then obtain " right lung is wild " region, " left lung field " region and " bronchus " region in step S204.In the table information, with The associated character string of region-of-interest in the medical imaging of subject and represent anatomic region type character string, thus by It is associated with each other.
Figure 15 is shown when the extraction " lung " in step S203, and " right lung is wild " region, " a left side are obtained in step S204 When lung field " region and " bronchus " region, the example of character string display region is shown in medical imaging.More specifically, in step In rapid S201, medical imaging 1500 is read.In step S202, the explanation report that sensing pin is created to medical imaging 1500.Will The example being described as follows, wherein, the explanation text in the explanation report for being created is " reality knot to be observed in right lung S2 regions Section ", this is displayed in the character string display region 1504 shown in Figure 15.
In step S203, from explanation Text Feature Extraction " lung " as keyword.In step S204, take up a job as a doctor with reference to Figure 12 and use Image 1500 extracts the right lung region 1501 corresponding with keyword, left lung region 1502 and bronchiolar region 1503.In step In rapid S205, such as in the above-described embodiments, display location determines that condition is arranged to that " whole character string display region is located at medical Inside image ", " character string display region is not overlapped with the inside in region extracted based on the keyword for explaining text ".At this In the case of kind, the display location of character string display region 1504 is confirmed as inside medical imaging 1500, outside right lung region 1501 Region outside portion, left lung region 1502 and outside bronchiolar region 1503.In fig .15, the display position of character string display region Outside inside medical imaging 1500 and right lung region 1501, left lung region 1502 and bronchiolar region 1503.Therefore, scheme The display location of the character string display region 1504 shown in 15 is qualified appropriate display location.
In this embodiment, it is also contemplated that with the corresponding region of keyword explained in text in terms of dissection or medical science The closely related another region of aspect, determines the display location of character string display region.Therefore, user more easily can know Other text strings.
Note, explain that report can include the multiple region-of-interests in medical imaging and be associated with these region-of-interests Multiple explanations text (annotation information), and display location determining unit 45 can be directed to multiple explanation texts, it is determined that not each other The display location of overlapping character string display region.This makes it possible to multiple region-of-interests and corresponding explanation text (annotation Information) it is simultaneously displayed in a medical imaging and does not overlap.
In the above-described embodiments, in step S206, display processing unit 46 shows on display unit 36 and is superimposed upon doctor With the character string on image.However, it is possible to create and show the medical imaging that character string is embedded directly within.
The process of step S201 to S205 with it is identical in above-described embodiment.In step S206, the second medical figure is created Picture, wherein, some or all in the character string of the explanation text obtained in step S202 are embedded into and read in step s 201 At display location in the medical imaging for going out, determining in step S205.Second medical imaging is displayed on display unit 36 On.
As described above, in this embodiment, generation is disposed with explanation text at the display location of character string display region New medical imaging.New medical imaging is displayed on display unit 36, used as including the medical imaging for explaining text.Cause This, can show which medical imaging and explain the corresponding relation between text, without being superimposed on medical imaging such as character string On situation make explanation text overlay in relevant range.
In the above-described embodiments, the unit of medical image display apparatus 10 is realized by software in home environment.So And, following server-client system can be formed, wherein, the work(of the control unit 37 in medical image display apparatus 10 At least some in energy is performed using LAN by server.
For example, it is contemplated that the medical imaging acquiring unit 41 with big amount of calculation, explanation report acquisition unit 42, keyword Place's reason server of extraction unit 43, area acquisition unit 44 and display location determining unit 45 is realizing.Carry out to Family finally shows that the process of the display processing unit 46 of the process of medical imaging can be realized in client-side.More specifically, working as When client-side selects Case No from list (not shown), selected Case No is sent to server via LAN. In server side, medical imaging is obtained based on selected Case No and report is explained, and above-mentioned process is carried out with final It is determined that explaining the display location (step S201 to S205) of text.Next, medical imaging, explanation are reported, are explained by server Text is conciliate the display location of annotations sheet and is sent to client-side.In client-side, medical imaging is shown based on the content for sending Conciliate annotations sheet (step S206).
According to the embodiment, even if the computing resource very little on client-side, it is also possible to clearly illustrated using server Corresponding relation between medical imaging and explanation text.
As described above, in various embodiments of the present invention, obtain concern position in medical imaging or concern scope, with And for paying close attention to the explanation text (annotation information) of position or concern scope.Annotation information is determined based on the content of character string The display location of (character string etc.) in medical imaging.Character string display is existed based on the content of character string therefore, it is possible to work as Display location, and the display location by character string Overlapping display in medical imaging are determined when in medical imaging.Therefore, it is possible to Avoid to be superimposed upon in medical imaging at the important position in terms of dissection of character string, or in the position related to the content of character string The place of putting is superimposed upon in medical imaging.Therefore, it is possible to provide a kind of display and without prejudice to user confirms the content of character string Medical imaging Display Technique.
According to the present invention, user can more easily grasp medical imaging and explain the corresponding relation between report.
Other embodiment
(also can also more completely be referred to as " non-transitory computer can in storage medium by reading and performing record Read storage medium ") on computer executable instructions (for example, one or more programs) performing in above-described embodiment It is individual or more function and/or including for performing one of the one or more function in above-described embodiment Or the computer of the system or device of more circuits (for example, special IC (ASIC)), realize the enforcement of the present invention Example, and it is possible to can using the computer for for example being read by the computer by system or device and perform from storage medium Execute instruction is performing the one or more function in above-described embodiment and/or control one or more circuits Method to perform the one or more function in above-described embodiment, realizes embodiments of the invention.Computer can be with Including one or more processors (for example, CPU (CPU), microprocessing unit (MPU)), and can include dividing The computer opened or the network of separate processor, to read and perform computer executable instructions.Computer executable instructions Computer can be provided to from network or storage medium for example.Storage medium can include such as hard disk, random access memory Device (RAM), read only memory (ROM), the memorizer of distributed computing system, CD (such as compact disk (CD), digital universal CD (DVD) or Blu-ray Disc (BD)TM), one of flash memory device and storage card etc. or more.
Embodiments of the invention can also be realized by following method, i.e. by network or various storage mediums The software (program) of function for performing above-described embodiment is supplied to into system or device, the computer of the system or device or in The method that Central Processing Unit (CPU), microprocessing unit (MPU) read simultaneously configuration processor.
Although with reference to exemplary embodiment, invention has been described, but it is to be understood that the invention is not restricted to institute public The exemplary embodiment opened.Most wide explanation should be given to scope of the following claims, so which covers all these changes The 26S Proteasome Structure and Function of type example and equivalent.

Claims (24)

1. a kind of information processor, described information processing meanss include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to obtain the region related to the region-of-interest in the medical imaging;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, not make the annotation information The viewing area is overlapping with the relevant range;And
Display control unit, which is suitable to show includes the medical imaging of the annotation information so that on the display unit described The annotation information is shown at display location determined by viewing area.
2. information processor according to claim 1, wherein, the determining unit is repaiied according to the annotation information Change, change the display location of the viewing area, and
The display control unit will include the medical imaging of the annotation information, after being displayed in the change of the viewing area At display location.
3. information processor according to claim 1, wherein, the relevant range acquiring unit is obtained includes the pass Used as the relevant range, the anatomic region is the region that patient is occupied in the medical imaging to the anatomic region in note region Subregion.
4. information processor according to claim 3, wherein, the relevant range acquiring unit is also obtained and the solution Other related anatomic regions of region are cutd open as the relevant range.
5. information processor according to claim 3, wherein, the relevant range acquiring unit is based on the annotation letter Breath, obtains the anatomic region as the relevant range.
6. information processor according to claim 5, wherein, the relevant range acquiring unit is from the annotation information The text string extracting keyword for including, and the anatomic region is obtained based on the keyword.
7. information processor according to claim 6, wherein, the relevant range acquiring unit is based on table acquisition of information The anatomic region is associated with the character string and the solution of the region-of-interest in the table information as the relevant range The type for cuing open region is associated with each other.
8. information processor according to claim 6, wherein, according to by the relevant range acquiring unit from the note Extraction of the character string that the information of releasing includes to the keyword, the display control unit will be corresponding with the keyword Part is shown in the way of being distinguished with other character strings.
9. information processor according to claim 6, wherein, the relevant range acquiring unit extracts Organ naming And/or disease name is used as the keyword.
10. information processor according to claim 3, wherein, the relevant range acquiring unit is based on described medical The position of the region-of-interest in image, obtains the anatomic region.
11. information processors according to claim 10, wherein, in the character string included based on the annotation information In the case of the anatomic region cannot be obtained, the relevant range acquiring unit based on the medical imaging in the concern The position in region, obtains the anatomic region.
12. information processors according to claim 1, wherein, medical imaging to be shown includes from same patient obtaining The multiple sectioning images for taking,
The determining unit is also from the plurality of sectioning image, it is determined that the sectioning image that will be shown together with the annotation information, And
The display control unit includes the annotation information in the viewing area of sectioning image determined by.
13. information processors according to claim 1, wherein, medical imaging to be shown includes from same patient obtaining The multiple sectioning images for taking, and
The annotation information that the display control unit will be associated with the region-of-interest, together with perpendicular to the sectioning image Section direction on each sectioning image for existing in the region-of-interest preset distance show together.
14. information processors according to claim 1, described information processing meanss also include image acquisition unit, institute State image acquisition unit to be suitable to obtain the subtraction image between the medical imaging and other medical imagings,
Wherein, pixel value of the determining unit based on the subtraction image, determines the display location of the viewing area.
15. information processors according to claim 1, wherein, the determining unit determines the institute of the viewing area State display location so that the display location is included in the region occupied by the medical imaging.
16. information processors according to claim 1, described information processing meanss also include signal generating unit, the life It is suitable to generate into unit and the note is disposed with the viewing area shown by the display location determined by the determining unit The new medical imaging of information is released,
Wherein, the display control unit shows the new medical imaging, used as the medical imaging including the annotation information.
17. information processors according to claim 1, described information processing meanss also include creating unit, the wound Build unit to be suitable to create the image file of medical imaging, described image file includes the annotation information and represents by described true The area information of the viewing area that order unit determines.
18. information processors according to claim 1, wherein, during the report information includes the medical imaging Multiple region-of-interests and with the associated plurality of annotation information of the region-of-interest, and
Viewing area of the determining unit for the plurality of annotation information, it is determined that the display location not overlapped each other.
19. information processors according to claim 1, described information processing meanss also include mobile unit, the shifting Moving cell is suitable to be input into according to the operation of user, the viewing area of the movement annotation information,
Wherein, in the situation for being made that the operation input that the first viewing area is moved to the position overlapped with the second viewing area Under, the determining unit determines the display location of at least one of first viewing area and second viewing area, First viewing area and second viewing area is not made to overlap each other.
A kind of 20. information processors, described information processing meanss include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to the character string included based on the annotation information, obtains in the medical imaging Relevant range;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information The viewing area and the relevant range it is overlapping;And
Display control unit, which is suitable to show the medical imaging for including the annotation information so that the annotation information is shown At display location determined by the viewing area on the display unit.
A kind of 21. information processing systems, described information processing system include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to obtain the region related to the region-of-interest in the medical imaging;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information The viewing area and the relevant range it is overlapping;And
Display control unit, which is suitable to show the medical imaging for including the annotation information so that the annotation information is shown At display location determined by the viewing area on the display unit.
A kind of 22. information processing systems, described information processing system include:
Report acquisition unit, its be suitable to obtain report information, the report information include the region-of-interest in medical imaging and with The associated annotation information of the region-of-interest;
Relevant range acquiring unit, which is suitable to the character string included based on the annotation information, obtains in the medical imaging Relevant range;
Determining unit, which is adapted to determine that the display location of the viewing area of the annotation information, so as not to make the annotation information The viewing area and the relevant range it is overlapping;And
Display control unit, which is suitable to show includes the medical imaging of the annotation information so that on the display unit described The annotation information is shown at display location determined by viewing area.
A kind of 23. information processing methods, described information processing method include:
By report acquisition unit obtain report information, the report information include the region-of-interest in medical imaging and with the pass The associated annotation information in note region;
The region related to the region-of-interest in the medical imaging is obtained by relevant range acquiring unit;
The display location of the viewing area of the annotation information is determined by determining unit, so as not to make described in the annotation information Viewing area is overlapping with the relevant range;And
Medical imaging including the annotation information is shown by display control unit so that the viewing area on the display unit The annotation information is shown at display location determined by domain.
A kind of 24. information processing methods, described information processing method include:
By report acquisition unit obtain report information, the report information include the region-of-interest in medical imaging and with the pass The associated annotation information in note region;
The character string included based on the annotation information by relevant range acquiring unit, obtains the correlation in the medical imaging Region;
The display location of the viewing area of the annotation information is determined by determining unit, so as not to make described in the annotation information Viewing area is overlapping with the relevant range;And
Medical imaging including the annotation information is shown by display control unit so that the viewing area on the display unit The annotation information is shown at display location determined by domain.
CN201610807491.XA 2015-09-09 2016-09-07 Information processing unit, information processing method Active CN106529115B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2015177914 2015-09-09
JPJP2015-177914 2015-09-09
JPJP2016-080480 2016-04-13
JP2016080480A JP6827706B2 (en) 2015-09-09 2016-04-13 Information processing equipment and its methods, information processing systems, computer programs

Publications (2)

Publication Number Publication Date
CN106529115A true CN106529115A (en) 2017-03-22
CN106529115B CN106529115B (en) 2019-10-15

Family

ID=58319786

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610807491.XA Active CN106529115B (en) 2015-09-09 2016-09-07 Information processing unit, information processing method

Country Status (2)

Country Link
JP (1) JP6827706B2 (en)
CN (1) CN106529115B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109461494A (en) * 2018-10-29 2019-03-12 北京青燕祥云科技有限公司 A kind of RIS platform and image assistant diagnostic system example method of data synchronization
CN109637628A (en) * 2017-10-06 2019-04-16 佳能株式会社 Information processing unit, method and non-transient computer-readable storage media
CN111627508A (en) * 2020-04-29 2020-09-04 数坤(北京)网络科技有限公司 Medical image reading method and device and computer readable medium
CN111681739A (en) * 2020-06-15 2020-09-18 杭州依图医疗技术有限公司 Pathological information display method and computer-readable storage medium
CN112562042A (en) * 2020-12-24 2021-03-26 凌云光技术股份有限公司 Display method and device for editing and analyzing image detection text in real time

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6987551B2 (en) * 2017-07-03 2022-01-05 キヤノンメディカルシステムズ株式会社 Medical image processing equipment
JP7086630B2 (en) * 2018-02-09 2022-06-20 キヤノン株式会社 Information processing equipment, information processing methods, and programs
JP7171271B2 (en) * 2018-07-04 2022-11-15 キヤノンメディカルシステムズ株式会社 Medical information display device
WO2020105415A1 (en) * 2018-11-23 2020-05-28 富士フイルム株式会社 Medical information display device, method, and program, and graphic user interface for displaying medical information
KR102216697B1 (en) * 2020-02-28 2021-02-17 주식회사 루닛 Medical image apparatus and method for processing medical image
JP7394959B2 (en) * 2020-03-05 2023-12-08 富士フイルム株式会社 Medical image processing device, medical image processing method and program, medical image display system
WO2022070528A1 (en) * 2020-09-29 2022-04-07 富士フイルム株式会社 Medical image processing device, method, and program
JP7418018B2 (en) * 2021-11-12 2024-01-19 iSurgery株式会社 Diagnostic support equipment and computer programs
WO2023199957A1 (en) * 2022-04-12 2023-10-19 富士フイルム株式会社 Information processing device, information processing method, and information processing program

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050107690A1 (en) * 2003-11-13 2005-05-19 Konica Minolta Medical & Graphic, Inc. Medical image interpretation system and interpretation report generating method
JP2006255021A (en) * 2005-03-15 2006-09-28 Toshiba Corp Image display device and method
CN101053521A (en) * 2006-04-12 2007-10-17 株式会社东芝 Medical image display apparatus
WO2011033769A1 (en) * 2009-09-17 2011-03-24 富士フイルム株式会社 Medical image display device, method, and program
CN103941855A (en) * 2013-01-22 2014-07-23 株式会社东芝 Medical image reference apparatus and method
CN104011787A (en) * 2011-12-26 2014-08-27 佳能株式会社 Image processing apparatus, control method for the same, image processing system, and program
CN104281683A (en) * 2014-09-30 2015-01-14 深圳华声医疗技术有限公司 Medical image retrieval method and medical image sharing method
CN104584018A (en) * 2012-08-22 2015-04-29 皇家飞利浦有限公司 Automatic detection and retrieval of prior annotations relevant for imaging study for efficient viewing and reporting

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5987345A (en) * 1996-11-29 1999-11-16 Arch Development Corporation Method and system for displaying medical images
JP4897293B2 (en) * 2006-01-11 2012-03-14 株式会社日立メディコ Medical image display device
JP2007282771A (en) * 2006-04-14 2007-11-01 Konica Minolta Medical & Graphic Inc Medical information processor, and program
JP2009018048A (en) * 2007-07-12 2009-01-29 Fujifilm Corp Medical image display, method and program
JP5062477B2 (en) * 2007-11-20 2012-10-31 よこはまティーエルオー株式会社 Medical image display device
JP5317558B2 (en) * 2008-07-07 2013-10-16 株式会社東芝 Medical information creation device
JP2010057902A (en) * 2008-08-06 2010-03-18 Toshiba Corp Report generation support apparatus, report generation support system, and medical image referring apparatus
JP5203858B2 (en) * 2008-09-01 2013-06-05 富士フイルム株式会社 MEDICAL IMAGE DISPLAY DEVICE, MEDICAL IMAGE DISPLAY METHOD, AND MEDICAL IMAGE DISPLAY PROGRAM
JP2010057684A (en) * 2008-09-03 2010-03-18 Fujifilm Corp Medical image display, medical image displaying method, and medical image displaying program
JP5624308B2 (en) * 2008-11-21 2014-11-12 株式会社東芝 Image processing apparatus and image processing method
JP5455470B2 (en) * 2009-07-02 2014-03-26 株式会社東芝 Medical image interpretation system
JP5523891B2 (en) * 2009-09-30 2014-06-18 富士フイルム株式会社 Lesion region extraction device, its operating method and program
JP2012040044A (en) * 2010-08-12 2012-03-01 Toshiba Corp Medical image display device
WO2012049741A1 (en) * 2010-10-13 2012-04-19 株式会社日立製作所 Medical image display device, medical information management server
JP5644607B2 (en) * 2011-03-17 2014-12-24 富士通株式会社 Information providing program, information providing apparatus, and information providing method
JP5746908B2 (en) * 2011-05-06 2015-07-08 株式会社東芝 Medical image processing device
WO2013001678A1 (en) * 2011-06-30 2013-01-03 パナソニック株式会社 Apparatus for searching for analogous cases and apparatus for preparing relevance database, as well as method for searching for analogous cases and method for preparing relevance database
WO2013076930A1 (en) * 2011-11-25 2013-05-30 パナソニック株式会社 Medical image compression device, medical image compressing method, and prediction knowledge database creation device
JP6080249B2 (en) * 2012-09-13 2017-02-15 富士フイルム株式会社 Three-dimensional image display apparatus and method, and program
WO2014053986A2 (en) * 2012-10-01 2014-04-10 Koninklijke Philips N.V. Multi-study medical image navigation
JP2015095050A (en) * 2013-11-11 2015-05-18 株式会社東芝 Radiograph interpretation report creation device
JP6595193B2 (en) * 2014-03-11 2019-10-23 キヤノンメディカルシステムズ株式会社 Interpretation report creation device and interpretation report creation system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050107690A1 (en) * 2003-11-13 2005-05-19 Konica Minolta Medical & Graphic, Inc. Medical image interpretation system and interpretation report generating method
JP2006255021A (en) * 2005-03-15 2006-09-28 Toshiba Corp Image display device and method
CN101053521A (en) * 2006-04-12 2007-10-17 株式会社东芝 Medical image display apparatus
WO2011033769A1 (en) * 2009-09-17 2011-03-24 富士フイルム株式会社 Medical image display device, method, and program
CN102497805A (en) * 2009-09-17 2012-06-13 富士胶片株式会社 Medical image display device, method, and program
CN104011787A (en) * 2011-12-26 2014-08-27 佳能株式会社 Image processing apparatus, control method for the same, image processing system, and program
CN104584018A (en) * 2012-08-22 2015-04-29 皇家飞利浦有限公司 Automatic detection and retrieval of prior annotations relevant for imaging study for efficient viewing and reporting
CN103941855A (en) * 2013-01-22 2014-07-23 株式会社东芝 Medical image reference apparatus and method
CN104281683A (en) * 2014-09-30 2015-01-14 深圳华声医疗技术有限公司 Medical image retrieval method and medical image sharing method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109637628A (en) * 2017-10-06 2019-04-16 佳能株式会社 Information processing unit, method and non-transient computer-readable storage media
CN109461494A (en) * 2018-10-29 2019-03-12 北京青燕祥云科技有限公司 A kind of RIS platform and image assistant diagnostic system example method of data synchronization
CN111627508A (en) * 2020-04-29 2020-09-04 数坤(北京)网络科技有限公司 Medical image reading method and device and computer readable medium
CN111627508B (en) * 2020-04-29 2021-05-11 数坤(北京)网络科技有限公司 Medical image reading method and device and computer readable medium
CN111681739A (en) * 2020-06-15 2020-09-18 杭州依图医疗技术有限公司 Pathological information display method and computer-readable storage medium
CN112562042A (en) * 2020-12-24 2021-03-26 凌云光技术股份有限公司 Display method and device for editing and analyzing image detection text in real time

Also Published As

Publication number Publication date
JP2017051591A (en) 2017-03-16
CN106529115B (en) 2019-10-15
JP6827706B2 (en) 2021-02-10

Similar Documents

Publication Publication Date Title
CN106529115B (en) Information processing unit, information processing method
US10460838B2 (en) Automated anatomically-based reporting of medical images via image annotation
CN105167793B (en) Image display device, display control unit and display control method
US10181187B2 (en) Information processing apparatus, method thereof, information processing system, and computer-readable storage medium that display a medical image with comment information
CN106560827B (en) Control method
US8625867B2 (en) Medical image display apparatus, method, and program
US10282840B2 (en) Image reporting method
US20180060535A1 (en) Updating probabilities of conditions based on annotations on medical images
EP3100209B1 (en) Extraction of information from an image and inclusion thereof in a clinical report
RU2493593C2 (en) Method of extracting data from set of data of medical images
US10729396B2 (en) Tracking anatomical findings within medical images
CN110050281A (en) Learn the annotation of the object in image
US20190150870A1 (en) Classification of a health state of tissue of interest based on longitudinal features
CN112885453A (en) Method and system for identifying pathological changes in subsequent medical images
JP6824845B2 (en) Image processing systems, equipment, methods and programs
KR20150125436A (en) Apparatus and method for providing additional information according to each region of interest
US8238999B2 (en) Method for display of at least one medical finding
US20180060488A1 (en) Customizing annotations on medical images
US20180064409A1 (en) Simultaneously displaying medical images
US20180060534A1 (en) Verifying annotations on medical images using stored rules
JP2017534316A (en) Image report annotation identification
CN106250665A (en) Information processor, information processing method and information processing system
CN107632997B (en) Determining a group of images from a set of signatures
JP6797858B2 (en) Medical image display device, display control device and display control method, program
US20230410305A1 (en) Information management apparatus, method, and program and information processing apparatus, method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant