JP7317528B2 - Image processing device, image processing system and control method - Google Patents

Description

The present invention relates to an image processing device, an image processing system, a control method, a program, and a recording medium.

When a person or animal is lying down, pressure is applied to the contact area between the contact surface and the body due to the weight of the person or animal. A patient who develops a pressure ulcer needs to take pressure ulcer care such as body pressure redistribution care and skin care, and to evaluate and manage the pressure ulcer regularly.

Non-Patent Document 1 proposes DESIGN-R (registered trademark) as a pressure ulcer evaluation tool developed by the Japanese Society of Pressure Ulcers Science and Education Committee. Currently, the size evaluation of pressure ulcers is often determined based on values manually measured by applying a measuring tape to the affected area. Specifically, first, two points with the longest linear distance in the damaged area of the skin are measured, and these points are taken as the major axis. Further, the length perpendicular to the major axis is defined as the minor axis, and the value obtained by multiplying the major axis by the minor axis is defined as the size of the pressure ulcer.

Shorinsha Pressure Ulcer Guidebook 2nd Edition Compliant with Pressure Ulcer Prevention and Management Guidelines (4th Edition) Edited by The Japanese Society of Pressure Ulcers ISBN13 978-4796523608 Page 23

Manual Size evaluation of pressure ulcers often has a complex shape, so it is necessary to adjust how the measure is applied. For such a problem, it is conceivable to evaluate the size of the pressure ulcer based on the image of the pressure ulcer.

However, since the patient's posture and the orientation of the imaging device held by the photographer are not constant each time the pressure ulcer is photographed, the orientation of the pressure ulcer in the photographed image is also not constant. Therefore, when progress comparison is performed using captured images of decubitus ulcers, it is difficult to compare progress simply by displaying the captured images.
SUMMARY OF THE INVENTION The present invention has been made in view of the problems described above, and an object of the present invention is to facilitate comparison of a plurality of images of an affected area.

The image processing apparatus of the present invention comprises: acquisition means for acquiring a plurality of images of an affected area; and control means for controlling to rotate an image, wherein the reference line is the major axis of the affected area, and the control means controls the rotation of the first image among the plurality of images. Rotating the first image so that the slope of the major axis of the affected area matches the slope of the major axis of the affected area in the plurality of remaining images that are different from the first image among the plurality of images. It is characterized in that control is performed so that the remaining plurality of images are rotated without being rotated .

ADVANTAGE OF THE INVENTION According to this invention, the several image which image|photographed the affected part can be easily compared.

2 is a diagram showing the hardware configuration of an image processing system; FIG. 1 is a diagram showing an outline of an image processing system; FIG. 4 is a flowchart showing processing of the image processing system; FIG. 4 is a diagram for explaining a method of superimposing information on an image of an affected area; It is a figure which shows the image which image|photographed the pressure ulcer of the same patient. 4 is a flowchart showing processing of the image processing system; FIG. 11 is a diagram showing a display example of a patient name list; FIG. 4 is a diagram showing a display example of an image of a pressure ulcer; It is a figure which shows the image which image|photographed the pressure ulcer of the same patient. 4 is a flowchart showing processing of the image processing system; FIG. 4 is a diagram showing a display example of an image of a pressure ulcer; 4 is a flowchart showing processing of the image processing system; FIG. 4 is a diagram showing a display example of an image of a pressure ulcer; It is a figure which shows the example of a display which designates a major axis. It is a figure which shows the image which image|photographed the pressure ulcer of the same patient. It is a figure which shows the example of a display which designates a reference line.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments according to the present invention will be described with reference to the drawings.
<First embodiment>
In this embodiment, an image of a pressure ulcer captured by an imaging device is transmitted to the management server for management by the management server. A case of browsing with is explained as an example.

FIG. 2 is a diagram schematically showing an example of the configuration of an image processing system.
The image processing system has an imaging device 100 , an image processing device 120 , a management server 130 and an image viewing device 140 .
The imaging device 100 images a pressure ulcer 202 that is an affected part of a patient 201 . The image processing device 120 analyzes the pressure ulcer 202 included in the image transmitted from the imaging device 100 and transmits the analysis result to the imaging device 100 . The imaging device 100 displays the analysis results transmitted from the image processing device 120 . The image captured by the imaging device 100 is finally transmitted to the management server 130 and stored in the management server 130 in association with the information of the barcode tag 203 attached to the patient 201 . The stored images of the pressure ulcer 202 can be viewed from the image viewing device 140 .

FIG. 1 is a diagram showing an example of each hardware configuration of an image processing system.
The imaging device 100 captures an image of the affected area and transmits the captured image to the image processing device 120 .
The imaging device 100 has an optical system 101 , an imaging device 102 , a CPU 103 , a primary storage device 104 , a secondary storage device 105 , a recording medium 106 , a display section 107 , an operation section 108 , a communication device 109 and a distance measurement section 110 .
The optical system 101 has a lens, a shutter, and an aperture, and forms an image of the light from the subject on the imaging device 102 with an appropriate amount and timing. The imaging element 102 converts the light imaged through the optical system 101 into an image. The CPU 103 performs various calculations and controls each unit that configures the imaging apparatus 100 according to the input signals and programs.

The primary storage device 104 stores temporary data and is used for work by the CPU 103 . The secondary storage device 105 stores a program (firmware) for controlling the imaging device 100, various setting information, and the like. A recording medium 106 records captured images. For example, an SD card or a CF card can be used as the recording medium 106 . A display unit 107 displays captured images and live view images. The operation unit 108 accepts the operations of the photographer. The communication device 109 communicates with the image processing device 120 . The communication device 109 is, for example, a wireless LAN.

A distance measurement unit 110 calculates distance information from the imaging device 100 to a subject. As the distance measuring unit 110, a general phase-difference distance measuring sensor mounted on a single-lens reflex camera may be used, or a system using a TOF (Time Of Flight) sensor may be used. A TOF sensor is a sensor that measures the distance to an object based on the time difference (or phase difference) between the transmission timing of an irradiation wave and the reception timing of a reflected wave, which is a wave of the irradiation wave reflected by the object. be. Furthermore, the distance measuring unit 110 may employ a PSD method or the like using a PSD (Position Sensitive Device) as a light receiving element. In addition, the image sensor 102 has a plurality of photoelectric conversion regions for each pixel, and the pupil positions corresponding to the plurality of photoelectric conversion regions included in a common pixel are made different. By adopting such a configuration, the distance measurement unit 110 can determine the position of each pixel or region based on the phase difference between the images obtained from the photoelectric conversion regions corresponding to the respective pupil regions output from the image sensor 102. can obtain distance information.

The distance measurement unit 110 may be configured to obtain distance information in one or a plurality of predetermined distance measurement areas within an image. may be configured to obtain a distance map showing Further, the distance measuring unit 110 extracts and integrates high-frequency components from the image, performs TV-AF or contrast AF for determining the position of the focus lens where the integrated value is maximum, and obtains distance information from the position of the focus lens. You can get it.

The image processing device 120 analyzes the image of the affected area transmitted from the imaging device 100 .
The image processing device 120 has a CPU 121 , a primary storage device 122 , a secondary storage device 123 and a communication device 124 . The CPU 121 performs various calculations and controls each part of the image processing apparatus 120 according to the input signals and the programs stored in the secondary storage device 123 . The primary storage device 122 stores temporary data and is used for work by the CPU 121 . The primary storage device 122 also stores programs read from the secondary storage device 123 . The secondary storage device 123 stores programs executed by the CPU 121 . A hard disk or the like can be used as the secondary storage device 123 . The communication device 124 communicates with the imaging device 100 and the management server 130 . The communication device 124 not only transmits and receives images, but also transmits analysis results.

The management server 130 stores the image of the affected area captured by the imaging device 100 and the analysis result analyzed by the image processing device 120 . Data stored in the management server 130 can be viewed from the image viewing device 140 using a browser or a dedicated application. A plurality of image browsing devices 140 may exist for one management server 130 . The management server 130 also performs image processing such as rotating the image of the affected area. Therefore, the management server 130 also functions as an image processing device.
The management server 130 has a CPU 131 , a primary storage device 132 , a secondary storage device 133 and a communication device 134 . The CPU 131 performs various calculations and controls each part of the management server 130 according to the input signals and the programs stored in the secondary storage device 133 . The CPU 131 corresponds to one example of acquisition means, control means, setting means, and transmission means. The primary storage device 132 stores temporary data and is used for work by the CPU 131 . The primary storage device 132 also stores programs read from the secondary storage device 133 . The secondary storage device 133 stores programs executed by the CPU 131 . A hard disk or the like can be used as the secondary storage device 133 . A communication device 134 communicates with the image processing device 120 and the image viewing device 140 .

The image browsing device 140 allows the user to browse the images of the affected area and the analysis results stored in the management server 130 . A smartphone, a tablet terminal, a PC, or the like can be used as the image browsing device 140 .
The image browsing device 140 has a CPU 141 , a primary storage device 142 , a secondary storage device 143 , a communication device 144 , a display section 145 and an operation section 146 .
The CPU 141 performs various calculations and controls each part of the image browsing device 140 according to the input signals and the programs stored in the secondary storage device 143 . The CPU 141 corresponds to an example of acquisition means and display means. The primary storage device 142 stores temporary data and is used for work by the CPU 141 . The primary storage device 142 also stores programs read from the secondary storage device 143 . The secondary storage device 143 stores programs executed by the CPU 141 . A hard disk or the like can be used as the secondary storage device 143 . A communication device 144 communicates with the management server 130 . The display unit 145 displays an image of the affected area and analysis results. The operation unit 146 accepts selection of a patient to be viewed by the user and selection of an image to be viewed by the user. The operation unit 146 can use buttons, switches, a touch panel that is also used as the display unit 145, or the like.

Note that the management server 130 may be shared with the image processing apparatus 120 . In this case, the functions of the management server 130 are performed by the image processing apparatus 120 .
Also, the image processing system may be configured without both the image processing apparatus 120 and the management server 130 . In this case, the functions of the image processing device 120 and the management server 130 can be realized by the imaging device 100. FIG.

FIG. 3 is a flow chart showing an example of processing of the image processing system. The flowchart shown in FIG. 3 is for analyzing the pressure ulcer image captured by the imaging device 100 by the image processing device 120, displaying the analysis result on the imaging device 100, and registering the image and the analysis result on the management server 130. processing. The flowchart in FIG. 3 starts when the imaging device 100 and the image processing device 120 are connected to a Wi-Fi standard network, which is a wireless LAN standard.

In S330, the CPU 121 of the image processing device 120 performs search processing for the imaging device 100 to be connected.
In S300, the CPU 103 of the imaging device 100 performs response processing to the search processing. Note that UPnP (Universal Plug and Play) is used as a technique for searching for devices via a network. In UPnP, individual devices are identified by UUID (Universally Unique Identifier).

In S301, the CPU 103 of the imaging device 100 sets the shooting mode to the tag shooting mode. The tag imaging mode is a mode for imaging a barcode tag for identifying a patient in order to associate the image of the decubitus ulcer with the identification information of the patient. In this embodiment, as shown in FIG. 2, a barcode tag 203 containing the patient ID of the patient 201 is photographed. By photographing the barcode tag and identifying the patient ID before taking the image of the pressure ulcer, the image of the pressure ulcer can be managed in association with the identification information of the patient. After the tag photographing mode is set, the CPU 103 photographs the barcode tag according to the photographing instruction from the photographer, and stores the photographed image of the tag in the primary storage device 104 or the secondary storage device 105 .

In S302, the CPU 103 starts live view processing. By starting the live view process, images being captured are displayed continuously on the display unit 107 .
In S303, the CPU 103 starts AF processing. Specifically, the CPU 103 obtains distance information to the subject from the distance measuring unit 110 by any of the methods described above, and starts AF processing for controlling the optical system 101 so as to bring the subject into focus. When the focus position is adjusted by TV-AF or contrast AF, distance information from the position of the optical system 101 in the focused state to the focused subject is obtained. The position to be focused may be the subject positioned in the center of the image, or the subject positioned closest to the imaging device 100 . When a distance map of the subject is obtained, the area to be noticed may be estimated from the distance map and focused on that position. Further, when the position of the affected area in the live view image has already been specified by the image processing device 120, the focus may be adjusted to that position. The imaging apparatus 100 repeatedly performs AF processing while displaying a live view image until the release button is pressed in S310, which will be described later.

In S304, the CPU 103 performs image development and compression processing on any image of the live view image to generate, for example, a JPEG standard image. Further, the CPU 103 performs resizing processing on the compressed image to reduce the size of the image.
In S305, the CPU 103 acquires the distance information obtained in S303 and the resized image generated in S304. Further, the CPU 103 acquires information on the zoom magnification and information on the size (the number of pixels) of the image after resizing processing, if necessary.
In S<b>306 , the CPU 103 transmits distance information and one or more pieces of information including the image after resizing to the image processing apparatus 120 .

Next, the processing by the image processing device 120 is performed.
In S<b>341 , the CPU 121 receives distance information transmitted from the imaging device 100 and one or more information including an image. CPU 121 stores the received distance information and image in primary storage device 104 .
In S342, the CPU 121 extracts the affected area from the received image. Semantic segmentation by deep learning is used as a method for extracting the affected area. That is, a high-performance computer for learning is made to learn a neural network model in advance using a plurality of actual images of the affected area of the decubitus as teaching data, thereby generating a trained model. The CPU 121 estimates the pressure ulcer area from the image based on the learned model. As an example of a neural network model, a fully convolutional network (FCN), which is a segmentation model using deep learning, can be applied. Inference by deep learning is processed by high-performance computers that excel at parallel execution of sum-of-products operations. However, inference by deep learning may be executed by FPGA, ASIC, or the like. Note that region division may be realized using other deep learning models. Also, the segmentation method is not limited to deep learning, and graph cut, region growth, edge detection, rule division method, etc., may be used, for example. Further, inside the high-performance computer, a neural network model may be trained using images of affected areas of pressure ulcers as training data.

In S343, the CPU 121 calculates the area of the affected area as information regarding the size of the extracted affected area. Here, the details of the area calculation method are omitted, but the CPU 121 first geometrically calculates the actual distance per pixel of the image based on the distance information from the imaging device 100 to the subject, the angle of view at the time of shooting, and the image size. Calculate to The CPU 121 can calculate the actual area of the affected area by multiplying the calculated actual distance per pixel of the image by the number of pixels in the affected area.
In S344, the CPU 121 determines whether or not the image being processed is an image shot with the release. Two methods are conceivable for this determination, but either method may be used.

First, when the imaging device 100 transmits an image to the image processing device 120, it transmits a flag indicating whether the image is a live view image or an image captured by releasing, and the CPU 121 makes a determination based on the flag. The method. Secondly, the processing itself of S341 to S347 is divided into two, one for live view images and the other for images shot with a release, and when the imaging device 100 transmits the images, the processing is divided into the respective processings. The method. If the image has been transmitted in S306, it is a live view image and not an image captured by releasing the image. On the other hand, if the image was shot with the release, the process proceeds to S345.

In S<b>345 , the CPU 121 performs image analysis on the received image and stores information on the analysis result in the primary storage device 104 . Here, the CPU 121 sets the major axis and the minor axis of the extracted affected area, and calculates the length of the major axis and the minor axis. The reason why the live view image is not subjected to image analysis is that the main purpose is for the photographer to check the extraction result of the affected area during the live view. In this way, by omitting the image analysis processing of S345 for the live view image, the processing time can be reduced. However, if the imaging device 100 has high performance, the process of S345 may be executed.

In S346, the CPU 121 generates an image in which information indicating the extraction result of the affected area and information regarding the size of the affected area are superimposed on the image from which the affected area is to be extracted.
FIG. 4 is a diagram for explaining a method of superimposing information indicating the extraction result of the affected area and information about the size of the affected area on the image.
An image 400 shown in FIG. 4A is an example of displaying an image before superimposition processing, and includes a pressure ulcer 401 .
An image 410 shown in FIG. 4B is an example of displaying an image after superimposition processing.

A label 411 indicating the area of the affected area is superimposed on the upper left corner of the image 410 shown in FIG. 4B in white characters on a black background. In addition, an index 412 indicating the estimated area of the affected area extracted in S342 is superimposed on the image 410 . By α-blending the index 412 indicating the estimated area and the original image of the image 400, the photographer can confirm whether or not the estimated area from which the area of the affected area is calculated is appropriate.

In S<b>347 , the CPU 121 transmits information indicating the extraction result of the extracted affected area and information regarding the size of the affected area to the imaging device 100 . In this embodiment, the CPU 121 transmits to the imaging device 100 an image in which the information indicating the extraction result of the affected area generated in S346 and the information regarding the size of the affected area are superimposed.

Next, the processing by the imaging device 100 is performed.
In S<b>307 , the CPU 103 of the imaging device 100 receives data transmitted from the image processing device 120 , if any.
In S308, the CPU 103 determines whether or not an image has been received. If it has been received, the process proceeds to S309, and if it has not been received, the process proceeds to S310.
In S309, the CPU 103 displays the received image on the display unit 107 for a predetermined time. Here, the CPU 103 displays an image 410 shown in FIG. 4(b). In this way, by superimposing the information indicating the extraction result of the affected area and the information about the size of the affected area on the live view image, the operator can determine whether the area of the affected area and the estimated area are appropriate. After confirming that there is, you can proceed to the actual shooting. In this embodiment, the case where information indicating the extraction result of the affected area and information on the size of the affected area are displayed was described, but only one of them may be displayed.

In S<b>310 , the CPU 103 determines whether or not a shooting instruction is received by the user pressing the release button included in the operation unit 108 . If the photographing instruction has been accepted, the process proceeds to S311, and if the photographing instruction has not been received, the process returns to S304.
In S311, the CPU 103 performs AF processing. This process is the same as S303.

In S312, the CPU 103 shoots a still image for recording in accordance with the shooting instruction from the photographer.
Since the processing from S313 to S315 is the same as that from S304 to S306 described above, only different points will be described.
In S313, the CPU 103 performs image development and compression processing on the image shot for recording to generate, for example, a JPEG standard image. Further, the CPU 103 performs resizing processing on the compressed image to reduce the size of the image. At this time, the size of the resized image is preferably larger than or equal to the size of the image resized in S304 in order to give priority to accuracy when measuring the affected area.

Next, the processing by the image processing device 120 is performed.
The processing from S341 to S347 is the same as the above-described S341 to S347, but there are two points of difference.
The first point is that the process of S345 is executed.
In S345, the CPU 121 performs image analysis. Specifically, the CPU 121 calculates the position of the extracted affected area, or calculates and sets the major axis and minor axis of the affected area. The CPU 121 also calculates the length of the major axis and the minor axis with respect to the affected area, the inclination (orientation), and the area of the rectangle circumscribing the affected area based on the actual distance per pixel of the image obtained in S343. DESIGN-R, which is an evaluation index for pressure ulcers, defines that the size of pressure ulcers is measured by the product of the major axis and the minor axis. By calculating the major axis and the minor axis in the image processing system of the present embodiment, it is possible to ensure compatibility with data measured by DESIGN-R so far. Since DESIGN-R does not have a strict definition, a plurality of methods for calculating the major axis and minor axis can be considered mathematically.

As a first example of how to calculate the major axis and the minor axis, the CPU 121 calculates a minimum bounding rectangle of the rectangles circumscribing the affected area. Next, the lengths of the long sides and the short sides of this rectangle are calculated, and the length of the long side is calculated as the major diameter and the length of the short side is calculated as the minor diameter. Next, the area of the rectangle is calculated based on the actual distance per pixel of the image obtained in S343.
As a second example of the calculation method of the major axis and the minor axis, the CPU 121 selects the maximum Feret diameter, which is the maximum caliper length, as the major axis, and selects the minimum Feret diameter as the minor axis. The maximum Feret diameter, which is the maximum caliper length, may be selected as the major axis, and the length measured in the direction perpendicular to the axis of the maximum Feret diameter may be selected as the minor axis.
An arbitrary method can be selected as a method for calculating the major axis and the minor axis based on compatibility with conventional measurement results.

The second point is that the information superimposed on the image is different.
During live view, since S345 is not executed to reduce the processing load, the major axis, minor axis, etc. are not calculated, and only the estimated area of the affected area and the area of the affected area are superimposed, generated the image. On the other hand, when shooting with the release, an image is generated in which information such as the major axis and the minor axis is also superimposed.

FIGS. 4C to 4E are diagrams in which information indicating the extraction result of the affected area and information regarding the size of the affected area including the major axis and the minor axis of the affected area are superimposed. Since multiple pieces of information regarding the size of the affected area are assumed, the description will be divided into three.
An image 420 shown in FIG. 4C is obtained by using a minimum bounding rectangle as a method of calculating the major axis and the minor axis. In the upper left corner of image 420 is superimposed information 421 regarding the size of the affected area.
Also, on the upper right corner of the image 420, a label 422 displaying the major axis and minor axis calculated based on the minimum bounding rectangle is superimposed as information on the size of the affected area. A rectangular frame 425 representing a minimum bounding rectangle circumscribing the affected area 424 is superimposed on the image 420 . By superimposing the rectangular frame 425 together with the lengths of the major axis and the minor axis, the photographer can confirm which part of the image is being measured.

In addition, on the lower left corner of the image 420, an indicator 423 of Size evaluation of DESIGN-R described above is superimposed. In the index 423 of the size evaluation of DESIGN-R, the long axis and short axis (maximum diameter perpendicular to the long axis) of the skin damage range are measured (unit: cm), and the multiplied values are classified into 7 levels. there is In this embodiment, an index 423 obtained by replacing the major axis and the minor axis with values output by respective calculation methods is superimposed.

An image 430 shown in FIG. 4D uses the maximum Feret diameter as the major axis and the minimum Feret diameter as the minor axis. An auxiliary line 432 corresponding to the measurement position of the maximum Feret diameter and an auxiliary line 433 corresponding to the minimum Feret diameter are superimposed on the affected area 431 of the image 430 . By superimposing the auxiliary lines 432 and 433 together with the lengths of the major axis and the minor axis, the photographer can confirm which part of the image is being measured.

An image 440 shown in FIG. 4E has the same major axis as the image 430 shown in FIG. It is due to An auxiliary line 442 corresponding to the measurement position of the maximum Feret diameter and an auxiliary line 443 corresponding to the length measured in the direction perpendicular to the axis of the maximum Feret diameter are superimposed on the affected area 441 of the image 440 .

It should be noted that the various information superimposed on the image shown in FIGS. good. Information such as the major axis and the minor axis are obtained by the image analysis in S345.
Further, in the present embodiment, the image processing apparatus 120 superimposes information such as the major axis and the minor axis on an image and transmits the information to the imaging apparatus 100, and the imaging apparatus 100 simply displays the superimposed image. processing load is reduced. However, the image processing apparatus 120 may transmit information such as the major axis and the minor axis to the imaging apparatus 100 as accompanying information, and the imaging apparatus 100 may superimpose and display the information.

Next, the processing by the imaging device 100 is performed.
In S<b>316 , the CPU 103 of the imaging device 100 receives the image transmitted from the image processing device 120 .
In S<b>317 , the CPU 103 displays the received image on the display unit 107 .
In S<b>318 , the CPU 103 displays on the display unit 107 a message asking the photographer whether or not to register the captured image in the management server 130 . If the photographer selects registration with the management server 130, the process advances to step S319, and if the photographer does not select registration, the process ends.

In S<b>319 , the CPU 103 transmits to the image processing apparatus 120 an instruction to register in the management server 130 the image and the analysis result information transmitted to the image processing apparatus 120 in S<b>315 . In this embodiment, the CPU 121 of the image processing apparatus 120 transmits the stored image and the information of the analysis result to the management server 130 according to the received instruction. However, the imaging device 100 may directly transmit the image and information on the analysis result to the management server 130 .

Next, the processing of the image processing device 120 is performed.
In S<b>350 , the CPU 121 receives an instruction from the imaging device 100 to register the image and the analysis result information in the management server 130 .
In S<b>351 , the CPU 121 transmits necessary data to the management server 130 in order to perform registration processing with the management server 130 . Here, the data to be transmitted is the photographed image, the information of the analysis result (distance information to the subject, the position of the affected area, the area of the affected area, the length of the major axis, the inclination of the major axis, the length of the minor axis, the minor axis slope, area of the rectangle), and the image of the tag. The image of the tag was taken in S301.

Next, the processing of the management server 130 is performed.
In S<b>360 , the CPU 131 of the management server 130 receives data transmitted from the image processing device 120 .
In S361, the CPU 131 reads the barcode information included in the tag image.
In S362, the CPU 131 acquires the patient ID based on the read bar code information. The management server 130 stores in the secondary storage device 133 a database in which patient IDs and patient names are associated with bar code information. The CPU 131 acquires the patient ID associated with the barcode information from the database.

In S<b>363 , the CPU 131 registers the data transmitted from the image processing device 120 in the database record stored in the secondary storage device 133 of the management server 130 . The management server 130 registers images in association with patient IDs and patient names, and registers information on analysis results in association with images. By registering in the database record, the user can use the image browsing device 140 to browse images of pressure ulcers for each patient.
In S<b>364 , the CPU 131 transmits to the image processing apparatus 120 a completion notice indicating that the data has been registered.

Next, the processing of the image processing device 120 is performed.
In S<b>352 , the CPU 121 of the image processing apparatus 120 receives the completion notification from the management server 130 .
In S<b>353 , the CPU 121 transmits to the imaging device 100 a completion notification indicating that the data has been registered.

Next, the processing of the imaging device 100 is performed.
In S<b>320 , the CPU 103 of the imaging device 100 receives a completion notification from the image processing device 120 . Upon receiving the completion notification, CPU 103 displays on display unit 107 a message indicating that the registration with management server 130 has been completed.
As described above, in the image processing system, the imaging device 100, the image processing device 120, and the management server 130 can photograph the pressure ulcer, analyze the affected area, and register it in the management server 130. FIG.

Next, the case of browsing images of pressure ulcers will be described.
In general, patients with pressure ulcers are photographed periodically to monitor their progress. Here, an example of an image obtained by photographing a pressure ulcer every week will be described.
FIGS. 5(a) to 5(c) are diagrams showing an example of images of the same patient's pressure ulcer taken every week. In the images 500 to 520, the orientations of the patient and the pressure ulcer are all different because the posture of the patient when the images were taken and the posture when the photographer held the imaging device 100 were not the same. be.
The image browsing device 140 can display the images taken for each patient in chronological order. At this time, when observing the progress of the pressure ulcer, visibility is better if the direction of the pressure ulcer is aligned. In this embodiment, a method of aligning the orientation of images using the major axis of the affected area will be described.

FIG. 6 is a flow chart showing an example of processing of the image browsing device 140 and the management server 130. As shown in FIG.
FIG. 6A is a flow chart showing an example of processing for displaying a list of patient names stored in the management server 130 on the image viewing device 140 so that the user can select a patient to view. If the management server 130 has a web server, images can be viewed from the image viewing device 140 through a web browser. In this case, the image browsing device 140 may be any device that can display a web browser, such as a smart phone, a tablet terminal, or a PC.

In S600, the CPU 141 of the image browsing device 140 transmits a patient name list acquisition request to the management server 130 in accordance with the user's instruction.
In S<b>610 , the CPU 131 of the management server 130 receives a patient name list acquisition request from the image browsing device 140 .
In S<b>611 , the CPU 131 acquires patient name list information from the database stored in the secondary storage device 133 . At this time, the CPU 131 may acquire information on the first shooting date and time and the last shooting date and time of the shooting dates of the images associated with the patient name.
In S<b>612 , the CPU 131 transmits the acquired patient name list information and imaging date/time information to the image viewing apparatus 140 .

In S<b>601 , the CPU 141 of the image viewing apparatus 140 receives the patient name list information and the imaging date/time information transmitted from the management server 130 .
In S602, the CPU 141 displays a patient name list on the display unit 145 based on the acquired information.
FIG. 7 is a diagram showing an example of a screen 700 displaying a list of patient names.
A screen 700 displays a folder icon 701 , a shooting date and time 702 , a search window 703 and a scroll bar 704 . A patient ID and a patient name are displayed in the folder icon 701 . Here, folder icons 701 corresponding to eight patients are displayed. The date and time of imaging 702 displays the date and time of the first imaging and the date and time of the last imaging for each patient. A search window 703 is a display item that allows the user to enter a patient ID, patient name, and imaging date and time to perform a search when there are many patients. A scroll bar 704 is a display item that the user operates to move when there are many patients and the user wants to display folder icons 701 that are not displayed on the screen. Here, the user can select a patient for whom the image of the pressure sore is to be viewed from the patient name list via the operation unit 146 such as a touch panel.

FIG. 6B shows a process in which the user selects a patient whose pressure ulcer image is to be viewed, and the pressure ulcer image corresponding to the selected patient stored in the management server 130 is displayed on the image viewing device 140. 2 is a flowchart showing an example of .
In S620, the CPU 141 of the image browsing device 140 transmits an image acquisition request to the management server 130 according to the user's instruction. Specifically, the CPU 141 transmits an image acquisition request in response to the user selecting a folder icon corresponding to a patient to be browsed. At this time, the CPU 141 also transmits the patient ID of the selected patient.

In S<b>630 , the CPU 131 of the management server 130 receives the image acquisition request and patient ID transmitted from the image browsing device 140 .
In S<b>631 , the CPU 131 acquires each image associated with the patient ID and the analysis result information associated with each image from the database stored in the secondary storage device 133 .
In S632, the CPU 131 rotates each image based on the information about the major axis of the affected area included in the analysis result information associated with each image. Details of the method for rotating the image will be described later.

In S<b>633 , the CPU 131 transmits the rotated image, the information on the shooting date and time, and the information on the analysis result to the image viewing apparatus 140 . The information of the analysis results includes information on the distance to the subject, the position of the affected area, the area of the affected area, the length of the major axis, the inclination of the major axis, the length of the minor axis, the inclination of the minor axis, and the area of the rectangle. be
In S<b>621 , the CPU 141 receives each rotated image and the information of the analysis result from the management server 130 .
In S<b>622 , the CPU 141 displays each received image and the information of the analysis result on the display unit 145 .

(First display example)
FIG. 8 is a diagram showing a display example of a screen that displays the received pressure ulcer image and analysis result information. A screen 800 shown in FIG. 8A includes a patient name 801, images 802 to 804, an evaluation display area 808, an imaging date and time 809, a scale 810, a return button 811, a first slider bar 812, and a second slider bar 813. etc. is displayed.
A patient name 801 displays the name of the patient selected by the user from the patient name list. Images 802-804 display rotated images of the pressure ulcer. Images 802 to 804 also display an affected area 805, a longer axis 806 of the affected area, and a shorter axis 807 of the affected area. An evaluation display portion 808 displays the area of the affected area, the length of the major axis, the length of the minor axis, and the value of DESIGN-R, which are part of the analysis results.

The photographing date and time 809 displays the date and time when the image was photographed. Here, the images 802 to 804 are sorted and displayed on the basis of the shooting date/time 809 so that the date/time becomes newer from the left side to the right side. Therefore, it is easier for the user to observe the progress of the pressure ulcer. A scale 810 is displayed based on the actual distance per image pixel. Therefore, the user can easily grasp the size of the pressure ulcer by checking the scale 810 .

A first slider bar 812 is a display item that the user operates to move when there are many images and the user wants to display an image that is not displayed on the screen. By operating the first slider bar 812 by the user, an image of an old shooting date or a new shooting date is displayed. A second slider bar 813 is a display item operated by the user to move when the user wishes to change the display size of an image and display it. When the user operates the second slider bar 813 to reduce the display size, each image is displayed in a small size, but many images can be displayed on one screen. A return button 811 is a display item operated to return to the patient list screen shown in FIG.

Here, the images 802 to 804 are displayed with the slopes of the major axes of the diseased regions matching. That is, in S632 described above, the CPU 131 of the management server 130 rotates each image so that the inclinations of the major axes of the affected area regions of each image match. The major axis of the affected area is an example of a reference line set in the affected area. In this way, by displaying images with the direction of the pressure ulcer aligned with the major axis as the reference line, a plurality of images can be easily compared, and the progress of the pressure ulcer can be easily observed. Here, matching is not limited to a complete match, but includes a case where the user can recognize a match.

Note that in FIG. 8A, the other two images 803 and 804 are rotated based on the inclination of the major axis of the diseased area of one image 802 . Here, the image used as a reference may be any of an image taken at the first shooting date, an image taken at the last shooting date, or an image arbitrarily selected by the user. That is, in S632 described above, the CPU 131 of the management server 130 does not rotate the reference image among the images, but rotates the other images so that the slopes of the major axes of the affected area match. In addition, it is only necessary to select one image that serves as a reference for the inclination of the major axis of the same patient, and it is not necessary to match the inclination of the major axis between different patients.
In this display example, the case where the CPU 131 of the management server 130 rotates the image has been described, but the image browsing device 140 may rotate the image. Specifically, the CPU 141 of the image browsing device 140 receives at least each image and information on the long axis of the affected area of each image from the management server 130, and rotates each image so that the inclination of the long axis of the affected area matches. Let

FIG. 8(b) is a diagram showing a display example of a screen different from that of FIG. 8(a). Note that the description of the same display items as those in FIG. 8A will be omitted as appropriate. Images 821 to 823 and the like are displayed on a screen 820 shown in FIG. 8B.
Images 821 to 823 are rotated images of pressure ulcers. Images 821 to 823 also display an affected area 824, a longer axis 825 of the affected area, and a shorter axis 826 of the affected area.

Here, each of the images 821 to 823 is displayed so that the inclination of the long axis of the diseased region is 0 degrees with respect to the lateral direction (horizontal direction) of the screen 820 . That is, in S632 described above, the CPU 131 of the management server 130 rotates each image so that the inclination of the major axis of the affected area region of each image matches the horizontal direction. In this way, by aligning the direction of the pressure ulcer and displaying the images so that the inclination of the long axis matches the horizontal direction, a plurality of images can be easily compared, and the progress of the pressure ulcer can be observed more easily.

Note that if the rotated image is displayed in the rectangular display frame 814, the edges of the image will be cut off, and if the image is displayed as it is, the size of the image may not be uniform. When the size of the image is insufficient for the rectangular display frame, the CPU 141 of the image browsing device 140 responds by enlarging and displaying the image or displaying the insufficient portion in black. be able to. At this time, the CPU 141 of the image browsing device 140 adjusts the size of the scale 810 and displays it when enlarging the image.
In addition, the CPU 103 of the imaging apparatus 100 may display guidance to the user to additionally photograph the surroundings of the pressure ulcer during imaging, assuming that the image will be rotated and displayed by the image viewing device 140. good.

(Second display example)
When photographing a pressure ulcer, not only the difference in the orientation of the image, but also the difference in the size of the pressure ulcer in the image occurs. That is, if the image is taken near the patient, or if the image is taken with the imaging device 100 having a higher zoom magnification, the decubitus ulcer will be imaged larger. Conversely, if the image is taken at a distance from the patient, or if the zoom magnification of the imaging device 100 is lowered, the decubitus ulcer will be imaged smaller.

FIGS. 9A to 9C are diagrams showing examples of images of the same patient's pressure ulcer taken at different distances. In images 900-920, the size of the pressure ulcer is significantly different. Using the image 900 as a reference, the image 910 is taken closer to the patient, so the pressure ulcer is displayed larger. Also, when the image 900 is used as a reference, the image 920 is taken away from the patient, so the pressure ulcer is displayed small.
When such an image is viewed with the image viewing device 140 as in the first display example described above, it is possible to align the directions of the bedsores, but it is difficult to align the sizes. Since the size of a decubitus ulcer serves as an index, it is desirable to photograph the subject at a constant distance from the imaging device 100 . However, in reality, it is difficult to keep the distance to the subject constant each time the image is taken. can be properly observed.

FIG. 10 is a flow chart showing an example of processing of the image browsing device 140 and the management server 130, including processing for enlarging/reducing an image. In the flowchart of FIG. 10, the process of S1013 is added to the flowchart of FIG. 6B. Other processes are the same as those in the flowchart of FIG. 6B, and description thereof will be omitted as appropriate.
In S1013, the CPU 131 of the management server 130 enlarges/reduces the image based on the shooting distance. Here, the shooting distance is information about the distance from the imaging device 100 to the subject, and is information acquired by the distance measuring unit 110 at the time of image shooting in S314 and transmitted as part of the analysis result in S319. Further, the distance information to the subject is transmitted from the image processing device 120 to the management server 130 in S351, and registered in the database stored in the secondary storage device 133 of the management server 130 in association with each image.

Here, three methods are assumed as methods for enlarging/reducing an image.
The first method is to calculate the average of the photographing distances of all images, and enlarge or reduce each image so as to obtain the average value. Specifically, in S<b>1011 , the CPU 131 of the management server 130 also acquires the photographing distance of each image when acquiring images of pressure ulcers. Therefore, the CPU 131 of the management server 130 can calculate the average value based on the shooting distance of each image.
The second method is to enlarge/reduce each image so that the photographing date and time correspond to the photographing distance of the first image or the last image. Specifically, in S1011, the CPU 131 of the management server 130 acquires the shooting distance of the first image or the last image, and enlarges/reduces each image based on the acquired shooting distance.
The third is a method of enlarging/reducing each image according to the image with the closest shooting distance or the farthest image. Specifically, in S1011, the CPU 131 of the management server 130 acquires the shooting distance of the image with the shortest shooting distance or the farthest shooting distance, and enlarges/reduces each image based on the acquired shooting distance.

FIG. 11 is a diagram showing a display example of a screen 1100 displaying an image enlarged/reduced based on the shooting distance.
Enlarged/reduced images 1101 to 1103 and the like are displayed on a screen 1100 shown in FIG. The image 1101 is the original image of the image 900 shown in FIG. 9A, the image 1102 is the original image of the image 910 shown in FIG. 9B, and the image 1103 is the original image of the image shown in FIG. This is the original image.

Here, since the size of the diseased region 1104 of the image 1101 is the same as the size of the diseased region 901 of the image 900, the image 1101 is not enlarged or reduced.
The original image 910 of the image 1102 was taken at a short distance, and the diseased region 911 of the image 910 is large, but the diseased region 1105 is displayed small because the image 1102 is reduced. Note that when the image is reduced, the CPU 131 of the management server 130 draws a contour 1107 indicating the size of the original image, and generates the image so that the portion outside the contour 1107 is solid black or solid white. do.
The original image 920 of the image 1103 was taken at a long distance, and the diseased region 921 of the image 920 is small, but the diseased region 1106 is displayed large because the image 1103 is magnified.

In this way, by enlarging or reducing the photographing distance of each image based on the photographing distance of each image so that the photographing distance of each image is pseudo-matched, a plurality of images can be easily compared, and the progress of the pressure ulcer can be more easily observed. be able to.
In this display example, the case where the CPU 131 of the management server 130 enlarges/reduces the image has been described, but the image viewing apparatus 140 may enlarge/reduce the image. Specifically, the CPU 141 of the image browsing device 140 receives at least each image and the shooting distance of each image from the management server 130, and enlarges or reduces each image so that the shooting distances of each image pseudo-match. You may

(Third display example)
The purpose of the user's viewing of the images is to observe the progress of the pressure ulcer. Therefore, by enlarging the image so that the pressure ulcer can be clearly seen, the visibility of the pressure ulcer can be improved.
FIG. 12 is a flow chart showing an example of processing of image browsing device 140 and management server 130, including processing for enlarging an image. In the flowchart of FIG. 12, processing of S1213 is added to the flowchart of FIG. 6B. Other processes are the same as those in the flowchart of FIG. 6B, and description thereof will be omitted as appropriate.
In S1213, the CPU 131 of the management server 130 enlarges the image based on the position of the affected area.

Here, two methods are assumed as a method of enlarging an image.
The first is a method of enlarging the image so that the length of the diseased area, whichever is longer, in the vertical or horizontal direction is the same as the length in the vertical or horizontal direction of the display frame that displays the image. Specifically, in S<b>1211 , the CPU 131 of the management server 130 also acquires information on the position of the affected area of each image when acquiring the image of the pressure ulcer. The CPU 131 enlarges the image so that the affected area fits within the display frame based on the positional information of the affected area. In this case, the image is enlarged so that the affected area fits within the display frame.
The second is a method of enlarging the image so as to provide a certain margin between the periphery of the affected area of the pressure ulcer and the display frame. Specifically, in S1211, the CPU 131 of the management server 130 enlarges the image so that the affected area fits within the display frame via the margin based on the information on the position of the affected area and the information on the set margin. do.

FIG. 13 is a diagram showing a display example of a screen 1300 displaying an enlarged image based on the position of the affected area.
Enlarged images 1301 to 1303 are displayed on a screen 1300 shown in FIG. Affected regions 1304 to 1306 are displayed enlarged in images 1301 to 1303, respectively. Further, as shown in the image 1301, certain margins M1 and M2 are provided between the affected area 1304 and the display frame 1308, so that the affected area 1304 and the peripheral area of the affected area 1304 are displayed.

By enlarging each image based on the position of the affected area in this way, the user can observe the pressure ulcer in greater detail. Note that when the image is enlarged, the actual distance per pixel of the image also changes. Therefore, the CPU 131 of the management server 130 changes the size of the scale 1307 according to the enlargement ratio. In addition, since the scale is displayed on each image, the user can grasp the size of the pressure ulcer by checking the scale. Therefore, the CPU 141 of the image viewing apparatus 140 may allow the user to select the display form of the screen 1100 shown in FIG. 11 and the display form of the screen 1300 shown in FIG. .

(Fourth display example)
In the processing described above, the case where the image processing apparatus 120 automatically calculates the major axis of the affected area has been described, but there are cases where the user himself/herself desires to specify the major axis. In this case, the user manually specifies the major axis of the affected area and rotates the image based on the specified major axis to align the orientation of the pressure ulcer and improve the visibility of the pressure ulcer.
FIG. 14 is a diagram for explaining how the user manually designates the length of the pressure ulcer.
Images 1401 to 1403 are displayed on a screen 1400 shown in FIG. Here, an image 1401 shows a state in which the user has already specified the major axis. On the other hand, images 1402 and 1403 show a state in which the major axis is not specified.

When the user desires to specify the major axis, the CPU 141 of the image viewing apparatus 140 transitions to the major axis specification mode in response to pressing the major axis specification button 1405 . In the major axis specification mode, the user can specify the major axis on the images 1402 and 1403 . The CPU 141 may enlarge and display the affected area in accordance with the transition to the major axis designation mode, and accept designation of the major axis. By enlarging the display in this way, the user can specify the major axis while confirming the decubitus ulcer in more detail.
Further, when the CPU 141 accepts a transition to the major axis designation mode in a state in which the affected area of the pressure ulcer is displayed in an enlarged manner, the CPU 141 displays the entire image including the original pressure ulcer before enlargement, and displays the entire image. You may make it accept designation|designated of a major axis with respect to. By displaying the entire original image in this way, the user can confirm the position of the body other than the pressure ulcer, and can specify the major axis in the same direction in a plurality of images.

The designated major axis 1410 and minor axis 1411 are displayed in the image 1401 . When the user designates two points or a line segment, the CPU 141 sets the line segment connecting the designated two points or the designated line segment as the major axis. Based on the set length information, the CPU 141 sets the length using the method for calculating the length and width described above. Further, the CPU 141 superimposes and displays the set major axis and minor axis on the image. At this time, the CPU 141 rotates and displays the image so that the set inclination of the major axis matches the inclination of the major axis of the other image. If the user wishes to correct the specified major axis, the user can press the major axis correction button 1404 to specify the major axis again.
Note that the CPU 141 transmits information on the designated major axis to the management server 130, and rotates the rotated image so as to match another image based on the information on the major axis received by the CPU 131 of the management server 130. You may make it transmit to the image browsing apparatus 140. FIG. Further, the CPU 131 of the management server 130 may set the minor axis based on the information on the major axis specified by the user, and recalculate the length of the major axis, the length of the minor axis, the area of the rectangle, and the like. .

Further, when the user designates the major axis, the process of calculating the major axis and the minor axis in S345 of the flowchart of FIG. 3 can be omitted. On the other hand, the CPU 141 of the image viewing device 140 transmits information such as the length and inclination of the major axis to the management server 130 in response to the user specifying the major axis. The CPU 131 of the management server 130 stores information on the major axis in association with the image in the database stored in the secondary storage device 133 . Therefore, from the next time onwards, the CPU 131 of the management server 130 can rotate the image based on the stored length information, so the CPU 141 of the image viewing device 140 can display the image with the direction of the pressure ulcer aligned.

(Fifth display example)
In the above-described processing, it is assumed that the slope of the long axis of the pressure ulcer does not change for the same patient. However, if the pressure ulcer has a shape close to a perfect circle, the slope of the long axis may change as the pressure ulcer heals. .
FIGS. 15(a) to 15(c) are diagrams showing an example of images taken of the same patient's pressure ulcer as the healing progresses. Here, the major axis 1506 set in the affected area 1503 of the image 1500 shown in FIG. 15(a), the major axis 1507 set in the affected area 1504 of the image 1501 shown in FIG. The major axis 1508 set in the affected area 1505 of the image 1502 shown is compared. In this case, the slope of the major axis 1506 is different from the slope of the major axes 1507 and 1508 .
In images 1500 to 1502 shown in FIG. 15, if each image is rotated so that the slopes of the major axes are matched, the directions of the pressure ulcers will not be aligned. Therefore, the user can specify a reference line for aligning the orientation of the images, in addition to the major axis.

FIG. 16 is a diagram showing a display example of a screen 1600 for setting a reference line.
Images 1601 to 1603, a reference line designation button 1605, a check button 1606, a label 1608, a cancel button 1609, and the like are displayed on a screen 1600 shown in FIG. Images 1601 to 1603 correspond to images 1500 to 1502 shown in FIG. 15, respectively.

A reference line specifying button 1605 is a button that the user presses when specifying a reference line in addition to the major axis. By pressing the reference line designation button 1605, the CPU 141 of the image viewing apparatus 140 transitions to the reference line designation mode. In the reference line designation mode, as in the major diameter designation mode, when the user designates two points or a line segment, the CPU 141 sets the line segment connecting the designated two points or the designated line segment as the reference line. do. The CPU 141 rotates and displays the image 1602 so that the inclination of the set reference line matches the inclination of the major axis of the other image. Here, the CPU 141 rotates the image 1602 so that the inclination of the set reference line 1607 matches the inclination of the major axis 1610 of the image 1601 taken at the date and time before the image 1602 .
Note that the CPU 141 transmits the designated reference line information to the management server 130, rotates the image so as to match another image based on the reference line information received by the CPU 131 of the management server 130, and rotates the rotated image. may be transmitted to the image browsing device 140 .

A check button 1606 is a button to be pressed when the user wants to rotate an image whose shooting date and time is later than the image for which the user has designated the reference line using the same reference line. When the check button 1606 is checked, the CPU 141 calculates the difference (angular difference) between the inclination of the reference line 1607 set in the image 1602 and the inclination of the major axis 1604 . Next, the CPU 141 rotates the image 1603 taken after the image 1602 by an angle corresponding to the calculated difference (angular difference). The CPU 141 transmits information on the reference line specified by the user to the management server 130, and based on the information on the reference line received by the CPU 131 of the management server 130, calculates the difference between the slope of the reference line and the slope of the major axis. can be calculated. The CPU 131 of the management server 130 may transmit the image rotated by the angle corresponding to the calculated difference to the image browsing device 140 .
A label 1608 is a display for notifying the user that the reference line has been specified. A cancel button 1609 is a button that is pressed when the user wishes to cancel the specified reference line.

In this way, even if the slope of the major axis changes as the pressure ulcer heals, it is possible to easily compare a plurality of images by rotating the images based on the reference line specified by the user, thereby facilitating the progress of the pressure ulcer. can be easily observed.

As described above, the present invention has been described in detail based on the preferred embodiments thereof, but the present invention is not limited to the above-described embodiments, and various forms without departing from the gist of the present invention are also included in the present invention. Some of the embodiments described above may be changed or combined as appropriate.
For example, the image viewing apparatus 140 may perform at least one of the processes of S632, S1012, S1013, S1212, and S1213 performed by the management server 130 in the flowcharts of FIGS. In this case, the information acquired in S631, S1011, and S1211 by the management server 130 can be transmitted to the image processing apparatus 120. FIG.
In addition, the management server 130 may perform the processing of S622, S1002, and S1202 performed by the image viewing apparatus 140 in the flowcharts of FIGS. In this case, the management server 130 can be realized by providing a display unit.
In addition, the processing performed by the management server 130 or the image browsing device 140 may be performed by a different device, or may be performed independently.
Further, in the present embodiment, the case where the affected area is a pressure ulcer has been described as an example, but the affected area is not limited to a pressure ulcer, and may be a burn or a laceration.

<Other embodiments>
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a recording medium, and one or more processors in the computer of the system or apparatus reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

100: Imaging Device 120: Image Processing Device 130: Management Server 131: CPU 134: Communication Device 140: Image Browsing Device 141: CPU 144: Communication Device 145: Display Unit

Claims (31)

Acquisition means for acquiring a plurality of images of the affected area;
an image processing apparatus comprising control means for controlling rotation of the images so that the inclinations of the reference lines match each other based on the reference lines set in the diseased area of each of the plurality of images,
The reference line is the major axis of the affected area,
The control means is
The slope of the major axis of the affected area in the first image among the plurality of images matches the slope of the major axis of the affected area in the remaining plurality of images different from the first image among the plurality of images. The image processing apparatus , wherein control is performed so as to rotate the remaining plurality of images without rotating the first image. The first image is an image of the first captured date and time among the plurality of images of the same patient, an image of the last captured date and time of the plurality of images of the same patient, or an image arbitrarily selected by the user. The image processing apparatus according to claim 1, characterized by: Acquisition means for acquiring a plurality of images of the affected area;
an image processing apparatus comprising control means for controlling rotation of the images so that the inclinations of the reference lines match each other based on the reference lines set in the diseased area of each of the plurality of images,
The control means is
An image processing apparatus, wherein control is performed to enlarge or reduce an image based on the photographing distances of the plurality of images so that the photographing distances of the plurality of images match. The control means is
4. The image processing apparatus according to claim 3, wherein control is performed such that the images are enlarged or reduced so that the photographing distance of the plurality of images becomes an average value of the photographing distances of the plurality of images. The control means is
4. The image processing apparatus according to claim 3, wherein the photographing distances of the plurality of images are controlled so as to enlarge or reduce the images so that the photographing date and time of the first image or the last image correspond to the photographing distance. . The control means is
4. The image processing apparatus according to claim 3, wherein the photographing distances of the plurality of images are controlled such that the images are enlarged or reduced so as to match the image with the closest photographing distance or the image with the furthest photographing distance. The control means is
7. The method according to any one of claims 4 to 6, wherein when the images are reduced so that the photographing distances of the plurality of images match, a contour indicating the size before reduction is drawn. Image processing device. Acquisition means for acquiring a plurality of images of the affected area;
an image processing apparatus comprising control means for controlling rotation of the images so that the inclinations of the reference lines match each other based on the reference lines set in the diseased area of each of the plurality of images,
The control means is
An image processing apparatus that performs control to enlarge the affected area or a peripheral area including the affected area based on the position of the affected area . The control means is
9. The image processing apparatus according to claim 8, wherein control is performed so as to enlarge the affected area or a surrounding area including the affected area so that the affected area fits within a display frame when an image is displayed. The control means is
10. The image according to claim 9, wherein control is performed so as to enlarge the affected area or a peripheral area including the affected area so as to provide a certain margin between the periphery of the affected area and the display frame. processing equipment. Acquisition means for acquiring a plurality of images of the affected area;
an image processing apparatus comprising control means for controlling rotation of the images so that the inclinations of the reference lines match each other based on the reference lines set in the diseased area of each of the plurality of images,
The reference line is the major axis of the affected area designated by the user;
The control means is
so that the slope of the major axis of the affected area in the image for which the major axis is newly specified among the plurality of images and the slope of the major axis of the affected area in the image for which the major axis has already been specified among the plurality of images match and (2) rotating the image with the newly designated major axis and controlling to set the minor axis of the image with the newly designated major axis . The control means is
12. The image processing apparatus according to claim 11, wherein when the user has corrected the already designated major axis, the image of the corrected major axis is controlled to be rotated. Acquisition means for acquiring a plurality of images of the affected area;
an image processing apparatus comprising control means for controlling rotation of the images so that the inclinations of the reference lines match each other based on the reference lines set in the diseased area of each of the plurality of images,
The reference line is the major axis of the affected area,
The control means is
When a new reference line different from the major axis of the affected area that has already been set is set in accordance with an instruction by the user, the image with the newly set reference line may be replaced with another reference line. An image processing apparatus characterized by controlling rotation so as to match the inclination of the major axis of an affected area of an image. 14. The image processing apparatus according to claim 13, wherein the other image is an image captured on a date and time before the image for which the new reference line is set. The control means is
Controlling to rotate an image captured on a later date than the image for which the new reference line is set according to the angular difference between the long axis of the affected area that has already been set and the new reference line. 15. The image processing apparatus according to claim 14, characterized by: The major axis of the affected area is
16. The long axis set based on the rectangle circumscribing the affected area, or the long axis set based on the caliper length of the affected area. The described image processing device. The image processing apparatus according to any one of claims 1 to 16, wherein the affected area is a pressure ulcer. 18. The image processing apparatus according to any one of claims 1 to 17 , wherein the control means rotates the image so that the slopes of the reference lines match for each patient. 19. The apparatus according to any one of claims 1 to 18 , further comprising transmitting means for transmitting to the outside in order to display the plurality of images rotated by the control means such that the inclinations of the reference lines match. image processing device. 19. The image processing apparatus according to any one of claims 1 to 18 , further comprising display means for displaying the plurality of images rotated by the control means so that the slopes of the reference lines match. The display means is
21. The image processing apparatus according to claim 20 , wherein the plurality of images are arranged and displayed in order of date and time when they were taken. The display means is
22. The image processing apparatus according to claim 20, wherein the reference line set in the affected area is displayed so as to be superimposed on each of the plurality of images. An image processing system comprising the image processing device according to claim 19 and an image viewing device,
The image browsing device is
An image processing system comprising display means for displaying the image transmitted by said transmission means. an acquiring step of acquiring a plurality of images of the affected area;
A control method for an image processing device, comprising : a control step of controlling to rotate the images so that the inclinations of the reference lines match, based on the reference lines set in the diseased area of each of the plurality of images, wherein ,
The reference line is the major axis of the affected area,
In the control step,
The slope of the major axis of the affected area in the first image among the plurality of images matches the slope of the major axis of the affected area in the remaining plurality of images different from the first image among the plurality of images. A control method for an image processing apparatus , wherein control is performed so as to rotate the plurality of remaining images without rotating the first image. an acquiring step of acquiring a plurality of images of the affected area;
A control method for an image processing device, comprising: a control step of controlling to rotate the images so that the inclinations of the reference lines match, based on the reference lines set in the diseased area of each of the plurality of images, wherein ,
In the control step,
A control method for an image processing apparatus, comprising: performing control such that an image is enlarged or reduced based on the photographing distances of the plurality of images so that the photographing distances of the plurality of images match. an acquiring step of acquiring a plurality of images of the affected area;
A control method for an image processing device, comprising: a control step of controlling to rotate the images so that the inclinations of the reference lines match, based on the reference lines set in the diseased area of each of the plurality of images, wherein ,
In the control step,
A control method for an image processing apparatus, comprising: controlling to enlarge the affected area or a peripheral area including the affected area based on the position of the affected area. an acquiring step of acquiring a plurality of images of the affected area;
A control method for an image processing device, comprising: a control step of controlling to rotate the images so that the inclinations of the reference lines match, based on the reference lines set in the diseased area of each of the plurality of images, wherein ,
The reference line is the major axis of the affected area designated by the user;
In the control step,
so that the slope of the major axis of the affected area in the image for which the major axis is newly specified among the plurality of images and the slope of the major axis of the affected area in the image for which the major axis has already been specified among the plurality of images match (2) a control method for an image processing apparatus, wherein the image with the newly designated major axis is rotated and the minor axis of the image with the newly designated major axis is set. an acquiring step of acquiring a plurality of images of the affected area;
A control method for an image processing device, comprising: a control step of controlling to rotate the images so that the inclinations of the reference lines match, based on the reference lines set in the diseased area of each of the plurality of images, wherein ,
The reference line is the major axis of the affected area,
In the control step,
When a new reference line different from the major axis of the affected area that has already been set is set in accordance with an instruction by the user, the image with the newly set reference line may be replaced with another reference line. A control method for an image processing apparatus, comprising: controlling rotation so as to match the inclination of the major axis of the diseased region of the image. A control method for an image processing system having an image processing device and an image viewing device, comprising:
The image processing device is
each step in the method for controlling an image processing apparatus according to any one of claims 24 to 28;
a transmission step of transmitting the plurality of images rotated so that the slopes of the reference lines match in the control step to an external device for display;
The image browsing device is
A control method for an image processing system, comprising a display step of displaying the image transmitted in the transmission step. A program for causing a computer to function as each means of the device according to any one of claims 1 to 22 . A computer-readable recording medium recording a program for causing a computer to function as each means of the device according to any one of claims 1 to 22 .

Images