JP2021010651A - Image analysis device, image analysis method and image analysis system - Google Patents

Abstract

To improve the safety of peritoneal dialysis.SOLUTION: An in-house device 1 according to one embodiment of the present invention comprises: an image acquisition unit which acquires a photographed image obtained by photographing a patient receiving the peritoneal dialysis by using a dialysis machine 2 or an assistant who assists the patient; a posture specification unit which specifies the posture of the patient or assistant on the basis of the photographed image; an analysis unit which analyzes the procedure of the peritoneal dialysis received by the patient or assisted by the assistant on the basis of the posture; and an output unit which outputs the analysis result by the analysis unit. A management server 4 outputs the analysis result output by the in-house device 1 to an information terminal 5.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image analysis device, an image analysis method, and an image analysis system for analyzing an captured image of a patient undergoing peritoneal dialysis.

Conventionally, hemodialysis (HD) and peritoneal dialysis (PD) are known as dialysis treatment methods. Hemodialysis requires the patient to visit the hospital each time, whereas peritoneal dialysis has the advantage that it can be performed at home or at work.

When performing peritoneal dialysis, the patient or an assistant such as the patient's family needs to connect the dialysis device to a tube embedded in the patient's abdomen and operate the dialysis device (for example, opening and closing a clamp) according to a predetermined procedure. There is. Patent Document 1 discloses a device that outputs an operating procedure of a dialysis machine by voice and an image when a patient performs peritoneal dialysis.

Japanese Unexamined Patent Publication No. 2012-40445

If the patient or assistant performs peritoneal dialysis in the wrong procedure, the patient may get an infection. However, even if the device described in Patent Document 1 outputs a correct peritoneal dialysis procedure, the patient or an assistant does not always perform peritoneal dialysis according to the procedure. Since peritoneal dialysis is performed at the patient's home or workplace, doctors and nurses should check the patient's condition, such as the actual peritoneal dialysis procedure performed by the patient or assistant, and whether or not the patient has an infection. I can't. Therefore, a technique for improving the safety of peritoneal dialysis is required.

The present invention has been made in view of these points, and an object of the present invention is to improve the safety of peritoneal dialysis.

The image analysis apparatus according to the first aspect of the present invention includes an image acquisition unit that acquires an image of a patient performing peritoneal dialysis using a dialysis machine or an assistant who assists the patient, and the image acquisition unit. An analysis unit that identifies the posture of the patient or the assistant based on the patient, an analysis unit that analyzes the peritoneal dialysis procedure performed by the patient or the assistant based on the posture, and an analysis by the analysis unit. It has an output unit that outputs the result.

The image analysis device further includes a component identification unit that specifies at least one of the positions and states of the components included in the dialysis machine based on the captured image, and the analysis unit includes the posture, the position of the component, and the position of the component. Based on at least one of the states, it is determined whether or not the procedure conforms to a predetermined criterion, and the output unit obtains information indicating whether or not the procedure conforms to the predetermined criterion as the analysis result. It may be output as.

The component identification unit identifies at least one of the positions and states of each of the plurality of components included in the dialysis machine, and the analysis unit determines the posture and at least one of the positions and states of the plurality of components. Whether or not the procedure meets the predetermined criteria by identifying the order in which the patient or assistant manipulates the plurality of parts based on the basis and comparing the identified sequence with a predetermined reference sequence. May be determined.

The analysis unit calculates the operation time when the patient or the assistant operates at least one of the plurality of the parts in the specified order, and whether or not the procedure is smooth based on the calculated operation time. The output unit may output information indicating whether or not the procedure is smooth as the analysis result.

When the analysis unit determines that the procedure does not meet the predetermined criteria, the output unit may transmit the captured image to the outside of the image analysis device.

The analysis unit calculates the number of times the patient or the assistant touches an object other than the dialysis machine based on the posture, and evaluates the degree of hygiene of the procedure based on the calculated number of times. The output unit may output information indicating the degree of hygiene as the analysis result.

The image analysis apparatus further includes a mask detection unit that detects a mask worn by the patient or the assistant based on the captured image, and the output unit has the mask detection unit detecting the mask. Information indicating whether or not it may be output may be output.

The image acquisition unit acquires the captured image including the outlet portion to which the dialysis device is connected in the patient's body, and the analysis unit evaluates the degree of hygiene of the outlet portion based on the captured image. Then, the output unit may output information indicating the degree of hygiene as the analysis result.

By inputting the captured image into a machine learning model that outputs information indicating the degree of hygiene of the outlet portion included in the captured image, the analysis unit inputs the captured image to the outlet portion. Information indicating the degree of hygiene may be obtained.

The output unit may output at least one of a predetermined notification and an information for stopping the dialysis machine when the degree of hygiene of the outlet unit satisfies a predetermined condition. Good.

The image analysis method of the second aspect of the present invention includes a step of acquiring an image taken by a processor, which is an image of a patient performing peritoneal dialysis using a dialysis machine or an assistant assisting the patient. The step of identifying the posture of the patient or the assistant based on the captured image, the step of analyzing the procedure of the peritoneal dialysis performed by the patient or the assistant based on the posture, and the step of analyzing the analysis. It has a step of outputting the analysis result.

The image analysis system of the third aspect of the present invention includes an image acquisition device and an image analysis device capable of communicating with the image acquisition device, and the image acquisition device performs peritoneal dialysis using a dialysis device. An image acquisition unit that acquires an image of a patient or an assistant who assists the patient, a posture specifying unit that specifies the posture of the patient or the assistant based on the captured image, and information indicating the posture. The image analysis device has a transmission unit that transmits to the image analysis device, and the image analysis device has a reception unit that receives information indicating the posture from the image acquisition device, and the patient or the assistant is based on the posture. It has an analysis unit that analyzes the procedure of the peritoneal dialysis that is being performed, and an output unit that outputs the analysis result by the analysis unit.

When the output unit of the image analysis device receives a predetermined input from the user or the analysis result satisfies a predetermined condition, the output unit transmits a request for the captured image to the image acquisition device to acquire the image. The transmitting unit of the device may transmit the captured image to the image analysis device on condition that the request is received from the image analysis device.

According to the present invention, there is an effect that the safety of peritoneal dialysis can be improved.

It is a schematic diagram of the image analysis system which concerns on 1st Embodiment. It is a block diagram of the image analysis system which concerns on 1st Embodiment. It is a schematic diagram of the dialysis machine used in peritoneal dialysis. It is a figure which shows the captured image acquired by the image acquisition unit. It is a figure which shows the captured image acquired by the image acquisition unit. It is a figure which shows the captured image acquired by the image acquisition unit. It is a sequence diagram of the image analysis method executed by the image analysis system which concerns on 1st Embodiment. It is a block diagram of the image analysis system which concerns on 2nd Embodiment. It is a sequence diagram of the image analysis method executed by the image analysis system which concerns on 2nd Embodiment.

(First Embodiment)
[Overview of image analysis system S]
FIG. 1 is a schematic diagram of an image analysis system S according to the present embodiment. The image analysis system S includes a home device 1, a dialysis device 2, an imaging device 3, a management server 4, and an information terminal 5. The image analysis system S may include other devices such as servers and terminals.

The home device 1, the dialysis device 2, and the imaging device 3 are provided at a place such as a home or a workplace where peritoneal dialysis for a patient is performed. The home device 1 is a computer that acquires an image captured by the image pickup device 3 from the image pickup device 3 and analyzes the captured image. That is, the home device 1 functions as an image analysis device. The home device 1 is also referred to as an edge device.

The dialysis machine 2 is a device for injecting a dialysate into the patient's body and discharging the dialysate from the patient's body in response to an operation by the patient or an assistant who assists the patient. The assistant who assists the patient is a person other than the patient (for example, the patient's family, a caregiver, etc.) who performs the work for performing peritoneal dialysis. Further, the dialysis machine 2 may include a control device that electrically controls the injection of the dialysate into the patient's body and the discharge of the dialysate from the patient's body.

More specifically, the dialysis machine 2 may be a device that performs CAPD (Continuous Ambulatory Peritoneal Dialysis) in which the dialysate in the patient's body is manually exchanged according to the operation of the patient or an assistant, and is electrically operated. It may be a device that performs APD (Automated Peritoneal Dialysis) that automatically exchanges dialysate in the patient's body by a control device. In either case of CAPD or APD, the patient or assistant connects the dialysis machine 2 to a tube implanted in the patient's abdomen and follows the prescribed procedure to perform peritoneal dialysis on the patient. It is necessary to perform the operation of 2 (for example, opening / closing the clamp and operating the switch).

In the present embodiment, performing peritoneal dialysis by the patient or an assistant is a task for performing peritoneal dialysis on the patient, for example, connecting the dialysis device 2 to a tube embedded in the patient's body, injecting liquid. Replace the dialysis bag and drainage bag, operate the dialysis machine 2 itself, and manage the outlet where the tube is embedded in the patient's body (observation, cleaning, disinfection, application of chemicals, etc.). And at least one of the other peritoneal dialysis-related tasks (such as keeping records).

The imaging device 3 has at least one imaging unit (camera) that images a patient performing peritoneal dialysis using the dialysis apparatus 2 or an assistant who assists the patient. The imaging device 3 outputs an captured image of a patient or an assistant performing peritoneal dialysis to the home device 1. The range imaged by the imaging device 3 may be the whole body of the patient or the assistant, or may be a part of the body of the patient or the assistant. The image pickup device 3 may be integrated with the home device 1 or may send and receive signals to and from the home device 1 by wire or wirelessly.

The management server 4 is a computer that records the information output by the home device 1 and outputs the information for the user to the information terminal 5. The user is, for example, a medical worker such as a doctor or a nurse. The management server 4 may be connected to a plurality of home devices 1 and a plurality of information terminals 5.

The information terminal 5 is a computer that accepts user operations and displays information output by the management server 4. The information terminal 5 may be integrated with the management server 4, and may send and receive signals to and from the management server 4 by wire or wirelessly. The information terminal 5 has an operation unit such as a keyboard and a mouse that can accept operations by the user, and a display unit such as a liquid crystal display that can display information.

The outline of the process of analyzing the image by the image analysis system S according to the present embodiment will be described below. First, the home device 1 uses the imaging device 3 to image a patient performing peritoneal dialysis using the dialysis device 2 or an assistant who assists the patient, and acquires an captured image.

The home device 1 identifies the posture of the patient or assistant performing peritoneal dialysis based on the acquired image. The home device 1 analyzes the peritoneal dialysis procedure performed by the patient or assistant based on the identified posture. For example, as described later, the home device 1 detects whether or not the peritoneal dialysis procedure is correct by detecting unsanitary behavior in peritoneal dialysis based on the posture of the patient or an assistant (that is,). Whether or not it meets the predetermined criteria) is determined. In addition, the home device 1 specifies in what order the patient or assistant operates parts such as clamps (fasteners) of the dialysis machine 2 based on the posture of the patient or assistant, and the specified order. Determines whether the peritoneal dialysis procedure meets the predetermined criteria based on whether the peritoneal dialysis procedure meets the predetermined order.

The home device 1 transmits the analysis result using the captured image to the management server 4. Further, the home device 1 transmits the captured image to the management server 4 when it is determined that the peritoneal dialysis procedure is incorrect. The management server 4 causes the information terminal 5 to display the analysis result and the captured image received from the home device 1.

As described above, the image analysis system S according to the present embodiment is based on an image of a patient performing peritoneal dialysis or an assistant who assists the patient, and is actually performing peritoneal dialysis by the patient or the assistant. The procedure is analyzed and the analysis result is output to users such as medical staff. Therefore, a user such as a medical worker can give appropriate guidance to the patient or the assistant based on the procedure of the peritoneal dialysis actually performed by the patient or the assistant, and the safety of the peritoneal dialysis for the patient can be given. Can be improved.

[Configuration of image analysis system S]
FIG. 2 is a block diagram of the image analysis system S according to the present embodiment. In FIG. 2, the arrows indicate the main data flows, and there may be data flows not shown in FIG. In FIG. 2, each block shows a functional unit configuration, not a hardware (device) unit configuration. Therefore, the block shown in FIG. 2 may be mounted in a single device, or may be mounted separately in a plurality of devices. Data transfer between blocks may be performed via an arbitrary means such as a data bus, a network, or a portable storage medium.

The home device 1 has a control unit 11 and a storage unit 12. The control unit 11 includes an image acquisition unit 111, a posture identification unit 112, a mask detection unit 113, a component identification unit 114, an analysis unit 115, and an output unit 116. The storage unit 12 includes an image storage unit 121, an analysis reference storage unit 122, and an analysis result storage unit 123.

The storage unit 12 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, and the like. The storage unit 12 stores in advance the program executed by the control unit 11. The storage unit 12 may be provided outside the home device 1, and in that case, data may be exchanged with the control unit 11 via a network. The image storage unit 121 stores the captured image captured by the image pickup device 3. The analysis reference storage unit 122 stores information used for analysis, such as a reference value for performing analysis and a machine learning model. The analysis result storage unit 123 stores the analysis result using the captured image. The image storage unit 121, the analysis reference storage unit 122, and the analysis result storage unit 123 may each be a storage area on the storage unit 12, or may be a database configured on the storage unit 12.

The control unit 11 is, for example, a processor such as a CPU (Central Processing Unit), and by executing a program stored in the storage unit 12, the image acquisition unit 111, the posture identification unit 112, the mask detection unit 113, and the component identification unit are executed. It functions as 114, an analysis unit 115, and an output unit 116. At least a part of the function of the control unit 11 may be executed by an electric circuit. Further, at least a part of the functions of the control unit 11 may be realized by the control unit 11 executing a program executed via the network.

The management server 4 has a control unit 41 and a storage unit 42. The control unit 41 includes a reception unit 411, an analysis unit 412, and an output unit 413. The storage unit 42 includes an image storage unit 421, an analysis reference storage unit 422, and an analysis result storage unit 423.

The storage unit 42 is a storage medium including a ROM, a RAM, a hard disk drive, and the like. The storage unit 42 stores in advance the program executed by the control unit 41. The storage unit 42 may be provided outside the management server 4, and in that case, data may be exchanged with the control unit 41 via the network. The image storage unit 421 stores the captured image captured by the image pickup device 3. The analysis reference storage unit 422 stores information used for analysis, such as a reference value for performing analysis and a machine learning model. The analysis result storage unit 423 stores the analysis result using the captured image. The image storage unit 421, the analysis reference storage unit 422, and the analysis result storage unit 423 may be storage areas on the storage unit 42, respectively, or may be a database configured on the storage unit 42.

The control unit 41 is, for example, a processor such as a CPU, and functions as a reception unit 411, an analysis unit 412, and an output unit 413 by executing a program stored in the storage unit 42. At least a part of the function of the control unit 41 may be executed by an electric circuit. Further, at least a part of the functions of the control unit 41 may be executed by a program executed via the network.

The image analysis system S according to the present embodiment is not limited to the specific configuration shown in FIG. The home device 1 and the management server 4 are not limited to one device each, and may be configured by connecting two or more physically separated devices by wire or wirelessly.

[Configuration of dialysis machine 2]
FIG. 3 is a schematic view of a dialysis machine 2 used in peritoneal dialysis. The dialysis machine 2 includes a tube embedded in the abdomen of the patient, a filling bag B1 for holding the dialysate before being injected into the patient's body, and a drainage device for holding the dialysate after being discharged from the patient's body. An instrument that connects to a liquid bag B2 and controls the transport of dialysate between them.

The dialysis machine 2 communicates the tube embedded in the abdomen of the patient with the liquid injection bag B1 and the drainage bag B2 via a tube 21 (tube). The tube 21 is connected to a patient-side connector 22 for connecting to a tube embedded in the patient's abdomen, a liquid-injection side connector 23 for connecting to the liquid-injection bag B1, and a drainage bag B2. It has a drainage side connector 24. The tube 21 is branched in three directions by the branch portion 25 into the tube embedded in the abdomen of the patient, the fluid injection bag B1 and the drainage bag B2.

In the middle of the pipe 21, a plurality of clamps 26 (clamps) that can be switched between an open state and a closed state according to an operation by the user are provided. The clamp 26 in the open state allows the dialysate to pass through the tube 21. The clamp 26 in the closed state makes it impossible for the dialysate to pass through the tube 21. Since the shape of the clamp 26 changes between the open state and the closed state, the home device 1 can specify whether the clamp 26 is in the open state or the closed state based on the appearance in the captured image.

In the example of FIG. 3, the plurality of clamps 26 include a patient side clamp 26a, a liquid injection side clamp 26b, and a drainage side clamp 26c. A patient-side clamp 26a is provided between the patient-side connector 22 and the branch portion 25. A liquid injection side clamp 26b is provided between the liquid injection side connector 23 and the branch portion 25. A drainage side clamp 26c is provided between the drainage side connector 24 and the branch portion 25. The plurality of clamps 26 are not limited to the example of FIG. 3, and may have other numbers or may be provided at other positions.

Since the plurality of clamps 26 have different colors or patterns, the home device 1 can identify each of the plurality of clamps 26 based on the appearance in the captured image. Further, by making the plurality of clamps 26 different from each other, the home device 1 may be able to identify each of the plurality of clamps 26 based on the appearance in the captured image.

The dialysis machine 2 is not limited to the configuration shown in FIG. 3, and may have other configurations. For example, the dialysis machine 2 may include a control device that electrically controls the transport of dialysate. In this case, the control device is connected to a tube implanted in the patient's abdomen via a tube 21 to electrically control the infusion and drainage of dialysate. A plurality of clamps 26 are provided in the middle of the tube 21 connecting the control device and the tube embedded in the abdomen of the patient, and the patient or an assistant holds the plurality of clamps 26 before and after starting the control by the control device. Manipulate.

[Explanation of image analysis method]
Hereinafter, the image analysis method executed by the image analysis system S according to the present embodiment will be described in detail. First, the home device 1 starts imaging of a patient or an assistant by the imaging device 3. At this time, the home device 1 starts imaging when the patient or an assistant performs a predetermined operation (for example, pressing the start button provided on the home device 1 or the dialysis device 2). Alternatively, the home device 1 may automatically start imaging when certain conditions (eg, the control device included in the dialysis machine 2 is turned on) are met. Further, in the home device 1, when the patient or an assistant performs a predetermined operation (for example, pressing the end button provided on the home device 1 or the dialysis device 2), or a predetermined condition (for example, the control included in the dialysis device 2). When the power of the device is turned off) is satisfied, the imaging is terminated. The home device 1 may collectively analyze the captured images from the start to the end of the imaging, or may sequentially analyze the captured images at predetermined time intervals after the start of the imaging.

In the home device 1, the image acquisition unit 111 acquires an image taken by the image pickup device 3 and images a patient or an assistant who is performing peritoneal dialysis using the dialysis device 2, and stores the image in the image storage unit 121. .. The captured image may be a moving image or a plurality of still images captured at predetermined time intervals. The captured image may be one image in which one imaging range is captured, or may be a set of a plurality of images in which a plurality of different imaging ranges are captured at the same time.

FIG. 4 is a diagram showing a captured image IM acquired by the image acquisition unit 111. FIG. 4 represents a region including a patient in the captured image IM. The posture specifying unit 112 identifies the patient's posture P based on the captured image acquired by the image acquisition unit 111. The posture P specified by the posture specifying unit 112 may be the posture of the whole body of the patient, or may be the position of the specific part of the patient. For example, the posture specifying unit 112 calculates the coordinates of a plurality of joint points included in the captured image IM by a human using a posture estimation model, and sets the calculated coordinates of the plurality of joint points as the posture of the patient. Specified as P. The posture specifying unit 112 is not limited to the method shown here, and a known posture estimation method capable of estimating the human posture P can be used. The posture specifying unit 112 outputs posture information indicating the posture P of the specified patient (for example, coordinates of a plurality of joint points of the patient). Further, the posture specifying unit 112 may specify the posture of the assistant based on the captured image in the same manner.

The mask detection unit 113 detects the mask M worn by the patient or the assistant based on the captured image acquired by the image acquisition unit 111. For example, the mask detection unit 113 detects the mask M included in the captured image IM by using the object recognition model. The mask detection unit 113 is not limited to the method shown here, and a known object detection method capable of detecting the mask M can be used. The mask detection unit 113 outputs mask detection information indicating whether or not the mask M worn by the patient or the assistant has been detected (for example, the coordinates of the mask M). In this way, the mask detection unit 113 determines whether the patient or the assistant is performing peritoneal dialysis in a hygienic state by outputting information indicating whether or not the patient or the assistant is wearing the mask M. Can be made possible.

FIG. 5 is a diagram showing a captured image IM acquired by the image acquisition unit 111. FIG. 5 shows a region of the dialysis machine 2 including a plurality of clamps 26 (patient side clamp 26a, liquid injection side clamp 26b, and drainage side clamp 26c) in the captured image IM. The component identification unit 114 specifies the position and state of each of the plurality of clamps 26, which are a plurality of components included in the dialysis machine 2, based on the captured image acquired by the image acquisition unit 111. For example, the component identification unit 114 identifies the positions of the plurality of clamps 26 included in the captured image IM by using the object recognition model, and each of the plurality of clamps 26 is in the open state or the closed state. To identify. As described above, the positions and states of the plurality of clamps 26 can be specified from the captured image IM based on the colors and shapes of the plurality of clamps 26. The part identification unit 114 is not limited to the method shown here, and a known object detection method capable of specifying the state of the clamp 26 can be used. The component specifying unit 114 outputs component information indicating the position and state of each of the specified plurality of clamps 26. The component identification unit 114 is not limited to the clamp 26, and may output component information indicating the position and state of other components included in the dialysis machine 2.

The posture P is specified by the posture specifying unit 112, the mask M is detected by the mask detecting unit 113, and the clamp 26 is specified by the component specifying unit 114, which may be performed in parallel or in any order. ..

The analysis unit 115 analyzes the procedure of peritoneal dialysis performed by the patient or the assistant based on the posture P of the patient or the posture of the assistant indicated by the posture information output by the posture identification unit 112. The analysis of the peritoneal dialysis procedure by the analysis unit 115 is to analyze whether the patient or assistant is performing unsanitary behavior in peritoneal dialysis and whether the patient or assistant is operating the plurality of clamps 26 in the correct order. Including analysis. Specifically, first, in the analysis unit 115, the time stamp of the captured image used by the posture specifying unit 112 to specify the posture P and the captured image used by the component specifying unit 114 to specify the state of the clamp 26. By associating with the time stamp of, the time of the posture information output by the posture specifying unit 112 and the part information output by the part specifying unit 114 are matched.

Next, when the posture information includes a plurality of human postures P, the analysis unit 115 selects the posture P of any one of them as the posture P of the patient. For example, the analysis unit 115 selects the patient's posture P based on the past posture information. In this case, the analysis unit 115 sets the posture P of the patient, which is the closest to the posture P of the patient specified at the previous timing in the time series, among the plurality of human postures P specified at a certain timing. Select as P. Alternatively, the analysis unit 115 may select the posture P closest to the clamp 26 among the plurality of human postures P identified at a certain timing as the patient posture P.

Next, the analysis unit 115, as an unsanitary act performed by the patient or the assistant in peritoneal dialysis, is based on the posture P of the patient or the posture of the assistant indicated by the posture information output by the posture identification unit 112, other than the dialysis device 2. Calculate the number of times you touched the object. For example, the analysis unit 115 calculates the number of times the patient touches the patient's own head. The head includes the patient's face and hair. At this time, the analysis unit 115 calculates the distance between the position of the hand and the position of the head in the posture P of the patient, and when the distance becomes equal to or less than a predetermined value, the number of times the patient touches the head is 1. Is added to calculate the number of times the patient touches the head. The analysis unit 115 may calculate the number of times the patient or an assistant touches not only the patient's head but also other objects that should not be touched during peritoneal dialysis. Then, the analysis unit 115 evaluates the degree of hygiene of the peritoneal dialysis procedure based on the calculated number of times.

For example, the analysis unit 115 calculates the higher the number of calculations, the lower the score indicating the degree of hygiene, and the smaller the number of calculations, the higher the score indicating the degree of hygiene. The analysis unit 115 sends the number of times the patient or assistant touches an object other than the dialysis machine 2 and the information (score) indicating the degree of hygiene evaluated based on the number of times to the analysis result storage unit 123 as an analysis result. Remember. In this way, the analysis unit 115 calculates the number of times the patient or assistant touches an object other than the dialysis device 2, so that the user such as a medical worker performs an unsanitary act in peritoneal dialysis by the patient or assistant. You can understand that you are there and give appropriate guidance.

Next, the analysis unit 115 determines the posture P of the patient or the posture of the assistant indicated by the posture information output by the posture specifying unit 112, and the positions and states of the plurality of parts indicated by the component information output by the component specifying unit 114. Based on this, it is determined whether or not the patient or assistant has operated the part. Hereinafter, the process performed by the analysis unit 115 will be described using the clamp 26 as a component included in the dialysis machine 2.

The analysis unit 115 is at least one of the posture P of the patient or the posture of the assistant indicated by the posture information output by the posture specifying unit 112 and the position and state of each of the plurality of clamps 26 indicated by the component information output by the component specifying unit 114. Based on the above, it is determined whether or not the patient or the assistant has operated the clamp 26. At this time, the analysis unit 115 calculates the distance between the position of the hand in the posture P of the patient or the posture of the assistant and the position of each of the plurality of clamps 26, and when the distance becomes equal to or less than a predetermined value, the patient Alternatively, it is determined that the assistant has touched the clamp 26 (that is, operated the clamp 26).

When the analysis unit 115 determines that the patient or assistant has touched the clamp 26, the identification information of the clamp 26 touched by the patient or assistant (that is, which of the plurality of clamps 26 the patient or assistant has touched) and , The time when the patient or assistant touches the clamp 26 is associated with the state of the clamp 26 when the patient or assistant touches it. The state of the clamp 26 is information indicating, for example, whether the clamp 26 is in the open state or the closed state. The analysis unit 115 specifies the order in which the patient or the assistant operates the plurality of clamps 26 by repeating the determination of the operation of the clamp 26 by the patient in chronological order for the captured image IM from the start to the end of the peritoneal dialysis. ..

Further, the analysis unit 115 may specify the order in which the patient or the assistant operates the plurality of clamps 26 based on the posture of the patient or the assistant and the position of the clamp 26 without using the state of the clamp 26. .. In this case, the analysis unit 115 associates the identification information of the clamp 26 touched by the patient or the assistant with the time when the patient or the assistant touches the clamp 26, so that the patient or the assistant has a plurality of clamps. Specify the order in which 26 was operated. With such a configuration, the analysis unit 115 operates the parts based on the relationship between the posture of the patient or the assistant and the position of the parts even when the state change of the parts of the dialysis machine 2 is not specified. The order can be estimated.

The analysis unit 115 compares the specified order with a predetermined reference order stored in advance in the analysis reference storage unit 122. The reference order is how the plurality of clamps 26 included in the dialysis machine 2 are operated in what order and how (for example, whether the clamp 26 is switched between the open state and the closed state, or the clamp 26 touches. It is information indicating whether it was done). The analysis unit 115 determines that the peritoneal dialysis procedure performed by the patient or assistant is incorrect when the specified order does not match the reference order (that is, when the predetermined criteria are not met). If this is not the case, the procedure of peritoneal dialysis performed by the patient or assistant is determined to be correct. By analyzing the peritoneal dialysis procedure based on the operation sequence of the plurality of clamps 26 in this way, the analysis unit 115 accurately determines whether the peritoneal dialysis procedure is correct (that is, whether or not it meets a predetermined criterion). ) Can be determined.

The analysis unit 115 specifies the order in which the patient or the assistant operates not only the clamp 26 but also other parts (for example, the infusion bag B1 and the drainage bag B2) provided in the dialysis machine 2, and in the specified order. Based on this, it may be determined whether the peritoneal dialysis procedure meets a predetermined criterion. In this case, the analysis unit 115 determines the order in which the patient or assistant operates the parts of the dialysis machine 2 based on the posture of the patient or the assistant and at least one of the positions and states of the parts of the dialysis machine 2. Identify.

The analysis unit 115 determines, as an analysis result, the order in which the patient or an assistant operates a plurality of parts (clamps 26) and whether or not the peritoneal dialysis procedure based on the order meets a predetermined criterion. It is stored in the analysis result storage unit 123.

6 (a) and 6 (b) are diagrams showing the captured image IM acquired by the image acquisition unit 111. 6 (a) and 6 (b) represent a region in the captured image IM including the outlet to which the dialysis device 2 is connected in the patient's body. The outlet portion is a portion of the abdomen of the patient's body in which a tube (catheter) connected to the dialysis device 2 is pre-embedded. By connecting the tube at the outlet to the tube 21 of the dialysis machine 2, the patient's body (in the abdominal cavity) and the tube 21 of the dialysis machine 2 communicate with each other, and the dialysate can be injected and discharged.

If the area around the outlet becomes unsanitary, infection by bacteria or the like may occur. If peritoneal dialysis is continued with an infection at the outlet, bacteria or the like may invade the patient's body and cause a more serious infection such as peritonitis. FIG. 6A shows a state in which no infection has occurred in the outlet portion, and FIG. 6B shows a state in which infection has occurred in the outlet portion. As shown in FIGS. 6A and 6B, there is a correlation between the appearance of the outlet portion included in the captured image IM and the degree of hygiene of the outlet portion. Therefore, the analysis unit 115 evaluates the degree of hygiene at the outlet portion based on the captured image IM.

The analysis reference storage unit 122 stores in advance information indicating a machine learning model that outputs information (score) indicating the degree of hygiene of the exit portion included in the image by inputting the image. The machine learning model is generated by learning in advance an image and a score (score) indicating the degree of hygiene at the exit portion included in the image by a known machine learning method. The degree of hygiene score is determined according to, for example, the size of the swelling, the size of the scab, the size of the flare, the intensity of pain, and the type of exudate. In this embodiment, the score is determined so that the higher the score, the worse the hygiene. Scores are not limited to the definitions given here.

The analysis unit 115 acquires a score indicating the degree of hygiene at the exit unit by inputting the captured image IM into the machine learning model stored in advance in the analysis reference storage unit 122. The analysis unit 115 stores the acquired score indicating the degree of hygiene at the exit unit in the analysis result storage unit 123 as an analysis result. It takes a lot of time for a user such as a medical worker to judge the degree of hygiene at the exit from the captured image IM every time, but the analysis unit 115 automatically determines the degree of hygiene at the exit by using a machine learning model. Can be evaluated.

In the present embodiment, the analysis unit 115 uses the captured image IM captured by the imaging device 3 installed in the house, but the captured image captured by the imaging unit of the communication terminal (smartphone or the like) possessed by the patient or the assistant. IM may be used. In this case, the patient or the assistant images the exit portion using the imaging unit of the communication terminal at any timing of the start, the middle, and the end of the peritoneal dialysis. The image acquisition unit 111 of the home device 1 acquires an image IM including an outlet image imaged by the communication terminal by communication. Then, the analysis unit 115 acquires a score indicating the degree of hygiene at the exit portion by using the captured image IM acquired from the communication terminal.

Further, the analysis unit 115 may evaluate the degree of hygiene based on the surrounding environment of the patient and the dialysis machine 2 included in the captured image IM. For example, the analysis unit 115 uses a known object detection method to detect a predetermined object (food or dust) that causes unsanitary conditions around the patient and the dialysis machine 2 in the captured image IM. Then, the analysis unit 115 calculates information (score) indicating the degree of hygiene based on the number and types of detected objects in addition to the state of the outlet portion included in the captured image IM. As a result, the analysis unit 115 can evaluate the degree of hygiene in consideration of the patient and the surrounding environment of the dialysis machine 2.

Further, the analysis unit 115 may evaluate the degree of hygiene based on at least one of the patient's biological information, the patient's medication information, and the drainage information of the dialysate discharged from the patient's body. In this case, the analysis unit 115 acquires biological information such as body temperature, blood pressure, and pulse rate from a sensor provided on the patient's body. In addition, the analysis unit 115 acquires the patient's medication information (drug name, etc.) stored in advance in the storage unit 12. In addition, the analysis unit 115 acquires drainage information such as the color and components of the dialysate after being discharged from the patient's body from a sensor provided in the dialysis machine 2.

Then, the analysis unit 115 calculates information (score) indicating the degree of hygiene based on the acquired biological information, medication information, and drainage information in addition to the state of the outlet portion included in the captured image IM. .. Specifically, the analysis unit 115 adds a predetermined value to the score when it indicates that the biological information is different from the state of a normal patient (for example, fever). This is because the patient may have an infection if the patient is not in a normal condition.

Further, the analysis unit 115 adds a predetermined value to the score when the medication information indicates administration of a predetermined drug (for example, a prescription drug for diabetes). This is because patients with diabetes and the like are at high risk of infectious diseases. Further, when the analysis unit 115 indicates that the drainage information is different from the normal drainage state (for example, the drainage is turbid), the analysis unit 115 adds a predetermined value to the score. This is because the patient may have an infection if the drainage is not normal.

In this way, the analysis unit 115 calculates a score indicating the degree of hygiene based on the biological information, the medication information, and the drainage information in addition to the captured image IM including the outlet part, thereby performing hygiene with higher accuracy. The degree can be evaluated.

The output unit 116 manages the attitude information output by the attitude identification unit 112, the mask detection information output by the mask detection unit 113, the component information output by the component identification unit 114, and the analysis result by the analysis unit 115. Output by transmitting to 4. The analysis result is the number of times the patient or assistant touches an object other than the dialysis machine 2, information indicating the degree of hygiene evaluated based on the number of times, and the order in which the patient or assistant operates a plurality of parts (clamp 26). Includes a determination of whether the peritoneal dialysis procedure based on the sequence meets predetermined criteria, and a score indicating the degree of hygiene at the outlet. Only a part of the analysis result may be transmitted to the management server 4. The output unit 116 is not limited to transmission to the management server 4, and outputs analysis results by other methods such as recording data in a storage device, printing on paper using a printer, and outputting voice using a speaker. You may.

Further, the output unit 116 determines whether or not the peritoneal dialysis procedure based on the order in which the patient or an assistant operates a plurality of parts (clamps 26) meets a predetermined criterion under a predetermined condition (for example, peritoneal dialysis). If the procedure of (1) is not correct), the captured image IM is transmitted to the management server 4. As a result, the output unit 116 transmits the captured image to the outside of the home device 1 only when it is determined that there is an abnormality in the peritoneal dialysis procedure, for example, so that the amount of communication data performed by the home device 1 can be reduced. it can.

Further, the output unit 116 may output a notification to at least one of the patient and the user when the score indicating the degree of hygiene at the outlet unit satisfies a predetermined condition stored in advance in the analysis reference storage unit 122. The condition for outputting the notification is, for example, that the score is equal to or higher than a predetermined value. The notification includes the fact that the hygiene of the exit portion is poor, is transmitted to a communication terminal (smartphone or the like) owned by the patient or an assistant, or an information terminal 5 used by the user, and is output by screen display or voice. Further, when the score indicating the degree of hygiene at the outlet section satisfies a predetermined condition and the dialysis machine 2 includes a control device for electrically controlling the transportation of the dialysate, the output unit 116 is a dialysis machine. Information (signal) for stopping 2 may be output. The condition for stopping the dialysis machine 2 is, for example, that the score is equal to or higher than a predetermined value. As a result, the output unit 116 can provide feedback to the patient or the user based on the score indicating the degree of hygiene at the outlet unit.

The condition for outputting the notification and the condition for stopping the dialysis machine 2 may be different from each other. As a result, the output unit 116 outputs a notification when, for example, the degree of hygiene satisfies the first condition, and forces the dialysis machine 2 when the degree of hygiene satisfies the second condition different from the first condition. Can be stopped at.

In the management server 4, the receiving unit 411 receives the posture information, the mask detection information, the component information, and the analysis result transmitted by the home device 1, and stores them in the analysis result storage unit 423. In addition, the receiving unit 411 receives the captured image IM transmitted by the home device 1 and stores it in the image storage unit 421.

The analysis unit 412 acquires the posture information, mask detection information, component information, and analysis result transmitted by the home device 1. Then, the analysis unit 412 performs additional analysis on the acquired posture information, mask detection information, component information, and analysis result. For example, the analysis unit 412 calculates the operation time of each of the plurality of steps included in the order in which the patient or the assistant including the analysis result operates the plurality of parts (clamps 26) of the dialysis machine 2. Specifically, the analysis unit 412 starts the operation of at least one of the plurality of clamps 26 in the order in which the patient or the assistant operates the plurality of clamps 26 (for example, to the clamp 26). The time from touching to the end of the operation of the clamp 26 (for example, until the clamp 26 is released) is calculated as the operation time of one step. The analysis unit 412 repeats the calculation of the operation time for the captured image IM from the start to the end of peritoneal dialysis in chronological order, so that each of the plurality of steps included in the order in which the patient or the assistant operates the plurality of clamps 26. Calculate the operation time.

The analysis unit 412 determines whether or not the peritoneal dialysis procedure is smooth based on the calculated operation time of each of the plurality of steps, and outputs information indicating whether or not the peritoneal dialysis procedure is smooth as an analysis result. For example, the analysis unit 412 determines that the peritoneal dialysis procedure is not smooth when at least one operation time out of the calculated plurality of steps is longer than a predetermined reference time, and when it is not, the peritoneal dialysis procedure is performed. Judge as smooth. In this way, the analysis unit 412 can calculate the operation time of each of the plurality of steps, so that the user such as a medical worker can grasp at which step the patient or the assistant is confused and can give appropriate guidance. .. The analysis unit 412 is not limited to the analysis shown here, and may perform other analysis.

In the image analysis system S, it is assumed that the home device 1 (edge device) has a low computing power because it is provided in each home, and the management server 4 has a higher computing power than the home device 1. In such a configuration, the analysis unit 412 of the management server 4 can suppress the load on the home device 1 by performing additional analysis that is not performed on the home device 1. On the other hand, the management server 4 may omit the analysis by the analysis unit 412 and use the analysis result transmitted by the home device 1 as it is.

The output unit 413 outputs the analysis result transmitted by the home device 1 and the analysis result output by the analysis unit 412 by transmitting the analysis result to the information terminal 5. The information terminal 5 outputs the analysis result transmitted by the management server 4 by screen display or voice. Further, the output unit 413 may transmit the mask detection information transmitted by the home device 1 to the information terminal 5. Further, the output unit 413 may transmit the captured image IM transmitted by the home device 1 to the information terminal 5.

[Sequence of image analysis method]
FIG. 7 is a sequence diagram of an image analysis method executed by the image analysis system S according to the present embodiment. First, the home device 1 starts imaging of a patient or an assistant by the imaging device 3. The image acquisition unit 111 acquires an image captured by the imaging device 3 that captures an image of a patient performing peritoneal dialysis using the dialysis device 2 or an assistant who assists the patient (S11).

The posture specifying unit 112 specifies the posture P of the patient or the posture of the assistant based on the captured image acquired by the image acquisition unit 111 (S12). The mask detection unit 113 detects the mask M worn by the patient or the assistant based on the captured image acquired by the image acquisition unit 111 (S13). The component identification unit 114 specifies the position and state of each of the plurality of components (clamps 26) based on the captured image acquired by the image acquisition unit 111 (S14).

The analysis unit 115 calculates the number of times the patient or the assistant touches an object other than the dialysis device 2 based on the posture P of the patient or the posture of the assistant indicated by the posture information output by the posture specifying unit 112 (S15). .. The analysis unit 115 includes at least one of the patient's posture P or the posture of the assistant indicated by the posture information output by the posture specifying unit 112 and the position and state of each of the plurality of parts indicated by the component information output by the component specifying unit 114. Based on, it is determined whether or not the patient or the assistant has operated the part. The analysis unit 115 identifies the order in which the patient or the assistant operates the plurality of parts by repeating the determination of the operation of the parts by the patient in chronological order (S16).

The analysis unit 115 calculates information (score) indicating the degree of hygiene based on the calculated number of times. In addition, the analysis unit 115 determines that the peritoneal dialysis procedure performed by the patient or assistant is incorrect when the specified order does not match the reference order (that is, when the predetermined order is not met). If not, it is determined that the peritoneal dialysis procedure performed by the patient or assistant is correct (S17).

The analysis unit 115 evaluates the degree of hygiene at the outlet portion based on the captured image IM (S18). The output unit 116 manages the attitude information output by the attitude identification unit 112, the mask detection information output by the mask detection unit 113, the component information output by the component identification unit 114, and the analysis result by the analysis unit 115. It is output by transmitting to 4. (S19). At this time, the output unit 116 determines whether or not the peritoneal dialysis procedure based on the order in which the patient or the assistant operates a plurality of parts meets a predetermined criterion under a predetermined condition (for example, the peritoneal dialysis procedure). If it is not correct), the captured image IM may be transmitted to the management server 4.

In the management server 4, the receiving unit 411 receives the posture information, the mask detection information, the component information, and the analysis result transmitted by the home device 1. The analysis unit 412 calculates the operation time of each of the plurality of steps included in the order in which the patient or the assistant operates the plurality of parts included in the analysis result (S20). The analysis unit 412 outputs the calculated operation time of each of the plurality of steps as an analysis result.

The output unit 413 outputs the analysis result transmitted by the home device 1 and the analysis result output by the analysis unit 412 by transmitting the analysis result to the information terminal 5 (S21). The information terminal 5 outputs the analysis result transmitted by the management server 4 by screen display or voice.

[Effect of Embodiment]
The image analysis system S according to the present embodiment identifies the patient's posture or the assistant's posture from the captured image of the patient performing peritoneal dialysis or the assistant who assists the patient, and the patient is based on the specified posture. Alternatively, the procedure of peritoneal dialysis actually performed by the assistant is analyzed, and the analysis result is output to a user such as a medical worker. Therefore, a user such as a medical worker can give appropriate guidance to the patient based on the peritoneal dialysis procedure actually performed by the patient or an assistant, and can improve the safety of the peritoneal dialysis for the patient. ..

(Second Embodiment)
In the first embodiment, the home device 1 mainly performs the analysis, whereas in the present embodiment, the management server 4 mainly performs the analysis. Hereinafter, a configuration different from that of the first embodiment will be described.

FIG. 8 is a block diagram of the image analysis system S according to the present embodiment. The home device 1 according to the present embodiment does not have an analysis unit 115, unlike the configuration shown in FIG. Instead, the analysis unit 412 of the management server 4 performs the analysis performed by the analysis unit 115 in the first embodiment. That is, in the present embodiment, the home device 1 functions as an image acquisition device, and the management server 4 functions as an image analysis device.

Specifically, in the home device 1, the output unit 116 obtains the posture information output by the posture specifying unit 112, the mask detection information output by the mask detection unit 113, and the component information output by the component identification unit 114. It is output by transmitting it to the management server 4 as information used for analysis. Unlike the first embodiment, the output unit 116 does not transmit the analysis result. The output unit 116 may transmit after matching the time of the posture information output by the posture specifying unit 112 and the component information output by the component specifying unit 114.

In the management server 4, the receiving unit 411 receives the posture information, the mask detection information, and the component information transmitted by the home device 1 as information used for analysis. Similar to the analysis unit 115 of the first embodiment, the analysis unit 412 calculates and calculates the number of times the patient or assistant touches an object other than the dialysis device 2 based on the posture information transmitted by the home device 1. Evaluate the degree of hygiene in the peritoneal dialysis procedure based on the number of times The analysis unit 412 stores in the analysis result storage unit 423 as an analysis result the number of times the patient or assistant touches an object other than the dialysis machine 2 and the information indicating the degree of hygiene evaluated based on the number of times.

Further, in the analysis unit 412, similarly to the analysis unit 115 of the first embodiment, the patient or an assistant operates a plurality of parts (clamps 26) based on the posture information and the part information transmitted by the home device 1. The order is specified and based on the specified order, it is determined whether the peritoneal dialysis procedure is correct (ie, meets certain criteria). The analysis unit 412 determines the order in which the patient or an assistant operates a plurality of parts and whether or not the peritoneal dialysis procedure based on the order meets a predetermined criterion, as an analysis result storage unit. Store in 423.

Further, the analysis unit 412 calculates the operation time of each of the plurality of steps included in the order in which the patient or the assistant operates the plurality of parts, as in the first embodiment. The analysis unit 412 stores the calculated operation time of each of the plurality of steps in the analysis result storage unit 423 as an analysis result.

The output unit 413 outputs the analysis result by the analysis unit 412 by transmitting it to the information terminal 5. The information terminal 5 outputs the analysis result transmitted by the management server 4 by screen display or voice. Further, the output unit 413 may transmit the mask detection information transmitted by the home device 1 to the information terminal 5. In the present embodiment, since the home device 1 does not perform analysis, the computing power of the home device 1 can be configured low, and the cost for introducing the home device 1 in the patient's home can be reduced.

The analysis unit 412 may evaluate the degree of hygiene at the outlet portion based on the captured image IM. In this case, the output unit 116 of the home device 1 transmits the captured image IM to the management server 4 in addition to the posture information, the mask detection information, and the component information. In the management server 4, the receiving unit 411 receives the captured image IM transmitted by the home device 1 and stores it in the image storage unit 421. The analysis unit 412 evaluates the degree of hygiene at the outlet portion based on the captured image IM, similarly to the analysis unit 115 of the first embodiment. The analysis unit 412 stores the acquired score indicating the degree of hygiene at the exit portion in the analysis result storage unit 423 as an analysis result. As a result, the management server 4 instead of the home device 1 can evaluate the degree of hygiene at the exit portion.

The information terminal 5 may accept an input for requesting the captured image IM from a user such as a medical worker who has referred to the analysis result. When the information terminal 5 receives an input for requesting the captured image IM from the user, the output unit 413 transmits the request for the captured image IM to the home device 1. Further, the output unit 413 determines whether or not the peritoneal dialysis procedure based on the order in which the patient or the assistant operates a plurality of parts conforms to a predetermined standard under a predetermined condition (for example, the peritoneal dialysis procedure). If it is not correct), the request for the captured image IM may be automatically transmitted to the home device 1.

In the home device 1, the output unit 116 receives the request for the captured image IM from the management server 4, and the first peritoneal dialysis after the next peritoneal dialysis (that is, the output unit 116 receives the request for the captured image IM). The captured image IM imaged in (dialysis) is transmitted to the management server 4. In the management server 4, the receiving unit 411 receives the captured image IM transmitted by the home device 1 and stores it in the image storage unit 421. The output unit 413 transmits the captured image IM transmitted by the home device 1 to the information terminal 5. With such a configuration, the home device 1 transmits the next captured image IM to the management server 4 in response to the user's request even when the captured image IM is not recorded, and the user can record the captured image IM. It can be confirmed.

[Sequence of image analysis method]
FIG. 9 is a sequence diagram of an image analysis method executed by the image analysis system S according to the present embodiment. Steps S11 to S14 are the same as in FIG. 7. The output unit 116 transmits the attitude information output by the attitude identification unit 112, the mask detection information output by the mask detection unit 113, and the component information output by the component identification unit 114 to the management server 4 as information used for analysis. Output by doing (S15').

In the management server 4, the receiving unit 411 receives the posture information, the mask detection information, and the component information transmitted by the home device 1 as information used for analysis. The analysis unit 412 calculates the number of times the patient or assistant touches an object other than the dialysis device 2 based on the posture information transmitted by the home device 1, and based on the calculated number of times, the degree of hygiene of the peritoneal dialysis procedure. Is evaluated (S16'). The analysis unit 412 identifies the order in which the patient or the assistant operates the plurality of parts (clamps 26) of the dialysis machine 2 based on the posture information and the parts information transmitted by the home device 1 (S17').

The analysis unit 412 calculates information (score) indicating the degree of hygiene based on the calculated number of times. In addition, the analysis unit 412 determines that the peritoneal dialysis procedure performed by the patient or assistant is incorrect when the specified order does not match the reference order, and when the specified order does not match, the patient or assistant determines that the procedure is incorrect. It is determined that the procedure of peritoneal dialysis performed is correct (S18').

The analysis unit 412 evaluates the degree of hygiene at the outlet based on the captured image IM transmitted by the home device 1 (S19'). The analysis unit 412 calculates the operation time of each of the plurality of steps included in the order in which the patient or the assistant operates the plurality of parts (S20').

The output unit 413 outputs the analysis result by the analysis unit 412 by transmitting it to the information terminal 5 (S21'). The information terminal 5 outputs the analysis result transmitted by the management server 4 by screen display or voice.

[Effect of Embodiment]
According to the image analysis system S according to the present embodiment, as in the first embodiment, the user such as a medical worker treats the patient based on the procedure of peritoneal dialysis actually performed by the patient or an assistant. It is possible to give appropriate guidance and improve the safety of peritoneal dialysis for patients. Further, since the management server 4 mainly performs the analysis instead of the home device 1, the cost for introducing the home device 1 can be reduced.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist thereof. is there. For example, all or a part of the device can be functionally or physically distributed / integrated in any unit. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination has the effect of the original embodiment.

The processor of the home device 1 and the management server 4 is the main body of each step included in the image analysis methods shown in FIGS. 7 and 9. That is, the processors of the home device 1 and the management server 4 read a program for executing the image analysis method shown in FIGS. 7 and 9 from the storage unit, and execute the program to control each part of the image analysis system S. As a result, the image analysis methods shown in FIGS. 7 and 9 are executed. Some of the steps included in the image analysis methods shown in FIGS. 7 and 9 may be omitted, the order between the steps may be changed, and a plurality of steps may be performed in parallel.

S Image analysis system 1 Home device 11 Control unit 111 Image acquisition unit 112 Posture identification unit 113 Mask detection unit 114 Part identification unit 115 Analysis unit 116 Output unit 4 Management server 41 Control unit 411 Reception unit 412 Analysis unit 413 Output unit

Claims (13)

An image acquisition unit that acquires an image of a patient undergoing peritoneal dialysis using a dialysis machine or an assistant who assists the patient.
A posture specifying unit that identifies the posture of the patient or the assistant based on the captured image, and
An analysis unit that analyzes the peritoneal dialysis procedure performed by the patient or the assistant based on the posture.
An output unit that outputs the analysis results by the analysis unit,
An image analysis device. Further having a component identification unit that specifies at least one of the positions and states of the components included in the dialysis machine based on the captured image.
The analysis unit determines whether or not the procedure meets a predetermined criterion based on the posture and at least one of the positions and states of the parts.
The image analysis apparatus according to claim 1, wherein the output unit outputs information indicating whether or not the procedure conforms to the predetermined criteria as the analysis result. The component identification unit identifies at least one of the positions and states of each of the plurality of components included in the dialysis machine.
The analysis unit identifies the order in which the patient or the assistant operates the plurality of parts based on the posture and at least one of the positions and states of the plurality of parts, and the specified order and predetermined order. The image analysis apparatus according to claim 2, wherein it is determined whether or not the procedure conforms to the predetermined reference by comparing with the reference order. The analysis unit calculates the operation time when the patient or the assistant operates at least one of the plurality of the parts in the specified order, and whether or not the procedure is smooth based on the calculated operation time. Judge whether
The image analysis apparatus according to claim 3, wherein the output unit outputs information indicating whether or not the procedure is smooth as the analysis result. According to any one of claims 2 to 4, when the analysis unit determines that the procedure does not meet the predetermined criteria, the output unit transmits the captured image to the outside of the image analysis device. The image analyzer described. The analysis unit calculates the number of times the patient or the assistant touches an object other than the dialysis machine based on the posture, and evaluates the degree of hygiene of the procedure based on the calculated number of times.
The image analysis apparatus according to any one of claims 1 to 5, wherein the output unit outputs information indicating the degree of hygiene as the analysis result. It further has a mask detection unit that detects a mask worn by the patient or the assistant based on the captured image.
The image analysis apparatus according to any one of claims 1 to 6, wherein the output unit outputs information indicating whether or not the mask detection unit has detected the mask. The image acquisition unit acquires the captured image including the outlet portion to which the dialysis machine is connected in the patient's body.
The analysis unit evaluates the degree of hygiene at the outlet portion based on the captured image, and evaluates the degree of hygiene at the outlet portion.
The image analysis apparatus according to any one of claims 1 to 7, wherein the output unit outputs information indicating the degree of hygiene as the analysis result. By inputting the captured image into a machine learning model that outputs information indicating the degree of hygiene of the outlet portion included in the captured image, the analysis unit inputs the captured image to the outlet portion. The image analysis apparatus according to claim 8, which acquires information indicating the degree of hygiene of the image. The output unit performs at least one of outputting a predetermined notification and outputting information for stopping the dialysis machine when the degree of hygiene of the outlet unit satisfies a predetermined condition. Item 8. The image analysis apparatus according to Item 8. The processor runs,
A step of acquiring an image of a patient undergoing peritoneal dialysis using a dialysis machine or an assistant assisting the patient, and a step of acquiring an image.
A step of identifying the posture of the patient or the assistant based on the captured image, and
A step of analyzing the peritoneal dialysis procedure performed by the patient or the assistant based on the posture, and
The step of outputting the analysis result by the above-mentioned analysis step and
An image analysis method having. It is provided with an image acquisition device and an image analysis device capable of communicating with the image acquisition device.
The image acquisition device is
An image acquisition unit that acquires an image of a patient undergoing peritoneal dialysis using a dialysis machine or an assistant who assists the patient.
A posture specifying unit that identifies the posture of the patient or the assistant based on the captured image, and
A transmission unit that transmits information indicating the posture to the image analysis device, and
Have,
The image analysis device is
A receiving unit that receives information indicating the posture from the image acquisition device, and
An analysis unit that analyzes the peritoneal dialysis procedure performed by the patient or the assistant based on the posture.
An output unit that outputs the analysis results by the analysis unit,
An image analysis system that has. The output unit of the image analysis device transmits a request for the captured image to the image acquisition device when a predetermined input is received from the user or when the analysis result satisfies a predetermined condition.
The image analysis system according to claim 12, wherein the transmission unit of the image acquisition device transmits the captured image to the image analysis device on condition that the request is received from the image analysis device.

Images