JP2022071974A - Stool state display system - Google Patents

Abstract

To provide a stool state display system that allows a caregiver to easily understand a stool state of a care recipient when an image captured by a camera is simply displayed on a display part such as a display.SOLUTION: The present disclosure relates to the stool state display system that causes a display part to display the state of a user's stool. The stool state display system causes the display part to display stool presence/absence estimation information included in intra-period imaging information that is additional information imaging information whose imaging date is included in a predetermined period from additional information including the stool presence/absence estimation information and received captured image information.SELECTED DRAWING: Figure 11

Description

The present disclosure relates to a stool status display system.

As disclosed in Patent Document 1, a digital camera is attached to a place inside the washing toilet seat of a toilet bowl for washing water where the state of defecation can be clearly seen, and the state of stool is imaged to capture the state of stool of a person who needs defecation management. There is known a device for managing defecation, which is characterized by grasping the above-mentioned stool from a captured image.

Registered Utility Model No. 3210435

Even if the image captured by the camera is simply displayed on a display unit such as a display, it is difficult for the caregiver to easily understand the condition of the care recipient's stool.

The present disclosure is a stool status display system that displays the status of a user's stool on a display unit.
The stool status display system is
Toilet bowl,
A server and a user-side information processing device including the display unit are provided.
here,
The toilet bowl includes a toilet seat, an image sensor, and an information processing device on the toilet bowl side.
The toilet-side information processing device includes a toilet-side data transmission unit and a toilet-side control unit.
The server includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit, and the user-side information processing device includes a user-side input unit, a user-side transmitting unit, and a user-side receiving unit. Further includes a unit, a user-side storage unit, and a user-side control unit.
In the stool status display system,
(T first step of image pickup) The toilet bowl side control unit controls the image pickup element so that the image pickup element captures the inside of the toilet bowl.
(T transmission first step) The toilet bowl side control unit controls the toilet bowl side storage unit so that the captured image captured by the image pickup element is transmitted to the server as captured image information.
Here, the captured image information includes the captured image and the imaging time of the captured image.
(S reception first step) The server-side control unit controls the server-side reception unit so as to receive the captured image information.
(First step of s processing) Based on the stool presence / absence recognition algorithm, the server-side control unit includes at least one of the received captured image information as stool presence / absence estimation information regarding the presence / absence of stool of the user. Estimated from one captured image,
(S storage first step) The server-side control unit controls the server-side storage unit so that the server-side storage unit stores additional information imaging information including the stool presence / absence estimation information and the received image pickup image information. death,
(U input first step) The user-side control unit acquires the date of the flight status that the viewer who browses the user's flight status wants to be displayed on the display unit via the user-side input unit. ,
(U transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the date to the server.
(S reception first step) The server control unit controls the server side reception unit so as to receive the date transmitted from the user side transmission unit.
(Third step of s processing) From the additional information imaging information stored in the server-side storage unit based on the date, the additional information imaging information whose imaging date is included in the predetermined period is used as the intra-period imaging information. Select the server-side control unit
(S transmission first step) The server-side control unit controls the server-side transmission unit so that the image pickup information within the period is transmitted to the user-side information processing apparatus.
(U reception first step) The user-side control unit controls the user-side reception unit so as to receive the image pickup information within the period.
(U display first step) The user-side control unit controls the display unit so that the stool presence / absence estimation information included in the image pickup information within the period received by the user-side reception unit is displayed on the display unit. What you do is done.

According to the stool status display system of the present disclosure, the stool presence / absence estimation information is displayed on the display unit, so that the user's (eg, caregiver) stool viewer (eg, caregiver) can easily read the user's stool. Can recognize the presence or absence of.

Figure of excretion device in Embodiment 1 Block diagram of the excretion device and system according to the first embodiment Block diagram of the system according to the first embodiment User-side information processing device diagram in the first embodiment User-side information processing device diagram in the first embodiment User-side information processing device diagram in the first embodiment User-side information processing device diagram in the first embodiment User-side information processing device diagram in the first embodiment User-side information processing device diagram in the first embodiment User-side information processing device diagram in the first embodiment Flowchart in Embodiment 1 Schematic diagram of captured image information according to the first embodiment Schematic diagram of captured image information according to the first embodiment Schematic diagram of captured image information according to the first embodiment Schematic diagram of additional information imaging information according to the first embodiment

(Embodiment 1)
FIG. 1 is a diagram of an excretion device according to the first embodiment.

FIG. 2 is a block diagram of an excretion device and a system according to the first embodiment.

In FIG. 1, a toilet bowl 1 and a toilet seat 2 are provided as a device for excretion, and an ID unique to the device is assigned to the toilet bowl 1 and the toilet seat 2. Further, the toilet seat has a switch sensor (that is, a seating sensor 3) for detecting that the user is seated on the toilet seat, and a camera 4 as an image pickup device for imaging the inside of the toilet bowl.

The stool status display system according to the first embodiment is a stool status display system that displays the stool status of a user (eg, a care recipient) on a display unit.

This stool status display system includes a toilet bowl 1, a server 101, and a user-side information processing device 201.

The toilet bowl 1 includes a toilet seat 2, an image sensor, a switch sensor (that is, a seating sensor 3), and an information processing device on the toilet bowl side (that is, a control unit 5). The toilet-side information processing device includes a toilet-side storage unit, a toilet-side data transmission unit, and a toilet-side control unit.

The server 101 includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit, similarly to a normally used server.

Examples of the server 101 are a general server on the Internet, a server in a long-term care facility, and a server in a home.

The user-side information processing device includes a display unit. The user-side information processing apparatus further includes a user-side input unit, a user-side transmission unit, a user-side reception unit, a user-side storage unit, and a user-side control unit. Examples of user-side information processing devices are personal computers, tablets, and smart phones equipped with displays.

The storage unit is a so-called memory. The control unit is a so-called central processing unit.

When it is detected that the user is seated on the toilet seat 2, the camera 4 starts imaging the inside of the toilet bowl.

When the control unit 5 arranged inside the toilet seat receives the seating signal from the seating sensor 3, the control unit 5 activates the camera 4 and continues to take an image while the user is seated on the toilet seat. The imaging interval is every specified interval, here every second, but it may be longer or less. The captured image is stored in the control unit 5, the imaging time is recorded in the image name, and the image name to which a text can be added so that it can be determined is added to the first image stored after the start of imaging. It is saved in. When it is detected that the user has left the toilet seat 2, the imaging is finished, and the captured image is uploaded from the control unit 5 to the server 101.

As described above, in the system according to the first embodiment, first, when the seating sensor 3 detects that the user is seated on the toilet seat 2, the image sensor starts imaging the inside of the toilet bowl 1. Controls the image sensor. Hereinafter, this imaging step is referred to as "t imaging first step".

Next, a plurality of captured images 502 (see FIGS. 12A to 12C) captured by the imaging element at predetermined time intervals are stored in the toilet bowl side storage unit as captured image information 501 (see FIGS. 12A to 12C). The toilet side control unit controls the toilet side storage unit. In other words, with the passage of time, the captured image 502 from the image pickup element is sequentially accumulated in the toilet bowl side storage unit, so that the captured image information 501 is formed in the toilet bowl side storage unit. As shown in FIGS. 12A to 12C, the captured image information 501 includes a plurality of captured images 502 and an imaging time 503 of each of the plurality of captured images 502. Hereinafter, this processing step is referred to as "t processing first step".

Further, the toilet bowl side control unit controls the toilet bowl side data transmission unit so as to transmit the captured image information 501 to the server. Hereinafter, this transmission step is referred to as "t transmission first step".

Finally, when the seating sensor 3 detects that the user is away from the toilet seat 2, the toilet side control unit controls the image pickup element so that the image pickup element stops the image pickup in the toilet bowl. Hereinafter, this stop step is referred to as "t stop first step".

FIG. 3 is a block diagram of the system according to the first embodiment.

In FIG. 3, the server 101 has a stool urine presence / absence detection algorithm 102, a stool shape recognition algorithm 103, a stool color recognition algorithm 104, a stool volume recognition algorithm 105, a stool fall frequency detection algorithm 106, a urine color recognition algorithm 107, and a urine volume recognition. It has an algorithm 108 and a representative image selection algorithm.

The stool urine presence / absence detection algorithm 102, the stool shape recognition algorithm 103, the stool color recognition algorithm 104, and the urine color recognition algorithm 107 can capture a large number of images of excrement into the algorithm in advance, extract features from the images, and react to the features. Generate a training model. Next, the recognition algorithm equipped with the learning model is implemented in the server.

The stool volume recognition algorithm calculates the area of the stool area from the 105 image, and determines whether it is large, small, or normal according to a threshold value.

The stool fall frequency detection algorithm 106 calculates how many times the stool has fallen in one excretion action from the image group, and the image group represents the image from the start of imaging to the image before the next imaging is started. By adding text to the image that is saved first after the start of imaging, it is possible to determine the image for one excretion action. Since the imaging time is also recorded in the image group, the images are analyzed in the order of earliest imaging time, and the number of changes in the stool region is counted to output the number of stool drops.

The urine volume recognition algorithm 108 takes in a large number of images of a state in which urine is flowing in the toilet bowl in advance, extracts features from the images, and generates a learning model that can respond to the features. Next, the recognition algorithm equipped with the learning model is implemented in the server. Thereby, the time during which urine is flowing is calculated to estimate the urine volume.

The representative image selection algorithm 109 selects an image immediately after the user's excretory behavior is completed, that is, an image immediately after the fecal urine is detected and immediately before the paper is detected. The image before a specific time from the time of leaving the seat may be selected as the representative image, or the image immediately before using the shower or washing with water may be selected as the representative image.

The uploaded image is determined by the fecal urine presence / absence detection algorithm 102 whether excrement, that is, stool or urine is shown, paper is shown, or nothing is shown in the image.

The stool urine presence / absence detection algorithm 102, the stool shape recognition algorithm 103, the stool color recognition algorithm 104, and the urine color recognition algorithm may be detected by means other than the image, for example, an infrared sensor.

When it is determined by the presence or absence of stool urine that the stool appears in the image, the stool shape recognition algorithm 103 determines which classification the stool belongs to in the Bristol scale index 7 classification, and further, the stool color recognition algorithm. According to 104, it is determined whether the color of the stool is red, black, yellow, green, or gray. A color other than red, black, yellow, green, and gray may be determined.

Further, the stool volume recognition algorithm 105 determines whether the stool volume is high, low, or normal, and the stool drop frequency detection algorithm 106 further determines the stool volume from the image group from the time the user sits down to the next time he / she leaves. Determine the number of drops of.

When it is determined that urine appears in the image, the urine color recognition algorithm 107 determines whether the color of the urine is yellow or red.

Further, the urine volume recognition algorithm 108 determines the urine volume from the image group from the time when the user sits down to the time when the user leaves the seat.

Further, the representative image selection algorithm 109 selects a representative image from the image group from the time when the user sits down to the time when the user leaves the seat.

A database 110 for storing the above determination results is provided.

As described above, in the system according to the first embodiment, the server-side control unit first controls the server-side reception unit so as to receive the captured image information 501. Hereinafter, this receiving process is referred to as "s reception first process".

Next, based on the above algorithm, stool is estimated from at least one captured image 502 included in the captured image information 501. More specifically, the presence or absence of stool, the condition, etc. are estimated. Here, based on the stool presence / absence recognition algorithm, the stool shape recognition algorithm, the stool volume recognition algorithm, the stool presence / absence recognition algorithm, and the stool volume recognition algorithm, the server-side control unit determines the presence / absence of stool, the shape, and the amount of stool of the user. , And the amount of stool are included in the captured image information 501 received via the server-side receiver as the stool presence / absence estimation information, the stool estimation shape, the stool estimation amount, the stool presence / absence estimation information, and the stool estimation amount, respectively. The server-side control unit estimates from at least one captured image 502. Hereinafter, this estimation step is referred to as "s processing first step".

Next, from the plurality of captured images 502 included in the received captured image information 501, the toilet paper is placed in the toilet bowl after the user's excretion behavior is completed based on the representative image selection algorithm using the imaging time 503. The server-side control unit selects at least one image until it is detected as a representative image. Hereinafter, this selection process is referred to as "s processing second process".

The captured image information 501 shown in FIG. 12A has four captured images 502 and an imaging time 503, respectively. Only a part of the stool is shown in the captured image 502 at the bottom. This is because the user throws the toilet paper in the toilet bowl and the toilet paper covers a part of the stool from the image sensor. Therefore, for the captured image information 501 shown in FIG. 12A, the third captured image 502 from the top is selected as the representative image. In FIG. 12A, the top image or the second captured image 502 from the top may be selected as the representative image. This also applies to FIGS. 12B and 12C.

The order of the s treatment first step and the s treatment second step does not matter. The first step of the s treatment may be performed first, and then the second step of the s treatment may be performed. Alternatively, the s treatment second step may be performed first, and then the s treatment first step may be performed.

In this way, the additional information imaging information 601 as shown in FIG. 13 is formed by the server-side control unit. As shown in FIG. 13, the additional information imaging information 601 includes (a) received captured image information 501, (b) stool presence / absence estimation information, and (c) estimated stool estimation shape.
It includes (d) an estimated stool estimator, (e) urine presence / absence estimation information, (f) an estimated urine estimator, and (g) a selected representative image.

Finally, the server-side control unit controls the server-side storage unit so that the additional information imaging information 601 is stored in the server-side storage unit. This control process is referred to as "s memory first process".

FIG. 4 is a diagram of the user-side information processing apparatus according to the first embodiment.

In FIG. 4, a user-side information processing device 201 for confirming the determination result is provided, and the user can confirm the determination result by inputting the device ID and the date on which the determination result is to be confirmed on the web or the application. ..

When the device ID and the date are input by the user, the user-side information processing apparatus 201 acquires the corresponding determination result from the database 110 and downloads it as text or csv format data 202. The user-side information processing device 201 displays the device ID, or if it can be linked from the device ID, the place where the defecation device is installed, for example, the room number or the name of the user who uses the device (not shown). .. The user-side information processing device 201 reads the determination result from the data 202, and determines the time when the patient was seated in the toilet seat 2, when there was excretion, whether the excretion was stool or urine, and if it was stool, the shape at that time as the Bristol scale index 7. In the classification, the classification, the color of the stool, the volume of the stool, and the number of times the stool has fallen are shown on the graph 203 in the information processing apparatus 201 on the user side. If it is urine, the color and volume of urine are shown on the graph 203 in the information processing apparatus 201 on the user side.

Graph 203 is composed of a three-stage graph with the time on the horizontal axis from 0:00:00 to 23:59:59. The first stage displays the time spent sitting on the toilet seat as a square wave from the imaging time written in the image name.

In the second stage, the imaging time recorded on the image determined to be urine by the presence / absence of stool urine is read, and a bar-shaped figure is displayed on the graph. At this time, the figure may be the same color as the urine color determination result, and the height may be changed depending on the urine volume. Alternatively, the text may be displayed in the form of an annotation near the figure, as shown in FIG.

Further, in the other stage, the imaging time recorded on the image determined to be stool by the presence / absence of stool urine is read, and a bar-shaped figure is displayed on the graph. At this time, the figure may display the stool shape recognition determination result as text in the figure, or may display a figure in which the Bristol scale index is iconized by imitating the shape of the stool. The figure may be the same color as the stool color determination result, and the height may be changed depending on the stool volume, or the stool color, stool volume, and number of stool drops may be displayed as text in the figure. Text may be displayed in the form of annotations near the shape.

Further, as shown in FIG. 7, the user-side information processing apparatus 201 of this embodiment serves as a basis for the determination result by clicking or touching the figure representing the determination result displayed on the graph 203. Images can be displayed. The image may be displayed on the graph 203 from the beginning. The image displayed at this time may be displayed in a form in which a window different from the graph pops up as the image display area 204, or as shown in FIG. 8, the image display area 204 provided in the same window as the graph. It may be displayed in. At this time, as the displayed image, the image selected by the representative image selection algorithm 109 is displayed.

As described above, in the system according to the first embodiment, first, the state of the stool (for example, the care facility) that the viewer (for example, the caregiver in the care facility) who browses the state of the user's stool wants to be displayed on the display unit. The date of the stool of the care recipient) is acquired by the user-side control unit via the user-side input unit. This control process is referred to as "u input first process".

Next, the user-side control unit controls the user-side transmission unit so that this date is transmitted to the server. This transmission is referred to as "u transmission first step".

The server control unit controls the server side reception unit so that the date sent from the user side transmission unit is received. This reception process is referred to as "s reception first process".

Based on the date, the server-side control unit selects the additional information imaging information 601 whose imaging date is included in the predetermined period from the additional information imaging information 601 stored in the server-side storage unit as the imaging information within the period. .. This selection process is referred to as "s processing third process".

A specific example of the third step of the s treatment will be described. Here, the predetermined period is set to "3 days". The viewer inputs "October 02, 2020" from the user side input unit. That is, the user-side control unit acquires "October 02, 2020" as a date via the user-side input unit.

Of FIGS. 12A to 12C, two days before and after "October 02, 2020" (that is, three days from October 01 to 03, 2020) include FIGS. 12A and 12B. On the other hand, FIG. 12C is not included in the three days before and after the said. Therefore, the server-side control unit selects the two additional information imaging information 601 shown in FIGS. 12A and 12B as the imaging information within the period. Since FIG. 12C is the captured image information 501 captured on October 04, 2020, it is not selected as the captured image information within the period in this specific example.

The server-side control unit controls the server-side transmission unit so that the image pickup information within such a period is transmitted to the user-side information processing apparatus. This transmission step is referred to as "s transmission first step".

The user-side control unit controls the user-side reception unit so that the image pickup information within the period is received. This receiving process is referred to as "u reception first process".

(B) Estimated stool presence / absence information, (c) Estimated stool estimated shape, (d) Estimated stool estimator, (e) Stool presence / absence estimation information included in the imaging information received by the user-side receiver during the period. The user-side control unit controls the display unit so that (f) the estimated stool estimated amount and (g) the selected representative image are displayed on the display unit. This display step is referred to as "u display first step".

In this way, in the stool status display system according to the first embodiment, the stool presence / absence estimation information is displayed on the display unit, so that the user (eg, the care recipient)'s stool viewer (eg, the care staff) can see. The presence or absence of a user's stool can be easily recognized, and as a result, the user's health condition can be easily grasped).

Further, although the judgment result in the recognition algorithm is premised on having high accuracy, the judgment result output by the algorithm is not always 100% correct. The user-side information processing apparatus 201 of this embodiment can display an image that is the basis of the determination result, but if the determination result by the recognition algorithm and the determination result visually confirmed by the user are different, the user side. The determination result displayed on the graph 203 on the information processing apparatus 201 can be modified. The user-side information processing apparatus 201 of this embodiment displays an image on which the determination result is based, and as shown in FIG. 9, a determination result display box in which the determination result text is input further below or around the image. A 205 is provided, and a pull-down box 206 is provided next to the box 205. The determination result list is displayed by clicking or touching the pull-down box 206, and the determination result displayed in the box 205 can be modified by clicking or touching the determination result confirmed by the user. At this time, the figure showing the determination result displayed on the graph is also redrawn according to the correction content.

Further, in the recognition algorithm, when the output determination result is wrong, the recognition accuracy can be further improved by additionally learning the wrong image, so that the representative image is very valuable. In general, in order to improve the accuracy of the image recognition algorithm, an image with a large number of correct labels is required, but even if the image that can already be determined is relearned, the effect is small and the determination is mistaken. It is desirable to attach the correct correct label to the image and relearn it.

The user-side information processing apparatus 201 of this embodiment transmits the image information in which the user has corrected the determination result to the server 101, and in addition to the correction of the corresponding image in the database 110, the corrected determination result is added. .. When the recognition algorithm is relearned, the recognition performance can be further improved efficiently by selecting an image to be used for learning based on the correction information.

As described above, in the system according to the first embodiment, (b) stool presence / absence estimation information, (c) estimated stool estimation shape, (d) estimated stool estimation amount, and (d) estimated stool presence / absence information displayed on the display unit. The user-side control unit acquires (e) stool presence / absence estimation information and (f) correction information for correcting at least one of the estimated stool estimation amounts via the user-side input unit. Hereinafter, this input process is referred to as "u correction input first process".

Next, the user-side control unit controls the user-side transmission unit so that this modification information is transmitted to the server. Hereinafter, this transmission step is referred to as "u modified transmission first step".

The server control unit controls the server side reception unit so as to receive the correction information transmitted from the user side transmission unit. Hereinafter, this reception process is referred to as "s correction reception first step".

The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information. Hereinafter, this correction step is referred to as "s correction process first step".

Further, as shown in FIG. 10, the user-side information processing apparatus 201 of this embodiment includes a message box 207 for notifying a message to the user. From the information in the database 110, there is no defecation for several days, or even if there is defecation, it is a solid stool such as type 1 or 2 in the Bristol scale index, the amount of stool is small, and the stool falls. It is possible to infer the constipation state from each information and display the advice of laxative administration in the message box 207 to notify the user, such as the fact that the stool has a large number of times and is small and spilled for several days.

Further, from the information in the database 110, the presence / absence of urination and the interval can be analyzed, and hydration instructions and advice for improving pollakiuria can be displayed in the message box 207.

Further, in the user-side information processing device 201 of the present embodiment, as information obtained from the excretion device, occupancy information, shower, whether washing with water was used, toilet lid, toilet seat, opening / closing information of the toilet bowl, etc. may be displayed. ..

(Embodiment 2)
Hereinafter, the second embodiment will be described. The second embodiment is the same as the first embodiment except for the following points.

(1) The toilet-side information processing device includes a toilet-side data transmission unit and a toilet-side control unit, and (2) the captured image information 501 is formed by a server control unit provided in the server 101, and is stored in a server. It is remembered in the department.

That is, in the second embodiment, the first step of the t treatment is not performed. In the first step of transmission, the toilet bowl side control unit controls the toilet bowl side data transmission unit so that the image pickup image 502 captured by the image pickup element is transmitted to the server together with the image pickup time 503. On the other hand, in the s reception first step, the server-side control unit controls the server-side reception unit so that the captured image is received together with the image capture time. Then, the server-side control unit controls the server-side storage unit so that the received captured image is stored in the server-side storage unit. This is called the second step of the s process. By repeating the t transmission first step, the s reception first step, and the s processing second step with the passage of time, a plurality of captured images 502 are accumulated in the server-side storage unit together with each imaging time 503. It is remembered to be done.

For a plurality of captured images taken by the camera 4 while seated, Bristol scale classification and stool color determination are performed for each captured image, and these are stored in the server 101 as time-series data and stored in the user-side information processing device 201. The time-series data may be displayed as a graph. With this configuration, even if the Bristol scale classification or stool color changes during defecation, the change can be confirmed, so that excretion management can be performed more finely.

In the first embodiment, the shooting is started / ended by the user sitting / leaving, but a person enters the room. When the constitution is detected, shooting may be started or stopped. Alternatively, the user may press the shooting start button to start shooting, and the user may press the shooting end button to end the shooting. In this case, a plurality of images are taken between the start of shooting and the end of shooting. The image may be taken.

Further, for example, after defecation, the user may be asked to press the shooting button once, so that a plurality of shots may not be taken. That is, when the shooting button is pressed by the user, the inside of the toilet bowl may be imaged by the image sensor. In the first embodiment, the captured image information 501 is composed of a plurality of captured images 502, but as described above, the captured image information 501 may be composed of one captured image 502.

The stool status display system according to the present disclosure is used by a viewer (for example, a caregiver) in a care facility for health management of a user (for example, a care recipient) who needs care due to old age or the like. The stool status display system according to the present disclosure is also used in the home of the user or the person who browses the display content (that is, the stool presence / absence estimation information) of the display unit (that is, the viewer). A program for causing a computer to execute the stool status display system according to the present disclosure is also included in the contents of the present disclosure.

1 toilet bowl 2 toilet seat 3 seating sensor 4 camera 5 control unit 101 server 102 stool urine presence / absence detection algorithm 103 stool shape recognition algorithm 104 stool color recognition algorithm 105 stool volume recognition algorithm 106 stool drop frequency detection algorithm 107 urine color recognition algorithm 108 urine volume recognition Algorithm 109 Representative image selection algorithm 110 Database 201 User-side information processing device 202 Data 203 Graph 204 Image display area 205 Judgment result display box 206 Pull-down box 207 Message box 501 Captured image information 502 Captured image 503 Captured time 601 Additional information Captured information

Claims (34)

It is a stool status display system that displays the status of the user's stool on the display unit.
The stool status display system is
Toilet bowl,
A server and a user-side information processing device including the display unit are provided.
here,
The toilet bowl includes a toilet seat, an image sensor, and an information processing device on the toilet bowl side.
The toilet-side information processing device includes a toilet-side data transmission unit and a toilet-side control unit.
The server includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit, and the user-side information processing device includes a user-side input unit, a user-side transmitting unit, and a user-side receiving unit. Further includes a unit, a user-side storage unit, and a user-side control unit.
In the stool status display system,
(T first step of image pickup) The toilet bowl side control unit controls the image pickup element so that the image pickup element captures the inside of the toilet bowl.
(T transmission first step) The toilet bowl side control unit controls the toilet bowl side storage unit so that the captured image captured by the image pickup element is transmitted to the server as captured image information.
Here, the captured image information includes the captured image and the imaging time of the captured image.
(S reception first step) The server-side control unit controls the server-side reception unit so as to receive the captured image information.
(First step of s processing) Based on the stool presence / absence recognition algorithm, the server-side control unit includes at least one of the received captured image information as stool presence / absence estimation information regarding the presence / absence of stool of the user. Estimated from one captured image,
(S storage first step) The server-side control unit controls the server-side storage unit so that the server-side storage unit stores additional information imaging information including the stool presence / absence estimation information and the received image pickup image information. death,
(U input first step) The user-side control unit acquires the date of the flight status that the viewer who browses the user's flight status wants to be displayed on the display unit via the user-side input unit. ,
(U transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the date to the server.
(S reception first step) The server control unit controls the server side reception unit so as to receive the date transmitted from the user side transmission unit.
(Third step of s processing) From the additional information imaging information stored in the server-side storage unit based on the date, the additional information imaging information whose imaging date is included in the predetermined period is used as the intra-period imaging information. Select the server-side control unit
(S transmission first step) The server-side control unit controls the server-side transmission unit so that the image pickup information within the period is transmitted to the user-side information processing apparatus.
(U reception first step) The user-side control unit controls the user-side reception unit so as to receive the image pickup information within the period.
(U display first step) The user-side control unit controls the display unit so that the stool presence / absence estimation information included in the image pickup information within the period received by the user-side reception unit is displayed on the display unit. A stool status display system that performs what you do. (U correction input first step) The user side control unit acquires the correction information for correcting the stool presence / absence estimation information displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 1. Between the s processing first step and the s storage first step, the following steps (s processing second step) From the captured image included in the captured image information received, a representative image using the imaging time. A process in which the server-side control unit selects at least one image as a representative image from the end of the excretion behavior of the user to the detection of toilet paper in the toilet bowl based on the selection algorithm.
The stool status display system according to claim 1 or 2, wherein the stool status display system is executed. In the first step of s processing, based on the stool shape recognition algorithm, the server-side control unit uses the shape of the user's stool as the estimated stool shape, and at least one of them is included in the received captured image information. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the stool estimation shape in the server-side storage unit, and u display first step. 3. The user-side control unit controls the display unit so that the stool estimation shape included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of the items. (U correction input first step) The user side control unit acquires correction information for correcting the stool estimation shape displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 4. In the first step of s processing, based on the stool color recognition algorithm, the server-side control unit uses the user's stool color as the stool estimation color, and at least one of them is included in the received captured image information. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the stool estimation color in the server-side storage unit, and u display first step. 1 to 5, wherein the user-side control unit controls the display unit so that the stool estimated color included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of the items. (U correction input first step) The user side control unit acquires the correction information for correcting the stool estimation color displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 6. In the first step of s processing, based on the stool volume recognition algorithm, the server-side control unit includes at least one of the received captured image information with the stool volume of the user as the stool estimation amount. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated stool amount in the server-side storage unit, and u display first step. In claims 1 to 7, the user-side control unit controls the display unit so that the stool estimated amount included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of the items. (U correction input first step) The user side control unit acquires the correction information for correcting the stool estimation amount displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 8. In the first step of the s process, the server-side control unit includes the number of drops of the user's stool as the estimated number of drops of stool in the received captured image information based on the stool drop count detection algorithm. The server-side control unit estimates from at least one captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated number of stool drops in the server-side storage unit, and u display first. From claim 1, the user-side control unit controls the display unit so that the estimated number of stool drops included in the imaging information within the period received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of 9. (U correction input first step) The user side control unit acquires the correction information for correcting the estimated number of stool drops displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 10. In the first step of s processing, based on the urine presence / absence recognition algorithm, the server-side control unit includes at least one of the received captured image information as urine presence / absence estimation information regarding the presence / absence of urine of the user. The server-side control unit estimates from one captured image and
s In the first storage step, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the stool presence / absence estimation information in the server-side storage unit, and u display first. From claim 1, the user-side control unit controls the display unit so that the stool presence / absence estimation information included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of 11. (U correction input first step) The user side control unit acquires the correction information for correcting the urine presence / absence estimation information displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 12. In the first step of s processing, based on the urine color recognition algorithm, the server-side control unit uses the color of the user's urine as the estimated urine color, and at least one of them is included in the received captured image information. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated stool color in the server-side storage unit, and u display first step. In claims 1 to 13, the user-side control unit controls the display unit so that the piss estimated color included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of the items. (U correction input first step) The user side control unit acquires correction information for correcting the urine estimation color displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 14. In the first step of s processing, based on the urine volume recognition algorithm, the server-side control unit includes at least one of the received captured image information as the urine estimator of the user's urine color. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated stool amount in the server-side storage unit, and u display first step. In claims 1 to 15, the user-side control unit controls the display unit so that the estimated amount of stool included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The flight status display system according to any one of the items. (U correction input first step) The user side control unit acquires the correction information for correcting the urine estimator displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The flight status display system according to claim 16. It is a program for operating the stool status display system that displays the user's stool status on the display unit.
The stool status display system is
Toilet bowl,
A server and a user-side information processing device including the display unit are provided.
here,
The toilet bowl includes a toilet seat, an image sensor, and an information processing device on the toilet bowl side.
The toilet-side information processing device includes a toilet-side data transmission unit and a toilet-side control unit.
The server includes a server-side receiving unit, a server-side transmitting unit, a server-side storage unit, and a server-side control unit, and the user-side information processing device includes a user-side input unit, a user-side transmitting unit, and a user-side receiving unit. Further includes a unit, a user-side storage unit, and a user-side control unit.
The program
(T first step of image pickup) The toilet bowl side control unit controls the image pickup element so that the image pickup element captures the inside of the toilet bowl.
(T transmission first step) The toilet bowl side control unit controls the toilet bowl side storage unit so that the captured image captured by the image pickup element is transmitted to the server as captured image information.
Here, the captured image information includes the captured image and the imaging time of the captured image.
(S reception first step) The server-side control unit controls the server-side reception unit so as to receive the captured image information.
(First step of s processing) Based on the stool presence / absence recognition algorithm, the server-side control unit includes at least one of the received captured image information as stool presence / absence estimation information regarding the presence / absence of stool of the user. Estimated from one captured image,
(S storage first step) The server-side control unit controls the server-side storage unit so that the server-side storage unit stores additional information imaging information including the stool presence / absence estimation information and the received image pickup image information. death,
(U input first step) The user-side control unit acquires the date of the flight status that the viewer who browses the user's flight status wants to be displayed on the display unit via the user-side input unit. ,
(U transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the date to the server.
(S reception first step) The server control unit controls the server side reception unit so as to receive the date transmitted from the user side transmission unit.
(Third step of s processing) From the additional information imaging information stored in the server-side storage unit based on the date, the additional information imaging information whose imaging date is included in the predetermined period is used as the intra-period imaging information. Select the server-side control unit
(S transmission first step) The server-side control unit controls the server-side transmission unit so that the image pickup information within the period is transmitted to the user-side information processing apparatus.
(U reception first step) The user-side control unit controls the user-side reception unit so as to receive the image pickup information within the period.
(U display first step) The user-side control unit controls the display unit so that the stool presence / absence estimation information included in the image pickup information within the period received by the user-side reception unit is displayed on the display unit. A program that does what it does. (U correction input first step) The user side control unit acquires the correction information for correcting the stool presence / absence estimation information displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The program of claim 18. Between the s processing first step and the s storage first step, the following steps (s processing second step) From the captured image included in the captured image information received, a representative image using the imaging time. A process in which the server-side control unit selects at least one image as a representative image from the end of the excretion behavior of the user to the detection of toilet paper in the toilet bowl based on the selection algorithm.
The program according to claim 18 or 19. In the first step of s processing, based on the stool shape recognition algorithm, the server-side control unit uses the shape of the user's stool as the estimated stool shape, and at least one of them is included in the received captured image information. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the stool estimation shape in the server-side storage unit, and u display first step. 18 to 20, wherein the user-side control unit controls the display unit so that the stool estimation shape included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The program described in any one of the items. (U correction input first step) The user side control unit acquires correction information for correcting the stool estimation shape displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
21. The program of claim 21. In the first step of s processing, based on the stool color recognition algorithm, the server-side control unit uses the user's stool color as the stool estimation color, and at least one of them is included in the received captured image information. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the stool estimation color in the server-side storage unit, and u display first step. 18 to 22, wherein the user-side control unit controls the display unit so that the stool estimated color included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The program described in any one of the items. (U correction input first step) The user side control unit acquires the correction information for correcting the stool estimation color displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
23. The program of claim 23. In the first step of s processing, based on the stool volume recognition algorithm, the server-side control unit includes at least one of the received captured image information with the stool volume of the user as the stool estimation amount. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated stool amount in the server-side storage unit, and u display first step. 18 to 24, wherein the user-side control unit controls the display unit so that the estimated amount of stool included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The program described in any one of the items. (U correction input first step) The user side control unit acquires the correction information for correcting the stool estimation amount displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
25. The program of claim 25. In the first step of the s process, the server-side control unit includes the number of drops of the user's stool as the estimated number of drops of stool in the received captured image information based on the stool drop count detection algorithm. The server-side control unit estimates from at least one captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated number of stool drops in the server-side storage unit, and u display first. From claim 18, the user-side control unit controls the display unit so that the estimated number of stool drops included in the imaging information within the period received by the user-side reception unit is displayed on the display unit. The program according to any one of 26. (U correction input first step) The user side control unit acquires the correction information for correcting the estimated number of stool drops displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
27. The program of claim 27. In the first step of s processing, based on the urine presence / absence recognition algorithm, the server-side control unit includes at least one of the received captured image information as urine presence / absence estimation information regarding the presence / absence of urine of the user. The server-side control unit estimates from one captured image and
s In the first storage step, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the stool presence / absence estimation information in the server-side storage unit, and u display first. From claim 18, the user-side control unit controls the display unit so that the stool presence / absence estimation information included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. Program in any one of 28. (U correction input first step) The user side control unit acquires the correction information for correcting the urine presence / absence estimation information displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The program of claim 29. In the first step of s processing, based on the urine color recognition algorithm, the server-side control unit uses the color of the user's urine as the estimated urine color, and at least one of them is included in the received captured image information. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated stool color in the server-side storage unit, and u display first step. 18 to 30, wherein the user-side control unit controls the display unit so that the piss estimated color included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. Program in any one item. (U correction input first step) The user side control unit acquires correction information for correcting the urine estimation color displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The program of claim 31. In the first step of s processing, based on the urine volume recognition algorithm, the server-side control unit includes at least one of the received captured image information as the urine estimator of the user's urine color. The server-side control unit estimates from the captured image and
s In the first step of storage, the server-side control unit controls the server-side storage unit so as to store additional information imaging information including the estimated amount of stool in the server-side storage unit, and u display first step. 18 to 32, wherein the user-side control unit controls the display unit so that the estimated amount of stool included in the intra-period imaging information received by the user-side reception unit is displayed on the display unit. The program described in any one of the items. (U correction input first step) The user side control unit acquires the correction information for correcting the urine estimator displayed on the display unit via the user side input unit.
(U correction transmission first step) The user-side control unit controls the user-side transmission unit so as to transmit the correction information to the server.
(S first step of correction reception) The server control unit controls the server-side reception unit so as to receive the correction information transmitted from the user-side transmission unit.
(S first step of correction processing) The server control unit controls the server-side storage unit so as to correct the additional information imaging information stored in the server-side storage unit based on the correction information.
The program of claim 33.

Images