JP6061546B2 - Medical information processing apparatus, medical information processing method and program - Google Patents

Description

  The present invention relates to a technique for searching for moving image data obtained by imaging a subject such as a patient.

  In the medical field, diagnosis is performed mainly based on medical examinations, explanations from patients, and various test results. However, a patient's symptoms do not always appear at the time of diagnosis, and the patient cannot always explain his / her symptoms in a form requested by a doctor. Therefore, a countermeasure is known in which a patient is photographed with a video camera and image data obtained by photographing is used for diagnosis and diagnosis.

  Patent Document 1 discloses a technique for estimating a treatment action to be performed and controlling the arrangement of cameras in a treatment room to an optimum condition. Patent Document 2 discloses that a terminal that collects personal physiological information, a terminal that collects behavior information, a base station that receives such information, and a network can be used to acquire target person information from a remote location. Techniques to do this are disclosed. Furthermore, Patent Document 3 discloses a technique for recording a medical practice using various sensors including a camera and reducing the recording capacity by deleting or changing the resolution of recorded information. Yes.

JP 2006-277486 A JP 2002-149824 A JP 2005-135344 A

  Here, an important point in photographing a patient is which scene is useful for diagnosis and diagnosis. For example, where is the scene where the patient complained of physical abnormalities such as pain, or which scene is estimated to be the cause. Without this point, the doctor would have to browse all the recorded data.

  When trying to cope with this point with the above-described conventional technology, the following problems arise. That is, with the technique disclosed in Patent Document 1, it is only possible to determine the arrangement of the camera, and it is not possible to discriminate and record important points. The technique disclosed in Patent Document 2 requires not only a video camera but also a wearable biometric information terminal, which requires much effort and cost, and is difficult to use. In the technique disclosed in Patent Document 3, the main purpose is to reduce the recording capacity, and it is impossible to extract a scene that is considered to be the cause of the abnormality.

  Accordingly, an object of the present invention is to enable easy retrieval of moving image data at a location where a physical change has occurred in a subject.

The medical information processing apparatus of the present invention includes a detection unit that detects that a physical abnormality has occurred in the subject based on moving image data of the subject captured by the imaging unit, and the target by the detection unit. A first assigning means for assigning a first tag to the moving image data at a location where a physical change is detected in the person, and that a predetermined change has occurred in the moving image data. When detecting that a predetermined change has occurred in the moving image data by the detecting means to detect and the detecting means, and when it has not been detected by the detecting means that a physical change has occurred in the subject And a second attaching unit for attaching a second tag to the moving image data at the location where the predetermined change is detected by the detecting unit .

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to search easily the moving image data of the location where the subject's physical abnormality occurred.

It is a figure which shows the structure of the medical information recording system which concerns on embodiment of this invention. It is a figure which shows the detailed structure of information processing apparatus. It is a figure which shows the functional structure of the medical information recording system which concerns on embodiment of this invention. It is a flowchart which shows the process which provides a tag with respect to moving image data in information processing apparatus. It is a flowchart which shows the process which provides the tag for identifying the kind of patient's meal to moving image data. It is a flowchart which shows the process which searches moving image data from a memory | storage device. It is a figure which shows the example of the moving image data of the location applicable to the cause candidate displayed by a moving image display part. It is a flowchart which shows the process which calculates possibility that the cause candidate corresponding to each searched moving image data is a true cause. It is a flowchart which shows the process which provides the tag for identifying the kind of person who contacted the patient to moving image data.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

  First, a first embodiment of the present invention will be described. FIG. 1 is a diagram showing a configuration of a medical information recording system according to the first embodiment of the present invention. As shown in FIG. 1, the medical information recording system according to the first embodiment of the present invention includes a moving image photographing device 101, an external environment information acquisition device 102, an output device 103, and an information processing device 104. The information processing apparatus 104 is a configuration that is an application example of a medical information processing apparatus.

  The moving image capturing apparatus 101 acquires moving image data captured by at least one video camera or the like. It is desirable that the moving image photographing apparatus 101 is fixed so that a patient (subject) as a subject is always captured. The external environment information acquisition device 102 is installed in the vicinity of the moving image capturing device 101 and acquires environment information such as the temperature and humidity of the space where the patient is and the time. The output device 103 is various display devices such as a liquid crystal panel, and displays searched moving image data and information accompanying the moving image data. The information processing apparatus 104 stores a program for performing various processing such as recording of moving image data, detection processing of changes occurring in the moving image data, searching processing of moving image data, and input of shooting instructions for moving image data. ing.

  FIG. 2 is a diagram illustrating a detailed configuration of the information processing apparatus 104. As shown in FIG. 2, the information processing device 104 includes a CPU (Central Processing Unit) 201, a search instruction input device 202, a shooting instruction input device 203, a storage device 204, a RAM (Random Access Memory) 205, a ROM (Read Only Memory). ) 206 and bus 207.

  The CPU 201 performs logical operations and determinations for various data processing, and controls each component connected via the bus 207. The search instruction input device 202 is connected to a keyboard having various function keys such as alphabet keys, hiragana keys, katakana keys, character symbol input keys such as punctuation marks, and cursor movement keys for instructing cursor movement. The Further, pointing devices such as a mouse and a stick pointer that point to a controllable position on the screen on a GUI (Graphical User Interface) and perform a function selection instruction or the like are also included. The imaging instruction input device 203 is also composed of the same devices as the search instruction input device 202. Note that the search instruction input device 202 and the imaging instruction input device 203 are not necessarily different, and may be the same device depending on the situation. The storage device 204 stores various information such as input / output data and programs. As a storage medium for storing these data and programs, a hard disk, CD-ROM, DVD-ROM, flash memory, or the like can be used. The RAM 205 is used when temporarily storing various data from each component. The ROM 206 stores a program executed in the present embodiment. All these components are connected via a bus 207. The CPU 201 reads out necessary programs and data from the ROM 206 to the RAM 205 and executes them, thereby realizing processing shown in FIGS. 4, 5, 6, and 8 to be described later.

  FIG. 3 is a diagram showing a functional configuration of the medical information recording system according to the first embodiment of the present invention. As illustrated in FIG. 3, the medical information recording system according to the first embodiment includes a moving image capturing unit 301, an external environment information acquisition unit 302, a change detection unit 303, a tag information addition unit 304, a causal relationship estimation unit 305, A search instruction unit 306, a shooting instruction unit 307, a moving image search unit 308, and a moving image display unit 309 are provided.

  The moving image photographing unit 301 has a configuration corresponding to the moving image photographing device 101 in FIG. The external environment information acquisition unit 302 has a configuration corresponding to the external environment information acquisition device 102 of FIG. Other configurations 303 to 309 are functional configurations of the information processing apparatus 104. Note that the moving image capturing unit 301 has a configuration as an application example of an imaging unit. In addition, the moving image display unit 309 is configured as an application example of the presentation unit.

  Next, processing of the medical information recording system according to the present embodiment will be described. As an outline of the medical information recording system according to the present embodiment, moving image data with a patient as a subject is photographed, and when a change that may cause a physical or abnormal change occurs in the patient, A tag shown is attached to the moving image data. When the user searches for moving image data, the moving image data is searched based on the assigned tag.

  First, referring to FIG. 4, processing for adding a tag to moving image data in the information processing apparatus 104 will be described. The moving image capturing unit 301 captures moving image data and transmits it to the information processing device 104, and the external environment information acquisition unit 302 acquires external environment information and transmits it to the information processing device 104. In step S <b> 101, the information processing apparatus 104 receives moving image data from the moving image capturing unit 301, receives external environment information from the external environment information acquisition unit 302, and stores them in the storage device 204. Here, the external environment information is information indicating an external environment in the vicinity of the patient, and the external environment is a factor that may cause a physical change of the patient or a change that may cause the change. Examples of the external environment include temperature, humidity, time, and atmospheric pressure. Further, the shooting timing and shooting range by the moving image shooting unit 301 may be specified based on the existing inspection result and the like. For example, a specific time zone, a specific behavior, a specific part, or the like may be designated to be focused. These are specified based on a command input from the imaging instruction unit 307.

  In step S <b> 102, the change detection unit 303 determines whether any change has occurred in the moving image data received from the moving image capturing unit 301. If any change occurs in the moving image data, the process proceeds to step S103. On the other hand, if no change occurs in the moving image data, the process returns to step S101. In step S <b> 103, the change detection unit 303 determines whether the change is a change caused by a physical change in the patient. Many techniques for detecting the occurrence of physical changes have been proposed for surveillance cameras, and these techniques may be applied here as well. In addition, biological information such as the patient's respiratory rate and heart rate is also important information for detecting that a physical abnormality has occurred in the patient. Therefore, the moving image data captured by the moving image capturing unit 301 is also used. Get from. Note that, for example, a technique disclosed in Non-Patent Document 1 below that can measure a heart rate from a video camera can be applied to this processing.

[Non-Patent Document 1]
MZ Poh, DJ McDuff and RW Picard, "Advancements in non-contact, multiparameter physiological measurements using a webcam," IEEE Trans Biomed Eng, vol. 58, no. 1, pp. 7-11, 2011.

  If a physical change occurs in the patient, the process proceeds to step S104. On the other hand, if no physical change has occurred in the patient, the process proceeds to step S105. In step S <b> 104, the tag information adding unit 304 stores the tag indicating the meaning of “abnormal state” in the storage device 204 with the moving image data at the location where the change has occurred. In step S106, the change detection unit 303 determines whether or not the change in the moving image data has ended. When the change is finished, the process proceeds to step S107. On the other hand, if the change has not ended, the process returns to step S103. In step S107, the tag information adding unit 304 ends tagging of the moving image data. In step S108, the shooting instruction unit 307 determines whether an operation for ending shooting by the user has been received. When an operation for ending shooting is received, the process ends. On the other hand, when the operation for ending the photographing is not accepted, the process returns to step S101.

  Here, a case will be described in which it is determined in step S103 that the change generated in the moving image data is not a change due to a physical change in the patient. In this case, it is determined that a change occurring in the moving image data may cause a physical change in the later patient. Accordingly, in step S <b> 105, the tag information adding unit 304 adds a tag indicating the meaning of “cause candidate” to the moving image data of the location where the change has occurred and stores the tag in the storage device 204. A tag indicating the meaning of “abnormal state” is an example of the first tag, and a tag indicating the meaning of “being a cause candidate” is an example of the second tag. Further, the process of adding a tag indicating the meaning of “abnormal state” to the moving image data in step S104 is a processing example of the first adding unit. In addition, the process of adding a tag indicating the meaning of “cause candidate” to the moving image data in step S105 is a processing example of the second adding unit.

  FIG. 5 is a flowchart illustrating a process executed in conjunction with step S105, which adds a tag for identifying the type of meal of the patient to the moving image data. In step S201, the change detection unit 303 determines whether food is detected from the moving image data at the location where the change is detected in step S102. For example, a technique for detecting and recording a meal from image data disclosed in Non-Patent Document 2 below can be applied to the determination process.

[Non-Patent Document 2]
Aizawa Kiyoharu, Ogawa Makoto, "Meal Contents Analysis by Multimedia Recording and Image Processing", Information Processing 52 (11), 1382-1387, 2011-11

  If food is detected from the moving image data, the process proceeds to step S202. On the other hand, if no food is detected from the moving image data, the process ends. In step S202, the change detection unit 303 determines whether or not the food is food that has been decided to be eaten in advance, such as hospital lunch. This is because it is presumed that the pre-determined items are unlikely to be a cause because the food allergy of the patient is highly considered. In this determination, the menu of lunch is learned in advance using image data or text data, and an image processing technique such as that shown in Non-Patent Document 2 may be used. It may be determined that the meal is a school lunch.

  If the food detected from the moving image data is food that is determined to be eaten in advance, the process proceeds to step S203. On the other hand, when the food detected from the moving image data is not food that has been decided to be eaten in advance, the process proceeds to step S204. In step S <b> 203, the tag information adding unit 304 adds a tag indicating the meaning of “standard meal” to the moving image data of the location where the change has occurred and stores the tag in the storage device 204. In this case, a tag indicating the meaning of “cause candidate” and a tag indicating the meaning of “standard meal” are attached to the moving image data at the location where the change has occurred. In step S <b> 204, the tag information adding unit 304 stores a tag indicating the meaning of “non-standard meal” on the moving image data of the location where the change has occurred, and stores the tag in the storage device 204. In this case, a tag indicating the meaning of “cause is a candidate” and a tag indicating the meaning “non-standard meal” are attached to the moving image data at the location where the change has occurred. The above processing is repeatedly executed until it is determined in step S106 that the change has been completed.

  Next, processing for retrieving moving image data from the storage device 204 will be described with reference to FIG. When the user searches for moving image data, the moving image data with a tag indicating the meaning of “abnormal state” and the moving image data with a tag indicating the meaning of “cause candidate” are attached. The search instructing unit 306 is used to instruct which one is to be viewed.

  In step S <b> 301, the moving image search unit 308 determines whether browsing of moving image data at a location with a tag indicating the meaning of “abnormal state” is designated. When it is designated to view moving image data at a location with a tag indicating the meaning of “abnormal state”, the process proceeds to step S302. On the other hand, when it is designated to view moving image data with a tag indicating the meaning of “cause is a candidate”, the process proceeds to step S303.

  In step S <b> 302, the moving image search unit 308 searches the storage device 204 for moving image data at a location with a tag indicating the meaning of “abnormal state”. In step S303, the moving image search unit 308 determines whether or not it is input by the user that the presumed cause is a previous action such as trauma. If it is input that the previous action is estimated to be the cause, the process proceeds to step S304, and if not, the process proceeds to step S305. In step S <b> 304, the moving image search unit 308 searches the storage device 204 for moving image data immediately before a portion with a tag indicating the meaning of “abnormal state”.

  In step S305, the moving image search unit 308 determines whether or not the user has input that the cause of the abnormality can be estimated. If it is input that the cause of the abnormality can be estimated, the process proceeds to step S306; otherwise, the process proceeds to step S307. In step S <b> 306, the moving image search unit 308 searches all moving image data at a portion with a tag indicating the meaning of “cause is a candidate”.

  In step S307, the moving image search unit 308 determines the type of search key information used when searching for moving image data. If the type of the search key information is time, that is, if the symptom can estimate the time when the cause of the abnormality occurred, the process proceeds to step S308. On the other hand, if the type of the inspection key information is the cause of the abnormality, that is, if the user can estimate the cause of the abnormality, the process proceeds to step S310.

  In step S308, the moving image search unit 308 inputs time according to the user's operation. In step S309, the moving image search unit 308 selects moving image data corresponding to the time input in step S308 among moving image data with a tag indicating the meaning of “cause candidate”. Search from the storage device 204. In step S <b> 310, the moving image search unit 308 inputs a tag (for example, “non-standard meal”) corresponding to the cause of the abnormality in accordance with a user operation. In step S <b> 311, the moving image search unit 308 moves the moving image data of the portion to which the tag input in step S <b> 310 is added, among the moving image data to which the tag indicating the meaning of “cause candidate” is attached. Is retrieved from the storage device 204.

  The moving image display unit 309 displays moving image data at a location corresponding to the cause candidate searched as described above. FIG. 7 is a diagram illustrating an example of moving image data of a portion corresponding to a cause candidate displayed by the moving image display unit 309. As shown in FIG. 7, moving image data (cause candidate 1,..., Cause candidate n) at a location corresponding to the cause candidate searched by the moving image search unit 308 is displayed so that it can be browsed simultaneously. As a result, it becomes possible to easily compare the moving image data, and to prevent a slight difference from being overlooked. Note that the number of moving image data that can be viewed simultaneously can be arbitrarily set by the user. For example, when the number of searched moving image data is small and it is desired to shorten the viewing time of moving image data as much as possible, all the searched moving image data may be viewed simultaneously. On the other hand, when it is desired to compare a small number of moving image data in detail, the number of moving image data to be displayed at the same time may be limited. Further, when there is moving image data to be worried about, it is possible to leave only the moving image data and sequentially compare with other moving image data. Furthermore, the moving image data of the location corresponding to the cause candidate and the moving image data of the location corresponding to the abnormal state can be displayed at the same time, which can be used for reconfirmation of the diagnosis and explanation to the patient. Further, the possibility that the cause candidate corresponding to each searched moving image data is the true cause (true cause) is calculated, and moving image data is arranged in descending order of the calculated possibility, or the moving image data is sequentially It can also take the form of displaying.

  FIG. 8 is a flowchart showing a process of calculating a possibility that a cause candidate corresponding to each searched moving image data is a real cause. In step S801, the causal relationship estimation unit 305 determines whether or not the user has input that the cause of the abnormality can be estimated. If it is input that the cause of the abnormality cannot be estimated, the process proceeds to step S802. On the other hand, if it is input that the cause of the abnormality can be estimated, the process proceeds to step S803.

  In step S <b> 802, the causal relationship estimation unit 305 compares the moving image data of the portion with the tag indicating the meaning of “abnormal state” with the learning data for specifying the type of abnormality. Then, the causal relationship estimation unit 305 identifies learning data having the highest degree of coincidence with the moving image data, and estimates the type of abnormality corresponding to the identified learning data as the type of abnormality corresponding to the moving image data at the location. To do. This is a process performed because the possibility of the true cause cannot be calculated unless the type of abnormality is known. Note that the data to be compared is not limited to moving image data with a tag indicating the meaning of “abnormal state”, but may be external environment information acquired at the same time, text data input by the user, or the like.

  After the type of abnormality is estimated in step S802, or when the cause of the abnormality can be estimated, the process proceeds to step S803. In step S <b> 803, the causal relationship estimation unit 305 compares the moving image data of the part with the tag indicating the meaning of “cause candidate” with the learning data for identifying the cause. Again, as in the case of specifying the type of abnormality in step S802, the data to be compared is not limited to moving image data at a location with a tag indicating the meaning of “cause candidate”. In step S804, the causal relationship estimation unit 305 can determine whether the degree of coincidence between the moving image data with the tag indicating the meaning of “cause is a candidate” and the learning data for identifying the cause is true. The calculated possibility is attached to the moving image data. In step S805, the causal relationship estimation unit 305 determines whether or not the possibility of a true cause has been calculated for all moving image data with a tag indicating the meaning of “being a cause candidate”. If the possibility of the true cause has been calculated for all moving image data, the process ends. On the other hand, if there is moving image data for which the possibility of the true cause has not yet been calculated, the process returns to step S803.

  As described above, in the present embodiment, the location where the captured moving image data has changed is recorded as an abnormal state scene or a cause candidate scene, and a scene required by a doctor can be easily retrieved later. can do. In addition, when detecting a scene in which moving image data has changed, in addition to patient movement in the moving image data, biological information such as pulse, respiration, and body temperature is also used to change the moving image data. Detection accuracy can be increased.

  In addition, it is possible to specify which period, movement, and biological information should be emphasized based on existing medical examination information. In addition, when browsing moving image data corresponding to a cause candidate, the moving image data is displayed in the descending order of possibility of the true cause, or the moving image data is displayed in the order designated by the doctor. Thus, it is possible to facilitate the doctor's examination and support the doctor's diagnosis.

  Next, a second embodiment of the present invention will be described. In the second embodiment, as shown in FIG. 5, instead of adding a tag for identifying the type of meal to a moving image data with a tag indicating a meaning of “cause candidate”, A tag for identifying the type of the person who has contacted is attached. Hereinafter, only the difference from the first embodiment will be described. The configuration of the medical information recording system according to the second embodiment is the same as the configuration shown in FIGS. Accordingly, in the following description, the reference numerals shown in these figures are used.

  FIG. 9 is a flowchart showing a process for adding a tag for identifying the type of the person in contact with the patient to the moving image data. In step S901, the change detection unit 303 detects whether a person other than the patient has entered the moving image data. This detection process is performed by existing face recognition and face authentication techniques. When a person other than the patient enters the moving image data, the process proceeds to step S902. On the other hand, if no person other than the patient has entered the moving image data, the process ends.

  In step S902, the change detection unit 303 determines whether the person who has entered the moving image data is a hospital related person such as a doctor. This is because contact with hospital personnel is considered to be unlikely to cause an abnormality, and therefore, it is easier to narrow down when searching later if the tags assigned to the moving image data are distinguished. Note that the specific processing in step S902 is performed in such a manner that face data of hospital personnel such as doctors and nurses is registered in advance and collated with the face data.

  If the person who has entered the moving image data is a hospital person, the process proceeds to step S903. On the other hand, if the person who entered the moving image data is a person other than the hospital staff, the process proceeds to step S904. In step S <b> 903, the tag information adding unit 304 adds a tag indicating the meaning of “hospital person” to the moving image data of the location where the change has occurred and stores the tag in the storage device 204. In this case, a tag indicating the meaning of “cause candidate” and a tag indicating the meaning of “hospital person” are attached to the moving image data at the location where the change has occurred. In step S <b> 904, the tag information adding unit 304 adds a tag indicating the meaning of “patient related person” to the moving image data of the location where the change has occurred and stores the tag in the storage device 204. In this case, a tag indicating the meaning of “cause candidate” and a tag indicating the meaning “patient-related person” are attached to the moving image data at the location where the change has occurred. The above processing is repeatedly executed until it is determined from the moving image data that there is no person other than the patient, that is, it is determined in step S106 that the change has been completed.

  As described above, when it is presumed that a person who has contacted the patient has any allergy source, it is possible to easily search for moving image data of a corresponding part.

  In the above-described embodiment, a tag for identifying the type of meal and a tag for identifying the type of the person who has contacted the patient are attached to the moving image data. You may give to image data. That is, as long as it is an event that can be detected based on moving image data or external environment information, it is not limited to the type of meal or the type of person. In addition, a combination of the process described in the first embodiment and the process described in the second embodiment is also included in the scope of the present invention.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

  301: Moving image photographing unit, 302: External environment information acquisition unit, 303: Change detection unit, 304: Tag information adding unit, 305: Causal relationship estimation unit, 306: Search instruction unit, 307: Shooting instruction unit, 308: Movie Image search unit, 309: moving image display unit

Claims (13)

Detecting means for detecting that a physical abnormality has occurred in the subject based on moving image data of the subject imaged by the imaging means;
First providing means for assigning a first tag to the moving image data at the location where the detection means detects that a physical abnormality has occurred in the subject ;
Detecting means for detecting that a predetermined change has occurred in the moving image data;
When the detection means detects that a predetermined change has occurred in the moving image data and the detection means does not detect that a physical change has occurred in the subject, the detection means A medical information processing apparatus, comprising: a second attaching unit that attaches a second tag to the moving image data at a location where a predetermined change is detected . The medical information according to claim 1 , further comprising search means for performing a search process on the moving image data based on the first tag or the second tag attached to the moving image data. Processing equipment. The medical information processing apparatus according to claim 2 , wherein the search unit searches the moving image data at a location to which the first tag is assigned. It said retrieval means, the medical information processing apparatus according to claim 2 or 3, characterized in that searching for the moving image data immediately before the location where the first tag is assigned. The medical information processing apparatus according to any one of claims 2 to 4 , wherein the search unit searches the moving image data at a location to which the second tag is added. Said retrieval means, according to claim, characterized in that said second tag of said moving image data points granted, searching the moving image data of a portion specified tag is granted by the user 5 The medical information processing apparatus according to 1. It said retrieval means, out of the moving image data of a portion the second tag is assigned, to claim 5 or 6, characterized in that searching for the moving image data corresponding to the specified time by the user The medical information processing apparatus described. Detecting means for detecting that a predetermined change different from the physical abnormality of the subject has occurred in the moving image data of the subject imaged by the imaging means;
The moving image data at a location where the detection unit detects that the predetermined change different from the physical abnormality of the subject is possible may be a true cause of the physical abnormality of the subject A calculating means for calculating the sex;
Presenting means for presenting the moving image data at a location where the predetermined change different from the physical abnormality of the subject is detected based on the possibility calculated by the calculating means;
It said that you have a medical care information processing apparatus. Said calculation means, by comparing with the moving image data of a portion that the predetermined change has occurred is detected, the learning data to determine the cause, the cause candidate corresponding to the moving image data The medical information processing apparatus according to claim 8 , wherein the possibility of a true cause is calculated. Detecting means for detecting that a physical abnormality has occurred in the subject based on moving image data of the subject imaged by the imaging means;
First providing means for assigning a first tag to the moving image data at the location where the detection means detects that a physical abnormality has occurred in the subject;
Detecting means for detecting that a predetermined change has occurred in the moving image data;
When the detection means detects that a predetermined change has occurred in the moving image data and the detection means does not detect that a physical change has occurred in the subject, the detection means 2nd provision means which provides the tag which shows whether the meal contained in the said moving image data is a meal decided beforehand with respect to the said moving image data of the location where the predetermined change was detected When
A medical information processing apparatus comprising: Detecting means for detecting that a physical abnormality has occurred in the subject based on moving image data of the subject imaged by the imaging means;
First providing means for assigning a first tag to the moving image data at the location where the detection means detects that a physical abnormality has occurred in the subject;
Detecting means for detecting that a predetermined change has occurred in the moving image data;
When the detection means detects that a predetermined change has occurred in the moving image data and the detection means does not detect that a physical change has occurred in the subject, the detection means A second tag is provided for indicating whether or not a person other than the subject included in the moving image data is a hospital related person, with respect to the moving image data where a predetermined change has been detected. Granting means and
A medical information processing apparatus comprising: A medical information processing method executed by a medical information processing apparatus,
A detection step of detecting that a physical change has occurred in the subject based on the moving image data of the subject imaged by the imaging means;
A first assigning step for assigning a first tag to the moving image data at a location where physical anomaly has occurred in the subject by the detecting step ;
A detection step of detecting that a predetermined change has occurred in the moving image data;
When the detection step detects that a predetermined change has occurred in the moving image data, and the detection step does not detect that a physical change has occurred in the subject, the detection step A medical information processing method, comprising: a second assigning step of assigning a second tag to the moving image data at a location where a predetermined change is detected . A program for causing a computer to execute a medical information processing method executed by a medical information processing apparatus,
A detection step of detecting that a physical change has occurred in the subject based on the moving image data of the subject imaged by the imaging means;
A first assigning step for assigning a first tag to the moving image data at a location where physical anomaly has occurred in the subject by the detecting step ;
A detection step of detecting that a predetermined change has occurred in the moving image data;
When the detection step detects that a predetermined change has occurred in the moving image data, and the detection step does not detect that a physical change has occurred in the subject, the detection step A program for causing a computer to execute a second assigning step of assigning a second tag to the moving image data at a location where a predetermined change is detected .

Images