JP2020086722A - Information processing apparatus - Google Patents

Abstract

To provide an information processing apparatus capable of suppressing that an article not associated with a person serving as an object to which an article relating to business of facilities is provided, is mistakenly specified as an article associated with the person.SOLUTION: An information processing apparatus outputs information indicating whether an object article is associated with a person on the basis of: a first captured image which is obtained by capturing a face of the person serving as an object to which an article relating to business of facilities for performing at least one of a healthcare, a nursing, and a rehabilitation is provided; and a second captured image which is obtained by capturing, as the object article, one of the plurality of articles whose content or a type is different from each other.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device.

Research and development have been conducted on technologies that assist the work of facilities that perform at least one of medical treatment, nursing care, and rehabilitation, such as hospitals and nursing homes.

In this regard, in the information processing device that specifies the medical information necessary for the instruction information for the doctor to instruct the medical personnel from the medical record information input by the doctor in the electronic medical record, for each type of medical information to be specified. An information processing device is known that includes type identification information for identifying medical information from medical record information, and extraction means for extracting the specific medical information identified by the type identification information (see Patent Document 1). ..

JP, 2018-163406, A

Here, in the above-mentioned facility, it may be necessary to specify the article associated with the user of the facility from the articles related to the business of the facility. However, in the facility, an item that is not associated with the user may be mistakenly identified as an item associated with the user. For example, when it is difficult to confirm the identity of the user due to dementia of the user, an item that is not associated with the user is erroneously identified as an item associated with the user. It may end up. As a result, in the facility, articles that are not associated with the user may be used by the user.

The present invention has been made in consideration of such circumstances, and mistakenly identifies an article that is not associated with a person who is a target to whom an article related to work of a facility is provided, as an article associated with the person. An object of the present invention is to provide an information processing device capable of suppressing such a situation.

One aspect of the present invention is that a first captured image in which a face of a person who is a target of which an article related to work of a facility that performs at least one of medical care, nursing care, and rehabilitation is provided, and the content or type of the first captured image are mutually different. An information processing apparatus that outputs information indicating whether or not the target article is associated with the person, based on a second captured image in which one of the plurality of different articles is captured as the target article. is there.

Further, according to an aspect of the present invention, an identification image representing item identification information for individually identifying each item is attached to each of the plurality of items, and the second captured image includes a plurality of items of the plurality of items. The identification image attached to the article selected by the user is captured, and the face information indicating the user's face and the user are shown for each of the one or more users who use the facility. First correspondence information in which user identification information is associated, the user identification information indicating a user for each of the one or more users, and the item indicating the article associated with the user A first storage unit that stores second correspondence information that is associated with item identification information, and the user that is associated with the user who matches the person by face authentication based on the first captured image A first identifying unit that identifies the identification information from the first correspondence information, and the second identification image, and is associated with the article identification information represented by the identification image captured in the second captured image. A second specifying unit that specifies the obtained user identification information from the second correspondence information, the user identification information that is specified by the first specifying unit, and the user that is specified by the second specifying unit. An output unit that outputs information indicating whether or not the article captured in the second captured image is associated with the person captured in the first captured image based on user identification information. A configuration comprising: and may be used.

Further, in one embodiment of the present invention, in the information processing device, the facility is a hospital, the article is a medicine or a container containing the medicine, the user is a patient, and the identification image is The configuration may be used, which is a one-dimensional code or a two-dimensional code.

Further, according to one aspect of the present invention, in the information processing device, whether the user identification information specified by the first specifying unit and the user identification information specified by the second specifying unit match each other. The determination unit that determines whether or not the output unit matches the user identification information identified by the first identification unit with the user identification information identified by the second identification unit. When the determination unit determines that the user who has been identified by the first identifying unit outputs information indicating that the article captured in the second captured image is associated with the person When the determination unit determines that the identification information and the user identification information identified by the second identification unit do not match, the article captured in the second captured image corresponds to the person. A configuration may be used that outputs information indicating that it is not attached.

Further, according to one aspect of the present invention, in the information processing device, a history in which the second storage unit and the information indicating the determination result by the determination unit are associated with the time information indicating the time when the determination by the determination unit is performed. A configuration including a storage control unit that stores the second storage unit as information may be used.

Further, according to one aspect of the present invention, in the information processing device, a display unit that displays an image is provided, and the output unit determines whether the article captured in the second captured image is associated with the person. A configuration may be used in which information indicating that is output to the display unit and the information is displayed on the display unit.

Further, according to an aspect of the present invention, in the information processing device, the output unit displays information indicating that the article captured in the second captured image is associated with the person on the display unit. In this case, a configuration may be used in which a UI (User Interface) to which information indicating that the article captured in the second captured image is provided to the person is input is displayed on the display unit. ..

Further, according to an aspect of the present invention, in the information processing device, the output unit provides another device with information indicating whether the article captured in the second captured image is associated with the person. An output, configuration may be used.

Further, according to an aspect of the present invention, in the information processing device, an image capturing unit is provided, and the first captured image and the second captured image are captured images captured by the image capturing unit. Good.

According to the present invention, it is possible to prevent an article that is not associated with a person who is a target to whom an article related to work of a facility is provided from being mistakenly identified as an article associated with the person.

It is a figure which shows an example of a structure of the information processing system 1 which concerns on embodiment. FIG. 9 is a diagram showing an example of a flow of processing performed by the information processing device 20.

<Embodiment>
Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Outline of information processing system>
First, the outline of the information processing system according to the embodiment will be described.

The information processing system includes a plurality of first and second captured images that are different in content or type from a first captured image in which a face of a person to whom an article related to work in a facility that performs at least one of medical treatment, nursing care, and correction is provided. Based on the second captured image in which one of the articles is captured as the target article, information indicating whether the target article is associated with the person is output. Accordingly, the information processing system can prevent an article that is not associated with a person to whom an article related to the work of the facility is provided from being mistakenly identified as an article associated with the person. it can.

Hereinafter, the configuration of such an information processing system and the processing performed by the information processing system will be described in detail.

<Structure of information processing system>
The configuration of the information processing system 1 according to the embodiment will be described below with reference to FIG. FIG. 1 is a diagram showing an example of the configuration of an information processing system 1 according to the embodiment.

Here, the information processing system 1 includes the mobile terminal 10 and the information processing device 20, as shown in FIG. In the example shown in FIG. 1, the mobile terminal 10 and the information processing device 20 are separate bodies. In addition, in the information processing system 1, the mobile terminal 10 and the information processing device 20 may be integrally configured.

In the information processing system 1, the mobile terminal 10 captures an image of the face of a person who is to be provided with an article related to work in a facility that performs at least one of medical care, nursing care, and correction. Then, in the information processing system 1, the information processing device 20 acquires the captured image in which the face of the person is captured by the mobile terminal 10 as the first captured image. Hereinafter, for convenience of description, an article related to the work of the facility will be simply referred to as an article. Further, in the following, for convenience of description, the person is described as a target person. Further, in the following, for convenience of description, the facility will be simply referred to as a facility. Here, the facility is, for example, a hospital, a nursing facility, a rehabilitation facility, or the like, but is not limited to these.

For example, when the facility is a hospital, articles relating to the work of the facility include, but are not limited to, medicines, medical records, nursing records, and slips. Further, in this case, the target person is a patient who is hospitalized in the hospital, a patient who is attending the hospital, etc. (that is, a user who uses the hospital, etc.), but is not limited to these. Further, in this case, the user who operates the mobile terminal 10 is a nurse, a doctor, various therapists, a medical clerk, or the like, but is not limited to these.

Further, for example, when the facility is a nursing care facility, the articles related to the work of the facility are various tools used for nursing care, nursing care records, slips, etc., but are not limited to these. Further, in this case, the target person is, for example, a user who is using a care facility, but is not limited to this. Further, in this case, the user who operates the mobile terminal 10 is a caregiver, a clerk of a care facility, or the like, but is not limited to these.

Further, for example, when the facility is a rehabilitation facility, the articles relating to the work of the facility are various tools used for rehabilitation, rehabilitation records, slips, etc., but are not limited to these. Further, in this case, the target person is, for example, a user who uses the rehabilitation facility, but is not limited to this. In addition, in this case, the user who operates the mobile terminal 10 is a staff member or the like of the rehabilitation facility, but is not limited to these.

Further, in the information processing system 1, one of a plurality of articles having different contents or types from each other is imaged by the mobile terminal 10 as a target article. Then, in the information processing system 1, the information processing device 20 acquires, as the second captured image, the captured image in which the target article is captured by the mobile terminal 10.

Here, the plurality of articles having different contents are, for example, charts, slips, and the like created in a hospital. Further, the plurality of articles of different types are, for example, medicines and the like.

Further, an identification image representing article identification information for identifying each is attached to each of the plurality of articles having different contents or types. The item identification information of a certain item is information indicating the item, for example, an identification ID indicating the item. The item identification information of the item may be other information that can indicate the item. The identification image is, for example, a one-dimensional code or a two-dimensional code. The one-dimensional code is, for example, a barcode or a color code. The two-dimensional code is, for example, a QR code (registered trademark) or the like. Moreover, the identification image may be attached to the article itself or may be attached to the container containing the article. That is, in the embodiment, the identification image attached to the article means the identification image attached to the article itself or the identification image attached to the container containing the article.

That is, the second captured image in which the target article is captured is, more specifically, an image in which the identification image attached to the target article is captured.

Then, in the information processing system 1, the information processing apparatus 20 associates the target article with the target person based on the first captured image acquired from the mobile terminal 10 and the second captured image acquired from the mobile terminal 10. The information indicating whether or not it is output is output.

More specifically, in the information processing system 1, the information processing apparatus 20 causes the first captured image acquired from the mobile terminal 10, the second captured image acquired from the mobile terminal 10, the first correspondence information, and the second correspondence information. Based on the correspondence information, information indicating whether the target article is associated with the target person is output.

Here, the first correspondence information is information in which face information indicating the face of the user and user identification information indicating the user are associated with each other for each of one or more users who use the facility. Is. The face information indicating the face of the user is, for example, a captured image in which the face of the user is captured. The face information indicating the face of the user may be other information capable of indicating the face of the user, such as CG indicating the face of the user. The first identification information indicating the user is, for example, an identification ID indicating the user, but may be other information capable of indicating the user.

The second correspondence information is associated with user identification information indicating a user and article identification information indicating an article associated with the user for each of one or more users who use the facility. Information. The item identification information indicating the item is, for example, an identification ID indicating the item, but may be other information that can indicate the item.

The information processing device 20 identifies, from the first correspondence information, the user identification information associated with the user who matches the target person by face authentication based on the acquired first captured image. In addition, the information processing device 20, based on the acquired second captured image, sets the user identification information associated with the item identification information represented by the identification image captured in the second captured image in the second correspondence information. Specify from. The information processing device 20 is based on the user identification information identified from the first correspondence information and the user identification information identified from the second correspondence information, and the target article imaged in the second captured image. Outputs information indicating whether or not is associated with the subject imaged in the first captured image. As a result, the information processing system 1 can prevent the article that is not associated with the target person from being mistakenly identified as the article that is associated with the target person. That is, for example, the information processing system 1 can prevent a drug that is not scheduled to be administered to the subject from being mistakenly identified as a drug to be administered to the subject.

Here, the mobile terminal 10 is, for example, an information processing device such as a multifunctional mobile phone terminal (smartphone), a mobile phone terminal, a tablet PC (Personal Computer), a notebook PC, or the like, but is not limited thereto. The mobile terminal 10 is communicatively connected to the information processing device 20 by wireless communication such as a mobile communication network or a wireless LAN (Local Area Network). Note that the mobile terminal 10 may be configured to be communicatively connected to the information processing device 20 by wire communication via a cable.

The mobile terminal 10 includes an imaging unit 11 and a display unit 12.

The imaging unit 11 is a camera including, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like as an imaging element that converts the collected light into an electric signal. The image capturing unit 11 captures a still image or a moving image. Hereinafter, as an example, a case where the image capturing unit 11 captures a still image will be described. When the image capturing unit 11 captures a moving image, the information processing system 1 performs a process based on any of the frames of the moving image instead of the captured image described below.

The display unit 12 is a display device including a liquid crystal display panel, an organic EL (ElectroLuminescence) display panel, and the like. The display unit 12 may be a touch panel integrated with a touch pad as an input device.

The information processing device 20 is, for example, a workstation, a desktop PC, a server, or the like, but is not limited to these.

The information processing device 20 also includes, for example, a storage unit 22, a communication unit 23, and a control unit 24. The information processing device 20 communicates with the mobile terminal 10 via the communication unit 23. The communication may be relayed by another device such as a server.

The storage unit 22 includes, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), an EEPROM (Electrically Erasable Programmable Read-Only Memory), a ROM (Read-Only Memory), a RAM (Random Access Memory), and the like. Note that the storage unit 22 may be an external storage device connected via a digital input/output port such as a USB (Universal Serial Bus) instead of being built in the information processing device 20. The storage unit 22 stores various information processed by a processor (not shown) included in the information processing apparatus 20, various instructions executable by a computer, various images, and the like. The processor is a CPU (Central Processing Unit), but may be another processor such as an FPGA (Field Programmable Gate Array). The processor included in the information processing device 20 executes various commands stored in the storage unit 22 included in the information processing device 20.

The storage unit 22 also includes a first storage unit 221 and a second storage unit 222.

The first storage unit 221 is a part of the storage area of the storage unit 22. The first storage unit 221 stores the above-mentioned first correspondence information and second correspondence information.

The second storage unit 222 stores history information described later.

The communication unit 23 is configured to include, for example, a digital input/output port such as USB and an Ethernet (registered trademark) port.

The information processing device 20 may be configured to include an input device such as a keyboard, a mouse, and a touch pad. The information processing device 20 may be configured to include a display device including a liquid crystal display panel, an organic EL (ElectroLuminescence) display panel, and the like.

The control unit 24 controls the entire information processing device 20. The control unit 24 includes an image acquisition unit 241, a first identification unit 242, a second identification unit 243, a determination unit 244, an output unit 245, and a storage control unit 246. These functional units included in the control unit 24 are realized by, for example, a processor (not illustrated) included in the information processing device 20 executing various commands stored in the storage unit 22. Further, some or all of these functional units may be hardware functional units such as LSI (Large Scale Integration) and ASIC (Application Specific Integrated Circuit).

The image acquisition unit 241 acquires, from the mobile terminal 10, the captured image captured by the imaging unit 11 of the mobile terminal 10. More specifically, the image acquisition unit 241 acquires, from the mobile terminal 10, a captured image in which the face of the target person is captured by the imaging unit 11 as the first captured image, for example. Further, the image acquisition unit 241 acquires, from the mobile terminal 10, the captured image obtained by capturing the target article by the image capturing unit 11 as the second captured image, for example.

The first identification unit 242 uses the face authentication based on the first captured image acquired by the image acquisition unit 241 to associate the user identification information with the user who matches the target person captured in the first captured image. From the first correspondence information.

The second specifying unit 243 determines, based on the second captured image acquired by the image acquiring unit 241, the user identification information associated with the item identification information represented by the identification image captured in the second captured image. 2 Identify from the correspondence information.

The determination unit 244 determines whether or not the user identification information identified by the first identification unit 242 and the user identification information identified by the second identification unit 243 match.

When the determination unit 244 determines that the user identification information identified by the first identification unit 242 and the user identification information identified by the second identification unit 243 match, the output unit 245 is the target article. Outputs information indicating that the user identification information is associated with the target person, and the user identification information identified by the first identification unit 242 and the user identification information identified by the second identification unit 243 match. If the determination unit 244 determines that the target article is not present, the information indicating that the target article is not associated with the target person is output.

The storage control unit 246 stores information indicating the determination result of the determination unit 244 in the second storage unit 222 as history information associated with time information indicating the time at which the determination unit 244 performed the determination.

<Process performed by information processing device>
The processing performed by the information processing device 20 will be described below with reference to FIG. FIG. 2 is a diagram illustrating an example of the flow of processing performed by the information processing device 20.

The first specifying unit 242 waits until the image acquisition unit 241 acquires the first captured image from the mobile terminal 10 (step S110). Here, for example, when the mobile terminal 10 has a dedicated application program installed and the user of the mobile terminal 10 images the target person by the image capturing unit 11, the captured image captured by the image capturing unit 11 is the captured image. Is output to the information processing device 20 together with information indicating that is the first captured image. In this case, when acquiring the captured image together with the information from the mobile terminal 10, the image acquisition unit 241 acquires the captured image as the first captured image. Accordingly, the first specifying unit 242 determines whether the image acquisition unit 241 has acquired the first captured image.

When determining that the image acquiring unit 241 has acquired the first captured image from the mobile terminal 10 (step S110-YES), the first specifying unit 242 performs the first specifying process (step S120). Here, in step S120, the first identifying unit 242 identifies the user identification information associated with the user who matches the target person by face authentication based on the first captured image from the first association information. Is performed as the first specifying process.

Next, the second specifying unit 243 waits until the image acquisition unit 241 acquires the second captured image from the mobile terminal 10 (step S130). Here, for example, when the dedicated application program is installed in the mobile terminal 10 and the user of the mobile terminal 10 images the target article by the image capturing unit 11, the captured image captured by the image capturing unit 11 is the captured image. Is output to the information processing device 20 together with information indicating that is the second captured image. In this case, the image acquisition unit 241 acquires the captured image as the second captured image when the captured image is acquired from the mobile terminal 10 together with the information. Accordingly, the second identifying unit 243 determines whether the image acquisition unit 241 has acquired the second captured image.

The 2nd specific part 243 performs the 2nd specific processing, when it is judged that image acquisition part 241 acquired the 2nd image pick-up picture from personal digital assistant 10 (Step S130-YES) (Step S140). Here, the 2nd specific part 243 reads the article identification information which the said identification image represents from the said identification image based on the identification image imaged by the 2nd picked-up image in step S140. Then, the second specifying unit 243 specifies the user identification information associated with the read item identification information from the second correspondence information. The second specifying unit 243 performs such processing as the second specifying processing.

Next, the determination unit 244 determines whether or not the user identification information identified by the first identification unit 242 and the user identification information identified by the second identification unit 243 match (step S150). ).

Next, the output unit 245 outputs information indicating the determination result of the determination performed by the determination unit 244 in step S150 (step S160). Here, in the output unit 245, the determination unit 244 determines in step S150 that the user identification information identified by the first identification unit 242 and the user identification information identified by the second identification unit 243 match. When the determination is made, information indicating that the target article is associated with the target person is output.

More specifically, in this case, the output unit 245 outputs the information to the mobile terminal 10 and causes the display unit 12 of the mobile terminal 10 to display the information. At this time, in this case, the output unit 245 may be configured to display on the display unit 12 a UI (User Interface) to which information indicating that the target article has been provided to the target person is input. As a result, the information processing system 1 can record that the target article is provided to the target person, forgetting to provide the target article to the target person, and excessively providing the target article to the target person. It can be suppressed. Further, in this case, the storage control unit 246 stores the information in the second storage unit 222 as history information associated with time information indicating the time when the determination by the determination unit 244 is performed. As a result, the information processing system 1 can record a history of determinations made by the information processing system 1. Further, in this case, the output unit 245 may be configured to output the information to another device. Further, in this case, and when the information processing device 20 includes a display device, the output unit 245 may be configured to display the information on the display device.

On the other hand, in the output unit 245, the determination unit 244 determines in step S150 that the user identification information identified by the first identification unit 242 and the user identification information identified by the second identification unit 243 do not match. In that case, information indicating that the target article is not associated with the target person is output. At this time, the output unit 245 may be configured to cause the display unit 12 to display warning information that warns that the target article is not associated with the target person in this case. Further, in this case, the output unit 245 may be configured to cause the mobile terminal 10 to output a sound that warns that the target article is not associated with the target person. As a result, the information processing system 1 can prevent the article that is not associated with the target person from being mistakenly identified as the article that is associated with the target person. Further, in this case, the storage control unit 246 stores the information in the second storage unit 222 as history information associated with time information indicating the time when the determination by the determination unit 244 is performed. As a result, the information processing system 1 can record a history of determinations made by the information processing system 1. Further, in this case, the output unit 245 may be configured to output the information to another device. Further, in this case, and when the information processing device 20 includes a display device, the output unit 245 may be configured to display the information on the display device.

After the processing of step S160 is performed, the information processing device 20 ends the processing.

As described above, the information processing device (the information processing device 20 in the example described above) of the information processing system (the information processing system 1 in the example described above) according to the embodiment is used for medical treatment, nursing care, and correction. The face of the person (the target person in the example described above) to which the article (for example, pharmaceutical product) related to the work of the facility (for example, hospital) that performs at least one of them is provided is captured. Based on the one captured image and the second captured image in which one of the plurality of articles having different contents or types from each other is captured as the target article, it is indicated whether or not the target article is associated with the person. Output information. As a result, the information processing system or the information processing apparatus may erroneously identify an article that is not associated with the person who is the target to whom the article related to the work of the facility is provided, as the article associated with the person. Can be suppressed.

Further, in the information processing apparatus of the information processing system, an identification image (for example, a QR code or the like) representing item identification information for identifying each item is attached to each of the plurality of items, and the second captured image includes The identification image attached to the item selected by the user among the plurality of items is captured, and the face information indicating the face of the user and the user are displayed for each of the one or more users who use the facility. First correspondence information associated with the user identification information indicated, user identification information indicating the user for each of the one or more users, and item identification information indicating the item associated with the user A first storage unit (the first storage unit 221 in the example described above) in which the second correspondence information in which is associated with is stored, and a user who matches a person by face authentication based on the first captured image Based on the second imaged image, the first identification unit (in the example described above, the first identification unit 242) that identifies the user identification information associated with A second specifying unit (the second specifying unit 243 in the example described above) that specifies the user identification information associated with the item identification information represented by the identification image captured in the image from the second correspondence information. And an image of the article captured in the second captured image in the first captured image based on the user identification information identified by the first identifying unit and the user identification information identified by the second identifying unit. A configuration including an output unit (in the example described above, the output unit 245) that outputs information indicating whether or not it is associated with the person being used may be used.

Further, in the information processing apparatus of the information processing system, the facility is a hospital, the article is a medicine or a container containing the medicine, the user is a patient, and the identification image is a one-dimensional code or a two-dimensional code. The configuration, which is a code, may be used.

Further, in the information processing device of the information processing system, the determination unit that determines whether or not the user identification information identified by the first identification unit and the user identification information identified by the second identification unit match. (In the example described above, the determination unit 244) and the output unit match the user identification information specified by the first specifying unit with the user identification information specified by the second specifying unit. When the determination unit determines, the information indicating that the article captured in the second captured image is associated with the person is output, and the user identification information identified by the first identification unit and the user identification information When the determination unit determines that the user identification information identified by the identification unit 2 does not match, the information indicating that the article imaged in the second captured image is not associated with the person is output. Yes, configurations may be used.

In addition, the information processing apparatus of the information processing system includes the second storage unit (the second storage unit 222 in the above-described example) and the information indicating the determination result of the determination unit, and the time at which the determination unit made the determination. A storage control unit (in the example described above, the storage control unit 246) that is stored in the second storage unit as the history information associated with the time information indicating that the configuration may be used.

The information processing apparatus of the information processing system includes a display unit that displays an image (in the example described above, the display unit 12 or the display provided in the information processing apparatus 20 when the information processing apparatus 20 is integrated with the mobile terminal 10). A device), and the output unit outputs, to the display unit, information indicating whether or not the article captured in the second captured image is associated with the person, and causes the display unit to display the information. May be used.

Further, in the information processing apparatus of the information processing system, when the output unit causes the display unit to display information indicating that the article imaged in the second captured image is associated with the person, the second captured image A configuration may be used in which a UI for inputting information indicating that the imaged article is provided to the person is displayed on the display unit.

Further, in the information processing apparatus of the information processing system, the output unit may provide information indicating whether or not the article captured in the second captured image is associated with the person, to another apparatus (in the example described above, A configuration may be used in which the information processing device 20 outputs to the mobile terminal 10 or another device when the information processing device 20 is separate from the mobile terminal 10.

Further, the information processing apparatus of the information processing system includes an imaging unit (in the example described above, the imaging unit 11 when the information processing device 20 is integrated with the mobile terminal 10), and the first captured image and the second captured image A configuration may be used in which the image is a captured image captured by the image capturing unit.

Although the embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and modifications, replacements, deletions, etc. are possible without departing from the gist of the present invention. May be done.

Further, the program for realizing the function of any component of the above-described device may be recorded in a computer-readable recording medium, and the program may be read by a computer system and executed. Here, the device is, for example, the mobile terminal 10, the information processing device 20, or the like. It should be noted that the “computer system” mentioned here includes an OS (Operating System) and hardware such as peripheral devices. The "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD (Compact Disk)-ROM, or a storage device such as a hard disk built in a computer system. .. Furthermore, "computer-readable recording medium" refers to a fixed amount of volatile memory inside the computer system that serves as a server or client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Those that hold time programs are also included.

Further, the above program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the "transmission medium" for transmitting the program refers to a medium having a function of transmitting information, such as a network such as the Internet or a communication line such as a telephone line.
Further, the above program may be a program for realizing a part of the functions described above. Furthermore, the above program may be a program that can realize the above-mentioned functions in combination with a program already recorded in a computer system, that is, a so-called difference file or difference program.

DESCRIPTION OF SYMBOLS 1... Information processing system, 10... Portable terminal, 11... Imaging part, 12... Display part, 20... Information processing device, 22... Storage part, 23... Communication part, 24... Control part, 221... 1st storage part, 222 ... second storage unit, 241... image acquisition unit, 242... first identification unit, 243... second identification unit, 244... determination unit, 245... output unit, 246... storage control unit

Claims (9)

Of the plurality of articles having different contents or types from the first captured image in which the face of the person to whom the article related to the work of the facility that performs at least one of medical care, nursing care, and correction is provided is provided. One of the items is output based on the second captured image captured as the target article, and information indicating whether the target article is associated with the person is output.
Information processing device. Each of the plurality of the articles, an identification image representing the article identification information for individually identifying is attached,
In the second captured image, the identification image attached to the article selected by the user among the plurality of articles is captured,
First correspondence information in which face information indicating a user's face and user identification information indicating a user are associated with each of one or more users who use the facility, and the one or more uses First storage in which, for each person, second identification information in which the user identification information indicating a user and the article identification information indicating the article associated with the user are associated Department,
A first identification unit that identifies the user identification information associated with the user who matches the person by face authentication based on the first captured image from the first correspondence information;
Based on the second captured image, the user identification information associated with the item identification information represented by the identification image captured in the second captured image is identified from the second correspondence information. 2 specific parts,
Based on the user identification information identified by the first identification unit and the user identification information identified by the second identification unit, the article captured in the second captured image is the first item. An output unit that outputs information indicating whether or not the person is captured in one captured image;
The information processing apparatus according to claim 1, further comprising: The facility is a hospital,
The article is a medicine or a container containing the medicine,
The user is a patient,
The identification image is a one-dimensional code or a two-dimensional code,
The information processing apparatus according to claim 2. A determination unit that determines whether or not the user identification information identified by the first identification unit and the user identification information identified by the second identification unit match;
When the determination unit determines that the user identification information identified by the first identification unit and the user identification information identified by the second identification unit match, the output unit is: Information indicating that the article captured in the second captured image is associated with the person is output, and the user identification information identified by the first identifying unit and the second identifying unit When the determination unit determines that the user identification information specified by does not match, the information indicating that the article captured in the second captured image is not associated with the person is displayed. Output,
The information processing apparatus according to claim 2. A second storage section;
A storage control unit that stores information indicating the determination result by the determination unit in the second storage unit as history information associated with time information indicating the time when the determination by the determination unit is performed;
The information processing apparatus according to claim 4, further comprising: Equipped with a display unit that displays images,
The output unit outputs information indicating whether the article captured in the second captured image is associated with the person to the display unit and causes the display unit to display the information.
The information processing apparatus according to any one of claims 2 to 5. When the output unit causes the display unit to display information indicating that the article captured in the second captured image is associated with the person, the output unit is captured in the second captured image. Displaying a UI (User Interface) on the display unit, into which information indicating that an article has been provided to the person is input;
The information processing device according to claim 6. The output unit outputs information indicating whether the article captured in the second captured image is associated with the person to another device,
The information processing apparatus according to any one of claims 2 to 7. Equipped with an imaging unit,
The first captured image and the second captured image are captured images captured by the image capturing unit,
The information processing apparatus according to any one of claims 1 to 8.

Images