JP2014117403A - Storage case, storage case design device, object management system, storage case design method, and object management method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an inexpensive storage case for object management.SOLUTION: A storage case 1 is the storage case to be attached to a terminal 20 to be carried. Keeping spaces 41-43 keeps an object inside the storage case 1. An imaging hole is opened to face an imaging unit 260 and light source part 265 of the terminal 20. A flat mirror 53 (a second reflection mirror) reflects light on the inner side and outer side of the storage case 1. Curved mirrors 61-63 reflect light between the flat mirror 53 (the second reflection mirror) and the keeping spaces 41-43.

Description

  The present invention relates to a storage case, a storage case design device, an article management system, a storage case design method, and an article management method, and more particularly to a storage case, a storage case design apparatus, and an article management system for managing articles on a mobile terminal. The present invention relates to a storage case design method and an article management method.

Traditionally, many elderly people have taken medicine daily for health and therapeutic purposes.
However, due to a decline in the cognitive ability of the elderly, accidents that significantly reduce the health status of the elderly frequently occur due to mistaking medication such as forgetting to drink or repeated drinking. Mistaken medication can be said to be medication behavior that reduces the main effects (drug efficacy) of the drug and increases side effects.
As a general countermeasure against such accidental medication accidents, caregivers and the like are confirmed whether the dosage and dosage are being observed every time an elderly person takes the medicine. However, the time and physical burden for visiting elderly people's homes was great. Furthermore, there are cases where the caregiver has a psychological burden in confirming the usage and dose, for example, when confirming the medication of a mother-in-law who does not fit his personality.
In addition, there were many cases of going out without taking medicine, which caused the compliance rate to decrease.
For this reason, there is a need for a portable medication management system that strictly checks the medication status not only in elderly homes but also when going out.
In addition, there is a need for a portable medication management system that checks the medication status not only for the elderly but also for children attending kindergartens and nurseries.

Here, as a conventional portable terminal capable of confirming medication even when going out, a sensor that is attached to a storage space or the like and is turned on when the storage cover is opened, and this sensor is in an on state in which the storage cover is opened. A CPU that receives the signal, a relay transmission unit that receives a signal from the CPU and transmits a transmission signal in the storage space via the relay transmission antenna, and a reception signal transmitted from the storage space. During the ON state, the relay receiving unit that receives via the relay receiving antenna and transmits to the CPU and the clock, and the time received from the relay receiving unit is transmitted to the CPU as the time when the CPU receives the received signal. The technology of the portable terminal with a storage space including a clock, a received signal and time arranged by the CPU, information of a predetermined designated terminal, and a mail transmission / reception unit that transmits mail to the designated terminal. There has been disclosed (hereinafter referred to as prior art 1.).
According to the prior art 1, it becomes possible to always keep medicines in the storage space of the mobile terminal and to inform the family members of changes in the body of the patient.

JP 2010-114644 A

Since the conventional portable terminal like the prior art 1 requires the opening / closing sensor attached to a storage space etc., the exclusive portable terminal and the storage cover with a sensor were needed, and there existed a problem that cost increased.
Moreover, the conventional portable terminal like the prior art 1 had the problem that it only estimated the presence or absence of an article indirectly from the opening / closing state of the opening / closing sensor. That is, the open / close sensor cannot confirm whether the article has been replenished or acquired, and cannot accurately manage the article.

  This invention is made | formed in view of such a condition, and it aims at solving the above-mentioned subject.

The storage case of the present invention is a storage case attached to a portable terminal having an imaging means, and reflects a storage space for storing an article inside the storage case and first reflected light from the article in the storage space. A first reflecting mirror and a second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means are provided.
The storage case of the present invention is characterized in that the first reflection mirror is formed with a Bezier curve.
The storage case design apparatus of the present invention is a storage case design apparatus for designing a storage case attached to a portable terminal having an imaging means, wherein the storage case stores an article inside the storage case, and the storage A first reflection mirror that reflects the first reflected light from the article in the space; and a second reflection mirror that receives the second reflected light from the first reflection mirror and reflects the reflected light to the imaging means. The design apparatus includes a first reflection mirror position shape calculation unit that calculates the position and shape of the first reflection mirror by optical simulation.
The storage case design apparatus of the present invention includes a plurality of the storage spaces and the first reflection mirrors, and the first reflection mirror position shape calculation means includes the first reflection mirror and the first reflection mirror. The position and shape of the first reflecting mirror are calculated so as to receive the first reflected light from the storage space.
In the storage case design apparatus of the present invention, the position of each first reflection mirror is such that the first reflection mirror position shape calculation means has a difference between the imageable angles that can be imaged by the imaging means equal to or less than a predetermined value. And the shape of the first reflecting mirror is calculated by a Bezier curve.
In the storage case design apparatus of the present invention, the first reflection mirror position shape calculation means adjusts the control points of the Bezier curves of the respective first reflection mirrors so that images can be taken uniformly without leaving the storage space. It is characterized by that.
The article management system of the present invention is an article management system comprising a portable terminal having an imaging means and having a storage case attached thereto, wherein the storage case stores an article inside the storage case, and the storage A first reflecting mirror that reflects the first reflected light from the article in the space; and a second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means. Image recognition means for recognizing the presence / absence of the article in the storage space from image data captured by the means is provided.
In the article management system according to the present invention, the portable terminal stores storage condition data of the drug condition for the usage and dose of the article, position information acquisition means for acquiring position information, and the acquired position Based on the information, the location information acquisition means for acquiring the location information of the eating and drinking facility or the accommodation facility; A living state estimating unit that estimates a living state corresponding to sleep, a medication condition calculating unit that calculates a medication condition of the article based on the estimated life state and the medication condition data, and a calculated medication It is characterized by comprising dose confirmation means for causing the imaging means to take an image depending on conditions and for checking the presence or absence of the article by the image recognition means.
The article management system according to the present invention includes an image feature quantity data creating unit that creates the image feature quantity data of hue H and saturation S by converting the imaging data into an HLS color space to remove information on luminance L, and the article. Is captured by the imaging unit when the presence / absence of the article is confirmed by the dose confirmation unit and the background image data which is the image feature amount data created from the imaging data in a state that does not exist in the storage space Difference image data creating means for creating difference image data from confirmation image data that is the image feature amount data created from the imaging data, and region recognition for recognizing the region of the first reflecting mirror from the background image data And the image recognition means performs the image recognition of the article based on the recognized image of the area of the difference image data. And features.
The storage case design method of the present invention is a storage case design method for designing a storage case attached to a mobile terminal having an imaging means, wherein the storage case stores an article inside the storage case, and the storage A first reflecting mirror that reflects the first reflected light from the article in the space, and a second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means; The position and shape of the first reflecting mirror are calculated.
The article management method of the present invention is an article management method using a portable terminal having an imaging means and having a storage case attached thereto, a storage space for storing the article inside the storage case, and a storage space from the article in the storage space. A first reflecting mirror that reflects the first reflected light; and a second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means. From the imaging data imaged by the imaging means An image of the presence / absence of the article in the storage space is recognized.

According to the present invention, an article can be easily managed by attaching to a terminal such as a general mobile phone and optically imaging the article in the storage space by the first reflecting mirror and the second reflecting mirror with the imaging means of the terminal. It is possible to provide a storage case capable of reducing costs.
In addition, according to the present invention, it is possible to directly check the presence or absence of an article in the storage space by taking an image with the imaging means of the terminal, and it is possible to provide a storage case that performs accurate article management.

1 is a system configuration diagram of an article management system X according to an embodiment of the present invention. It is a block diagram which shows the control structure of the terminal 20 and the storage case 1 which concern on embodiment of this invention. It is a flow chart of article management processing by article management system X concerning an embodiment of the invention. It is a figure which shows the example of the medication condition data 218 which concerns on embodiment of this invention. It is an example of a screen of location information acquisition processing concerning an embodiment of the invention. It is a figure which shows the example of the medication condition calculation which concerns on embodiment of this invention. It is an example of the screen of the low risk or high risk medicine notification which concerns on embodiment of this invention. It is a flowchart of the image initial setting process which concerns on embodiment of this invention. It is a conceptual diagram which shows the structural example of the straight line detection and area | region recognition which concern on embodiment of this invention. It is a flowchart of the dose confirmation process which concerns on embodiment of this invention. It is a conceptual diagram of the background difference calculation process which concerns on embodiment of this invention. It is a block diagram which shows the control structure of the storage case design apparatus 10 which concerns on embodiment of this invention. It is a flowchart of the storage case design process which concerns on embodiment of this invention. It is a figure which shows the structure of the storage case 1 and the curved mirrors 61-63 which concern on embodiment of this invention. It is a perspective view which shows the storage case 1 which concerns on embodiment of this invention. It is a perspective view which shows the storage case 1 of FIG. It is a figure which shows the case part 2 of FIG. It is a figure which shows the curved mirror member 6 of FIG. It is a top view which shows the case part 2 of FIG. It is a figure which shows another structure of the storage case 1 which concerns on embodiment of this invention.

<Embodiment>
[Description of article management system X]
Next, the article management system X according to the embodiment of the present invention will be described with reference to FIGS.
The article management system X according to the embodiment of the present invention is a system that supports article management using the terminal 20 and the storage case 1 (FIG. 15).
The article management system X is a nurse, a doctor, etc., such as a provider of the article management system X. Supports article management for warning. For this reason, the article management system X uses the storage case 1 according to the embodiment in which the optical system is optimized. By attaching the storage case 1 to the terminal 20, an inexpensive article management support system can be constructed using a sensor or a display unit built in the terminal. The storage case 1 can also be expected to have an effect of preventing forgetting to take items.
Hereinafter, a user who takes out the terminal 20 and carries it will be described as a “medicine”.
In the following example, the article management system X is used as a medication management support system. However, the article management system X can be applied to other systems that manage the loading and unloading of articles at a predetermined place for a predetermined time and condition.

{Configuration of article management system X}
First, a system configuration of an article management system X according to an embodiment of the present invention will be described with reference to FIG.
In the article management system X according to the embodiment of the present invention, a server 30 and a terminal 20 (article management apparatus) that executes an article management process are connected via a network 25.
The terminal 20 is a terminal device for performing article management using a mobile phone, a smartphone, a PDA (Personal Digital Assistant), a tablet terminal, a tablet-type or notebook-type PC (Personal Computer), and the like. The terminal 20 is particularly preferably a smartphone that has excellent portability and can install application software (program).
The network 25 is a network such as a wireless telephone network, the Internet, or an intranet. The network 25 may be a mobile phone network, WiMAX, PHS network, wireless LAN, wired telephone line, LAN, power line LAN, cLink, dedicated line, or the like. As the network form of the network 25, an IP network or other star-shaped or ring-shaped network can be used.
The server 30 is a server group or the like on a so-called “cloud”, receives position information acquired by the terminal 20, and transmits map information, store information, and the like. It also has various service (daemon) functions such as transmission / reception of electronic mail (hereinafter referred to as “mail”), SMS (short message service), various messengers and chats, SNS (social network service), and video call server. Further, the server 30 may include storage means such as a database for storing medication history data, and medication condition data setting means such as a CGI or ASP server for setting medication condition data 218 (FIG. 2).
The management terminal 35 is a PC, a tablet terminal, a smartphone, or the like, and is a terminal device that is mainly used by an administrator to check the acquisition status of the article of the terminal 20. The management terminal 35 may be a portable terminal or a stationary type installed at a base. In the case where the management terminal 35 is a portable terminal, the administrator can access the drug taker's terminal 20, the server 30, etc. anytime and anywhere to check the medication status. For this reason, the management terminal 35 may include medication condition data setting means for accessing the terminal 20, as with the server 30. In addition, the management terminal 35 includes an imaging unit such as a web camera for performing a video call or the like with the terminal 20 and a voice input / output unit such as a microphone or a speaker. In addition, the management terminal 35 may be configured to access the server 30 using a web browser or the like.

{Configuration of terminal 20}
Next, a detailed configuration of the terminal 20 will be described with reference to FIG. The terminal 20 includes a control unit 200 (image recognition means, life state estimation means, location information acquisition means, medication condition calculation means, dose confirmation means, image feature value data creation means, difference image data creation means, area recognition means), storage Unit 210 (storage unit), input unit 230 (input unit), display unit 240 (display unit), audio output unit 250 (audio output unit, notification unit), feedback unit 255 (feedback unit, notification unit), imaging unit 260 (Imaging means), light source part 265 (light source), acceleration sensor part 270 (acceleration sensor means, position information acquisition means), atmospheric pressure sensor part 275 (atmospheric pressure sensor means, position information acquisition means), timer part 276 (time acquisition means) , GPS receiver 280 (position information acquisition means), network connection part 290 (network transmission / reception means, position acquisition means, notification means) Eteiru.
The storage case 1 according to the embodiment is attached to the terminal 20. The storage case 1 can store small articles in the storage spaces 41 to 43. These articles are imaged by the imaging unit 260 via the curved mirrors 61 to 63 (first reflection mirror) and the plane mirror 53 (second reflection mirror). Below, the example which uses an internal medicine, an injection needle, etc. (henceforth "medicine etc.") as an article is explained. The storage spaces 41 to 43 can be used for storing medicines for breakfast, lunch, dinner, and the like, for example. The detailed configuration of the storage case 1 will be described later.

The control unit 200 includes a CPU, an MPU, a DSP, a GPU, a dedicated processor, and the like, and is a unit that executes various programs and implements each function of the terminal 20. The control unit 200 executes the application 300 (application / software) in the storage unit 210 in cooperation with each unit, so that an image recognition unit, a life state estimation unit, a location information acquisition unit, a medication condition calculation unit, a dose confirmation unit, It functions as an image feature quantity data creation means, difference image data creation means, area recognition means, and dose detection means.
The storage unit 210 is a storage unit such as a RAM, a ROM, a flash memory, and an HDD. The storage unit 210 stores programs and data executed by the control unit 100. Specifically, the storage unit 210 stores an application 300 for causing the terminal 20 to function as an article management device of the article management system X. The application 300 is downloaded via an external recording medium, a PC (not shown) or the network connection unit 290 and stored in the storage unit 210. The storage unit 210 stores an OS, a WWW browser, an electronic mailer, map drawing (map) software, various programs such as a 3D drawing program, and data of these programs.
The voice input unit 220 is voice input means such as a condenser microphone and other ICs. The audio signal input from the microphone of the audio input unit 220 is converted into an electric signal, and converted into a digital signal by the A / D converter and input. The voice input unit 220 can acquire not only voice data but also vibration data.
The input unit 230 is an input unit including a touch panel, a touch pad, an electromagnetic digitizer, an optical pointing device, a trackball, a keyboard, a numeric keypad, a cursor key (cross key), a selection button, a cancel button, and other various buttons. . The input unit 230 acquires input information input by the user using these input means. In addition, the switch etc. which detect opening / closing of the storage spaces 41-43 of the storage case 1 may be attached to the input unit 230. The input unit 230 may be configured integrally with the display unit 240.
The display unit 240 is a display unit such as a liquid crystal display, an organic EL display, a plasma display, an LED, or a projector. The display unit 240 displays a two-dimensional image or a three-dimensional image including a moving image drawn by the GPU of the control unit 200.
The audio output unit 250 is an audio output unit such as a dynamic speaker or a piezoelectric element speaker. The audio output unit 250 outputs the D / A converted electric signal as an audio signal. The audio output unit 250 may include a warning buzzer or the like.
The feedback unit 255 is a vibration motor (vibrator), an electromagnetic actuator, a piezo element, or the like. In other words, the feedback unit 255 is a notification unit for giving a warning or the like to the drug taker with information other than the image and the sound. The feedback unit 255 may be provided with a notification unit that warns with a smell such as a wasabi odor, for a person who is blind and blind. In addition, the feedback unit 255 may include not only vibration but also means for notifying by a warm feeling or a cold feeling using a heater, a Peltier element, or the like.
The imaging unit 260 includes an imaging element such as a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS) and a lens, and is an imaging unit such as a camera that captures a still image or a moving image. The imaging unit 260 may be a single-focus camera that does not have a telephoto or macro imaging function. Even in this case, the imaging unit 260 can image the storage spaces 41 to 43 inside the storage case 1 in which the optical system is optimized. Note that a plurality of imaging units 260 may be provided. Even in this case, any one of the imaging units 260, mainly a camera provided behind, captures the inside of the storage case 1 when managing articles. .
The light source unit 265 is an LED light, a flash light, or the like, and serves as a light source when the imaging unit 260 captures an image. The light source unit 265 illuminates the storage spaces 41 to 43 from the inside when the lid 51 (FIG. 15) of the storage case 1 is opened and closed, etc., so that the drug taker can easily recognize the article in a dark place. Furthermore, it is also possible to notify the patient of the warning by the light emission of the light source unit 265.
The acceleration sensor unit 270 is a three-dimensional gyro sensor, an acceleration sensor, or the like, and detects an inclination of the terminal 20, an acceleration in a three-dimensional space due to movement of a drug taker, a movement distance, and the like. Furthermore, the acceleration sensor unit 270 may include a step number sensor, a drug taker's motion sensor, and the like. Further, the acceleration sensor unit 270 can also acquire fine vibration data such as an impact given to the terminal 20.
The atmospheric pressure sensor unit 275 is an atmospheric pressure sensor that can detect a change in atmospheric pressure on the order of several hectopascals. The height from the ground can be detected by the atmospheric pressure sensor unit 275. Further, the atmospheric pressure sensor unit 275 can also detect a change in weather.
The timer unit 276 is means for acquiring time information of the current time such as a real-time clock by a crystal resonator. By using the time information acquired by the timer unit 276, the estimation accuracy of the living state can be improved. Note that the timer unit 276 may acquire time information by the GPS receiving unit 280 or may perform time adjustment. Further, the timer unit 276 is connected to the server 30, the mobile base station (not shown), and another time server (not shown) via the network connection unit 290, and acquires time information using a protocol such as NTP. May be. By matching the time with the server 30, it becomes possible to improve the searchability and accuracy of the medication history data.
The GPS receiving unit 280 is a GPS signal receiving module that receives radio waves from satellites of satellite positioning systems such as GPS (Global Positioning System) and quasi-zenith satellite systems. The GPS receiving unit 280 includes a DSP, an RF modulator, an antenna, and the like. The position of the terminal 20 on the map can be specified by the GPS signal acquired by the GPS receiving unit 280 and the signals of the acceleration sensor unit 270 and the atmospheric pressure sensor unit 275. In addition, since the GPS receiving unit 280 also receives a signal from a GPS repeater or the like, the position of the terminal 20 can be specified even indoors.
The network connection unit 290 is a network connection unit that performs digital wireless communication in order to connect to the network 25. The network connection unit 290 includes an antenna, RF (wireless communication) means, digital modulation means, A / D conversion means, D / A conversion means, packet encoding means, encryption means, and the like. The network connection unit 290 may include wired network connection means. In addition, the network connection unit 290 includes a means for connecting to the outside by wireless or the like such as Bluetooth (registered trademark), and may be configured to be connectable to an external device such as a vibrator. Thereby, it becomes possible to notify an erroneous medication to a visually impaired person or a hearing impaired person with an external device or an external buzzer. Note that the network connection unit 290 may be configured to perform analog wireless communication.
In addition to this, the terminal 20 measures an optical sensor, an infrared sensor, an ultrasonic sensor, a biometric authentication sensor, a magnetic sensor, an odor sensor, a humidity sensor, a sweat sensor, a urine sensor, an infrared sensor, a pulse and a blood glucose level. A biological sensor or the like may also be provided. In addition, there are temperature sensors for measuring the body temperature and room temperature of patients, breath sensors for patients with respiratory diseases such as asthma, alcohol sensors that detect alcohol that is incompatible with drugs, etc. You may have. Signals from these other sensors can also be used for estimation of living conditions and determination of wrong medication.
Further, the terminal 20 may include a card reader for connecting an external recording medium, means for connecting to an external device by USB, and the like.

Here, the application 300 in the storage unit 210 includes a dose confirmation program 211, imaging data 212, image feature amount data 213, region data 214, difference image data 215, monochrome image data 216, usage confirmation program 217, and medication condition data 218. I have.
The dose confirmation program 211 is a program for recognizing the presence or absence of a drug or the like by image processing. The dose confirmation program 211 images the inside of the storage case 1 by the imaging unit 260 and operates to detect articles such as tablets and injection needles stored in the storage spaces 41 to 43. A detection algorithm based on the background subtraction method is used for detection of articles in the dose confirmation program 211.
The imaging data 212 is image data inside the storage case 1 captured by the imaging unit 260.
The image feature amount data 213 is data extracted as image feature amounts from the background image data or the confirmation image data of the imaging data 212 by distortion removal, color space conversion, white balance correction, and the like. The image feature amount data 213 includes background image data in which no articles are contained in the storage spaces 41 to 43 of the storage case 1 acquired in the image initial setting process, and a confirmation image captured during the dose confirmation process. Data. In addition, in the case where a plurality of medicines are stored in any of the storage spaces 41 to 43 and are taken little by little with time, the image feature data 213 after each ingestion remains. It may be included as background image data in the presence state. Further, the image feature data 213 may store a state in which used articles are stored again in the storage spaces 41 to 43 in order to recognize completion of use of the articles. Thereby, in the case of a medicine etc., it becomes possible to recognize completion of medication by returning the wrapping paper into the storage spaces 41 to 43.
The area data 214 is data indicating the areas of the mirrors 61 to 63 detected from the image feature amount data 213.
The difference image data 215 is data of a difference image between the confirmation image data of the image feature amount data 213 and the background image data.
The black and white image data 216 is black and white (binary) image data obtained by converting the difference image data 215 with a predetermined threshold.
The usage confirmation program 217 is a program or the like for monitoring acquisition of an article using a GUI (Graphical User Interface) and a service (daemon) that is always executed. The usage confirmation program 217 calculates the location information of the terminal 20 from the signal from the GPS receiver 280, etc., and estimates the living state from entering and exiting the facility (building) by comparing with the facility location existing on the Internet, From this life state, it is determined whether to detect the presence of an article, and an operation is performed to detect erroneous acquisition. The usage confirmation program 217, as this misacquisition, for example, if mistaking medicine such as forgetting to take or repeated ingestion is detected, alerts the patient via the display unit 240 etc. And / or mail etc. are transmitted with respect to a medication person, and generation | occurrence | production of mistaking medicine is alert | reported. Further, the usage confirmation program 217 can also notify the user using a video call or the like when the danger is high. In addition, the usage confirmation program 217 can also estimate the life pattern of the drug taker from the time information of the timer unit 276 and the time information of the day of the week. By recognizing these patterns, the accuracy of life state estimation is improved. In addition, the usage confirmation program 217 can further improve the accuracy of life state estimation by using information from the acceleration sensor unit 270 and other sensors.
The medication condition data 218 is data in which an article acquisition condition, an erroneous acquisition determination condition, and the like are set. The medication condition data 218 includes, for example, drug usage and dosage data as the condition for acquiring the article. In addition, the medication condition data 218 includes risk information about whether the risk is high or low for each mistake medication condition such as forgetting to drink or repeated drinking in the usage and dose data of the medicine. This makes it possible to change the process depending on whether the risk is high or low when an accidental medication occurs. Moreover, the medication condition data 218 includes data on detection conditions for occurrence of erroneous medications as judgment conditions for erroneous acquisition. The medication condition data 218 is set by the user or downloaded from the server 30 and acquired. The medication condition data 218 also includes information such as coordinates of the user's home, meals and bedtime when staying at home.
The facility search setting data 219 is data such as a threshold value for searching the entrance and exit of the facility using the position information and the location information of the facility acquired from the server 30.

{Article management processing by article management system X}
Next, the article management process by the article management system X will be described with reference to FIGS.
In the present embodiment, an example of an article management process when the article management system X is used as a portable medication management support system will be described. That is, in this embodiment, the storage case 1 is used as a medicine case with curved mirrors 61 to 63, and the article to be managed uses medicine or the like.
In the article management process of the present embodiment, the article management system X images the inside of the storage case 1 by initial setting, confirms that the article has been stored, and then, based on the location information acquired by the terminal 20, Estimate living conditions. On this basis, the article management system X determines the presence / absence of an article stored in the storage case 1 by image recognition, determines whether the article extraction condition is met, and gives a warning if necessary.
Hereinafter, the article management process according to the embodiment of the present invention will be described in detail for each step with reference to the flowchart of FIG. The following processing is executed by the control unit 200 using hardware resources in cooperation with each unit.

(Step S201)
First, the control unit 200 performs an image initial setting process using the dose confirmation program 211.
In this process, the imaging unit 260 of the terminal 20 first performs lens distortion removal in a state where the article is not inside the storage spaces 41 to 43 in order to detect the article based on the background difference method. Thus, the background image data of the image feature amount data 213 with the corrected brightness and white balance is acquired.
At this time, if the imaging unit 260 of the terminal 20 does not have a close-up mode, the imaging data 212 obtained by imaging the storage case 1 will be blurred. Therefore, the control unit 200 acquires and stores background image data after performing image processing.
This process may be performed when the application 300 is installed or when the storage case 1 is attached, or may be performed according to an instruction from an administrator or a drug taker.
Details of the image initial setting process will be described later.

(Step S202)
Next, the control unit 200 performs a medication condition setting process using the usage confirmation program 217.
Here, the control unit 200 sets the medication condition data 218 according to the input from the input unit 230 of the administrator or the drug taker.
The control unit 200 may download the medication condition data 218 corresponding to an article such as a medicine prescribed from the server 30 via the network 25. At this time, the control unit 200 may acquire appropriate medication condition data 218 by imaging the article itself with the imaging unit 260 and recognizing characters, barcodes, and the like. Alternatively, the medication condition data 218 may be set directly by accessing the terminal 20 from the medication condition setting means of the server 30 or the management terminal 35.

The setting of the medication condition data 218 will be described in detail with reference to FIG.
FIG. 4A shows an example of setting the usage and dose of the medication condition data 218. When used as a medication management support system, the article management system X of the present embodiment assists a drug taker in taking medicines by properly adhering to the dosage and administration, preventing missed medications, and maintaining good medication status. To do. For this reason, the medication condition data 218 includes setting of usage and dose for each medicine and the like stored in the storage spaces 41 to 43 (FIG. 2).
As for the usage of the medication condition data 218, the control unit 200 mainly deals with lifestyles such as meals, sleep, etc. before meals, after meals, during meals, between meals such as 2-3 hours after meals, after waking up, before going to bed, etc. Estimate the condition and set the timing of medication. This is because the intake of drugs and the like is strongly related to the living state. In other words, drugs that regulate blood sugar levels, such as insulin, have no effect unless taken before meals, and conversely, drugs that burden the stomach, such as headache drugs, should be taken after meals. is there. In addition, as a usage, it is possible to directly specify the time for taking medicine or the like. Thereby, the control part 200 can manage the medicine etc. with which the taking time is designated. Moreover, since it is better not to take a single dose of medication that is taken only when symptoms are seen after taking it once, the control unit 200 can also set such usage. is there. Furthermore, it is possible to specify the usage of a medicine to be taken before exercise or a medicine that should not be taken before exercise.
Moreover, the control part 200 sets about the kind and quantity of the medicine etc. which were stored in the said storage space 41-43 as a dose of the medication condition data 218. In addition to this, the control unit 200 adds to the medication condition data 218 the medication timing, the type of medication, the amount of the medication, etc. with a high risk of weakening the main action of the medication or causing side effects when taking the wrong medication. Also set for.
In addition, when the some medicine is stored in the same storage space 41-43 about the usage and the dose, the control unit 200 can set each, and sets the priority usage and dose. You can also.

FIG. 4B shows an example of setting for the occurrence detection condition (production rule) of the erroneous medication. For example, in the case of a medicine to be taken “before meal”, the control unit 200 sets the medication condition data 218 so as to determine “normal” if the medicine or the like is acquired in the life state before the meal. . However, the control unit 200 sets the medication condition data 218 so that, for example, if the medicine is acquired in the “other” life state, it is determined as “abnormal (ingestion repeated)”. Here, the “other” life state indicates a life state that is not related to meals or sleep. In addition, for example, the control unit 200 sets the medication condition data 218 so that it is determined as “abnormal (forget to take)” if no medicine is acquired even when the meal is in progress.
In addition to these, the control unit 200 sets the medication condition data 218 so as to detect an error in taking a medicine for lunch at the time of breakfast as an abnormality. At this time, the control unit 200 similarly sets the detection condition for the occurrence of an erroneous medication and the medication condition data 218 for “after meal”, “during meal”, “between meals”, “after waking up”, “before going to bed”, and the like. Can be set.
The control unit 200 of the terminal 20 can detect an erroneous medication by referring to the setting of the detection condition for occurrence of an erroneous medication in the medication condition data 218 based on the estimated life state.
In addition, the control part 200 can also set separately the generation | occurrence | production detection conditions of the incorrect medication of the medication condition data 218 for every storage space 41-43.
In addition, the setting of the usage and dosage of the medication condition data 218 and the setting of the detection condition of occurrence of an erroneous medication can be confirmed by the medication person on the display unit 240 at the time of medication or warning notification. is there.
In addition, in the medication condition data 218, it is possible to set a schedule such as whether the subject is going out or at home, and when he / she is at home, meals and bedtime.

(Step S203)
Next, the controller 200 uses the usage confirmation program 217 to perform location information acquisition processing.
The location information acquisition process will be described with reference to FIG.
First, the control unit 200 calculates position information of the current location of the terminal 20. When calculating the position information, the control unit 200 calculates accurate position information using signals from the acceleration sensor unit 270 and the atmospheric pressure sensor unit 275, router information acquired from the network connection unit 290, and the like. Therefore, for example, when the application 300 is created as a native application for an iOS device such as iPhone (registered trademark), the CoreLocation framework provided by Apple Inc. can be used.
Moreover, the control part 200 can suppress the power consumption of a battery by calculating the positional information on the present location for every about several tens of seconds to several minutes, for example. At this time, it is preferable that the control unit 200 continuously calculates the position information even when the terminal 20 is in a power saving state such as sleep.
As shown in a screen example 700 of FIG. 5A, the control unit 200 is preferably configured not only to acquire numerical data but also to confirm the current location 810 on a map.
Further, the screen example 700 displays slide bars 820 and 830 for adjusting a distance threshold for searching for facilities from location information. The slide bar 820 sets a threshold of the distance from the current location for searching for a restaurant. In addition, the slide bar 830 sets a threshold value of the distance from the current location where the hotel is searched. The control unit 200 stores these settings as facility search setting data 219. As will be described later, the control unit 200 determines entry, stay, and exit from the facility based on the distance threshold set by the slide bars 820 and 830, calculates the living state, and changes the living state to the medication condition. Judge whether or not.

Next, the control unit 200 uses the calculated location information of the current location to acquire location information of eating and drinking facilities and accommodation facilities within a predetermined distance set in the facility search setting data 219. For this purpose, the control unit 200 transmits the calculated position information to the server 30 via the network connection unit 290, and acquires location information, such as information on the positions of eating and drinking facilities and accommodation facilities, from the server 30. When the application 300 is developed as a native application as described above, position information can be acquired using the Google Places API or the like. In addition to the current location, this API can specify the radius for acquiring location information and the type of facility. Therefore, in the application 300, the acquired radius is set to 1000 m, for example, “cafe” or “restaurant” in the case of a restaurant, and “loading” in the case of an accommodation facility. Facilities) ”and“ campground ”. The control unit 200 receives the acquired information in the JSON format or the like, collects location and facility name information using the SBJson framework, and uses it as location information.
At this time, the control unit 200 calculates the distance from the current location from the location information of each eating and drinking facility or accommodation facility. The control unit 200 may calculate the distance between the current location and each facility based on a Hubeny formula that calculates the distance from the latitude and longitude of two points. The Hybeni formula is a calculation method that takes the roundness of the earth into account, and has two fixed parameters. In this example, in the application 300, it is preferable that each value of the fixed parameter is based on the geodetic system WGS84 used in Google Maps, the major radius a is 6378137 m, and the square of the eccentricity e is 0.00669337999019758. It is.
The storage unit 210 may be configured to store map data and facility location information. In this case, since it is not necessary to acquire location information from the server 30, location information can be acquired without being connected to the network 25. In addition, the network bandwidth can be used effectively, and battery power consumption can be suppressed.
FIG. 5B shows a screen example 710 when the control unit 200 displays the acquired location information on the display unit 240. The control unit 200 displays a list of eating and drinking facilities, and displays the closest facility name at the top.

Note that the control unit 200 can improve the accuracy of the calculation of the location information of the terminal 20 by using information on the location of the base station and the reach of radio waves acquired by the network connection unit 290.
In addition, the control unit 200 can acquire the location information by using another gourmet site or an accommodation reservation site, for example, a “taste log API”.
Furthermore, the control unit 200 can also estimate the living behavior based on the history of the behavior of the drug taker of the terminal 20. At this time, the control unit 200 can estimate the current living behavior of the drug taker based on the information such as the acceleration and the location acquired from the acceleration sensor unit 270 even in the facility. In addition, the control unit 200 can register location information on facilities, homes, family homes, friend homes, and the like, and can estimate living behavior based on the location information. At this time, the control unit 200 can also automatically register the location information and the like using information such as the telephone directory stored in the storage unit 210 of the terminal 20 and the SNS address of the server 30.

(Step S204)
Next, the control unit 200 uses the usage confirmation program 217 to perform a life state medication condition calculation process. In this process, first, the control unit 200 determines whether the patient is entering or leaving the facility. Based on this, the control unit 200 estimates the living state based on the entry / exit determination. And the control part 200 calculates the medication condition about whether it is a medication time from the estimated life state.

The details of the medication condition calculation process will be described with reference to FIG.
First, the control unit 200 determines entrance / exit to / from the facility using the location information of the current location calculated from the signal acquired by the GPS receiving unit 280 and the like, and the location information of the restaurant and hotel acquired from the server 30.
Specifically, the control unit 200 recognizes the start or end of the meal or sleep by using the current location information of the drug taker and the location information of the eating or drinking facility or the accommodation facility. At this time, the control unit 200 determines that the patient has entered the facility if he / she stays for a predetermined time or more at a distance within the threshold specified from the facility acquired by the location information. On the contrary, after entering, the control unit 200 determines that the vehicle has left when the distance within the threshold is not searched for a predetermined time or longer, that is, when the distance is longer than the predetermined distance.

FIG. 6A shows an example where the facility search setting data 219 specifies a restaurant search threshold of 20 m.
For example, if “facility A” searched for in the location information as a facility within the specified range is a restaurant, the control unit 200 determines that “entry” is detected three times (three minutes), and thereafter Judge as “stay”.
In addition, the control unit 200 determines “exit” when the facility A is not searched and three times (three minutes) have elapsed.

Next, the control unit 200 recognizes the start or end of the meal or sleep of the drug taker according to the determination of entering, staying, or leaving the facility from the location information, and determines the living state corresponding to the meal or sleep. presume.
According to FIG. 6 (b), the control unit 200 determines 30 minutes from the entrance to the eating and drinking facility as a “before meal” living state, and then estimates the “during meal” living state. On this basis, the control unit 200 estimates that the life state is “after eating” after the determination of leaving. In the example of FIG. 6B, in the case of an eating and drinking facility, the control unit 200 makes a transition to the “other” living state 30 minutes after “after meal”. For example, in the case of an accommodation facility such as a hotel, the control unit 200 estimates that 60 minutes after entering the “pre-sleep”, “sleeping” after 60 minutes, and 60 minutes after leaving the “post-sleep” life state. To do.
The control unit 200 may change the living state when a predetermined condition such as signal values of various sensors changes in the facility. For example, after entering the accommodation facility, when it is detected by the optical sensor that the surroundings have become dark, the living state after sleep may be estimated. When it is detected by the optical sensor after entering the eating and drinking facility that the surroundings are dark, it may be estimated that the living state is such as eating or drinking at a tavern or the like.
Further, the predetermined time for determination can be changed as appropriate depending on the setting by the user, whether the user is walking or on the moving means, information on the acceleration sensor unit 270, and the like.
Furthermore, the control unit 200 sets a time period during which the patient normally takes a meal or sleep in the medication condition data 218, and refers to the timer unit 276 to determine a predetermined number of minutes to several hours from this setting. When time passes, you may comprise so that a life state may be changed irrespective of going in and out of a facility. That is, the control unit 200 can also estimate the living state based on the life pattern of the user. The control unit 200 may be configured to change the living state even when it is clear that the user is at home from the location information of the current location of the drug taker, when the predetermined time has passed. At this time, it may be detected by the network transmission / reception unit 290 or the like that a person in charge of a predetermined catering service, a caregiver or the like has arrived, and the living state may be changed. Further, the control unit 200 obtains the schedule of the patient from calendar software (not shown), detects whether the person in charge of the catering service, the caregiver, etc. is coming to the home, etc. It may be changed.
Moreover, the control part 200 estimates also about a lifestyle condition other than a medication person's meal and sleep. For example, the control unit 200 obtains time information from the timer unit 276, and if a medicine or the like has already been taken with respect to the incompetent drug, information such as whether or not the time until the medicine can be taken has passed, Estimate by including in the living state. In addition, the control unit 200 estimates a living state such as whether the drug taker is before exercise or is exercising from information such as acceleration of the acceleration sensor unit 270 and whether or not the user has entered or exited a facility such as a gym. It is also possible.
Moreover, the control part 200 has a high blood sugar level and a high urine sugar level, there is a possibility of heat stroke from temperature and humidity, it is excessively tense, the body temperature of the doser is high, and a cold is caught. It is also possible to estimate living conditions such as being exhaled, having asthma signs, and taking medication by alcohol.

Next, the control unit 200 calculates the medication condition by estimating the living state.
The control unit 200 searches the medication condition data 218 from the estimated life state. Here, the control unit 200 calculates whether or not any medicine or the like in the storage spaces 41 to 43 corresponds to the dosage time of the usage as “medication condition”. At this time, for example, when the drug taker stays in a restaurant, the control unit 200 can determine that the possibility of eating is high, and can narrow down only to the drug taking conditions related to the meal.

Note that the control unit 200 can also directly estimate the living state by machine learning using only the current time and current location information.
In addition, when the terminal 20 is a smartphone, the control unit 200 can determine entry and exit and estimate a living state using various sensors other than the GPS reception unit 280. In addition, after recognizing entry and exit, the control unit 200 can collect data from other sensors and accurately estimate the start and end of meals and sleep by machine learning. For example, the control unit 200 can determine that the terminal 20 is placed and the drug taker goes to bed when the acceleration detected by the acceleration sensor is equal to or less than a predetermined value when staying at the accommodation facility.
In addition, the control unit 200 changes the medication condition so as to cancel the medication condition, for example, when the body temperature is high, there is a sign of an asthma attack, or alcohol is consumed, based on information from other sensors. It is also possible to make it.

(Step S205)
Next, the control unit 200 uses the usage confirmation program 217 to determine whether there is a medicine or the like under the medication condition. The control unit 200 determines Yes when there is a medication condition, that is, a medication that requires confirmation of medication in the storage spaces 41 to 43. In other cases, the control unit 200 determines No.
In Yes, the control part 200 advances a process to step S206.
In No, the control part 200 returns a process to step S203 and continues acquisition of location information.

(Step S206)
When there is a medicine or the like whose estimated living state is a medication condition, the control unit 200 performs a dose confirmation process using the dose confirmation program 211.
The control unit 200 images the storage case 1 with the imaging unit 260 of the terminal 20 and recognizes the presence or absence of an article such as a medicine in the storage spaces 41 to 43.
As described above, abundant information for recognizing the presence or absence of a medicine or the like by imaging with the imaging unit 260 can be collected in an instant. Further, by recognizing the acquisition of the medicine from the storage case 1, it is not necessary to measure the active ingredient in the blood of the medicine or to measure that the medicine has reached the stomach, and the cost can be reduced.
Details of the dose confirmation processing will also be described later.
The control unit 200 can be configured to recognize not only the presence / absence of a drug or the like but also the type or amount of an article including the amount of the drug and the type of the drug. Moreover, the control part 200 may distinguish the packaged medicine etc. and only the package in the case of a packaged medicine.

(Step S207)
Next, the control unit 200 performs a medication confirmation process using the usage confirmation program 217.
The control unit 200 confirms whether or not all stored medicines have been acquired at an appropriate time based on the presence or absence of medicines in the storage spaces 41 to 43 recognized by the above dose confirmation processing. In other words, the control unit 200 refers to the medication condition data 218 and determines the medication state based on the presence or absence of the storage spaces 41 to 43 medicine corresponding to the estimated life state. In addition, you may judge a medication state not only by the presence or absence of a medicine etc. but by the amount.
The control unit 200 can determine whether the medicine is normal or abnormal (forgetting to take or forgetting to take it) by checking the presence or absence of the medicine when the appropriate medication time comes. Moreover, the control part 200 can judge that it is abnormal (it is repeated intake, it takes too much), when the medicine has run out before the time for taking medicine. The control unit 200 determines that the drug is normally taken when it is normal, and determines that it is a mistaken drug when it is forgotten to take or the intake is abnormal. Here, when the medicine or the like is taken from the storage spaces 41 to 43 different from the storage spaces 41 to 43 that should be taken by the drug taker, it is a mistake, and the control unit 200 performs both forgetting to take and repeated ingestion. Abnormalities can also be judged as mistaken drugs.
Thereby, as will be described below, the control unit 200 takes the medicine at an appropriate timing, for example, when there is a medicine that should be taken before meals, and when there is a medicine that should be taken after meals. It becomes possible to be careful about forgetting and repeated intake.
The control unit 200 can store the determination of normal medication or wrong medication in the storage unit 210 as medication history data, or can transmit it to the server 30. The server 30 can store the medication history data in storage means such as a database.
It is also possible to recognize the open / close state of the lid 51 (FIG. 15) and notify the user. That is, it may be noted immediately after the opening / closing of the lid 51 is detected, the dose confirmation process is performed to determine the wrong medication. At this time, it is possible to detect that one of the lids 51 is opened or closed by detecting a shock when the lid 51 is opened or closed by the acceleration sensor unit 270. Further, when the lid 51 is opened and closed, a clicking sound of the magnet 52 (FIG. 15) can be input by the voice input unit 220 and recognized from a predetermined frequency pattern. Thus, the battery consumption can be suppressed by detecting the opening / closing of the lid 51 by the acceleration sensor unit 270 or the voice input unit 220. Further, when the terminal 20 is provided with a magnetic sensor or the like for a flip cover or the like, this can be used. It is also possible to detect opening and closing of the lid 51 from the moving image captured by the imaging unit 260. In this case, since power consumption increases when the imaging unit 260 always captures images, it is preferable to increase the imaging interval and reduce the resolution.
A configuration in which the lid 51 is additionally provided with an open / close sensor is also possible.

(Step S208)
Next, the control unit 200 uses the usage confirmation program 217 to determine whether or not to notify medication. The control unit 200 determines Yes when the determined medication state is abnormal, that is, when there is forgetting to take or repeated ingestion and the medication is in the wrong medication state. The control unit 200 determines No otherwise.
In Yes, control part 200 advances processing to Step S209.
In No, the control part 200 returns a process to step S203 and continues acquisition of location information.

(Step S209)
When the medication notification is to be made, the control unit 200 uses the usage confirmation program 217 to determine whether or not the medication has a high risk.
The control unit 200 refers to the medication condition data 218 and determines “Yes” when there is a high risk of the user's life or health in the mistaking medication state in the medication time, the kind of medication, the amount of the medication, etc. To do. The control unit 200 determines No otherwise, that is, when the risk of life or health is low. For example, in the example of FIG. 4 (a), even if the cold medicine A in the storage space 41 is forgotten to be taken after meals, it is determined as “No” because there is little risk to the drug taker in life. On the other hand, if the intake of the insulin in the storage space 42 is repeated, the control unit 200 determines “Yes” because the drug taker falls into hypoglycemia and there is a risk of life.
In Yes, control part 200 advances processing to Step S211.
In No, the control part 200 advances a process to step S210.

(Step S210)
If the risk of life or health is low even if it is an accidental medication, the control unit 200 uses the usage confirmation program 217 to perform a low-risk medication notification process.
Referring to FIG. 7A, the control unit 200 displays a banner message such as “Did you forget to drink?” On the display unit 240 as in the banner 840 of the screen example 720 to notify the wrong medication. To do. In addition, the control unit 200 can notify the same message from the audio output unit 250 by sounding a sound or a buzzer. The control unit 200 can also notify the feedback unit 255 by shaking it. These notifications are preferably performed even when the terminal 20 is in a power saving state such as sleep.
Furthermore, the control unit 200 may send a signal for controlling the external device from the network connection unit 290 to notify the external device of detection of an erroneous medication. When the external device is a vibrator or a buzzer, the control unit 200 instructs to generate a vibration or a buzzer.
Thereafter, the control unit 200 ends the process.

(Step S211)
When there is a high risk of life or health due to wrong medication, the control unit 200 uses the usage confirmation program 217 to perform high risk medication medication notification processing.
Referring to FIG. 7B, first, the control unit 200 displays a dialog such as “Did you forget to drink?” On the display unit 240 as in the dialog 850 in the screen example 730.
Here, when a button such as “application activation” is pressed, the control unit 200 can call up the GUI and check the actual usage and dose of the medicine in the mistaking state. In addition, the control unit 200 can perform notification by using the audio output unit 250 and the feedback unit 255.
In addition, the control unit 200 transmits an email indicating that an erroneous medication has been detected from the network connection unit 290 to the management terminal 35 of the administrator via the network 25.
Moreover, the control part 200 can alert | report a danger by transmitting mail also to the person who takes the medicine. Since the person who is taking the drug is usually accustomed to using the terminal 20 by checking the reception of the e-mail, warning of the e-mail can be ensured and the notification of the incorrect medicine can be ensured and the usability of the person taking the medicine can be improved.
The control unit 200 may access a server such as various messengers or chat of the server 30 to notify the management terminal 35 of detection of an erroneous medication.
This process is also preferably performed even when the terminal 20 is in a power saving state such as sleep, as in the low risk medication notification process described above. Moreover, the control part 200 may alert | report the detection of an incorrect medication by an external apparatus. At this time, the control unit 200 can instruct the generation of a greater vibration or buzzer sound than the low risk medication notification process.

(Step S212)
Next, the control unit 200 uses the usage confirmation program 217 to perform video call processing.
The control unit 200 uses the other camera such as the front camera of the imaging unit 260 with the management terminal 35 of the administrator, the server 30 or the other terminal 20 via the network 25, and the video. Make a phone call and give medication instructions. Moreover, the state of the storage case 1 can be imaged by the imaging unit 260, the state of the storage spaces 41 to 43 can be checked again, and appropriate guidance can be performed. In addition, the administrator can arrange for ambulance crews and instruct appropriate treatment depending on the condition of the patient. At this time, since the location of the drug taker is known from the position information of the current location calculated from the signal from the GPS receiver 280 of the terminal 20, the emergency team can be dispatched without hesitation. The control unit 200 can also instruct the drug taker of the terminal 20 in real time via the server 30 using various messengers, chats, and the like.
Thereby, it becomes possible to avoid that a drug taker falls into a life or health risk state due to a wrong drug.
Thus, the article management process according to the embodiment of the present invention is completed.

{Details of image initialization process}
Next, the details of the image initial setting process will be described with reference to FIGS.
Hereinafter, the image initial setting process of the present invention will be described in detail for each step with reference to the flowchart of FIG.

(Step S301)
First, the control unit 200 performs a region extraction process.
The control unit 200 displays a message such as “Empty the storage space and close the lid” on the display unit 240, and after the confirmation, the imaging unit 260 images the inside of the storage case 1. At this time, the control unit 200 illuminates the storage case 1 with the light source unit 265.
The control unit 200 cuts out a predetermined range area including the curved mirrors 61 to 63 (FIG. 2) from the captured image, and stores it in the storage unit 210 as the imaging data 212.
The imaging data 212 is expressed in RGB (Red, Green, Blue) color space in terms of color expression.

(Step S302)
Next, the control unit 200 performs distortion removal processing.
The control unit 200 removes lens distortion from the imaging data 212 so that the straight line can be recognized as a straight line on the image. The controller 200 removes the distortion by, for example, detecting a curved surface such as a wall surface of the imaging data 212 and deforming it with a lens model.

(Step S303)
Next, the control unit 200 performs color space conversion processing.
Here, although the storage case 1 is basically configured to prevent external light from entering, it is also conceivable that external light such as strong direct sunlight enters the inside.
The control unit 200 converts the color expression method of the imaging data 212 from the RGB color space to the HLS color space in order to reduce the influence of such external light. The HLS color space is a color space represented by hue (Hue, H), saturation (Saturation, S), and luminance (Lightness, L).

(Step S304)
Next, the control unit 200 performs feature amount extraction / recording processing.
In order to correct the white balance, the control unit 200 removes the luminance L information from the imaging data 212 converted into the HLS color space, creates an image having only the hue H and saturation S information, and the storage unit 210. Are stored as background image data of the image feature data 213.
That is, each pixel of the background image data of the image feature amount data 213 has information on the hue H and the saturation S.

(Step S305)
Next, the control unit 200 performs straight line detection processing.
Referring to FIG. 9, the control unit 200 detects a straight line group 900 representing the ends of the curved mirrors 61 to 63 on the image feature data 213.
According to FIG. 9A, the control unit 200 detects an edge from the image feature amount data 213 in the vertical direction or the horizontal direction by, for example, differentiation processing, and uses an algorithm such as Hough transform (Hough transform). , A portion where the edges are arranged on a straight line is detected as a straight line group 900 representing the ends of the curved mirrors 61 to 63. At this time, the control unit 200 detects a large number of straight lines as the straight line group 900, and then performs a thinning process to leave only representative straight lines, thereby reducing misrecognition.

(Step S306)
Next, the control unit 200 performs area recognition recording processing.
Referring to FIG. 9B, the control unit 200 recognizes regions representing the curved mirrors 61 to 63 on the image feature data 213 based on the straight line group 900, and stores these regions in the storage unit 210 as region data. Store as 214. Thereby, the control unit 200 can recognize the areas corresponding to the curved mirrors 61 to 63 from the image feature data 213, respectively.
In addition, each wall of the storage spaces 41 to 43 is configured to have a uniform color such as white, so that the above-described straight line detection and area recognition can be facilitated, and is also suitable for image recognition during dose confirmation processing described later. . In addition to this, the walls corresponding to the curved mirrors 61 to 63 can be more easily recognized by configuring the walls of the storage spaces 41 to 43 with predetermined colors and patterns. Further, at the time of area recognition, it is possible to facilitate area recognition by filling the storage spaces 41 to 43 with articles of a specific color or pattern.
Thus, the image initial setting process according to the embodiment of the present invention is completed.

{Details of dose confirmation process}
Next, details of the dose confirmation processing will be described with reference to FIGS.
Below, with reference to the flowchart of FIG. 10, the dose confirmation process of this invention is demonstrated in detail for every step.

(Steps S401 to S404)
First, the control part 200 acquires the imaging data 212 in the imaging part 260 at the time of dose confirmation.
In the control unit 200, step S401 is a region extraction process in step S301 (FIG. 8), step S402 is a distortion removal process in step S302, step S403 is a color space conversion process in step S303, and step S404 is a feature of step S304. The same processing as the amount extraction processing is performed.
Then, the control unit 200 stores an image having only the hue H and saturation S information created by the feature amount extraction processing in the storage unit 210 as confirmation image data for the image feature amount data 213.

(Step S405)
Next, the control unit 200 performs background difference calculation processing.
Referring to FIG. 11, the control unit 200 calculates a difference value of the hue H for the background image data and the confirmation image data of the image feature amount data 213 in order to calculate a difference from the background image. The control unit 200 also calculates a difference value of the saturation S for the background image data and the confirmation image data of the image feature amount data 213. Further, the control unit 200 performs, for example, predetermined weighting on the difference value of the hue H and the difference value of the saturation S, creates a grayscale image based on these difference values, and stores the difference image data in the storage unit 210. Store as 215.
FIG. 11A shows an example of this difference image data 215.
In addition, when taking the medicine etc. in the storage spaces 41 to 43 little by little, the control unit 200 can also calculate a difference value between the remaining background image data and the confirmation image data. At this time, the control unit 200 may store the confirmation image data after ingestion in the storage unit 210 as background image data in a state in which the image feature amount data 213 remains.
In addition, the control unit 200 may calculate the feature amount of the difference image data 215. For example, the control unit 200 can calculate the number and position of the center of gravity in the difference image data 215, the number of straight lines and circles, a change in the hue histogram of the difference image data 215, and the like as the feature amount.

(Step S406)
Next, the control unit 200 performs a smoothing process.
In order to emphasize the difference in the horizontal direction of the obtained difference image data 215, the control unit 200 performs smoothing in the vertical direction while storing the edges. That is, by making the difference in the horizontal direction easier than the difference in the vertical direction, it is possible to detect the horizontal direction with high resolution.

(Step S407)
Next, the control unit 200 performs a monochrome image creation process.
Referring further to FIG. 11, the control unit 200 converts the smoothed difference image data 215 to black and white (2) based on a predetermined threshold value in order to determine whether or not there is a medicine or the like in the storage spaces 41 to 43. And black and white image data 216 is created and stored in the storage unit 210.
FIG. 11B shows an example of this monochrome image data 216.

(Step S408)
Next, the control unit 200 performs a masking process.
The control unit 200 calculates, from the monochrome image data 216, the total number of white pixels, that is, the number of pixels having a difference, for each region corresponding to the curved mirrors 61 to 63 in the region data 214.

(Step S409)
Next, the control unit 200 determines whether or not the number of white pixels in each region corresponding to each of the curved mirrors 61 to 63 is equal to or greater than a threshold value, and determines the presence or absence of an article. That is, the control unit 200 uses the presence / absence of articles in the medicine storage spaces 41 to 43, and the threshold value uses, for example, a value such as a predetermined percentage or more of the pixel area. These threshold values can be calculated based on the value of the number of white pixels due to the noise of the black and white image data 216 described above.
When the number of white pixels in each region is equal to or greater than the threshold, the control unit 200 determines that an article exists in the corresponding storage space 41 to 43, that is, Yes. When it is less than the threshold value, the control unit 200 determines that there is no article in the corresponding storage spaces 41 to 43, that is, No. Note that the control unit 200 may determine the presence of an article from the feature amount of the difference image data 215.
In Yes, the control part 200 advances a process to step S410.
In No, the control part 200 advances a process to step S411.

(Step S410)
In the case of being equal to or greater than the threshold value, the control unit 200 performs a drug presence determination process.
The control unit 200 determines that the article is “present” for the corresponding medicine storage spaces 41 to 43 and stores them in the storage unit 210.

(Step S411)
When it is less than the threshold value, the control unit 200 performs no-drug determination processing.
The control unit 200 determines that the article is “absent” for the corresponding medicine storage spaces 41 to 43 and stores them in the storage unit 210.
Thus, the dose confirmation process according to the embodiment of the present invention is completed.

With the configuration described above, the following effects can be obtained.
Prior art 1 can only recognize the open / close state of a case containing a medicine and notify a remote place, or can automatically pay attention when a preset time for taking a medicine comes. In the same way, there has been a portable medicine case equipped with a timer and an open / close sensor, which are forgotten to take and drink repeatedly on a time basis, and a portable medicine case (for example, made by MedSignals). MedSignals). These dedicated terminals and cases are costly, and there is a problem that it is not always possible to report wrong medications according to the living conditions of the subjects.
The article management system X according to the embodiment of the present invention estimates living behavior related to the start and end of meals and sleep, etc., based on the user's location information, the location information of eating and drinking facilities and accommodation facilities, and the usage status of the mobile terminal. Then, after determining the medication condition based on this living behavior, the presence or absence of a medicine or the like in the storage case 1 is recognized, and an erroneous medication is reported. That is, it is possible to determine an abnormality (forgetting to take) by checking the presence or absence of a medicine when the appropriate medication time comes. In addition, if the medicine has run out before the time for taking medicine, it can be determined that the medicine is abnormal (too much drinking). As a result, it is possible to make notification appropriately in accordance with the timing of medication. For this reason, the accuracy of notification of wrong medication is increased, and the user can easily use it even when going out, and the usability is improved. For this reason, the effect which prevents taking out of medicine is also expectable.
In addition, the article management system X can accurately measure the current location, and can recognize that the patient has entered or exited the facility from the facility search setting data 219. As a result, the drug taker can manage his / her own medication and can live an independent life. In addition, the family of patients taking medicine can watch over from a remote location.
In addition, a small number of managers can watch over a large number of patients and can expect a reduction in medical costs. The medication history can also be used for accurate diagnosis and guidance by a doctor.
In addition, by obtaining the medication history, it can be effectively used as evidence for clinical trials for new drug development.

Moreover, in the medication management system like the prior art 1, it was judged that the medicine was acquired when the lid | cover of the medicine case was opened and closed. However, unless the presence or absence of a medicine in the medicine case is recognized, it has not been possible to reliably recognize whether or not the medicine has been acquired.
On the other hand, the article management system X of the present embodiment recognizes the presence or absence of medicine using various sensors including the imaging unit 260 built in the terminal 20. That is, not only the opening / closing status of the storage case 1 but also the acquisition status of the article can be recognized. Thereby, abundant information for recognizing the presence or absence of a medicine can be acquired immediately when necessary. Moreover, since the captured image is easy to understand by humans, it can be used for remote watching.
In addition, the article management system X estimates not only the time and place, but also the living behavior and performs imaging and notification by the imaging unit 260. Therefore, the article management system X performs practical article management even by using a smartphone or the like for a long time. be able to. For this reason, cost can be reduced. Furthermore, the system cost of article management can be reduced by using a sensor or display of a smartphone. In addition, by using the communication function of the smartphone, it is not necessary to separately subscribe to a communication line, and the monthly communication cost can be reduced.
In addition, since the article management system X of the present embodiment directly recognizes the presence or absence of medicine in the medicine case, it is not necessary to recognize the open / closed state of the lid of the storage case 1. For this reason, it is not necessary to provide a sensor etc. in the storage case 1, and cost can be reduced.
Further, the article management system X of the present embodiment can be used without connecting cables from the storage case 1 to the terminal 20. For this reason, it is possible to reduce the operations required of the user of the drug taker or the administrator, and to reduce the risk of human error.

In the article management system X of the present embodiment, the storage case 1 is removed, or the flap portion 5 (FIG. 16) is slid and the rear camera is used in daily life as will be described later. It is possible to notify an error when taking a medicine.
In addition, regarding the method for confirming the medication time, for example, when Google Places API or the like is used to collect facility location information, there is a possibility that an accurate location is not registered. For this reason, the facility used regularly can be registered in the terminal 20, or another API may be used in combination. In the case of a large-scale facility such as a shopping mall, since there are a large number of stores in the facility, the number of floors, the front of which store, etc. It is possible to calculate from the wireless strength or the like.
Further, the article management system X of the present embodiment is described so as to confirm the presence or absence of articles in the storage spaces 41 to 43 by performing image recognition by the control unit 200 of the terminal 20. However, the configuration may be such that the imaging data 212 is transmitted from the terminal 20 to the server 30 and the above-described image recognition is performed by the image processing unit of the server 30. At this time, the background image data, the confirmation image data, the area data 214, the difference image data 215, and the monochrome image data 216 of the image feature data 213 may be stored in the storage unit of the server 30. With this configuration, the load on the control unit 200 of the terminal 20 can be reduced and battery consumption can be suppressed. Even in such a configuration, it is preferable to perform processing in real time (real time) with little delay including the communication time between the server 30 and the terminal 20.
Further, the article management system X of the present embodiment can also determine the presence / absence of an article based on the background difference of external light when the terminal 20 does not include the light source unit 265. It is also possible to recognize the presence of an article by directly recognizing the shape of the article.
Further, the terminals 20 can communicate directly with each other without using the server 30. This enables communication support such as performing ad-hoc “passing” communication in the town and storing it when an article is exchanged.
In addition, the articles managed by the article management system X of the present embodiment are not limited to medicines and the like, and are used under predetermined conditions such as fragrances, clothing items, fishing gear, small parts, etc. Can be used.

[Description of the design of the storage case 1]
{Configuration of storage case design apparatus 10}
Next, the configuration of the storage case design apparatus 10 (storage case design apparatus, storage case manufacturing apparatus, mirror position shape setting apparatus) according to the embodiment of the present invention will be described with reference to FIGS.
The storage case design apparatus 10 performs an optical simulation to calculate, for example, the number and position of storage spaces of the storage case 1 (FIG. 14) according to the embodiment of the present invention, and the curved mirrors 61 to 63 (first reflection). The position and shape of the mirror) are calculated, a design drawing of each part of the storage case 1 is output, and a 3D printer or the like is controlled.
The storage case design apparatus 10 can be used by installing software (programs) on a computer (server) having a control operation function such as a PC such as a general PC / AT compatible machine or an FC (Factory Computer). It is.
12 to 14, the same reference numerals as those in FIGS. 1 to 11 indicate the same configuration.

  Referring to FIG. 12, the storage case design apparatus 10 includes a control unit 100 (control unit, first reflecting mirror position shape calculation unit), a storage unit 110 (storage unit), an input unit 130 (input unit), and a display unit 140 ( Display means) and an I / O unit 150 (storage case manufacturing apparatus connection means).

The control unit 100 includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), a GPU (Graphic Processing Unit), a dedicated processor, and the like. And means for executing various programs to control each function of the storage case design apparatus 10. The control unit 100 executes the curved mirror position shape calculation program 111 stored in the storage unit 110 and functions as a first reflection mirror position shape calculation unit.
The storage unit 110 is a storage unit such as a RAM, a ROM, a flash memory, and an HDD. The storage unit 110 stores programs and data executed by the control unit 100.
The input unit 130 is input means such as a pointing device such as a keyboard and a mouse, a touch panel, a digitizer, and a touch pad. The input unit 130 can acquire an instruction from a user who is a designer of the storage case design apparatus 10 and can perform initial setting of the model data 112 of the curved mirror to be designed.
The display unit 140 is a display unit including a liquid crystal display, an organic EL display, a plasma display, a projector, and the like. The display unit 140 can display a three-dimensional image drawn by the GPU of the control unit 100 and a two-dimensional image including a moving image.
The I / O unit 150 is an input / output unit including an I / O that transmits and receives control signals to a storage case manufacturing apparatus such as a 3D printer such as an optical molding machine or an NC machine tool. The I / O unit 150 can also be connected to a normal 2D printer to output print data on which the position shape data 113 is drawn, or to output to an external network.

(Configuration of storage unit 110)
The storage unit 110 includes a curved mirror position shape calculation program 111, model data 112, and position shape data 113.
The curved mirror position shape calculation program 111 calculates the arrangement positions and shapes of the curved mirrors 61 to 63 for imaging the inside of the storage spaces 41 to 43 (FIG. 2) by the imaging unit 260 of the terminal 20 by optical simulation. Programs. The curved mirror position shape calculation program 111 can be created using MATLAB (registered trademark) manufactured by MathWorks or the like.
Model data 112 is three-dimensional model data of a medicine case. This three-dimensional model can be created by using software such as SolidWorks (registered trademark) manufactured by Dassault Systems SolidWorks corresponding to the model of the terminal. In addition to this, the model data 112 also includes coordinate data such as the calculated storage spaces 41 to 43 and the range of positions where the curved mirrors 61 to 63 can be arranged.
The position shape data 113 is data including design drawing data created from the model data 112. The position shape data 113 may include data of a three-dimensional model including a triangular surface normal vector and three vertices for a 3D printer or CAD. As data of this three-dimensional model, STL data for SLA CAD of 3D Systems, etc. can be used.
The curved mirror position shape calculation program 111, model data 112, and position shape data 113 according to the embodiment of the present invention are downloaded or uploaded via an external network, or a recording medium such as a flash memory or an optical medium (FIG. (Not shown) may be installed in the storage unit 110 or output and stored.
The storage unit 110 may also store programs such as an OS, 3D modeling software such as the above-mentioned SolidWorks (registered trademark), CAD software, output device control software, and device drivers. These programs can be executed by the control unit 100.

{Storage Case Design Processing by Storage Case Design Device 10}
Next, storage case design processing by the storage case design device 10 will be described with reference to FIGS. 13 to 14. In the storage case design processing according to the embodiment of the present invention, the imaging unit 260 of the terminal 20 stores the storage space 41. The positions of the curved mirrors 61 to 63 and the appropriate curved surface shape are calculated and set by optical system simulation so that the entire image can be imaged in .about.43. By using the storage case 1 having such an arrangement, it is possible to easily determine whether or not an article to be managed such as a medicine is present in the storage spaces 41 to 43 by image processing.
Hereinafter, the storage case design processing according to the embodiment of the present invention will be described in detail for each step with reference to the flowchart of FIG. This processing is executed by the control unit 100 of the storage case design apparatus 10 using the hardware resource while executing the curved mirror position shape calculation program 111 and cooperating with each unit.
In the following, an example of calculating the positions and shapes of the three curved mirrors 61 to 63 corresponding to the three storage spaces 41 to 43 as in the storage case 1 (FIG. 2) according to the embodiment will be described. . However, the present invention is not limited to this, and the position and shape of one to a plurality of curved mirrors can be calculated. That is, it is possible to use model data 112 having two or less or four or more storage spaces.

(Step S1000)
First, the control unit 100 performs storage space calculation processing.
With reference to FIG. 14, the storage space calculation process will be specifically described.
FIG. 14A shows a front view of the base portion 4 of the storage case 1 in which the storage spaces 41 to 43 for the model data 112 and the curved mirrors 61 to 63 are arranged. In FIG. 14A, the horizontal axis represents the X axis, the vertical axis represents the Y axis, and the position of the imaging unit 260 is represented as coordinates (0, 0).
First, the control unit 100 calculates an optimum value for the number of storage spaces based on the setting of the size of the article to be managed stored in the storage unit 110, the condition for acquiring the article, and the like. For example, when the article to be managed is a medicine or the like, the controller 100 uses three storage spaces 41 to 41 when using a total of about six tablets, capsules, injection needles, etc. in the morning, noon, and evening. 43 is used. At this time, the control unit 100 may also refer to the maximum values of the X axis and the Y axis of the model data 112.
In addition, the number of storage spaces can be set directly by obtaining a user instruction from the input unit 130.

Next, the control part 100 calculates each position of the storage spaces 41-43. In this example, the control unit 100 calculates the storage spaces 41 to 43 so as to exist on the right side of the line A, that is, the imaging unit 260 (in the positive direction of the X axis). However, if it is too close to the imaging unit 260, the optical accuracy of the curved mirrors 61 to 63 is required, and the cost increases. For example, when the imaging unit 260 without a close-up function is used, in this embodiment, about 5 to 15 mm. It is preferable to have a margin of.
Further, the control unit 100 arranges the storage spaces 41 to 43 in the Y-axis direction above the line B (the positive direction of the Y-axis) set based on the imageable range 501 of the imaging unit 260. As a result, the entire imageable range 501 of the imaging unit 260 can be directed to the storage spaces 41 to 43 by the curved mirrors 61 to 63. For this reason, it is preferable that the lower end of the Y axis of the storage spaces 41 to 43 has a margin of about 2 to 10 mm from the line B in the present embodiment.
The control unit 100 calculates the positions of the storage spaces 41 to 43 and then stores them in the model data 112.
In the example of FIG. 14A, the control unit 100, for example, in the case of the storage case 1 for iPhone (registered trademark) 4S, as the storage spaces 41 to 43, width 28 × height 27 × depth 12 mm, respectively. The size of was calculated. As described above, the control unit 100 can calculate the positions of the storage spaces 41 to 43 in which a relatively large insulin injection needle can be stored in addition to tablets and capsules.

(Step S1001)
Next, the control unit 100 performs curved mirror position calculation processing.
The control unit 100 calculates the positions (coordinates) of the curved mirrors 61 to 63 in the base unit 4.
The configuration of the curved mirrors 61 to 63 will be described with reference to the plan view of FIG. In the storage case design process of the present embodiment, the curved mirrors 61 to 63 are convex mirror mirrors that express a curved surface with XY axis coordinates by a Bezier curve that is easy to design and process. In the present embodiment, as the curved mirrors 61 to 63, shapes having a Bezier curve start point 601, a control point 602, and an end point 603 are used. In this process, the control unit 100 determines the position in the model data 112 for the start point 601 and the end point 603. A Bezier curve has a feature that a curved surface always falls within a control point. For this reason, first, the imageable angle is divided into three equal parts, the position is set, and then the shape is adjusted.

First, the control unit 100 calculates the ranges C1 to C3 in which the curved mirrors 61 to 63 are disposed corresponding to the storage spaces 41 to 43, and stores them in the model data 112.
The control unit 100 sets ranges C1 to C3 at positions inside the base unit 4 and below the storage spaces 41 to 43 (in the negative direction of the Y axis). That is, for example, by arranging the curved mirror 62 that reflects light inside the central storage space 42 in the range C2, interference with other curved mirrors can be prevented.
The control unit 100 also stores the ranges C1 to C3 in the model data 112.

Referring to FIG. 14 (a) again, next, the control unit 100 proceeds from left to right in the X axis so that the imageable range 501 that is the angle of view of the imaging unit 260 is equally divided into three on an angle basis. The positions of the curved mirrors 61 to 63 are calculated in order from the upper side to the lower side on the Y axis. The control unit 100 searches for the start point 601 and end point 603 of the Bezier curve constituting the curved mirror in the order of the mirrors 61 to 63. The control unit 100 starts searching for the curved mirrors 61 to 63 from the upper left of the arrangement ranges C1 to C3. The control unit 100 increases the position of the start point 601 and the end point 603 on the X axis from left to right, and decreases the value of the Y axis from the top to the bottom at the position on the X axis, and continues the search. At this time, the control unit 100 can adjust the position in steps of about 0.5 mm, for example, and can be sufficiently arranged in processing accuracy.
In addition, the control unit 100 can calculate the size of the curved mirrors 61 to 63, that is, the distance between the start point 601 and the end point 603 so as to increase in accordance with the distance from the imaging unit 260 within a predetermined range. Is preferred. That is, the distance between the start point 601 and the end point 603 is calculated to be longer.

(Step S1002)
Next, the control unit 100 performs an imageable angle calculation process.
Here, the control unit 100 calculates the imageable angles of the curved mirrors 61 to 63 within the imageable range 501.
For example, on the surface of the curved mirrors 61 to 63, the control unit 100 calculates the imageable plane 500 connecting the imageable range 501, the start point 601, the end point 603, and the image pickup unit 260, and The imageable angle between these is calculated.

(Step S1003)
Next, the control unit 100 determines whether or not the imageable angles of the curved mirrors 61 to 63 are equally divided. That is, the control unit 100 determines whether or not the imageable range 501 in FIG. 14A is equally allocated to the curved mirrors 61 to 63.
The control part 100 determines as Yes, when the difference of each imaging possible angle of the curved mirrors 61-63 is below a predetermined threshold value. Moreover, the control part 100 determines with No in other than that.
In Yes, control part 100 advances processing to Step S1004.
In No, the control part 100 returns a process to step S1001. Thereby, the control part 100 continues adjustment of the position of the curved mirrors 61-63.
Note that the control unit 100 may search all positions in the ranges C1 to C3 and calculate the minimum value of the difference between the imageable angles. In addition, the control unit 100 may search for a position where the interval and density of the imageable angles of the curved mirrors 61 to 63 are most uniform.

(Step S1004)
Next, the control unit 100 performs control point adjustment processing.
The control unit 100 calculates an appropriate curved surface shape of the curved mirrors 61 to 63.
Referring to FIG. 14B again, the control unit 100 calculates a Bezier curve control point 602 between the start point 601 and the end point 603, that is, a range, in order to calculate an appropriate curved surface shape of the three curved mirrors. Determine in D. Using a Bezier curve in this way is preferable because an optimal solution can be obtained reliably.
Also here, the control unit 100 can sufficiently cope with the processing accuracy and the like by adjusting the position of the control point 602 in increments of 0.5 mm, for example.
In the present embodiment, the curved mirrors 61 to 63 have been described as convex mirror mirrors having a Bezier curve shape. It is.
It is also possible to insert a lens or the like in front of the curved mirrors 61 to 63, or attach a lens or the like for macro photography to the imaging unit 260. The control unit 100 can also perform an optical simulation in such a case.

(Step S1005)
Next, the control unit 100 performs an imageable area calculation process.
The control unit 100 calculates an imageable area in the storage spaces 41 to 43 by a method such as a light source tracking method.
Referring again to FIG. 14A, the control unit 100 includes storage spaces 41 to 43, curved mirrors 61 to 63, a plane mirror 53, and an imaging unit 260 for each predetermined angle within the imageable range 501. The imageable planes 500 connecting the two are calculated by the light source tracking method or the like.
Specifically, the control unit 100 obtains the intersecting surface of any one of the curved mirrors 61 to 63 from the imaging unit 260, and determines the reflection angle by the angle between the surface normal of the intersecting surface and the imaging unit 260. Then, the intersection plane between the plane reflected from the intersection plane and the storage spaces 41 to 43 is obtained, and a set of these planes is calculated as the imageable plane 500. In the model data 112, an area indicated by the imageable plane 500 is an imageable area of the imaging unit 260.
FIG. 14A shows an example in which the imageable plane 500 is calculated every 0.5 degrees. If the imageable plane 500 exists almost uniformly in the three storage spaces 41 to 43, it can be said that the imaging unit 260 can image the three storage spaces 41 to 43 without any problems. At this time, it is preferable to image an area of about 80% or more in the storage spaces 41 to 43.

(Step S1006)
Next, the control unit 100 determines whether or not all the storage spaces 41 to 43 can be imaged.
Here, the control unit 100 determines whether or not the imaging unit 260 can image each of the storage spaces 41 to 43 to the heel. Specifically, in the control unit 100, the intersecting surfaces of the storage spaces 41 to 43 reflected from both ends of the imageable plane 500 within the imageable range 501 that hit the curved mirrors 61 to 63 are diagrams of the storage spaces 41 to 43. It is determined whether it is within a predetermined range from the lower end of the Y-axis of 14 (a). That is, in the example of the curved mirror 63, the coordinates of the Y axis of the plane intersecting the storage space 43 of the planes indicated by the planes E1 and E2 in the imageable plane 500 are within 5% from the lower end of the storage space 43, for example. Is determined.
The control part 100 determines with Yes, when it exists in the predetermined range from a lower end. In other cases, the control unit 100 determines No.
In Yes, the control part 100 advances a process to step S1007.
In No, the control part 100 returns a process to step S1004. Thereby, adjustment of the control point 602 of each curved mirror 61-63 is continued.

In addition, the control part 100 may calculate the optimal number of the curved mirrors 61-63 separately, when the position and shape of the curved mirrors 61-63 cannot be optimized.
That is, you may comprise so that the inside of each storage space may be imaged with a some curved mirror.
Further, the control unit 100 can set the shapes of the curved mirrors 61 to 63 in advance, and can calculate the position and size of the storage space according to the reflected shootable range. In this case, the shape of the storage space may be changed to a trapezoid or the like.

{Results of optical simulation}
Here, an example in which the positions and shapes of the curved mirrors 61 to 63 are set by the model data 112 of FIG. 14A will be described with reference to FIG.
Here, using the model data 112 corresponding to iPhone (registered trademark) 4S, the angle of view of the range that can be imaged by the camera of the imaging unit 260 is calculated as 39 degrees horizontal. FIG. 14C shows the X-axis and Y-axis coordinates of the Bezier curve start point 601, control point 602, and end point 603 calculated at this time. FIG. 14A shows the imageable plane 500 at the calculated start point 601, control point 602, and end point 603.
As a result, it was confirmed that the imaging unit 260 can capture images of the storage spaces 41 to 43 without any problem.

(Step S1007)
Next, the control unit 100 performs output processing.
The control unit 100 creates position shape data 113 using the model data 112 to which the calculated storage spaces 41 to 43 and the positions and shapes of the curved mirrors 61 to 63 are applied.
For example, the control unit 100 creates STL data from a three-dimensional model created by SolidWorks.
In addition, the control unit 100 outputs the created position shape data 113 to, for example, a 3D printer such as uPrint Plus manufactured by Stratasys, an NC machine tool, or the like, and actually stores the storage case 1 or a mold. May be manufactured.
Thus, the storage case design process according to the embodiment of the present invention is completed.

With the configuration described above, the following effects can be obtained.
Since the storage case design apparatus 10 according to the embodiment of the present invention accurately detects articles stored in the plurality of storage spaces 41 to 43, the optical system in the storage case 1 can be optimized. become.
That is, the storage case design device 10 can calculate the optimal number and position of the storage spaces 41 to 43 of the storage case 1. In addition, the storage case design apparatus 10 calculates the positions and shapes of the curved mirrors 61 to 63 by optical system simulation so that the articles stored in the storage spaces 41 to 43 can be easily detected by imaging with the imaging unit 260. it can. At this time, the storage case design device 10 can capture a plurality of storage spaces 41 to 43 from the imaging range 501 of the imaging unit 260 built in the terminal 20 (FIG. 2) without any problems. The number, position, and shape of ˜63 can be calculated.
In addition, the storage case design apparatus 10 creates position shape data 113 from the model data 112 based on the calculated number of storage spaces 41 to 43, position and number of curved mirrors 61 to 63, position, and shape. In addition, the actual storage case 1 can be manufactured.
Here, when the storage case 1 is used as a medicine case, in order to prevent forgetting to take it out, it is desirable that the size be in a pocket of a pants or the like. The storage case design apparatus 10 can design a compact optical system so that the imaging unit 260 of the terminal 20 can efficiently image the inside of the storage spaces 41 to 43.

[Description of specific configuration of storage case 1]
Next, a specific configuration of the storage case 1 according to the embodiment of the present invention will be described below with reference to FIGS.
A storage case 1 shown in FIGS. 15 and 16 is an article management case attached to the back surface of a terminal 20 (portable terminal) which is a smartphone or the like having a built-in function such as a camera, a GPS sensor, a network transmission / reception, and a display. . FIG. 15B is a perspective view of the back surface of the terminal 20 and is stored in the storage case 1 with the back surface facing the case portion 2 side. On the back surface of the terminal 20, an imaging unit 260 (imaging unit) such as a camera and a light source unit 265 (light source) such as a flash LED (Light Emitting Diode) serving as a light source of the imaging unit 260 are provided.
15 to 19, the same reference numerals as those in FIGS. 1 to 14 indicate the same configuration.

  The storage case 1 is made of, for example, white ABS resin, and includes a case part 2 for storing articles and a cover part 3 fixed to the terminal. The cover part 3 and the case part 2 may be configured to be separable or may be integrally formed. The case part 2 includes a base part 4 and a flap part 5. One end of the base portion 4 and the flap portion 5 is fixed by fitting a claw, and the other end is fixed by a hexagon nut or the like. The base part 4 and the flap part 5 may be fixed by a claw, or may be fixed by an adhesive or the like.

  17A and 17B are diagrams showing the case portion of FIG. 15, where FIG. 17A is a bottom view, FIG. 17B is a side view, and FIG. As shown in FIG. 17, the base portion 4 has three storage spaces 41 to 43. The storage spaces 41 to 43 are spaces for storing articles inside the storage case 1. When the article to be managed is a medicine or the like, drugs such as tablets, capsules, orally disintegrating tablets, or insulin pen type Articles such as syringe needles can be stored. These are stored in each of the storage spaces 41 to 43 separately for breakfast, lunch, and dinner, for example. For example, when the terminal 20 is Apple's iPhone (registered trademark) 4S, it is possible to store about 4 tablets by dividing the terminal 20 into three. In the case of iPhone (registered trademark) 5, a configuration in which four storage spaces are provided is possible.

  In the present embodiment, the case where the storage case 1 has three storage spaces 41 to 43 will be described. However, the storage case 1 may have four or more storage spaces. Further, the number of storage spaces may be one or two.

  As shown in FIGS. 15 and 16, the flap portion 5 is provided with a lid 51 for covering each storage space 41 to 43 for each storage space 41 to 43. The lid 51 includes a magnetic body and is fixed with a hinge tape or the like so that a protruding portion does not occur on the outer surface of the storage case 1. As shown in FIG. It is fixed to prevent accidental opening while carrying. Note that the fixing of the lid 51 is not limited to that by magnetic force, and unexpected opening and closing can be prevented even by fixing with a claw. In this case, it is possible to adopt a configuration in which the claw is released by pressing the button and is opened by the spring force. A flat mirror 53 (second reflection mirror) is attached to the flap portion 5 at a position facing an imaging hole 44 described later. The flat mirror 53 receives the second reflected light from the curved mirrors 61 to 63 (first reflecting mirror) of the curved mirror member 6 described later and reflects the reflected light to the light source unit 265. The plane mirror 53 (second reflection mirror) is installed on the flap portion 5 side so as to be easily movable.

  As shown in FIG. 17, the base unit 4 is provided with an imaging hole 44 for using the imaging unit 260 and the light source unit 265 of the terminal 20. The imaging unit 260 is installed so as to capture the outside of the terminal 20 from the back side of the terminal 20. The light source unit 265 is used as a light source of the camera, and irradiates light from the back surface of the terminal 20 to the outside of the terminal 20.

  In the base portion 4, a mirror installation space 45 is provided along the arrangement direction of the storage spaces 41 to 43 from the imaging hole 44. The mirror installation space 45 extends from the imaging hole 44 along the side wall of the case. The storage spaces 41 to 43 and the mirror installation space 45 are separated by a transparent wall 46. A transparent acrylic plate or the like is used for the transparent wall 46 so that the inside of the storage spaces 41 to 43 can be imaged from the mirror installation space 45 side.

  18A and 18B are diagrams showing the curved mirror member of FIG. 1, wherein FIG. 18A is a front view, FIG. 18B is a plan view, and FIG. 18C is a side view. A curved mirror member 6 shown in FIG. 18 is installed in the mirror installation space 45. The curved mirror member 6 is a member that is installed as shown in FIG. 19 and reflects light between the plane mirror 53 and the storage spaces 41 to 43, and between the plane mirror 53 and the storage spaces 41 to 43. The curved mirrors 61 to 63 (first reflecting mirrors) for reflecting the light are provided for each of the storage spaces 41 to 43. The curved mirrors 61 to 63 are convex mirrors configured by vapor deposition, metal foil, or the like, and are configured so that the imageable range in the imaging unit 260 is uniformly allocated to the three storage spaces 41 to 43.

  In the above-described embodiment, the case where the imaging unit 260 and the light source unit 265 are located at the corners of the terminal 20 has been described. Therefore, as schematically illustrated in FIG. Is provided. However, when the imaging unit 260 and the light source unit 265 are in the center of the end of the terminal 20, as schematically shown in FIG. 20B, the imaging hole is formed in the center of the end of the base unit 4. 44 may be provided. In this case, a mirror 53A (second reflection mirror) disposed at a position corresponding to the imaging hole 44 in FIG. 20A is provided, and the curved mirrors 61 to 63 (first reflection mirror) of the curved mirror member 6 are provided. The mirror 64 (third reflection mirror) that reflects the reflected light to the mirror 53A is arranged at the corner of the base portion 4, so that the first reflected light from the articles in the storage spaces 41 to 43 is reflected by the first reflecting mirror. The first reflected light can be received by the third reflecting mirror, and the third reflected light can be received by the second reflecting mirror and reflected to the imaging unit 260. As a result, imaging in the storage spaces 41 to 43 can be performed as in the above embodiment. However, in this case, one of the two mirrors 53A and 64 is made flat so that the area in which the storage spaces 41 to 43 occupy the images captured by the imaging unit 260 and the light source unit 265 are not narrowed. It is desirable to adopt a configuration in which the other is concave. Further, a configuration including a light guide plate or prism for guiding light from the light source unit 265, a prism for imaging, or the like is also possible. Furthermore, it is possible to illuminate the inside using a phosphorescent material. Thereby, the influence of regular reflection by a mirror or a transparent plate can be reduced during flash photography.

Further, when the imaging unit 260 and the light source unit 265 are in the central part of the terminal 20, the imaging hole 44 is provided in the central part of the base unit 4 as schematically shown in FIG. be able to. In this case, mirrors 65A and 65B (first reflection mirrors) are arranged at both ends of the mirror installation space 45, and reflected light from the articles in the storage spaces 41 and 43 is reflected by the mirror 65A (first reflection mirror). Reflected light from the articles in the storage spaces 42 and 44 is reflected by the mirror 65B (first reflecting mirror), and reflected light by the mirrors 65A and 65B (first reflecting mirror) is received by the mirror 53B (second reflecting mirror). It can be configured to reflect to the imaging unit 260.
The mirror 53B arranged at a position facing the imaging hole 44 is formed in a plane bent in the center in a V shape, and the plane is directed at both ends of the mirror installation space 45 at an angle of 45 °, for example. Yes. The mirrors 65 </ b> A and 65 </ b> B arranged at both ends of the mirror installation space 45 can be configured by curved surfaces formed by Bezier curves. According to this configuration, it is possible to image the storage spaces 40 to 43 at the four corners of the base unit 4 with the imaging unit 260 and the light source unit 265 at the center of the terminal 20 as in the above embodiment.

The flat mirror 53 may be configured to collect light using, for example, a curved mirror instead of a completely flat mirror. Moreover, you may use a spherical mirror also about the curved surface mirrors 61-63.
Furthermore, for the flat mirror 53 and the curved mirrors 61 to 63, it is also possible to use an optical element such as a prism that performs similar reflection and light guide in order to receive and reflect light. In addition, an optical fiber or the like is introduced from each of the storage spaces 41 to 43 so that the imaging unit 260 can capture images, and the presence / absence of articles in the storage spaces 41 to 43 is determined based on the difference in brightness at the end of the optical fiber It is also possible to detect directly.
In addition, in the terminal 20, when the imaging unit 260 and the light source unit 265 are separated from each other, an optical system that separately illuminates the storage spaces 41 to 43 with a mirror, a light guide plate, an optical fiber, or the like is provided. Is also possible.
Further, by allowing the flap portion 5 or the attachment portion of the flat mirror 53 (second reflection mirror) of the flap portion 5 to slide, the rear camera of the imaging portion 260 can be easily used. Thereby, when using a back camera in daily life, it is not necessary to remove the storage case 1 one by one, and it becomes easy to use.

With the configuration described above, the following effects can be obtained.
The storage case 1 can bend the imageable range of the terminal 20 in an arbitrary direction by using the flat mirror 53 and the curved mirrors 61 to 63, and the imageable range by using the convex mirror surface curved mirrors 61 to 63. Can be extended. The storage case 1 uses several curved mirrors 61 to 63. Thereby, processing can be facilitated, and manufacturing costs, maintenance costs, and the like can be reduced.
In addition, since the storage case 1 does not require a special sensor or terminal for connection to the terminal 20, manufacturing costs and the like can be reduced. Moreover, since it is not necessary to respond | correspond to a sensor and a terminal at the terminal 20 side, a smart phone etc. can be used as the terminal 20, and since it is not necessary to use a dedicated terminal device, cost can be reduced.
In addition, the storage case 1 has become widespread and can be used as an optional product of the terminal 20 such as a mobile phone already possessed by the drug taker, and the imaging unit 260, the control unit 200 (FIG. 2), etc. can be used as a storage case. It is not necessary to prepare for the 1 side, and cost can be reduced.

  Note that the configuration and operation of the above-described embodiment are examples, and it is needless to say that the configuration and operation can be appropriately changed and executed without departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 1 Storage case 2 Case part 3 Cover part 4 Base part 5 Flap part 6 Curved mirror member 10 Storage case design apparatus 20 Terminal 25 Network 30 Server 35 Management terminal 40, 41-43 Storage space 44 Imaging hole 45 Mirror installation space 46 Transparent Wall 51 Lid 52 Magnet 53 Flat mirror 53A, 53B, 64, 65A, 65B Mirror 61-63 Curved mirror 100, 200 Control unit 110, 210 Storage unit 111 Curved mirror position shape calculation program 112 Model data 113 Position shape data 130, 230 Input unit 140, 240 Display unit 150 I / O unit 211 Dose confirmation program 212 Imaging data 213 Image feature data 214 Area data 215 Difference image data 216 Black and white image data 217 Usage confirmation program 218 Medication condition data 219 Facility Search setting data 220 Audio input unit 250 Audio output unit 255 Feedback unit 260 Imaging unit 265 Light source unit 270 Acceleration sensor unit 275 Barometric pressure sensor unit 276 Timer unit 280 GPS receiving unit 290 Network connection unit 300 Application 500 Imageable plane 501 Imageable range 601 Start point 602 Control point 603 End point 700, 710, 720, 730 Screen example 810 Current location 820, 830 Slide bar 840 Banner 850 Dialog 900 Line group C1, C2, C3, D Range E1, E2 Plane X Article management system

Claims (11)

In a storage case attached to a portable terminal having an imaging means,
A storage space for storing articles inside the storage case;
A first reflecting mirror for reflecting first reflected light from the article in the storage space;
A storage case comprising: a second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means. The storage case according to claim 1, wherein the first reflection mirror is formed with a Bezier curve. In a storage case design apparatus for designing a storage case to be attached to a mobile terminal having an imaging means,
The storage case is
A storage space for storing articles inside the storage case;
A first reflecting mirror for reflecting first reflected light from the article in the storage space;
A second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means;
The storage case design device comprises:
A storage case design apparatus comprising: a first reflection mirror position shape calculating means for calculating the position and shape of the first reflection mirror by optical simulation. A plurality of the storage space and the first reflecting mirror are provided,
The first reflecting mirror position shape calculating means includes:
The position and shape of the first reflecting mirror are calculated so that each of the first reflecting mirrors receives the first reflected light from the respective storage space. Storage case design device. The first reflecting mirror position shape calculating means includes:
Calculating the position of each of the first reflecting mirrors so that the difference in imageable angle that can be imaged by the imaging means is equal to or less than a predetermined value;
The storage case design device according to claim 3 or 4, wherein the shape of the first reflection mirror is calculated by a Bezier curve. The first reflecting mirror position shape calculating means includes:
The storage case design apparatus according to claim 5, wherein the control points of the Bezier curves of the respective first reflecting mirrors are adjusted so that images can be uniformly captured without leaving the storage space. In an article management system comprising a portable terminal having an imaging means and having a storage case attached thereto,
The storage case is
A storage space for storing articles inside the storage case;
A first reflecting mirror for reflecting first reflected light from the article in the storage space;
A second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means;
An article management system comprising image recognition means for recognizing the presence / absence of the article in the storage space from image data captured by the imaging means. The portable terminal is
Storage means for storing medication condition data of medication conditions for usage and dosage of the article;
Position information acquisition means for acquiring position information;
Based on the acquired location information, location information acquisition means for acquiring location information of a dining facility or accommodation facility;
Living state estimation means for determining entry / exit to the eating facility or the accommodation facility based on the location information and the location information, and estimating a living state corresponding to meal or sleep based on the determination;
A medication condition calculating means for calculating a medication condition of the article based on the estimated life state and the medication condition data;
The article management system according to claim 7, further comprising: a dose confirmation unit that causes the imaging unit to capture an image based on the calculated medication condition and causes the image recognition unit to confirm the presence or absence of the article. Image feature value data creating means for converting the imaging data into an HLS color space to remove information on luminance L and creating image feature value data of hue H and saturation S;
The background image data, which is the image feature amount data created from the imaging data in a state where the article does not exist in the storage space, and the imaging means when the presence / absence of the article is confirmed by the dose confirmation means Difference image data creating means for creating difference image data from the confirmation image data which is the image feature amount data created from the captured image data;
Area recognition means for recognizing the area of the first reflecting mirror from the background image data,
The image recognition means includes
The article management system according to claim 7 or 8, wherein the image recognition of the article is performed based on an image of the region of the recognized difference image data. In a storage case design method for designing a storage case attached to a mobile terminal having an imaging means,
The storage case is
A storage space for storing articles inside the storage case;
A first reflecting mirror for reflecting first reflected light from the article in the storage space;
A second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means;
A storage case design method, wherein the position and shape of the first reflecting mirror are calculated by optical simulation. In an article management method by a portable terminal having an imaging means and having a storage case attached thereto,
A storage space for storing articles inside the storage case;
A first reflecting mirror for reflecting first reflected light from the article in the storage space;
A second reflecting mirror that receives the second reflected light from the first reflecting mirror and reflects the reflected light to the imaging means;
An article management method, wherein the presence or absence of the article in the storage space is image-recognized from imaging data captured by the imaging unit.

Images