WO2020208917A1 - Body function management system, and body function management method - Google Patents

Body function management system, and body function management method Download PDF

Info

Publication number
WO2020208917A1
WO2020208917A1 PCT/JP2020/004270 JP2020004270W WO2020208917A1 WO 2020208917 A1 WO2020208917 A1 WO 2020208917A1 JP 2020004270 W JP2020004270 W JP 2020004270W WO 2020208917 A1 WO2020208917 A1 WO 2020208917A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
physical function
identification information
person
management system
Prior art date
Application number
PCT/JP2020/004270
Other languages
French (fr)
Japanese (ja)
Inventor
健吾 和田
貴拓 相原
太一 濱塚
嵩 内田
貴洋 樋山
佳州 佐藤
彰 松原
湯峯 学
松村 吉浩
Original Assignee
パナソニックIpマネジメント株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニックIpマネジメント株式会社 filed Critical パナソニックIpマネジメント株式会社
Priority to JP2021513182A priority Critical patent/JP7304531B2/en
Publication of WO2020208917A1 publication Critical patent/WO2020208917A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/117Identification of persons
    • A61B5/1171Identification of persons based on the shapes or appearances of their bodies or parts thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment

Definitions

  • the present invention relates to a physical function management system and a physical function management method for managing a person's physical function.
  • Patent Document 1 discloses a life management system that detects a user's mental and physical condition, restricts the user's behavior, and distributes relaxation information to the user.
  • An object of the present invention is to provide a physical function management system and a physical function management method capable of efficiently managing human physical function information.
  • the physical function management system captures a moving image of a person as a subject, and based on the captured moving image, obtains the physical function information of the person and the identification information of the person. It includes an information processing unit that stores the specified and specified physical function information and the specified identification information in a storage unit in association with each other.
  • the physical function management method is a physical function management method executed by a computer, in which a moving image of a person as a subject is imaged, and the physical function of the person is based on the captured moving image.
  • the information and the identification information of the person are specified, and the identified physical function information and the identified identification information are associated and stored in the storage unit.
  • the program according to one aspect of the present invention is a program for causing a computer to execute the physical function management method.
  • the physical function management system and the physical function management method of the present invention can efficiently manage human physical function information.
  • FIG. 1 is a diagram showing an outline of a physical function management system according to an embodiment.
  • FIG. 2 is a block diagram showing a functional configuration of the physical function management system according to the embodiment.
  • FIG. 3 is a flowchart of the registration operation of the physical function management system according to the embodiment.
  • FIG. 4 is a diagram showing an example of a registration completion screen displayed on the communication terminal that has received the registration completion notification.
  • FIG. 5 is a flowchart of the operation of accumulating gait information and other physical function information of the physical function management system according to the embodiment.
  • FIG. 6 is a flowchart of a physical function information distribution operation of the physical function management system according to the embodiment.
  • FIG. 7 is a diagram showing an example of a display screen displayed on the communication terminal that has received the notification information.
  • FIG. 8 is a diagram showing an outline of the authentication operation of the physical function management system according to the embodiment.
  • FIG. 9 is a flowchart of the authentication operation of the physical function management system according to the embodiment.
  • each figure is a schematic diagram and is not necessarily exactly illustrated. Further, in each figure, substantially the same configuration may be designated by the same reference numerals, and duplicate description may be omitted or simplified.
  • FIG. 1 is a diagram showing an outline of a physical function management system according to an embodiment.
  • FIG. 2 is a block diagram showing a functional configuration of the physical function management system according to the embodiment.
  • the physical function management system 10 according to the embodiment includes a plurality of imaging units 20, a human detection unit 30, a lock device 40, and a management device 50.
  • the communication terminal 60 is also shown in FIGS. 1 and 2.
  • the physical function management system 10 is a system that manages physical function information indicating a person's physical function.
  • the physical function here means, for example, gait, muscular strength, cognitive function, and the like. Gait is the state of physical exercise when a person is walking, and the gait information indicating the gait includes walking speed, stride length, stride, walking cycle, cadence, left-right step difference, and walking time. It includes the shaking of the trunk and the amount of change in the joint angle.
  • the physical function management system 10 is a system that accumulates the above-mentioned physical function information and is useful for human health management.
  • the imaging unit 20 is installed in a building such as a house and images the outside of the building.
  • the imaging unit 20 can image a person passing through the imaging range of the imaging unit 20.
  • the imaging unit 20 can image a member of the family.
  • the imaging unit 20 may be installed in a building other than a house such as a nursing care facility, an office, or a public institution.
  • the image pickup unit 20 is a security camera (surveillance camera), but may be a doorphone (intercom) camera as shown in FIG.
  • the physical function management system 10 includes a plurality of imaging units 20, but the physical function management system 10 may include at least one imaging unit 20, and the number of imaging units 20 is not particularly limited.
  • the person detection unit 30 is a pyroelectric sensor that detects infrared rays emitted from the human body around the place where the person detection unit 30 is installed, and is provided in the door phone.
  • the person detection unit 30 may be a sensor that detects a person using visible light, ultrasonic waves, or the like.
  • the human detection unit 30 functions as a device that gives the image pickup unit 20 a trigger for starting imaging. It is not essential that the physical function management system 10 includes the person detection unit 30, the imaging unit 20 constantly captures a moving image, and the information processing unit 52 detects a person based on the moving image captured by the imaging unit 20. You may.
  • the lock device 40 is an electric lock for locking and unlocking the door 41 of the building.
  • the lock device 40 unlocks (that is, unlocks) the door 41 based on, for example, an unlock signal transmitted from the management device 50.
  • the management device 50 acquires the moving image captured by the imaging unit 20 and manages the gait information of the person appearing in the acquired moving image.
  • the management device 50 is, for example, a control device (home controller or the like) installed in a house, but may be a server device (cloud server).
  • the management device 50 may be realized as a system that combines a control device and a server device installed in a house.
  • the management device 50 includes a first communication unit 51, an information processing unit 52, a storage unit 53, and a second communication unit 54.
  • the first communication unit 51 is a communication module (communication circuit) for the management device 50 to communicate with the image pickup unit 20, the person detection unit 30, the lock device 40, and the like via the local communication network.
  • the communication performed by the first communication unit 51 may be wired communication or wireless communication.
  • the communication standard used for communication is not particularly limited.
  • the information processing unit 52 performs information processing for managing the gait information of a person.
  • the information processing unit 52 includes a registration processing unit 55, a storage processing unit 56, a distribution processing unit 57, and an authentication processing unit 58.
  • the information processing unit 52 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.
  • the storage unit 53 is a storage device that stores moving images acquired by the first communication unit 51, gait information specified based on the moving images, and the like.
  • the storage unit 53 also stores a computer program or the like for execution by the information processing unit 52.
  • the storage unit 53 is realized by a semiconductor memory, an HDD (Hard Disk Drive), or the like.
  • the second communication unit 54 is a communication module (communication circuit) for the management device 50 to communicate with the communication terminal 60 via a wide area communication network 70 such as the Internet.
  • the communication performed by the second communication unit 54 may be wireless communication or wired communication.
  • the communication standard used for communication is also not particularly limited.
  • the communication terminal 60 is, for example, a portable information terminal such as a smartphone or a tablet terminal, but may be a stationary information terminal such as a personal computer.
  • the communication terminal 60 is operated by a person when he / she wants to view his / her own physical function information.
  • the communication terminal 60 may directly communicate with the management device 50 without going through the wide area communication network 70.
  • FIG. 3 is a flowchart of the registration operation of the physical function management system 10.
  • the communication terminal 60 accepts a predetermined operation for registration from a person who wishes to register.
  • This operation includes an operation of inputting information such as a login ID, a name, an age, a height, and a gender.
  • the method of inputting such information is not particularly limited, and for example, when the management device 50 includes a user interface, the information may be input via such a user interface.
  • a registration request is transmitted from the communication terminal 60, and the transmitted registration request is received by the management device 50.
  • the registration processing unit 55 starts the registration process (S12). Specifically, the registration processing unit 55 of the management device 50 causes the imaging unit 20 to start imaging, and transmits instruction information for instructing the registration applicant to the operation for registration to the second communication unit 54. Let me. On the display screen of the communication terminal 60 that has received the instruction information, information instructing the image pickup unit 20 to walk back and forth several times and information instructing the image pickup unit 20 to image a face image are displayed. Is displayed.
  • the registration processing unit 55 generates a face image for registration and gait information for registration based on a video obtained by the applicant for registration acting as instructed, and generates the above-mentioned login ID, name, and age. , Height, gender, and other information, a face image for registration, and registered identification information, which is information associated with gait information for registration, are stored in the storage unit 53. Then, the registration processing unit 55 issues a password and sends a registration completion notification including the password to the communication terminal 60.
  • FIG. 4 is a diagram showing an example of a registration completion screen displayed on the communication terminal 60 that has received the registration completion notification.
  • the face image may be captured and registered by the imaging unit included in the communication terminal 60 instead of the imaging unit 20.
  • the gait information is registered in the registration process.
  • the registration process only the face image is registered, and it is specified for the first time in the operation of accumulating other physical function information described later.
  • At least a part of the gait information or the physical function information estimated based on the gait information identified at the first time may be used as the registered identification information.
  • FIG. 5 is a flowchart of the operation of accumulating gait information and other physical function information of the physical function management system 10.
  • the storage processing unit 56 of the management device 50 starts imaging a moving image by the imaging unit 20 (S22).
  • the moving image is temporarily stored in the storage unit 53.
  • the storage processing unit 56 reads out the moving image stored in the storage unit 53, and identifies the gait information of the person based on the moving image (S23).
  • the gait for example, the 3D skeleton model of the person shown in the video (3D coordinate data of each joint such as the human knee joint, hip joint, and ankle) is specified using an existing algorithm, and the 3D skeleton is specified.
  • Gait information is specified using the position change of each skeleton point of the model.
  • the gait information includes at least one such as walking speed, stride length, stride, walking cycle, cadence, difference between left and right steps, trunk sway during walking, and amount of change in joint angle. Just do it.
  • the storage processing unit 56 identifies the identification information of the person appearing in the moving image (S24). For example, the accumulation processing unit 56 identifies the face image of a person appearing in the moving image by the existing face image recognition processing. Further, the accumulation processing unit 56 may specify at least a part of the gait information specified in step S23 as identification information. For example, when a person's face image is not shown in the moving image, at least a part of the gait information is used as identification information. When the person shown in the moving image is walking with his back to the imaging unit 20, or when the person shown in the moving image is wearing a mask, the face image cannot be acquired by the above face image recognition process. There is sex.
  • the storage processing unit 56 temporarily stores the gait information specified in step S23 and the identification information specified in step S24 in the storage unit 53 (S25).
  • the gait information for a plurality of persons may be stored in a state of being classified according to the degree of similarity.
  • the storage processing unit 56 determines whether or not the identification information temporarily stored in step S25 matches the registered identification information (S26). When the storage processing unit 56 determines that the temporarily stored identification information does not match the registered identification information, the storage processing unit 56 discards the temporarily stored gait information and the identification information (S27), and operates. Is the end.
  • the storage processing unit 56 determines that the temporarily stored identification information (at least a part of the face image or gait information) matches the registered identification information, the temporarily stored gait information Is stored (stored) in association with the registered identification information (S28).
  • the accumulation processing unit 56 estimates other physical function information based on the gait information stored in step S28 (S29).
  • Other physical function information is, for example, muscle strength information or cognitive function information.
  • the accumulation processing unit 56 estimates the lower limb muscle strength information of the person, for example, based on the bending angle of the knee of the leg that the person shown in the moving image steps forward while walking.
  • the accumulation processing unit 56 estimates the lower limb muscle strength information of the walking person shown in the moving image based on the change in the walking speed when the walking person stops.
  • Other examples of physical function information include left-right balance during walking.
  • cognitive function can be estimated based on, for example, a decrease in the bending angle of the knee of the leg during walking and a deterioration in the left-right balance during walking. Further, the accumulation processing unit 56 stores the other physical function information estimated in this way in association with the registered identification information (S30).
  • the physical function management system 10 stores the gait information in association with the registered identification information, and based on the gait information. , Estimate other physical functions. As a result, the registered person's physical function information can be selectively stored in the storage unit 53. In addition, the physical function management system 10 can estimate other physical function information such as dementia function decline and muscle weakness based on the gait information of the person who matches the identification information, and can store it in the storage unit 53. .. It is not essential that a plurality of types of physical function information are accumulated, and the physical function management system 10 may accumulate at least one type of physical function information.
  • the moving image is temporarily stored in the storage unit 53
  • the storage processing unit 56 reads out the moving image stored in the storage unit 53
  • the gait information of a person is based on the moving image.
  • other physical function information was estimated based on the identified gait information.
  • other physical function information may be estimated directly from the moving image without specifying the gait information.
  • the storage processing unit 56 since the storage processing unit 56 is associated with the identification information and the moving image, other physical function information can be estimated after the temporary storage in the storage unit 53 is completed, and the estimation can be performed. It is possible to make an accurate estimation by spending sufficient calculation processing time on a necessary computer or the like.
  • FIG. 6 is a flowchart of the physical function information distribution operation of the physical function management system 10.
  • the communication terminal 60 receives a predetermined operation for receiving the distribution of the physical function information from the registered user.
  • This operation includes a login ID and a password input operation.
  • the method of inputting such information is not particularly limited.
  • a distribution request is transmitted from the communication terminal 60, and the transmitted distribution request is received by the management device 50.
  • the distribution processing unit 57 When the distribution request is received by the second communication unit 54 of the management device 50 (S31), the distribution processing unit 57 starts the distribution process (S32). The distribution processing unit 57 determines whether the login ID and password included in the distribution request are correct, and if they are correct, stores the physical function information associated with these login IDs (that is, the registered identification information). It is specified by referring to the part 53.
  • the distribution processing unit 57 causes the second communication unit 54 to transmit the notification information for notifying the specified physical function information to the communication terminal 60.
  • FIG. 7 is a diagram showing an example of a display screen displayed on the communication terminal 60 that has received such notification information.
  • the physical function management system 10 can deliver the accumulated physical function information in response to the request of the registered user.
  • FIG. 8 is a diagram showing an outline of the authentication operation of the physical function management system 10.
  • FIG. 9 is a flowchart of the authentication operation of the physical function management system 10.
  • one of the image pickup units 20 and the person detection unit 30 are provided by a door phone.
  • the person detection unit 30 detects this (S41).
  • the authentication processing unit 58 of the management device 50 starts imaging a moving image by the imaging unit 20 (S42).
  • the moving image is temporarily stored in the storage unit 53.
  • the authentication processing unit 58 identifies the face image of the person appearing in the moving image by performing the face image recognition processing on the moving image stored in the storage unit 53 (S43), and the specified face image is registered. It is determined whether or not the image matches the face image included in the identification information (S44). When the authentication processing unit 58 determines that the specified face image does not match the face image included in the registered identification information (No in S44), the operation ends.
  • the authentication processing unit 58 determines that the specified face image matches the face image included in the registered identification information (Yes in S44), the authentication processing unit 58 first issues a release signal for unlocking the door 41.
  • the communication unit 51 is made to output to the lock device 40 (S45). As a result, the door 41 is unlocked.
  • the physical function management system 10 can also use the identification information registered by the above registration operation as the authentication information for unlocking the door 41.
  • authentication processing based on physical function information may be performed instead of the face image.
  • the physical function management system 10 identifies the human physical function information and the human identification information based on the image pickup unit 20 that captures the moving image of the person as the subject and the captured moving image.
  • the information processing unit 52 that stores the specified physical function information and the specified identification information in the storage unit 53 in association with each other.
  • a physical function management system 10 can identify both human physical function information and human identification information based on a moving image, it is not necessary to manually input the identification information. That is, the physical function management system 10 can efficiently manage human physical function information.
  • the information processing unit 52 identifies the person's gait information as the person's physical function information, and stores the specified gait information and the specified identification information in the storage unit 53 in association with each other.
  • Such a physical function management system 10 can manage a person's gait information.
  • the registered identification information is stored in advance in the storage unit 53.
  • the information processing unit 52 temporarily stores the specified physical function information and the specified identification information in the storage unit 53 in association with each other, and is specified when the specified identification information matches the registered identification information.
  • the physical function information is associated with the registered identification information and stored in the storage unit 53.
  • Such a physical function management system 10 can selectively manage only the physical function information of a person whose identification information is registered.
  • the physical function management system 10 further includes a second communication unit 54 that communicates with the communication terminal 60.
  • the information processing unit 52 transfers the physical function information associated with the registered identification information in the storage unit 53 to the second communication unit 54. To transmit to the communication terminal 60.
  • Such a physical function management system 10 can provide the stored (stored) physical function information to the person who operates the communication terminal 60.
  • the imaging unit 20 images the outside of the closed space provided with the door 41, and the information processing unit 52 locks the door 41 when the identified identification information matches the registered identification information. Outputs a release signal for release.
  • Such a physical function management system 10 can unlock the door 41 when a person whose identification information is registered is imaged by the imaging unit 20.
  • the physical function management system 10 further includes a person detection unit 30, and the information processing unit 52 causes the image pickup unit 20 to start capturing a moving image triggered by the detection of a person by the person detection unit 30. ..
  • the information processing unit 52 detects a person based on the moving image captured by the imaging unit 20.
  • Such a physical function management system 10 can detect a person by an image without using a sensor or the like.
  • the identification information is image information (that is, a face image) of a human face part.
  • Such a physical function management system 10 can use a human face image obtained from a moving image as identification information.
  • the identification information is at least a part of the physical function information.
  • Such a physical function management system 10 can use at least a part of a person's physical function information obtained from a moving image as identification information.
  • the physical function management method executed by a computer such as the physical function management system 10 captures a moving image of a person as a subject, and based on the captured moving image, the physical function information of the person and the identification information of the person. Is specified, and the specified physical function information and the specified identification information are linked and stored in the storage unit 53.
  • both the physical function information of a person and the identification information of a person can be specified based on a moving image, so that the identification information does not need to be manually input. That is, the physical function management method can efficiently manage the gait information of a person.
  • a part of the face image and the gait information is used together as the identification information, but at least one of the face image and the gait information may be used as the identification information.
  • the imaging unit is installed outdoors, but it may be installed indoors. Further, the imaging unit may be installed in a building other than a house such as a nursing care facility or a public institution, or may be installed in a utility pole or the like.
  • the physical function management system is realized by a plurality of devices, but it may be realized as a single device.
  • each component of the physical function management system may be distributed to the plurality of devices in any way.
  • each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component.
  • Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
  • each component may be a circuit (or an integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits from each other. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.
  • a recording medium such as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM. Further, it may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program and a recording medium.
  • the present invention may be realized as a program for causing a computer to execute the physical function management method of the above embodiment, or a computer-readable non-temporary recording medium in which such a program is stored. It may be realized as.
  • the order of a plurality of processes in the flowchart of the operation example described in the above embodiment is an example.
  • the order of the plurality of processes may be changed, and the plurality of processes may be executed in parallel.
  • another processing unit may execute the processing executed by the specific processing unit.

Abstract

A body function management system (10) is provided with: an imaging unit (20) that captures a moving image in which a person appears as a subject; and an information processing unit (52) that specifies body function information for the person and identification information for the person on the basis of the captured moving image, associates the specified body function information and the specified identification information together, and stores the same in a storage unit (53).

Description

身体機能管理システム、及び、身体機能管理方法Physical function management system and physical function management method
 本発明は、人の身体機能を管理する身体機能管理システムおよび身体機能管理方法に関する。 The present invention relates to a physical function management system and a physical function management method for managing a person's physical function.
 近年、健康に対する関心が強くなっている。健康寿命を延ばすためには、日々の健康管理が大切である。その中で、自分自身の身体の機能の状態、衰退を知っておくことが健康管理の意識向上につながる。健康に関する技術として、特許文献1には、ユーザの心身状態を検出し、ユーザの行動を制限したり、ユーザにリラクゼーション情報を配信したりする生活管理システムが開示されている。 In recent years, interest in health has increased. Daily health management is important to extend healthy life expectancy. Among them, knowing the state of one's own physical function and decline leads to raising awareness of health management. As a technique related to health, Patent Document 1 discloses a life management system that detects a user's mental and physical condition, restricts the user's behavior, and distributes relaxation information to the user.
特開2005-74107号公報Japanese Unexamined Patent Publication No. 2005-74107
 ところで、複数人の健康状態を管理するためには、複数人分の健康状態を示す情報のそれぞれが誰のものであるかを識別するために、識別情報の入力が必要である。人数が多くなると識別情報の入力に非常に手間がかかり、非効率的である。 By the way, in order to manage the health status of a plurality of people, it is necessary to input the identification information in order to identify who each of the information indicating the health status of the plurality of people belongs to. When the number of people is large, it takes a lot of time and effort to input the identification information, which is inefficient.
 本発明は、人の身体機能情報を効率的に管理することができる、身体機能管理システム、及び、身体機能管理方法を提供することを目的とする。 An object of the present invention is to provide a physical function management system and a physical function management method capable of efficiently managing human physical function information.
 本発明の一態様に係る身体機能管理システムは、人が被写体として映る動画を撮像する撮像部と、撮像された前記動画に基づいて、前記人の身体機能情報、及び、前記人の識別情報を特定し、特定された前記身体機能情報及び特定された前記識別情報を紐づけて記憶部に記憶する情報処理部とを備える。 The physical function management system according to one aspect of the present invention captures a moving image of a person as a subject, and based on the captured moving image, obtains the physical function information of the person and the identification information of the person. It includes an information processing unit that stores the specified and specified physical function information and the specified identification information in a storage unit in association with each other.
 本発明の一態様に係る身体機能管理方法は、コンピュータによって実行される身体機能管理方法であって、人が被写体として映る動画を撮像し、撮像された前記動画に基づいて、前記人の身体機能情報、及び、前記人の識別情報を特定し、特定された前記身体機能情報及び特定された前記識別情報を紐づけて記憶部に記憶する。 The physical function management method according to one aspect of the present invention is a physical function management method executed by a computer, in which a moving image of a person as a subject is imaged, and the physical function of the person is based on the captured moving image. The information and the identification information of the person are specified, and the identified physical function information and the identified identification information are associated and stored in the storage unit.
 本発明の一態様に係るプログラムは、前記身体機能管理方法をコンピュータに実行させるためのプログラムである。 The program according to one aspect of the present invention is a program for causing a computer to execute the physical function management method.
 本発明の身体機能管理システム、及び、身体機能管理方法は、人の身体機能情報を効率的に管理することができる。 The physical function management system and the physical function management method of the present invention can efficiently manage human physical function information.
図1は、実施の形態に係る身体機能管理システムの概要を示す図である。FIG. 1 is a diagram showing an outline of a physical function management system according to an embodiment. 図2は、実施の形態に係る身体機能管理システムの機能構成を示すブロック図である。FIG. 2 is a block diagram showing a functional configuration of the physical function management system according to the embodiment. 図3は、実施の形態に係る身体機能管理システムの登録動作のフローチャートである。FIG. 3 is a flowchart of the registration operation of the physical function management system according to the embodiment. 図4は、登録完了通知を受信した通信端末に表示される登録完了画面の一例を示す図である。FIG. 4 is a diagram showing an example of a registration completion screen displayed on the communication terminal that has received the registration completion notification. 図5は、実施の形態に係る身体機能管理システムの歩容情報及び他の身体機能情報の蓄積動作のフローチャートである。FIG. 5 is a flowchart of the operation of accumulating gait information and other physical function information of the physical function management system according to the embodiment. 図6は、実施の形態に係る身体機能管理システムの身体機能情報の配信動作のフローチャートである。FIG. 6 is a flowchart of a physical function information distribution operation of the physical function management system according to the embodiment. 図7は、通知情報を受信した通信端末に表示される表示画面の一例を示す図である。FIG. 7 is a diagram showing an example of a display screen displayed on the communication terminal that has received the notification information. 図8は、実施の形態に係る身体機能管理システムの認証動作の概要を示す図である。FIG. 8 is a diagram showing an outline of the authentication operation of the physical function management system according to the embodiment. 図9は、実施の形態に係る身体機能管理システムの認証動作のフローチャートである。FIG. 9 is a flowchart of the authentication operation of the physical function management system according to the embodiment.
 以下、実施の形態について、図面を参照しながら説明する。なお、以下で説明する実施の形態は、いずれも包括的または具体的な例を示すものである。以下の実施の形態で示される数値、形状、材料、構成要素、構成要素の配置位置及び接続形態、ステップ、ステップの順序などは、一例であり、本発明を限定する主旨ではない。また、以下の実施の形態における構成要素のうち、独立請求項に記載されていない構成要素については、任意の構成要素として説明される。 Hereinafter, embodiments will be described with reference to the drawings. It should be noted that all of the embodiments described below show comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, the order of steps, etc. shown in the following embodiments are examples, and are not intended to limit the present invention. Further, among the components in the following embodiments, the components not described in the independent claims will be described as arbitrary components.
 なお、各図は模式図であり、必ずしも厳密に図示されたものではない。また、各図において、実質的に同一の構成に対しては同一の符号を付し、重複する説明は省略または簡略化される場合がある。 Note that each figure is a schematic diagram and is not necessarily exactly illustrated. Further, in each figure, substantially the same configuration may be designated by the same reference numerals, and duplicate description may be omitted or simplified.
 (実施の形態)
 [構成]
 まず、実施の形態に係る身体機能管理システムの構成について説明する。図1は、実施の形態に係る身体機能管理システムの概要を示す図である。図2は、実施の形態に係る身体機能管理システムの機能構成を示すブロック図である。図1及び図2に示されるように、実施の形態に係る身体機能管理システム10は、複数の撮像部20と、人検知部30と、錠前装置40と、管理装置50とを備える。なお、図1および図2には、通信端末60も示されている。
(Embodiment)
[Constitution]
First, the configuration of the physical function management system according to the embodiment will be described. FIG. 1 is a diagram showing an outline of a physical function management system according to an embodiment. FIG. 2 is a block diagram showing a functional configuration of the physical function management system according to the embodiment. As shown in FIGS. 1 and 2, the physical function management system 10 according to the embodiment includes a plurality of imaging units 20, a human detection unit 30, a lock device 40, and a management device 50. The communication terminal 60 is also shown in FIGS. 1 and 2.
 身体機能管理システム10は、人の身体機能を示す身体機能情報を管理するシステムである。ここでの身体機能は、例えば、歩容、筋力、及び、認知機能などを意味する。歩容とは、人が歩いている時の身体運動の様子であり、歩容を示す歩容情報には、歩行速度、歩幅、歩隔、歩行周期、ケイデンス、左右のステップ差、歩行時の体幹の揺れ、及び、関節角度の変化量などが含まれる。身体機能管理システム10は、上記のような身体機能情報を蓄積し、人の健康管理に役立てるシステムである。 The physical function management system 10 is a system that manages physical function information indicating a person's physical function. The physical function here means, for example, gait, muscular strength, cognitive function, and the like. Gait is the state of physical exercise when a person is walking, and the gait information indicating the gait includes walking speed, stride length, stride, walking cycle, cadence, left-right step difference, and walking time. It includes the shaking of the trunk and the amount of change in the joint angle. The physical function management system 10 is a system that accumulates the above-mentioned physical function information and is useful for human health management.
 撮像部20は、住宅などの建物に設置され、当該建物の外側を撮像する。撮像部20は、当該撮像部20の撮像範囲を通行する人を撮像することができる。撮像部20が住宅に設置される場合、撮像部20は、家族の一員を撮像することができる。なお、撮像部20は、介護施設、オフィス、または、公共機関など住宅以外の建物に設置されてもよい。 The imaging unit 20 is installed in a building such as a house and images the outside of the building. The imaging unit 20 can image a person passing through the imaging range of the imaging unit 20. When the imaging unit 20 is installed in a house, the imaging unit 20 can image a member of the family. The imaging unit 20 may be installed in a building other than a house such as a nursing care facility, an office, or a public institution.
 撮像部20は、具体的には、セキュリティカメラ(監視カメラ)であるが、図1に示されるようにドアホン(インターホン)のカメラであってもよい。身体機能管理システム10は、複数の撮像部20を備えているが、身体機能管理システム10は、少なくとも1つの撮像部20を備えていればよく、撮像部20の数は特に限定されない。 Specifically, the image pickup unit 20 is a security camera (surveillance camera), but may be a doorphone (intercom) camera as shown in FIG. The physical function management system 10 includes a plurality of imaging units 20, but the physical function management system 10 may include at least one imaging unit 20, and the number of imaging units 20 is not particularly limited.
 人検知部30は、当該人検知部30の設置場所の周辺において、人の体から発せられる赤外線を検知する焦電センサであり、ドアホンに備えられている。人検知部30は、可視光または超音波などを用いて人を検出するセンサであってもよい。人検知部30は、撮像部20に、撮像を開始するためのトリガを与える装置として機能する。なお、身体機能管理システム10が人検知部30を備えることは必須ではなく、撮像部20は常時動画を撮像し、情報処理部52が撮像部20によって撮像された動画に基づいて人を検知してもよい。 The person detection unit 30 is a pyroelectric sensor that detects infrared rays emitted from the human body around the place where the person detection unit 30 is installed, and is provided in the door phone. The person detection unit 30 may be a sensor that detects a person using visible light, ultrasonic waves, or the like. The human detection unit 30 functions as a device that gives the image pickup unit 20 a trigger for starting imaging. It is not essential that the physical function management system 10 includes the person detection unit 30, the imaging unit 20 constantly captures a moving image, and the information processing unit 52 detects a person based on the moving image captured by the imaging unit 20. You may.
 錠前装置40は、建物のドア41を施錠及び解錠するための電気錠である。錠前装置40は、例えば、管理装置50から送信される解除信号に基づいてドア41のロックを解除(つまり、解錠)する。 The lock device 40 is an electric lock for locking and unlocking the door 41 of the building. The lock device 40 unlocks (that is, unlocks) the door 41 based on, for example, an unlock signal transmitted from the management device 50.
 管理装置50は、撮像部20によって撮像された動画を取得し、取得した動画に映る人の歩容情報を管理する。管理装置50は、例えば、住宅に設置される制御装置(ホームコントローラなど)であるが、サーバ装置(クラウドサーバ)であってもよい。管理装置50は、住宅に設置される制御装置及びサーバ装置を組み合わせたシステムとして実現されてもよい。管理装置50は、第一通信部51と、情報処理部52と、記憶部53と、第二通信部54とを備える。 The management device 50 acquires the moving image captured by the imaging unit 20 and manages the gait information of the person appearing in the acquired moving image. The management device 50 is, for example, a control device (home controller or the like) installed in a house, but may be a server device (cloud server). The management device 50 may be realized as a system that combines a control device and a server device installed in a house. The management device 50 includes a first communication unit 51, an information processing unit 52, a storage unit 53, and a second communication unit 54.
 第一通信部51は、管理装置50が、撮像部20、人検知部30、及び、錠前装置40などと局所通信網を介した通信を行うための通信モジュール(通信回路)である。第一通信部51によって行われる通信は、有線通信であってもよいし、無線通信であってもよい。通信に用いられる通信規格は、特に限定されない。 The first communication unit 51 is a communication module (communication circuit) for the management device 50 to communicate with the image pickup unit 20, the person detection unit 30, the lock device 40, and the like via the local communication network. The communication performed by the first communication unit 51 may be wired communication or wireless communication. The communication standard used for communication is not particularly limited.
 情報処理部52は、人の歩容情報を管理するための情報処理を行う。情報処理部52は、登録処理部55と、蓄積処理部56と、配信処理部57と、認証処理部58とを有する。情報処理部52は、具体的には、CPU(Central Processing Unit)、RAM(Random Access Memory)およびROM(Read Only Memory)などによって構成されている。 The information processing unit 52 performs information processing for managing the gait information of a person. The information processing unit 52 includes a registration processing unit 55, a storage processing unit 56, a distribution processing unit 57, and an authentication processing unit 58. Specifically, the information processing unit 52 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.
 記憶部53は、第一通信部51によって取得された動画、動画に基づいて特定された歩容情報などが蓄積される記憶装置である。記憶部53には、情報処理部52が実行するためのコンピュータプログラムなども記憶されている。記憶部53は、具体的には、半導体メモリまたはHDD(Hard Disk Drive)などによって実現される。 The storage unit 53 is a storage device that stores moving images acquired by the first communication unit 51, gait information specified based on the moving images, and the like. The storage unit 53 also stores a computer program or the like for execution by the information processing unit 52. Specifically, the storage unit 53 is realized by a semiconductor memory, an HDD (Hard Disk Drive), or the like.
 第二通信部54は、管理装置50がインターネットなどの広域通信網70を介して通信端末60と通信を行うための通信モジュール(通信回路)である。第二通信部54によって行われる通信は、無線通信であってもよいし、有線通信であってもよい。通信に用いられる通信規格についても特に限定されない。 The second communication unit 54 is a communication module (communication circuit) for the management device 50 to communicate with the communication terminal 60 via a wide area communication network 70 such as the Internet. The communication performed by the second communication unit 54 may be wireless communication or wired communication. The communication standard used for communication is also not particularly limited.
 通信端末60は、例えば、スマートフォン、または、タブレット端末などの携帯型の情報端末であるが、パーソナルコンピュータなどの据え置き型の情報端末であってもよい。通信端末60は、人が、自身の身体機能情報を閲覧したい場合に、当該人によって操作される。通信端末60は、広域通信網70を介さずに管理装置50と直接通信を行ってもよい。 The communication terminal 60 is, for example, a portable information terminal such as a smartphone or a tablet terminal, but may be a stationary information terminal such as a personal computer. The communication terminal 60 is operated by a person when he / she wants to view his / her own physical function information. The communication terminal 60 may directly communicate with the management device 50 without going through the wide area communication network 70.
 [登録動作]
 次に、身体機能管理システム10の動作について説明する。以下では、身体機能情報の一例として、歩容情報が蓄積される例について説明する。身体機能管理システム10は、撮像部20によって撮像された人の歩容情報を蓄積するが、このときに、当該人が誰であるかを区別する必要がある。身体機能管理システム10においては、人を区別するための識別情報として、顔画像(顔の部分の画像情報)、及び、歩容情報が用いられる。まず、識別情報を登録するときの動作について説明する。図3は、身体機能管理システム10の登録動作のフローチャートである。
[Registration operation]
Next, the operation of the physical function management system 10 will be described. In the following, as an example of physical function information, an example in which gait information is accumulated will be described. The physical function management system 10 accumulates gait information of a person imaged by the imaging unit 20, and at this time, it is necessary to distinguish who the person is. In the physical function management system 10, face image (image information of a face portion) and gait information are used as identification information for distinguishing a person. First, the operation when registering the identification information will be described. FIG. 3 is a flowchart of the registration operation of the physical function management system 10.
 まず、通信端末60は、登録のための所定の操作を登録希望者から受け付ける。この操作には、ログインID、名前、年齢、身長、性別などの情報の入力操作が含まれる。なお、これらの情報の入力方法については特に限定されず、例えば、管理装置50がユーザインターフェースを備えるような場合には、このようなユーザインターフェースを介して入力されてもよい。このような操作が受け付けられると、通信端末60から登録要求が送信され、送信された登録要求は管理装置50によって受信される。 First, the communication terminal 60 accepts a predetermined operation for registration from a person who wishes to register. This operation includes an operation of inputting information such as a login ID, a name, an age, a height, and a gender. The method of inputting such information is not particularly limited, and for example, when the management device 50 includes a user interface, the information may be input via such a user interface. When such an operation is accepted, a registration request is transmitted from the communication terminal 60, and the transmitted registration request is received by the management device 50.
 管理装置50の第二通信部54によって登録要求が受信されると(S11)、登録処理部55は、登録処理を開始する(S12)。管理装置50の登録処理部55は、具体的には、撮像部20に撮像を開始させるとともに、第二通信部54に、登録希望者に登録のための動作を指示するための指示情報を送信させる。指示情報を受信した通信端末60の表示画面には、撮像部20の撮像範囲を何回か歩いて往復することを指示する情報と、撮像部20によって顔画像を撮像することを指示する情報とが表示される。 When the registration request is received by the second communication unit 54 of the management device 50 (S11), the registration processing unit 55 starts the registration process (S12). Specifically, the registration processing unit 55 of the management device 50 causes the imaging unit 20 to start imaging, and transmits instruction information for instructing the registration applicant to the operation for registration to the second communication unit 54. Let me. On the display screen of the communication terminal 60 that has received the instruction information, information instructing the image pickup unit 20 to walk back and forth several times and information instructing the image pickup unit 20 to image a face image are displayed. Is displayed.
 登録処理部55は、登録希望者が指示通りに行動することで得られる動画に基づいて、登録用の顔画像、及び、登録用の歩容情報を生成し、上述のログインID、名前、年齢、身長、性別などの情報と、登録用の顔画像と、登録用の歩容情報とを紐づけた情報である登録済み識別情報を記憶部53に記憶する。そして、登録処理部55は、パスワードを発行し、パスワードを含む登録完了通知を通信端末60に送信する。図4は、登録完了通知を受信した通信端末60に表示される登録完了画面の一例を示す図である。なお、顔画像は、撮像部20ではなく、通信端末60が備える撮像部によって撮像し、登録されてもよい。 The registration processing unit 55 generates a face image for registration and gait information for registration based on a video obtained by the applicant for registration acting as instructed, and generates the above-mentioned login ID, name, and age. , Height, gender, and other information, a face image for registration, and registered identification information, which is information associated with gait information for registration, are stored in the storage unit 53. Then, the registration processing unit 55 issues a password and sends a registration completion notification including the password to the communication terminal 60. FIG. 4 is a diagram showing an example of a registration completion screen displayed on the communication terminal 60 that has received the registration completion notification. The face image may be captured and registered by the imaging unit included in the communication terminal 60 instead of the imaging unit 20.
 また、登録処理において歩容情報が登録されることは必須ではなく、例えば、登録処理においては顔画像のみが登録され、後述する他の身体機能情報の蓄積動作の際に、初回に特定された歩容情報、または、初回に特定された歩容情報に基づいて推定された身体機能情報の少なくとも一部が登録済み識別情報として使用されてもよい。 Further, it is not essential that the gait information is registered in the registration process. For example, in the registration process, only the face image is registered, and it is specified for the first time in the operation of accumulating other physical function information described later. At least a part of the gait information or the physical function information estimated based on the gait information identified at the first time may be used as the registered identification information.
 [歩容情報及び他の身体機能情報の蓄積動作]
 次に、身体機能管理システム10の歩容情報及び他の身体機能情報の蓄積動作について説明する。図5は、身体機能管理システム10の歩容情報及び他の身体機能情報の蓄積動作のフローチャートである。
[Accumulation of gait information and other physical function information]
Next, the gait information and other physical function information storage operations of the physical function management system 10 will be described. FIG. 5 is a flowchart of the operation of accumulating gait information and other physical function information of the physical function management system 10.
 人検知部30によって人が検知されると(S21)、管理装置50の蓄積処理部56は、撮像部20による動画の撮像を開始する(S22)。動画は、一時的に記憶部53に記憶される。 When a person is detected by the person detection unit 30 (S21), the storage processing unit 56 of the management device 50 starts imaging a moving image by the imaging unit 20 (S22). The moving image is temporarily stored in the storage unit 53.
 蓄積処理部56は、記憶部53に記憶された動画を読み出し、当該動画に基づいて、人の歩容情報を特定する(S23)。歩容を特定するに際して、例えば、動画に映る人の3次元骨格モデル(人の膝関節、股関節、くるぶしなどの各関節の3次元座標データ)を既存のアルゴリズムを用いて特定し、3次元骨格モデルの各骨格点の位置変化を用いて歩容情報を特定する。上述のように、歩容情報は、歩行速度、歩幅、歩隔、歩行周期、ケイデンス、左右のステップ差、歩行時の体幹の揺れ、及び、関節角度の変化量などの少なくとも1つを含めばよい。 The storage processing unit 56 reads out the moving image stored in the storage unit 53, and identifies the gait information of the person based on the moving image (S23). When specifying the gait, for example, the 3D skeleton model of the person shown in the video (3D coordinate data of each joint such as the human knee joint, hip joint, and ankle) is specified using an existing algorithm, and the 3D skeleton is specified. Gait information is specified using the position change of each skeleton point of the model. As described above, the gait information includes at least one such as walking speed, stride length, stride, walking cycle, cadence, difference between left and right steps, trunk sway during walking, and amount of change in joint angle. Just do it.
 次に、蓄積処理部56は、動画に映る人の識別情報を特定する(S24)。例えば、蓄積処理部56は、既存の顔画像認識処理により、動画に映る人の顔画像を特定する。また、蓄積処理部56は、ステップS23で特定した歩容情報の少なくとも一部を識別情報として特定してもよい。例えば、動画に人の顔画像が映っていなかった場合などに、歩容情報の少なくとも一部が識別情報として使用される。動画に映る人が撮像部20に背中を向けて歩行している場合、及び、動画に映る人がマスクを装着しているような場合には、上記顔画像認識処理によって顔画像が取得できない可能性がある。 Next, the storage processing unit 56 identifies the identification information of the person appearing in the moving image (S24). For example, the accumulation processing unit 56 identifies the face image of a person appearing in the moving image by the existing face image recognition processing. Further, the accumulation processing unit 56 may specify at least a part of the gait information specified in step S23 as identification information. For example, when a person's face image is not shown in the moving image, at least a part of the gait information is used as identification information. When the person shown in the moving image is walking with his back to the imaging unit 20, or when the person shown in the moving image is wearing a mask, the face image cannot be acquired by the above face image recognition process. There is sex.
 次に、蓄積処理部56は、ステップS23で特定された歩容情報及びステップS24で特定された識別情報を紐づけて記憶部53に一時的に記憶する(S25)。なお、ステップS25において複数人分の歩容情報が一時的に記憶される場合、複数人分の歩容情報は、類似度に応じてクラス分けされた状態で記憶されていてもよい。 Next, the storage processing unit 56 temporarily stores the gait information specified in step S23 and the identification information specified in step S24 in the storage unit 53 (S25). When the gait information for a plurality of persons is temporarily stored in step S25, the gait information for the plurality of persons may be stored in a state of being classified according to the degree of similarity.
 次に、蓄積処理部56は、ステップS25において一時的に記憶された識別情報が、登録済み識別情報と一致するか否かの判定を行う(S26)。蓄積処理部56は、一時的に記憶された識別情報が、登録済み識別情報と一致しないと判定した場合、一時的に記憶された歩容情報、及び、識別情報を破棄し(S27)、動作は終了となる。 Next, the storage processing unit 56 determines whether or not the identification information temporarily stored in step S25 matches the registered identification information (S26). When the storage processing unit 56 determines that the temporarily stored identification information does not match the registered identification information, the storage processing unit 56 discards the temporarily stored gait information and the identification information (S27), and operates. Is the end.
 一方、蓄積処理部56は、一時的に記憶された識別情報(顔画像または歩容情報の少なくとも一部)が、登録済み識別情報と一致すると判定した場合、一時的に記憶された歩容情報を、当該登録済み識別情報に紐づけて記憶(蓄積)する(S28)。 On the other hand, when the storage processing unit 56 determines that the temporarily stored identification information (at least a part of the face image or gait information) matches the registered identification information, the temporarily stored gait information Is stored (stored) in association with the registered identification information (S28).
 そして、蓄積処理部56は、ステップS28で記憶された歩容情報に基づいて他の身体機能情報の推定を行う(S29)。他の身体機能情報は、例えば、筋力情報または認知機能情報である。蓄積処理部56は、例えば、動画に映る人が歩行中に前方へ踏み出す脚の膝の曲げ角度に基づいて、当該人の下肢筋力情報を推定する。また、蓄積処理部56は、動画に映る歩行中の人が停止するときの歩行速度の変化に基づいて、当該人の下肢筋力情報を推定する。身体機能情報としては、その他に、歩行中の左右のバランスなどが例示される。筋力と同じように、認知機能に関しても、例えば歩行中の脚の膝の曲げ角度の衰えや歩行中の左右バランスの劣化をもとに推定することが可能である。また、蓄積処理部56は、このように推定した他の身体機能情報を、上記登録済み識別情報に紐づけて記憶する(S30)。 Then, the accumulation processing unit 56 estimates other physical function information based on the gait information stored in step S28 (S29). Other physical function information is, for example, muscle strength information or cognitive function information. The accumulation processing unit 56 estimates the lower limb muscle strength information of the person, for example, based on the bending angle of the knee of the leg that the person shown in the moving image steps forward while walking. In addition, the accumulation processing unit 56 estimates the lower limb muscle strength information of the walking person shown in the moving image based on the change in the walking speed when the walking person stops. Other examples of physical function information include left-right balance during walking. Similar to muscular strength, cognitive function can be estimated based on, for example, a decrease in the bending angle of the knee of the leg during walking and a deterioration in the left-right balance during walking. Further, the accumulation processing unit 56 stores the other physical function information estimated in this way in association with the registered identification information (S30).
 このように、身体機能管理システム10は、特定される識別情報が、登録済み識別情報と一致する場合には、歩容情報を登録済み識別情報と紐づけて記憶し、歩容情報に基づいて、他の身体機能を推定する。これにより、登録済みの人の身体機能情報を選択的に記憶部53に蓄積することができる。また、身体機能容管理システム10は、識別情報と一致した人の歩容情報に基づいて認知症機能低下や筋力低下などの他の身体機能情報を推定し、記憶部53に蓄積することもできる。なお、複数種類の身体機能情報が蓄積されることは必須ではなく、身体機能管理システム10は、少なくとも一種類の身体機能情報を蓄積すればよい。 As described above, when the identified identification information matches the registered identification information, the physical function management system 10 stores the gait information in association with the registered identification information, and based on the gait information. , Estimate other physical functions. As a result, the registered person's physical function information can be selectively stored in the storage unit 53. In addition, the physical function management system 10 can estimate other physical function information such as dementia function decline and muscle weakness based on the gait information of the person who matches the identification information, and can store it in the storage unit 53. .. It is not essential that a plurality of types of physical function information are accumulated, and the physical function management system 10 may accumulate at least one type of physical function information.
 なお、上記図5のフローチャートにおいては、動画は、一時的に記憶部53に記憶され、蓄積処理部56は、記憶部53に記憶された動画を読み出し、当該動画に基づいて人の歩容情報を特定し、特定した歩容情報に基づいて他の身体機能情報の推定を行った。しかしながら、他の身体機能情報は、歩容情報を特定せずに動画から直接推定されてもよい。この場合、蓄積処理部56は、識別情報と動画が紐付けされているために、記憶部53への一時的な記憶が終了してから他の身体機能情報を推定することができ、推定に必要なコンピュータなどの計算処理時間を十分にかけて精度のよい推定を行うことができる。 In the flowchart of FIG. 5, the moving image is temporarily stored in the storage unit 53, the storage processing unit 56 reads out the moving image stored in the storage unit 53, and the gait information of a person is based on the moving image. Was identified, and other physical function information was estimated based on the identified gait information. However, other physical function information may be estimated directly from the moving image without specifying the gait information. In this case, since the storage processing unit 56 is associated with the identification information and the moving image, other physical function information can be estimated after the temporary storage in the storage unit 53 is completed, and the estimation can be performed. It is possible to make an accurate estimation by spending sufficient calculation processing time on a necessary computer or the like.
 [身体機能情報の配信動作]
 次に、身体機能管理システム10の身体機能情報の配信動作について説明する。図6は、身体機能管理システム10の身体機能情報の配信動作のフローチャートである。
[Distribution of physical function information]
Next, the operation of distributing the physical function information of the physical function management system 10 will be described. FIG. 6 is a flowchart of the physical function information distribution operation of the physical function management system 10.
 まず、通信端末60は、身体機能情報の配信を受けるための所定の操作を登録済みユーザから受け付ける。この操作には、ログインID、及び、パスワードの入力操作が含まれる。なお、これらの情報の入力方法については特に限定されない。このような操作が受け付けられると、通信端末60から配信要求が送信され、送信された配信要求は管理装置50によって受信される。 First, the communication terminal 60 receives a predetermined operation for receiving the distribution of the physical function information from the registered user. This operation includes a login ID and a password input operation. The method of inputting such information is not particularly limited. When such an operation is accepted, a distribution request is transmitted from the communication terminal 60, and the transmitted distribution request is received by the management device 50.
 管理装置50の第二通信部54によって配信要求が受信されると(S31)、配信処理部57は、配信処理を開始する(S32)。配信処理部57は、配信要求に含まれるログインID及びパスワードが正しいかを判定し、正しい場合には、これらのログインID(つまり、登録済み識別情報)に紐づけられた身体機能情報を、記憶部53を参照することにより特定する。 When the distribution request is received by the second communication unit 54 of the management device 50 (S31), the distribution processing unit 57 starts the distribution process (S32). The distribution processing unit 57 determines whether the login ID and password included in the distribution request are correct, and if they are correct, stores the physical function information associated with these login IDs (that is, the registered identification information). It is specified by referring to the part 53.
 配信処理部57は、第二通信部54に、特定した身体機能情報を通知するための通知情報を通信端末60へ送信させる。図7は、このような通知情報を受信した通信端末60に表示される表示画面の一例を示す図である。 The distribution processing unit 57 causes the second communication unit 54 to transmit the notification information for notifying the specified physical function information to the communication terminal 60. FIG. 7 is a diagram showing an example of a display screen displayed on the communication terminal 60 that has received such notification information.
 このように、身体機能管理システム10は、蓄積した身体機能情報を、登録ユーザの要求に応じて配信することができる。 In this way, the physical function management system 10 can deliver the accumulated physical function information in response to the request of the registered user.
 [認証動作]
 上記登録動作によって登録された識別情報は、ドア41のロックを解除するための認証情報として使用することもできる。図8は、身体機能管理システム10の認証動作の概要を示す図である。図9は、身体機能管理システム10の認証動作のフローチャートである。
[Authentication operation]
The identification information registered by the registration operation can also be used as authentication information for unlocking the door 41. FIG. 8 is a diagram showing an outline of the authentication operation of the physical function management system 10. FIG. 9 is a flowchart of the authentication operation of the physical function management system 10.
 図8に示されるように、実施の形態では、撮像部20の1つ、及び、人検知部30は、ドアホンによって備えられている。ドアホンに人が近づくと、人検知部30はこれを検知する(S41)。管理装置50の認証処理部58は、撮像部20による動画の撮像を開始する(S42)。動画は、一時的に記憶部53に記憶される。 As shown in FIG. 8, in the embodiment, one of the image pickup units 20 and the person detection unit 30 are provided by a door phone. When a person approaches the door phone, the person detection unit 30 detects this (S41). The authentication processing unit 58 of the management device 50 starts imaging a moving image by the imaging unit 20 (S42). The moving image is temporarily stored in the storage unit 53.
 次に、認証処理部58は、記憶部53に記憶された動画を対象として顔画像認識処理を行うことにより動画に映る人の顔画像を特定し(S43)、特定した顔画像が、登録済み識別情報に含まれる顔画像と一致するか否かの判定を行う(S44)。認証処理部58によって、特定した顔画像が登録済み識別情報に含まれる顔画像と一致しないと判定された場合(S44でNo)、動作は終了となる。 Next, the authentication processing unit 58 identifies the face image of the person appearing in the moving image by performing the face image recognition processing on the moving image stored in the storage unit 53 (S43), and the specified face image is registered. It is determined whether or not the image matches the face image included in the identification information (S44). When the authentication processing unit 58 determines that the specified face image does not match the face image included in the registered identification information (No in S44), the operation ends.
 一方、認証処理部58は、特定した顔画像が、登録済み識別情報に含まれる顔画像と一致すると判定した場合(S44でYes)、ドア41のロックを解除するための解除信号を、第一通信部51に錠前装置40へ出力させる(S45)。これにより、ドア41のロックが解除される。 On the other hand, when the authentication processing unit 58 determines that the specified face image matches the face image included in the registered identification information (Yes in S44), the authentication processing unit 58 first issues a release signal for unlocking the door 41. The communication unit 51 is made to output to the lock device 40 (S45). As a result, the door 41 is unlocked.
 このように、身体機能管理システム10は、上記登録動作によって登録された識別情報を、ドア41のロックを解除するための認証情報として使用することもできる。なお、ステップS43及びステップS44では、顔画像に代えて、身体機能情報に基づく認証処理が行われてもよい。 As described above, the physical function management system 10 can also use the identification information registered by the above registration operation as the authentication information for unlocking the door 41. In steps S43 and S44, authentication processing based on physical function information may be performed instead of the face image.
 [効果等]
 以上説明したように、身体機能管理システム10は、人が被写体として映る動画を撮像する撮像部20と、撮像された動画に基づいて、人の身体機能情報、及び、人の識別情報を特定し、特定された身体機能情報及び特定された識別情報を紐づけて記憶部53に記憶する情報処理部52とを備える。
[Effects, etc.]
As described above, the physical function management system 10 identifies the human physical function information and the human identification information based on the image pickup unit 20 that captures the moving image of the person as the subject and the captured moving image. , The information processing unit 52 that stores the specified physical function information and the specified identification information in the storage unit 53 in association with each other.
 このような身体機能管理システム10は、動画に基づいて、人の身体機能情報、及び、人の識別情報の両方を特定することができるため、識別情報が手動入力される必要がない。つまり、身体機能管理システム10は、人の身体機能情報を効率的に管理することができる。 Since such a physical function management system 10 can identify both human physical function information and human identification information based on a moving image, it is not necessary to manually input the identification information. That is, the physical function management system 10 can efficiently manage human physical function information.
 また、例えば、情報処理部52は、人の身体機能情報として、人の歩容情報を特定し、特定された歩容情報及び特定された識別情報を紐づけて記憶部53に記憶する。 Further, for example, the information processing unit 52 identifies the person's gait information as the person's physical function information, and stores the specified gait information and the specified identification information in the storage unit 53 in association with each other.
 このような身体機能管理システム10は、人の歩容情報を管理することができる。 Such a physical function management system 10 can manage a person's gait information.
 また、例えば、記憶部53には、登録済み識別情報があらかじめ記憶される。情報処理部52は、特定された身体機能情報及び特定された識別情報を紐づけて記憶部53に一時的に記憶し、特定された識別情報が登録済み識別情報と一致する場合に、特定された身体機能情報を登録済み識別情報に紐づけて記憶部53に記憶する。 Further, for example, the registered identification information is stored in advance in the storage unit 53. The information processing unit 52 temporarily stores the specified physical function information and the specified identification information in the storage unit 53 in association with each other, and is specified when the specified identification information matches the registered identification information. The physical function information is associated with the registered identification information and stored in the storage unit 53.
 このような身体機能管理システム10は、識別情報が登録されている人の身体機能情報のみを選択的に管理することができる。 Such a physical function management system 10 can selectively manage only the physical function information of a person whose identification information is registered.
 また、例えば、身体機能管理システム10は、さらに、通信端末60と通信する第二通信部54を備える。情報処理部52は、通信端末60に入力された識別情報が登録済み識別情報と一致する場合に、記憶部53において登録済み識別情報に紐づけられた、身体機能情報を、第二通信部54に通信端末60へ送信させる。 Further, for example, the physical function management system 10 further includes a second communication unit 54 that communicates with the communication terminal 60. When the identification information input to the communication terminal 60 matches the registered identification information, the information processing unit 52 transfers the physical function information associated with the registered identification information in the storage unit 53 to the second communication unit 54. To transmit to the communication terminal 60.
 このような身体機能管理システム10は、記憶(蓄積)した身体機能情報を、通信端末60を操作する人に提供することができる。 Such a physical function management system 10 can provide the stored (stored) physical function information to the person who operates the communication terminal 60.
 また、例えば、撮像部20は、ドア41が設けられた閉空間の外部を撮像し、情報処理部52は、特定された識別情報が登録済み識別情報と一致する場合に、ドア41のロックを解除するための解除信号を出力する。 Further, for example, the imaging unit 20 images the outside of the closed space provided with the door 41, and the information processing unit 52 locks the door 41 when the identified identification information matches the registered identification information. Outputs a release signal for release.
 このような身体機能管理システム10は、識別情報が登録されている人が撮像部20によって撮像されたときに、ドア41のロックを解除することができる。 Such a physical function management system 10 can unlock the door 41 when a person whose identification information is registered is imaged by the imaging unit 20.
 また、例えば、身体機能管理システム10は、さらに、人検知部30を備え、情報処理部52は、人検知部30によって人が検知されたことをトリガとして撮像部20に動画の撮像を開始させる。 Further, for example, the physical function management system 10 further includes a person detection unit 30, and the information processing unit 52 causes the image pickup unit 20 to start capturing a moving image triggered by the detection of a person by the person detection unit 30. ..
 このような身体機能管理システム10は、必要なときのみ撮像部20を動作させることができるため、撮像部20の消費電力を低減することができる。 Since such a physical function management system 10 can operate the imaging unit 20 only when necessary, the power consumption of the imaging unit 20 can be reduced.
 また、例えば、情報処理部52は、撮像部20によって撮像された動画に基づいて人を検知する。 Further, for example, the information processing unit 52 detects a person based on the moving image captured by the imaging unit 20.
 このような身体機能管理システム10は、センサなどを用いずに画像によって人を検知することができる。 Such a physical function management system 10 can detect a person by an image without using a sensor or the like.
 また、例えば、識別情報は、人の顔の部分の画像情報(つまり、顔画像)である。 Also, for example, the identification information is image information (that is, a face image) of a human face part.
 このような身体機能管理システム10は、動画から得られる人の顔画像を識別情報として使用することができる。 Such a physical function management system 10 can use a human face image obtained from a moving image as identification information.
 また、例えば、識別情報は、身体機能情報の少なくとも一部である。 Also, for example, the identification information is at least a part of the physical function information.
 このような身体機能管理システム10は、動画から得られる人の身体機能情報の少なくとも一部を識別情報として使用することができる。 Such a physical function management system 10 can use at least a part of a person's physical function information obtained from a moving image as identification information.
 また、身体機能管理システム10などのコンピュータによって実行される身体機能管理方法は、人が被写体として映る動画を撮像し、撮像された動画に基づいて、人の身体機能情報、及び、人の識別情報を特定し、特定された身体機能情報及び特定された識別情報を紐づけて記憶部53に記憶する。 In addition, the physical function management method executed by a computer such as the physical function management system 10 captures a moving image of a person as a subject, and based on the captured moving image, the physical function information of the person and the identification information of the person. Is specified, and the specified physical function information and the specified identification information are linked and stored in the storage unit 53.
 このような身体機能管理方法は、動画に基づいて、人の身体機能情報、及び、人の識別情報の両方を特定することができるため、識別情報が手動入力される必要がない。つまり、身体機能管理方法は、人の歩容情報を効率的に管理することができる。 In such a physical function management method, both the physical function information of a person and the identification information of a person can be specified based on a moving image, so that the identification information does not need to be manually input. That is, the physical function management method can efficiently manage the gait information of a person.
 (その他の実施の形態)
 以上、実施の形態に係る身体機能管理システム及び身体機能管理方法について説明したが、本発明は、上記実施の形態に限定されるものではない。
(Other embodiments)
Although the physical function management system and the physical function management method according to the embodiment have been described above, the present invention is not limited to the above embodiment.
 例えば、上記実施の形態では、識別情報として顔画像及び歩容情報の一部が併用されたが、識別情報としては顔画像及び歩容情報の少なくとも一方が用いられればよい。 For example, in the above embodiment, a part of the face image and the gait information is used together as the identification information, but at least one of the face image and the gait information may be used as the identification information.
 また、上記実施の形態では、撮像部は屋外に設置されると説明されたが、屋内に設置されてもよい。また、撮像部は、介護施設、または、公共機関などの住宅以外の建物に設置されてもよいし、電柱などに設置されてもよい。 Further, in the above embodiment, it has been explained that the imaging unit is installed outdoors, but it may be installed indoors. Further, the imaging unit may be installed in a building other than a house such as a nursing care facility or a public institution, or may be installed in a utility pole or the like.
 また、上記実施の形態では、身体機能管理システムは、複数の装置によって実現されたが、単一の装置として実現されてもよい。身体機能管理システムが複数の装置によって実現される場合、身体機能管理システムが備える各構成要素は、複数の装置にどのように振り分けられてもよい。 Further, in the above embodiment, the physical function management system is realized by a plurality of devices, but it may be realized as a single device. When the physical function management system is realized by a plurality of devices, each component of the physical function management system may be distributed to the plurality of devices in any way.
 また、上記実施の形態において、各構成要素は、専用のハードウェアで構成されるか、各構成要素に適したソフトウェアプログラムを実行することによって実現されてもよい。各構成要素は、CPUまたはプロセッサなどのプログラム実行部が、ハードディスクまたは半導体メモリなどの記録媒体に記録されたソフトウェアプログラムを読み出して実行することによって実現されてもよい。 Further, in the above embodiment, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.
 また、各構成要素は、回路(または集積回路)でもよい。これらの回路は、全体として1つの回路を構成してもよいし、それぞれ別々の回路でもよい。また、これらの回路は、それぞれ、汎用的な回路でもよいし、専用の回路でもよい。 Further, each component may be a circuit (or an integrated circuit). These circuits may form one circuit as a whole, or may be separate circuits from each other. Further, each of these circuits may be a general-purpose circuit or a dedicated circuit.
 また、本発明の全般的または具体的な態様は、システム、装置、方法、集積回路、コンピュータプログラムまたはコンピュータ読み取り可能なCD-ROMなどの記録媒体で実現されてもよい。また、システム、装置、方法、集積回路、コンピュータプログラム及び記録媒体の任意な組み合わせで実現されてもよい。例えば、本発明は、上記実施の形態の身体機能管理方法をコンピュータに実行させるためのプログラムとして実現されてもよいし、このようなプログラムが記憶された、コンピュータ読み取り可能な非一時的な記録媒体として実現されてもよい。 Further, general or specific aspects of the present invention may be realized by a recording medium such as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable CD-ROM. Further, it may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program and a recording medium. For example, the present invention may be realized as a program for causing a computer to execute the physical function management method of the above embodiment, or a computer-readable non-temporary recording medium in which such a program is stored. It may be realized as.
 また、上記実施の形態において説明された動作例のフローチャートにおける複数の処理の順序は一例である。複数の処理の順序は、変更されてもよいし、複数の処理は、並行して実行されてもよい。また、特定の処理部が実行する処理を別の処理部が実行してもよい。 Further, the order of a plurality of processes in the flowchart of the operation example described in the above embodiment is an example. The order of the plurality of processes may be changed, and the plurality of processes may be executed in parallel. Further, another processing unit may execute the processing executed by the specific processing unit.
 その他、各実施の形態に対して当業者が思いつく各種変形を施して得られる形態、または、本発明の趣旨を逸脱しない範囲で各実施の形態における構成要素及び機能を任意に組み合わせることで実現される形態も本発明に含まれる。 In addition, it is realized by applying various modifications to each embodiment that can be conceived by those skilled in the art, or by arbitrarily combining the components and functions in each embodiment without departing from the spirit of the present invention. The form is also included in the present invention.
 10 身体機能管理システム
 20 撮像部
 30 人検知部
 52 情報処理部
 53 記憶部
 54 第二通信部
 60 通信端末
10 Physical function management system 20 Imaging unit 30 Human detection unit 52 Information processing unit 53 Storage unit 54 Second communication unit 60 Communication terminal

Claims (11)

  1.  人が被写体として映る動画を撮像する撮像部と、
     撮像された前記動画に基づいて、前記人の身体機能情報、及び、前記人の識別情報を特定し、特定された前記身体機能情報及び特定された前記識別情報を紐づけて記憶部に記憶する情報処理部とを備える
     身体機能管理システム。
    An imaging unit that captures a moving image of a person as a subject,
    Based on the captured moving image, the physical function information of the person and the identification information of the person are specified, and the specified physical function information and the specified identification information are linked and stored in the storage unit. A physical function management system equipped with an information processing department.
  2.  前記情報処理部は、
     前記人の身体機能情報として、前記人の歩容情報を特定し、
     特定された前記歩容情報及び特定された前記識別情報を紐づけて前記記憶部に記憶する
     請求項1に記載の身体機能管理システム。
    The information processing unit
    As the physical function information of the person, the gait information of the person is specified,
    The physical function management system according to claim 1, wherein the specified gait information and the specified identification information are linked and stored in the storage unit.
  3.  前記記憶部には、登録済み識別情報があらかじめ記憶され、
     前記情報処理部は、
     特定された前記身体機能情報及び特定された前記識別情報を紐づけて前記記憶部に一時的に記憶し、
     特定された前記識別情報が前記登録済み識別情報と一致する場合に、特定された前記身体機能情報を前記登録済み識別情報に紐づけて前記記憶部に記憶する
     請求項1または2に記載の身体機能管理システム。
    Registered identification information is stored in advance in the storage unit.
    The information processing unit
    The identified physical function information and the identified identification information are linked and temporarily stored in the storage unit.
    The body according to claim 1 or 2, wherein when the identified identification information matches the registered identification information, the identified physical function information is associated with the registered identification information and stored in the storage unit. Function management system.
  4.  さらに、通信端末と通信する通信部を備え、
     前記情報処理部は、前記通信端末に入力された識別情報が前記登録済み識別情報と一致する場合に、前記記憶部において前記登録済み識別情報に紐づけられた、前記身体機能情報を、前記通信部に前記通信端末へ送信させる
     請求項3に記載の身体機能管理システム。
    In addition, it is equipped with a communication unit that communicates with communication terminals.
    When the identification information input to the communication terminal matches the registered identification information, the information processing unit communicates the physical function information associated with the registered identification information in the storage unit. The physical function management system according to claim 3, wherein the unit is made to transmit to the communication terminal.
  5.  前記撮像部は、ドアが設けられた閉空間の外部を撮像し、
     前記情報処理部は、特定された前記識別情報が前記登録済み識別情報と一致する場合に、前記ドアのロックを解除するための解除信号を出力する
     請求項3または4に記載の身体機能管理システム。
    The imaging unit captures the outside of a closed space provided with a door.
    The physical function management system according to claim 3 or 4, wherein the information processing unit outputs a release signal for unlocking the door when the identified identification information matches the registered identification information. ..
  6.  さらに、人検知部を備え、
     前記情報処理部は、前記人検知部によって前記人が検知されたことをトリガとして前記撮像部に前記動画の撮像を開始させる
     請求項1~5のいずれか1項に記載の身体機能管理システム。
    In addition, it is equipped with a person detection unit.
    The physical function management system according to any one of claims 1 to 5, wherein the information processing unit causes the imaging unit to start imaging the moving image when the person is detected by the person detecting unit.
  7.  前記情報処理部は、前記撮像部によって撮像された動画に基づいて前記人を検知する
     請求項1~6のいずれか1項に記載の身体機能管理システム。
    The physical function management system according to any one of claims 1 to 6, wherein the information processing unit detects the person based on a moving image captured by the imaging unit.
  8.  前記識別情報は、前記人の顔の部分の画像情報である
     請求項1~7のいずれか1項に記載の身体機能管理システム。
    The physical function management system according to any one of claims 1 to 7, wherein the identification information is image information of a face portion of the person.
  9.  前記識別情報は、前記身体機能情報の少なくとも一部である
     請求項1~7のいずれか1項に記載の身体機能管理システム。
    The physical function management system according to any one of claims 1 to 7, wherein the identification information is at least a part of the physical function information.
  10.  コンピュータによって実行される身体機能管理方法であって、
     人が被写体として映る動画を撮像し、
     撮像された前記動画に基づいて、前記人の身体機能情報、及び、前記人の識別情報を特定し、
     特定された前記身体機能情報及び特定された前記識別情報を紐づけて記憶部に記憶する
     身体機能管理方法。
    A method of managing physical function performed by a computer
    I took a video of a person as a subject and
    Based on the captured moving image, the physical function information of the person and the identification information of the person are specified.
    A physical function management method of associating the specified physical function information and the specified identification information and storing them in a storage unit.
  11.  請求項10に記載の身体機能管理方法をコンピュータに実行させるためのプログラム。 A program for causing a computer to execute the physical function management method according to claim 10.
PCT/JP2020/004270 2019-04-09 2020-02-05 Body function management system, and body function management method WO2020208917A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021513182A JP7304531B2 (en) 2019-04-09 2020-02-05 PHYSICAL FUNCTION MANAGEMENT SYSTEM AND PHYSICAL FUNCTION MANAGEMENT METHOD

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-074281 2019-04-09
JP2019074281 2019-04-09

Publications (1)

Publication Number Publication Date
WO2020208917A1 true WO2020208917A1 (en) 2020-10-15

Family

ID=72751988

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/004270 WO2020208917A1 (en) 2019-04-09 2020-02-05 Body function management system, and body function management method

Country Status (2)

Country Link
JP (1) JP7304531B2 (en)
WO (1) WO2020208917A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022138584A1 (en) * 2020-12-21 2022-06-30 株式会社リヴァンプ Information processing device, information processing method, and program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007202869A (en) * 2006-02-02 2007-08-16 Masahide Tanaka Personal identification and health control system
JP2011215122A (en) * 2010-03-17 2011-10-27 Kyokko Denki Kk Object detector
US20130289449A1 (en) * 2012-04-27 2013-10-31 The Curators Of The University Of Missouri Activity analysis, fall detection and risk assessment systems and methods
JP2018106435A (en) * 2016-12-27 2018-07-05 清水建設株式会社 Labor Management System
JP2019049786A (en) * 2017-09-08 2019-03-28 株式会社日立ビルシステム Personal identification system and personal identification method
JP2019124012A (en) * 2018-01-12 2019-07-25 ナブテスコ株式会社 Automatic door

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5370927B2 (en) 2007-08-21 2013-12-18 日本電気株式会社 Behavior monitoring system and behavior monitoring method
JP6336709B2 (en) 2013-03-29 2018-06-06 綜合警備保障株式会社 Security device, security method and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007202869A (en) * 2006-02-02 2007-08-16 Masahide Tanaka Personal identification and health control system
JP2011215122A (en) * 2010-03-17 2011-10-27 Kyokko Denki Kk Object detector
US20130289449A1 (en) * 2012-04-27 2013-10-31 The Curators Of The University Of Missouri Activity analysis, fall detection and risk assessment systems and methods
JP2018106435A (en) * 2016-12-27 2018-07-05 清水建設株式会社 Labor Management System
JP2019049786A (en) * 2017-09-08 2019-03-28 株式会社日立ビルシステム Personal identification system and personal identification method
JP2019124012A (en) * 2018-01-12 2019-07-25 ナブテスコ株式会社 Automatic door

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022138584A1 (en) * 2020-12-21 2022-06-30 株式会社リヴァンプ Information processing device, information processing method, and program
WO2022138585A1 (en) * 2020-12-21 2022-06-30 株式会社リヴァンプ Information processing device, information processing method, and program

Also Published As

Publication number Publication date
JP7304531B2 (en) 2023-07-07
JPWO2020208917A1 (en) 2021-12-02

Similar Documents

Publication Publication Date Title
US10909355B2 (en) Systems and methods for efficient face recognition
US10855957B2 (en) Wireless augmented video system and method to detect and prevent insurance billing fraud and physical assault for remote mobile application
CN109479181B (en) System and method for user detection and identification
JP2018120644A (en) Identification apparatus, identification method, and program
JP2018023768A (en) Subject identification method, subject identification system, blood pressure measurement state determination method, blood pressure measurement state determination device, and blood pressure measurement state determination program
JP6199270B2 (en) Measurement information recording system and measurement information recording method
JP2016038774A (en) Person identification apparatus
WO2017183602A1 (en) Monitoring-subject monitoring system and method for monitoring subject
CN114269243A (en) Fall risk evaluation system
WO2020208917A1 (en) Body function management system, and body function management method
JP2019091395A (en) Information processing device, monitoring system, control method, and program
KR101434899B1 (en) Daily life health information providing system and method of providing daily life health information
JP7183788B2 (en) Behavior determination device and behavior determination method
JP6922768B2 (en) Information processing device
JP7113274B2 (en) Lower limb muscle strength estimation system, lower limb muscle strength estimation method, and program
WO2018021215A1 (en) Subject of measurement identification method, subject of measurement identification system, blood pressure measurement state determination method, blood pressure measurement state determination device, and blood pressure measurement state determination program
JP2021114021A (en) Method of providing information supporting rehabilitation and rehabilitation supporting system
JP2021190051A (en) Behavior body identification system
WO2020208900A1 (en) Recommendation system, and recommendation method
JP7446806B2 (en) Information processing device, method and program
JP2021015497A (en) Control device, control program, and control method
US10970988B2 (en) Information processing apparatus, information processing system, method, and program
JP2023183537A (en) Information processing apparatus, program, computer-readable recording medium, information processing system, and information processing method
JP2023108852A (en) Display device, display system, display method, and display program
JP2021197072A (en) Control program, arithmetic device, control system, and control method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20786898

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021513182

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20786898

Country of ref document: EP

Kind code of ref document: A1