WO2024070918A1 - Terminal device, terminal device control method and program - Google Patents

Terminal device, terminal device control method and program Download PDF

Info

Publication number
WO2024070918A1
WO2024070918A1 PCT/JP2023/034417 JP2023034417W WO2024070918A1 WO 2024070918 A1 WO2024070918 A1 WO 2024070918A1 JP 2023034417 W JP2023034417 W JP 2023034417W WO 2024070918 A1 WO2024070918 A1 WO 2024070918A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
imaging
terminal device
measured
control unit
Prior art date
Application number
PCT/JP2023/034417
Other languages
French (fr)
Japanese (ja)
Inventor
昌彦 夏目
幸知 赤木
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Publication of WO2024070918A1 publication Critical patent/WO2024070918A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection

Definitions

  • the present invention relates to a terminal device and a method for controlling the terminal device.
  • non-contact vital sensing that detects the biometric information of a person being measured based on an image of the person being measured.
  • biometric information the person being measured, the measured biometric information, and information on the person who performed the measurement are associated and managed.
  • Information on the person who performed the measurement is also used, for example, to identify close contacts of a person with an infectious disease.
  • Patent Document 1 discloses a mobile device that, when the rear camera is on, recognizes a gesture of waving a hand up and down and switches the camera that is set to be on from the rear camera to the front camera. Generally, when switching the active camera on a mobile device, as in the mobile device of Patent Document 1, a switching operation by the user is required.
  • the biometric information of the person being measured may be measured using a terminal device equipped with a front camera and a rear camera.
  • the terminal device can photograph the person being measured using the rear camera and the person being measured using the front camera.
  • the terminal device can identify the person being measured from the photographed image of the person being measured.
  • the person taking the measurement must (1) take a picture of himself/herself with the front camera, and after the terminal device identifies the person being measured, (2) actively switch the rear camera to the rear camera, and (3) take a picture of the person being measured with the rear camera.
  • this operation increases the time required for the measurement and can be a burden for the person being measured.
  • One aspect of the present invention is to provide a terminal device that appropriately acquires information on the person being measured and the person measuring, while reducing the burden on the person measuring.
  • a terminal device includes a first image capturing device, a second image capturing device that captures an image in a different direction from that of the first image capturing device, a first processing unit that identifies the person being measured using the captured image obtained from the first image capturing device, a second processing unit that measures biometric information of the person being measured using the captured image obtained from the second image capturing device, and an image capturing control unit that automatically switches the second image capturing device to active when processing by the first processing unit is successful, or automatically switches the first image capturing device to active when processing by the second processing unit is successful.
  • a control method for a terminal device is a control method for a terminal device equipped with a first image capturing device and a second image capturing device that captures an image in a different direction from that of the first image capturing device, and includes a first processing step of identifying a person being measured using an image captured by the first image capturing device, a second processing step of measuring biometric information of a person being measured using an image captured by the second image capturing device, and an image capturing control step of automatically switching the second image capturing device to active when the processing by the first processing step is successful, or automatically switching the first image capturing device to active when the processing by the second processing step is successful.
  • FIG. 1 is a block diagram showing a schematic configuration of a terminal device according to an embodiment of the present invention
  • 1 is a front view showing a configuration of a terminal device according to an embodiment of the present invention
  • FIG. 2 is a rear view showing the configuration of a terminal device according to an embodiment of the present invention.
  • FIG. 4 is a flowchart showing an example of the operation of the terminal device.
  • FIG. 4 is a flowchart showing an example of the operation of the terminal device.
  • FIG. 4 is a flowchart showing an example of an operation of the terminal device.
  • FIG. 1 is a block diagram showing a schematic configuration of a terminal device 100 according to the present embodiment.
  • the terminal device 100 includes a first image capturing device 1, a second image capturing device 2, an input device 3, a display device 4, a communication device 5, a storage device 6, and a control unit 10.
  • the terminal device 100 is a device used to measure the biological information of a subject based on a captured image of the subject (i.e., non-contact). Examples of biological information include, but are not limited to, the subject's blood pressure, pulse rate, etc.
  • the terminal device 100 may be any device that has an image acquisition function and an image display function, and may be, for example, a smartphone or a tablet terminal.
  • the person measuring the subject uses the terminal device 100 to measure the biometric information of the subject by continuing to photograph the subject while checking an image including the subject displayed on the screen of the display device 4.
  • a terminal device 100 is used, for example, in a care setting when a caregiver (measurer) measures the biometric information of a person being cared for (person being measured).
  • each function of the terminal device 100 described below can also be realized by installing a program on a general-purpose computer.
  • the above program can also be called application software.
  • the terminal device 100 is a smartphone on which the above program is installed.
  • FIG. 2 is a front view showing the configuration of the terminal device 100 according to this embodiment.
  • FIG. 3 is a rear view showing the configuration of the terminal device 100 according to this embodiment.
  • the terminal device 100 has a plate-like rectangular parallelepiped shape and has a first surface (front side) and a second surface (back side) opposite the first surface.
  • the first imaging device 1 is disposed on the first surface of the terminal device 100.
  • the second imaging device 2 is disposed on the second surface of the terminal device 100.
  • the first imaging device captures an image in a first direction (front side) and outputs image data to the control unit 10.
  • the second imaging device 2 captures an image in a direction different from that of the first imaging device (back side) and outputs captured image data to the control unit 10.
  • the input device 3 accepts user input operations on the terminal device 100.
  • the input device 3 outputs instructions indicated by the accepted input operations to the control unit 10.
  • the input device 3 is arranged on the first surface. However, this is not limited to this, and the input device 3 may be arranged on a surface other than the first surface, such as the back or side.
  • the display device 4 has a screen, and displays images captured by the first imaging device 1 and the second imaging device 2 on the screen.
  • the display device 4 is arranged on the first surface.
  • the input device 3 and the display device 4 may be integrated into a touch panel. In the following, an example of a configuration in which the input device 3 and the display device 4 are integrated into a touch panel will be used for explanation.
  • the person being measured is on the front side, where the first image capturing device 1 captures, and has the input device 3 and display device 4 to operate the terminal device 100.
  • the person being measured is included in the captured image obtained from the first image capturing device 1.
  • the person being measured is on the back side, where the second image capturing device 2 captures, as the person being measured is being photographed by the person being measured.
  • the image obtained from the second image capturing device 2 includes the person being measured.
  • the communication device 5 transmits and receives various data between an external communication device (e.g., a server) and the control unit 10.
  • an external communication device e.g., a server
  • the storage device 6 stores various data handled by the terminal device 100.
  • the storage device 6 stores image features of multiple pre-registered candidate measurers in association with information (such as names or identifiers) of the multiple candidate measurers.
  • the storage device 6 also stores image features of multiple pre-registered candidate subjects in association with information (such as names or identifiers) of the multiple candidate subject subjects.
  • the control unit 10 controls each unit of the terminal device 100.
  • the control unit 10 also executes application software (hereinafter referred to as application) that measures biometric information.
  • the control unit 10 includes an imaging control unit 11, a display control unit 12, a measurement unit 13 (second processing unit), a first identification unit 14 (first processing unit), a second identification unit 15 (second processing unit), and an operation input unit 16.
  • the imaging control unit 11 controls the first imaging device 1 and the second imaging device 2.
  • the imaging control unit 11 activates one of the first imaging device 1 and the second imaging device 2.
  • the imaging control unit 11 activates one of the first imaging device 1 and the second imaging device 2 by starting it.
  • the imaging control unit 11 receives imaging image data from the active imaging device.
  • the imaging control unit 11 outputs the imaging image data received from the active imaging device to the display control unit 12.
  • the imaging control unit 11 also outputs the imaging image data received from the active first imaging device 1 to the first identification unit 14.
  • the imaging control unit 11 outputs the imaging image data received from the active second imaging device 2 to the measurement unit 13 and the second identification unit 15.
  • the imaging control unit 11 also associates the measurement results of the biological information, the information of the identified subject, and the information of the identified person being measured with each other, and stores them in the storage device 6 or may transmit them to an external server.
  • the display control unit 12 controls the display device 4.
  • the display control unit 12 causes the display device 4 to display images including images captured by the active imaging device.
  • the display control unit 12 also causes the display device 4 to display the measurement results of the biometric information, information on the identified person being measured, and information on the identified person being measured.
  • the first identification unit 14 constitutes a first processing unit that performs processing using the captured image obtained from the first imaging device 1.
  • the second identification unit 15 and the measurement unit 13 constitute a second processing unit that performs processing using the captured image obtained from the second imaging device 2.
  • the measurement unit 13 measures the biometric information of the subject using the captured image obtained from the second image capture device 2.
  • the measurement unit 13 measures the biometric information of the subject based on an image of a specific part of the subject in the captured image (such as a face image, hand image, or foot image).
  • a known technique can be used to measure the biometric information based on an image of the specific part.
  • the measurement unit 13 calculates the biometric information using a judgment table corresponding to the specific part based on image data of the specific part (such as color information).
  • the judgment table includes parameters used in a judgment formula for calculating the biometric information from the image data of the specific part.
  • the captured image may be a video of the subject or a still image of the subject.
  • the measurement unit 13 may obtain a video as the captured image from the imaging control unit 11 when performing a measurement based on a change in the subject, and may obtain a still image as the captured image when performing a measurement not based on a change in the subject.
  • the measurement unit 13 outputs the biometric information of the subject to the display control unit 12.
  • the measurement unit 13 also notifies the imaging control unit 11 that the measurement of the biometric information of the subject has been successful.
  • an external server may calculate the biometric information of the person being measured instead of the measurement unit 13.
  • the measurement unit 13 transmits a captured image including the person being measured to the external server via the communication device 5.
  • the external server calculates the biometric information based on the captured image including the person being measured.
  • the measurement unit 13 obtains the biometric information, which is the calculation result, from the external server. In this way, the measurement unit 13 may measure the biometric information by using an external server.
  • the second processing unit may be configured as the measurement unit 13 that obtains the biometric information by using an external server.
  • the first identification unit 14 identifies the person who took the measurement using the captured image obtained from the first photographing device 1. For example, the first identification unit 14 identifies the person who took the measurement by comparing the feature amount of the person obtained from the captured image with the feature amount of the candidate person who has been registered in advance. The first identification unit 14 acquires the feature amounts of the images of the multiple candidate people from the storage device 6. The first identification unit 14 identifies the person who took the measurement included in the captured image obtained from the first photographing device 1 using the captured image obtained from the first photographing device 1 and the feature amounts of the images of the multiple candidate people. The first identification unit 14 outputs information about the identified person who took the measurement (such as a name or an identifier) to the photographing control unit 11.
  • information about the identified person who took the measurement such as a name or an identifier
  • the second identification unit 15 identifies the person being measured using the captured image obtained from the second imaging device 2. For example, the second identification unit 15 identifies the person being measured by comparing the feature amounts of the person obtained from the captured image with the feature amounts of the candidate person registered in advance. The second identification unit 15 acquires the feature amounts of the images of the multiple candidate people from the storage device 6. The second identification unit 15 identifies the person being measured included in the captured image obtained from the second imaging device 2 using the captured image obtained from the second imaging device 2 and the feature amounts of the images of the multiple candidate people. The second identification unit 15 outputs information about the identified person being measured (such as name or identifier) to the imaging control unit 11.
  • the identified person being measured such as name or identifier
  • the first identification unit 14 or the second identification unit 15 may acquire image features of multiple candidate measurers, image features of multiple candidate subjects, information on the measurers, or information on the subjects from an external server via the communication device 5.
  • the first identification unit 14 or the second identification unit 15 may transmit a captured image including the person being measured or a captured image including the person being measured to an external server via the communication device 5.
  • the first identification unit 14 or the second identification unit 15 may acquire information on the person being measured identified by the external server or information on the person being measured identified by the external server from the external server. In this way, the first identification unit 14 or the second identification unit 15 may identify the person being measured or the person being measured by using an external server.
  • the first processing unit may be configured with the first identification unit 14 that identifies the person being measured using an external server.
  • the second processing unit may be configured with the second identification unit 15 that identifies the person being measured using an external server.
  • the operation input unit 16 receives instructions indicated by input operations from the input device 3. For example, the operation input unit 16 receives instructions to start an application that measures biometric information, instructions to end an application, and instructions such as zooming in/zooming out. When the operation input unit 16 receives an instruction to start/end an application, it starts/ends the application. When the operation input unit 16 receives an instruction to zoom in/zoom out, it outputs the instruction to the imaging control unit 11, and the imaging control unit 11 controls the zoom of the active imaging device.
  • FIG. 4 is a diagram showing a flowchart showing an example of the operation of the terminal device 100.
  • the subject first operates the input device 3 to start an application for measuring biological information.
  • the operation input unit 16 starts the application according to the instruction indicated by the input operation (S1).
  • the photographing control unit 11 automatically activates the first photographing device 1 (S2).
  • the display control unit 12 displays the photographed image obtained from the active first photographing device 1 on the display device 4.
  • the first identification unit 14 automatically starts identifying the subject (S3).
  • the first identification unit 14 performs a process of identifying the subject using the photographed image obtained from the first photographing device 1.
  • the first identification unit 14 repeats the process until the subject can be identified.
  • the term “automatically” means "without the need for input operation by the user.”
  • the first identification unit 14 When the process of identifying the person by the first identification unit 14 is successful (completed) (S4), the first identification unit 14 notifies the imaging control unit 11 that the person has been successfully identified and provides information about the identified person.
  • the imaging control unit 11 causes the display device 4 to display the information about the identified person via the display control unit 12.
  • the imaging control unit 11 automatically switches the second imaging device 2 to active (S5). Meanwhile, the imaging control unit 11 automatically makes the first imaging device 1 inactive (stopped state).
  • the display control unit 12 causes the display device 4 to display the captured image obtained from the second imaging device 2.
  • the second identification unit 15 automatically starts identifying the person being measured (S6).
  • the second identification unit 15 performs a process of identifying the person being measured using the captured image obtained from the second image capturing device 2.
  • the second identification unit 15 repeats the process until the person being measured can be identified.
  • the imaging control unit 11 When the process of identifying the subject by the second identification unit 15 is successful (completed) (S7), the imaging control unit 11 is notified that the subject has been successfully identified and of the information of the identified subject. The imaging control unit 11 causes the display device 4 to display the information of the identified subject via the display control unit 12.
  • the measurement unit 13 automatically starts measuring the biometric information of the person being measured (S8).
  • the measurement unit 13 performs a process of measuring the biometric information of the person being measured using the captured image obtained from the second imaging device 2. If the process of measuring the biometric information is successful (S9), the display control unit 12 causes the display device 4 to display the measurement results of the biometric information of the person being measured (S10). At this time, the display control unit 12 may also cause the display device 4 to display information about the person measuring and the person being measured.
  • the operation input unit 16 ends the application.
  • FIG. 5 is a diagram showing a flowchart showing an example of the operation of the terminal device 100.
  • the same processes as those in the above-mentioned operation example are given the same reference numerals, and detailed description thereof will be omitted.
  • the operation input unit 16 starts an application according to the instruction indicated by the input operation (S1).
  • the photographing control unit 11 automatically activates the second photographing device 2 (S21).
  • the display control unit 12 displays the photographed image obtained from the active second photographing device 2 on the display device 4.
  • the second identification unit 15 automatically starts identifying the subject (S6).
  • the measurement unit 13 automatically starts measuring the subject's biological information (S8).
  • the imaging control unit 11 When the process of measuring the biometric information by the measurement unit 13 is successful (completed) (S9), the imaging control unit 11 automatically switches the first imaging device 1 to active (S22). On the other hand, the imaging control unit 11 automatically makes the second imaging device 2 inactive (stopped state). As a result, the display control unit 12 causes the display device 4 to display the captured image obtained from the first imaging device 1.
  • the first identification unit 14 automatically starts identifying the person being measured (S3).
  • the display control unit 12 causes the display device 4 to display the measurement results of the subject's biometric information, etc. (S10).
  • FIG. 6 is a diagram showing a flowchart showing an example of the operation of the terminal device 100.
  • the same processes as those in the above-mentioned operation examples are given the same reference numerals, and detailed description thereof is omitted.
  • Operation example 3 is an example in which the order of the process of identifying the subject (S6, S7) and the process of measuring biological information (S8, S9) in operation example 2 is reversed.
  • the operation input unit 16 starts an application according to the instruction indicated by the input operation (S1).
  • the imaging control unit 11 automatically activates the second imaging device 2 (S21).
  • the display control unit 12 displays the captured image obtained from the active second imaging device 2 on the display device 4.
  • the measurement unit 13 automatically starts measuring the biological information of the subject (S8).
  • the second identification unit 15 automatically starts identifying the subject (S6).
  • the imaging control unit 11 automatically switches the first imaging device 1 to active (S31).
  • the subsequent operations are the same as those in operation example 2.
  • the active photographing device can be automatically switched without the need for user operation, and the person being measured, the person being measured, and the biometric information of the person being measured can be identified.
  • the person being measured who is the user, only needs to hold the terminal device 100 so that the person being measured appears on the display device 4 (so that the person being measured is photographed) while the first photographing device 1 on the person being measured is active.
  • the person being measured only needs to hold the terminal device 100 so that the person being measured appears on the display device 4 (so that the person being measured is photographed) while the second photographing device 2 on the person being measured is active.
  • the person being measured does not need to perform input operations to switch between the processes of identifying the person being measured, identifying the person being measured, and measuring the biometric information of the person being measured. Therefore, the person being measured can concentrate on photographing, and the burden on the person being measured for measuring the biometric information is reduced. In addition, the overall processing time required for measuring the biometric information can be shortened. Therefore, the burden on the person being measured, who needs to maintain a constant posture during photographing, is also reduced. As a result, the failure in measuring the biometric information can be reduced. For example, in nursing care settings, a small number of people need to measure the vital signs of many subjects, so even a small reduction in processing time can lead to a significant reduction in the burden.
  • the terminal device 100 of this embodiment can appropriately perform non-contact vital sensing while reducing the burden on the person measuring and the person being measured. This effect also contributes to the achievement of, for example, Goal 3 of the Sustainable Development Goals (SDGs) advocated by the United Nations, "Ensure good health and well-being for all.”
  • SDGs Sustainable Development Goals
  • the photographing control unit 11 activates the photographing device to be active and stops the photographing device to be inactive, but this is not limited thereto.
  • the photographing control unit 11 may activate both the first photographing device 1 and the second photographing device 2.
  • the photographing control unit 11 may display the photographed image obtained from the photographing device to be active on the display device 4, and may not display the photographed image obtained from the photographing device to be inactive on the display device 4.
  • the process of switching the photographing device to be active may be to switch the photographed image to be displayed on the display device 4 and the photographed image to be used for processing between the photographed image obtained from the first photographing device 1 and the photographed image obtained from the second photographing device 2.
  • the functions of the terminal device 100 are realized by a program for causing a computer to function as the device, and by a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 10).
  • the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program.
  • control device e.g., a processor
  • storage device e.g., a memory
  • the program may be recorded on one or more computer-readable recording media, not on a temporary basis.
  • the recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.
  • each of the above control blocks can be realized by a logic circuit.
  • a logic circuit for example, an integrated circuit in which a logic circuit that functions as each of the above control blocks is formed is also included in the scope of the present invention.
  • each process described in each of the above embodiments may be executed by AI (Artificial Intelligence).
  • AI Artificial Intelligence
  • the AI may run on the control device, or may run on another device (such as an edge computer or a cloud server).
  • a terminal device comprises a first imaging device, a second imaging device that captures an image in a different direction from that of the first imaging device, a first processing unit that identifies a person to be measured using an image captured by the first imaging device, a second processing unit that measures biometric information of a person to be measured using an image captured by the second imaging device, and an imaging control unit that automatically switches the second imaging device to active when processing by the first processing unit is successful, or automatically switches the first imaging device to active when processing by the second processing unit is successful.
  • the terminal device when the terminal device has successfully (completed) processing using the captured image obtained from either the first or second imaging device, it automatically switches to active the other. Therefore, there is no need for the user to switch between the imaging devices.
  • This makes it possible to smoothly identify the person being measured who is located on the first imaging device side and measure the biometric information of the person being measured who is located on the second imaging device side. Therefore, the total time required for measuring the biometric information of the person being measured can be shortened. Furthermore, by shortening the time required for measurement, the time that the person being measured, who is, for example, an elderly person, needs to maintain a specific posture for imaging can be shortened. This ultimately reduces failures in measuring biometric information.
  • the imaging control unit may be configured to automatically switch the second imaging device to active when the first processing unit has successfully identified the subject.
  • the imaging control unit may be configured to automatically switch the first imaging device to active when the measurement of the biometric information by the second processing unit is successful.
  • the second processing unit may be configured to, after measuring the biometric information, identify the person being measured using a captured image obtained from the second imaging device, and the imaging control unit may be configured to automatically switch the first imaging device to active when the second processing unit has successfully identified the person being measured.
  • the terminal device according to aspect 5 of the present invention may be configured as in aspects 1 to 4 above, having a first surface on which the first image capture device is arranged, and a second surface opposite the first surface on which the second image capture device is arranged.
  • the terminal device according to aspect 6 of the present invention may be configured in accordance with aspect 5 above, further comprising a display device disposed on the first surface.
  • the imaging control unit may automatically activate the first imaging device, and the first processing unit may automatically start identifying the person being measured.
  • the imaging control unit when an application for measuring the biometric information is launched, the imaging control unit may automatically activate the second imaging device, and the second processing unit may automatically start measuring the biometric information.
  • the imaging control unit when an application for measuring the biometric information is launched, the imaging control unit automatically activates the second imaging device, the second processing unit automatically starts identifying the person being measured, and after identifying the person being measured, the second processing unit starts measuring the biometric information of the person being measured.
  • the control method for a terminal device is a control method for a terminal device equipped with a first image capturing device and a second image capturing device that captures an image in a different direction from that of the first image capturing device, and includes a first processing step of identifying a person being measured using an image captured by the first image capturing device, a second processing step of measuring biometric information of a person being measured using an image captured by the second image capturing device, and an image capturing control step of automatically switching the second image capturing device to active when the processing by the first processing step is successful, or automatically switching the first image capturing device to active when the processing by the second processing step is successful.
  • the terminal device may be realized by a computer.
  • the control program of the terminal device that causes the computer to operate as each unit (software element) of the terminal device, thereby realizing the terminal device on the computer, and the computer-readable recording medium on which the control program is recorded, also fall within the scope of the present invention.
  • the present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims.
  • the technical scope of the present invention also includes embodiments obtained by appropriately combining the technical means disclosed in the different embodiments.
  • new technical features can be formed by combining the technical means disclosed in the respective embodiments.
  • First imaging device Second imaging device 3
  • Input device Display device 5
  • Communication device 6
  • Storage device 10
  • Control unit 11 Imaging control unit 12
  • Display control unit 13 Measurement unit (second processing unit) 14
  • First identification unit (first processing unit) 15
  • Second identification unit (second processing unit) 16 Operation input unit 100 Terminal device

Abstract

Provided is a terminal device for appropriately obtaining information about a measurement subject and a measurer while reducing the burden on the measurer. A terminal device (100) is equipped with a first imaging device (1), a second imaging device (2), a first identification unit (14) for identifying the measurer by using a captured image obtained from the first imaging device, a measurement unit (13) for measuring biological information of the measurement subject by using a captured image obtained from the second imaging device, and an imaging control unit (11) which automatically switches the second imaging device to active when the measurement unit processing is successful, or automatically switches the first imaging device to active when the measurement unit processing is successful.

Description

端末装置、端末装置の制御方法およびプログラムTerminal device, terminal device control method and program
　本発明は、端末装置および当該端末装置の制御方法に関する。 The present invention relates to a terminal device and a method for controlling the terminal device.
　従来、被測定者を撮影した撮影画像に基づき、被測定者の生体情報を検出する技術（非接触バイタルセンシング）が知られている。生体情報の管理において、被測定者、測定された生体情報、および測定を行った測定者の情報を対応付けて管理することが行われている。測定者の情報は、例えば、感染症の濃厚接触者を特定するためにも利用される。 　Conventionally, there is known a technology (non-contact vital sensing) that detects the biometric information of a person being measured based on an image of the person being measured. In managing biometric information, the person being measured, the measured biometric information, and information on the person who performed the measurement are associated and managed. Information on the person who performed the measurement is also used, for example, to identify close contacts of a person with an infectious disease.
　特許文献１には、リアカメラがオンの時に、手を上下に振るジェスチャを認識すると、オンに設定されるカメラをリアカメラからフロントカメラへ切り替える携帯端末が開示されている。一般的に、携帯端末においてアクティブにするカメラを切り替える場合、特許文献１の携帯端末のように、ユーザによる切り替え操作が必要となる。 Patent Document 1 discloses a mobile device that, when the rear camera is on, recognizes a gesture of waving a hand up and down and switches the camera that is set to be on from the rear camera to the front camera. Generally, when switching the active camera on a mobile device, as in the mobile device of Patent Document 1, a switching operation by the user is required.
日本国特開2016-139947号公報Japanese Patent Publication No. 2016-139947
　例えば、フロントカメラおよびリアカメラを備える端末装置を用いて、被測定者の生体情報の測定を行ってもよい。この場合、端末装置は、リアカメラによって被測定者を撮影し、フロントカメラによって測定者を撮影することができる。端末装置は、撮影された測定者の画像から、測定者を特定することができる。 For example, the biometric information of the person being measured may be measured using a terminal device equipped with a front camera and a rear camera. In this case, the terminal device can photograph the person being measured using the rear camera and the person being measured using the front camera. The terminal device can identify the person being measured from the photographed image of the person being measured.
　しかしながら、測定者は、（１）フロントカメラによって測定者自身を撮影し、端末装置が測定者を特定した後、（２）リアカメラをアクティブに切り替える操作を行い、（３）リアカメラによって被測定者を撮影するという操作を行う必要がある。多くの被測定者の生体情報を測定する必要がある場合、この操作は、測定に掛かる時間を長くし、測定者の負担になり得る。 However, the person taking the measurement must (1) take a picture of himself/herself with the front camera, and after the terminal device identifies the person being measured, (2) actively switch the rear camera to the rear camera, and (3) take a picture of the person being measured with the rear camera. When it is necessary to measure the biometric information of many people being measured, this operation increases the time required for the measurement and can be a burden for the person being measured.
　本発明の一態様は、測定者の負担を低減しつつ、被測定者および測定者の情報を適切に取得する端末装置を提供することにある。 One aspect of the present invention is to provide a terminal device that appropriately acquires information on the person being measured and the person measuring, while reducing the burden on the person measuring.
　本発明の一態様に係る端末装置は、第１撮影装置と、第１撮影装置とは異なる方向を撮影する第２撮影装置と、前記第１撮影装置から得られた撮影画像を用いて、測定者を特定する第１処理部と、前記第２撮影装置から得られた撮影画像を用いて、被測定者の生体情報を測定する第２処理部と、前記第１処理部による処理が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、または、前記第２処理部による処理が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、撮影制御部と、を備える。 A terminal device according to one aspect of the present invention includes a first image capturing device, a second image capturing device that captures an image in a different direction from that of the first image capturing device, a first processing unit that identifies the person being measured using the captured image obtained from the first image capturing device, a second processing unit that measures biometric information of the person being measured using the captured image obtained from the second image capturing device, and an image capturing control unit that automatically switches the second image capturing device to active when processing by the first processing unit is successful, or automatically switches the first image capturing device to active when processing by the second processing unit is successful.
　本発明の一態様に係る端末装置の制御方法は、第１撮影装置と、第１撮影装置とは異なる方向を撮影する第２撮影装置と、を備える端末装置の制御方法であって、前記第１撮影装置から得られた撮影画像を用いて、測定者を特定する第１処理ステップと、前記第２撮影装置から得られた撮影画像を用いて、被測定者の生体情報を測定する第２処理ステップと、前記第１処理ステップによる処理が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、または、前記第２処理ステップによる処理が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、撮影制御ステップと、を含む。 A control method for a terminal device according to one aspect of the present invention is a control method for a terminal device equipped with a first image capturing device and a second image capturing device that captures an image in a different direction from that of the first image capturing device, and includes a first processing step of identifying a person being measured using an image captured by the first image capturing device, a second processing step of measuring biometric information of a person being measured using an image captured by the second image capturing device, and an image capturing control step of automatically switching the second image capturing device to active when the processing by the first processing step is successful, or automatically switching the first image capturing device to active when the processing by the second processing step is successful.
　本発明の一態様によれば、測定者の負担を低減しつつ、被測定者および測定者の情報を適切に取得することができる。 According to one aspect of the present invention, it is possible to appropriately obtain information on the person being measured and the person measuring while reducing the burden on the person measuring.
本発明の一実施形態に係る端末装置の概略構成を示すブロック図である。1 is a block diagram showing a schematic configuration of a terminal device according to an embodiment of the present invention; 本発明の一実施形態に係る端末装置の構成を示す正面図である。1 is a front view showing a configuration of a terminal device according to an embodiment of the present invention; 本発明の一実施形態に係る端末装置の構成を示す背面図である。FIG. 2 is a rear view showing the configuration of a terminal device according to an embodiment of the present invention. 上記端末装置の動作の一例を示すフローチャートを示す図である。FIG. 4 is a flowchart showing an example of the operation of the terminal device. 上記端末装置の動作の一例を示すフローチャートを示す図である。FIG. 4 is a flowchart showing an example of the operation of the terminal device. 上記端末装置の動作の一例を示すフローチャートを示す図である。FIG. 4 is a flowchart showing an example of an operation of the terminal device.
　〔実施形態１〕
　（端末装置１００の概略構成）
　図１は、本実施形態に係る端末装置１００の概略構成を示すブロック図である。端末装置１００は、第１撮影装置１、第２撮影装置２、入力装置３、表示装置４、通信装置５、記憶装置６、および制御部１０を備える。端末装置１００は、被測定者の撮影画像に基づき（すなわち非接触で）被測定者の生体情報を測定するために用いられる装置である。生体情報の項目としては、被測定者の血圧、脈拍等が挙げられるが、これらに限定されない。端末装置１００は、画像の取得機能および画像の表示機能を備えたものであればよく、例えばスマートフォンまたはタブレット端末であってもよい。 [Embodiment 1]
(General configuration of terminal device 100)
FIG. 1 is a block diagram showing a schematic configuration of a terminal device 100 according to the present embodiment. The terminal device 100 includes a first image capturing device 1, a second image capturing device 2, an input device 3, a display device 4, a communication device 5, a storage device 6, and a control unit 10. The terminal device 100 is a device used to measure the biological information of a subject based on a captured image of the subject (i.e., non-contact). Examples of biological information include, but are not limited to, the subject's blood pressure, pulse rate, etc. The terminal device 100 may be any device that has an image acquisition function and an image display function, and may be, for example, a smartphone or a tablet terminal.
　測定者は、端末装置１００を用いて、表示装置４の画面に表示される被測定者を含む画像を確認しつつ被測定者を撮影し続けることで、被測定者の生体情報を測定する。このような端末装置１００は、例えば、介護の現場において、介護者（測定者）が被介護者（被測定者）の生体情報を測定する際に使用される。 The person measuring the subject uses the terminal device 100 to measure the biometric information of the subject by continuing to photograph the subject while checking an image including the subject displayed on the screen of the display device 4. Such a terminal device 100 is used, for example, in a care setting when a caregiver (measurer) measures the biometric information of a person being cared for (person being measured).
　なお、以下説明する端末装置１００の各機能は、汎用のコンピュータにプログラムをインストールすることにより実現することもできる。上記プログラムは、アプリケーションソフトウェアと呼ぶこともできる。以下では、端末装置１００が、上記プログラムをインストールしたスマートフォンである例を説明する。 Note that each function of the terminal device 100 described below can also be realized by installing a program on a general-purpose computer. The above program can also be called application software. Below, an example will be described in which the terminal device 100 is a smartphone on which the above program is installed.
　図２は、本実施形態に係る端末装置１００の構成を示す正面図である。図３は、本実施形態に係る端末装置１００の構成を示す背面図である。ここでは、端末装置１００は、板状の直方体形状であり、第１面（表面）と、第１面とは反対側の第２面（背面）とを有する。第１撮影装置１は、端末装置１００の第１面に配置されている。第２撮影装置２は、端末装置１００の第２面に配置されている。第１撮影装置は、第１方向（表面側）を撮影し、画像データを制御部１０に出力する。第２撮影装置２は、第１撮影装置とは異なる方向（背面側）を撮影し、撮影画像データを制御部１０に出力する。 FIG. 2 is a front view showing the configuration of the terminal device 100 according to this embodiment. FIG. 3 is a rear view showing the configuration of the terminal device 100 according to this embodiment. Here, the terminal device 100 has a plate-like rectangular parallelepiped shape and has a first surface (front side) and a second surface (back side) opposite the first surface. The first imaging device 1 is disposed on the first surface of the terminal device 100. The second imaging device 2 is disposed on the second surface of the terminal device 100. The first imaging device captures an image in a first direction (front side) and outputs image data to the control unit 10. The second imaging device 2 captures an image in a direction different from that of the first imaging device (back side) and outputs captured image data to the control unit 10.
　入力装置３は、端末装置１００に対するユーザの入力操作を受け付ける。入力装置３は、受け付けた入力操作が示す指示を制御部１０に出力する。入力装置３は、第１面に配置されている。ただしこれに限らず、入力装置３は、第１面とは異なる面、例えば背面または側面等に配置されていてもよい。表示装置４は、画面を有し、第１撮影装置１および第２撮影装置２にて撮影された画像を画面上に表示する。表示装置４は、第１面に配置されている。入力装置３および表示装置４は、タッチパネルとして一体となって構成されてもよい。以下では、入力装置３と表示装置４とが、タッチパネルとして一体となって構成されている構成を例にして説明を進める。 The input device 3 accepts user input operations on the terminal device 100. The input device 3 outputs instructions indicated by the accepted input operations to the control unit 10. The input device 3 is arranged on the first surface. However, this is not limited to this, and the input device 3 may be arranged on a surface other than the first surface, such as the back or side. The display device 4 has a screen, and displays images captured by the first imaging device 1 and the second imaging device 2 on the screen. The display device 4 is arranged on the first surface. The input device 3 and the display device 4 may be integrated into a touch panel. In the following, an example of a configuration in which the input device 3 and the display device 4 are integrated into a touch panel will be used for explanation.
　測定者は、端末装置１００を操作するため、入力装置３および表示装置４があり第１撮影装置１が撮影する表面側にいる。第１撮影装置１から得られる撮影画像には、測定者が含まれる。被測定者は、測定者によって撮影されるため、第２撮影装置２が撮影する背面側にいる。第２撮影装置２から得られる撮影画像には、被測定者が含まれる。 The person being measured is on the front side, where the first image capturing device 1 captures, and has the input device 3 and display device 4 to operate the terminal device 100. The person being measured is included in the captured image obtained from the first image capturing device 1. The person being measured is on the back side, where the second image capturing device 2 captures, as the person being measured is being photographed by the person being measured. The image obtained from the second image capturing device 2 includes the person being measured.
　通信装置５は、外部の通信機器（例えばサーバ）と制御部１０との間で各種データを送受信する。 The communication device 5 transmits and receives various data between an external communication device (e.g., a server) and the control unit 10.
　記憶装置６は、端末装置１００にて扱う各種データを格納する。記憶装置６は、予め登録された複数の測定者候補の画像の特徴量と、複数の測定者候補の情報（名前、または識別子等）とを対応付けて記憶する。また、記憶装置６は、予め登録された複数の被測定者候補の画像の特徴量と、複数の被測定者候補の情報（名前、または識別子等）とを対応付けて記憶する。 The storage device 6 stores various data handled by the terminal device 100. The storage device 6 stores image features of multiple pre-registered candidate measurers in association with information (such as names or identifiers) of the multiple candidate measurers. The storage device 6 also stores image features of multiple pre-registered candidate subjects in association with information (such as names or identifiers) of the multiple candidate subject subjects.
　制御部１０は、端末装置１００の各部を統括して制御する。また、制御部１０は、生体情報を測定するアプリケーションソフトウェア（以下アプリケーションと呼ぶ）を実行する。制御部１０は、撮影制御部１１、表示制御部１２、測定部１３（第２処理部）、第１特定部１４（第１処理部）、第２特定部１５（第２処理部）、および操作入力部１６を備える。 The control unit 10 controls each unit of the terminal device 100. The control unit 10 also executes application software (hereinafter referred to as application) that measures biometric information. The control unit 10 includes an imaging control unit 11, a display control unit 12, a measurement unit 13 (second processing unit), a first identification unit 14 (first processing unit), a second identification unit 15 (second processing unit), and an operation input unit 16.
　撮影制御部１１は、第１撮影装置１および第２撮影装置２を制御する。撮影制御部１１は、第１撮影装置１および第２撮影装置２のうちの１つをアクティブにする。ここでは、撮影制御部１１は、第１撮影装置１および第２撮影装置２のうちの１つを起動することでアクティブにする。撮影制御部１１は、アクティブである撮影装置から、撮影画像データを受け取る。撮影制御部１１は、アクティブである撮影装置から受け取った撮影画像データを、表示制御部１２に出力する。また、撮影制御部１１は、アクティブである第１撮影装置１から受け取った撮影画像データを、第１特定部１４に出力する。撮影制御部１１は、アクティブである第２撮影装置２から受け取った撮影画像データを、測定部１３および第２特定部１５に出力する。また、撮影制御部１１は、生体情報の測定結果、特定された被測定者の情報、および特定された測定者の情報を互いに対応付けて、記憶装置６に記憶させる、または外部のサーバに送信してもよい。 The imaging control unit 11 controls the first imaging device 1 and the second imaging device 2. The imaging control unit 11 activates one of the first imaging device 1 and the second imaging device 2. Here, the imaging control unit 11 activates one of the first imaging device 1 and the second imaging device 2 by starting it. The imaging control unit 11 receives imaging image data from the active imaging device. The imaging control unit 11 outputs the imaging image data received from the active imaging device to the display control unit 12. The imaging control unit 11 also outputs the imaging image data received from the active first imaging device 1 to the first identification unit 14. The imaging control unit 11 outputs the imaging image data received from the active second imaging device 2 to the measurement unit 13 and the second identification unit 15. The imaging control unit 11 also associates the measurement results of the biological information, the information of the identified subject, and the information of the identified person being measured with each other, and stores them in the storage device 6 or may transmit them to an external server.
　表示制御部１２は、表示装置４を制御する。表示制御部１２は、アクティブである撮影装置が撮影した撮影画像を含む画像を、表示装置４に表示させる。また、表示制御部１２は、生体情報の測定結果、特定された測定者の情報、および特定された被測定者の情報を、表示装置４に表示させる。 The display control unit 12 controls the display device 4. The display control unit 12 causes the display device 4 to display images including images captured by the active imaging device. The display control unit 12 also causes the display device 4 to display the measurement results of the biometric information, information on the identified person being measured, and information on the identified person being measured.
　第１特定部１４は、第１撮影装置１から得られた撮影画像を用いて処理を行う、第１処理部を構成する。第２特定部１５および測定部１３は、第２撮影装置２から得られた撮影画像を用いて処理を行う、第２処理部を構成する。 The first identification unit 14 constitutes a first processing unit that performs processing using the captured image obtained from the first imaging device 1. The second identification unit 15 and the measurement unit 13 constitute a second processing unit that performs processing using the captured image obtained from the second imaging device 2.
　測定部１３は、第２撮影装置２から得られた撮影画像を用いて、被測定者の生体情報を測定する。測定部１３は、撮影画像における被測定者の所定の部位の画像（顔画像、手画像、または足画像等）に基づき被測定者の生体情報を測定する。所定の部位の画像に基づく生体情報の測定方法については、公知の技術を利用できる。例えば、測定部１３は、所定の部位の画像データ（色味の情報等）に基づき、所定の部位に対応する判定テーブルを用いて生体情報を算出する。当該判定テーブルは、所定の部位の画像データから生体情報を算出する判定式において使用されるパラメータを含む。撮影画像は、被測定者の動画であってもよく、被測定者の静止画であってもよい。測定部１３は、撮影制御部１１から、撮影対象の変化に基づく測定を行う場合には撮影画像として動画を取得し、撮影対象の変化に基づかない測定を行う場合には撮影画像として静止画を取得してもよい。測定部１３は、被測定者の生体情報を、表示制御部１２に出力する。また、測定部１３は、被測定者の生体情報の測定に成功した旨を撮影制御部１１に通知する。 The measurement unit 13 measures the biometric information of the subject using the captured image obtained from the second image capture device 2. The measurement unit 13 measures the biometric information of the subject based on an image of a specific part of the subject in the captured image (such as a face image, hand image, or foot image). A known technique can be used to measure the biometric information based on an image of the specific part. For example, the measurement unit 13 calculates the biometric information using a judgment table corresponding to the specific part based on image data of the specific part (such as color information). The judgment table includes parameters used in a judgment formula for calculating the biometric information from the image data of the specific part. The captured image may be a video of the subject or a still image of the subject. The measurement unit 13 may obtain a video as the captured image from the imaging control unit 11 when performing a measurement based on a change in the subject, and may obtain a still image as the captured image when performing a measurement not based on a change in the subject. The measurement unit 13 outputs the biometric information of the subject to the display control unit 12. The measurement unit 13 also notifies the imaging control unit 11 that the measurement of the biometric information of the subject has been successful.
　なお、測定部１３の代わりに外部のサーバが、被測定者の生体情報を算出してもよい。この場合、測定部１３は、被測定者を含む撮影画像を、通信装置５を介して外部のサーバに送信する。外部のサーバにおいて、被測定者を含む撮影画像に基づいた生体情報の算出を行う。測定部１３は、外部のサーバから算出結果である生体情報を取得する。このように、測定部１３は、外部のサーバを利用することで、生体情報を測定してもよい。第２処理部は、外部のサーバを利用して生体情報を得る測定部１３で構成されてもよい。 In addition, an external server may calculate the biometric information of the person being measured instead of the measurement unit 13. In this case, the measurement unit 13 transmits a captured image including the person being measured to the external server via the communication device 5. The external server calculates the biometric information based on the captured image including the person being measured. The measurement unit 13 obtains the biometric information, which is the calculation result, from the external server. In this way, the measurement unit 13 may measure the biometric information by using an external server. The second processing unit may be configured as the measurement unit 13 that obtains the biometric information by using an external server.
　第１特定部１４は、第１撮影装置１から得られた撮影画像を用いて、測定者を特定する。例えば、第１特定部１４は、撮影画像から得られる人物の特徴量を、予め登録されている測定者候補の特徴量と照合することで、測定者を特定する。第１特定部１４は、記憶装置６から、複数の測定者候補の画像の特徴量を取得する。第１特定部１４は、第１撮影装置１から得られた撮影画像と、複数の測定者候補の画像の特徴量とを用いて、第１撮影装置１から得られた撮影画像に含まれる測定者を特定する。第１特定部１４は、特定した測定者の情報（名前、または識別子等）を、撮影制御部１１に出力する。 The first identification unit 14 identifies the person who took the measurement using the captured image obtained from the first photographing device 1. For example, the first identification unit 14 identifies the person who took the measurement by comparing the feature amount of the person obtained from the captured image with the feature amount of the candidate person who has been registered in advance. The first identification unit 14 acquires the feature amounts of the images of the multiple candidate people from the storage device 6. The first identification unit 14 identifies the person who took the measurement included in the captured image obtained from the first photographing device 1 using the captured image obtained from the first photographing device 1 and the feature amounts of the images of the multiple candidate people. The first identification unit 14 outputs information about the identified person who took the measurement (such as a name or an identifier) to the photographing control unit 11.
　第２特定部１５は、第２撮影装置２から得られた撮影画像を用いて、被測定者を特定する。例えば、第２特定部１５は、撮影画像から得られる人物の特徴量を、予め登録されている被測定者候補の特徴量と照合することで、被測定者を特定する。第２特定部１５は、記憶装置６から、複数の被測定者候補の画像の特徴量を取得する。第２特定部１５は、第２撮影装置２から得られた撮影画像と、複数の被測定者候補の画像の特徴量とを用いて、第２撮影装置２から得られた撮影画像に含まれる被測定者を特定する。第２特定部１５は、特定した被測定者の情報（名前、または識別子等）を、撮影制御部１１に出力する。 The second identification unit 15 identifies the person being measured using the captured image obtained from the second imaging device 2. For example, the second identification unit 15 identifies the person being measured by comparing the feature amounts of the person obtained from the captured image with the feature amounts of the candidate person registered in advance. The second identification unit 15 acquires the feature amounts of the images of the multiple candidate people from the storage device 6. The second identification unit 15 identifies the person being measured included in the captured image obtained from the second imaging device 2 using the captured image obtained from the second imaging device 2 and the feature amounts of the images of the multiple candidate people. The second identification unit 15 outputs information about the identified person being measured (such as name or identifier) to the imaging control unit 11.
　なお、第１特定部１４または第２特定部１５は、複数の測定者候補の画像の特徴量、複数の被測定者候補の画像の特徴量、測定者の情報、または被測定者の情報を、通信装置５を介して外部のサーバから取得してもよい。 The first identification unit 14 or the second identification unit 15 may acquire image features of multiple candidate measurers, image features of multiple candidate subjects, information on the measurers, or information on the subjects from an external server via the communication device 5.
　第１特定部１４または第２特定部１５は、測定者を含む撮影画像または被測定者を含む撮影画像を、通信装置５を介して外部のサーバに送信してもよい。第１特定部１４または第２特定部１５は、外部のサーバで特定された測定者の情報または特定された被測定者の情報を、外部のサーバから取得してもよい。このように、第１特定部１４または第２特定部１５は、外部のサーバを利用することで、測定者または被測定者を特定してもよい。第１処理部は、外部のサーバを利用して測定者を特定する第１特定部１４で構成されてもよい。第２処理部は、外部のサーバを利用して被測定者を特定する第２特定部１５で構成されてもよい。 The first identification unit 14 or the second identification unit 15 may transmit a captured image including the person being measured or a captured image including the person being measured to an external server via the communication device 5. The first identification unit 14 or the second identification unit 15 may acquire information on the person being measured identified by the external server or information on the person being measured identified by the external server from the external server. In this way, the first identification unit 14 or the second identification unit 15 may identify the person being measured or the person being measured by using an external server. The first processing unit may be configured with the first identification unit 14 that identifies the person being measured using an external server. The second processing unit may be configured with the second identification unit 15 that identifies the person being measured using an external server.
　操作入力部１６は、入力装置３から入力操作が示す指示を受け取る。例えば、操作入力部１６は、生体情報を測定するアプリケーションを起動させる指示、アプリケーションを終了させる指示、および、ズームイン／ズームアウト等の指示を受け取る。操作入力部１６は、アプリケーションを起動／終了させる指示を受け取ると、アプリケーションを起動／終了させる。操作入力部１６は、ズームイン／ズームアウトの指示を受け取ると、該指示を撮影制御部１１に出力し、撮影制御部１１はアクティブな撮影装置のズームを制御する。 The operation input unit 16 receives instructions indicated by input operations from the input device 3. For example, the operation input unit 16 receives instructions to start an application that measures biometric information, instructions to end an application, and instructions such as zooming in/zooming out. When the operation input unit 16 receives an instruction to start/end an application, it starts/ends the application. When the operation input unit 16 receives an instruction to zoom in/zoom out, it outputs the instruction to the imaging control unit 11, and the imaging control unit 11 controls the zoom of the active imaging device.
　（動作例１）
　図４は、端末装置１００の動作の一例を示すフローチャートを示す図である。測定者は、まず入力装置３を操作し、生体情報を測定するアプリケーションを起動させる。操作入力部１６は、入力操作が示す指示に従って、アプリケーションを起動させる（Ｓ１）。アプリケーションが起動されると、撮影制御部１１は、自動的に第１撮影装置１をアクティブにする（Ｓ２）。表示制御部１２は、アクティブである第１撮影装置１から得られた撮影画像を、表示装置４に表示させる。その後、第１特定部１４は、自動的に測定者の特定を開始する（Ｓ３）。第１特定部１４は、第１撮影装置１から得られた撮影画像を用いて、測定者を特定する処理を行う。第１特定部１４は、測定者を特定できるまで処理を繰り返す。「自動的に」という用語は、「ユーザによる入力操作を必要とせずに」ということを意味する。 (Operation example 1)
FIG. 4 is a diagram showing a flowchart showing an example of the operation of the terminal device 100. The subject first operates the input device 3 to start an application for measuring biological information. The operation input unit 16 starts the application according to the instruction indicated by the input operation (S1). When the application is started, the photographing control unit 11 automatically activates the first photographing device 1 (S2). The display control unit 12 displays the photographed image obtained from the active first photographing device 1 on the display device 4. After that, the first identification unit 14 automatically starts identifying the subject (S3). The first identification unit 14 performs a process of identifying the subject using the photographed image obtained from the first photographing device 1. The first identification unit 14 repeats the process until the subject can be identified. The term "automatically" means "without the need for input operation by the user."
　第１特定部１４による測定者を特定する処理が成功（完了）すると（Ｓ４）、第１特定部１４は、測定者の特定に成功した旨と、特定された測定者の情報とを撮影制御部１１に通知する。撮影制御部１１は、表示制御部１２を介して、特定された測定者の情報を表示装置４に表示させる。また、第１特定部１４による測定者を特定する処理が成功すると、撮影制御部１１は、自動的に第２撮影装置２をアクティブに切り替える（Ｓ５）。一方、撮影制御部１１は、自動的に第１撮影装置１を非アクティブ（停止状態）にする。これにより、表示制御部１２は、第２撮影装置２から得られた撮影画像を表示装置４に表示させる。 When the process of identifying the person by the first identification unit 14 is successful (completed) (S4), the first identification unit 14 notifies the imaging control unit 11 that the person has been successfully identified and provides information about the identified person. The imaging control unit 11 causes the display device 4 to display the information about the identified person via the display control unit 12. Furthermore, when the process of identifying the person by the first identification unit 14 is successful, the imaging control unit 11 automatically switches the second imaging device 2 to active (S5). Meanwhile, the imaging control unit 11 automatically makes the first imaging device 1 inactive (stopped state). As a result, the display control unit 12 causes the display device 4 to display the captured image obtained from the second imaging device 2.
　第２撮影装置２がアクティブに切り替わると、第２特定部１５は、自動的に被測定者の特定を開始する（Ｓ６）。第２特定部１５は、第２撮影装置２から得られた撮影画像を用いて、被測定者を特定する処理を行う。第２特定部１５は、被測定者を特定できるまで処理を繰り返す。 When the second image capturing device 2 switches to active, the second identification unit 15 automatically starts identifying the person being measured (S6). The second identification unit 15 performs a process of identifying the person being measured using the captured image obtained from the second image capturing device 2. The second identification unit 15 repeats the process until the person being measured can be identified.
　第２特定部１５による被測定者を特定する処理が成功（完了）すると（Ｓ７）、被測定者の特定に成功した旨と、特定された被測定者の情報とを撮影制御部１１に通知する。撮影制御部１１は、表示制御部１２を介して、特定された被測定者の情報を表示装置４に表示させる。 When the process of identifying the subject by the second identification unit 15 is successful (completed) (S7), the imaging control unit 11 is notified that the subject has been successfully identified and of the information of the identified subject. The imaging control unit 11 causes the display device 4 to display the information of the identified subject via the display control unit 12.
　また、第２特定部１５による被測定者を特定する処理が成功すると、測定部１３は、自動的に被測定者の生体情報の測定を開始する（Ｓ８）。測定部１３は、第２撮影装置２から得られた撮影画像を用いて、被測定者の生体情報を測定する処理を行う。生体情報を測定する処理が成功すると（Ｓ９）、表示制御部１２は、被測定者の生体情報の測定結果を、表示装置４に表示させる（Ｓ１０）。このとき、表示制御部１２は、測定者の情報および被測定者の情報をも、表示装置４に表示させてもよい。 Furthermore, if the process of identifying the person being measured by the second identification unit 15 is successful, the measurement unit 13 automatically starts measuring the biometric information of the person being measured (S8). The measurement unit 13 performs a process of measuring the biometric information of the person being measured using the captured image obtained from the second imaging device 2. If the process of measuring the biometric information is successful (S9), the display control unit 12 causes the display device 4 to display the measurement results of the biometric information of the person being measured (S10). At this time, the display control unit 12 may also cause the display device 4 to display information about the person measuring and the person being measured.
　その後、測定者が入力装置３に対して終了を指示する入力操作を行うと、操作入力部１６は、アプリケーションを終了させる。 After that, when the person taking the measurement performs an input operation on the input device 3 to instruct the user to end the application, the operation input unit 16 ends the application.
　なお、動作例１において、被測定者を特定する処理（Ｓ６、Ｓ７）を省略してもよい。また、動作例１において、被測定者を特定する処理（Ｓ６、Ｓ７）と、生体情報を測定する処理（Ｓ８、Ｓ９）との順序を入れ替えてもよい。 In addition, in operation example 1, the process of identifying the subject (S6, S7) may be omitted. Also, in operation example 1, the order of the process of identifying the subject (S6, S7) and the process of measuring biological information (S8, S9) may be reversed.
　（動作例２）
　図５は、端末装置１００の動作の一例を示すフローチャートを示す図である。上述の動作例と同一の処理については、同じ符号を付し、その詳細な説明を省略する。操作入力部１６は、入力操作が示す指示に従って、アプリケーションを起動させる（Ｓ１）。アプリケーションが起動されると、撮影制御部１１は、自動的に第２撮影装置２をアクティブにする（Ｓ２１）。表示制御部１２は、アクティブである第２撮影装置２から得られた撮影画像を、表示装置４に表示させる。その後、第２特定部１５は、自動的に被測定者の特定を開始する（Ｓ６）。第２特定部１５による被測定者を特定する処理が成功（完了）すると（Ｓ７）、測定部１３は、自動的に被測定者の生体情報の測定を開始する（Ｓ８）。 (Operation example 2)
FIG. 5 is a diagram showing a flowchart showing an example of the operation of the terminal device 100. The same processes as those in the above-mentioned operation example are given the same reference numerals, and detailed description thereof will be omitted. The operation input unit 16 starts an application according to the instruction indicated by the input operation (S1). When the application is started, the photographing control unit 11 automatically activates the second photographing device 2 (S21). The display control unit 12 displays the photographed image obtained from the active second photographing device 2 on the display device 4. Thereafter, the second identification unit 15 automatically starts identifying the subject (S6). When the process of identifying the subject by the second identification unit 15 is successful (completed) (S7), the measurement unit 13 automatically starts measuring the subject's biological information (S8).
　測定部１３による生体情報を測定する処理が成功（完了）すると（Ｓ９）、撮影制御部１１は、自動的に第１撮影装置１をアクティブに切り替える（Ｓ２２）。一方、撮影制御部１１は、自動的に第２撮影装置２を非アクティブ（停止状態）にする。これにより、表示制御部１２は、第１撮影装置１から得られた撮影画像を表示装置４に表示させる。 When the process of measuring the biometric information by the measurement unit 13 is successful (completed) (S9), the imaging control unit 11 automatically switches the first imaging device 1 to active (S22). On the other hand, the imaging control unit 11 automatically makes the second imaging device 2 inactive (stopped state). As a result, the display control unit 12 causes the display device 4 to display the captured image obtained from the first imaging device 1.
　第１撮影装置１がアクティブに切り替わると、第１特定部１４は、自動的に測定者の特定を開始する（Ｓ３）。第１特定部１４による測定者を特定する処理が成功（完了）すると（Ｓ４）、表示制御部１２は、被測定者の生体情報の測定結果等を、表示装置４に表示させる（Ｓ１０）。 When the first image capture device 1 switches to active, the first identification unit 14 automatically starts identifying the person being measured (S3). When the process of identifying the person being measured by the first identification unit 14 is successful (completed) (S4), the display control unit 12 causes the display device 4 to display the measurement results of the subject's biometric information, etc. (S10).
　なお、動作例２において、被測定者を特定する処理（Ｓ６、Ｓ７）を省略してもよい。 In addition, in operation example 2, the process of identifying the person being measured (S6, S7) may be omitted.
　（動作例３）
　図６は、端末装置１００の動作の一例を示すフローチャートを示す図である。上述の動作例と同一の処理については、同じ符号を付し、その詳細な説明を省略する。動作例３は、動作例２における、被測定者を特定する処理（Ｓ６、Ｓ７）と、生体情報を測定する処理（Ｓ８、Ｓ９）との順序を入れ替えたものである。操作入力部１６は、入力操作が示す指示に従って、アプリケーションを起動させる（Ｓ１）。アプリケーションが起動されると、撮影制御部１１は、自動的に第２撮影装置２をアクティブにする（Ｓ２１）。表示制御部１２は、アクティブである第２撮影装置２から得られた撮影画像を、表示装置４に表示させる。その後、測定部１３は、自動的に被測定者の生体情報の測定を開始する（Ｓ８）。測定部１３による生体情報を測定する処理が成功（完了）すると（Ｓ９）、第２特定部１５は、自動的に被測定者の特定を開始する（Ｓ６）。 (Operation example 3)
FIG. 6 is a diagram showing a flowchart showing an example of the operation of the terminal device 100. The same processes as those in the above-mentioned operation examples are given the same reference numerals, and detailed description thereof is omitted. Operation example 3 is an example in which the order of the process of identifying the subject (S6, S7) and the process of measuring biological information (S8, S9) in operation example 2 is reversed. The operation input unit 16 starts an application according to the instruction indicated by the input operation (S1). When the application is started, the imaging control unit 11 automatically activates the second imaging device 2 (S21). The display control unit 12 displays the captured image obtained from the active second imaging device 2 on the display device 4. Thereafter, the measurement unit 13 automatically starts measuring the biological information of the subject (S8). When the process of measuring biological information by the measurement unit 13 is successful (completed) (S9), the second identification unit 15 automatically starts identifying the subject (S6).
　第２特定部１５による被測定者を特定する処理が成功（完了）すると（Ｓ７）、撮影制御部１１は、自動的に第１撮影装置１をアクティブに切り替える（Ｓ３１）。以降の動作は動作例２と同じである。 When the process of identifying the subject by the second identification unit 15 is successful (completed) (S7), the imaging control unit 11 automatically switches the first imaging device 1 to active (S31). The subsequent operations are the same as those in operation example 2.
　本実施形態の端末装置１００によれば、生体情報を測定するアプリケーションが起動した後、ユーザの操作を必要とせずに自動でアクティブにする撮影装置を切り替えて、測定者の特定、被測定者の特定、および被測定者の生体情報の測定を行うことができる。ユーザである測定者は、測定者側の第１撮影装置１がアクティブである間は、測定者自身が表示装置４に映るように（測定者が撮影されるように）、端末装置１００を保持すればよい。また、測定者は、被測定者側の第２撮影装置２がアクティブである間は、被測定者が表示装置４に映るように（被測定者が撮影されるように）、端末装置１００を保持すればよい。測定者の特定、被測定者の特定、および被測定者の生体情報の測定の処理の切り替えのために、測定者が入力操作をする必要はない。それゆえ、測定者は撮影に集中することができ、生体情報を測定するための測定者の負担が軽減される。また、生体情報の測定のために掛かる全体の処理時間を短縮することができる。それゆえ、撮影中に姿勢を一定に保つ必要がある被測定者の負担も軽減される。これにより、結果的に生体情報の測定における失敗を少なくすることができる。例えば介護の現場では、少数の測定者が多くの被測定者に対して生体情報の測定をする必要があり、少しの処理時間の短縮でも大きな負担の軽減に繋がる。 According to the terminal device 100 of the present embodiment, after an application for measuring biometric information is started, the active photographing device can be automatically switched without the need for user operation, and the person being measured, the person being measured, and the biometric information of the person being measured can be identified. The person being measured, who is the user, only needs to hold the terminal device 100 so that the person being measured appears on the display device 4 (so that the person being measured is photographed) while the first photographing device 1 on the person being measured is active. Also, the person being measured only needs to hold the terminal device 100 so that the person being measured appears on the display device 4 (so that the person being measured is photographed) while the second photographing device 2 on the person being measured is active. The person being measured does not need to perform input operations to switch between the processes of identifying the person being measured, identifying the person being measured, and measuring the biometric information of the person being measured. Therefore, the person being measured can concentrate on photographing, and the burden on the person being measured for measuring the biometric information is reduced. In addition, the overall processing time required for measuring the biometric information can be shortened. Therefore, the burden on the person being measured, who needs to maintain a constant posture during photographing, is also reduced. As a result, the failure in measuring the biometric information can be reduced. For example, in nursing care settings, a small number of people need to measure the vital signs of many subjects, so even a small reduction in processing time can lead to a significant reduction in the burden.
　本実施形態の端末装置１００によれば、測定者および被測定者への負担を低減しつつ非接触バイタルセンシングを適切に実行できる。このような効果は、例えば、国連が提唱する持続可能な開発目標（ＳＤＧｓ）の目標３「すべての人に健康と福祉を」等の達成にも貢献するものである。 The terminal device 100 of this embodiment can appropriately perform non-contact vital sensing while reducing the burden on the person measuring and the person being measured. This effect also contributes to the achievement of, for example, Goal 3 of the Sustainable Development Goals (SDGs) advocated by the United Nations, "Ensure good health and well-being for all."
　（変形例）
　以上では、撮影制御部１１は、アクティブとする撮影装置を起動し、非アクティブとする撮影装置を停止するが、これに限らない。撮影制御部１１は、第１撮影装置１と第２撮影装置２の両方を起動していてもよい。撮影制御部１１は、アクティブとする撮影装置から得られた撮影画像を、表示装置４に表示させ、非アクティブとする撮影装置から得られた撮影画像を、表示装置４に表示させなくてもよい。すなわち、アクティブにする撮影装置を切り替えるという処理は、表示装置４に表示する撮影画像および処理に用いる撮影画像を、第１撮影装置１から得られた撮影画像にするか第２撮影装置２から得られた撮影画像にするかを切り替えることであってもよい。 (Modification)
In the above, the photographing control unit 11 activates the photographing device to be active and stops the photographing device to be inactive, but this is not limited thereto. The photographing control unit 11 may activate both the first photographing device 1 and the second photographing device 2. The photographing control unit 11 may display the photographed image obtained from the photographing device to be active on the display device 4, and may not display the photographed image obtained from the photographing device to be inactive on the display device 4. In other words, the process of switching the photographing device to be active may be to switch the photographed image to be displayed on the display device 4 and the photographed image to be used for processing between the photographed image obtained from the first photographing device 1 and the photographed image obtained from the second photographing device 2.
　〔ソフトウェアによる実現例〕
　端末装置１００（以下、「装置」と呼ぶ）の機能は、当該装置としてコンピュータを機能させるためのプログラムであって、当該装置の各制御ブロック（特に制御部１０に含まれる各部）としてコンピュータを機能させるためのプログラムにより実現することができる。 [Software implementation example]
The functions of the terminal device 100 (hereinafter referred to as the "device") are realized by a program for causing a computer to function as the device, and by a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 10).
　この場合、上記装置は、上記プログラムを実行するためのハードウェアとして、少なくとも１つの制御装置（例えばプロセッサ）と少なくとも１つの記憶装置（例えばメモリ）を有するコンピュータを備えている。この制御装置と記憶装置により上記プログラムを実行することにより、上記各実施形態で説明した各機能が実現される。 In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The functions described in each of the above embodiments are realized by executing the program using this control device and storage device.
　上記プログラムは、一時的ではなく、コンピュータ読み取り可能な、１または複数の記録媒体に記録されていてもよい。この記録媒体は、上記装置が備えていてもよいし、備えていなくてもよい。後者の場合、上記プログラムは、有線または無線の任意の伝送媒体を介して上記装置に供給されてもよい。 The program may be recorded on one or more computer-readable recording media, not on a temporary basis. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.
　また、上記各制御ブロックの機能の一部または全部は、論理回路により実現することも可能である。例えば、上記各制御ブロックとして機能する論理回路が形成された集積回路も本発明の範疇に含まれる。この他にも、例えば量子コンピュータにより上記各制御ブロックの機能を実現することも可能である。 Furthermore, some or all of the functions of each of the above control blocks can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the above control blocks is formed is also included in the scope of the present invention. In addition, it is also possible to realize the functions of each of the above control blocks by, for example, a quantum computer.
　また、上記各実施形態で説明した各処理は、ＡＩ（Artificial Intelligence：人工知能）に実行させてもよい。この場合、ＡＩは上記制御装置で動作するものであってもよいし、他の装置（例えばエッジコンピュータまたはクラウドサーバ等）で動作するものであってもよい。 Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may run on the control device, or may run on another device (such as an edge computer or a cloud server).
　〔まとめ〕
　本発明の態様１に係る端末装置は、第１撮影装置と、第１撮影装置とは異なる方向を撮影する第２撮影装置と、前記第１撮影装置から得られた撮影画像を用いて、測定者を特定する第１処理部と、前記第２撮影装置から得られた撮影画像を用いて、被測定者の生体情報を測定する第２処理部と、前記第１処理部による処理が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、または、前記第２処理部による処理が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、撮影制御部と、を備える。 〔summary〕
A terminal device according to aspect 1 of the present invention comprises a first imaging device, a second imaging device that captures an image in a different direction from that of the first imaging device, a first processing unit that identifies a person to be measured using an image captured by the first imaging device, a second processing unit that measures biometric information of a person to be measured using an image captured by the second imaging device, and an imaging control unit that automatically switches the second imaging device to active when processing by the first processing unit is successful, or automatically switches the first imaging device to active when processing by the second processing unit is successful.
　上記構成によれば、端末装置は、第１撮影装置および第２撮影装置の一方から得られた撮影画像を用いて行う処理が成功（完了）すると、自動的に他方をアクティブに切り替える。そのため、ユーザによる撮影装置の切り替え操作を必要としない。これにより、第１撮影装置側に位置する測定者の特定と、第２撮影装置側に位置する被測定者の生体情報の測定とをスムースに行うことができる。それゆえ、被測定者の生体情報の測定作業に掛かるトータル時間を短縮することができる。また測定に掛かる時間が短縮されることにより、例えば高齢者である被測定者が撮影のための特定の姿勢を維持する必要がある時間を短くすることができる。これにより、結果的に生体情報の測定における失敗を少なくすることができる。 With the above configuration, when the terminal device has successfully (completed) processing using the captured image obtained from either the first or second imaging device, it automatically switches to active the other. Therefore, there is no need for the user to switch between the imaging devices. This makes it possible to smoothly identify the person being measured who is located on the first imaging device side and measure the biometric information of the person being measured who is located on the second imaging device side. Therefore, the total time required for measuring the biometric information of the person being measured can be shortened. Furthermore, by shortening the time required for measurement, the time that the person being measured, who is, for example, an elderly person, needs to maintain a specific posture for imaging can be shortened. This ultimately reduces failures in measuring biometric information.
　本発明の態様２に係る端末装置では、上記態様１において、前記撮影制御部は、前記第１処理部による前記測定者の特定が成功すると、自動的に前記第２撮影装置をアクティブに切り替える構成であってもよい。 In the terminal device according to aspect 2 of the present invention, in aspect 1 above, the imaging control unit may be configured to automatically switch the second imaging device to active when the first processing unit has successfully identified the subject.
　本発明の態様３に係る端末装置では、上記態様１において、前記撮影制御部は、前記第２処理部による前記生体情報の測定が成功すると、自動的に前記第１撮影装置をアクティブに切り替える構成であってもよい。 In the terminal device according to aspect 3 of the present invention, in aspect 1 above, the imaging control unit may be configured to automatically switch the first imaging device to active when the measurement of the biometric information by the second processing unit is successful.
　本発明の態様４に係る端末装置では、上記態様１において、前記第２処理部は、前記生体情報を測定した後、前記第２撮影装置から得られた撮影画像を用いて、前記被測定者を特定し、前記撮影制御部は、前記第２処理部による前記被測定者の特定が成功すると、自動的に前記第１撮影装置をアクティブに切り替える構成であってもよい。 In the terminal device according to aspect 4 of the present invention, in aspect 1 above, the second processing unit may be configured to, after measuring the biometric information, identify the person being measured using a captured image obtained from the second imaging device, and the imaging control unit may be configured to automatically switch the first imaging device to active when the second processing unit has successfully identified the person being measured.
　本発明の態様５に係る端末装置は、上記態様１から４において、前記第１撮影装置が配置された第１面と、前記第２撮影装置が配置された、第１面とは反対側の第２面とを有する構成であってもよい。 The terminal device according to aspect 5 of the present invention may be configured as in aspects 1 to 4 above, having a first surface on which the first image capture device is arranged, and a second surface opposite the first surface on which the second image capture device is arranged.
　本発明の態様６に係る端末装置は、上記態様５において、前記第１面に配置された表示装置を備える構成であってもよい。 The terminal device according to aspect 6 of the present invention may be configured in accordance with aspect 5 above, further comprising a display device disposed on the first surface.
　本発明の態様７に係る端末装置では、上記態様２において、前記生体情報を測定するアプリケーションが起動されると、前記撮影制御部は、自動的に前記第１撮影装置をアクティブにし、前記第１処理部は、自動的に測定者の特定を開始する構成であってもよい。 In the terminal device according to aspect 7 of the present invention, in aspect 2 above, when an application for measuring the biometric information is launched, the imaging control unit may automatically activate the first imaging device, and the first processing unit may automatically start identifying the person being measured.
　本発明の態様８に係る端末装置では、上記態様３または４において、前記生体情報を測定するアプリケーションが起動されると、前記撮影制御部は、自動的に前記第２撮影装置をアクティブにし、前記第２処理部は、自動的に前記生体情報の測定を開始する、構成であってもよい。 In the terminal device according to aspect 8 of the present invention, in aspect 3 or 4 above, when an application for measuring the biometric information is launched, the imaging control unit may automatically activate the second imaging device, and the second processing unit may automatically start measuring the biometric information.
　本発明の態様９に係る端末装置では、上記態様３において、前記生体情報を測定するアプリケーションが起動されると、前記撮影制御部は、自動的に前記第２撮影装置をアクティブにし、前記第２処理部は、自動的に前記被測定者の特定を開始し、前記第２処理部は、前記被測定者を特定した後、前記被測定者の前記生体情報の測定を開始する、構成であってもよい。 In the terminal device according to aspect 9 of the present invention, in aspect 3 above, when an application for measuring the biometric information is launched, the imaging control unit automatically activates the second imaging device, the second processing unit automatically starts identifying the person being measured, and after identifying the person being measured, the second processing unit starts measuring the biometric information of the person being measured.
　本発明の態様１０に係る端末装置の制御方法は、第１撮影装置と、第１撮影装置とは異なる方向を撮影する第２撮影装置と、を備える端末装置の制御方法であって、前記第１撮影装置から得られた撮影画像を用いて、測定者を特定する第１処理ステップと、前記第２撮影装置から得られた撮影画像を用いて、被測定者の生体情報を測定する第２処理ステップと、前記第１処理ステップによる処理が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、または、前記第２処理ステップによる処理が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、撮影制御ステップと、を含む。 The control method for a terminal device according to aspect 10 of the present invention is a control method for a terminal device equipped with a first image capturing device and a second image capturing device that captures an image in a different direction from that of the first image capturing device, and includes a first processing step of identifying a person being measured using an image captured by the first image capturing device, a second processing step of measuring biometric information of a person being measured using an image captured by the second image capturing device, and an image capturing control step of automatically switching the second image capturing device to active when the processing by the first processing step is successful, or automatically switching the first image capturing device to active when the processing by the second processing step is successful.
　本発明の各態様に係る端末装置は、コンピュータによって実現してもよく、この場合には、コンピュータを上記端末装置が備える各部（ソフトウェア要素）として動作させることにより上記端末装置をコンピュータにて実現させる端末装置の制御プログラム、およびそれを記録したコンピュータ読み取り可能な記録媒体も、本発明の範疇に入る。 The terminal device according to each aspect of the present invention may be realized by a computer. In this case, the control program of the terminal device that causes the computer to operate as each unit (software element) of the terminal device, thereby realizing the terminal device on the computer, and the computer-readable recording medium on which the control program is recorded, also fall within the scope of the present invention.
　本発明は上述した各実施形態に限定されるものではなく、請求項に示した範囲で種々の変更が可能であり、異なる実施形態にそれぞれ開示された技術的手段を適宜組み合わせて得られる実施形態についても本発明の技術的範囲に含まれる。さらに、各実施形態にそれぞれ開示された技術的手段を組み合わせることにより、新しい技術的特徴を形成することができる。 The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. The technical scope of the present invention also includes embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Furthermore, new technical features can be formed by combining the technical means disclosed in the respective embodiments.
１　第１撮影装置
２　第２撮影装置
３　入力装置
４　表示装置
５　通信装置
６　記憶装置
１０　制御部
１１　撮影制御部
１２　表示制御部
１３　測定部（第２処理部）
１４　第１特定部（第１処理部）
１５　第２特定部（第２処理部）
１６　操作入力部
１００　端末装置 1 First imaging device 2 Second imaging device 3 Input device 4 Display device 5 Communication device 6 Storage device 10 Control unit 11 Imaging control unit 12 Display control unit 13 Measurement unit (second processing unit)
14 First identification unit (first processing unit)
15 Second identification unit (second processing unit)
16 Operation input unit 100 Terminal device

Claims (11)

  1. 　第１撮影装置と、
    　第１撮影装置とは異なる方向を撮影する第２撮影装置と、
    　前記第１撮影装置から得られた撮影画像を用いて、測定者を特定する第１処理部と、
    　前記第２撮影装置から得られた撮影画像を用いて、被測定者の生体情報を測定する第２処理部と、
    　前記第１処理部による処理が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、または、前記第２処理部による処理が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、撮影制御部と、を備える端末装置。     A first imaging device;
    A second image capturing device that captures an image in a direction different from that of the first image capturing device;
    a first processing unit that identifies a person to be measured using a photographed image obtained from the first photographing device;
    a second processing unit that measures biological information of the subject using the captured image obtained by the second imaging device;
    A terminal device comprising: an imaging control unit that automatically switches the second imaging device to active when processing by the first processing unit is successful; or automatically switches the first imaging device to active when processing by the second processing unit is successful.
  2. 　前記撮影制御部は、前記第１処理部による前記測定者の特定が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、請求項１に記載の端末装置。 The terminal device according to claim 1, wherein the imaging control unit automatically switches the second imaging device to active when the first processing unit successfully identifies the subject.
  3. 　前記撮影制御部は、前記第２処理部による前記生体情報の測定が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、請求項１に記載の端末装置。 The terminal device according to claim 1, wherein the imaging control unit automatically switches the first imaging device to active when the measurement of the biometric information by the second processing unit is successful.
  4. 　前記第２処理部は、前記生体情報を測定した後、前記第２撮影装置から得られた撮影画像を用いて、前記被測定者を特定し、
    　前記撮影制御部は、前記第２処理部による前記被測定者の特定が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、請求項１に記載の端末装置。     The second processing unit, after measuring the biological information, identifies the subject using a captured image obtained by the second imaging device; and
    The terminal device according to claim 1 , wherein the imaging control unit automatically switches the first imaging device to active when the second processing unit has succeeded in identifying the subject.
  5. 　前記第１撮影装置が配置された第１面と、
    　前記第２撮影装置が配置された、第１面とは反対側の第２面とを有する、請求項１に記載の端末装置。     a first surface on which the first image capturing device is disposed;
    The terminal device according to claim 1 , further comprising a second surface opposite to the first surface, the second image capturing device being disposed on the second surface.
  6. 　前記第１面に配置された表示装置を備える、請求項５に記載の端末装置。 The terminal device according to claim 5, comprising a display device disposed on the first surface.
  7. 　前記生体情報を測定するアプリケーションが起動されると、
    　　前記撮影制御部は、自動的に前記第１撮影装置をアクティブにし、
    　　前記第１処理部は、自動的に測定者の特定を開始する、請求項２に記載の端末装置。     When the application for measuring the biological information is started,
    The photographing control unit automatically activates the first photographing device,
    The terminal device according to claim 2 , wherein the first processing unit automatically starts identifying the subject.
  8. 　前記生体情報を測定するアプリケーションが起動されると、
    　　前記撮影制御部は、自動的に前記第２撮影装置をアクティブにし、
    　　前記第２処理部は、自動的に前記生体情報の測定を開始する、請求項３または４に記載の端末装置。     When the application for measuring the biological information is started,
    The imaging control unit automatically activates the second imaging device,
    The terminal device according to claim 3 , wherein the second processing unit automatically starts measuring the biological information.
  9. 　前記生体情報を測定するアプリケーションが起動されると、
    　　前記撮影制御部は、自動的に前記第２撮影装置をアクティブにし、
    　　前記第２処理部は、自動的に前記被測定者の特定を開始し、
    　前記第２処理部は、前記被測定者を特定した後、前記被測定者の前記生体情報の測定を開始する、請求項３に記載の端末装置。     When the application for measuring the biological information is started,
    The imaging control unit automatically activates the second imaging device,
    The second processing unit automatically starts identifying the subject,
    The terminal device according to claim 3 , wherein the second processing unit starts measuring the biological information of the person being measured after identifying the person being measured.
  10. 　第１撮影装置と、第１撮影装置とは異なる方向を撮影する第２撮影装置と、を備える端末装置の制御方法であって、
    　前記第１撮影装置から得られた撮影画像を用いて、測定者を特定する第１処理ステップと、
    　前記第２撮影装置から得られた撮影画像を用いて、被測定者の生体情報を測定する第２処理ステップと、
    　前記第１処理ステップによる処理が成功すると、自動的に前記第２撮影装置をアクティブに切り替える、または、前記第２処理ステップによる処理が成功すると、自動的に前記第１撮影装置をアクティブに切り替える、撮影制御ステップと、を含む端末装置の制御方法。     A method for controlling a terminal device including a first photographing device and a second photographing device that photographs a direction different from that of the first photographing device, the method comprising:
    a first processing step of identifying a person to be measured using a photographed image obtained from the first photographing device;
    a second processing step of measuring biological information of the subject using the captured image obtained by the second imaging device;
    a photographing control step of automatically switching the second photographing device to active when the processing by the first processing step is successful, or automatically switching the first photographing device to active when the processing by the second processing step is successful.
  11. 　請求項１に記載の端末装置としてコンピュータを機能させるためのプログラムであって、前記第１処理部、前記第２処理部、および前記撮影制御部としてコンピュータを機能させるためのプログラム。 A program for causing a computer to function as the terminal device described in claim 1, the program causing a computer to function as the first processing unit, the second processing unit, and the imaging control unit.
PCT/JP2023/034417 2022-09-29 2023-09-22 Terminal device, terminal device control method and program WO2024070918A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022156795 2022-09-29
JP2022-156795 2022-09-29

Publications (1)

Publication Number Publication Date
WO2024070918A1 true WO2024070918A1 (en) 2024-04-04

Family

ID=90477727

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/034417 WO2024070918A1 (en) 2022-09-29 2023-09-22 Terminal device, terminal device control method and program

Country Status (1)

Country Link
WO (1) WO2024070918A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120323590A1 (en) * 2011-06-17 2012-12-20 Sanjay Udani Methods and systems for electronic medical source
JP2014198198A (en) * 2013-03-29 2014-10-23 富士通株式会社 Blood flow index calculation program, blood flow index calculation device, and blood flow index calculation method
US20170007137A1 (en) * 2015-07-07 2017-01-12 Research And Business Foundation Sungkyunkwan University Method of estimating blood pressure based on image
JP2021033324A (en) * 2019-08-13 2021-03-01 株式会社タニタ Authentication system, authentication method, and authentication program
US20210343017A1 (en) * 2020-04-30 2021-11-04 Medtronic, Inc. Post operative implantation site monitoring and medical device performance
JP2022128627A (en) * 2021-02-24 2022-09-05 株式会社日立製作所 Biometric authentication system, authentication terminal, and authentication method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120323590A1 (en) * 2011-06-17 2012-12-20 Sanjay Udani Methods and systems for electronic medical source
JP2014198198A (en) * 2013-03-29 2014-10-23 富士通株式会社 Blood flow index calculation program, blood flow index calculation device, and blood flow index calculation method
US20170007137A1 (en) * 2015-07-07 2017-01-12 Research And Business Foundation Sungkyunkwan University Method of estimating blood pressure based on image
JP2021033324A (en) * 2019-08-13 2021-03-01 株式会社タニタ Authentication system, authentication method, and authentication program
US20210343017A1 (en) * 2020-04-30 2021-11-04 Medtronic, Inc. Post operative implantation site monitoring and medical device performance
JP2022128627A (en) * 2021-02-24 2022-09-05 株式会社日立製作所 Biometric authentication system, authentication terminal, and authentication method

Similar Documents

Publication Publication Date Title
JP2009172181A (en) Health checkup method and health checkup apparatus
US20160262631A1 (en) Handset mobile communication device for measuring body temperature and body temprature measuring method thereof
JP2010171797A (en) Imaging apparatus and program
JP7480884B2 (en) Information processing device, authentication device, information processing method, and program
JP6727776B2 (en) Support system, support method, program
JP2014184068A (en) Portable medical image display terminal, and operation method of the same
WO2024070918A1 (en) Terminal device, terminal device control method and program
JP3845380B2 (en) Nursing support system, nursing support method, and nursing support program
JP7280660B2 (en) Information processing device, management device, measurement unit, management system and program
JP5368821B2 (en) Camera control apparatus, camera control method and program
JP2014146275A (en) Authentication device, authentication method, and program
JP4533028B2 (en) Ophthalmic image recording apparatus, method, and program
JP2016127525A (en) Imaging apparatus, and its control method and program
JP2010273858A (en) X-ray imaging apparatus and method of controlling the same
JP2004329620A (en) Imaging unit
JP2014226515A (en) Diagnosis support system
WO2024070917A1 (en) Terminal device and measurement method
JP5477025B2 (en) Image display device and program
US20240000307A1 (en) Photography support device, image-capturing device, and control method of image-capturing device
JP2013255594A (en) Image processing apparatus and image processing method
JP2011066828A (en) Imaging device, imaging method and program
TW202414350A (en) (無)
US20220386981A1 (en) Information processing system and information processing method
JP2005341016A (en) Camera apparatus and program
WO2022038834A1 (en) Vital data measurement control device, vital data measurement system, vital data measurement state determination method, vital data measurement state determination program, and recording medium