JP6072717B2 - Measurement support apparatus, measurement support method, measurement support system, and program - Google Patents

Description

  The present invention relates to a measurement support apparatus, a measurement support method, a measurement support system, and a program.

  When detecting biological information using a healthcare device (measuring device) equipped with a sensor capable of detecting biological information, in order to detect accurate biological information, the subject (user) is placed at an appropriate position on the healthcare device. It is necessary to match parts of the body.

  In order for the subject to adjust the body part to the appropriate position of the health care device, the positional relationship between the health care device and the body part is indicated in the manual, or the part where the body part is aligned is indicated by the health care device. Marking on top is done.

  Patent Document 1 discloses an electrode arrangement system that acquires an image of a patient's body and displays an electrode attachment position on the image.

Special table 2010-502343 gazette

  However, there is a problem that the subject may misunderstand only by the instructions in the instructions and the markings on the health care device, and the body measurement site may not be accurately aligned with the appropriate position of the health care device. is there.

  In addition, the technique disclosed in Patent Document 1 is a technique that indicates an electrode attachment position with respect to a patient's body, and does not disclose that a body measurement site is aligned with an appropriate position of a health care device.

  The present invention has been made to solve such a problem, and provides a measurement support apparatus, a measurement support method, a measurement support system, and a program capable of accurately aligning a measurement site to an appropriate position of a measurement instrument. It is intended to provide.

  A measurement support apparatus according to an aspect of the present invention includes an image acquisition unit that acquires an apparatus image including a measurement apparatus, and a guide image for guiding a measurement site to a measurement position of the measurement apparatus based on the apparatus image. An image generation unit that generates a superimposed image superimposed on the device image; and a display unit that displays the superimposed image, wherein the guide image indicates a body part that is a measurement target of the measurement device. The image generation means superimposes the part image on the predetermined measurement position of the measuring device.

  A measurement support method according to an aspect of the present invention includes a step of acquiring a device image including a measurement device, and a guide image for guiding a measurement site to a measurement position of the measurement device based on the device image. A step of generating a superimposed image superimposed on the image; and a step of displaying the superimposed image, wherein the guide image includes a part image indicating a body part to be measured by the measuring device, and the superimposition is performed. The step of generating an image is to superimpose the part image on the predetermined measurement position of the measuring device.

  A measurement support system according to an aspect of the present invention guides a measurement site to a measurement position of the measurement device based on the measurement device, an image acquisition unit that acquires a device image including the measurement device, and the device image. Image generating means for generating a superimposed image obtained by superimposing a guide image for superimposing on the device image, and display means for displaying the superimposed image, wherein the guide image is a measurement target of the measuring device. The image generation means includes a region image indicating a region, and the image generation unit superimposes the region image on the predetermined measurement position of the measuring device.

  The program according to an aspect of the present invention includes a step of acquiring a device image including a measurement device in a computer, and a guide image for guiding a measurement site to a measurement position of the measurement device based on the device image. Generating a superimposed image superimposed on a device image; and displaying the superimposed image; and the guide image includes a body image indicating a body part to be measured by the measuring device, The step of generating the superimposed image superimposes the part image on the predetermined measurement position of the measuring device.

  A measurement device according to an aspect of the present invention is a measurement device that can communicate with a measurement support apparatus, and a signal indicating that a position of a measurement site of a user matches a predetermined measurement position of the measurement device. , Communication means received from the measurement support device, and measurement means for starting measurement of the measurement site of the user on the basis of the signal indicating the coincidence.

  A measuring device according to an aspect of the present invention includes an image acquisition unit that acquires a device image including a measuring device, a position of a measurement site of a user based on the device image, and a predetermined measurement position of the measuring device. And, based on the comparison result, a determination unit that determines whether or not the measurement device is in a state in which the measurement site of the user can be measured, and the user based on the determination result of the determination unit Measuring means for starting measurement of the measurement site.

  According to the present invention, it is possible to provide a measurement support apparatus, a measurement support method, a measurement support system, and a program that can accurately match a measurement site to an appropriate position of a measurement device.

1 is a block diagram of a measurement support apparatus according to a first embodiment. 3 is a flowchart for explaining an operation of the measurement support apparatus according to the first exemplary embodiment; FIG. 3 is an external view of a health care device according to a second embodiment. FIG. 3 is a block diagram of a health care device according to a second exemplary embodiment. FIG. 6 is a diagram for explaining a position where a measurement site is aligned with a health care device according to a second embodiment; FIG. 6 is an external view of an external device according to a second embodiment. FIG. 6 is a block diagram of an external device according to a second embodiment. FIG. 10 is a diagram for explaining an operation of the measurement support system according to the second exemplary embodiment. 10 is a flowchart for explaining an operation of the health care device according to the second exemplary embodiment; FIG. 10 is a diagram for explaining a measurement procedure according to the second embodiment. 12 is a flowchart for explaining an operation of the external device according to the second exemplary embodiment; FIG. 10 is a diagram for explaining an operation of an external device according to the first modification of the second embodiment. FIG. 10 is a diagram for explaining an operation of an external device according to the second modification of the second embodiment.

<Embodiment 1>
Embodiment 1 of the present invention will be described below with reference to the drawings. The measurement support apparatus 1 according to the present embodiment displays a position where a measurement part of a user's body is aligned on a measurement device in a device image including the measurement device. The measurement support apparatus 1 is an electronic device including at least a display unit, such as a smartphone, a tablet terminal, or a mobile phone. In addition, measuring devices can measure biological information (heart rate, blood pressure, body temperature, blood sugar level, etc.), physique, and skeleton of humans and animals by approaching or contacting at least part of the human or animal body. Equipment.

<Configuration of Measurement Support Device 1>
The configuration of the measurement support apparatus 1 will be described with reference to the block diagram of FIG. The measurement support apparatus 1 includes an image acquisition unit 11, an image generation unit 12, and a display unit 13. The image acquisition unit 11 acquires a device image. Here, the device image means an image in which at least a part of the measuring device is included in the image. Note that, as a method of acquiring a device image, the image acquisition unit 11 may capture a measurement device and generate a device image, or the image acquisition unit 11 may be a device captured by an imaging device different from the measurement support device 1. An image may be received.

  The image generation unit 12 generates a superimposed image based on the device image acquired by the image acquisition unit 11. Here, the superimposed image is an image in which the guide image is superimposed on the device image.

  Here, the guide image is an image for guiding the measurement site of the subject to a predetermined measurement position of the measurement device. That is, the guide image is an image for guiding the placement of the measurement site at the measurement position of the measurement device. For example, the guide image may be an image showing a mark or a marker indicating the measurement position. Further, the guide image may be an image (part image) showing at least a part of a body part (hereinafter, also referred to as a measurement target part) that is a measurement target of the measurement device. The part image is an image virtually showing the measurement target part. That is, the part image is an image showing the shape and posture of the measurement target part with respect to the measuring device. In this way, in the superimposed image, a mark or part (guide image) that does not exist in the real space is displayed so as to overlap the device image.

  The display unit 13 is a display such as an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence). The display unit 13 displays the superimposed image generated by the image generation unit 12.

<Operation of Measurement Support Device 1>
Next, the operation of the measurement support apparatus 1 according to the present embodiment will be described with reference to the flowchart shown in FIG. First, the image acquisition unit 11 acquires a device image (step S101). Note that the image acquisition processing by the image acquisition unit 11 may be performed in accordance with a user operation, or may be performed automatically (for example, every predetermined time).

  In the present embodiment, it is assumed that the measurement image is included in the device image. However, a process for determining whether or not the measurement device is included in the device image may be added. Good.

  Next, the image generation unit 12 generates a superimposed image by superimposing a guide image on the device image based on the device image of the measurement device (step S102). For example, the image generation unit 12 specifies the position, angle, size, and the like of the measurement device in the device image. Then, the image generation unit 12 determines a superimposition parameter indicating the position, angle, size, and the like of the part image with respect to the measurement device. Then, the image generation unit 12 superimposes the guide image on the device image using the determined superposition parameter. The superimposition based on the device image of the measuring device recognizes the position, angle, size, posture, etc. of the measuring device using the size, posture, shape, color, marker, barcode, etc. of the measuring device in the device image. This means that the guide image is superimposed on a predetermined measurement position of the measuring device. The image generation unit 12 outputs the generated superimposed image to the display unit 13.

  The display unit 13 displays the acquired superimposed image (step S103). Thereby, the user of the measurement support apparatus 1 can confirm an image in which a mark or a part exists at the measurement position of the measurement device.

  As described above, according to the configuration of the measurement support apparatus 1 according to the present embodiment, the image generation unit 12 guides the measurement site to the measurement position of the measurement device based on the device image of the measurement device. A superimposed image is generated by superimposing the images. Then, the display unit 13 displays the superimposed image. For this reason, the user can confirm the approach position or the contact position of the measurement site with respect to the measurement device by referring to the superimposed image displayed on the display unit 13. Therefore, the user can accurately adjust the region to be measured to the appropriate position of the measuring device.

  Furthermore, when the part image is used as the guide image, the part image is displayed on the device image of the measuring device that actually exists in front of the user's eyes. Therefore, the user can display the part image included in the displayed superimposed image. What is necessary is just to make a measurement site | part approach or contact a measurement apparatus according to a position and attitude | position. Therefore, since the measurement site can be aligned with an appropriate position of the measurement device, the measurement accuracy is also improved.

<Embodiment 2>
A second embodiment according to the present invention will be described. The measurement system according to the present embodiment includes a health care device 100 and an external device 200. The external device 200 (measurement support device) recognizes an AR (Augmented reality) marker attached to the healthcare device 100 when performing measurement using the non-invasive healthcare device 100 (measurement device). Then, the external device 200 generates and displays a superimposed image based on the AR marker. In the present embodiment, as an example of the health care device 100, a measurement target region is a user's hand. Specifically, the health care device 100 irradiates the blood vessel at the base of the thumb of the hand with infrared rays, and measures the blood sugar level in the blood based on the reflected light.

<Configuration of healthcare device 100>
The configuration of the health care device 100 according to the present embodiment will be described with reference to FIGS. 3 and 4. FIG. 3A is a front view of the health care device 100, and FIG. 3B is a side view of the health care device 100. FIG. FIG. 4 is a block diagram of the health care device 100.

  As shown in FIGS. 3 and 4, the healthcare device 100 includes a display unit 101, an operation unit 102, a measurement window 103, a power switch 104, an AR marker 105, a measurement optical unit 106, and an auxiliary storage unit. 111, a main storage unit 112, a control unit 113, a measurement processing unit 114, a power supply unit 115, a communication unit 116, and a housing 120.

  The display unit 101 is a display that displays measurement results, setting screens, and the like. In the example illustrated in FIG. 3A, the display unit 101 displays a numerical value “123.4”.

  The operation unit 102 is an interface for inputting instructions such as measurement start and setting change to the health care device 100. The operation unit 102 may be a physical button key or a touch panel.

  The measurement window 103 is a window that transmits infrared light emitted from the measurement optical unit 106 disposed inside the healthcare device 100 and transmits reflected light from the measurement target portion. That is, the arrangement position of the measurement window 103 indicates the measurement position of the healthcare device 100.

  The power switch 104 is a switch for switching on / off the power supply of the health care device 100.

  The AR marker 105 is a marker for recognizing the positions, postures, sizes, and the like of the health care device 100 and the measurement window 103 in an application executed on the external device 200. In the example illustrated in FIG. 3A, the health care device 100 includes two AR markers 105. The AR markers 105 are located at both ends of the housing 120 so as to sandwich the measurement window 103 in plan view. Note that the position, shape, and the like of the AR marker are not limited to those shown in FIG. The AR marker 105 is a figure.

  The measurement optical unit 106 emits infrared rays for blood glucose level measurement and receives reflected light reflected by the blood vessels. The measurement optical unit 106 includes, for example, an LED (Light Emitting Diode) that emits infrared light and a light receiving element that receives reflected light.

  The auxiliary storage unit 111 is a memory such as a RAM (Random Access Memory), for example, and stores a measurement result, a control program for controlling the health care device 100, and the like.

  The main storage unit 112 is a memory such as a RAM, for example, and is a working memory for the control unit 113 to execute and develop a control program.

  The control unit 113 is, for example, a CPU (Central Processing Unit) or the like, and controls the entire processing block of the healthcare device 100 based on a control program stored in the auxiliary storage unit 111.

  The measurement processing unit 114 analyzes the blood glucose level in the blood based on the detection result of the measurement optical unit 106 (the amount of reflected light received by the light receiving element of the measurement optical unit 106). In addition, about the analysis of the blood glucose level based on reflected light, since a well-known technique can be used, detailed description is abbreviate | omitted.

  The power supply unit 115 supplies power necessary for driving the health care device 100. The power supply unit 115 is, for example, a battery or a battery. When receiving power from an external power source (such as an outlet), the power unit 115 is an AC / DC converter or the like.

  The communication unit 116 transmits / receives information to / from the external device 200. The communication unit 116 is a wireless communication module that performs communication using, for example, Bluetooth (registered trademark) or Wi-Fi (registered trademark). Note that the communication unit 116 may communicate with the external device 200 in a wired manner via a communication cable or the like.

  Here, with reference to FIG. 5, measurement at an appropriate position and measurement at an inappropriate position using the health care device 100 according to the present embodiment will be described. In FIG. 5A, the measurement position 902 (position of the measurement window 103) is located at the base of the thumb of the subject's hand 901, and the subject's hand 901 is disposed at an appropriate position of the health care device 100. Indicates the state. On the other hand, FIGS. 5B and 5C are examples in which the subject places the hand 901 at the wrong position.

<Configuration of External Device 200>
Next, the configuration of the external device 200 according to the present embodiment will be described with reference to FIGS. 6 and 7. FIG. 6A is a front view of the external device 200, and FIG. 6B is a side view of the external device 200. FIG. 7 is a block diagram of the external device 200.

  6 and 7, the external device 200 includes a display unit 201, an imaging unit 202, an auxiliary storage unit 211, a main storage unit 212, an operation unit 213, a control unit 214, and an image generation unit. 215, a power supply unit 216, a communication unit 217, and a housing 220.

  The display unit 201 is a display that displays a superimposed image generated by the image generation unit 215, a measurement result transmitted from the health care device 100, and the like.

  The imaging unit 202 (image acquisition means) is a camera having a lens and a light receiving element. The imaging unit 202 is provided on the surface opposite to the surface on which the display unit 201 is provided. The imaging unit 202 performs an imaging process according to a user operation and generates a captured image.

  The auxiliary storage unit 211 is a memory such as a RAM, and stores a part image to be superimposed on the captured image, a control program for controlling the external device 200, and the like.

  The main storage unit 212 is a memory such as a RAM, for example, and is a working memory for the control unit 214 to execute and develop a control program.

  The operation unit 213 is an interface for inputting an instruction to start imaging or change settings to the external device 200. In the present embodiment, operation unit 213 is a touch panel provided on the display of display unit 201. Of course, the operation unit 213 may be a physical button key.

  The control unit 214 is a CPU, for example, and controls the entire processing block of the external device 200 based on a control program stored in the auxiliary storage unit 211. Further, the control unit 214 detects the AR marker 105 attached to the healthcare device 100 based on the captured image generated by the imaging unit 202.

  The image generation unit 215 determines the type of the healthcare device 100 and the healthcare device in the captured image based on the position, size, angle, and the like in the captured image (device image) of the AR marker 105 detected by the control unit 214. 100 positions, postures, sizes, etc. are specified. Then, the image generation unit 215 superimposes the part image on the captured image generated by the imaging unit 202 based on the type of the healthcare device 100, the position, posture, size, and the like of the healthcare device 100 in the captured image. By doing so, a superimposed image is generated.

  Here, an example of a method for generating a superimposed image will be briefly described. The image generation unit 215 generates three-dimensional coordinates based on the health care device 100 based on the position, posture, size, and the like of the health care device 100 in the captured image. Then, the image generation unit 215 acquires a part image corresponding to the type of the health care device 100 from the auxiliary storage unit 211. Then, the image generation unit 215 adjusts the position, posture, size, and the like (superimposition parameter) of the part image based on the position, posture, size, and the like of the health care device 100, so The part image is superimposed at the determined position. As a result, a part image to be measured is displayed at a predetermined position on the health care device 100 in a predetermined posture.

  The power supply unit 216 supplies power necessary for driving the external device 200. The power supply unit 216 is, for example, a battery or a battery.

  The communication unit 217 transmits / receives information to / from the health care device 100. The communication unit 217 is a wireless communication module that performs communication using, for example, Bluetooth (registered trademark) or Wi-Fi (registered trademark).

  Here, an outline of the operation of the measurement support system including the health care device 100 and the external device 200 will be described with reference to FIG. First, according to the operation of the user 900, the external device 200 captures an image of the health care device 100 (step S11). Next, the external device 200 generates a superimposed image by superimposing the part image on the captured image based on the marker position in the captured image being captured (step S12). The external device 200 displays the superimposed image on the display unit 201 (step S13).

  The user 900 aligns his / her measurement site (user's hand) with the position of the site image in the superimposed image while referring to the superimposed image (step S14). When the position of the part image matches the position of the measurement part, the external device 200 transmits a measurement start instruction to the health care device 100 (step S15). Thereby, the health care device 100 performs the measurement process. Then, the health care device 100 transmits the measurement result to the external device 200 (step S16). The external device 200 displays the received measurement result on the display unit 201 (step S17). The user 900 confirms the displayed measurement result.

<Operation of Healthcare Device 100>
Next, a specific operation of the health care device 100 according to the present embodiment will be described with reference to a flowchart shown in FIG. First, in response to pressing of the power switch 104, the power supply of the health care device 100 is turned on (step S201).

  Next, the control unit 113 determines whether or not the communication unit 116 has received a measurement start instruction signal from the external device 200 (step S202). The measurement start instruction signal is a signal for instructing the healthcare device 100 to start measurement from the external device 200.

  When the communication unit 116 has not received the measurement start instruction signal (step S202: No), the health care device 100 waits until the measurement start instruction signal is received.

  When the communication unit 116 receives the measurement start signal (step S202: Yes), the measurement optical unit 106 and the measurement processing unit 114 execute a measurement process in accordance with an instruction from the control unit 113 (step S203). Specifically, the measurement optical unit 106 irradiates infrared rays from the measurement window 103 to the outside of the healthcare device 100. And the measurement process part 114 light-receives the reflected light which infrared rays reflected in the measurement site | part of the user (subject), and measures a blood glucose level based on the light quantity etc. of reflected light.

  Next, the display unit 101 displays the blood sugar level measured by the measurement processing unit 114 (step S204). Thereby, the user can confirm his own blood glucose level. Further, the communication unit 116 transmits the measurement result to the external device 200 according to the command of the control unit 113 (step S205). As a result, the user can check the measurement result even on the external device 200. In addition, measurement results can be managed and analyzed using an application of the external device 200 or the like.

<Operation of External Device 200>
Next, a specific operation of the external device 200 according to the present embodiment will be described with reference to the flowchart shown in FIG. First, in response to an operation of a power switch (not shown) of the external device 200, the power of the external device 200 is turned on (step S301).

  Next, the imaging unit 202 performs an imaging process according to a user operation (step S302). The display unit 201 displays the captured image generated by the imaging unit 202 (step S303).

  Next, the control unit 214 determines whether or not a predetermined AR marker 105 is included in the captured image (step S304). When the AR marker 105 is not included in the captured image (step S304: No), the control unit 214 continues the marker detection process.

  On the other hand, when the captured image includes the AR marker 105 (step S304: Yes), the image generation unit 215 generates a superimposed image (step S305). Then, the display unit 201 displays the generated superimposed image (step S306).

  Here, as shown in FIG. 11, the user overlaps his / her hand image 901 in the superimposed image (an image of the user's hand in the superimposed image) with the part image 801 in the superimposed image displayed on the display unit 201. Move your hands so that. In the example shown in FIG. 11, the part image 801 is a stereoscopic transmission image having a hand shape. Then, the control unit 214 (determination means) compares the position of the part image 801 and the position of the hand image 901 in the superimposed image, and the position of the part image 801 and the position of the hand image 901 are based on the comparison result. It is determined whether or not they match (step S307). At this time, the case where the positions match is not only the case where the part image 801 and the hand image 901 match in pixel units, but the distance between the part image 801 and the hand image 901 in the superimposed image is a predetermined distance. The following cases are also included.

  When the part image 801 and the hand image 901 do not match (step S307: No), the control unit 214 continues to determine whether or not the position of the part image 801 and the position of the hand image 901 match. .

  On the other hand, when the part image 801 matches the hand image 901 (step S307: Yes), the control unit 214 transmits a measurement start instruction signal to the healthcare device 100 via the communication unit 217 (step S308). That is, the measurement start instruction signal is a signal indicating that the position of the user's measurement site (hand image 901) matches the predetermined measurement position (site image 801) of the measurement device.

  The healthcare device 100 that has received the measurement start instruction signal starts the measurement process. Then, the health care device 100 transmits the measurement result to the external device 200.

  Thereafter, the communication unit 217 receives the measurement result transmitted from the health care device 100 (step S309). Then, the display unit 201 displays the measurement result. Further, the control unit 214 stores the measurement result in the auxiliary storage unit 211 (step S310).

  As described above, according to the configuration of the external device 200 according to the present embodiment, when the control unit 214 detects the AR marker 105 of the healthcare device 100, the image generation unit 215 generates a superimposed image including a part image. . For this reason, the user can place his / her hand at an appropriate predetermined position of the healthcare device 100 while confirming the part image in the superimposed image and his / her hand image.

  Further, when the position of the part image matches the position of the hand image in the superimposed image, the external device 200 instructs the health care device 100 to start measurement. Therefore, the health care device 100 starts the measurement process at the timing when the user's hand is placed at a predetermined optimal position of the health care device 100. Therefore, measurement accuracy can be improved.

<Modification 1>
Modification 1 according to the present embodiment will be described. The external device 200 according to Modification 1 acquires the user's physique information. The external device 200 is characterized in that the size of the part image in the superimposed image is adjusted based on the user's physique information. Since the other configuration is the same as that of the external device 200 shown in FIGS. 6 and 7, the description thereof is omitted as appropriate.

  The control unit 214 acquires physique information input by the user using the operation unit 213. That is, the operation unit 213 functions as a physique information acquisition unit. Here, the physique information is information relating to the user's physique, such as height, weight, chest circumference, abdominal circumference, hand size, foot size, and the like. Note that the imaging unit 202 and the control unit 214 may be physique information acquisition means. Specifically, the imaging unit 202 captures a captured image including the user's hands and feet. And the control part 214 may acquire physique information based on the magnitude | size of the hand and the leg in a captured image.

  The image generation unit 215 adjusts the size of the part image in the superimposed image based on the acquired physique information. For example, as the user's physique (height, weight, chest circumference, abdominal circumference, hand size, foot size, etc.) is larger than a preset reference value, the size of the part image is increased. Moreover, the size of the part image is reduced as the user's physique is smaller than the reference value.

  For example, as shown in FIG. 12, the size of the part image is reduced according to the size of the hand image 901 of the user. Specifically, the size is changed from the site image 801a having the default (reference value) size (the size in the second embodiment described above) to the size of the site image 801b. Thereby, the size of the part image is adjusted to a size corresponding to the user's hand image 901.

  Thus, according to the configuration of the external device 200 according to the first modification, the size of the part image can be matched with the size of the measurement part of the user. Therefore, the external device 200 can guide the user's hand to a more accurate position.

<Modification 2>
Modification 2 according to the present embodiment will be described. The external device 200 according to Modification 2 is characterized in that the posture of the part image in the superimposed image changes. Since the other configuration is the same as that of the external device 200 shown in FIGS. 6 and 7, the description thereof is omitted as appropriate.

  The image generation unit 215 changes the position and posture of the part image in the superimposed image when it is necessary to measure a plurality of different parts of the body according to the measurement window 103 of the healthcare device 100. For example, when there are two measurement locations, the image generation unit 215 displays part images at two different positions or postures in the measurement order.

  An example of the change of the part image is shown in FIG. In the example shown in FIG. 13, the first measurement location is the tip of the index finger, and the next measurement location is the center of the palm. In this case, the position of the part image 801 is changed from a state in which the index finger overlaps the measurement window 103 (FIG. 13A) to a state in which the center part of the palm overlaps the measurement window 103 (FIG. 13B). It changes continuously. That is, the image generation unit 215 generates a superimposed image as a moving image in which the process of position movement or posture change of the part image 801 is also displayed. In other words, when the health care device 100 continuously measures a plurality of parts with different postures, the image generation unit 215 continuously superimposes a plurality of part images with different postures on the captured image, thereby generating a superimposed image. Generate.

  As described above, according to the configuration of the external device 200 according to the second modification, even when a continuous operation is involved in the measurement, it is possible to intuitively notify the user that the measurement site is to be changed. As a result, the external device 200 can guide the user's hand to a more accurate position.

<Modification 3>
Modification 3 according to the present embodiment will be described. In the above-described embodiment, the process of determining whether the position of the part image matches the position of the hand image in the superimposed image is performed by the control unit 214 of the external device 200. It is not something that can be done. In the third modification, the control unit 113 of the healthcare device 100 performs the above determination.

  Specifically, the external device 200 sequentially transmits the captured image generated by the imaging unit 202 to the healthcare device 100. The control unit 113 of the health care device 100 determines whether or not the position of the hand image in the captured image matches the predetermined measurement position of the measurement device. In the determination process at this time, similarly to the above-described embodiment, a superimposed image including a part image may be generated, and the positions of the hand image and the part image may be compared. Alternatively, coordinates indicating a predetermined measurement position in the captured image may be acquired without using the part image, and the coordinates in the captured image may be compared with the position (coordinates) of the hand image.

  Then, the control unit 113 instructs the measurement optical unit 106 and the measurement processing unit 114 to start the measurement process when the position of the hand image in the captured image matches the predetermined measurement position of the measurement device. Thereby, when the user's hand is arranged at a predetermined position, the healthcare device 100 can start the measurement process. That is, in the third modification, the control unit 113 starts measurement of the measurement site based on the determination result of the control unit 113 (determination unit) instead of the measurement start instruction signal from the external device 200.

  The present invention is not limited to the above-described embodiment, and can be appropriately changed and combined without departing from the spirit of the present invention. For example, the shape of the health care device 100 and the external device 200, the arrangement position of each part, and the like are not limited to the above-described embodiment. In the second embodiment, the AR image 105 is used to specify the display position and orientation of the part image, but the shape of the entire health care device 100 may be used as the marker. In this case, it is not necessary to separately provide the AR marker in the health care device 100. Further, the position of the health care device 100 is identified by a method of identifying the position of the health care device 100 by recognizing a predetermined shape such as the AR marker 105 or the outer shape of the health care device 100 (so-called vision-based AR). Not limited to. For example, the position or the like of the health care device 100 may be specified based on position information acquired from the GPS, direction information acquired from the magnetic sensor, posture (tilt) information of the external device 200 acquired from the acceleration sensor, or the like ( So-called location-based AR).

  In addition, arbitrary processing of the above-described healthcare device and external device can be realized by causing a CPU (Central Processing Unit) to execute a computer program. In this case, the computer program can be stored using various types of non-transitory computer readable media and supplied to the computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W and semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)) are included. The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

  In addition to the case where the function of the above-described embodiment is realized by the computer executing the program that realizes the function of the above-described embodiment, this program is not limited to the OS ( A case where the functions of the above-described embodiment are realized in cooperation with an operating system or application software is also included in the embodiment of the present invention. Furthermore, the present invention is also applicable to the case where the functions of the above-described embodiment are realized by performing all or part of the processing of the program by a function expansion board inserted into the computer or a function expansion unit connected to the computer. It is included in the embodiment.

DESCRIPTION OF SYMBOLS 1 Measurement support apparatus 11 Image acquisition part 12 Image generation part 13 Display part 100 Healthcare apparatus 101 Display part 102 Operation part 103 Measurement window 104 Power switch 105 AR marker 106 Measurement optical part 111 Auxiliary storage part 112 Main storage part 113 Control part 114 Measurement processing unit 115 Power supply unit 116 Communication unit 200 External device 201 Display unit 202 Imaging unit 211 Auxiliary storage unit 212 Main storage unit 213 Operation unit 214 Control unit 215 Image generation unit 216 Power supply unit 217 Communication unit

Claims (9)

Image acquisition means for acquiring a device image including a measurement device;
Based on the device image, image generating means for generating a superimposed image in which a guide image for guiding a measurement site to a measurement position of the measurement device is superimposed on the device image;
Display means for displaying the superimposed image;
With
The guide image includes a part image indicating a part of the body to be measured by the measuring device,
The said image generation means is a measurement assistance apparatus which superimposes the said site | part image on the said predetermined measurement position of the said measurement apparatus.   In the superimposed image, the position of the guide image is compared with the position of the measurement site of the user, and based on the comparison result, whether or not the measurement device is in a state capable of measuring the measurement site of the user. The measurement support apparatus according to claim 1, further comprising determination means for determining.   The measurement support apparatus according to claim 2, further comprising a communication unit that transmits a signal for instructing a measurement start to the measurement device when the determination unit determines that the measurement is possible. Physique information acquisition means for acquiring physique information related to the physique of the user,
The measurement support apparatus according to claim 1, wherein the image generation unit adjusts the size of the guide image in the superimposed image based on the physique information.   The measurement support apparatus according to claim 1, wherein the image generation unit changes a position of the guide image with respect to the measurement device in the superimposed image. Acquiring a device image including a measuring device;
Based on the device image, generating a superimposed image in which a guide image for guiding a measurement site to a measurement position of the measurement device is superimposed on the device image;
Displaying the superimposed image, and
The guide image includes a part image indicating a part of the body to be measured by the measuring device,
The step of generating the superimposed image is a measurement support method in which the part image is superimposed on the predetermined measurement position of the measuring device. Measuring equipment;
Image acquisition means for acquiring a device image including the measurement device;
Based on the device image, image generating means for generating a superimposed image in which a guide image for guiding a measurement site to a measurement position of the measurement device is superimposed on the device image;
Display means for displaying the superimposed image,
The guide image includes a part image indicating a part of the body to be measured by the measuring device,
The measurement support system in which the image generation means superimposes the part image on the predetermined measurement position of the measurement device. On the computer,
Acquiring a device image including a measuring device;
Based on the device image, generating a superimposed image in which a guide image for guiding a measurement site to a measurement position of the measurement device is superimposed on the device image;
Displaying the superimposed image; and
The guide image includes a part image indicating a part of the body to be measured by the measuring device,
The step of generating the superimposed image is a program for superimposing the part image on the predetermined measurement position of the measuring device. A measurement device capable of communicating with the measurement support apparatus according to any one of claims 1 to 5 ,
A communication means for receiving from the measurement support device a signal indicating that the position of the user's measurement site matches the predetermined measurement position of the measurement device;
Measurement means for starting the measurement of the measurement site of the user based on the signal indicating the coincidence;
Measuring instrument comprising.

Images