WO2022130592A1 - ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法 - Google Patents

ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法 Download PDF

Info

Publication number
WO2022130592A1
WO2022130592A1 PCT/JP2020/047276 JP2020047276W WO2022130592A1 WO 2022130592 A1 WO2022130592 A1 WO 2022130592A1 JP 2020047276 W JP2020047276 W JP 2020047276W WO 2022130592 A1 WO2022130592 A1 WO 2022130592A1
Authority
WO
WIPO (PCT)
Prior art keywords
blood glucose
glucose level
bite
chews
mounted display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/047276
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
眞弓 中出
滋行 伊藤
治 川前
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Maxell Ltd
Original Assignee
Maxell Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Maxell Ltd filed Critical Maxell Ltd
Priority to JP2022569639A priority Critical patent/JPWO2022130592A1/ja
Priority to CN202080107503.2A priority patent/CN116490932A/zh
Priority to PCT/JP2020/047276 priority patent/WO2022130592A1/ja
Priority to US18/267,588 priority patent/US20240062875A1/en
Publication of WO2022130592A1 publication Critical patent/WO2022130592A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/60—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to nutrition control, e.g. diets
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display

Definitions

  • the present invention relates to a head-mounted display (HMD: Head Mount Display; hereinafter referred to as HMD) used in a mixed reality (MR: Mixed Reality) system that superimposes and displays a real space and a virtual space (also referred to as a virtual object). ..
  • HMD Head Mount Display
  • MR Mixed Reality
  • Patent Document 1 is a background technique in this technical field.
  • the food and the meal movement such as the bite amount and the number of chews are recognized from the camera image, and the standard for each bite amount and the number of chews is dynamically created from the standard bite amount for each dish. The point that the problem is estimated and output from the comparison between the created standard and the actual bite amount is described.
  • Patent Document 1 has a problem that the real-time relationship between the amount actually eaten and the increase in blood glucose level with respect to the amount eaten cannot be obtained, and the optimum dietary guidance for suppressing the blood glucose level within a certain range cannot be obtained.
  • the HMD is a device that is attached to the head and displays an image on a glasses-like or goggle-like display.
  • This device is equipped with a camera, a sensor for measuring the distance to an object, a plurality of sensors such as a GPS sensor for measuring a position, a CPU for performing image processing, a battery, and the like.
  • a GPS sensor for measuring a position
  • a CPU for performing image processing
  • a battery and the like.
  • non-invasive blood glucose level sensors that can measure blood glucose levels have been developed.
  • the present invention provides a specific eating method such as controlling the eating time so as not to eat early and recommending the order of eating by utilizing the HMD and the blood glucose level sensor. It is an object of the present invention to provide an HMD for controlling a blood glucose level and a blood glucose level management method used for the HMD by presenting it in real time and suppressing a rapid rise in the blood glucose level.
  • the present invention is, for example, an HMD that displays an AR object in a real space, and has a camera that captures a real space and obtains a captured image, a blood glucose level sensor that measures a blood glucose level, and a control device.
  • the control device determines the amount to be eaten in one bite and the time interval to the next bite from the information of the actual food obtained from the captured image and the information obtained from the blood glucose level sensor, and the amount to be eaten in one bite and the next The time interval up to a bite is displayed as an AR object.
  • an HMD capable of providing effective dietary guidance for suppressing a blood glucose level within a certain range, and a blood glucose level management method used therefor.
  • FIG. It is an appearance image figure of the HMD in Example 1.
  • FIG. It is a guide display example of the feeding method in Example 1. It is a display example of the recommended bite amount of the dish that the wearer of the HMD tries to eat in Example 1. It is a display example of the number of times of chewing in Example 1. It is an example of displaying the next recommended dish in Example 1. It is another guide display example of the feeding method in Example 1. It is a figure which imitated the relationship between the blood glucose level and the time required for a meal in Example 1. It is another guide display example of the feeding method in Example 1. It is a figure explaining the cooperation between the HMD and the mobile terminal in Example 1.
  • FIG. It is a hardware block diagram of HMD in Example 1.
  • FIG. 1 It is a processing flowchart of the initial setting of the blood glucose level management method in Example 1. It is a processing flowchart of the blood glucose level management method in Example 1.
  • FIG. 2 It is another example of the processing flowchart of the blood glucose level management method in Example 1.
  • FIG. It is a system block diagram for realizing the blood glucose level management method in Example 2.
  • FIG. It is an example of the database such as the amount of carbohydrates and fiber for each menu of the restaurant in Example 2.
  • It is a display example in the case of hypoglycemia in Example 3.
  • FIG. It is explanatory drawing of the display for showing a large amount of a bite in Example 4.
  • FIG. 1 is an external image diagram of the HMD used in this embodiment.
  • the HMD 100 includes a distance sensor that measures a distance that is the position of an object photographed by a display 10, a camera 20, a microphone 81, and a camera unit, and a movement that measures movements such as vibration and acceleration of the HMD. It has an acceleration sensor that is a detection sensor, a gyro sensor that measures rotation, various sensors 5 such as a blood glucose level sensor, a speaker 83, a battery 9 (not shown), and a control circuit (control device) 4.
  • the display 10 is a transmissive or semi-transparent display, and the wearer wearing the HMD 100 superimposes a virtual object or an image displayed on the display 10 on the outside view (augmented reality, hereinafter referred to as AR). Can be done.
  • AR augmented reality
  • FIG. 2 is an example of a guide display of the feeding method in this embodiment.
  • 201 is the display area of the display 10 of the HMD 100
  • 202 and 203 are AR objects
  • 204 is the actual dish.
  • the AR object 202 is the result of measuring the blood glucose level of the wearer of the HMD100 with the blood glucose level sensor.
  • the AR object 203 captures the entire dish with the camera 20, detects the classification of the dish and the ingredients from the image data and the database, and estimates the amount of sugar and the ease of absorbing the sugar from the sugar data of each dish. However, it shows the optimal order of cooking from the viewpoint of suppressing the rise in blood glucose level.
  • the wearer can determine the order in which the dishes are eaten.
  • the displayed order of eating is not compulsory, but is for reference only.
  • the entire dish is in the range of view, but it is not necessary to photograph the entire dish at once with the camera 20, and the dishes detected sequentially from the moving images taken by the camera 20 are captured. You may guess and display the order of eating only the dishes detected from the sugar content data of the detected dishes. In this case, for example, the wearer can find a dish numbered in the order of eating by looking over the entire dish.
  • the amount of each dish is measured from the three-dimensional data measured by the distance sensor and camera image processing, and the sugar mass of each dish is calculated together with the sugar data of the dish and ingredients, and the dishes and dishes that are good to eat.
  • the amount of may be determined and displayed. In this case, for example, dishes that are not recommended to be eaten are not numbered and are displayed to the effect that they are not recommended.
  • the recommended amount to eat may be displayed together with the order of eating.
  • the recommended amount to eat may be displayed numerically, for example, or an AR object indicating the recommended amount to eat or the area not to be eaten may be superimposed on the dish.
  • FIG. 3 is an example of displaying the recommended bite amount of the dish that the wearer of HMD100 intends to eat in this embodiment.
  • 310 is an AR object and indicates a bite amount.
  • the recommended amount is displayed in AR by a circle as shown in the AR object 310, and the amount to be taken with chopsticks or a spoon is guided. This bite-sized guidance is displayed when chopsticks, spoons, etc. approach the food to be eaten.
  • the AR object 310 is indicated by a circle here, it is possible to make the wearer more easily recognize the amount of food to be eaten by displaying it in 3D according to the actual food. In addition, the amount of the bite to be displayed is changed according to the food and the amount of change in the blood glucose level of the wearer.
  • FIG. 4 is an example of displaying the number of chews in this embodiment.
  • the same functions as those in FIG. 2 are designated by the same reference numerals, and the description thereof will be omitted.
  • (a) shows the display immediately after eating a bite.
  • 410 is an AR object that displays the time interval until the next bite is eaten, and calculates and displays the time interval until the next bite is eaten from the currently eaten dish and the amount of the bite.
  • Reference numeral 420 denotes an AR object that displays the number of chews, and displays the reference number of chews and the remaining number of chews from the reference number of chews starting to count the actual number of chews. For example, in 410, the time interval until the next bite is eaten is displayed as 30 seconds, and in 420, the standard number of chews is displayed as 30 times, and the remaining number of chews is displayed as 30 more times.
  • FIG. 4B shows a display showing a state in which 20 seconds have passed since the bite was eaten.
  • the time interval until the next bite is eaten is displayed as 10 seconds, and when 10 chews are detected in 20 seconds, in 420, the remaining chews are displayed as a message prompting to increase the number of chews. Display 20 more times.
  • the numerical values in 410 and 420 do not change from (a) to (b), but for example, 410 changes the display every second and 420 changes the display every time chewing.
  • FIG. 4C shows a display showing a state in which 30 seconds have passed since eating a bite.
  • the time interval until the next bite is eaten is displayed as 0 seconds, and when 20 chewing times are detected in 30 seconds, the remaining chewing times are displayed as 10 times in 420.
  • FIG. 4D is an example of determining whether or not to display that the food may be eaten only with the passage of time, and like FIG. 4C, the display shows a state in which 30 seconds have passed since the bite was eaten. ing.
  • FIG. 4D shows a case where only the passage of time is used as a criterion, and when 30 seconds, which is a predetermined time interval until the next bite is eaten, elapses, an AR object 430 indicating that the food is acceptable is displayed. Will be done.
  • FIG. 4 (c) when the number of chewing times 20 times is detected in 30 seconds, the remaining number of chewing times is displayed as 10 more times in 420.
  • FIG. 4 (e) is an example of determining whether to indicate whether or not to eat based on the passage of time and the number of chews, and like FIG. 4 (c), the display of the state in which 30 seconds have passed since the bite was eaten. Is shown. In addition, it is in a state where the number of chewing times is 30 or more. In this case, the AR object 440 indicating that it is okay to eat is displayed. Further, in 410, the time interval until the next bite is eaten is displayed as 0 seconds, and in 420, the remaining number of chews is displayed as 0 times. Note that 410 and 420 do not have to be displayed.
  • a display indicating that the number of chews is appropriate in the display area 201 for example, a message such as "Please continue eating at that tempo" or the like. You may put out a smile icon or the like.
  • FIG. 5 is an example of displaying the dish recommended to be eaten next in this embodiment.
  • the same functions as those in FIG. 2 are designated by the same reference numerals, and the description thereof will be omitted.
  • 510 is an AR object display in the order of eating next.
  • the order of eating is not compulsory, but the order of eating is recommended. If you have a lot of forgetfulness, it will be easier for the wearer to take appropriate actions by teaching them what they are doing now.
  • FIG. 6 is another guide display example of the feeding method in this embodiment.
  • the same functions as those in FIG. 2 are designated by the same reference numerals, and the description thereof will be omitted.
  • FIG. 6 (a) shows the blood glucose level detected by the blood glucose level sensor at the start of a meal, the recommended cooking order for suppressing the increase in the blood glucose level within a certain range, and the standard number of chews when eating the meal. It is a standard example at the beginning of the meal to be displayed.
  • the AR object 610 is the blood glucose level detected by the blood glucose level sensor
  • the AR object 620 is the recommended cooking order
  • the AR object 630 is an example of displaying the standard number of chews.
  • the measured blood glucose level may be displayed as it is as shown in FIG.
  • the normal value range is A
  • the value below the normal value range is B
  • the normal value range is displayed by C or the like. Further, the guidance of the recommended amount for one unit is displayed as described with reference to FIG.
  • the AR object 640 when eating a dish, the AR object 640 counts the number of chews and chews until the count reaches the standard count. This is an example of displaying a message related to mastication such as ".
  • FIG. 7 is a diagram simulating the relationship between the blood glucose level and the time required for eating.
  • the vertical axis shows the blood glucose level
  • the horizontal axis shows the time from the start of the meal.
  • 701 is a graph of changes in blood glucose level when eating at a standard rate
  • 702 is a graph of changes in blood glucose level when eating fast
  • 703 is a graph of changes in blood glucose level when eating slowly
  • 704 is a graph of changes in blood glucose level when eating slowly. It shows the maximum blood glucose level v1 when eating at a standard rate.
  • the blood glucose level reaches its peak about 60 minutes after a meal and returns to the blood glucose level before a meal about 120 minutes.
  • people who eat so-called fast-eating which takes significantly faster than the average time to eat, consume less short-term intake of carbohydrates and proteins that raise blood sugar levels than people who eat at the average time.
  • the rising curve of the blood glucose level becomes steep, and as a result, the peak value of the blood glucose level becomes large. For example, when eating at a standard speed, the blood glucose level becomes the maximum blood glucose level v1 at time t1 as shown in Graph 701.
  • the blood glucose level becomes maximum at time t2 ⁇ t1, and the value becomes larger than the maximum blood glucose level v1.
  • the blood glucose level becomes maximum at time t3> t1, and the value becomes smaller than the maximum blood glucose level v1.
  • the number of chews that is, to set the number of chews to a certain number or more (hereinafter referred to as the reference number). It is said.
  • FIG. 8 is another guide display example of the feeding method in this embodiment.
  • the same functions as those in FIGS. 2 and 6 are designated by the same reference numerals, and the description thereof will be omitted.
  • (a) measures the mastication speed with the HMD100, and when the mastication speed is high, in order to slow down the mastication speed, the display of the HMD100 displays blinking or the like for controlling the mastication speed.
  • AR object 810 displays a message to chew slowly in time with the blinking.
  • FIG. 8B displays C indicating that the blood glucose level is above the normal value range as shown in the AR object 610 when the blood glucose level measured during the meal is determined to be above a certain range. As shown in the AR object 820, it is displayed that the blood glucose level is above the normal value range. Furthermore, if it is judged that the increase in blood glucose level cannot be suppressed by increasing the number of chews, digestion of blood glucose by light exercise such as stepping is effective for lowering the blood glucose level. I went up to. Let's step on 15 times in time with the blinking. ”Is displayed. Whether or not the stepping has been carried out is grasped by the accelerometers of various sensors of the HMD 100, and when it is not carried out, a message prompting the execution again is displayed. Furthermore, if it is determined that the increase in blood glucose level cannot be suppressed, a message prompting the patient to stop eating may be displayed.
  • FIG. 8 (d) AR displays the recommended order of dishes to be eaten in order to effectively control the increase in blood glucose level.
  • the AR object 840 displays what you want to eat next so that you can eat the food in order. For example, "Next, let's eat the second dish.” Is displayed.
  • the reference number of chews is also displayed on the AR object 850.
  • FIG. 8 (e) is a display example in which, for example, the time from having breakfast to having lunch is about one hour earlier than the normal time.
  • AR object 860 display such as "Since the meal interval is short, let's chew slowly and eat.” If the time to eat the next meal is shortened, it is possible that the blood sugar level has not dropped sufficiently. Therefore, it is required to eat more slowly and more frequently.
  • the method of eating a meal that suppresses the increase in blood glucose level within a certain range based on the blood glucose level, the number of chews, the chewing speed, the meal menu from the camera image, etc. obtained from the sensor data of the HMD 100 is performed in real time. Instruct.
  • the blood glucose level is measured at regular intervals with respect to the blood glucose level at the start of a meal, and it is displayed that the blood glucose level shows an abnormal value only when the value exceeds a certain range. do.
  • the recommended order for eating is displayed when eating, it is not always the case that the food is eaten in order. Therefore, the recommended order is shown each time, and the dish that is desirable to be eaten next is made larger than other dishes and displayed in AR.
  • the number of chews, the chewing speed, etc. are displayed in AR as a feeding method for suppressing the increase in blood glucose level within a certain range, but the instruction may be notified by voice.
  • the blood glucose level collected by various sensors 5, the camera 20, the microphone 81, etc. of the HMD 100, the meal menu, the number of chewing times, the chewing speed, etc. are used to instantaneously adjust the increase in the blood glucose level within a certain range. It is determined whether mastication is being performed properly, and advanced processing is performed to determine the action to be taken, such as an instruction to increase the number of mastications and an instruction to encourage light exercise, and the instruction is displayed on the display 10 in AR. It is assumed that it is difficult to carry out these operations only with the HMD 100 at the processing speed of the control circuit of the HMD 100. In such a case, as shown in FIG.
  • the HMD 100 and the mobile terminal (smartphone) 200 are linked via the data communication 90, advanced processing is performed by the mobile terminal 200, and the HMD 100 performs data collection. This is possible by assigning tasks such as displaying the result of advanced processing on the mobile terminal 200 on the display 10 in an AR manner. A part of the text or the like may be displayed on the mobile terminal 200.
  • FIG. 10 is a hardware configuration diagram of the HMD in this embodiment.
  • the HMD 100 has a control circuit (control device) 4, a sensor 5, a communication processing device 6, a video processing device 7, an audio processing device 8, and a battery 9, which are connected by a system bus 3.
  • the control circuit 4 has a main processor 2, a RAM 41, a ROM 42, a flash memory 43, a button switch 91, a touch panel 92, and a timer 93.
  • the sensor 5 includes a GPS (Global Positioning System) receiver 51, a geomagnetic sensor 52, a distance sensor 53, an acceleration sensor 54, a gyro sensor 55, and a blood glucose level sensor 56.
  • the communication processing device 6 includes a Wi-Fi (registered trademark) communication device 61 and a BlueTooth (registered trademark) communication device 62.
  • the image processing device 7 has a camera (for outside and inside) 20 and a display 10.
  • the voice processing device 8 has a microphone 81, a codec 82, and a speaker 83.
  • the main processor 2 is a so-called CPU (central processing unit) or MPU (numerical arithmetic unit), and reads an operation program or information that realizes a predetermined function from the ROM 42 and the flash memory 43, and performs a predetermined process by software processing. , Controls the entire HMD100.
  • CPU central processing unit
  • MPU number of arithmetic unit
  • the system bus 3 is a data communication path that interconnects the main processor 2 and each component in the HMD 100.
  • the main processor 2 and each component in the HMD 100 transmit and receive various commands and data via the system bus 3.
  • the RAM 41 constitutes a rewritable program work area such as a work area used when the main processor 2 executes various programs.
  • the ROM 42 and the flash memory 43 store various programs for realizing the functions of the HMD 100, sensor information including operation setting values and detection values from sensors described later, and various display data such as virtual objects and contents.
  • the ROM 42 and the flash memory 43 are so-called non-volatile storages that hold the stored information even when the HMD 100 is not supplied with power from the outside.
  • the flash memory 43 stores an operation program downloaded from the network, various data created by the operation program, and the like. Each operation program stored in the flash memory 43 can be updated and expanded by a download process from each server device on the network. Further, the flash memory 43 can store contents such as moving images, still images, and sounds downloaded from the network. In addition, data such as moving images and still images taken by the camera 20 can be stored.
  • the RAM 41, ROM 42, and flash memory 43 are examples of storage, and even if other devices such as semiconductor device memory such as SSD (Solid State Drive) and a device such as a magnetic disk drive such as HDD (Hard Disc Drive) are used. good.
  • semiconductor device memory such as SSD (Solid State Drive)
  • HDD Hard Disc Drive
  • the main processor 2 acquires sensor information of each of the GPS receiver 51, the geomagnetic sensor 52, the distance sensor 53, the acceleration sensor 54, the gyro sensor 55, and the blood glucose level sensor 56. Further, the timer 93 acquires time measurement associated with each event such as mastication speed and possession time interval. The main processor 2 uses various sensor information to grasp the movement status such as the number of chews, the chewing speed, and stepping, calculate the blood glucose level, acquire the distance data to the object acquired by the camera, and further, the position, tilt, and direction of the HMD 100. , Motion, etc. are detected. Further, the HMD 100 may further include other sensors such as an illuminance sensor, a proximity sensor, and an altitude sensor.
  • the Wi-Fi communication device 61 and the BlueTooth communication device 62 transmit and receive data by wireless communication with the mobile terminal 200, and also connect to a network such as the Internet via a wireless access point or the like to send and receive data to and from each server on the network. I do.
  • the communication processing device 6 has a telephone network communication function, for example, a GSM (registered trademark) (Global System for Mobile Communications) system, a W-CDMA (Wideband Code Division Multiple Access) system, or a CDMA2000 system. , UMTS (Universal Mobile Telecommunications System) system and other 3rd generation mobile communication systems (hereinafter referred to as "3G"), or LTE (LongTerm Evolution) system, 4th generation (4G), 5th generation (5G) It may have a communication method called.
  • 3G Universal Mobile Telecommunications System
  • LTE LongTerm Evolution
  • 4G LongTerm Evolution
  • 5G 5th generation
  • the wireless communication function and the telephone network communication function are provided with a coding circuit, a decoding circuit, an antenna, and the like for each function. Further, the HMD 100 may be provided with another communication I / F such as an infrared communication I / F.
  • the camera 20 has a function of taking a picture of the outside of the HMD 100 (out-camera function in a mobile terminal (smartphone)), and the out-camera function includes taking a picture of the whole meal, taking a picture of each dish, and a spoon used for eating. Take a picture of the amount of food (the amount of food you can eat) that you actually scooped up with chopsticks or a spoon.
  • the camera 20 is a camera that inputs image data of surroundings and objects by converting the light input from the lens into an electric signal using an electronic device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) sensor. Is.
  • the display 10 is a display device such as a liquid crystal panel, and provides image data to the wearer of the HMD 100.
  • the HMD 100 includes a video RAM (not shown), and a virtual object, a video, a text, or the like is displayed on the screen of the display 10 by AR based on the image data input to the video RAM.
  • the display 10 is transparent or semi-transparent.
  • the microphone 81 converts the voice of the wearer of the HMD 100, surrounding sounds, etc. into voice data and inputs it.
  • the speaker 83 outputs voice information and the like.
  • the codec 82 performs coding / decoding processing of the coded voice signal, if necessary.
  • the button switch 91 and the touch panel 92 are operation devices for inputting operation instructions to the HMD 100.
  • the operation device is not limited to the button switch 91 and the touch panel 92.
  • an operation signal of the HMD 100 may be transmitted from another mobile terminal device (for example, a smartphone or a tablet terminal) connected by wire communication or wireless communication, the HMD 100 may receive the operation signal, and the operation may be performed according to the operation signal.
  • the voice may be input from the microphone 81, the main processor 2 may execute the voice recognition process to generate an operation signal, and control the operation of the HMD 100.
  • the blood glucose level sensor 56 may be provided in a wristwatch-type device separate from the HMD 100.
  • the configuration example of the HMD 100 shown in FIG. 10 includes a configuration that is not essential to this embodiment, the effect of this embodiment is not impaired even if the configuration is not provided with these. Further, a configuration (not shown) such as a digital broadcast receiving function and an electronic money payment function may be further added.
  • FIG. 11 is a processing flowchart of the initial setting of the blood glucose level management method for instructing the feeding method such as the number of chews and the time interval until the next bite so that the increase in blood glucose level in this embodiment is kept within a certain range.
  • the user of this system wears the HMD 100 and selects the start of the initial setting with the button switch 91.
  • step S2 the weight, height, age, gender, etc.
  • step S3 the blood glucose level, the heart rate, and the blood pressure are measured by using the blood glucose level sensor 56 of the sensor 5 of the HMD 100.
  • step S4 the size of the spoon used for meals is measured by taking a picture of the spoon with the camera 20. Further, in step S5, the amount of food for one spoon is calculated. Then, in step S6, a general number of chews based on the data input in step S2 is set. Then, in step S7, the data from steps S2 to S6 are stored in the flash memory 43 as personal basic data of the HMD100 wearer with an identification name.
  • step S8 the input data is confirmed, and if there are no changes or mistakes, the process proceeds to step S9 at the end of the initial setting, and the data in the flash memory is confirmed. If there are any changes or mistakes, the process returns to step S2 and the entire initial setting is restarted. It should be noted that only the applicable items may be corrected. Further, although the above has described the case of using a spoon, it goes without saying that other things such as chopsticks and forks may be used.
  • FIG. 12 is a processing flowchart of a blood glucose level management method that gives instructions for controlling a normal blood glucose level such as the number of chews in this embodiment.
  • step S100 the user of this system wears the HMD 100 and selects the start of a meal with the button switch 91. Taking home meals as an example, it is assumed that all meals are on the table.
  • step S10 the entire meal is photographed by the camera 20 to grasp what kind of food is available.
  • step S11 a rough type of dish is determined from the photographed dish, the amount of carbohydrate, fiber, etc. related to the blood glucose level of the dish is estimated, and the food to be eaten for slowing the rise of the blood glucose level. Perform ordering.
  • the increase in blood glucose level is controlled by controlling the amount of spoon and one bite of food to be used, the standard number of chews, the time interval to the standard next bite, and the like. Set to the program to be used.
  • step S12 when the meal is started in step S12, the recommended amount to be placed on the spoon is AR-displayed on the dish (see FIG. 3), and the actual amount is grasped. Then, in step S13, the amount actually eaten is grasped from the amount placed on the spoon and the amount remaining on the spoon, and the recommended number of times of chewing and the time interval until the next bite are analyzed and set. Then, in step S14, the number of chews analyzed and set in S13 and the time interval until the next bite are AR-displayed on the display 10.
  • step S15 various sensors 5 of the HMD 100 are used to count the actual number of chews and the time until the next bite is eaten, and display them (see FIG. 4 (c)).
  • step S16 it is determined whether or not the interval time until the next bite as a reference has elapsed, and if not, it returns to S14 and displays the remaining number of chewing times and time information.
  • the process proceeds to step S17, and an indication that the food is acceptable is displayed (see FIG. 4 (d)).
  • step S18 it is determined whether or not the user's eating action is detected, and if not, the time and the number of chewing times are continuously displayed and counted until the user returns to S14 and starts the next bite action.
  • the process proceeds to step S19, and the food residue is confirmed. If there is food left, the process proceeds to step S20, the blood glucose level is measured by the blood glucose level sensor of the HMD100, and it is checked whether the increased value is within a certain range (normal range). If it is normal, return to S11 and repeat the same procedure.
  • step S19 If there is no food left in step S19, the process proceeds to the blood glucose level follow-up process for observing how the blood glucose level in S20 measured last time fluctuates (S110). If the increase in blood glucose level exceeds a certain range (normal range) in step S20, it is determined that the blood glucose level is abnormal, and the process proceeds to the blood glucose abnormality processing (S210).
  • FIG. 13 is another example of the processing flowchart of the blood glucose level management method in this embodiment.
  • the same steps as in FIG. 12 are designated by the same reference numerals, and the description thereof will be omitted.
  • step S21 is added between steps S16 and S17.
  • step S16 if it is determined in step S16 that the interval time until the next bite as a reference has elapsed, the process proceeds to step S21, it is determined whether or not the reference number of chews has been cleared, and if it is cleared, it is determined.
  • the process proceeds to step S17, and a display indicating that the food is acceptable is displayed (see FIG. 4 (e)). That is, FIG. 13 is an example of determining whether to indicate whether or not the food may be eaten based on both the passage of time and the number of times of chewing. As a result, by making the prescribed number of chews, it becomes easier to obtain a feeling of fullness, it is possible to prevent overeating, and further, it is possible to suppress an increase in blood glucose level by leaving a time interval until the next bite.
  • FIG. 14 is a processing flowchart of blood glucose abnormality processing in this embodiment.
  • the blood glucose abnormality handling S210 first grasps the degree of the abnormal blood glucose level in step S150.
  • step S151 it is determined whether or not improvement is possible by changing the number of chewing times and the time interval until the next bite grasped in step S150.
  • step S151 If the result of step S151 is YES, the process proceeds to step S152, and a new number of chews and a time interval are set (S152). After that, processing is performed according to the processing flows of S14 to S20 and S110 described with reference to FIG.
  • step S151 If the result of step S151 is NO, the process proceeds to step S153, a light exercise such as stepping to lower the blood glucose level is selected, and the amount of exercise is calculated and set. Then, in step S154, the set exercise content (for example, stepping), the amount of exercise (for example, 20 times of stepping), and the like are displayed on the display 10.
  • step S153 a light exercise such as stepping to lower the blood glucose level is selected, and the amount of exercise is calculated and set.
  • step S154 the set exercise content (for example, stepping), the amount of exercise (for example, 20 times of stepping), and the like are displayed on the display 10.
  • step S155 it is determined by using various sensors 5 whether or not the displayed exercise is executed. If the result of step S155 is NO, the process returns to step S154 to urge the exercise to be performed. If the result of step S155 is YES, the process proceeds to the process of S20 described with reference to FIG.
  • FIG. 14 is described based on the processing flowchart of the blood glucose level management method of FIG. 12, it may be based on the processing flowchart of the blood glucose level management method of FIG. 13, and in that case, in steps S16 and S17. In the meantime, step S21 of FIG. 13 may be added.
  • FIG. 15 is a processing flowchart of the blood glucose level follow-up process in this embodiment.
  • the blood glucose level follow-up process S110 first measures the blood glucose level with the blood glucose level sensor 56 of the HMD 100 in step S111. Then, in step S112, blood pressure, heart rate, and the like are measured.
  • step S113 it is confirmed whether or not the blood glucose level measured in step S111 is within the normal range. If the result in step S113 is NO (abnormal), the process proceeds to step S153 for blood glucose abnormality processing in FIG. If the result in step S113 is OK (normal), the process proceeds to step S114, the patient waits for a predetermined time (for example, 10 minutes) after the measurement in step S111, and the number of measurements (for example, 3 times). Check if you have reached.
  • a predetermined time for example, 10 minutes
  • step S114 If the result in step S114 is NO, the process returns to step S111. If the result in step S114 is YES, the process proceeds to step S115, the increase curve of the blood glucose level is estimated from the plurality of acquired data in steps S111 and S112, and the blood glucose level per unit (amount of one unit) is estimated. Calculate the rising value.
  • step S116 along with the blood glucose level rise value, along with the cooking items (including image data) acquired in FIGS. 12 and 13, the estimated amount of carbohydrates, the amount of bite, the number of chews, and the interval time until the next bite. It is stored in personal data together with the identification name, and the initial setting data is supplemented and updated.
  • step S116 by updating the data accumulation and the initial setting data in step S116, the same kind of meal is usually provided at a constant frequency at home, so that the blood glucose level tends to rise and the food is cooked. It will be possible to effectively grasp the correlation with and to increase the accuracy of the feeding method that suppresses the rise in blood glucose level within a certain range.
  • the HMD having a non-invasive wearable blood glucose level sensor or the like is used to display an instruction on the number of chews to control the eating time so as not to eat prematurely, or to cook.
  • Present in real time at the time of meal such as recommending the order of eating.
  • FIG. 16 is a system configuration diagram for realizing the blood glucose level management method in this embodiment.
  • the user of this system wears the HMD 100, for example, in a restaurant.
  • the HMD 100 is linked to the mobile terminal 200 via the data communication 90, and the mobile terminal 200 can access the servers 170 to 175 on the restaurant side via the communication network (Internet) 160.
  • the servers 170 to 175 have databases 180 to 185.
  • Figure 17 shows an example of a database such as the amount of carbohydrates and fiber for each menu.
  • a database of predetermined restaurants holds the amount of food, the amount of carbohydrates, and the amount of fiber for each menu.
  • the HMD 100 connects to the database 180 to 185 of the amount of carbohydrates and fibers of the menu provided by the restaurant via the mobile terminal 200.
  • the HMD 100 uses the information in the databases 180 to 185 to determine the number of chews for each dish and the time interval until the next bite, and displays an instruction on the display 10.
  • the abnormal blood glucose level treatment in FIG. 14 is performed. Along with the execution, it is also possible to request the restaurants 170 to 175 to serve a small amount of food through the mobile terminal 200, which enables more effective treatment of abnormal blood glucose level. You can.
  • the restaurant side can also provide a service of controlling the rise in blood sugar level so that the person can enjoy a pleasant meal.
  • Examples 1 and 2 described a method for dealing with an increase in blood glucose level at the time of meal, but this example describes a method for dealing with hypoglycemia.
  • hypoglycemia is said to be more likely to occur due to a small amount of food, hard work or exercise on an empty stomach. In addition, it is said that if it becomes normal to consume too much sugar and calories such as snack drinks, carbonated drinks, and juice drinks, the pancreas becomes tired and overreaction occurs, resulting in abnormal insulin secretion, leading to hypoglycemia. It has been. Hypoglycemia causes lethargy, distraction, headache, nausea, etc., and when it becomes severe, it leads to a very dangerous situation such as coma.
  • the HMD 100 is always attached and connected to the mobile terminal 200 by data communication, not only at the time of meal. In this situation, blood glucose measurement is started. Then, when the blood glucose level is below a certain range, an instruction as shown in FIG. 18 is AR-displayed on the display 10 of the HMD 100.
  • FIG. 18A is a display when it can be inferred from the data of various sensors of the HMD100 that the person is exercising or working hard, and gives an instruction such as "The blood glucose level is low. Please refrain from exercising.” Display AR.
  • FIG. 19 is a processing flowchart corresponding to hypoglycemia in this embodiment.
  • the user wears the HMD 100 and selects the start of the corresponding program at the time of hypoglycemia with the button switch 91.
  • step S311 the elapsed time from eating is measured.
  • step S312 various sensors 5 of the HMD 100 are used to measure the heart rate, blood pressure, body temperature, etc., and grasp whether or not the person is exercising. Further, the blood glucose level is measured in step S313.
  • step S314 it is determined from the measurement data of S311 to S313 whether or not the blood glucose level corresponds to hypoglycemia, and each data and instruction content is stored in the flash memory as personal data.
  • step S314 determines how much the blood glucose is lower than the reference blood glucose. If the result of step S314 is NO (normal), the process waits for a certain period of time in step S320, and when the waiting time has passed, the process returns to step S311 and the measurement is repeated.
  • step S315 If the result of step S315 is slightly lower, the process proceeds to step S316, and a display such as taking sugar or stopping exercise is displayed. Then, the process proceeds to step S18, and the blood glucose level is measured in order to confirm the effect of step S316 to determine whether or not the blood glucose level is within the normal range. If the result of step S18 is YES (normal), the process returns to step S311. If the result of step S18 is NO (hypoglycemia level), the process returns to step S316 and the instruction is repeated.
  • step S315 If the result of step S315 is significantly reduced, the process proceeds to step S317, and a display such as urgent intake of sugar or discontinuation of exercise is performed. Then, the process proceeds to step S18, and the blood glucose level is measured to confirm the effect of step S317 to determine whether or not the blood glucose level is within the normal range (S18). If the result of step S18 is YES (normal), the process returns to step S311. If the result of step S18 is NO (hypoglycemia level), the process proceeds to step S318, and the emergency contact (or 119 emergency) is contacted using the voice data stored in the HMD 100 together with the location information (S318).
  • step S18 If the result of step S18 is NO (hypoglycemia level), the process proceeds to step S318, and the emergency contact (or 119 emergency) is contacted using the voice data stored in the HMD 100 together with the location information (S318).
  • the configuration for emergency contact is that the position data of the HMD100 wearer is generated by the mobile terminal 200 or the HMD100 based on the positioning data 770 of the GPS (Global Positioning System) from the artificial satellite 750, and the position data thereof is generated.
  • the mobile terminal 200 informs the family doctor 700 of physical information such as blood glucose level data, blood pressure, and heart rate as well as position data.
  • an HMD capable of coping with hypoglycemia by utilizing an HMD having a non-invasive wearable blood glucose level sensor and a blood glucose level management method used therefor.
  • Example 1 and 2 the number of chews is increased, and an instruction is displayed on the display of the HMD 100 to take an interval time until the next bite so that the meal time is sufficient and the meal amount is reduced. I tried to keep my blood sugar level within a certain range.
  • a method of deceiving the brain for example, a bite amount that makes the amount of food appear larger than the actual amount is used. Make it feel like you have eaten a lot by showing it more than the actual amount, and try to reduce the amount of food you eat.
  • FIG. 21 is a display example of the HMD 100 in this embodiment.
  • FIG. 21 is a display when trying to eat rice with chopsticks at the time of meal. A spoon may be used instead of chopsticks.
  • the recommended amount of one bite is AR-displayed as 310 in (a)
  • the recommended amount with chopsticks is captured as 320 in (b).
  • Guidance when the dish taken with chopsticks is brought to the mouth like 330 in (c), a larger amount (virtual one) is AR-displayed instead of the actually taken amount.
  • the amount of rice is felt to be large, so the amount of rice actually consumed is small.
  • the size of chopsticks and spoons As another method, reduce the size of chopsticks and spoons and display them in AR (replace chopsticks and spoons with virtual objects) and display them on the display 10. Since the chopsticks and spoons look small to the HMD100 wearer, the amount of rice is relatively large, and therefore the amount of rice actually consumed is small. Alternatively, instead of making the chopsticks and spoons smaller, the serving dish may be made smaller to make the dish look like a large amount (illusion).
  • Control circuit control device
  • 5 Sensor
  • 20 Camera
  • 53 Distance sensor
  • 54 Accelerometer
  • 55 Gyro sensor
  • 56 Blood glucose level sensor
  • 100 Head-mounted display (HMD)
  • 170, 175 Server
  • 180, 185 Database
  • 200 Mobile terminal (smartphone)
  • 201 Display area, 202, 203, 310-330, 410-440, 510, 610-640, 810-860
  • AR object 700: Primary care doctor

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Engineering & Computer Science (AREA)
  • Public Health (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Nutrition Science (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
PCT/JP2020/047276 2020-12-17 2020-12-17 ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法 Ceased WO2022130592A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2022569639A JPWO2022130592A1 (https=) 2020-12-17 2020-12-17
CN202080107503.2A CN116490932A (zh) 2020-12-17 2020-12-17 头戴式显示器及其使用的血糖值管理方法
PCT/JP2020/047276 WO2022130592A1 (ja) 2020-12-17 2020-12-17 ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法
US18/267,588 US20240062875A1 (en) 2020-12-17 2020-12-17 Head mounted display and blood sugar level management method employed in same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/047276 WO2022130592A1 (ja) 2020-12-17 2020-12-17 ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法

Publications (1)

Publication Number Publication Date
WO2022130592A1 true WO2022130592A1 (ja) 2022-06-23

Family

ID=82057483

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/047276 Ceased WO2022130592A1 (ja) 2020-12-17 2020-12-17 ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法

Country Status (4)

Country Link
US (1) US20240062875A1 (https=)
JP (1) JPWO2022130592A1 (https=)
CN (1) CN116490932A (https=)
WO (1) WO2022130592A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024177045A1 (ja) * 2023-02-21 2024-08-29 株式会社電通 咀嚼状態判定装置、咀嚼状態判定システム、咀嚼状態判定方法、咀嚼状態判定プログラム、制御装置、制御方法および制御判定プログラム

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7618452B2 (ja) * 2021-01-26 2025-01-21 マクセル株式会社 指タッピング計測処理端末、システム、方法およびコンピュータプログラム
JP2024142210A (ja) * 2023-03-29 2024-10-10 Kddi株式会社 摂食監視装置、方法及びプログラム
CA237745S (en) * 2023-04-24 2025-03-04 Sanofi China Invest Co Ltd Display screen with graphical user interface for drug administration management

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017111837A (ja) * 2011-07-05 2017-06-22 サウジ アラビアン オイル カンパニー 拡張現実感表示によって従業員に健康情報を提供するためのシステム、コンピュータ媒体およびコンピュータにより実行される方法
JP2017164556A (ja) * 2017-06-06 2017-09-21 株式会社吉田製作所 食生活管理装置
JP2018033624A (ja) * 2016-08-30 2018-03-08 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP2018201905A (ja) * 2017-06-06 2018-12-27 富士ゼロックス株式会社 情報処理装置及びプログラム

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9442100B2 (en) * 2013-12-18 2016-09-13 Medibotics Llc Caloric intake measuring system using spectroscopic and 3D imaging analysis
US20160132642A1 (en) * 2014-11-06 2016-05-12 Raz Carmi Device and method for monitoring food intake
US20170270820A1 (en) * 2016-03-18 2017-09-21 Icon Health & Fitness, Inc. Eating Feedback System

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017111837A (ja) * 2011-07-05 2017-06-22 サウジ アラビアン オイル カンパニー 拡張現実感表示によって従業員に健康情報を提供するためのシステム、コンピュータ媒体およびコンピュータにより実行される方法
JP2018033624A (ja) * 2016-08-30 2018-03-08 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
JP2017164556A (ja) * 2017-06-06 2017-09-21 株式会社吉田製作所 食生活管理装置
JP2018201905A (ja) * 2017-06-06 2018-12-27 富士ゼロックス株式会社 情報処理装置及びプログラム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024177045A1 (ja) * 2023-02-21 2024-08-29 株式会社電通 咀嚼状態判定装置、咀嚼状態判定システム、咀嚼状態判定方法、咀嚼状態判定プログラム、制御装置、制御方法および制御判定プログラム

Also Published As

Publication number Publication date
US20240062875A1 (en) 2024-02-22
JPWO2022130592A1 (https=) 2022-06-23
CN116490932A (zh) 2023-07-25

Similar Documents

Publication Publication Date Title
WO2022130592A1 (ja) ヘッドマウントディスプレイ及びそれに用いる血糖値管理方法
EP3079090B1 (en) Method for processing data and electronic device thereof
EP4216801B1 (en) Hydration tracking using baseline calibration
US9269119B2 (en) Devices and methods for health tracking and providing information for improving health
US10549173B2 (en) Sharing updatable graphical user interface elements
US20180204638A1 (en) Dynamic scale and accurate food measuring
US20160071423A1 (en) Systems and method for monitoring an individual's compliance with a weight loss plan
EP4252646A2 (en) Wearable electronic device and method for controlling the same
KR20160096070A (ko) 사용자의 음식 소비 정보를 캡처하기 위한 방법 및 시스템
KR20190084567A (ko) 음식과 관련된 정보를 처리하기 위한 전자 장치 및 방법
JP2011107768A (ja) 食行動改善支援システム
US20180345082A1 (en) Information processing apparatus and non-transitory computer readable medium
JP6648789B2 (ja) 電子機器及び情報送信方法
JPWO2016143404A1 (ja) 情報処理装置、情報処理方法、およびプログラム
JPWO2019021358A1 (ja) 食事アドバイス提供システムおよび分析装置
US20200297256A1 (en) Electronic device and method for notification of biometric information by electronic device
US12300375B2 (en) Early meal detection and calorie intake detection
JP4701039B2 (ja) 体に良い食事摂取をナビゲートする装置
KR102428570B1 (ko) 음식 이미지를 이용한 혈당 변화 예측 방법
KR20150037108A (ko) 헤드 마운트 디스플레이 및 그 제어 방법
KR20190048922A (ko) 스마트 테이블 및 스마트 테이블의 제어방법
JP2007054241A (ja) 携帯端末装置
CN119235132A (zh) 一种基于智能沙发的用餐互动方法、电子设备及存储介质
KR20260032863A (ko) 연속혈당측정장치 및 확장현실 글래스를 이용한 혈당 관리 시스템 및 혈당 관리 방법
JP2026018031A (ja) システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20965979

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202080107503.2

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2022569639

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 18267588

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20965979

Country of ref document: EP

Kind code of ref document: A1