JPWO2020240470A5

JPWO2020240470A5 -

Info

Publication number: JPWO2020240470A5
Application number: JP2021571484A
Authority: JP
Publication date: 2023-05-24

Claims

A method of helping a user overcome disorientation, comprising:
determining a user confusion index;
causing a projector to emit electromagnetic radiation that is viewed by the user as an augmented reality disorientation graphic in response to the determined user confusion index meeting a predetermined threshold, wherein the electromagnetic radiation is at least partially so that it is reflected by an AR lens and directed toward the user's eyeball through a corrective lens ;
including
the AR lens is coupled to a frame configured to be worn on the user's head;
Method.

generating image data, via a camera, reproducible as one or more images generally corresponding to the user's field of view ;
estimating a motion component of the head of the user based at least in part on the generated image data;
2. The method of claim 1 , further comprising:

3. The method of claim 2 , wherein the field of view of the camera is substantially aligned with the optical axis of the correction lens.

The estimating of the movement component of the head of the user includes identifying an object included in two of the one or more images, and the two images generated at predetermined time intervals. 4. The method of claim 2 or claim 3 , comprising calculating the amount of movement of the object between images.

A method according to any one of claims 1 to 4 , further comprising emitting a sound audible to said user as a disorientation voice message via a speaker coupled to said frame.

a system,
a control system including one or more processors;
a memory in which machine-readable instructions are stored;
The control system is coupled to the memory, and the method of any one of claims 1 to 5 , wherein machine-executable instructions in the memory are executed by one of the one or more processors of the control system. executed when executed by at least one
system.

A system for assisting a user to overcome disorientation, comprising:
a housing configured to be coupled to a frame configured to be worn on a user's head;
an AR lens attached to the housing;
coupled to the housing to emit the electromagnetic radiation such that the electromagnetic radiation viewed by the user as an augmented reality disorientation graphic is at least partially reflected off the AR lens and directed toward the user's eyeballs; a projector configured to
a memory that stores machine-readable instructions;
a control system comprising one or more processors configured to execute the machine-readable instructions;
The machine-readable instructions are:
determine a user confusion index;
causing the projector to emit the electromagnetic radiation such that the augmented reality disorientation graphic is visible to the user when the determined user confusion index meets a predetermined threshold;
system.

8. The system of Claim 7 , further comprising a camera coupled to the housing and configured to generate image data.

The control system is further configured to estimate a motion component of the head of the user based, at least in part, on the generated image data, and the determination of the user confusion index is based on the estimated 9. The system of claim 8 , based at least in part on a moving component.

The system of any one of claims 7-9 , further comprising a motion sensor coupled to the housing and configured to generate motion data indicative of movement of the head of the user.

11. The system of claim 10 , wherein determining the user confusion index is based at least in part on the generated motion data.

11. The system of claim 10 , wherein the determining the user confusion index comprises estimating a motion component of the head of the user based at least in part on the generated motion data.

estimating the movement component of the head of the user comprises estimating angular velocity of the head, frequency of movement of the head, angular acceleration of the head, or any combination thereof; 13. The system of claim 12 .

13. The motion component of claim 12, wherein the movement component of the head of the user indicates that the user is shaking his head, looking around, looking forward or backward, or any combination thereof. system.

The system of any one of claims 10 to 14 , wherein said determining said user confusion index comprises estimating locomotion of said user based at least in part on said generated motion data. .

The system of any one of claims 10-15 , wherein the motion sensor is a gyroscope or an accelerometer.

The system of any one of claims 7-16 , wherein the housing is removable from the frame without the use of tools.

A system according to any one of claims 7 to 16 , wherein the housing is permanently connected to the frame.

The system of any one of claims 7-18 , wherein the control system is further configured to calibrate the projector based on the position of the housing along the frame.

The augmented reality disorientation graphic includes (i) text-based information indicating the user's current duties, (ii) reminders for the user to take certain medications at certain times. (iii) augmented reality directions; (iv) current day of the week, current year, current time, current season, or any combination thereof; (v) current event information; (vii) social media news feed information previously viewed by said user; (viii) rendering of a portion of websites previously viewed by said user; (ix) field of view of said user. (x) identifying information associated with said user, including information identifying the name of the person within, (x) said user's name, said user's home address, the user's spouse's name, or any combination thereof; (xi) or any combination of (i)-( x ).

a camera coupled to the housing and configured to generate image data;
a motion sensor connected to the housing and configured to generate motion data;
further comprising
The control system is further configured to estimate a motion component of the head of the user based at least in part on the generated image data and at least in part on the generated motion data. 8. The system of claim 7 , wherein:

22. The system of claim 21 , wherein determining the user confusion index is based at least in part on the estimated motion component.

The system of any one of claims 7-22 , further comprising a heartbeat sensor coupled to the housing and configured to generate heartbeat data.

24. The system of claim 23 , wherein said determination of said user confusion index is based at least in part on said generated heart rate data.

25. The system of claim 23 or claim 24, wherein the heart rate data is indicative of the user's heart rate, the user's heart rate variability between inspiration and expiration, or both.

further comprising a skin conductivity sensor coupled to the housing and configured to generate skin conductivity data;
wherein said determination of said user confusion index is based at least in part on generated skin conductivity data;
A system according to any one of claims 7-25 .

a camera connected to the housing and configured to generate image data;
a motion sensor connected to the housing and configured to generate motion data;
a heart rate sensor coupled to the housing and configured to generate heart rate data;
a skin conductivity sensor connected to the housing and configured to generate skin conductivity data;
further comprising
(ii) the generated motion data; (iii) the generated heart rate data; (iv) the generated skin conductivity data. , or (v) based at least in part on any combination of (i ) -(iv).