NL2013234B1 - Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction. - Google Patents
Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction. Download PDFInfo
- Publication number
- NL2013234B1 NL2013234B1 NL2013234A NL2013234A NL2013234B1 NL 2013234 B1 NL2013234 B1 NL 2013234B1 NL 2013234 A NL2013234 A NL 2013234A NL 2013234 A NL2013234 A NL 2013234A NL 2013234 B1 NL2013234 B1 NL 2013234B1
- Authority
- NL
- Netherlands
- Prior art keywords
- display device
- user
- head display
- head mounted
- assembly
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0176—Head mounted characterised by mechanical features
-
- A—HUMAN NECESSITIES
- A42—HEADWEAR
- A42B—HATS; HEAD COVERINGS
- A42B3/00—Helmets; Helmet covers ; Other protective head coverings
- A42B3/04—Parts, details or accessories of helmets
- A42B3/0406—Accessories for helmets
- A42B3/0433—Detecting, signalling or lighting devices
- A42B3/046—Means for detecting hazards or accidents
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
Abstract
Head mounted display assembly, comprising a head mounted display arranged to be worn by a user, a sensor assembly arranged to detect objects in a rear view sensing area direction of said user, a processing unit communicatively coupled with said sensor assembly and arranged for determining whether detected objects are approaching said head mounted display assembly, an alerting unit communicatively coupled to said processing unit and arranged for providing an alert signal in case it is determined, by said processing unit, that a detected object is approaching said head mounted display.
Description
Title: Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction
Description
The present invention relates to a head mounted display assembly comprising a head mounted display. A head mounted display (HMD) is an image or video display device which may be worn on the head of a user, or as part of a helmet. Either one eye or both eyes of the user are provided with small electronic display devices for displaying the image and/or video.
Head mounted displays are known in which displayed images are superimposed on a real-world view. This type of head mounted display can be referred to as an optical see-through head mounted display and generally requires the display devices to be positioned somewhere other than directly in front of the user’s eyes. Some way of deflecting the displayed image so that the user may see it is then required. This might be through the use of a partially reflective mirror placed in front of the user’s eyes so as to allow the user to see through the mirror but also to see a reflection of the output of the display devices.
Another type of head mounted display is known which allows the user to only see the displayed images. As such, the real world environment surrounding the user is then obscured. This type of device might be used, for example, for viewing movies or similar recorded content, or for viewing so-called virtual reality content representing a virtual space surrounding the user.
Originally, the development of head mounted display was mainly driven by military and professional applications of these head mounted display. Nowadays, head mounted displays are becoming increasingly popular for use by casual users in, for example, computer game or domestic applications.
The present invention is mainly directed to head mounted displays in which displayed images are superimposed on a real-world view, but can, alternatively, also be used in combination with a head mounted display in which the real world environment is obscured for the user. A problem occurring with these known head mounted displays is that a user wearing these displays is less observant, i.e. the user is to a lesser extent aware of all kinds of the things occurring in the surrounding environment. This poses, amongst other, a safety risk for the user.
The above stated problem is especially the case in traffic situations. If a user is participating in the traffic, it may be preferred for the user not to wear a head mounted display as the user needs his/her devoted attention to surrounding traffic.
It is an object of the present invention to provide for a head mounted display assembly which can safely be used in any type of environment, for example in traffic situations.
The object is achieved in that there is provided, in a first aspect thereof, a head mounted display assembly, comprising: a head mounted display arranged to be worn by a user; a sensor assembly arranged to detect objects in a rear view sensing area direction of said user; processing unit communicatively coupled with said sensor assembly and arranged for determining whether detected objects are approaching said head mounted display assembly; alerting unit communicatively coupled to said processing unit and arranged for providing an alert signal in case it is determined, by said processing unit, that a detected object is approaching said head mounted display.
The sensor assembly may comprise as any type of sensor, such as a camera, distance measurement device or the like. The rear view sensing area direction of the user is defined as the direction towards the rear side, i.e. back side, of the user when the head mounted display assembly is worn by the user. As such, the sensor assembly is arranged to detect any objects which are located or oriented behind the user.
The processing unit may comprise a processor and a memory for performing different types of calculations for determining whether the detected objects are approaching the head mounted display assembly. The processing unit is communicatively coupled with the sensor assembly, for example, electronically wired, wirelessly, or may be comprised in a same printed circuit board as the sensor assembly.
According to the present invention, an object may be a vehicle participating in the traffic, like a car, truck, motor cycle or the like, or may be a bicycle, pedestrian, etc. Further, the present wording of the claim states that it is detected that an object is approaching the head mounted display. According to the present invention this may also include a static object, wherein the head mounted display is moving towards the object, i.e. the user is moving backwardly.
It was the insight of the inventor that the awareness of a user is improved in case the user is actively warned whenever an object is approaching the head mounted display from the rear side.
An advantage hereof is that a head mounted display assembly is no longer considered a hindress for the user, for example, in traffic situations, as the head mounted display assembly is actually pro-actively helping the user in these type of situations by alerting the user in case an object is approaching the user from the rear side.
In an example, the sensor assembly comprises a rangefinder for measuring a range from the sensor assembly to an object in said rear view sensing area of said user. A rangefinder is a device arranged for measuring a distance between the device and the object. The devices may use active methods for measuring the distance, like an ultrasonic ranging module, laser rangefinder, a radar distance measurement. Other types of rangefinders measure the distance using trigonometry, i.e. stadiametric rangefinder and parallax, or coincidence, rangefinders.
The sensor assembly may be comprised with several rangefinders, wherein each rangefinder is arranged to sense a part of the complete rear view sensing area.
In another example, the processing unit is arranged for determining that said object is approaching said head mounted display when said measured range is smaller than a predefined range.
The predefined range may be set by the user beforehand. As such, the user may determine when an alerting signal should be sent, i.e. whenever the distance is for example smaller than 10 meter, 20 meter, 30 meter, or the like.
In a further example, the sensor assembly comprises a camera unit arranged for capturing images in said rear view sensing area direction of said user, and for detecting objects in said captured images.
Here, the processing unit may be arranged for image processing comprising determining whether detected objects are approaching said head mounted display in subsequent captured images.
In an example, the alerting unit is arranged to project said captured images to said head mounted display in case it is determined that said detected object is approaching said head mounted display.
The images may be overlaid on the head mounted display such that the real world view as well as the images can be at the same time by the user.
In a further example, the processing unit is arranged for horizontally and/or vertically aligning said captured images with the horizon.
The advantage of this example is that for example the images are provided to the head mounted display in a uniform matter. This means that the orientation of the head of the user does not influence the captured images, as the images are corrected for, for example, the vertical tilting of the user’s head. This provides a clear advantage, as in each case, the rear view image is aligned with, for example, the horizon.
In order to accomplish the above, the processing unit may be arranged to detect the horizon present in the images captured, and to subsequently alter the image such that the detected horizon is aligned horizontally, and vertically. Aligning vertically means, for example, that the detected horizon is placed somewhere in the middle of the altered image.
In an example, the alerting unit is arranged for providing an alert signal in the form of any of an auditive signal and a tactile signal.
The inventors noted that in certain situation is may be advantageous in case the alert signal is auditive or tactile. This may limit the risk for the user to startle, for example in case the image is suddenly shown on the head mounted display. An auditive or tactile alert signal is considered a less radical, or profound, way of alerting the user.
The alert signal may further be routed via earphones or a headset worn by the user.
In a further example, the head mounted display comprises two temples and wherein said sensor assembly is arranged in one of said temples.
In accordance with the present invention, a temple is fixture connected to the front end of the head mounted display. The fixture is intended to be carried by the user’s ears such that it provides stability to the head mounted display.
The advantage hereof is that the user does not need to set the rear view sensing area direction of the sensor assembly each time the head mounted display assembly is worn by the user. By integrating the sensor assembly in the temples, the rear view sensing area direction of the sensor assembly is automatically correctly set whenever the head mounted display is worn by the user.
In an even further example, the processing unit and said alerting unit are comprised in one of said temples.
In an example, the head mounted display assembly comprises a smart device, such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to provide said alert signal to said smart device, and wherein said smart device is arranged to alert said user via any of an auditive signal and a tactile signal.
In another example, an alert is displayed to the user in the form of a text message, a graphic image or the like, for example displayed on the head mounted display or on the smart device.
In a further example, the sensor assembly is arranged to detect objects in a rear view sensing area direction of said user, said rear view sensing area direction comprises a horizontal sensing area between 20 degrees and 90 degrees, preferably between 34 and 75 degrees, even more preferably between 50 and 70 degrees.
The above-mentioned and other features and advantages of the invention will be best understood from the following description referring to the attached drawings. In the drawings, like reference numerals denote identical parts or parts performing an identical or comparable function or operation.
The invention is not limited to the particular examples disclosed below in connection with a particular type of head mounted display assembly.
Brief description of the Drawings
Figure 1 discloses an example of a user wearing a head mounted display assembly according to the present invention.
Figures 2a and 2b disclose an example of a user wearing a head mounted display assembly according to the present invention, wherein the processing unit is arranged for horizontally and/or vertically aligning images captured.
Figures 3a and 3b disclose a top view and a side view, respectively, of a head mounted display assembly detecting an object in its rear view.
Figure 4 discloses an example of a head mounted display assembly comprising a smart device according to the present invention.
Figure 1 discloses an example of a user 1 wearing a head mounted display assembly 8 according to the present invention.
The head mounted display assembly 7 comprises a head mounted display 2 arranged to be worn by the user 1, a sensor assembly 6 arranged to detect objects 4 in a rear view sensing area direction 5 of said user 1, a processing unit communicatively coupled with said sensor assembly 6 and arranged for determining whether detected objects 4 are approaching said head mounted display assembly 8, and an alerting unit communicatively coupled to said processing unit and arranged for providing an alert signal in case it is determined, by said processing unit, that a detected object is approaching said head mounted display.
In the present case the objected 4 detected by the sensor assembly 6 is a truck 6, which truck 6 is approaching the user 1 riding a bicycle 9. The user 1 is alarmed, i.e. triggered or alerted, that the truck 4 is approaching the user 1. In the context of the present invention, approaching the head mounted display assembly 8 is the same as approaching the user 1, as the user 1 is wearing the head mounted display assembly 8 in use.
The present example displays a direct advantage of the invention. The user 1 is made aware that the truck 4 is approaching, such that the user 1 is able to react appropriately to that fact. As such, the user 1 may, for example, move aside such that the truck 4 can easily overtake the user 1 without creating a hazardous situation. In a conventional situation, a hazardous situation may occur when the user 1 is not made aware of the truck 4 approaching, and overtaking the user 1. The user 1 may, at the last moment, sense the presence of the truck 4, i.e. while the truck 8 is overtaking the user 1, creating a startle from the user 1, resulting in a hazardous situation.
The processing unit may be arranged to determine the distance 7 between the head mounted display assembly 8 and the detected object 4. In case the determined distance 7 is smaller than a predefined distance setting, than the processing unit determines that the detected object 4 is approaching the head mounted display assembly 8, resulting therein that a alert signal is provided by the alerting unit.
In the context of the above, approaching means that the distance 7 between detected object 4 and the head mounted display assembly 8 is, initially, larger than the predefined distance setting. Once the distance between the same detected object 4 and the head mounted display assembly 8 is, subsequently, smaller than the predefined distance setting it is determined that the detected object 4 is approaching the head mounted display assembly 8.
In the present example, the vertical sensing angle 3 of the sensor assembly 6 is approximately 30 degrees, but is preferable anywhere between 0 and 90 degrees, more preferably between 20 and 50 degrees, even more preferably between 30 and 40 degrees.
In an example of the present invention, the sensor assembly is chosen such that the vertical height of the sensing area at the predefined distance setting is approximately equal to the height of the head mounted display assembly 8 in use, i.e. when it is worn by the user 1.
Figures 2a and 2b disclose an example of a user 1 wearing a head mounted display assembly 8 according to the present invention, wherein the processing unit is arranged for horizontally and/or vertically aligning images captured.
Here, the orientation of the head 11 of the user 1 differs in figure 2a compared to the orientation of the head 11 of the user 1 in figure 2b. In figure 2a, the orientation of the head 11 is such that it is in line with the surface area 12, i.e. in parallel with the surface area 12. As such, the sensing area direction of the sensor assembly is also parallel with the surface area 12 such that the processing unit does not need to compensate for any vertical alignment,
Figure 2b shows that the head 11 of the user 1 is facing downwardly. This would result therein that the sensing area direction of the sensor assembly would be facing the sky. As such, the inventors noted that the processing unit should be able to compensate herefor, such that captured images are aligned with the, for example, surface area 12.
Figures 3a and 3b disclose a top view 21 and a side view 22, respectively, of a head mounted display assembly 8 detecting an object 4 in its rear view.
The rear view sensing direction 5 of the sensor assembly 6 has a horizontal angle 23, such that objects 4 which are not perfectly placed behind, i.e. in line, with the user 1 are also detected. The horizontal angle 23 of the sensor assembly 6, preferably makes an angle between 10 degrees and 60 degrees, more preferably between 20 and 45 degrees, and even more preferably around 40 degrees.
The distance 7 between the object 4 and the head mounted display 8 may be measured with a rangefinder, as explained above, but can also be determined with an imaging unit, wherein the distance is estimated, by the processing unit, based on subsequent captured images.
Figure 4 discloses an example of a head mounted display assembly 8 comprising a smart device 31 according to the present invention.
The head mounted display assembly 8 comprises a smart device 31, such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to provide said alert signal to said smart device 31, and wherein said smart device 31 is arranged to alert said user via any of an auditive signal and a tactile signal.
The smart device 31 may be coupled to the alerting unit via any of a Bluetooth connection or any other sort of short range wireless communication protocol.
In stead of making a direct connection with the alerting unit, the wireless device may also be arranged to directly connect to the processing unit, the head mounted display or the sensor assembly.
In the present example, the processing unit, the sensor assembly and the alerting unit are comprised within the temple 32 of the head mounted display 2. As shown, the temple 32 originates from the glasses at the front side of the head mounted display and run all the way to the back, i.e. to right after the ear of the user 1. The temple at the left side of the head (not shown) and the temple 32 at the right side of the head of the user 1 may be connected to each other at the back side of the head, such that the sensor assembly can be efficiently integrated in the temple.
In order to power these electronic units, the temple may further comprise a (rechargeable) battery pack for powering the units / features present in the head mounted display assembly according to the present invention.
The present invention is not limited to the embodiments as disclosed above, and can be modified and enhanced by those skilled in the art beyond the scope of the present invention as disclosed in the appended claims without having to apply inventive skills.
Claims (12)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
NL2013234A NL2013234B1 (en) | 2014-07-22 | 2014-07-22 | Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction. |
PCT/EP2015/066797 WO2016012516A1 (en) | 2014-07-22 | 2015-07-22 | Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
NL2013234A NL2013234B1 (en) | 2014-07-22 | 2014-07-22 | Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction. |
Publications (1)
Publication Number | Publication Date |
---|---|
NL2013234B1 true NL2013234B1 (en) | 2016-08-16 |
Family
ID=51660563
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
NL2013234A NL2013234B1 (en) | 2014-07-22 | 2014-07-22 | Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction. |
Country Status (2)
Country | Link |
---|---|
NL (1) | NL2013234B1 (en) |
WO (1) | WO2016012516A1 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2550318A (en) * | 2016-03-11 | 2017-11-22 | Zhang Xiaoyang | Cyclist accessory system |
GB2571134B (en) * | 2018-02-20 | 2022-05-11 | John Pollard Darren | Protective headgear |
DE102021126401A1 (en) | 2021-10-12 | 2023-04-13 | Ifm Electronic Gmbh | Ski helmet with a safety device |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000095169A (en) * | 1998-09-25 | 2000-04-04 | Akebono Brake Ind Co Ltd | Safety device for bicycle |
US20030026461A1 (en) * | 2001-07-31 | 2003-02-06 | Andrew Arthur Hunter | Recognition and identification apparatus |
GB2386732A (en) * | 2002-03-06 | 2003-09-24 | Antony Gary Ward | Motorcycle collision prevention apparatus |
JP2003300492A (en) * | 2002-04-09 | 2003-10-21 | Toto Ltd | Collision preventive device for bicycle |
KR20090067415A (en) * | 2007-12-21 | 2009-06-25 | 휴롭 주식회사 | Multi-functional helmet |
KR20110027150A (en) * | 2009-09-09 | 2011-03-16 | (주)씨클론 | Bicycle control system and method for the same |
GB2490905A (en) * | 2011-05-17 | 2012-11-21 | Dave Lacey | Proximity alarm to alert HGV or LGV that a cyclist or motorbike is approaching |
US20130128046A1 (en) * | 2011-11-23 | 2013-05-23 | Jeffrey L. Gindin | Camera equipped helmet |
US20130141576A1 (en) * | 2011-12-01 | 2013-06-06 | Richard T. Lord | Determining threats based on information from road-based devices in a transportation-related context |
US8510869B1 (en) * | 2012-02-23 | 2013-08-20 | Dennis Drake McCrady | Rear looking snow helmet |
US20130305437A1 (en) * | 2012-05-19 | 2013-11-21 | Skully Helmets Inc. | Augmented reality motorcycle helmet |
WO2013190766A1 (en) * | 2012-06-18 | 2013-12-27 | ソニー株式会社 | Image display device, image display program, and image display method |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101300797B1 (en) * | 2011-04-07 | 2013-08-29 | 서울대학교산학협력단 | Obstacle detection device and bicycle and helmet using the same |
-
2014
- 2014-07-22 NL NL2013234A patent/NL2013234B1/en not_active IP Right Cessation
-
2015
- 2015-07-22 WO PCT/EP2015/066797 patent/WO2016012516A1/en active Application Filing
Patent Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000095169A (en) * | 1998-09-25 | 2000-04-04 | Akebono Brake Ind Co Ltd | Safety device for bicycle |
US20030026461A1 (en) * | 2001-07-31 | 2003-02-06 | Andrew Arthur Hunter | Recognition and identification apparatus |
GB2386732A (en) * | 2002-03-06 | 2003-09-24 | Antony Gary Ward | Motorcycle collision prevention apparatus |
JP2003300492A (en) * | 2002-04-09 | 2003-10-21 | Toto Ltd | Collision preventive device for bicycle |
KR20090067415A (en) * | 2007-12-21 | 2009-06-25 | 휴롭 주식회사 | Multi-functional helmet |
KR20110027150A (en) * | 2009-09-09 | 2011-03-16 | (주)씨클론 | Bicycle control system and method for the same |
GB2490905A (en) * | 2011-05-17 | 2012-11-21 | Dave Lacey | Proximity alarm to alert HGV or LGV that a cyclist or motorbike is approaching |
US20130128046A1 (en) * | 2011-11-23 | 2013-05-23 | Jeffrey L. Gindin | Camera equipped helmet |
US20130141576A1 (en) * | 2011-12-01 | 2013-06-06 | Richard T. Lord | Determining threats based on information from road-based devices in a transportation-related context |
US8510869B1 (en) * | 2012-02-23 | 2013-08-20 | Dennis Drake McCrady | Rear looking snow helmet |
US20130305437A1 (en) * | 2012-05-19 | 2013-11-21 | Skully Helmets Inc. | Augmented reality motorcycle helmet |
WO2013190766A1 (en) * | 2012-06-18 | 2013-12-27 | ソニー株式会社 | Image display device, image display program, and image display method |
Also Published As
Publication number | Publication date |
---|---|
WO2016012516A1 (en) | 2016-01-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11488366B2 (en) | Augmented reality lighting effects | |
US11765331B2 (en) | Immersive display and method of operating immersive display for real-world object alert | |
US9881422B2 (en) | Virtual reality system and method for controlling operation modes of virtual reality system | |
US9898868B2 (en) | Display device, method of controlling the same, and program | |
CN107852474B (en) | Head-mounted display | |
US10395116B2 (en) | Dynamically created and updated indoor positioning map | |
EP2893867B1 (en) | Detecting visual inattention based on eye convergence | |
US10298741B2 (en) | Method and device for assisting in safe driving of a vehicle | |
IL292427A (en) | Imaging modification, display and visualization using augmented and virtual reality eyewear | |
TWI614729B (en) | Warning system for virtual reality device and the warning method of the same | |
US20210112150A1 (en) | Divided Display of Multiple Cameras | |
KR20170051136A (en) | Method and apparatus for alerting to head mounted display user | |
CN103731659A (en) | Head-mounted display device | |
KR101629175B1 (en) | Multi-functional helmet | |
US10913355B2 (en) | Head-up display | |
NL2013234B1 (en) | Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction. | |
CN108621922A (en) | The control method of the display system of vehicle and the display system of vehicle | |
KR20150084200A (en) | A head mounted display and the method of controlling thereof | |
JP6717330B2 (en) | Eye-gaze detecting device, control method of the eye-gaze detecting device, method of detecting corneal reflection image position, and computer program | |
EP3012822B1 (en) | Display control device, display control method, display control program, and projection device | |
JP6321848B2 (en) | Wearable device | |
KR101517130B1 (en) | Safety driving system for vehicles | |
EP3012821B1 (en) | Display control device, display control method, display control program, and projection device | |
JP2019159917A (en) | Driving support device, vehicle, system and method | |
KR102627392B1 (en) | Infotainment system for the hearing impaired |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
HC | Change of name(s) of proprietor(s) |
Owner name: MODUS S.A.R.L.; LU Free format text: DETAILS ASSIGNMENT: CHANGE OF OWNER(S), CHANGE OF OWNER(S) NAME; FORMER OWNER NAME: MODUS HOLDING S.A.R.L. Effective date: 20161115 |
|
MM | Lapsed because of non-payment of the annual fee |
Effective date: 20170801 |