WO2016012516A1

WO2016012516A1 - Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction

Info

Publication number: WO2016012516A1
Application number: PCT/EP2015/066797
Authority: WO
Inventors: Daniel Petrus Marie Peeters
Original assignee: Modus Holding S.À.R.L.
Priority date: 2014-07-22
Filing date: 2015-07-22
Publication date: 2016-01-28
Also published as: NL2013234B1

Abstract

Head mounted display assembly, comprising a head mounted display arranged to be worn by a user, wherein said head mounted display comprises, a sensor assembly arranged to detect objects in a rear view sensing area direction of said user, when said head mounted display is being worn by said user, a processing unit communicatively coupled with said sensor assembly and arranged for determining whether detected objects are approaching said head mounted display and whether detected objects are within a predetermined distance from said head mounted display, an alerting unit communicatively coupled to said processing unit and arranged for providing an alert signal in case it is determined, by said processing unit, that a detected object is approaching said head mounted display and is within said predetermined distance from said head mounted display, said head mounted display assembly further comprising a smart device, such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to wirelessly provide said alert signal to said smart device, and wherein said smart device is arranged to alert said user via any of an auditive signal and a tactile signal

Description

Title: Head mounted display assembly comprising a sensor assembly having a rear view sensing area direction

Description

The present invention relates to a head mounted display assembly comprising a head mounted display.

A head mounted display (HMD) is an image or video display device which may be worn on the head of a user, or as part of a helmet. Either one eye or both eyes of the user are provided with small electronic display devices for displaying the image and/or video.

Head mounted displays are known in which displayed images are superimposed on a real-world view. This type of head mounted display can be referred to as an optical see-through head mounted display and generally requires the display devices to be positioned somewhere other than directly in front of the user's eyes. Some way of deflecting the displayed image so that the user may see it is then required. This might be through the use of a partially reflective mirror placed in front of the user's eyes so as to allow the user to see through the mirror but also to see a reflection of the output of the display devices.

Another type of head mounted display is known which allows the user to only see the displayed images. As such, the real world environment surrounding the user is then obscured. This type of device might be used, for example, for viewing movies or similar recorded content, or for viewing so-called virtual reality content representing a virtual space surrounding the user.

Originally, the development of head mounted display was mainly driven by military and professional applications of these head mounted display. Nowadays, head mounted displays are becoming increasingly popular for use by casual users in, for example, computer game or domestic applications.

The present invention is mainly directed to head mounted displays in which displayed images are superimposed on a real-world view, but can, alternatively, also be used in combination with a head mounted display in which the real world environment is obscured for the user.

A problem occurring with these known head mounted displays is that a user wearing these displays is less observant, i.e. the user is to a lesser extent aware of all kinds of the things occurring in the surrounding environment. This poses, amongst other, a safety risk for the user.

The above stated problem is especially the case in traffic situations. If a user is participating in the traffic, it may be preferred for the user not to wear a head mounted display as the user needs his/her devoted attention to surrounding traffic.

It is an object of the present invention to provide for a head mounted display assembly which can safely be used in any type of environment, for example in traffic situations.

The object is achieved in that there is provided, in a first aspect thereof, a head mounted display assembly, comprising:

a head mounted display arranged to be worn by a user, wherein said head mounted display comprises:

a sensor assembly arranged to detect objects in a rear view sensing area direction of said user, when said head mounted display is being worn by said user;

processing unit communicatively coupled with said sensor assembly and arranged for determining whether detected objects are approaching said head mounted display and whether detected objects are within a predetermined distance from said head mounted display;

alerting unit communicatively coupled to said processing unit and arranged for providing an alert signal in case it is determined, by said processing unit, that a detected object is approaching said head mounted display and is within said predetermined distance from said head mounted display;

- a smart device, such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to wirelessly provide said alert signal to said smart device, and wherein said smart device is arranged to alert said user via any of an auditive signal and a tactile signal.

The sensor assembly may comprise as any type of sensor, such as a camera, distance measurement device or the like. The rear view sensing area direction of the user is defined as the direction towards the rear side, i.e. back side, of the user when the head mounted display assembly is worn by the user. As such, the sensor assembly is arranged to detect any objects which are located or oriented behind the user. The processing unit may comprise a processor and a memory for performing different types of calculations for determining whether the detected objects are approaching the head mounted display assembly and whether the detected objects are within the predetermined distance from said user. The processing unit is communicatively coupled with the sensor assembly, for example, electronically wired, wirelessly, or may be comprised in a same printed circuit board as the sensor assembly.

According to the present invention, an object may be a vehicle participating in the traffic, like a car, truck, motor cycle or the like, or may be a bicycle, pedestrian, etc. Further, the present wording of the claim states that it is detected that an object is approaching the head mounted display. According to the present invention this may also include a static object, wherein the head mounted display is moving towards the object, i.e. the user is moving backwardly.

It was the insight of the inventor that the awareness of a user is improved in case the user is actively warned whenever an object is approaching the head mounted display from the rear side.

An advantage hereof is that a head mounted display assembly is no longer considered a hindress for the user, for example, in traffic situations, as the head mounted display assembly is actually pro-actively helping the user in these type of situations by alerting the user in case an object is approaching the user from the rear side.

One of the advantages of the present invention is that the assembly comprises a smart device, such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to wirelessly provide said alert signal to said smart device, and wherein said smart device is arranged to alert said user via any of an auditive signal and a tactile signal.

The advantage hereof is that the user is not scared whenever an alert signal is provided. It was the insight of the inventor that a smart watch, for example, may start to vibrate or to glow for efficiently alerting the user about the approaching detected object.

The smart device may be wirelessly coupled to the alerting unit, for example via a Bluetooth connection.

In an example, the head mounted display further comprises: a velocity sensor communicatively coupled to said processing unit and arranged for determining a velocity of said user, when said head mounted display is being worn by said user;

wherein said processing unit is arranged for determining whether detected objects are approaching said head mounted display by taking into account said determined velocity of said user.

It was the insight of the inventor that, in order to accurately determine whether the detected object is approaching the user, the velocity of itself, i.e. the user wearing the head mounted display, should be taken in to account.

The velocity sensor is, for example, any of a Global positioning system, GPS, sensor and an accelerometer.

In an example, the sensor assembly comprises a rangefinder for measuring a range from the sensor assembly to an object in said rear view sensing area of said user.

A rangefinder is a device arranged for measuring a distance between the device and the object. The devices may use active methods for measuring the distance, like an ultrasonic ranging module, laser rangefinder, a radar distance measurement. Other types of rangefinders measure the distance using trigonometry, i.e. stadiametric rangefinder and parallax, or coincidence, rangefinders.

The sensor assembly may be comprised with several rangefinders, wherein each rangefinder is arranged to sense a part of the complete rear view sensing area.

In another example, the processing unit is arranged for determining that said object is approaching said head mounted display when said measured range is smaller than a predefined range.

The predefined range may be set by the user beforehand. As such, the user may determine when an alerting signal should be sent, i.e. whenever the distance is for example smaller than 10 meter, 20 meter, 30 meter, or the like.

In a further example, the sensor assembly comprises a camera unit arranged for capturing images in said rear view sensing area direction of said user, and for detecting objects in said captured images. Here, the processing unit may be arranged for image processing comprising determining whether detected objects are approaching said head mounted display in subsequent captured images.

In an example, the alerting unit is arranged to project said captured images to said head mounted display in case it is determined that said detected object is approaching said head mounted display.

The images may be overlaid on the head mounted display such that the real world view as well as the images can be at the same time by the user.

In a further example, the processing unit is arranged for horizontally and/or vertically aligning said captured images with the horizon.

The advantage of this example is that for example the images are provided to the head mounted display in a uniform matter. This means that the orientation of the head of the user does not influence the captured images, as the images are corrected for, for example, the vertical tilting of the user's head. This provides a clear advantage, as in each case, the rear view image is aligned with, for example, the horizon.

In order to accomplish the above, the processing unit may be arranged to detect the horizon present in the images captured, and to subsequently alter the image such that the detected horizon is aligned horizontally, and vertically. Aligning vertically means, for example, that the detected horizon is placed somewhere in the middle of the altered image.

In an example, the alerting unit is arranged for providing an alert signal in the form of any of an auditive signal and a tactile signal.

The inventors noted that in certain situation is may be advantageous in case the alert signal is auditive or tactile. This may limit the risk for the user to startle, for example in case the image is suddenly shown on the head mounted display. An auditive or tactile alert signal is considered a less radical, or profound, way of alerting the user.

The alert signal may further be routed via earphones or a headset worn by the user.

In a further example, the head mounted display comprises two temples, wherein said sensor assembly is arranged in one of said temples. In accordance with the present invention, a temple is fixture connected to the front end of the head mounted display. The fixture is intended to be carried by the user's ears such that it provides stability to the head mounted display.

The advantage hereof is that the user does not need to set the rear view sensing area direction of the sensor assembly each time the head mounted display assembly is worn by the user. By integrating the sensor assembly in the temples, the rear view sensing area direction of the sensor assembly is automatically correctly set whenever the head mounted display is worn by the user.

In an even further example, the processing unit and said alerting unit are comprised in one of said temples.

In another example, an alert is displayed to the user in the form of a text message, a graphic image or the like, for example displayed on the head mounted display or on the smart device.

In a further example, the sensor assembly is arranged to detect objects in a rear view sensing area direction of said user, said rear view sensing area direction comprises a horizontal sensing area between 20 degrees and 90 degrees, preferably between 34 and 75 degrees, even more preferably between 50 and 70 degrees.

The above-mentioned and other features and advantages of the invention will be best understood from the following description referring to the attached drawings. In the drawings, like reference numerals denote identical parts or parts performing an identical or comparable function or operation.

The invention is not limited to the particular examples disclosed below in connection with a particular type of head mounted display assembly.

Brief description of the Drawings

Figure 1 discloses an example of a user wearing a head mounted display assembly according to the present invention.

Figures 2a and 2b disclose an example of a user wearing a head mounted display assembly according to the present invention, wherein the processing unit is arranged for horizontally and/or vertically aligning images captured. Figures 3a and 3b disclose a top view and a side view, respectively, of a head mounted display assembly detecting an object in its rear view.

Figure 4 discloses an example of a head mounted display assembly comprising a smart device according to the present invention.

Figure 1 discloses an example of a user 1 wearing a head mounted display assembly 8 according to the present invention.

The head mounted display assembly 7 comprises a head mounted display 2 arranged to be worn by the user 1 , a sensor assembly 6 arranged to detect objects 4 in a rear view sensing area direction 5 of said user 1 , a processing unit communicatively coupled with said sensor assembly 6 and arranged for determining whether detected objects 4 are approaching said head mounted display assembly 8, and an alerting unit communicatively coupled to said processing unit and arranged for providing an alert signal in case it is determined, by said processing unit, that a detected object is approaching said head mounted display.

In the present case the objected 4 detected by the sensor assembly 6 is a truck 6, which truck 6 is approaching the user 1 riding a bicycle 9. The user 1 is alarmed, i.e. triggered or alerted, that the truck 4 is approaching the user 1 . In the context of the present invention, approaching the head mounted display assembly 8 is the same as approaching the user 1 , as the user 1 is wearing the head mounted display assembly 8 in use.

The present example displays a direct advantage of the invention. The user 1 is made aware that the truck 4 is approaching, such that the user 1 is able to react appropriately to that fact. As such, the user 1 may, for example, move aside such that the truck 4 can easily overtake the user 1 without creating a hazardous situation. In a conventional situation, a hazardous situation may occur when the user 1 is not made aware of the truck 4 approaching, and overtaking the user 1 . The user 1 may, at the last moment, sense the presence of the truck 4, i.e. while the truck 8 is overtaking the user 1 , creating a startle from the user 1 , resulting in a hazardous situation.

The processing unit may be arranged to determine the distance 7 between the head mounted display assembly 8 and the detected object 4. In case the determined distance 7 is smaller than a predefined distance setting, than the processing unit determines that the detected object 4 is approaching the head mounted display assembly 8, resulting therein that a alert signal is provided by the alerting unit.

In the context of the above, approaching means that the distance 7 between detected object 4 and the head mounted display assembly 8 is, initially, larger than the predefined distance setting. Once the distance between the same detected object 4 and the head mounted display assembly 8 is, subsequently, smaller than the predefined distance setting it is determined that the detected object 4 is approaching the head mounted display assembly 8.

In the present example, the vertical sensing angle 3 of the sensor assembly 6 is approximately 30 degrees, but is preferable anywhere between 0 and 90 degrees, more preferably between 20 and 50 degrees, even more preferably between 30 and 40 degrees.

In an example of the present invention, the sensor assembly is chosen such that the vertical height of the sensing area at the predefined distance setting is approximately equal to the height of the head mounted display assembly 8 in use, i.e. when it is worn by the user 1 .

Figures 2a and 2b disclose an example of a user 1 wearing a head mounted display assembly 8 according to the present invention, wherein the processing unit is arranged for horizontally and/or vertically aligning images captured.

Here, the orientation of the head 1 1 of the user 1 differs in figure 2a compared to the orientation of the head 1 1 of the user 1 in figure 2b. In figure 2a, the orientation of the head 1 1 is such that it is in line with the surface area 12, i.e. in parallel with the surface area 12. As such, the sensing area direction of the sensor assembly is also parallel with the surface area 12 such that the processing unit does not need to compensate for any vertical alignment,

Figure 2b shows that the head 1 1 of the user 1 is facing downwardly. This would result therein that the sensing area direction of the sensor assembly would be facing the sky. As such, the inventors noted that the processing unit should be able to compensate herefor, such that captured images are aligned with the, for example, surface area 12.

Figures 3a and 3b disclose a top view 21 and a side view 22, respectively, of a head mounted display assembly 8 detecting an object 4 in its rear view. The rear view sensing direction 5 of the sensor assembly 6 has a horizontal angle 23, such that objects 4 which are not perfectly placed behind, i.e. in line, with the user 1 are also detected. The horizontal angle 23 of the sensor assembly 6, preferably makes an angle between 10 degrees and 60 degrees, more preferably between 20 and 45 degrees, and even more preferably around 40 degrees.

The distance 7 between the object 4 and the head mounted display 8 may be measured with a rangefinder, as explained above, but can also be determined with an imaging unit, wherein the distance is estimated, by the processing unit, based on subsequent captured images.

Figure 4 discloses an example of a head mounted display assembly 8 comprising a smart device 31 according to the present invention.

The head mounted display assembly 8 comprises a smart device 31 , such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to provide said alert signal to said smart device 31 , and wherein said smart device 31 is arranged to alert said user via any of an auditive signal and a tactile signal.

The smart device 31 may be coupled to the alerting unit via any of a Bluetooth connection or any other sort of short range wireless communication protocol.

In stead of making a direct connection with the alerting unit, the wireless device may also be arranged to directly connect to the processing unit, the head mounted display or the sensor assembly.

In the present example, the processing unit, the sensor assembly and the alerting unit are comprised within the temple 32 of the head mounted display 2. As shown, the temple 32 originates from the glasses at the front side of the head mounted display and run all the way to the back, i.e. to right after the ear of the user 1 . The temple at the left side of the head (not shown) and the temple 32 at the right side of the head of the user 1 may be connected to each other at the back side of the head, such that the sensor assembly can be efficiently integrated in the temple.

In order to power these electronic units, the temple may further comprise a (rechargeable) battery pack for powering the units / features present in the head mounted display assembly according to the present invention. The present invention is not limited to the embodiments as disclosed above, and can be modified and enhanced by those skilled in the art beyond the scope of the present invention as disclosed in the appended claims without having to apply inventive skills.

Claims

CLAI MS

1 . Head mounted display assembly, comprising:

a smart device, such as a smart phone or a smart watch, wirelessly coupled with said alerting unit, wherein said alerting unit is arranged to wirelessly provide said alert signal to said smart device, and wherein said smart device is arranged to alert said user via any of an auditive signal and a tactile signal.

2. Head mounted display assembly according to claim 1 , wherein said head mounted display further comprises:

a velocity sensor communicatively coupled to said processing unit and arranged for determining a velocity of said user, when said head mounted display is being worn by said user;

3. Head mounted display assembly according to claim 2, wherein said velocity sensor is any of a Global positioning system, GPS, sensor and an accelerometer.

4. Head mounted display assembly according to any of the previous claims, wherein said sensor assembly comprises a rangefinder for measuring a range from said sensor assembly to an object in said rear view sensing area of said user.

5. Head mounted display assembly according to claim 4, wherein said processing unit is arranged for determining that said object is approaching said head mounted display when said measured range is smaller than a predefined range.

6. Head mounted display assembly according to any of the previous claims, wherein said sensor assembly comprises a camera unit arranged for capturing images in said rear view sensing area direction of said user, and for detecting objects in said captured images.

7. Head mounted display assembly according to claim 6, wherein said processing unit is arranged for image processing comprising determining whether detected objects are approaching said head mounted display in subsequent captured images.

8. Head mounted display assembly according to any of the claims 5 - 6, wherein said alerting unit is arranged to project said captured images to said head mounted display in case it is determined that said detected object is approaching said head mounted display.

9. Head mounted display assembly according to claim 8, wherein said processing unit is arranged for horizontally and/or vertically aligning said captured images with the horizon.

10. Head mounted display assembly according to any of the previous claims, wherein said alerting unit is arranged for providing an alert signal in the form of any of an auditive signal and a tactile signal.

1 1 . Head mounted display assembly according to any of the previous claims, wherein said head mounted display comprises two temples and wherein said sensor assembly is arranged in one of said temples.

12. Head mounted display assembly according to any of the previous claims, wherein said processing unit and said alerting unit are comprised in one of said temples.

13. Head mounted display assembly according to any of the previous claims, wherein said sensor assembly is arranged to detect objects in a rear view sensing area direction of said user, said rear view sensing area direction comprises a horizontal sensing area between 20 degrees and 90 degrees, preferably between 34 and 75 degrees, even more preferably between 50 and 70 degrees.