WO2015046669A1

WO2015046669A1 - Head mounted display device and method of controlling the same

Info

Publication number: WO2015046669A1
Application number: PCT/KR2013/011887
Authority: WO
Inventors: Jihwan Kim; Doyoung Lee; Sinae Chun; Eunhyung Cho
Original assignee: Lg Electronics Inc.
Priority date: 2013-09-26
Filing date: 2013-12-19
Publication date: 2015-04-02

Abstract

Disclosed is a Head Mounted Display (HMD) device. The head Mounted Display (HMD) device comprising: a rotation sensor unit configured to sense a rotation degree of the HMD device; a display unit configured to display visual information; and a processor configured to control the rotation sensor unit and the display unit, wherein, when providing a map image for guidance on a drive path, the processor is further configured to : acquire driver identification information regarding a user wearing the HMD device, the driver identification information indicating whether or not the user is a driver, and provide the map image in a stationary view mode when detecting that the user is the driver based on the acquired driver identification information, or provide the map image in a moving view mode when detecting that the user is not the driver based on the acquired driver identification information.

Description

HEAD MOUNTED DISPLAY DEVICE AND METHOD OF CONTROLLING THE SAME

The present disclosure relates to a head mounted display device, and more particularly to a head mounted display device, which provides a map image in various modes according to driver identification information, and a method of controlling the same.

A Head Mounted Display (HMD) may be worn on the head of a user like glasses. The user may receive information displayed on an HMD device. In particular, the HMD device may display a map image for guidance on a drive path, thus providing various information that the user needs when driving.

Typical HMD devices have displayed the same map image and provided the same information regardless of whether the user is the driver. Thus, typical HMD devices have a disadvantage in that they cannot provide the user with a customized friendly interface. This is because a driver who drives a vehicle and a passenger who simply rides in the vehicle may need different information.

Accordingly, there is a demand for an HMD device that may determine whether or not a user who wears the HMD device is a driver, thereby providing a map image in different modes based on a determined result.

Accordingly, the present disclosure is directed to a head mounted display device and a method of controlling the same that substantially obviate one or more problems due to limitations and disadvantages of the related art.

According to one embodiment, an object of the present disclosure is to provide an HMD device, which is configured to detect whether or not a user who wears the HMD device is a driver according to driver identification information, thereby providing a map image in different view modes, and a method of controlling the same.

According to another embodiment, an object of the present disclosure is to provide an HMD device, which is configured to acquire driver identification information via various ways, and a method of controlling the same.

According to another embodiment, an object of the present disclosure is to provide an HMD device, which is configured to perform switching between view modes of a map image according to a rotation degree of the HMD device, and a method of controlling the same.

According to another embodiment, an object of the present disclosure is to provide an HMD device, which is configured to perform switching between view modes of a map image according to a traveling velocity of the vehicle, and a method of controlling the same.

According to a further embodiment, an object of the present disclosure is to provide an HMD device, which is configured to provide traffic information and information regarding the surrounding environment according to driver identification information, and a method of controlling the same.

Additional advantages, objects, and features of the disclosure will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the disclosure. The objectives and other advantages of the disclosure may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

To achieve these objects and other advantages and in accordance with the purpose of the disclosure, as embodied and broadly described herein, a head Mounted Display (HMD) device comprising: a rotation sensor unit configured to sense a rotation degree of the HMD device; a display unit configured to display visual information; and a processor configured to control the rotation sensor unit and the display unit, wherein, when providing a map image for guidance on a drive path, the processor is further configured to : acquire driver identification information regarding a user wearing the HMD device, the driver identification information indicating whether or not the user is a driver, and provide the map image in a stationary view mode when detecting that the user is the driver based on the acquired driver identification information, or provide the map image in a moving view mode when detecting that the user is not the driver based on the acquired driver identification information.

It is to be understood that both the foregoing general description and the following detailed description of the present disclosure are exemplary and explanatory and are intended to provide further explanation of the disclosure as claimed.

As is apparent from the above description, according to an embodiment, an HMD device is configured to detect whether or not a user is a driver according to driver identification information to provide a driver and a passenger with a map image in different view modes, which may provide a user customized interface.

Further, according to another embodiment, an HMD device is configured to perform switching between view modes of a map image according to a rotation degree of the HMD device and/or a traveling velocity of the vehicle, which ensures appropriate switching between view modes of a map image according to traveling conditions of the vehicle.

Furthermore, according to a further embodiment, an HMD device provides traffic information and information regarding the surrounding environment according to driver identification information, which may provide the user with additional customized information.

The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the disclosure and together with the description serve to explain the principle of the disclosure. In the drawings:

FIG. 1 is a block diagram showing an HMD device according to an embodiment;

FIG. 2 is a view showing an HMD device that provides a map image according to an embodiment;

FIG. 3 is a view showing an embodiment of an HMD device that provides a map image in various modes according to driver identification information;

FIG. 4 is a view showing various embodiments of a method of acquiring driver identification information;

FIG. 5 is a view showing an embodiment of an HMD device that provides a map image in a stationary view mode or in a moving view mode according to driver identification information;

FIG. 6 is a view showing an embodiment of an HMD device that performs switching between view modes of a map image according to a rotation degree of the HMD device;

FIG. 7 is a view showing an embodiment of an HMD device that performs switching between view modes of a map image according to a traveling velocity of the vehicle; and

FIG. 8 is a flowchart showing a method of controlling an HMD device according to an embodiment.

Although the terms used in the following description are selected, as much as possible, from general terms that are widely used at present while taking into consideration the functions obtained in accordance with the embodiments, these terms may be replaced by other terms based on intensions of those skilled in the art, customs, emergence of new technologies, or the like. Also, in a particular case, terms that are arbitrarily selected by the applicant may be used. In this case, the meanings of these terms may be described in corresponding description parts of the disclosure. Accordingly, it should be noted that the terms used herein should be construed based on practical meanings thereof and the whole content of this specification, rather than being simply construed based on names of the terms.

Moreover, although the embodiments will be described herein in detail with reference to the accompanying drawings and content described in the accompanying drawings, it should be understood that the disclosure is not limited to or restricted by the embodiments.

The present disclosure relates to a head mounted display device (hereinafter referred to as ‘HMD device’), and more particularly to an HMD device that provides a map image in various modes according to driver identification information. Here, the HMD device may be a wearable computer or wearable device that is worn on the head of a user. In addition, in the present disclosure, a map image may refer to a graphic image that serves as a user interface for guidance on a drive path. The user may more easily reach a desired destination by driving a vehicle using the map image for guidance on a drive path. A more detailed description of the map image will follow with reference to FIG. 2.

FIG. 1 is a block diagram showing an HMD device according to an embodiment. In the present disclosure, the HMD device may include a rotation sensor unit 1010, a display unit 1020, a camera unit 1030, a communication unit 1040, and a processor 1050.

The rotation sensor unit 1010 may sense a rotation degree of the HMD device. More particularly, the rotation sensor unit 1010 may sense a rotation degree in the horizontal direction of the HMD device according to an embodiment. Here, the rotation degree may be a rotation angle of the HMD device that is rotated leftward or rightward under the assumption that a traveling direction is Zero degrees.

The rotation sensor unit 1010 may sense a rotation degree of the HMD device using at least one rotation sensing means provided in the HMD device, and transmit a sensed result to the processor 1050. In an embodiment, the rotation sensing means may include at least one of a gravity sensor, a camera sensor, a geomagnetic sensor, a gyro sensor, an accelerometer, an inclination sensor, a height sensor, a depth sensor, a pressure sensor, a gyroscope sensor, a proximity sensor, a rotation velocity sensor, a stroboscope sensor, a magnetic pickup sensor, a generator sensor, a Tacho generator sensor, an angular velocity sensor, and a Global Positioning System (GPS) sensor. It is noted that the rotation sensing means is not limited to the above-described embodiment, and may include various other sensing means that may be used to sense a rotation degree of the HMD device.

The display unit 1020 may display visual information. Here, the visual information may include various visually perceptible information, such as still images, moving images, text, photographs, pictures, and the like. In particular, in the present disclosure, the display unit 1020 may display a map image for guidance on a drive path. The display unit 1020 may display a map image as an augmented reality image displayed based on a real object. Alternatively, the display unit 1020 may display a map image as a virtual image. In this case, in an embodiment, the display unit 1020 may take the form of an optical see-through display panel.

The camera unit 1030 may capture an image within a view angle range. More specifically, the camera unit 1030 may capture an image within a view angle range of at least one camera sensor mounted to the HMD device. Moreover, the camera unit 1030 may transmit a captured result to the processor 1050.

The communication unit 1040 may perform communication with an external device and/or a web server using various protocols to receive and/or transmit data. More specifically, the communication unit 1040 may access a network in a wired or wireless manner to receive and/or transmit various digital data. In particular, in the present disclosure, the communication unit 1040 may transmit data regarding driver identification information to an external device, or may receive the same from the external device. In addition, the communication unit 1040 may perform pairing between the HMD device and the external device.

The camera unit 1030 and the communication unit 1040 as described above may be selectively provided in the HMD device according to embodiments.

The processor 1050 may execute various applications via processing of internal data of the HMD device. In addition, the processor 1050 may control the aforementioned respective units as well as transmission and/or reception of data between the units.

In particular, the processor 1050 may acquire driver identification information using the camera unit 1030 and/or the communication unit 1040 as described above. Here, the driver identification information may correspond to information regarding whether or not a user who wears the HMD device is a driver. The processor 1050 may acquire the driver identification information via various ways, and a more detailed description of this will follow with reference to FIG. 4. In addition, the processor 1050 may provide a map image in a stationary view mode or in a moving view mode based on the acquired driver identification information. A more detailed description of the stationary view mode and the moving view mode will follow with reference to FIG. 5.

Hereinafter, in the case which each step or operation to be performed by the HMD device begins or proceeds based upon sensing of a user input, it is noted that a procedure of generating and receiving a signal depending on the sensed user input is included in a description of the above step or operation even though the procedure is not repeatedly described. In addition, it is noted that the processor 1050 will be described as controlling the HMD device or at least one unit included in the HMD device according to a user input, and the processor 1050 and the HMD device may be regarded in the same light.

In FIG. 1 as a block diagram of the HMD device according to an embodiment, separately shown blocks logically distinguish elements of the HMD device. Accordingly, the elements of the above-described HMD device may be mounted as a single chip or a plurality of chips based on device design.

FIG. 2 is a view showing an HMD device that provides a map image according to an embodiment.

The HMD device of the present disclosure, designated by reference numeral 2010, may provide a map image. The map image may refer to a graphic user interface for guidance on a drive path. The user may more easily reach a desired destination by driving a vehicle using the map image for guidance on a drive path.

The HMD device 2010 may display a map image in various forms according to embodiments. In one embodiment, as exemplarily shown in FIG. 2, the HMD device 2010 may display a road or street image 2020 including a directional image that shows a map image for guidance on a drive path. In this case, the road image including the directional image may be referred to as a navigation image 2020. In another embodiment, the HMD device 2010 may display a directional image that shows a map image for guidance on a drive path based on a real object. In this case, the real object may be a road or street detected via a camera unit. That is, the HMD device 2010 may display a map image as an augmented reality image based on a real object. More specifically, the HMD device 2010 may detect a real object, and display a directional image in a region proximate to the real object, thereby providing guidance on a drive path. Alternatively, the HMD device 2010 may detect a real object, and display a directional image to overlap with the real object, thereby providing guidance on a drive path. As such, the HMD device 2010 may display a directional image based on a real object, thereby providing the user with augmented reality.

In the present disclosure, the HMD device 2010 may provide the map image 2020 in various view modes. More specifically, the HMD device 2010 may provide the map image 2020 in a stationary view mode or in a moving view mode. The stationary view mode may be a mode that provides the map image 2020 for guidance on a drive path when the viewpoint is stationary regardless of a rotation degree of the HMD device. The moving view mode may be a mode that provides the map image 2020 for guidance on a drive path when the viewpoint is moved according to rotation of the HMD device 2010. The HMD device 2010 may provide the map image 2020 in a stationary view mode or in a moving view mode according to driver identification information, and a more detailed description of this will follow with reference to FIG. 3.

Hereinafter, for convenience of description, the following description will focus upon the HMD device 2010 that provides a navigation image as a map image.

FIG. 3 is a view showing an embodiment of an HMD device that provides a map image in various modes according to driver identification information.

As described above, the HMD device may provide a map image in a stationary view mode 3030-1 or in a moving view mode 3030-2. In this case, the HMD device may provide the aforementioned view modes 3030-1 and 3030-2 based on acquired driver identification information. Here, the driver identification information may refer to information regarding whether or not the user who wears the HMD device is a driver 3010. The HMD device may detect that the user who wears the HMD device is the driver 3010 or is not the driver 3010 using the driver identification information. The HMD device may acquire the driver identification information via various ways in order to determine the view mode 3030-1 or 3030-2 to be provided, and a more detailed description of this will follow with reference to FIG. 4.

If the acquired driver identification information indicates that the user who wears the HMD device is the driver 3010, the HMD device may provide a map image in the stationary view mode 3030-1. Alternatively, if the acquired driver identification information indicates that the user who wears the HMD device is not the driver 3010, the HMD device may provide a map image in the moving view mode 3030-2. That is, the HMD device of the present disclosure may detect whether or not the user who wears the HMD device is the driver 3010, and provide a map image in different view modes.

This is because the driver 3010 who drives a vehicle is the subject of driving, and thus must focus upon driving differently from a passenger 3020 who simply rides in the vehicle. In the case in which the driver 3010 does not focus upon driving, a serious accident may occur. Accordingly, if it is detected that the user is the driver 3010, the HMD device may display a stationary map image that is not rotated according to a gaze direction of the user or an orientation of the user’s head, to help the driver focus upon driving. In addition, since the driver 3010 is the driving subject who recognizes a traveling direction of the vehicle, providing a map image based on the traveling direction of the vehicle in stationary viewpoint may reduce confusion of the driver 3010.

On the contrary, the passenger 3020 who is not the driving subject needs not focus upon driving like the driver. Rather, the passenger 3020 may focus more upon the scenery of a road than the driver. Accordingly, the HMD device may provide the passenger 3020 with a map image in the moving view mode 3030-2 that is rotatable according to a gaze direction of the passenger 3020 or an orientation of the user’s head. In this way, the HMD device may provide a map image in the dynamic view mode 3030-2 to assist the passenger 3020 in focusing more upon the scenery.

In an additional embodiment, the HMD device may provide different units of information regarding a drive path according to whether or not the user is the driver 3010. For instance, if it is detected that the user is the driver 3010, the HMD device may provide the user 3010 with traffic information regarding a drive path. Here, the traffic information may include information regarding various factors that have an effect on traffic, such as traffic conditions on a per road section basis, accidents, construction, and the like. On the contrary, if it is detected that the user is not the driver 3010, the HMD device may provide the user 3020 with information regarding the surrounding environment of a drive path. Here, the surrounding environment information may include a variety of units of information regarding surrounding environmental factors, such as surrounding restaurants, tourist destinations, rest areas, accommodations, and the like.

FIG. 4 is a view showing various embodiments of a method of acquiring driver identification information.

In one embodiment, the HMD device may acquire driver identification information by detecting a handle 4020 provided at a vehicle. In this case, the HMD device may acquire driver identification information by detecting the handle 4020 in front of the HMD device using a camera unit 4010. More specifically, the HMD device may set driver identification information to indicate that the user is a driver if the handle 4020 is detected using the camera unit 4010. On the contrary, the HMD device may set driver identification information to indicate that the user is not a driver if handle is not detected using the camera unit 4010.

In another embodiment, the HMD device may acquire driver identification information by detecting a selection input of a selection interface 4030. More specifically, the HMD device may set driver identification information according to a selection input to the selection interface 4030. For instance, the HMD device may display the selection interface 4030 to inquire whether or not the user is a driver as exemplarily shown in FIG. 4(B). If the user performs a selection input 4040 to indicate that the user is a driver on the selection interface 4030, the HMD device may set driver identification information to indicate that the user is a driver. On the contrary, if the user performs a selection input to indicate that the user is not a driver on the selection interface 4030, the HMD device may set driver identification information to indicate that the user is not a driver. In this case, the HMD device may provide a visual, auditory, or tactile selection interface 4030 and is not limited to the above-described embodiment.

In a further embodiment, the HMD device may acquire driver identification information from an external device. More specifically, the HMD device may acquire driver identification information by performing communication 4060 with the external device using a communication unit. In this case, the external device may acquire driver identification information via various ways to transmit the same to the HMD device. In one example, when detecting that the HMD device 4050 is located in a driver seat, the external device may perform transmission 4060 of driver identification information, indicating that the user is a driver, to a corresponding HMD device 4050. Alternatively, the external device may acquire fingerprint information from the user’s hand that grips a handle, and perform transmission 4060 of driver identification information indicating that the user is a driver to the HMD device 4050 that corresponds with the fingerprint information.

It is noted that the HMD device may acquire driver identification information via various other ways, and is not limited to the above-described embodiment. The HMD device may acquire driver identification information that is set according to embodiments, and provide a map image in a stationary view mode or in a moving view mode according to the acquired driver identification information.

FIG. 5 is a view showing an embodiment of an HMD device that provides a map image in a stationary view mode or in a moving view mode according to driver identification information.

The HMD device may provide a map image in a stationary view mode 5010 when detecting that the user is a driver 1 using driver identification information. If the HMD device provides a map image in the stationary view mode 5010, the HMD device may not rotate and display a map image even if the user 1 rotates the head and thus the HMD device is rotated. That is, if the HMD device provides a map image in the stationary view mode 5010, the HMD device may display a map image for guidance on a drive path when the viewpoint is stationary regardless of rotation of the HMD device. In this case, the stationary viewpoint may be determined based on a traveling direction of the vehicle.

On the contrary, the HMD device may provide a map image in a moving view mode 5020-1 when detecting that the user is a passenger 2 using driver identification information. If the HMD device provides a map image in the moving view mode 5020-1, the HMD device may display a rotated map image that is acquired as the HMD device is rotated to follow rotation of the head of the user 2.

For instance, if it is sensed that the HMD device is rotated counterclockwise by 45 degrees, the HMD device may rotate a map image 5020-2 clockwise by 45 degrees to display the rotated map image. In addition, if it is sensed that the HMD device is rotated counterclockwise by 90 degrees, the HMD device may rotate a map image 5020-3 clockwise by 90 degrees to display the rotated map image. That is, the HMD device may variably move a viewpoint according to rotation of the HMD device to display a map image for guidance on a drive path based on the moved viewpoint.

In this case, the HMD device may sense a rotation degree of the HMD device using a rotation sensor unit. The HMD device may move a reference viewpoint for guidance on a drive path according to a sensed rotation degree. As a result, the map image may be rotated and displayed according to a sensed rotation degree of the HMD device.

FIG. 6 is a view showing an embodiment of an HMD device that performs switching between view modes of a map image according to a rotation degree of the HMD device.

In one embodiment, the HMD device may perform switching between view modes based on a rotation degree of the HMD device. In other words, the HMD device may perform switching from a stationary view mode 6010 to a moving view mode 6020, or from the moving view mode 6020 to the stationary view mode 6010 according to a rotation degree of the HMD device.

More specifically, the HMD device may detect a rotation degree of the HMD device when detecting rotation of the HMD device while the HMD, which has detected that the user is a driver, is providing a map image in the stationary view mode 6010. In this case, if it is detected that the detected rotation degree is outside a predetermined rotation range, i.e. a first rotation range, the HMD device may perform switching from the stationary view mode 6010 that has been provided to the moving view mode 6020. That is, if a rotation degree of the HMD device is within the first rotation range, the HMD device may maintain the stationary view mode 6010. However, if a rotation degree of the HMD device is outside the first rotation range, the HMD device may perform switching from the stationary view mode 6010 to the moving view mode 6020.

On the contrary, when detecting rotation of the HMD device while the HMD, which has detected that the user is not a driver, is providing a map image in the moving view mode 6020, the HMD device may detect a rotation degree of the HMD device. In this case, if it is detected that the detected rotation degree enters a predetermined rotation range, i.e. a second rotation range, the HMD device may perform switching from the moving view mode 6020 that has been provided to the stationary view mode 6010. That is, if a rotation degree of the HMD device is outside the second rotation range, the HMD device may maintain the moving view mode 6020. However, if a rotation degree of the HMD device is within the second rotation range, the HMD device may perform switching from the moving view mode 6020 to the stationary view mode 6010.

The reason why the user turns their head leftward or rightward beyond a predetermined rotation angle range to keep their eyes leftward or rightward, rather than keeping their eyes forward, is that the user wishes to focus upon the scenery rather than focusing upon driving. On the contrary, the reason why the user turns their head to keep their eyes forward within a predetermined rotation angle range is that the user wishes to focus upon driving other than the scenery. Accordingly, the HMD device of the present disclosure may designate a predetermined rotation angle range, and perform switching from the moving view mode 6020 to the stationary view mode 6010 when entering the predetermined rotation angle range, or switching from the stationary view mode 6010 to the moving view mode 6020 when deviating from the predetermined rotation angle range, thereby providing a user interface in consideration of a gaze direction of the user and user intention.

Although not shown in the drawings, in an additional embodiment, the HMD device may separately set a third rotation range to additionally provide a voice guide that provides voice navigation. Here, the voice navigation may represent guidance on a drive path using sound or voice that is perceivable via the user’s auditory senses. For instance, the HMD device may provide the voice navigation that provides guidance on a drive path when detecting that a rotation degree of the HMD device is outside a third rotation range. This serves to provide a driver with various types of navigation.

In addition, if deviation from the third rotation range is continued beyond a predetermined time, the HMD device may provide the user with an accident warning message. In this case, the HMD device may display the warning message as a virtual image, or may generate voice or vibration. The present embodiment, in particular, may be effectively applied in the case in which the HMD device provides a map image in the stationary view mode 6010. The stationary view mode 6010, as described above, is a view mode provided in the case in which the user is a driver because the above-described voice guide or warning message may provide information that the driver more needs than the passenger. It is noted that application of the present embodiment is not limited to the stationary view mode 6010, and may also be applied to the moving view mode 6020 according to design purposes and use purposes of the HMD device, user settings, and the like.

With regard to FIG. 6, the first rotation range to the third rotation range as described above may be equal to one another, or may be set to different angle ranges according to design purposes and use purposes of the HMD device, user settings, and the like.

FIG. 7 is a view showing an embodiment of an HMD device that performs switching between view modes of a map image according to a traveling velocity of a vehicle.

In one embodiment, the HMD device may perform switching between view modes of a map image based on a traveling velocity V of a vehicle 7010. In other words, the HMD device may acquire information regarding the traveling velocity V of the vehicle 7010, and switch from a stationary view mode 7020-1 to a moving view mode 7020-2 or from the moving view mode 7020-2 to the stationary view mode 7020-1 based on the acquired information regarding the traveling velocity V.

More specifically, the HMD device may acquire information regarding the traveling velocity V of the vehicle 7010 while the HMD, which has detected that the user is a driver, is providing a map image in the stationary view mode 7020-1. Next, the HMD device may determine, based on the acquired information regarding the traveling velocity V of the vehicle 7010, whether the traveling velocity V exceeds a first threshold velocity that is a predetermined velocity, or is equal to or less than the first threshold velocity. The HMD device may maintain the stationary view mode 7020-1 when detecting that the traveling velocity V of the vehicle 7010 exceeds the first threshold velocity. On the other hand, the HMD device may perform switching from the stationary view mode 7020-1 that has been provided to the moving view mode 7020-2 when detecting that the traveling velocity V of the vehicle 7010 is equal to or less than the first threshold velocity.

On the contrary, the HMD device may acquire information regarding the traveling velocity V of the vehicle 7010 while the HMD device, which has detected that the user is not a driver, is providing a map image in the moving view mode 7020-2. Next, the HMD device may determine, based on the acquired information regarding the traveling velocity V of the vehicle 7010, whether the traveling velocity V exceeds a second threshold velocity that is a predetermined velocity, or is equal to or less than the second threshold velocity. The HMD device may perform switching from the moving view mode 7020-2 that has been provided to the stationary view mode 7020-1 when detecting that the traveling velocity V of the vehicle 7010 exceeds the second threshold velocity. On the other hand, the HMD device may maintain the moving view mode 7020-2 when detecting that the traveling velocity V of the vehicle 7010 is equal to or less than the second threshold velocity.

If the traveling velocity V exceeds the threshold velocity, it is advantageous to provide the stationary view mode 7020-1 that may enhance focus upon driving and reduce confusion, regardless of whether the user is a driver, because the risk of an accident increases with increase in traveling velocity V. On the contrary, if the traveling velocity V is slow, it is advantageous to provide the moving view mode 7020-2 to enhance focus of the user upon the scenery regardless of whether the user is a passenger because the risk of an accident is low and the user wishes to view the scenery.

Meanwhile, according to various embodiments, the HMD device may acquire information regarding the traveling velocity V. In one embodiment, the HMD device may acquire information regarding the traveling velocity V by measuring a moved distance per hour using a GPS provided in the HMD device. Alternatively, the HMD device may acquire information regarding the traveling velocity V from an external device using a communication unit. In this case, the external device may be the vehicle 7010 in which the user travels. It is noted that the HMD device may acquire information regarding the traveling velocity V via various methods, and information acquisition is not limited to the above-described embodiments.

The above-described first threshold velocity and second threshold velocity may be determined to be equal to or different from each other according to design purposes and user purposes of the HMD device, user settings, and the like in various embodiments.

FIG. 8 is a flowchart showing a method of controlling an HMD device according to an embodiment. In the flowchart, a detailed description of parts similar to or repeated parts of the above description with reference to FIGs. 1 to 7 will be omitted.

First, the HMD device may acquire driver identification information regarding the user who wears the HMD device (S8010). Here, the driver identification information, as described above, is information regarding whether or not a user who wears the HMD device is a driver. The HMD device may acquire the driver identification information via various ways, and a more detailed description of this has been described above with reference to FIG. 4.

Next, the HMD device may detect whether or not the user is a driver (S8020). More specifically, the HMD device may detect whether or not the user who wears the HMD device is a driver using the acquired driver identification information. For instance, if the acquired driver identification information indicates that the user is a driver, the HMD device may detect that the user is a driver. On the contrary, if the acquired driver identification information indicates that the user is not a driver, the HMD device may detect that the user is not a driver.

The HMD device may provide a map image in a stationary view mode when detecting that the user is a driver (S8030). Here, the map image may be a graphic image that serves as a user interface for guidance on a drive path. A detailed description of the map image has been described above with reference to FIG. 2. In addition, the stationary view mode may be a mode that provides a map image for guidance on a drive path when the viewpoint is stationary regardless of a rotation degree of the HMD device.

On the contrary, the HMD device may provide a map image in a moving view mode when detecting that the user is not a driver (S8040). Here, the moving view mode may be a mode that provides a map image for guidance on a drive path when the viewpoint is moved according to rotation of the HMD device.

Although not shown in the flowchart, the HMD device may perform switching between view modes of a map image according to a rotation degree of the HMD device and/or a traveling velocity of a vehicle. An embodiment of switching between view modes according to a rotation degree of the HMD device has been described above with reference to FIG. 6, and an embodiment of switching between view modes according to a traveling velocity of a vehicle has been described above with reference to FIG. 7.

Although the respective drawings have been described individually for convenience, the embodiments described in the respective drawings may be combined to realize novel embodiments. In addition, designing a computer readable recording medium in which a program to execute the above-described embodiments is recorded according to a need of those skilled in the art is within the scope of the disclosure.

In addition, the HMD device and the method of controlling the same are not limited to the configurations and methods of the above described embodiments, and all or some of the embodiments may be selectively combined to achieve various modifications.

It will be apparent that, although the preferred embodiments have been shown and described above, the disclosure is not limited to the above-described specific embodiments, and various modifications and variations can be made by those skilled in the art without departing from the gist of the appended claims. Thus, it is intended that the modifications and variations should not be understood independently of the technical sprit or prospect of the disclosure.

Moreover, the HMD device and the method of controlling the same according to the present disclosure may be performed as code that may be written on a processor readable recording medium and thus read by a processor provided in a network device. The processor readable recording medium may be any type of recording device in which data is stored in a processor readable manner. Examples of the processor readable recording medium may include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device. In addition, the processor readable recording medium includes a carrier wave (e.g., data transmission over the Internet). Also, the processor readable recording medium may be distributed over a plurality of computer systems connected to a network so that processor readable code is written thereto and executed therefrom in a decentralized manner.

In the present disclosure, a rotation degree, an angle, and a velocity may be understood as not only referring to accurate values, but as also including a substantial rotation degree, a substantial angle, and a substantial velocity within a predetermined range. That is, a rotation degree, an angle, and a velocity of the present disclosure may refer to a substantial rotation degree, a substantial angle, and a substantial velocity, and a predetermined tolerance may be present therebetween.

In addition, the disclosure describes both a device invention as well as a method invention, and descriptions of both inventions may be complementarily applied as needed.

Various embodiments have been described in the best mode for carrying out the invention.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

As described above, the present invention is totally or partially applicable to electronic devices.

Claims

A head Mounted Display (HMD) device comprising:

a rotation sensor unit configured to sense a rotation degree of the HMD device;

a display unit configured to display visual information; and

a processor configured to control the rotation sensor unit and the display unit,

wherein, when providing a map image for guidance on a drive path, the processor is further configured to :

acquire driver identification information regarding a user wearing the HMD device, the driver identification information indicating whether or not the user is a driver, and

provide the map image in a stationary view mode when detecting that the user is the driver based on the acquired driver identification information, or provide the map image in a moving view mode when detecting that the user is not the driver based on the acquired driver identification information.
The HMD device according to claim 1, wherein the processor is further configured to :

not rotate the map image according to a rotation of the HMD device when the map image is provided in the stationary view mode, and

rotate the map image according to the rotation of the HMD device when the map image is provided in the moving view mode.
The HMD device according to claim 1, further comprising a camera unit configured to capture an image within a view angle range,

wherein, when providing the map image, the processor is further configured to:

set the driver identification information to indicate that the user is the driver when detecting a handle provided at a vehicle, and

set the driver identification information to indicate that the user is not the driver when the handle is not detected.
The HMD device according to claim 1, wherein, when providing the map image for guidance on the drive path, the processor is further configured to:

provide a selection interface for setting the driver identification information, and

set the driver identification information according to a selection input of the selection interface.
The HMD device according to claim 1, further comprising a communication unit configured to transmit and receive data to and from an external device.
The HMD device according to claim 5, wherein the processor is further configured to :

receive the driver identification information from the external device, and

provide the map image in the stationary view mode or in the moving view mode based on the received information.
The HMD device according to claim 1, wherein the processor is further configured to :

detect the rotation degree when detecting a rotation of the HMD device while the map image is provided in the stationary view mode, and

maintain the stationary view mode when the detected rotation degree is within a first rotation range, and perform switching from the stationary view mode to the moving view mode when the detected rotation degree is outside the first rotation range.
The HMD device according to claim 1, wherein the processor is further configured to :

detect the rotation degree when detecting a rotation of the HMD device while the map image is provided in the moving view mode, and

maintain the moving view mode when the detected rotation degree is outside a second rotation range, and perform switching from the moving view mode to the stationary view mode when the detected rotation degree is within the second rotation range.
The HMD device according to claim 1, wherein the processor is further configured to :

acquire traveling velocity information of a vehicle in which the user travels,

detect the traveling velocity of the vehicle from the acquired traveling velocity information, and

provide the map image in the stationary view mode or in the moving view mode based on the acquired traveling velocity information.
The HMD device according to claim 9, wherein, while the map image is provided in the stationary view mode, the processor is further configured to:

maintain the stationary view mode when the acquired traveling velocity exceeds a first threshold velocity, and perform switching from the stationary view mode to the moving view mode when the acquired traveling velocity is equal to or less than the first threshold velocity.
The HMD device according to claim 9, wherein, while the map image is provided in the moving view mode, the processor is further configured to :

maintain the moving view mode when the acquired traveling velocity is equal to or less than a second threshold velocity, and perform switching from the moving view mode to the stationary view mode when the acquired traveling velocity exceeds the second threshold velocity.
The HMD device according to claim 1, wherein the processor is further configured to provide traffic information related to the drive path when the map image is provided in the stationary view mode.
The HMD device according to claim 1, wherein the processor is further configured to provide surrounding environment information related to the drive path when the map image is provided in the moving view mode.
The HMD device according to claim 1, wherein the processor is further configured to provide voice navigation for guidance on the drive path when the rotation degree of the HMD device is outside a third rotation range while the map image is provided in the stationary view mode.
The HMD device according to claim 14, wherein the processor is further configured to provide an accident warning message when the rotation degree is outside the third rotation range beyond a predetermined time.
The HMD device according to claim 1, wherein the display unit comprises an optical see-through display panel.
The HMD device according to claim 1, wherein the map image is an augmented reality image displayed based on a real object.
The HMD device according to claim 1, wherein the map image includes a navigation image.
A method of providing a map image for guidance on a drive path, the method comprising:

acquiring driver identification information regarding a user wearing a Head Mounted Display (HMD) device, wherein the driver identification information indicates whether or not the user is a driver;

detecting whether or not the user is the driver based on the acquired driver identification information; and

providing the map image in a stationary view mode when detecting that the user is the driver, and providing the map image in a moving view mode when detecting that the user is not the driver.
The method according to claim 19, further comprising:

not rotating the map image according to a rotation of the HMD device when the map image is provided in the stationary view mode, and

rotating the map image according to the rotation of the HMD device when the map image is provided in the moving view mode.