KR20150085587A - Head mounted display and method for controlling the same - Google Patents

Head mounted display and method for controlling the same Download PDF

Info

Publication number
KR20150085587A
KR20150085587A KR1020140005386A KR20140005386A KR20150085587A KR 20150085587 A KR20150085587 A KR 20150085587A KR 1020140005386 A KR1020140005386 A KR 1020140005386A KR 20140005386 A KR20140005386 A KR 20140005386A KR 20150085587 A KR20150085587 A KR 20150085587A
Authority
KR
South Korea
Prior art keywords
hmd
case
unit
processor
state
Prior art date
Application number
KR1020140005386A
Other languages
Korean (ko)
Inventor
김종호
김지환
이도영
김용신
천시내
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020140005386A priority Critical patent/KR20150085587A/en
Priority to PCT/KR2014/001361 priority patent/WO2015108225A1/en
Publication of KR20150085587A publication Critical patent/KR20150085587A/en

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The present invention relates to a head mounted display (HMD) and a control method thereof. According to an embodiment, the HMD comprises: a projector unit to project visual information; a sensor unit to senses whether the HMD is stored in a HMD case which stores the HMD; and a processor to control the projector unit and the sensor unit. The processor is to convert a light path of the projector unit with respect to a physical structure of the HMD case when the HMD is detected as an incase state in which the HMD case stores the HMD and is to convert the light path of the projector unit with respect to the physical structure when the HMD is detected as an uncase state in which the HMD case does not store the HMD.

Description

[0001] DESCRIPTION [0002] HEAD MOUNTED DISPLAY AND METHOD FOR CONTROLLING THE SAME [

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an HMD case for housing an HMD and an HMD, and more particularly, to an HMD for changing the optical path of a projector unit based on the physical structure of the HMD case and its control method when the HMD is housed in the HMD case.

The head mounted display ("HMD") can be worn by the user like a pair of glasses. The user can receive various information from the HMD worn like glasses.

The user can store the HMD in the HMD case to use the HMD or to charge the power. However, when the HMD is stored in the HMD case, there is a problem that the user can not continuously use the HMD. That is, the user had to disconnection the HMD from the HMD case in order to use the HMD.

Therefore, it is necessary to guarantee the continuity of HMD use to the user so that the user can continuously use the HMD even when the HMD is stored in the HMD case.

According to an embodiment of the present invention, an HMD for changing a setting according to a storage state of an HMD and a control method thereof are provided.

According to another embodiment, there is provided an HMD for changing the optical path of a projector unit according to a physical structure of an HMD case and a control method thereof.

According to another aspect of the present invention, there is provided an HMD for changing the setting of visual information according to a physical structure of a display unit, and a control method thereof.

According to another embodiment of the present invention, there is provided an HMD for changing a setting of a touch sensing panel according to a physical structure of a touch input hole and a control method thereof.

According to another embodiment, there is provided an HMD case for housing an HMD.

According to an embodiment of the present invention, there is provided a head mounted display (HMD), comprising: a projector unit for projecting visual information; A sensor unit for sensing whether the HMD is housed in an HMD case housing the HMD; And a processor for controlling the projector unit and the sensor unit; Wherein the processor changes the optical path of the projector unit based on a physical structure of the HMD case when the HMD detects an in-case state stored in the HMD case, It is possible to provide an HMD that changes the optical path of the projector unit based on the physical structure of the HMD when the unseated state not stored in the case is detected.

According to one embodiment, when the HMD is housed, the setting of the HMD is changed according to the physical structure of the HMD case, so that the user can continuously use the HMD housed through the HMD case.

Further, according to another embodiment, the HMD in the in-case state can change the optical path of the projector unit so that the visual information projected from the projector unit faces the display unit provided in the HMD case. Therefore, the user can receive the visual information projected from the HMD through the display unit provided in the HMD case.

According to another embodiment, the HMD in the in-case state changes the setting of the touch sensing panel according to the physical structure of the touch input hole, so that the user can directly control the HMD through the touch input hole.

The effects of the more specific invention will be described later in detail.

1 is a view showing an embodiment of an HMD case housing an HMD and an HMD.
2 is a functional block diagram of the HMD and the HMD case.
3A is a view showing an embodiment of an HMD case in which an HMD is housed.
3B is a view showing an embodiment of the HMD case in which the HMD is not housed.
4A is a view showing an embodiment of an HMD for changing the optical path of the projector unit.
4B is a view showing an embodiment of an HMD for changing the optical path of the projector unit.
5 is a view illustrating an embodiment of an HMD for changing the setting of the touch sensing panel based on the physical structure of the HMD case.
6 is a view illustrating an HMD for scaling a touch sensing panel based on the physical structure of the HMD case.
7 is a diagram illustrating an HMD for determining the type of command corresponding to the touch input direction according to the stored state of the HMD.
8 is a flowchart showing a control method of the HMD.

As used herein, terms used in the present specification are taken into consideration in considering the function of the present invention. However, this may vary depending on the intention of the person skilled in the art, custom or the emergence of a new technique. Also, in some cases, there may be a term selected arbitrarily by the applicant, and in this case, the meaning will be described in the description of the corresponding embodiment. Therefore, it is intended that the terminology used herein should be interpreted relative to the meaning of the term rather than to the nomenclature of the term, and the entire content of the specification.

Furthermore, the embodiments are described in detail below with reference to the accompanying drawings and the accompanying drawings, but are not limited or limited by the embodiments.

1 is a view showing an embodiment of an HMD case housing an HMD and an HMD.

In this specification, the HMD 1010 refers to a head mounted display, which may represent a wearable device that a user can wear like a pair of glasses. The HMD 1010 may be housed in the HMD case 1020. Accordingly, the HMD 1010 of the present specification may have an in-case state accommodated in the HMD case 1020 and an un-case state not accommodated in the HMD case 1020. Here, the HMD case 1020 is a case capable of housing the HMD 1010, and may include a display unit 1030, a touch input hole 1040, and / or an external touch sensing panel. A detailed description thereof will be described below with reference to FIG.

When the HMD 1010 is accommodated in the HMD case 1020, the HMD 1010 can change the setting based on the physical structure of the HMD case 1020. [ More specifically, when the HMD 1010 is in an in-case state housed in the HMD case 1020, the HMD 1010 can be mounted on the projector unit provided in the HMD 1010, / / You can change the settings of the touch sensing panel. This is to allow the user to use the HMD 1010 through the HMD case 1020 even when the HMD 1010 is accommodated in the HMD case 1020. A detailed description of an embodiment in which the HMD 1010 changes settings of the projector unit based on the physical structure of the HMD case 1020 will be described below with reference to Figs. 4A and 4B. Further, a detailed description of an embodiment in which the HMD 1010 changes the setting of the touch sensing panel based on the physical structure of the HMD case 1020 will be described below with reference to Figs. 5 to 7.

Further, when the HMD 1010 is not housed in the HMD case 1020, the HMD 1010 can change the setting based on the physical structure of the HMD 1010. [ More specifically, when the HMD 1010 is in the un-case state in which the HMD 1010 is not housed in the HMD case 1020, the HMD 1010 is connected to the projector unit provided in the HMD 1010 based on the physical structure of the HMD 1010, / / You can change the settings of the touch sensing panel. This is to return to the original setting value so that the user can use the HMD 1010 when the HMD 1010 is separated from the HMD case 1020. [ A detailed description thereof will be described below with reference to Figs. 4A to 7.

Meanwhile, the HMD 1010 and the HMD case 1020 shown in FIG. 1 are merely examples, and they can be implemented in various forms and structures, and are not limited to those shown in the drawings.

2 is a functional block diagram of the HMD and the HMD case. Figure 2 is an example of a functional block diagram, in which some components may be deleted or new components may be added as needed by those skilled in the art.

The HMD herein may include a first processor 2010, a projector unit 2020, a sensor unit 2030 and / or a touch sensing panel 2040. In this specification, the HMD case includes a second processor 2060, a display unit 2070, an external touch sensing panel 2080, a touch input hole 2090, an audio output unit 2100 and / or a charging unit 2110, . ≪ / RTI >

The projector unit 2020 can project visual information. More specifically, the projector unit 2020 can display visual information by projecting visual information on the user's eyes, a lens, or a screen. Where visual information can represent a variety of visually recognizable digital information that can be projected by the projector as light. For example, visual information can represent various information that can be recognized by the user's view such as a picture, an image, a photograph, a moving picture, a text, and an execution screen.

Further, the projector unit 2020 is rotatable according to the embodiment. More specifically, the projector unit 2020 can be controlled to be rotated by the first processor 2010 according to the housed state of the HMD. If the HMD is an in-case state accommodated in the HMD case, the projector unit 2020 can be controlled to rotate based on the physical structure of the HMD case. Alternatively, when the HMD is in the un-case state not accommodated in the HMD case, the projector unit 2020 can be controlled to rotate based on the physical structure of the HMD. A detailed description thereof will be described later in detail with reference to FIG. 4A.

The sensor unit 2030 can sense whether the HMD is housed in the HMD case. More specifically, the sensor unit 2030 can sense whether the HMD is housed in the HMD case using at least one sensing means provided in the HMD. The at least one sensing means may include a touch sensor, a pressure sensor, a geomagnetism sensor, a brightness sensor, a camera sensor, and the like. In addition, the sensor unit 2030 may include various sensing means for sensing whether the HMD is housed in the HMD case, and is not limited to the above-described embodiments.

The sensor unit 2030 can sense whether the HMD is housed in the HMD case and deliver the sensing result to the first processor 2010. [ When it is sensed that the HMD is housed in the HMD case by the sensor unit 2030, the first processor 2010 can detect the in-case state of the HMD. Alternatively, when it is sensed that the HMD has been separated from the HMD case by the sensor unit 2030, the first processor 2010 can detect the uncase state of the HMD.

The touch sensing panel 2040 can sense a touch input to the HMD. More specifically, the touch sensing panel 2040 may be provided outside the HMD to sense various touch inputs of the user to the HMD. At this time, the touch sensing panel 2040 can sense the touch input using at least one sensing means. Here, the at least one sensing means may represent various sensing means for sensing a touch input of a user such as a touch sensor, a proximity sensor, a pressure sensor, an infrared sensor, a motion sensor, and a brightness sensor. The touch sensing panel 2040 may sense the touch input to the HMD and transmit the sensing result to the first processor 2010. [

The prism unit 2050 can reflect the light projected from the projector unit 2020. [ The prism unit 2050 can reflect light projected from the projector unit 2020 and change the optical path. The prism unit 2050 can direct the light projected from the projector unit 2020 to the user's eyes or the display unit 2070. [ Accordingly, the prism unit 2050 can be provided in the HMD as a material that can reflect light such as a lens or glass. In addition, the prism unit 2050 can refract or disperse the light projected from the projector unit 2020 according to the embodiment.

Further, the prism unit 2050 can be rotated to change the optical path. More specifically, the prism unit 2050 can be controlled to be rotated by the first processor 2010 to change the optical path. In this case, the prism unit 2050 can be controlled to change the optical path based on the physical structure of the HMD or HMD case. A detailed description thereof will be described below in detail with reference to FIG. 4B.

Meanwhile, the touch sensing panel 2040 and the prism unit 2050 may be selectively provided in the HMD according to the embodiment.

The first processor 2010 controls each component of the HMD described above, and can control data transmission / reception between the components. Also, the first processor 2010 may process data in the HMD to execute various applications.

The first processor 2010 may receive the sensing result from the sensor unit 2030 and / or the touch sensing panel 2040. [ The first processor 2010 may change the setting of the HMD or perform a predetermined command based on the received sensing result. In particular, the first processor 2010 can change the settings of the projector unit 2020 and / or the touch sensing panel 2040 based on the sensing result received from the sensor unit 2030, Will be described below with reference to FIG.

The display unit 2070 can display visual information projected from the projector unit 2020. More specifically, the display unit 2070 can display visual information by reflecting the light projected by the projector unit 2020 in the in-case state of the HMD. Thus, the display unit 2070 herein may represent various visual display devices capable of displaying visual information using the projected light. At this time, the HMD can change the optical path of the projector unit 2020 so that the light projected from the projector unit 2020 faces the display unit 2070. A detailed description thereof will be described below with reference to FIG. 4A.

The external touch sensing panel 2080 can sense a touch input to the HMD case. More specifically, the external touch sensing panel 2080 is a touch sensing panel 2040 provided outside the HMD case, and can perform the same function as the touch sensing panel 2040 of the HMD described above. Accordingly, the touch input of the user to the HMD case can be sensed, and the sensing result can be transmitted to the second processor 2060. Also, as described above, the external touch sensing panel 2080 includes at least one sensing means for sensing a touch input of a user, such as a touch sensor, a proximity sensor, a pressure sensor, an infrared sensor, a motion sensor, .

Further, as an embodiment, the external touch sensing panel 2080 may be combined with the display unit 2070 and provided in the HMD case. In this case, the user can receive the visual information through the display unit 2070, and can control the HMD and / or the HMD case by touching the display unit 2070. However, this is only an example, and the external touch sensing panel 2080 may be separately provided from the display unit 2070 and provided in the HMD case.

When the touch sensing panel 2040 is provided in the HMD, the touch input hole 2090 is located at a position corresponding to the touch sensing panel 2040 of the received HMD to expose the touch sensing panel 2040 to the outside of the HMD case. Lt; / RTI > That is, the touch input hole 2090 allows the touch sensing panel 2040 of the HMD to be exposed to the outside in the in-case state of the HMD, thereby enabling the touch input to the touch sensing panel 2040, have. That is, the user can control the HMD and / or the HMD case by touching the touch sensing panel 2040 of the HMD housed in the HMD case through the touch input hole 2090. A detailed description thereof will be described below with reference to FIGS. 5 and 6. FIG.

The audio output unit 2100 may represent audio output means such as a speaker, an earphone, and the like. The audio output unit 2100 can output various sounds recognizable by the auditory sense of the user.

The charging unit 2110 can supply electric power to the HMD to charge the HMD. More specifically, when the HMD is housed in the HMD case, the charging unit 2110 can charge the HMD by supplying power to the HMD by wire or wirelessly.

The external touch sensing panel 2080, the touch input hole 2090, the audio output unit 2100, and the charging unit 2110 may be selectively provided in the HMD case according to the embodiment. Hereinafter, the HMD case having the touch input hole 2090 will be described for convenience of explanation.

The second processor 2060 controls each component of the HMD case described above, and can control data transmission / reception between the components. The second processor 2060 can receive a sensing result from each component and can perform a predetermined command based on the received sensing result. In addition, the second processor 2060 can process data in the HMD case to execute various applications.

The second processor 2060 may be a processor provided in the HMD case separately from the first processor 2010. However, the second processor 2060 may be the same processor as the first processor 2010 according to an embodiment. In this case, the first processor 2010 may perform the functions of the second processor 2060 described above by controlling the components included in the HMD and the HMD case in the in-case state of the HMD. Also, the first processor 2010 may receive the sensing result from the components provided in the HMD case.

Meanwhile, although not shown in the drawing, a communication unit (not shown) may be additionally provided so that the HMD and the HMD case can communicate with each other. The communication unit can perform communication between the HMD and the HMD case using various communication protocols.

Hereinafter, the first processor 2010 or the second processor 2060 controls at least one component included in the HMD or the HMD case according to the user input and / or the sensing result. In addition, the first processor 2010 and the HMD may be equated to describe the second processor 2060 and the HMD case.

Meanwhile, the HMD and the HMD case shown in FIG. 1 are block diagrams according to the embodiment, and the blocks separately displayed are logically distinguished from the components of the HMD and the HMD case. Therefore, the components of the HMD and the HMD case described above can be mounted as one chip or as a plurality of chips according to the designing method.

3A is a view showing an embodiment of an HMD case in which an HMD is housed. That is, FIG. 3A is a view showing an HMD and an HMD case in an in-case state.

The HMD case 3010 is a case capable of accommodating the HMD 3020 and can be designed based on the physical structure of the HMD 3020 so as to accommodate the HMD 3020. At this time, the HMD case 3010 can be provided with the binding portion 3030 so that the HMD 3020 can stably bind to the HMD case 3010. The HMD 3020 may be fixed to the HMD case 3010 by binding to the binding portion 3030 and accommodated therein. At this time, the HMD case 3010 may be provided with various sensors such as a pressure sensor, a touch sensor, a geomagnetic sensor, and the like in the binding unit 3030 to detect the stored state of the HMD 3020.

2, the HMD case 3010 may include a display unit 3050, an external touch sensing panel, and / or a touch input hole 3070 in addition to the binding unit 3030 described above. Each component of the HMD case 3010 can be arranged based on the physical structure of the received HMD 3020. This is to allow the user to continuously use each component of the HMD 3020 through the HMD case 3010 even if the HMD 3020 is housed in the HMD case 3010. [ More specifically, the HMD 3020 of the present disclosure may be configured so that each setting of the HMD 3020 component is set to a physical (not shown) state of the HMD 3010 so that it can be continuously used by the user through the HMD case 3010 even in the in- You can change it based on structure. Accordingly, each component of the HMD case 3010 can be arranged so that the setting change of the HMD 3020 is facilitated and each component of the HMD 3020 can be efficiently used through the HMD case 3010. [

More specifically, the display unit 3050 can be positioned with respect to the projector unit 3040 of the HMD 3020. In other words, the display unit 3050 can be located at a position corresponding to the projector unit 3040 of the HMD 3020. [ This is to allow the projector unit 3040 to easily change the optical path for the display unit 3050. [ The HMD 3020 can change the optical path of the projector unit 3040 so that the visual information is projected on the display unit 3050 located at a position corresponding to the projector unit 3040. [ The visual information projected by the projector unit 3040 can be displayed on the display unit 3050. [ Accordingly, the user can continuously use the display unit 3050 of the HMD 3020 even in the in-case state in which the HMD 3020 is housed. The projector unit 3040 can change the optical path in various ways, and a detailed description thereof will be described below with reference to FIGS. 4A and 4B.

If the HMD case 3010 includes the touch input hole 3070, the touch input hole 3070 may be positioned with respect to the touch sensing panel 3060 of the HMD 3020. The touch input hole 3070 is a hole for exposing the touch sensing panel 3060 of the HMD 3020 to the outside of the HMD case 3010. The touch input hole 3070 is located in a region corresponding to the touch sensing panel 3060 of the HMD 3020 so that when the HMD 3020 is accommodated in the HMD case 3010, (3060) to be exposed to the outside. The user can continuously use the HMD 3020 stored by touching the touch sensing panel 3060 exposed to the outside of the HMD case 3010 as described above.

If the HMD case 3010 has an external touch sensing panel according to the embodiment, the external touch sensing panel (not shown) may be located at various places outside the HMD case 3010. In one embodiment, the external touch sensing panel may be provided in the HMD case 3010 in combination with the display unit 3050. A detailed description thereof is as described above with reference to Fig. As another example, the external touch sensing panel may be located around the display unit 3050. [ The user can control the HMD 3020 stored in the HMD case 3010 by touching the external touch sensing panel while receiving visual information from the display unit 3050. [ In addition, the external touch sensing panel may be located at various positions outside the HMD case 3010.

3B is a view showing an embodiment of the HMD case in which the HMD is not housed. That is, FIG. 3B is a view showing an embodiment of the HMD case separated from the HMD.

The physical structure of the HMD case 3010 may be designed based on the physical structure of the HMD 3020 as described above with reference to FIG. Alternatively, the physical structure of the HMD case 3010 may be designed on the basis of the form in which the HMD 3020 is housed in the HMD case 3010.

When the projector unit 3040 of the HMD 3020 accommodated is located on the front surface of the HMD 3020, the display unit 3050 may also be positioned on the front surface of the HMD case 3010. [ When the touch sensing panel 3060 of the HMD 3020 accommodated is located on the rear surface of the HMD 3020, the touch input hole 3070 may also be positioned on the rear surface of the HMD case 3010. [

The user can receive visual information through the display unit 3050 located on the front surface of the HMD case 3010. [ At the same time, the user can control the HMD 3020 in the in-case state by touching the touch sensing panel 3060 through the touch input hole 3070 located on the rear side of the HMD case 3010. Alternatively, when the HMD case 3010 has an external touch sensing panel (not shown), the user can control the HMD 3020 in the in-case state by touching the external touch sensing panel.

The HMD case 3010 in this drawing is only an embodiment, and various embodiments of design may exist depending on the physical structure of the HMD 3020. [

4A is a view showing an embodiment of an HMD for changing the optical path of the projector unit. More specifically, FIG. 4A shows an embodiment of an HMD that changes the optical path by rotating the projector unit.

The HMD 4010 can change the optical path of the projector unit 4020 based on the physical structure of the HMD case. More specifically, when the in-case state is detected, the HMD 4010 can change the optical path of the projector unit 4020 based on the display unit provided in the HMD case. The HMD 4010 can rotate the projector unit 4020 so that the visual information projected from the projector unit 4020 is directed to the display unit to change the optical path to the first path. Here, the first path may indicate a preset optical path so that visual information can be properly displayed on the display unit.

Accordingly, when the HMD 4010 or the HMD case is provided with the prism unit 4030 according to the embodiment, the HMD 4010 is configured such that the visual information is reflected by the prism unit 4030 and directed to the display unit, The optical path can be changed to the first path by rotating the second path 4020. Alternatively, according to the embodiment, the HMD 4010 may rotate the projector unit 4020 to change the optical path to the first path so that visual information can be projected directly toward the display unit. In this case, the HMD 4010 controls the direction and angle of light of the projector unit 4020, the distance and angle between the projector unit 4020 and the display unit, the display unit size and shape, the position of the prism unit 4030, It is possible to set the first path and rotate the projector unit 4020.

The HMD 4010 can change the optical path of the projector unit 4020 on the basis of the physical structure of the HMD 4010. On the other hand, More specifically, when the uncase case is detected, the HMD 4010 can change the optical path of the projector unit 4020 based on the eyes of the user wearing the HMD 4010. The HMD 4010 can rotate the projector unit 4020 so that the visual information projected from the projector unit 4020 faces the user's eyes and change the optical path to the second path. More specifically, the HMD 4010 can rotate the projector unit 4020 so that the visual information projected from the projector unit 4020 faces the user's eyes, thereby changing the optical path to the second path. Here, the second path may indicate a predetermined light path so that visual information can be appropriately projected by the user's eyes.

Accordingly, when the HMD 4010 is provided with a separate display unit (not shown) according to the embodiment, the HMD 4010 can display the visual information on the display unit 4020, So that the optical path can be changed to the second path. If the prism unit 4030 is provided in the HMD 4010 according to the embodiment of the present invention, the HMD 4010 may be configured such that the visual information is reflected by the prism unit 4030 and directed toward the user's eyes. ) So that the optical path can be changed to the second path. Alternatively, according to the embodiment, the HMD 4010 can rotate the projector unit 4020 so that the visual information can be directly projected toward the user's eyes, thereby changing the optical path to the second path. In this case, the HMD 4010 controls the light projection direction and angle of the projector unit 4020, the distance and angle between the projector unit 4020 and the eye of the user, the position of the prism unit 4030, And the projector unit 4020 can be rotated.

4B is a view showing an embodiment of an HMD for changing the optical path of the projector unit. More specifically, FIG. 4B illustrates an embodiment of an HMD 4010 that changes the optical path by rotating the prism unit 4030. Referring to FIG. Accordingly, the HMD 4010 of the present embodiment may include a prism unit 4030. [

The HMD 4010 can change the optical path of the projector unit 4020 based on the physical structure of the HMD case. More specifically, when the in-case state is detected, the HMD 4010 can change the optical path of the projector unit 4020 based on the display unit 4040 provided in the HMD case. The HMD 4010 can change the optical path to the first path by rotating the prism unit 4030 such that the visual information projected from the projector unit 4020 is directed to the display unit 4040. [ Here, the first path is as described above, so that the visual information on the display unit 4040 can be properly displayed. That is, the HMD 4010 rotates the prism unit 4030 so that the visual information reflected by the prism unit 4030 faces the display unit 4040, thereby changing the optical path to the first path. In this case, the HMD 4010 has a structure in which the light projection direction and angle? 1 of the projector unit 4020, the distance and angle between the prism unit 4030 and the projector unit 4020, the distance between the prism unit 4030 and the display unit The prism unit 4030 can be rotated by setting the first path in consideration of the distance and angle between the prism unit 4030 and the prism unit 4030.

The HMD 4010 can change the optical path of the projector unit 4020 based on the physical structure of the HMD 4010. [ More specifically, when the uncase case is detected, the HMD 4010 can change the optical path of the projector unit 4020 based on the eye 4050 of the user wearing the HMD 4010. [ The HMD 4010 can rotate the prism unit 4030 so that the visual information projected from the projector unit 4020 is directed to the user's eyes 4050 and change the optical path to the second path. Here, the second path is the light path set in advance so that the visual information can be appropriately projected onto the user's eyes 4050 as described above. That is, the HMD 4010 can rotate the prism unit 4030 so that the visual information reflected by the prism unit 4030 faces the user's eyes 4050, thereby changing the optical path to the second path.

Accordingly, in the case where the HMD 4010 is provided with a separate display unit (not shown) according to the embodiment, the HMD 4010 displays the prism unit 4030 so that visual information can be appropriately displayed on the display unit. So that the optical path can be changed to the second path. Alternatively, according to the embodiment, the HMD 4010 can rotate the prism unit 4030 so that the visual information can be directly projected toward the user's eyes 4050, thereby changing the optical path to the second path. In this case, the HMD 4010 has a configuration in which the light projection direction and angle 2 of the projector unit 4020, the distance and angle between the user's eye 4050 and the prism unit 4030, the distance between the prism unit 4030 and the projector unit 4030, The prism unit 4030 can be rotated by setting the second path in consideration of the distance and angle between the prism unit 4020 and the second path.

Although the HMD 4010 having one prism unit 4030 has been described in the present embodiment, the same can be applied to the case where a plurality of prism units 4030 are provided. Therefore, when a plurality of prism units 4030 are provided, the HMD 4010 can rotate a plurality of prism units 4030 to change the optical path of the projector unit 4020 to the first path or the second path. The HMD 4010 sets the first path and the second path in consideration of the relative positions of the display unit 4040 and the user's eye 4050 for the plurality of prism units 4030 and sets the plurality of prism units 4030 Can be rotated.

Meanwhile, although not shown in the drawing, when the in-case state is detected, the HMD 4010 has a physical structure of the display unit 4040 provided in the HMD case as a reference You can change the settings of the visual information. More specifically, the HMD 4010 in the in-case state can change the setting of the visual information in consideration of the physical structure such as the position, size, and shape of the display unit 4040 provided in the HMD case. For example, the HMD 4010 may scale visual attributes such as size, intensity, contrast, color, brightness, contrast, and transparency of the visual information to match the physical structure of the display unit 4040. Conversely, when the unexcited state is detected, the HMD 4010 can change the setting of the visual information based on the physical structure of the HMD 4010 in order to appropriately provide the visual information to the user through the HMD 4010 have.

This is because the manner and means for providing visual information in the in-case state and the un-case state of the HMD 4010 are different from each other. For example, the HMD 4010 in the un-case state can project visual information directly to the user's eyes 4050 to provide visual information. Conversely, the HMD 4010 in the in-case state can provide visual information by projecting visual information to the display unit 4040 provided in the HMD case. Since the manner and means of providing visual information differ depending on the in-case state and the un-case state of the HMD 4010, the visual attributes of the visual information can be set in consideration of this. Thus, the HMD 4010 can appropriately provide visual information to the user depending on the situation.

5 is a view illustrating an embodiment of an HMD for changing the setting of the touch sensing panel based on the physical structure of the HMD case.

The HMD 5010 in the in-case state can change the setting of the touch sensing panel 5030 based on the physical structure of the HMD case 5020. [ More specifically, the HMD 5010 in the in-case state can change the setting of the touch sensing panel 5030 based on the physical structure of the touch input hole 5040 provided in the HMD case 5020. This is because the user uses the touch sensing panel 5030 exposed through the touch input hole 5040 of the HMD case 5020 in the in-case state. Therefore, in this case, the HMD 5010 needs to change the setting of the touch sensing panel 5030 based on the physical structure of the touch input hole 5040. The physical structure of the touch input hole 5040 includes the position, size, and / or shape of the touch input hole 5040, and the HMD 5010 includes the position, size, and / or shape of the touch input hole 5040 The setting of the touch sensing panel 5030 can be changed on the basis of the setting value.

In one embodiment, the HMD 5010 may activate the touch input sensing of the area 5050 corresponding to the touch input hole 5040 of the touch sensing panel 5030. If the size of the touch sensing panel 5030 is smaller than or equal to the size of the touch input hole 5040, the HMD 5010 performs touch input sensing on the overall region 5030 of the touch sensing panel, can do. Conversely, when the size of the touch sensing panel 5030 is larger than the size of the touch input hole 5040, the HMD 5010 does not need to activate the touch input sensing for the entire area 5030 of the touch sensing panel. This is because the user can touch only the panel area 5050 exposed to the outside through the touch input hole 5040 in the in-case state. Therefore, in this case, the HMD 5010 can activate the touch input sensing only for a partial region (5050) exposed to the outside through the touch input hole (5040) of the touch sensing panel (5030). At this time, the HMD 5010 scales the touch sensing panel 5030 based on the reduction ratio of the active area, and a detailed description thereof will be described below with reference to FIG.

On the other hand, when the unexception state is detected, the HMD 5010 can activate the touch input sensing of the entire area 5030 of the touch sensing panel. This is because the user can touch the whole area of the touch sensing panel 5030 in this case.

6 is a view illustrating an HMD for scaling a touch sensing panel based on the physical structure of the HMD case.

When only a part 6020-2 of the touch sensing panel 6020-1 performs touch input sensing according to the physical structure of the touch input hole 6030, the HMD scales the corresponding area 6020-2 can do. In this case, the HMD may perform scaling for some of the activated areas 6020-2 based on the reduction ratio of the active area 6020-2.

For example, when the length of the touch sensing panel 6020-1 is x and the length of the touch input hole 6030 is 3/4 x, the HMD is connected to the touch input hole 6030 of the touch sensing panel 6020-1 The touch input sensing for the corresponding 3 / 4x area 6020-2 can be activated. At this time, the HMD can perform scaling based on the reduction ratio 3/4 of the active area 6020-2. Therefore, when the HMD in the uncase case performs the first command for the touch input having the length of 1 cm, the HMD in the in-case state in which the scaling has been completed is set to 0.75 cm (or 3/4 cm) 1 command can be executed.

Even if the touch input sensing area 6020-2 of the touch sensing panel 6020-1 is reduced, even if the touch sensing panel 6020-1 is scaled based on the reduction ratio, the touch of the user to the touch sensing panel 6020-1 . Accordingly, the user can control the HMD stored by touching the touch sensing panel 6020-2 exposed outside the HMD case 6010 even in the in-case state.

7 is a diagram illustrating an HMD for determining the type of command corresponding to the touch input direction according to the stored state of the HMD.

In one embodiment, the command corresponding to the touch input direction to the touch sensing panel 7020 may be changed according to the stored state of the HMD. More specifically, the HMD in the in-case state can determine the command corresponding to the touch input direction based on the physical structure of the HMD case 7010. [ Alternatively, the HMD in the un-case state can determine a command corresponding to the touch input direction based on the physical structure of the HMD.

For example, the touch sensing panel 7020 may be provided at the leg portion of the HMD, as shown in the figure. In this case, the HMD in the un-case state can perform the first command when the slide touch input in the outward direction with respect to the touch sensing panel 7020 is detected. If the user wears the HMD, the HMD can perform the first command if the touch sensing panel 7020 detects the slide touch input in the ear direction of the user. On the contrary, the HMD in the un-case state can perform the second command when the slide touch input in the inward direction to the touch sensing panel 7020 is detected. If the user wears the HMD, the HMD can perform the second command if the HMD touches the touch sensing panel 7020 with the slide touch input in the user's eye direction.

When such an HMD is housed in the HMD case, the eyeglass leg portion of the HMD can be folded and housed in the HMD case 7010 (see the HMD storage form in Figs. 1 and 3A). In this case, as shown in the figure, the HMD in the in-case state is configured to move the slide touch input 7040-1 in the upward direction (or rightward direction) relative to the touch sensing panel 7020 In case of tact, the first command can be executed. Alternatively, as shown in the figure, the HMD in the in-case state is configured to detect the slide touch input 7040-2 in the downward direction (or leftward direction) with respect to the touch sensing panel 7020 based on the HMD case 7010, In this case, the second command can be executed. Here, the slide touch input for the HMD may represent a touch input to the touch sensing panel exposed to the outside through the touch input hole 7030 provided in the HMD case.

Therefore, the same structure of the touch sensing panel 7020 can be obtained in accordance with the structure of the HMD and the HMD case 7010, such as the structure of the HMD, the manner of storing the HMD, the structure of the HMD case 7010, the position of the touch sensing panel 7020, The same or different commands may be executed for the touch input of the direction. This minimizes the confusion that may occur when the user controls the HMD through the HMD case 7010. [

On the other hand, the first command and the second command may include various control commands such as a volume control command, an audio control command, an image enlargement control command, an image reduction control command, a paging control command, and a scroll control command. Further, the first command and the second command may be mutually corresponding commands. For example, if the first command is a volume up command, the second command may be a volume down command. Alternatively, when the first command is an image enlargement command, the second command may be an image reduction command.

8 is a flowchart showing a control method of the HMD. In the flowchart, the detailed description of the portions similar or overlapping with those described in Figs. 1 to 7 will be omitted.

First, the HMD can detect the state of the HMD (S8010). Here, the state of the HMD indicates the housed state with respect to the HMD case, which indicates the state in which the HMD is housed in the HMD case, and the state in which the HMD is not housed in the HMD case in the uncase state. The HMD can detect the stored state of the HMD using the sensor unit, and a detailed description thereof is as described above with reference to FIG.

If the in-case state of the HMD is detected, the HMD can change the optical path of the projector unit based on the physical structure of the HMD case (S8020). More specifically, the HMD in the in-case state can change the optical path of the projector unit based on the physical structure of the display unit provided in the HMD case. The HMD in the in-case state can change the optical path so that the visual information projected from the projector unit can be displayed on the display unit. This is to allow the user to continuously use the HMD through the HMD case even if the HMD is housed in the HMD case. In this case, the HMD can change the optical path of the projector unit by rotating the projector unit or rotating the prism unit, and a detailed description thereof is as described above with reference to FIGS. 4A and 4B. Further, the HMD can change the setting of the projected visual information based on the physical structure of the display unit, and a detailed description thereof is as described above with reference to FIG. 4B.

If the unexpected state of the HMD is detected, the HMD can change the optical path of the projector unit based on the physical structure of the HMD (S8030). More specifically, the HMD in the un-case state can change the optical path so that the visual information projected from the projector unit faces the user's eyes. In this case as well, the HMD can change the optical path of the projector unit by rotating the projector unit and / or the prism unit, and a detailed description thereof is as described above with reference to Figs. 4A and 4B. Further, the HMD can change the setting of the projected visual information based on the physical structure of the HMD, and a detailed description thereof is as described above with reference to FIG. 4B.

In addition, the HMD can change the setting of the touch sensing panel according to the physical state of the HMD or the HMD case according to the storage state of the HMD, and a detailed description thereof is as described above with reference to FIGS. 5 to 7.

Although the drawings have been described for the sake of convenience of explanation, it is also possible to combine the embodiments described in the drawings to design a new embodiment. It is also within the scope of the right to design a computer-readable recording medium on which programs for executing the previously described embodiments are recorded according to the needs of those skilled in the art.

In addition, the HMD and its control method are not limited to the configuration and method of the embodiments described above as described above, but the embodiments described above may be modified so that all or some of the embodiments are selectively And may be configured in combination.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

In addition, the HMD and the control method of the present invention can be implemented as a code readable by a processor on a recording medium readable by a processor included in the network device. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a magnetic tape, a floppy disk, an optical data storage, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet. In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

Further, the directions in the present specification are not limited to the exact directions, but can be viewed as including a certain range of actual angles, velocities, and directions. That is, the angles, velocities and directions herein may represent substantial angles, velocities, and directions, and a range of errors may exist.

In this specification, both the invention and the method invention are explained, and the description of both inventions can be supplemented as necessary.

1010: HMD
1020: HMD case
1030: Display unit
1040: Touch input hole

Claims (21)

In an HMD (Head Mounted Display)
A projector unit for projecting visual information;
A sensor unit for sensing whether the HMD is housed in an HMD case housing the HMD; And
A processor for controlling the projector unit and the sensor unit; Lt; / RTI >
The processor comprising:
When the HMD detects the in-case state stored in the HMD case, the optical path of the projector unit is changed based on the physical structure of the HMD case,
And changes the optical path of the projector unit based on the physical structure of the HMD when the HMD detects an unfolded state not accommodated in the HMD case.
The method according to claim 1,
In the HMD case,
In the in-case state of the HMD,
A display unit for displaying the visual information projected from the projector unit; Which is a case including an HMD.
3. The method of claim 2,
In the HMD case,
In the in-case state of the HMD,
An external touch sensing panel sensing a touch input to the HMD case; Which is a case including the HMD.
3. The method of claim 2,
A touch sensing panel for sensing a touch input to the HMD; Further comprising an HMD.
5. The method of claim 4,
In the HMD case,
In the in-case state of the HMD,
A touch input hole located at a position corresponding to the touch sensing panel and exposing the touch sensing panel to the outside of the HMD case; Which is a case including the HMD.
3. The method of claim 2,
The processor comprising:
When the in-case state is detected,
And changes the light path to a first path to project the visual information to the display unit of the HMD case.
The method according to claim 1,
The processor comprising:
And changes the light path by rotating the projector unit.
The method according to claim 1,
A prism unit for reflecting light projected from the projector unit; Further comprising:
The processor comprising:
And changing the optical path by rotating the prism unit.
3. The method of claim 2,
The processor comprising:
When the in-case state is detected,
And changes the setting of the visual information displayed on the display unit based on the physical structure of the display unit of the HMD case.
10. The method of claim 9,
The physical structure of the display unit of the HMD case includes the position, size and shape of the display unit,
The processor comprising:
And changes the setting of the visual information based on at least one of the position, size, and shape of the display unit when the in-case state is detected.
10. The method of claim 9,
The processor comprising:
When changing the setting of the visual information,
And scales at least one of size, illuminance, contrast, color, brightness, contrast, and transparency of the visual information to match the physical structure of the display unit.
6. The method of claim 5,
The processor comprising:
When the in-case state is detected,
And changes settings of the touch sensing panel based on the physical structure of the touch input hole.
13. The method of claim 12,
The physical structure of the touch input hole includes the position, size, and shape of the touch input hole,
The processor comprising:
And changes the setting of the touch sensing panel based on at least one of a position, a size, and a shape of the touch input hole when the in-case state is detected.
13. The method of claim 12,
The processor comprising:
When the in-case state is detected,
And activates the touch input sensing of a panel area corresponding to a physical structure of the touch input hole of the touch sensing panel.
15. The method of claim 14,
The processor comprising:
And scales the activated partial area based on the reduction ratio of the active area when activating a part of the touch sensing panel corresponding to the touch input hole.
6. The method of claim 5,
The processor comprising:
When the in-case state is detected, based on the physical structure of the HMD case,
When the unexpected state is detected, based on the physical structure of the HMD,
And determines a type of a command corresponding to a touch input direction to the touch sensing panel.
3. The method of claim 2,
The HMD case includes a charging unit for supplying electric power to the HMD to charge the HMD; Which is a case including the HMD.
3. The method of claim 2,
The HMD case includes an audio output unit for outputting auditory information; Which is a case including the HMD.
6. The method of claim 5,
The processor comprising:
When the unexecuted state is detected,
The visual path of the projector unit is changed to a second path to provide the visual information through the HMD or to activate the touch input sensing in the overall region of the touch sensing panel.
A method of controlling an HMD (Head Mounted Display)
Detecting whether the HMD is housed in an HMD case housing the HMD; And
When the HMD detects the in-case state stored in the HMD case, the optical path of the projector unit is changed based on the physical structure of the HMD case,
Wherein the light path of the projector unit is changed based on the physical structure of the HMD when the HMD detects an unfolded state not accommodated in the HMD case.
21. The method of claim 20,
In the HMD case,
In the in-case state of the HMD,
A display unit for displaying the visual information projected from the projector unit; Wherein the HMD is a case including the HMD.
KR1020140005386A 2014-01-16 2014-01-16 Head mounted display and method for controlling the same KR20150085587A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020140005386A KR20150085587A (en) 2014-01-16 2014-01-16 Head mounted display and method for controlling the same
PCT/KR2014/001361 WO2015108225A1 (en) 2014-01-16 2014-02-20 Head mounted dispay and method of controlling therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140005386A KR20150085587A (en) 2014-01-16 2014-01-16 Head mounted display and method for controlling the same

Publications (1)

Publication Number Publication Date
KR20150085587A true KR20150085587A (en) 2015-07-24

Family

ID=53543102

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140005386A KR20150085587A (en) 2014-01-16 2014-01-16 Head mounted display and method for controlling the same

Country Status (2)

Country Link
KR (1) KR20150085587A (en)
WO (1) WO2015108225A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022215984A1 (en) * 2021-04-07 2022-10-13 삼성전자 주식회사 Method for controlling designated function, and electronic device for supporting same
WO2022244956A1 (en) * 2021-05-18 2022-11-24 삼성전자 주식회사 Wearable electronic device and external electronic device accommodating wearable electronic device
US11927985B2 (en) 2021-05-18 2024-03-12 Samsung Electronics Co., Ltd. Wearable electronic device and external electronic device accommodating wearable electronic device

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210135099A (en) * 2020-05-04 2021-11-12 삼성전자주식회사 Electronic device utilizing low power wireless communication and method thereof
WO2023238197A1 (en) * 2022-06-06 2023-12-14 株式会社ソニー・インタラクティブエンタテインメント Virtual reality content display system and virtual reality content display method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1164780A (en) * 1997-08-12 1999-03-05 Olympus Optical Co Ltd Head mounted video display device
JP3328177B2 (en) * 1997-10-29 2002-09-24 オリンパス光学工業株式会社 Head-mounted display device
JP2006195007A (en) * 2005-01-11 2006-07-27 Fujitsu Ten Ltd Display device
US20070064311A1 (en) * 2005-08-05 2007-03-22 Park Brian V Head mounted projector display for flat and immersive media
US7542210B2 (en) * 2006-06-29 2009-06-02 Chirieleison Sr Anthony Eye tracking head mounted display

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022215984A1 (en) * 2021-04-07 2022-10-13 삼성전자 주식회사 Method for controlling designated function, and electronic device for supporting same
WO2022244956A1 (en) * 2021-05-18 2022-11-24 삼성전자 주식회사 Wearable electronic device and external electronic device accommodating wearable electronic device
US11927985B2 (en) 2021-05-18 2024-03-12 Samsung Electronics Co., Ltd. Wearable electronic device and external electronic device accommodating wearable electronic device

Also Published As

Publication number Publication date
WO2015108225A1 (en) 2015-07-23

Similar Documents

Publication Publication Date Title
KR102637662B1 (en) Method and appratus for processing screen using device
US9864198B2 (en) Head-mounted display
KR102153599B1 (en) Head mounted display apparatus and method for changing a light transmittance
US10761566B2 (en) Electronic apparatus and method for processing information
KR102208195B1 (en) Method for controlling display screen in head-mounted display device, and head-mounted display device
KR20140132278A (en) Head mounted display
US20160011724A1 (en) Hands-Free Selection Using a Ring-Based User-Interface
JP2018101019A (en) Display unit and method for controlling display unit
KR20150096947A (en) The Apparatus and Method for Display System displaying Augmented Reality image
US20160216792A1 (en) Head mounted display, and control method and control program for head mounted display
KR20150085587A (en) Head mounted display and method for controlling the same
WO2013070408A1 (en) Velocity-based triggering
JP2018142857A (en) Head mounted display device, program, and control method of head mounted display device
KR20190101827A (en) Electronic apparatus for providing second content associated with first content displayed through display according to motion of external object, and operating method thereof
JP7059619B2 (en) Processing equipment, display systems, and programs
JP6776578B2 (en) Input device, input method, computer program
US9958681B2 (en) Electronic device and control method thereof
KR20200106871A (en) Head mounted display apparatus and method for changing a light transmittance
JP6996115B2 (en) Head-mounted display device, program, and control method of head-mounted display device
US10930200B2 (en) Connection device, display device, and control method for the display device
JP6932917B2 (en) Head-mounted display, program, and head-mounted display control method
TW201640180A (en) Head-mounted display
KR20240094945A (en) Electronic device, method, and computer-readable storage medium for displaying visual object indicating application using area formed based on user's body information
JP6693160B2 (en) Display device, display device control method, and program
JP6631299B2 (en) DISPLAY DEVICE, DISPLAY DEVICE CONTROL METHOD, AND PROGRAM

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination