KR101655792B1 - Head-mounted display apparatus - Google Patents

Abstract

A head mount display device includes: a main frame having one surface facing a user's face; And a wear part coupled to at least a part of the main frame and formed so that the main frame can be fixed to the face, wherein the main frame is formed in a hollow structure so that an external electronic device can be mounted on the other surface of the main frame, The main frame includes a position adjuster capable of adjusting the position of the external electronic device. The main frame includes a structure for preventing the external electronic device from tilting when the position is adjusted.

Description

[0001] HEAD-MOUNTED DISPLAY APPARATUS [0002]

Various embodiments of the present invention are directed to a head mounted display device.

Recently, various electronic devices in a form that can be worn directly on the body are being developed. These devices are commonly referred to as wearable electronic devices.

As an example of a wearable electronic device worn on a part of a body, there is a head-mounted display device (HMD) mounted on a head or head of a user to display an image, a smart glass, And may include various forms that are removable to a part of the human body or clothing, including, but not limited to, wristbands, smart wristbands, contact lens type devices, ring type devices, shoe type devices, The HMD may be formed into a goggle shape or an eyeglass shape.

As the wearable electronic device is directly worn on the body, portability and user's accessibility can be improved.

The head-mounted display device HMD according to various embodiments of the present invention can solve the inconvenience of carrying the portable terminal separately by using the portable mobile communication terminal as a display and mounting it on the head-mounted device. For example, the display of the head-mounted display device can output an image at a position facing the user's eyes, and the lens can be positioned between the user and the display to correct the user's visual acuity.

A head-mounted display HMD device according to various embodiments of the present invention provides a structure that can prevent shaking or tilting when adjusting the distance between the lens and the display device.

A head-mounted display (HMD) device according to various embodiments of the present invention includes a main frame having one surface facing the user's face; And a wear part coupled to at least a part of the main frame and formed so that the main frame can be fixed to the face, wherein the main frame is formed in a hollow structure so that an external electronic device can be mounted on the other surface of the main frame, The main frame includes a position adjuster capable of adjusting the position of the external electronic device. The main frame may include a structure for preventing the external electronic device from tilting when the position is adjusted.

According to various embodiments of the present invention, the head-mounted display HMD device can be prevented from shaking or tilting when moving the display, thereby providing a comfortable image to the user.

1 is a perspective view showing a configuration of a head-mounted display device according to various embodiments of the present invention.
Fig. 2 is a perspective view of the main frame of the head-mounted display device of Fig. 1 without being coupled with an electronic device. Fig.
Fig. 3 is a rear perspective view of Fig. 2 with the electronic device and the cover mounted. Fig.
4 is a state in which the head-mounted display device of FIG. 2 is worn by a user.
5 is an exploded perspective view of a main frame of a head-mounted display device according to various embodiments of the present invention.
6 is an exploded perspective view of a main frame of a head-mounted display device according to various embodiments of the present invention.
7A to 7C are a structural view and a cross-sectional view of a head-mounted display device with a front case removed in accordance with various embodiments of the present invention.
Fig. 8 is a cross-sectional view of the head-mounted display device of Fig. 1 cut in the AB direction. Fig.
Fig. 9 is a cross-sectional view of the head-mounted display device of Fig. 6 cut in the CD direction. Fig.
Fig. 10 shows a schematic block diagram showing the configuration of a head-mounted display device according to various embodiments of the present invention.
11 is a view for explaining a normal mode, a head-mounted mode (HMM), or a VR mode of a head-mounted display device according to various embodiments of the present invention.
Figure 12 is a view of a head-mounted display device according to various embodiments of the present invention providing a see-through mode using a rear camera of a smartphone.
13 is a view of a position adjustment unit of a head-mounted display device according to various embodiments of the present invention.
14 is a flowchart showing the tilting detection and user interface of the head-mounted display device according to various embodiments of the present invention.
15 is an exemplary screen for tilting detection and user interface of the head-mounted display device according to various embodiments of the present invention.
16 is a flowchart of tilting detection and measurement value display of the head-mounted display device according to various embodiments of the present invention.

Hereinafter, various embodiments will be described in detail with reference to the accompanying drawings. Note that, in the drawings, the same components are denoted by the same reference symbols as possible. Further, the detailed description of well-known functions and constructions that may obscure the gist of the present invention will be omitted. In the following description, only parts necessary for understanding the operation according to various embodiments of the present invention will be described, and the description of other parts will be omitted so as not to obscure the gist of the present invention.

A head-mounted display device according to various embodiments of the present invention includes a viewing-through display that provides a see-through or virtual reality (VR) through a display to provide augmented reality (AR) And may provide at least one of the See-Closed functions.

The see-through function allows the user to transmit the object or virtual object or object to the user through the display or the transparent / translucent lens, for example, in the case of the Google glass, Can generally mean the function of providing, using visual or diverse sensory means.

This see-through function allows the user to provide additional information and images for actually visible objects and the like.

In another embodiment, additional information may be provided to the user using a hologram or the like without a display or a lens.

The time-closed function is provided by a separate display, for example, in the case of Sony's HMZ, in which two displays are placed in front of the user's eyes so that content (game, movie, streaming, broadcast, As shown in FIG. This can provide the user with the impression by using the independent screen.

Accordingly, the HMD (Head-mounted Theater) device of the present invention can be differentiated from the conventional head-mounted display device.

The electronic device 200 that is detachably attached to the face plate 100 of the head-mounted display device 100 according to various embodiments of the present invention may be an apparatus including a communication function.

The electronic device 200 may be, for example, a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader, a desktop personal computer, Such as a laptop personal computer, a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device : At least one of a head-mounted-device (HMD) such as electronic glasses, an electronic garment, an electronic bracelet, an electronic necklace, an electronic app apparel, an electronic tattoo, or a smart watch.

FIG. 1 shows a configuration of an HMD device 100 according to various embodiments of the present invention, FIG. 2 shows a state in which the HMD device 100 of FIG. 1 is not coupled with the electronic device 200, FIG. 3 is a rear perspective view of FIG. 2 in a state where the electronic device 200 and the cover 220 are mounted, and FIG. 4 shows a state in which the head mounted display device 100 of FIG. 2 is worn by a user.

1 to 4, an HMD device 100 according to various embodiments of the present invention includes a main frame 110 and a support part 115 (e.g., a goggle band) .

The mainframe 110 may be worn on at least some of the user's faces (e.g., the facial side) and may be supported on the user's face by various components.

In one embodiment, the wear part 115 may adjust the length of the band formed of an elastic material so that the face plate 110 may be brought into close contact with the eyes of the user's face, and cushions .

Additionally or alternatively, the wearing part 115 may be comprised of eyeglass temples, helmets or straps, and the like.

The rear face of the main frame 110 is a portion " face contact part 130 " that contacts the face of the user and may have a structure corresponding to the bending of the user's face and may include at least a part of the elastic body 134.

The elastic body 134 may use at least one or more cushioning materials, such as a sponge, to provide a comfortable fit when the facial contacting part 130 contacts the user's face. The elastic body 134 may be formed of a single sponge or may have a shape obtained by laminating at least one sponge having a different compression ratio. For example, the elastic body 134 may be a sponge that is composed of three layers (e.g., upper layer, middle layer, and lower layer), the upper and lower layers may be sponges having a low compression ratio, and the middle layer may be a sponge having a high compression ratio.

According to another embodiment, the elastic body 134 may be detachably attached to the main frame 110. One side of the elastic body 134 can be positioned with an adhesive member, and can be detachably attached to the main frame 110 through the adhesive member 134. The adhesive member may be, for example, a velcro, a tape, an adhesive, or the like, and any adhesive member capable of being attached and detached may be used. Accordingly, when one HMD device 100 is used by multiple users, it is possible to use an elastic body corresponding to the user (for example, an adult and a child having different outline of the face), the surface of the elastic body 134 is contaminated (for example, The HMD device 100 can be used by replacing the elastic body 134 when the elastic body 134 is destroyed due to frequent use.

Accordingly, the HMD device 100 of the present invention can be easily worn on the user's face. For example, the shape or structure of the main frame 110 may be a shape that covers the user's eyes, and may include a nose recess 120 to allow the user's nose to be positioned.

A lens assembly including at least one lens may be inserted into a portion of the face contacting portion 130 at a location facing the user's two eyes.

When the user wears the HMD device 100 of the present invention, at least one side of the lens may be exposed to the face contact part 130 so that the user can see the screen of the display device with the user's eyes.

The mainframe 110 may also be made of a material that is light enough to support the electronic device 200, such as a plastic material, such that the user can feel comfortable fit.

The main frame 110 may further include a material for protecting the HMD device 100 of the present invention.

As another example, the protective material may be made of a variety of materials, such as glass, plastic (e.g. ABS, polycarbonate), ceramic, metal (e.g. aluminum) or metal alloys (e.g. steel, stainless steel, Titanium or a magnesium alloy).

The main frame 110 may include a touch pad 112, a display position adjustment unit 114, and a lens fixing unit 116, and may form a front case 122 including a space or structure capable of coupling the external electronic device 200 to the front surface thereof.

The mainframe 110 may further include a connector connector for communicating with the coupled external electronic device 200.

In one embodiment, the connector may include a USB connector, which may be connected to an electrical connection of the external electronic device 200, for example, a USB port, through which the signal of the graphical user interface And can be provided to the external electronic device 200.

The front case 122 of the main frame 110 may correspond to the external shape of the external electronic device 200.

In one embodiment, the front case 122 can accommodate external electronic devices 200 of varying sizes as they deform, including elastic or flexible materials.

The HMD device 100 according to various embodiments of the present invention may further include a cover 220 coupled to the main frame 110 so as to firmly support the terminal in the main frame 110 while the terminal of the external electronic device 200 is fastened.

The cover 220 may be physically coupled to the main frame 110 in the form of a hook, or may be coupled in the same manner as a magnet or an electromagnet.

Thus, the cover 220 can further prevent the terminal from being detached from the frame 110, and can enhance the aesthetics while forming the appearance of the frame 110.

The cover 220 may further include a window 240 on the front surface thereof, and the window 240 functions to enhance aesthetics through various materials and colors.

The window 240 can be made of a general plastic material such as PC, acrylic, or a ceramic material such as glass, sapphire, transparent ceramic, or a metal such as aluminum or SUS. In the case of a transparent material, it may contain a colored color, and transparency may be controlled.

The cover 220 may further include one or more openings 222. The opening 222 can easily dissipate the heat generated from the terminal to the outside of the cover 220, thereby lowering the terminal temperature and preventing terminal performance deterioration.

And the weight of the cover 220 may be reduced through the one or more openings 222, thereby reducing the overall weight and helping to reduce the weight.

The display or transparent / translucent lens 260 may be integrally fixed or detachably fixed to the lens fixing portion 116 of the main frame 110.

In one embodiment, a lens assembly may be inserted between the display and the user's eye.

The back side of the main frame 110 may also include a soft material (e.g., sponge, rubber, etc.) to protect the main frame 110 from excessive adhesion to the user ' s eyes.

In one embodiment, the mainframe 110 may include a control device or user input module capable of controlling the external electronic device 200.

The control device may include, for example, at least one of a touch pad 112 on the side of the main frame 110, a physical key, a physical button, a touch key, a joystick, or a wheel key.

In this embodiment, the touch pad 112 may display a graphical user interface (GUI) capable of controlling functions of the electronic device 200. [ For example, the GUI for the sound setting can control the volume of audio output from the external electronic device 200, and the GUI for the image reproduction can control the image displayed on the external electronic device 200.

The touch pad 112 may receive a touch input of the user or touch input of the touch pad 112 or a hovering input.

Since the HMD device 100 of the present invention is connected to the external electronic device 200 using an interface such as a USB, the received touch input can be transmitted to the external electronic device 200.

The external electronic device 200 can control the function corresponding to the touch input in response to the touch input received from the HMD device 100. [ For example, the external electronic device 200 can adjust the volume or control the image reproduction in response to the received touch input.

According to one embodiment, the display position adjustment unit 114 may be configured in the form of a wheel or a dial.

When the user turns the wheel or the dial implemented in the position adjustment unit 114, the external electronic device 200 can be moved to adjust the distance between the display of the external electronic device 200 and the user so that the user can adjust the display The position of the external electronic device 200 can be adjusted so that the user can appreciate the image.

Meanwhile, the front case 122 of the main frame 110 may include a fastening part 500 for fastening the coupled external electronic device 200 thereto.

5 to 6 are exploded perspective views of a main frame 110 of the head-mounted display device 100 according to various embodiments of the present invention.

5, the main frame 110 includes a front case 122, a lens fixing part 116, a face contact part 130, a rear case 131, at least one lens moving rail 141A, 141B, 141C and 141D, at least one lens moving rail Fixed portions 142A, 142B, 142C, 142D, or cover 220. [

The front case 122 can secure the electronic device 200 between the covers 220. [ The front case 122 may include a fixing part capable of supporting the cover 220 and a fixing part capable of fixing the electronic device 200. [ For example, the front case 122 may further include the fastening portion 500 of FIG. 1 and may secure the electronic device 200 through the fastening portion 500.

If there is an operation of the position adjusting unit 114 for moving the electronic device 200, the front case 122 moves along at least one lens moving rail 141A, 141B, 141C, and 141D while the electronic device 200 is fixed. For example, through the operation of the position adjustment unit 114, the front case 122 can be moved away from or close to the user's eyes while the electronic device 200 is fixed.

The face contact part 130 is disposed on one side of the rear case 132 and may be formed of a cushion material so as to provide a comfortable feeling as a part where the HMD device 100 and the body part of the user are in direct contact with each other. When the user wears the HMD device 100, at least one side of the lens may be exposed to the face contact part 130 so that the user can see the screen of the display device with his or her eyes.

The rear case 131 can partially expose the position adjusting unit 114 to the upper center. The position adjustment unit 114 may be installed in at least one or more of the wheels or a dial. The user may turn the wheel or dial implemented in the position adjustment unit 114 to adjust the position of the display. The position where the position adjustment unit 114 is disposed can be variously adjusted in consideration of the characteristics of the HMD device 100.

In one embodiment, the HMD device 100 can adjust the distance between the electronic device 200 and the user by locking the lens and moving the electronic device 200 supported by the HMD device 100 through the position adjustment portion 114. The user can adjust the position of the electronic device 200 by adjusting the display position of the electronic device 200 through the position adjustment unit 114 so that the user can enjoy an image suitable for his or her own visual acuity.

In one embodiment, when the user manipulates the position adjustment unit 114, the HMD device 100 may move the electronic device 200 closer to the user or move it away to the user.

In one embodiment, the front case 122 constituting the main frame 110 can be moved in accordance with the operation of the position adjustment unit 114. At this time, the rear case 131 provides a space through which the front case 122 can move, and can provide a movable guide.

The lens fixing portion 116 can be detachably fixed to the display or the transparent / translucent lens 260. The lens fixing portion 116 may be disposed between the front case 122 and the rear case 131.

The at least one lens moving rails 141A, 141B, 141C, and 141D may be disposed on one side of the four corners of the front case 122, the lens fixing portion 116, and the rear case 131. At least one lens moving rails 141A, 141B, 141C, May be fixed to the rear case 131 through at least one lens moving rail fixing part 142A, 142B, 142C, 142D. At least one or more lens moving rails 141A, 141B, 141C, and 141D fixed to the rear case 131 may be fixed to the front case 122 through the lens fixing portion 116. [

In Fig. 6, the lens fixing portion 116 can be combined with at least one elastic member 143A, 143B, 143C, 143D.

At least one or more lens moving rails 141A, 141B, 141C, and 141D are provided in at least one of the elastic members 143A, 143B, 143C, and 143D in a structure in which at least one of the elastic members 143A, 143B, 143C, . For example, when at least one elastic member 143A, 143B, 143C, 143D is a resilient spring, at least one lens moving rail 141A, 141B, 141C, 141D may be disposed inside the spring. When at least one elastic member 143A, 143B, 143C, 143D is a spring having elasticity, it may be a spring having various types such as a coil spring, a leaf spring, a hydraulic spring, It can be replaced by a substance.

When at least one elastic member 143A, 143B, 143C, 143D moves along the at least one lens moving rail 141A, 141B, 141C, 141D by the operation of the position adjustment section 114, It is possible to prevent the front case 122 from being shaken or tilted.

When the position adjusting unit 114 is operated, the front case 122 can be moved while the female screw and the male screw included in at least one of the moving gears 133A and 133B are loosened or tightened. For example, the direction in which the male screw is released may be the direction in which the front case 122 approaches the lens 260 or the user, and the direction in which the male screw is wound may be the direction in which the front case 122 moves away from the lens 260 or away from the user. In another embodiment, the direction in which the male screw is wound may be the direction in which the front case 122 approaches the lens 260 or the user, and the direction in which the male screw is released may be the direction in which the front case 122 moves away from the lens 260 or away from the user.

7A to 7C are a structural view and a cross-sectional view of the head-mounted display device 100 with the front case removed in accordance with various embodiments of the present invention.

In Fig. 7A, at least one elastic member 143A, 143B, 143C, 143D may be fixed to the lens fixing portion 116. Fig. The lens fixing portion 116 may include at least one fixing member 144A, 144B, 144C, 144D capable of fixing at least one elastic member 143A, 143B, 143C, 143D. At least one of the fixing members 144A, 144B, 144C and 144D may be separately inserted into the lens fixing portion 116 or may include at least one fixing member 144A, 144B, 144C and 144D when the lens fixing portion 116 is injected.

At least one of the fixing members 144A, 144B, 144C and 144D has at least one elastic member 143A, 143B, 143C, 143D and at least four lens moving rails 141A, 141B, 141C and 141D at four corners of the lens fixing portion 116 Can be located.

Each of the at least one fixing members 144A, 144B, 144C and 144D is provided with a groove (or hole) 147 in which the lens moving rails 141A, 141B, 141C and 141D can be inserted and fixing members 143A, 143B, 143C and 143D And includes a hook. The hook direction may be the direction of the front case 122.

In Fig. 7B, the hooks of the fixing members 144A, 144B, 144C and 144D have grooves 145 through which the elastic members 143A, 143B, 143C and 143D can be fitted, and the hooks of the fixing members 144A, 144B, 144C and 144D are engaged with the elastic members 143A , 143B, 143C, 143D can be prevented from departing from each other.

In Fig. 7C, the hooks of the fixing members 144A, 144B, 144C and 144D fix the elastic members 143A, 143B, 143C and 143D. The lens moving rails 141A, 141B, 141C and 141D can be inserted through the grooves (or holes) 147 of the fixing members 144A, 144B, 144C and 144D.

8 is a cross-sectional view of the head-mounted display device 100 of Fig. 1 taken along the line A-B.

Through the operation of the position adjusting section 114, the front case 122 can be moved while the female screw and the male screw included in the moving gears 133A and 133B are loosened or tightened.

At this time, when the front case 122 is moved in the direction of the lens 260 or the user, the electronic device 200 and the lens 260 may be close to the maximum first distance D1. When the front case 122 is moved in a direction away from the lens 260 or the user, the distance of the distance between the electronic device 200 and the lens 260 may be distanced to a maximum second distance D2. The front case 122 is movable between the first distance D1 and the second distance D2 with respect to the lens 260. For example, the first distance D1 may be 39 mm and the second distance D2 may be 47 mm. For example, the refractive index of the lens 260 at the first distance D1 may be -9 diopter, and the refractive index of the lens 260 at the second distance D2 may be +0.5 diopters. The HMD device 100 can provide the user with a refractive index of the lens 260 between -9 and +0.5 diopters.

9 is a cross-sectional view of the head-mounted display device 100 of Fig. 6 taken along the line C-D.

The front case 122 has at least one connecting cylinder 141A, 141B, 141C, 141D to which the lens moving rails 141A, 141B, 141C, 141D are coupled at four corners that contact the lens moving rails 141A, 141B, 141C, 141D or the elastic members 143A, 143B, 143C, 123A, 123B, 123C, and 123D. Each of the at least one coupling cylinder 123A, 123B, 123C, and 123D may further include a bush 124 therein. At least one of the coupling cylinders 123A, 123B, 123C, and 123D may include lens moving rails 141A, 141B, and 141C , The guide function can be performed at the time of 141D movement. At least one of the coupling cylinders 123A, 123B, 123C, and 123D is coupled to the outside with elastic members 143A, 143B, 143C, and 143D, thereby preventing the elastic members 143A, 143B, 143C, and 143D from being separated. When the user moves the front case 122, the bushes located inside the front case 122 can move on the surfaces of the lens moving rails 141A, 141B, 141C, and 141D. One end of each of the lens moving rails 141A, 141B, 141C, and 141D can form a thread like a screw, and at least one lens moving rail fixing parts 142A, 142B, 142C, 142D And the lens fixing portion 116 may be positioned between the lens moving rails 141A, 141B, 141C, and 141D and the rear case 131 by fixing a step 146 to the end of the threaded portion.

The smaller the distance between the bush and the lens moving rails 141A, 141B, 141C and 141D, the smaller the amount of flow. However, the assembly may be difficult due to the dimensional tolerance between the parts. On the other hand, . Considering the flow amount and assembly tolerance, the gap between the two parts may be about 0.03 to 0.05 mm, for example. The bush can be made of a metal material and can be made of a material having high dimensional accuracy with respect to the metal. Likewise, the lens moving rails 141A, 141B, 141C and 141D can be made of a metal material, have.

Fig. 10 shows a schematic block diagram illustrating the configuration of a head-mounted display device 100 according to various embodiments of the present invention.

10, an HMD device 100 according to various embodiments of the present invention includes a micro controller unit (MCU) 320, a communication module 340, a sensor module 360, an input device 380, a power management module 400 and a battery 410, An eye tracker 420, a motor (Vibrator) 430, adjustable optics or a lens assembly 440 and a memory 450.

In the above block diagram, other components (e.g., a display) are not shown for convenience of explanation.

In other embodiments, some of the components shown in the block diagram may be included within the mainframe 110, while other components may be included within a display device (e.g., a removable smart phone) of the external electronic device 200.

The control unit (MCU) 320 includes, for example, a processor, and can control a plurality of hardware components connected to the control unit 320 by driving an operating system (OS) or an embedded software program.

The communication module 340 can perform data transmission and reception by electrically connecting the main frame 110 of the HMD device 100 of the present invention and the external electronic device 200, for example, a smartphone terminal by using wire and / or wireless communication.

According to one embodiment, the communication module 340 may include a USB module, a WiFi module, a BT module, an NFC module, and a GPS module.

According to another embodiment, at least some (e.g., two or more) of the WiFi module, the BT module, the GPS module, or the NFC module may be included in one integrated chip (IC) or an IC package.

The sensor module 360 can measure the physical quantity or detect the operating state of the HMD device, and convert the measured or sensed information into electrical signals. The sensor module 360 may include at least one of, for example, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a magnetic sensor, a proximity sensor, a gesture sensor, a grip sensor, and a biosensor.

An acceleration sensor, a gyro sensor, and a magnetic field sensor can be used to detect a head movement of a user wearing the HMD device 100. [

It is possible to detect whether the HMD device 100 is worn by using a proximity sensor or a grip sensor.

In one embodiment, at least some of the components of the sensor module 360 may be included in the smart phone of the removable electronic device 200.

According to one embodiment, at least one of IR recognition, pressure recognition, and variation of capacitance (or dielectric constant) due to wear of a user can be sensed to detect whether or not the user wears the sensor.

The gesture sensor can detect movement of a user's hand or finger and receive the gesture sensor through the input operation of the HMD device 100 of the present invention.

Additionally or alternatively, the sensor module 360 may be a biometric sensor such as, for example, an e-nose sensor, an electromyography sensor, an electroencephalogram sensor, an electrocardiogram sensor, The biometric information of the user can be recognized by using the sensor.

The sensor module 360 may further include a control circuit for controlling at least one or more sensors belonging to the sensor module 360.

The input device 380 may include a touch pad 112 and a button. The touch pad 112 can recognize the touch input in at least one of, for example, an electrostatic type, a pressure sensitive type, an infrared type, or an ultrasonic type. Further, the touch pad 112 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch pad may further include a tactile layer. In this case, the touchpad 112 may provide a tactile response to the user, and the button may include, for example, a physical button, an optical key or a keypad.

The eye tracker 420 may include at least one of EOG sensor, Coil systems, Dual purkinje systems, Bright pupil systems, Dark pupil systems, So that the user's eyes can be tracked. The gaze tracking unit 420 may further include a micro camera for gaze tracking. The adjustable optics 440 measures the user's inter-pupil distance (IPD) so that the user can enjoy an image suitable for his / her sight, and adjusts the distance of the lens and the display position of the electronic device 200 Can be adjusted.

The memory 450 may include an internal memory or an external memory. For example, the internal memory may be a volatile memory (e.g., dynamic RAM, SRAM, synchronous dynamic RAM (SDRAM), etc.) or non-volatile memory (e.g., OTPROM one time programmable ROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, NOR flash memory, . According to one embodiment, the internal memory may be a solid state drive (SSD). The external memory may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital . The external memory can be functionally connected to the HMD device 100 through various interfaces. According to one embodiment, the HMD device 100 may further include a storage device (or storage medium) such as a hard drive.

The memory 450 may store commands or data generated from the control unit 320, the communication module 340, the input device 380, and the sensor module 360. Memory 450 may include programming modules such as a kernel, middleware, an application programming interface (API), or an application.

The kernel may control or manage system resources (e. G., Control 360 or memory 450) used to execute operations or functions implemented in other programming modules (e. G., Middleware, APIs or applications) .

The kernel may provide an interface through which middleware, APIs or applications can access and control or manage the individual components of the HMD device 100.

The middleware can act as an intermediary for the API or application to communicate with the kernel and exchange data. With respect to the work requests received from the applications, the middleware assigns a priority to use at least one of the applications with the system resources (e.g., control 320 or memory 450) of the head mounted display device 100 You can perform control (such as scheduling or load balancing) on work requests.

An API is an interface for an application to control functions provided by the kernel or middleware. For example, the API may include at least one interface or function (e.g., command) for file control, window control, image processing, or character control.

The application can be used to monitor and / or monitor SMS / MMS applications, email applications, calendar applications, alarm applications, health care applications (eg, applications that measure momentum or blood glucose), or environmental information applications (such as pressure, humidity, (E.g., providing applications). Additionally or alternatively, the application may be an application related to the exchange of information between the HMD device 100 and the electronic device 200. For example, an application related to information exchange may include a notification relay application for communicating specific information to the electronic device 200, or a device management application for managing the electronic device 200.

For example, the notification delivery application has the function of transmitting notification information generated by another application (e.g., an SMS / MMS application, an email application, a healthcare application, or an environmental information application) of the HMD device 100 to the electronic device 200 . Additionally or alternatively, the notification delivery application may receive notification information from the electronic device 200 and provide it to the user. For example, the device management application may determine whether to turn on / off the function (e.g., turn on / off of the external electronic device itself (or some component) or the brightness of the display (E.g., install, delete, or update) services provided by an external electronic device or external electronic device (e.g., call service or message service).

11 is a diagram for explaining a normal mode and an HMM (head-mounted mode) or a VR mode of the HMD device 100 according to various embodiments of the present invention.

The HMM or VR mode may include a See-through function that provides a see-through or virtual reality (VR) that provides augmented reality (AR) For example, as the electronic device 200, the smartphone may be switched from the normal mode to the HMM or VR mode when the smartphone is mounted and operated on the main frame 110 of the HMD device 100 of the present invention. In the HMM or VR mode, one image may be represented as two images. According to one embodiment, since the HMM or VR mode may cause distortion of the image due to the lens 240 included in the main frame 110, the image of the plane may be distorted according to the characteristics of the lens Reverse distortion can be performed.

Figure 12 is a view of a head-mounted display device according to various embodiments of the present invention providing a see-through mode using a rear camera of a smartphone.

Referring to FIG. 12, the head-mounted display device 100 of the present invention can provide a see-through mode as an external electronic device 200 using a rear camera of a smart phone.

 In one embodiment, a method of providing a see-through mode may be performed by pressing a view-through mode switching button in the VR mode. In this case, the preview screen of the rear camera may be displayed in a PIP (Picture-in-Picture) form in a part of the existing VR screen, the VR screen may be switched to the background, You can also expand it. Through this, the user can experience the external virtual environment and at the same time confirm the surrounding environment through the camera image as needed.

13 is a view of a position adjustment unit 114 of the head-mounted display device 100 according to various embodiments of the present invention.

When the position adjusting unit 114 located in the main frame 110 is operated, the sensor module 360, the focus adjusting unit 440, or the switch, which is located on the main frame 110 or the main frame 110, You can receive input. Various embodiments of the present invention can be detected through a photo-reflector sensor, which is one of several devices that detect the operation of the position adjustment unit 114. FIG. The sensor module 360 may be positioned on at least one side of the position adjustment unit 114 located on the main frame 110 so that the rotation of the sensor module 360 may be detected. The photo-reflector sensor transmits light of the light-emitting unit to the surface of the position adjusting unit 114, and senses the rotation by detecting a change in the input value of the light-receiving unit according to the change of the pattern through the rotation.

14 is a flowchart showing the tilting detection and user interface (UI) of the head-mounted display device 100 according to various embodiments of the present invention.

The HMD apparatus 100 can sense the operation of the position adjustment unit 114 in operation 1401. [ In one embodiment, the HMD device 100 implements a certain pattern of the position adjustment unit 114, and the photo-reflector sensor transmits light of the light emitting unit to the surface of the position adjustment unit 114, detects a change in the input value of the light receiving unit, Can be detected.

In operation 1403, the HMD device 100 may display a skew confirmation user interface (UI). In one embodiment, the HMD device 100 may display a tilt confirmation user interface (UI) on the electronic device 200 associated with the HMD device 100, in operation 1403. The tilting confirmation user interface UI can also serve as a focus confirmation user interface. For example, the tilt confirmation user interface (UI) may be a constant repeating shape (e.g., at least one dot shape in the longitudinal direction). A user interface (UI) for confirming that the image (e.g., all dots) is clearly skewed will be displayed if the image adjusted by the user through the position adjustment unit 114 is correctly focused and is not skewed to the image. If the image adjusted by the user through the position adjustment unit 114 is out of focus and is inclined to the image, a slanting confirmation user interface (UI) is displayed in which a part of the image is blurred or the image corresponding to the outline of the center part is blurred will be.

The user can adjust the position adjustment unit 114 through the user interface (UI) for tilt confirmation to precisely focus the image and eliminate the tilt.

In operation 1405, the HMD device 100 may determine whether the user interface (UI) for skew confirmation is terminated. If the tilting confirmation user interface (UI) is not terminated, the HMD device 100 branches to operation 1403. When the user input for ending the tilting confirmation user interface (UI) is received, whether the tilting confirmation user interface (UI) is ended or not can be determined. The user input may be input through at least one of the touch pad 112 on the side of the main frame 110, a physical key, a physical button, a touch key, a joystick, or a wheel key.

FIG. 15 is an exemplary screen of a tilting detection and user interface (UI) of the head-mounted display device 100 according to various embodiments of the present invention.

When the lens 260 and the front case 122 are parallel to each other, as shown in the screen example of the reference numeral 1501, all the dots of the user interface (UI) for tilting confirmation of the screen example of the reference numeral can be clearly displayed.

When the lens 260 and the front case 122 are inclined as shown in the screen of the reference numeral 1505, some of the dots of the user interface (UI) for confirming the inclination of the screen example shown in FIG. The negative shape can be displayed distorted. In the user interface (UI) for tilting confirmation of the screen example of the reference numeral, tilting occurs and the dots of the center and the outer contour may be displayed in an out-of-focus state or the shape may be displayed distorted in the outer shape All.

16 is a flowchart illustrating tilting detection and measurement value display of the head-mounted display device 100 according to various embodiments of the present invention.

The HMD device 100 can sense the operation of the position adjustment unit 114 in operation 1601. [

The HMD device 100 may activate the sensor module 360 in operation 1603. The HMD device 100 can activate a sensor capable of measuring distance and depth from the sensor module 360 in operation 1603. [ Sensors capable of distance and depth measurement may include proximity sensors, cameras, ultrasonic sensors, and the like.

The HMD device 100 can measure the distance between the electronic device 200 and the HMD device 100 with the sensor module 360 in 1605 operation.

The HMD device 100 can display the measured distance in the 1607 operation. In one embodiment, the HMD device 100 may, in operation 1607, display the measured distance via the electronic device 200.

In operation 1609, the HMD device 100 determines whether the measured distance is within an error range. For example, if the distance between the electronic device 200 and the HMD device 100 is within the error range, it can be determined that no tilting or focussing occurs. If the measured distance is determined to be equal to or larger than the error range, the user will continuously try to adjust the focus or tilt using the position adjustment unit 114 and branch to operation 1601.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. no.

Accordingly, the scope of various embodiments of the present invention should be construed as being included in the scope of various embodiments of the present invention without departing from the scope of the present invention, all changes or modifications derived from the technical idea of various embodiments of the present invention .

Claims (15)

In a head mounted device,
A frame including a top surface, a bottom surface, a first side surface and a second side surface, and a rear surface having a shape shaped to be worn on the user's face;
A band connected to a portion of a first side of the frame and a portion of the second side and having elasticity;
A cover coupled to a portion of the head-mounted device to cover at least a portion of the portable electronic device mounted on the frame;
At least a part of which is housed in the frame, and includes a coupling structure capable of detachably mounting the portable electronic device, the portable electronic device comprising: a movable front case;
A lens assembly positioned between the front case and the rear surface, the lens assembly including a first lens and a second lens disposed between the display of the portable electronic device mounted on the frame and the user's eyes, respectively;
A position adjusting unit located on an upper surface of the frame and adjusting a distance between the first lens and the second lens and a display of the portable electronic device mounted on the frame; And
And a posture maintaining portion that is disposed at least partially on the lens assembly and prevents tilting of the portable electronic device,
The posture maintaining unit
At least one first projection projecting from the lens assembly toward the front case, guiding a movement path of the front case when the front case is moved by the operation of the position adjustment unit;
At least one second protrusion protruding from the front case toward the lens assembly and connected to move with the at least one first protrusion; And
At least one elastic member having a first end disposed on an outer periphery of the at least one first projection and a second end disposed on an outer periphery of the at least one second projection,
Wherein the first end contacts the lens assembly and the second end contacts a portion of the front case. The method according to claim 1,
The position-
Comprising a rotatable wheel or dial,
Wherein at least a portion of the wheel or dial is exposed to the outside of the frame. The method according to claim 1,
The front case
Wherein the portable electronic device includes a coupling structure that can be engaged with the portable electronic device regardless of the size of the portable electronic device. delete The method according to claim 1,
The posture maintaining unit
And at least one fixing member for fixing the at least one elastic member to the lens assembly. 6. The method of claim 5,
The at least one fixing member
And a latching structure capable of fixing the at least one elastic member to the lens assembly. The method of claim 1, wherein
The at least one resilient member
A coil spring, a leaf spring, a hydraulic spring, a rubber, or a sponge. The method according to claim 1,
And a moving member connected to the position adjusting unit and moving the front case mounted with the portable electronic device according to the adjustment of the position adjusting unit. 9. The method of claim 8,
The moving member
And a gear assembly capable of adjusting a position of the portable electronic device by a force transmitted from the position adjusting unit. The method according to claim 1,
Further comprising an interface electrically connectable to the portable electronic device. The method according to claim 1,
Wherein each of the at least one first projection and the at least one second projection
Each of which is formed at a position corresponding to each of upper, lower, right and left sides of the frame. The method according to claim 1,
The at least one resilient member
And one at a position corresponding to each of the upper, lower, right, and left sides of the frame. In a head mounted device,
A main frame including a top surface, a bottom surface, a first side surface and a second side surface, and a rear surface having a shape shaped to be worn on the user's face;
A wear part connected to a part of the first side of the main frame and a part of the second side and having elasticity;
A cover coupled to a portion of the head-mounted device to cover at least a portion of the portable electronic device mounted on the mainframe;
A front case including at least a part of which is housed in the main frame and includes a coupling structure in which the portable electronic device is detachably mountable;
A lens assembly positioned between the front case and the rear surface, the lens assembly including a first lens and a second lens disposed between a display of a portable electronic device mounted on the main frame and a user's eyes, respectively;
A position adjusting unit located on an upper surface of the main frame and adjusting a distance between the first lens and the second lens and a display of the portable electronic device mounted on the main frame; And
And an attitude maintaining unit disposed at least partially on the lens assembly to prevent inclination of the portable electronic device,
The posture maintaining unit
At least one lens moving rail protruding from the lens assembly toward the front case to guide the movement path of the portable electronic device when the portable electronic device moves by the operation of the position adjusting unit;
At least one cylindrical coupling portion disposed in the front case and protruding toward the lens assembly and connected to the at least one lens moving rail; And
At least one elastic member having a first end disposed on an outer periphery of the at least one lens moving rail and a second end disposed on an outer periphery of the at least one cylindrical coupling portion,
Wherein the first end contacts the lens assembly and the second end contacts a portion of the front case. A case formed on the first surface to expose at least a portion of the lens module and to face the face of the user; And
And a band, coupled with at least a portion of the case, such that the case is secured to the face,
The case
A cavity structure including a second surface at a back surface of the first surface, the portable electronic device being mounted opposite the second surface;
At least one position adjuster for adjusting a position between the portable electronic device and the lens module in at least a part of the side face surrounding the first face and the second face; And
And an anti-tilt structure disposed within the casing to oppose the cavity structure to prevent tilting of the portable electronic device,
The anti-tilt structure
At least one first moving rail for guiding a moving path of the portable electronic device when the portable electronic device moves by the operation of the position adjusting portion;
At least one second moving rail facing the at least one first moving rail; And
At least one resilient member having a first end disposed on an outer periphery of said at least one first moving rail and a second end disposed on an outer periphery of said at least one second moving rail. 15. The method of claim 14,
Wherein the second moving rail includes a cylindrical structure including a hollow, at least a portion of the first moving rail being movably inserted in the hollow.

Images