WO2024071903A1 - Appareil de visiocasque et procédé de détection d'état de port de celui-ci - Google Patents

Appareil de visiocasque et procédé de détection d'état de port de celui-ci Download PDF

Info

Publication number
WO2024071903A1
WO2024071903A1 PCT/KR2023/014648 KR2023014648W WO2024071903A1 WO 2024071903 A1 WO2024071903 A1 WO 2024071903A1 KR 2023014648 W KR2023014648 W KR 2023014648W WO 2024071903 A1 WO2024071903 A1 WO 2024071903A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
hmd
wearing
display device
mounted display
Prior art date
Application number
PCT/KR2023/014648
Other languages
English (en)
Korean (ko)
Inventor
이승헌
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020220138584A external-priority patent/KR20240043031A/ko
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2024071903A1 publication Critical patent/WO2024071903A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Definitions

  • Various embodiments of the present disclosure relate to a head mounted display device and technology for detecting a wearing state thereof.
  • wearable electronic devices that can be worn directly on the body have been actively distributed. Wearable electronic devices can improve mobility and portability because they can be used by being mounted on any part of the body, such as the wrist, ankle, neck, waist, or head.
  • a head-mounted display apparatus (hereinafter referred to as HMD) that is mounted on the user's head and displays images may be provided with a wearing portion so that it can be mounted on the head.
  • HMDs may include an AR device that implements augmented reality (AR) and a VR device that implements virtual reality (VR).
  • AR augmented reality
  • VR virtual reality
  • the HMD when the HMD is worn on the user's head, it can activate the display to display information such as AR content or VR content. Additionally, the HMD can disable the display when not worn on the user's head. To control the activation or deactivation of these displays, the HMD can detect the wearing state.
  • Existing HMDs may be equipped with separate sensors, such as proximity sensors, to detect the wearing state.
  • sensors such as proximity sensors
  • the HMD is equipped with a separate sensor, not only does the manufacturing cost increase, but the mounting space for other electronic components may become narrow due to the sensor mounting space.
  • space restrictions may be imposed because many electronic components are intensively mounted on the glasses frame, including the temples.
  • Various embodiments of the present disclosure can provide an HMD that detects a wearing state using a touch circuit disposed on the inner surface of the wearable unit without a separate sensor and a method for detecting the wearing state thereof.
  • a head mounted display device includes a frame including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction, and a frame including a second surface facing in a second direction opposite to the first direction. It may include a display exposed to the outside, wearing parts respectively connected to both ends of the frame and extending in one direction, and a processor disposed inside at least one of the frame or the wearing parts.
  • Each of the wearing units may include an inner surface that is in contact with a portion of the head when the head mounted display device is worn on the user's head, and an outer surface that faces the inner surface.
  • At least one of the wearing parts may include a first touch circuit disposed on the inner surface.
  • the method for detecting the wearing state of a head mounted display device includes detecting the inner surface of at least one of the wearing parts connected to both ends of the frame of the head mounted display device and extending in one direction.
  • the wearing state is detected using a touch circuit disposed on the inner surface of the wearable unit without a separate sensor, thereby reducing manufacturing costs and making it easy to secure mounting space for electronic components. .
  • FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
  • FIG. 2 is a diagram for explaining the configuration of an AR device among HMDs according to an embodiment of the present disclosure.
  • FIG. 3 is a diagram illustrating a touch circuit disposed in an AR device among HMDs according to an embodiment of the present disclosure.
  • Figure 4 is a front perspective view of a VR device among HMDs according to an embodiment of the present disclosure.
  • Figure 5 is a rear perspective view of a VR device among HMDs according to an embodiment of the present disclosure.
  • FIG. 6 is a diagram illustrating a touch circuit disposed on a wearable portion of an HMD according to an embodiment of the present disclosure.
  • FIG. 7 is a diagram for explaining a method of operating an HMD when worn, according to an embodiment of the present disclosure.
  • FIG. 8 is a diagram for explaining another method of operating an HMD when worn, according to an embodiment of the present disclosure.
  • FIG. 9 is a diagram for explaining a method of operating an HMD when removing the HMD according to an embodiment of the present disclosure.
  • FIG. 10 is a diagram for explaining a method of operating an HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.
  • FIG. 11 is a diagram for explaining another method of operating the HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.
  • FIG. 12 is a diagram illustrating a method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.
  • FIG. 13 is a diagram illustrating another method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.
  • FIG. 14 is a diagram for explaining a method of operating an HMD when wearing parts of the HMD are in contact according to an embodiment of the present disclosure.
  • FIG. 15 is a diagram for explaining another method of operating an HMD when wearing parts of the HMD are in contact, according to an embodiment of the present disclosure.
  • FIG. 16 is a diagram for explaining a method of operating an HMD when the HMD enters a charger according to an embodiment of the present disclosure.
  • FIG. 17 is a diagram for explaining a method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.
  • FIG. 18 is a diagram for explaining another method of operating an HMD related to the wearing posture of the HMD according to an embodiment of the present disclosure.
  • FIG. 19 is a diagram for explaining another method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments.
  • the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108.
  • a first network 198 e.g., a short-range wireless communication network
  • a second network 199 e.g., a second network 199.
  • the electronic device 101 may communicate with the electronic device 104 through the server 108.
  • the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197.
  • at least one of these components eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101.
  • some of these components e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.
  • the processor 120 for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores instructions or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134.
  • software e.g., program 140
  • the processor 120 stores instructions or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132.
  • the commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134.
  • the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
  • the main processor 121 e.g., a central processing unit or an application processor
  • an auxiliary processor 123 e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor.
  • the electronic device 101 includes a main processor 121 and a secondary processor 123
  • the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can.
  • the auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.
  • the auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled.
  • co-processor 123 e.g., image signal processor or communication processor
  • may be implemented as part of another functionally related component e.g., camera module 180 or communication module 190. there is.
  • the auxiliary processor 123 may include a hardware structure specialized for processing artificial intelligence models.
  • Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108).
  • Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited.
  • An artificial intelligence model may include multiple artificial neural network layers.
  • Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above.
  • artificial intelligence models may additionally or alternatively include software structures.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto.
  • Memory 130 may include volatile memory 132 or non-volatile memory 134.
  • the program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.
  • the input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user).
  • the input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).
  • the sound output module 155 may output sound signals to the outside of the electronic device 101.
  • the sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback.
  • the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
  • the display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user).
  • the display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device.
  • the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.
  • the audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).
  • the electronic device 102 e.g., speaker or headphone
  • the sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do.
  • the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.
  • the interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card interface
  • audio interface audio interface
  • connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 can capture still images and moving images.
  • the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 can manage power supplied to the electronic device 101.
  • the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101.
  • the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
  • Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication.
  • processor 120 e.g., an application processor
  • the communication module 190 may be a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included.
  • a wireless communication module 192 e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
  • GNSS global navigation satellite system
  • wired communication module 194 e.g., : LAN (local area network) communication module, or power line communication module
  • the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN).
  • a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN).
  • a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN).
  • a telecommunication network such as a cellular network, a 5G network, a next-generation communication network
  • the wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199.
  • subscriber information e.g., International Mobile Subscriber Identifier (IMSI)
  • IMSI International Mobile Subscriber Identifier
  • the wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology).
  • NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported.
  • the wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates.
  • the wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna.
  • the wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199).
  • the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC.
  • Peak data rate e.g., 20 Gbps or more
  • loss coverage e.g., 164 dB or less
  • U-plane latency e.g., 164 dB or less
  • the antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB).
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for the communication method used in the communication network, such as the first network 198 or the second network 199, is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna.
  • other components eg, radio frequency integrated circuit (RFIC) may be additionally formed as part of the antenna module 197.
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.
  • a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side)
  • peripheral devices e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • signal e.g. commands or data
  • commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199.
  • Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101.
  • all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108.
  • the electronic device 101 may perform the function or service instead of executing the function or service on its own.
  • one or more external electronic devices may be requested to perform at least part of the function or service.
  • One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101.
  • the electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology can be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an Internet of Things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks.
  • the external electronic device 104 or server 108 may be included in the second network 199.
  • the electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
  • the shape, structure, and operation (or operating method) of a head-mounted display apparatus (hereinafter referred to as HMD) that is mounted on the user's head and displays images is mentioned, but the configuration is It may be the same or similar to the configuration of the electronic device 101 of FIG. 1 described above.
  • the HMD may include an AR device that implements augmented reality and a VR device that implements virtual reality.
  • Figures 2 and 3 describe the shape and structure of the AR device among the HMD, and Figures 4 and 5 In this section, the shape and structure of the VR device among HMD devices will be explained.
  • the shape and structure of the HMD are not limited to those described in FIGS. 2 to 5, and may include a component for detecting the wearing state of the HMD, for example, a touch circuit disposed on the inner surface of the wearing portion of the HMD.
  • the shape and structure of the remaining components may be modified.
  • FIG. 2 is a diagram for explaining the configuration of an AR device among HMDs according to an embodiment of the present disclosure
  • FIG. 3 is a diagram for explaining a touch circuit disposed in an AR device among HMDs according to an embodiment of the present disclosure. .
  • the HMD 200 may include a main frame 210, displays 211 and 212, and wearable units 221 and 222. there is.
  • the main frame 210 may be worn on at least part of the user's head (eg, face) and may be supported on the user's face by various components.
  • the main frame 210 may include a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction.
  • the main frame 210 may be made of a material light enough to allow the user to feel comfortable wearing it.
  • the main frame 210 may be made of plastic material.
  • the main frame 210 is made of at least one of various materials, such as glass, ceramic, metal (e.g., aluminum), or metal alloy (e.g., steel, stainless steel, titanium, or magnesium alloy) for strength or aesthetics. More may be included.
  • 2 and 3 show the HMD 200 in the form of glasses, and the main frame 210 represents a structure including a rim, bar, and bridge of the glasses, These HMDs 200 may be referred to as AR glasses.
  • the displays 211 and 212 may be exposed through the second side of the main frame 210.
  • the first display 211 of the displays 211 and 212 is disposed on the right edge of the main frame 210 to face the user's right eye
  • the first display 211 of the displays 211 and 212 is disposed on the right edge of the main frame 210 to face the user's right eye.
  • the display 212 may be placed on the left edge of the main frame 210 to face the user's left eye.
  • either the first display 211 or the second display 212 may be omitted.
  • the displays 211 and 212 may be, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS) device, or a liquid crystal display (LCoS). It may include a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), or a micro LED (micro light emitting diode, micro LED).
  • LED light emitting diode
  • OLED organic light emitting diode
  • micro LED micro light emitting diode, micro LED
  • the HMD 200 transmits light to the screen output area of the displays 211 and 212. It may include a light source for irradiation.
  • the HMD 200 may emit light even if it does not include a separate light source. It is possible to provide good quality images to users.
  • the displays 211 and 212 are implemented with organic light emitting diodes or micro LEDs, a light source is not required, so the HMD 200 can be lightweight.
  • Transparent members 213 and 214 may be disposed on the first surface of the main frame 210.
  • the transparent members 213 and 214 may be formed of a glass plate, a plastic plate, or a polymer, and may be made transparent or translucent.
  • the first transparent member 213 among the transparent members 213 and 214 is disposed on the right edge of the main frame 210, and the second transparent member among the transparent members 213 and 214 ( 214) may be placed on the left edge of the main frame 210.
  • the transparent members 213 and 214 may be disposed at a position facing the user's eyes to form a screen display unit.
  • either the first transparent member 213 or the second transparent member 214 may be omitted.
  • the displays 211 and 212 may include an optical waveguide 215.
  • the optical waveguide 215 may serve to transmit the light source generated by the displays 211 and 212 to the user's eyes.
  • the optical waveguide 215 may be made of glass, plastic, or polymer, and may include a nanopattern formed on some of the interior or exterior surfaces, for example, a polygonal or curved grating structure. According to one embodiment, light incident on one end of the waveguide may be propagated inside the optical waveguide 215 by a nano-pattern and provided to the user. Additionally, the optical waveguide 215, which is composed of a free-form prism, can provide incident light to the user through a reflection mirror.
  • the optical waveguide 215 may include at least one of at least one diffractive element (eg, a diffractive optical element (DOE) or a holographic optical element (HOE)) or a reflective element (eg, a reflective mirror).
  • the optical waveguide 215 may guide the display light emitted from the light source unit to the user's eyes using at least one diffractive element or reflective element included in the optical waveguide 215.
  • the diffractive element may include an input optical member 216 and an output optical member (not shown).
  • the input optical member 216 may refer to an input grating area
  • the output optical member may refer to an output grating area.
  • the input grating area serves as an input terminal that diffracts (or reflects) the light output from the displays 211 and 212 (e.g., Micro LED) to transmit the light to the transparent members 213 and 214 of the screen display unit. You can.
  • the output grating area may serve as an outlet that diffracts (or reflects) light transmitted to the transparent members 213 and 214 of the optical waveguide 215 to the user's eyes.
  • the reflective element may include a total reflection optical element or a total reflection waveguide for total internal reflection (TIR).
  • TIR total internal reflection
  • total reflection is a method of guiding light, and an angle of incidence is created such that light (e.g., an image) input through the input grating area is 100% reflected from one side (e.g., a specific side) of the optical waveguide 215. , which may mean ensuring that 100% of the output is transmitted to the output grating area.
  • the light emitted from the displays 211 and 212 may be guided to an optical path through the input optical member 216 to the optical waveguide 215. Additionally, light moving inside the optical waveguide 215 may be guided toward the user's eyes through the output optical member.
  • the screen display may be determined based on the light emitted in the eye direction.
  • the wearing parts 221 and 222 may be connected to a portion of the main frame 210 so that the user can wear the HMD 200.
  • the first wearing part 221 of the wearing parts 221 and 222 is connected to an end of the right edge of the main frame 210 and extends in one direction (e.g., the second direction).
  • the second wearing part 222 of the wearing parts 221 and 222 may be connected to an end of the left edge of the main frame 210 and extend in one direction (eg, the second direction).
  • the wearing parts 221 and 222 may be connected to the main frame 210 through hinges 223 and 224. 2 and 3 show the HMD 200 in the form of glasses, and the wearing parts 221 and 222 may represent temples of the glasses.
  • Each of the wearing parts 221 and 222 includes an inner surface 221b and 222b that contact a part of the head (e.g., temple) when the HMD 200 is worn on the user's head. It may include outer surfaces 221a and 222a facing 222b).
  • touch circuits 291 and 292 may be disposed on the inner surfaces 221b and 222b of at least one of the wearable parts 221 and 222.
  • the touch circuits 291 and 292 may include touch cells.
  • the touch circuits 291 and 292 may have a plurality of touch cells arranged adjacent to each other.
  • the touch circuits 291 and 292 may include a touch processor that processes touch input.
  • the touch processor may include a microprocessor.
  • the touch circuits 291 and 292 may be used to detect the wearing state of the HMD 200. For example, when the HMD 200 is worn on the user's head, the touch circuits 291 and 292 disposed on the inner surfaces 221b and 222b of the wearing parts 221 and 222 are attached to a portion of the head. It can be contacted, and touch information corresponding to the touch input according to the contact can be obtained.
  • the touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells).
  • the touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches.
  • the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.
  • the touch circuits 291 and 292 may detect the wearing state of the HMD 200 using the acquired touch information. For example, if the pattern of the touch input detected through the touch circuits 291 and 292 has a designated pattern (e.g., a first pattern), the touch circuits 291 and 292 allow the HMD 200 to be placed on the user's head. It can be judged that it has been worn.
  • the designated pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or a combination thereof. It can indicate a state of being.
  • the state in which the touch position is the first position is the wearing part (221, 222) among the plurality of touch cells disposed on the inner surfaces (221b, 222b) of the wearing part (221, 222).
  • At least one touch cell disposed in the end direction may indicate a state in which it is in contact with the user's ear or a portion of the temple adjacent to the ear.
  • the state in which the touch area is greater than or equal to the first size is when at least one touch cell is in contact among a plurality of touch cells disposed on the inner surfaces 221b and 222b of the wearing units 221 and 222. It may indicate a state where the total area is greater than or equal to the first size.
  • the state in which the touch shape has the first shape is when at least one touch cell is contacted among a plurality of touch cells disposed on the inner surfaces 221b and 222b of the wearing units 221 and 222.
  • the arrangement form may indicate a state corresponding to the first form.
  • the first shape may be, for example, a square or oval with one long side.
  • the state in which the number of touches is greater than the first number is when at least one touch cell touched among a plurality of touch cells disposed on the inner surfaces 221b and 222b of the wearing units 221 and 222. It may indicate a state where the number is greater than or equal to the first number.
  • the touch circuits 291 and 292 may determine that the HMD 200 has been removed from the user's head.
  • the touch circuits 291 and 292 transmit the acquired touch information to a processor, and the processor can use the touch information to determine the wearing state of the HMD 200.
  • the HMD 200 may further include a lens (not shown).
  • the lens may serve to adjust the focus so that the screen output to the displays 211 and 212 can be viewed by the user's eyes.
  • the lens may be comprised of, for example, a Fresnel lens, a Pancake lens, or a multi-channel lens.
  • the HMD 200 may include at least one camera.
  • the at least one camera may include at least one of a first camera unit 231 and 232, a second camera unit 233 and 234, or a third camera unit 235.
  • the first camera units 231 and 232 may be used for 3Dof (degrees of freedom) or 6Dof head tracking, hand detection and tracking, and space recognition.
  • the first camera units 231 and 232 may perform at least one of a spatial recognition function for 6Dof, a simultaneous localization and mapping (SLAM) function through depth shooting, or a user gesture recognition function.
  • the first camera units 231 and 232 may be disposed on the first side of the main frame 210.
  • one camera 231 of the first camera units 231 and 232 is disposed on the right rim of the main frame 210, and the other camera 231 of the first camera units 231 and 232
  • the camera 232 may be placed on the left edge of the main frame 210.
  • the first camera units 231 and 232 may include global shutter cameras.
  • the second camera units 233 and 234 may be used to detect and track the user's pupils.
  • the second camera units 233 and 234 may be used to ensure that the center of the image projected on the AR glasses is located according to the direction in which the wearer's eyes are looking.
  • the second camera units 233 and 234 may be disposed on the second side of the main frame 210.
  • one camera 233 of the second camera units 233 and 234 is disposed on the right rim of the main frame 210, and the other camera 233 of the second camera units 233 and 234
  • the camera 234 may be placed on the left edge of the main frame 210.
  • the second camera units 233 and 234 may include global shutter cameras.
  • the third camera unit 235 may be used to photograph an external subject.
  • the third camera unit 235 may be disposed on the first side of the commercial main frame 210.
  • the third camera unit 235 may be placed on the bridge of the main frame 210.
  • the third camera unit 235 is called a high resolution (HR) or photo video (PV) camera and may include a high resolution camera.
  • the third camera unit 235 has at least one function for obtaining high-definition images, such as an auto focus (AF) function and/or an optical image stabilization (OIS) function. This may include a color camera.
  • the third camera unit 235 may include a global shutter camera or a rolling shutter camera.
  • the at least one camera may further include a fourth camera unit (not shown).
  • the fourth camera unit may be used to detect and track the user's facial expression.
  • the fourth camera may be disposed on the second side of the main frame 210.
  • the HMD 200 may include light emitting units 241 and 242 (eg, LED).
  • the light emitting units 241 and 242 may have different purposes depending on their placement location.
  • the light emitting units 241 and 242 detect movement of the user's eyes with the second camera units 233 and 234.
  • it can be used as an auxiliary means to facilitate line-of-sight detection, and in this case, IR LEDs with infrared wavelengths can be mainly used.
  • the light emitting units 241 and 242 are connected to cameras (e.g., the first camera unit 231) disposed around the hinges 223 and 224 connecting the main frame 210 and the wearing units 221 and 222. , 232)) or when disposed adjacent to a camera disposed around the bridge of the main frame 210 (e.g., the third camera unit 235), the light emitting units 241 and 242 are used to capture images of the camera. It can be used as a means of supplementing ambient brightness.
  • the light emitting units 241 and 242 may emit light when it is difficult to detect a subject in a dark environment.
  • the HMD 200 may include microphones 251, 252, and 253 and speakers 254 and 255.
  • the microphones 251, 252, and 253 can convert sound into electrical signals and transmit the converted electrical signals to the processor.
  • the speakers 254 and 255 can output voice signals.
  • the speakers 254 and 255 may convert electrical signals generated inside the HMD 200 into sound and output it to the outside.
  • the microphones 251, 252, and 253 may be placed on the main frame 210 to be placed close to the user's mouth, and the speakers 254, 255 may be placed close to the user's ears. In order to be placed in a close position, it may be placed on the wearing parts 221 and 222.
  • the HMD 200 may include printed circuit boards 261 and 262.
  • the printed circuit boards 261 and 262 may be placed inside the wearing portions 221 and 222, and various electronic components may be mounted thereon.
  • Electronic components mounted on the printed circuit boards 261 and 262 may include, for example, at least one of a processor, memory, or communication circuit.
  • the printed circuit boards 261 and 262 may include flexible printed circuit boards.
  • the printed circuit boards 261 and 262 are connected to at least one component of the HMD 200 (e.g., displays 211 and 212 or cameras 231, 232, 233, 234, and 235) through a flexible printed circuit board. ) can transmit electrical signals.
  • the printed circuit boards 261 and 262 may include a first substrate, a second substrate, and an interposer disposed between the first substrate and the second substrate.
  • the processor can control at least one component of the HMD 200 and perform various data processing or calculations. According to one embodiment, the processor may perform a function related to detecting a wearing state of the HMD 200 by executing instructions stored in the memory included in the HMD 200.
  • the memory may store various data used by at least one component of the HMD 200.
  • the memory may store commands and data related to detection of the wearing state of the HMD 200.
  • the instruction may be executed by the processor.
  • the communication circuit may support communication between the HMD 200 and an external electronic device.
  • the communication circuit may establish wired or wireless communication with the external electronic device according to a specified communication protocol, and may transmit and receive signals or data.
  • the HMD 200 may include batteries 271 and 272.
  • the batteries 271 and 272 may supply power to at least one component of the HMD 200.
  • the batteries 271 and 272 may be disposed inside the ends of the wearing parts 221 and 222.
  • the configuration of the HMD 200 is not limited to this. According to various embodiments, the HMD 200 may omit at least one of the above-described components and may further include at least one other component. As an example, the HMD 200 may further include at least one of an antenna or a sensor.
  • FIG. 4 is a front perspective view of a VR device among HMDs according to an embodiment of the present disclosure
  • FIG. 5 is a rear perspective view of a VR device among HMDs according to an embodiment of the present disclosure.
  • the HMD 400 may include a main frame 410, a display (not shown), and wearable units 421 and 422. .
  • the main frame 410 may be worn on at least part of the user's head (eg, face) and may be supported on the user's face by various components.
  • the main frame 410 may include a first surface 410a facing in a first direction and a second surface 410b facing in a second direction opposite to the first direction.
  • the main frame 410 may be made of a material light enough to allow the user to feel comfortable wearing it.
  • the main frame 410 may be made of plastic material.
  • the main frame 410 is made of at least one of various materials, such as glass, ceramic, metal (e.g., aluminum), or metal alloy (e.g., steel, stainless steel, titanium, or magnesium alloy) for strength or aesthetics. More may be included.
  • the HMD 400 may further include a cover coupled to more firmly support the external electronic device to the main frame 410 while the external electronic device is fastened to the main frame 410. You can.
  • the cover may be physically coupled to the main frame 410 in the form of a hook, or may be coupled to the main frame 410 in a manner such as a magnet or electromagnet.
  • the cover can prevent the external electronic device from being separated from the main frame 410, and can also enhance the aesthetics by forming the appearance of the main frame 410.
  • the display is placed inside the main frame 410 and can be viewed through a lens 411. In one embodiment, the display may be exposed through the second side 410b of the main frame 410.
  • the display may include, for example, a liquid crystal display device, a digital mirror display device, a silicon liquid crystal display device, an organic light emitting diode, or a micro LED.
  • the HMD 400 may include a light source that radiates light to the screen output area of the display.
  • the HMD 400 when the display is capable of generating light on its own, for example, when it is made of one of organic light emitting diodes or micro LEDs, the HMD 400 provides good quality to the user even if it does not include a separate light source. Video can be provided. In one embodiment, if the display is implemented with organic light emitting diodes or micro LEDs, a light source is not required, so the HMD 400 can be lightweight.
  • the wearing parts 421 and 422 may be connected to a portion of the main frame 410 so that the user can wear the HMD 400.
  • the first wearing part 421 of the wearing parts 421 and 422 is connected to the right end of the main frame 410 and extends in one direction (e.g., the second direction),
  • the second wearing part 422 may be connected to the left end of the main frame 410 and extend in one direction (eg, the second direction).
  • the wearing parts 421 and 422 may be connected to the main frame 410 through a hinge. 4 and 5 show the wearing parts 421 and 422 in the form of glasses legs, but the present invention is not limited thereto.
  • the wearing parts 421 and 422 may be provided in the form of a band and may be fastened to the user's head in a manner that surrounds a portion of the user's head.
  • the wearing parts 421 and 422 may be provided in the form of a single band and may be fixed to the user's head so as to cross the temporal region, including the temples.
  • the wearing parts (421, 422) may be made of a material with elasticity of a specified size or more, and include a length adjustment part that can adjust the length of the wearing parts (421, 422) to fit the circumference of the user's head. can do.
  • the length of the wearing parts 421 and 422 can be adjusted through the length adjusting part, so that the main frame 410 can fit tightly around the eyes of the user's face.
  • the length adjusting part may include gears, Velcro, or magnets.
  • the wearing parts 421 and 422 are provided in the shape of temples of glasses will be described.
  • Each of the wearing parts 421 and 422 includes an inner surface 421b and 422b that contact a part of the head (e.g., temple) when the HMD 400 is worn on the user's head. It may include outer surfaces 421a and 422a facing 422b).
  • touch circuits 491 and 492 may be disposed on the inner surfaces 421b and 422b of at least one of the wearable parts 421 and 422.
  • the touch circuits 491 and 492 may include touch cells.
  • the touch circuits 491 and 492 may have a plurality of touch cells arranged adjacent to each other.
  • the touch circuits 491 and 492 may include a touch processor that processes touch input.
  • the touch processor may include a microprocessor.
  • the touch circuits 491 and 492 may be used to detect the wearing state of the HMD 400. For example, when the HMD 400 is worn on the user's head, the touch circuits 491 and 492 disposed on the inner surfaces 421b and 422b of the wearing parts 421 and 422 are attached to a portion of the head. It can be contacted, and touch information corresponding to the touch input according to the contact can be obtained.
  • the touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells).
  • the touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches.
  • the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.
  • the touch circuits 491 and 492 may detect the wearing state of the HMD 400 using the acquired touch information. For example, if the pattern of the touch input detected through the touch circuits 491 and 492 has a designated pattern (e.g., the first pattern), the touch circuits 491 and 492 allow the HMD 400 to be placed on the user's head. It can be judged that it has been worn.
  • the designated pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or a combination thereof. It can indicate a state of being.
  • the state in which the touch position is the first position is the wearing part (421, 422) among the plurality of touch cells disposed on the inner surfaces (421b, 422b) of the wearing part (421, 422).
  • At least one touch cell disposed in the end direction may indicate a state in which it is in contact with the user's ear or a temple portion adjacent to the ear.
  • the state in which the touch area is greater than or equal to the first size is when at least one touch cell contacted among a plurality of touch cells disposed on the inner surfaces 421b and 422b of the wearing units 421 and 422 It may indicate a state where the total area is greater than or equal to the first size.
  • the state in which the touch shape has the first shape is when at least one touch cell is contacted among a plurality of touch cells disposed on the inner surfaces 421b and 422b of the wearing parts 421 and 422.
  • the arrangement form may indicate a state corresponding to the first form.
  • the first shape may be, for example, a square or oval with one long side.
  • the state in which the number of touches is greater than or equal to the first number is when at least one touch cell touched among a plurality of touch cells disposed on the inner surfaces 421b and 422b of the wearing units 421 and 422. It may indicate a state where the number is greater than or equal to the first number.
  • the touch circuits 491 and 492 may determine that the HMD 400 has been removed from the user's head.
  • the touch circuits 491 and 492 transmit the acquired touch information to a processor, and the processor can use the touch information to determine the wearing state of the HMD 400.
  • the HMD 400 may include a lens 411.
  • the lens 411 may serve to adjust the focus so that the screen displayed on the display can be viewed by the user's eyes.
  • a lens assembly including at least one lens may be inserted inside the main frame 410 at a position facing the user's two eyes.
  • at least one surface of the lens 411 is provided through the second surface 410b of the main frame 410 so that the user can view the screen of the display with the user's eyes. This may be exposed.
  • the lens 411 may be composed of, for example, a Fresnel lens, a Pencake lens, or a multi-channel lens.
  • the HMD 400 may include at least one camera.
  • the at least one camera may include at least one of a first camera unit 431, a third camera unit 432, or a fourth camera unit 433.
  • the first camera unit 431 can be used for 3Dof or 6Dof head tracking, hand detection and tracking, and spatial recognition.
  • the first camera unit 431 may perform at least one of a spatial recognition function for 6Dof, a SLAM function through depth shooting, or a user gesture recognition function.
  • the first camera unit 431 may be disposed on the first surface 410a of the main frame 410.
  • the first camera unit 431 may include a global shutter camera.
  • the third camera unit 432 may be used to photograph an external subject.
  • the third camera unit 432 may be disposed on the first side 410a of the commercial main frame 410.
  • the third camera unit 432 is called HR or PV and may include a high-resolution camera.
  • the third camera unit 432 may include a color camera equipped with at least one function for acquiring high-definition images, such as an autofocus function and/or a shake correction function.
  • the third camera unit 432 may include a global shutter camera or a rolling shutter camera.
  • the fourth camera unit 433 may be used to detect and track the user's facial expression.
  • the fourth camera 433 may be disposed on the second side 410b of the main frame 410.
  • the HMD 400 may include a depth sensor 440.
  • the depth sensor 440 can be used to measure the distance to an object.
  • the depth sensor 440 may include a light emitting unit and a light receiving unit, and may be used to determine the distance to an object through a method of measuring time of flight (TOF).
  • TOF time of flight
  • the HMD 400 may further include a light emitting unit, microphone, speaker, printed circuit board, and battery.
  • the light emitting unit may be disposed adjacent to the at least one camera.
  • the microphone may be placed on the main frame 410 to be placed close to the user's mouth, and the speaker may be placed on the wearing unit 421 to be placed close to the user's ears. , 422).
  • the printed circuit board may be placed inside the main frame 410, and various electronic components may be mounted. Electronic components mounted on the printed circuit board may include, for example, at least one of a processor, memory, or communication circuit.
  • the battery may be placed inside the main frame 410.
  • the processor can control at least one component of the HMD 400 and perform various data processing or calculations. According to one embodiment, the processor may perform a function related to detecting a wearing state of the HMD 400 by executing instructions stored in the memory included in the HMD 400.
  • the memory may store various data used by at least one component of the HMD 400.
  • the memory may store commands and data related to detection of the wearing state of the HMD 400.
  • the instruction may be executed by the processor.
  • the communication circuit may support communication between the HMD 400 and an external electronic device.
  • the communication circuit may establish wired or wireless communication with the external electronic device according to a specified communication protocol, and may transmit and receive signals or data.
  • the configuration of the HMD 400 is not limited to this. According to various embodiments, the HMD 400 may omit at least one of the above-described components and may further include at least one other component. As an example, the HMD 400 may further include at least one of an antenna or a sensor.
  • FIG. 6 is a diagram illustrating a touch circuit disposed on a wearable portion of an HMD according to an embodiment of the present disclosure.
  • an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) includes a wearing unit 600 (e.g., HMD 400 in Figures 4 and 5) so that a user can wear the HMD. It may include the wearing parts 221 and 222 of FIGS. 2 and 3 or the wearing parts 421 and 422 of FIGS. 4 and 5.
  • the wearable unit 600 may be connected to a portion of the main frame of the HMD (eg, the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5).
  • the wearing portion 600 includes an outer surface 601 (e.g., the outer surface of an eyeglass temple), an inner surface 603 opposing the outer surface 601 (e.g., an inner surface of a temple), and the outer surface. It may include an upper surface 602 (eg, the upper surface of a temple) extending from 601 to the inner surface 603.
  • the inner surface 603, which is the surface in contact with a part of the head (e.g., temple) is the inner surface 221b and 222b of FIGS. 2 and 3 or the inner surface 221b and 222b of FIGS. 4 and 3.
  • the outer surface 601 opposite to the inner surface 603 is the outer surface 221a and 222a of FIGS. 2 and 3 or the outer surfaces 221a and 222a of FIGS. 4 and 5. It may correspond to the outer surfaces 421a and 422a.
  • a first touch circuit 613 (e.g., the touch circuits 291 and 292 in FIG. 3 or the touch circuits 491 and 492 in FIGS. 4 and 5) is disposed on the inner surface 603 of the wearing unit 600. It can be.
  • the first touch circuit 613 can be used to detect the wearing state of the HMD. For example, when the HMD is worn on the user's head, the first touch circuit 613 disposed on the inner surface 603 of the wearing unit 600 may contact a portion of the head, and the contact Touch information according to can be acquired, and the wearing state of the HMD can be detected using the obtained touch information.
  • the first touch circuit 613 may include a touch cell.
  • the first touch circuit 613 may have a plurality of touch cells arranged adjacent to each other.
  • a second touch circuit 611 may be disposed on the outer surface 601 of the wearing unit 600.
  • the second touch circuit 611 may receive a user's input.
  • the second touch circuit 611 may receive a user input for controlling the HMD.
  • the user input may correspond to signals related to settings (e.g., sound settings or communication settings) and controls (e.g., sound control or video playback control) related to functions supported by the HMD.
  • the second touch circuit 611 may include a touch cell.
  • the second touch circuit 611 may have a plurality of touch cells arranged adjacent to each other.
  • the first touch circuit 613 and the second touch circuit 611 may be formed integrally.
  • one touch circuit 611, 612, and 613 may be disposed from the outer surface 601 to the inner surface 603 of the wearable unit 600.
  • the touch circuits 611, 612, and 613 are connected to the first part 631 disposed on the outer surface 601 of the wearing part 600, from a part of the first part 631 to the wearing part ( A second part 632 extending in the direction of the inner surface 603 of the 600, and a third part 633 connected to the second part 632 and disposed on the inner surface 603 of the wearing part 600. ) may include.
  • the third portion 633 of the touch circuits 611, 612, and 613 may be disposed over a smaller area than the first portion 631 of the touch circuits 611, 612, and 613.
  • the third portion 633 of the touch circuits 611, 612, and 613 is limited to the surface that contacts a part of the head (e.g., temple) when the HMD is worn on the user's head. can be placed.
  • a head mounted display device (e.g., HMD 200 of FIGS. 2 and 3 or HMD 400 of FIGS. 4 and 5) has a first surface facing in a first direction. and a frame including a second surface facing in a second direction opposite to the first direction (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5), A display exposed to the outside through the second side (e.g., the displays 211 and 212 in FIGS. 2 and 3 or the displays in FIGS. 4 and 5), respectively connected to both ends of the frame and extending in one direction. Parts (e.g., the wearing parts 221 and 222 of FIGS.
  • each of the wearing units has an inner surface (e.g., in FIGS. 2 and 3) that is in contact with a portion of the head when the head mounted display device is worn on the user's head.
  • a first touch circuit (e.g., the touch circuits 291 and 292 of FIG. 3, the touch circuits 491 and 492 of FIGS. 4 and 5, or the first touch circuit of FIG. 6 (or a third portion of the touch circuit formed integrally) )(613)) may be included.
  • the head mounted display device is provided in the form of glasses, and the wearing parts may form legs of the glasses.
  • the wearing parts may be integrally provided in the form of a band and tightened to surround a portion of the head.
  • the first touch circuit may have a plurality of touch cells arranged adjacent to each other.
  • the first touch circuit may be arranged to extend from the inner surface to the outer surface.
  • At least one of the wearing parts includes a second touch circuit (e.g., the second touch circuit of FIG. 6 (or the first part of the touch circuit formed integrally) 611 disposed on the outer surface. ) or the touch circuit 1221 of FIG. 12).
  • a second touch circuit e.g., the second touch circuit of FIG. 6 (or the first part of the touch circuit formed integrally) 611 disposed on the outer surface.
  • the touch circuit 1221 of FIG. 12 includes a second touch circuit (e.g., the second touch circuit of FIG. 6 (or the first part of the touch circuit formed integrally) 611 disposed on the outer surface. ) or the touch circuit 1221 of FIG. 12).
  • the wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, and the first touch circuit is connected to the first wearing part of the first wearing part. It may be disposed on the inner surface, and the second touch circuit may be disposed on the outer surface of the second wearing part.
  • At least one of the wearing parts may include a conductor (eg, the conductor 1321 in FIG. 13) disposed on the outer surface.
  • a conductor eg, the conductor 1321 in FIG. 13
  • the wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, and the first touch circuit is connected to the first wearing part of the first wearing part. It may be disposed on the inner surface, and the conductor may be disposed on the outer surface of the second wearing part.
  • FIG. 7 is a diagram for explaining a method of operating an HMD when worn, according to an embodiment of the present disclosure.
  • the HMD may determine whether the first touch input has been detected.
  • the HMD has a wearable part (e.g., FIG. 2 and It may include the wearing parts 221 and 222 of FIG. 3, the wearing parts 421 and 422 of FIGS. 4 and 5, or the wearing part 600 of FIG. 6. Additionally, the HMD can detect the user's finger touching the wearing unit. Here, when the user's finger touches the wearing part, the HMD can detect the first touch input.
  • a situation in which the user's finger touches the wearing part may include, for example, a situation in which the user pinches the wearing part with a finger to wear the HMD.
  • the HMD uses a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally)) disposed on the outer surface of the wearable unit.
  • the first touch input can be detected.
  • the touch circuit may include a touch processor that processes the first touch input.
  • the touch processor may include a microprocessor.
  • the HMD may re-perform operation 710. For example, the HMD may monitor detection of the first touch input continuously or at regular intervals until the first touch input is detected.
  • the HMD may perform preprocessing in operation 720.
  • the HMD may increase the activation level of the processor.
  • the HMD can control the processor to operate from a low-power mode to a normal mode.
  • the HMD can increase the driving frequency of the processor.
  • the processor may include, for example, an application processor.
  • the HMD may pre-load execution data of a designated application into memory to prevent additional delays such as memory load.
  • the HMD may determine whether a second touch input has been detected.
  • the HMD includes a touch circuit disposed on the inner surface of the wearable unit (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit 613 in FIG. 6). (or the third part 633 of the touch circuit formed integrally)) can be used to detect the second touch input.
  • the touch circuit disposed on the inner surface of the wearing unit may be in contact with a portion of the head and may detect the second touch input according to the contact.
  • the HMD may acquire touch information corresponding to the second touch input and detect the wearing state of the HMD using the acquired touch information.
  • the HMD may re-perform operation 710.
  • the HMD may activate the display and display information through the activated display in operation 740. For example, when the second touch input is detected, the HMD may determine that the HMD is worn on the user's head, and in order to perform an operation according to wearing the HMD, turn on the screen of the display and display the Information according to operation can be displayed.
  • the HMD may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.
  • FIG. 8 is a diagram for explaining another method of operating an HMD when worn, according to an embodiment of the present disclosure.
  • the HMD may determine whether a first touch input has been detected.
  • the HMD has a wearable part (e.g., FIG. 2 and It may include the wearing parts 221 and 222 of FIG. 3, the wearing parts 421 and 422 of FIGS. 4 and 5, or the wearing part 600 of FIG. 6. Additionally, the HMD can detect the user's finger touching the wearing unit. Here, when the user's finger touches the wearing part, the HMD can detect the first touch input.
  • a situation in which the user's finger touches the wearing part may include, for example, a situation in which the user pinches the wearing part with a finger to wear the HMD.
  • the HMD uses a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally)) disposed on the outer surface of the wearable unit.
  • the first touch input can be detected.
  • the touch circuit may include a touch processor that processes the first touch input.
  • the touch processor may include a microprocessor.
  • the HMD may re-perform operation 810. For example, the HMD may monitor detection of the first touch input continuously or at regular intervals until the first touch input is detected.
  • the HMD may perform preprocessing and activate the display in operation 820.
  • the HMD may increase the activation level of the processor.
  • the HMD can control the processor to operate from a low-power mode to a normal mode.
  • the HMD can increase the driving frequency of the processor.
  • the processor may include, for example, an application processor.
  • the HMD may preload execution data of a designated application into memory to prevent additional delays such as memory loading. Additionally, the HMD can turn on the screen of the display.
  • the HMD may determine whether a second touch input has been detected.
  • the HMD includes a touch circuit disposed on the inner surface of the wearable unit (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit 613 in FIG. 6). (or the third part 633 of the touch circuit formed integrally)) can be used to detect the second touch input.
  • the touch circuit disposed on the inner surface of the wearing unit may be in contact with a portion of the head and may detect the second touch input according to the contact.
  • the HMD may acquire touch information corresponding to the second touch input and detect the wearing state of the HMD using the acquired touch information.
  • the HMD may re-perform operation 810.
  • the HMD may display information through the activated display in operation 840. For example, when the second touch input is detected, the HMD may determine that the HMD is worn on the user's head, and in order to perform an operation according to wearing the HMD, information according to the operation may be displayed on the screen of the display. It can be displayed.
  • the HMD may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.
  • the HMD may deactivate the display if the second touch input is not detected within a specified time (eg, 10 seconds) after the first touch input is detected.
  • a specified time eg, 10 seconds
  • the HMD can turn off the screen of the display.
  • FIG. 9 is a diagram for explaining a method of operating an HMD when removing the HMD according to an embodiment of the present disclosure.
  • an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 3) so that the user can wear it.
  • a wearing part e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts of FIGS. 4 and 5) connected to a portion of the main frame 210 or the main frame 410 of FIGS. 4 and 5. It may include (421, 422) or the wearing part 600 of FIG. 6.
  • the HMD includes a touch circuit (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS.
  • the wearing state of the HMD can be detected using 613) (or the third part 633 of the integrated touch circuit).
  • the touch circuit disposed on the inner surface of the wearing unit may contact a portion of the head and detect a touch input according to the contact.
  • the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.
  • the touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells).
  • the touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches.
  • the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.
  • the HMD may determine that the HMD is worn on the user's head.
  • the first pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or more, or It can represent a combination state.
  • the touch position is the first position, at least one touch cell arranged in the end direction of the wearable part among the plurality of touch cells arranged on the inner surface of the wearable part is connected to the user's ear or the ear. It may indicate contact with the adjacent temple area.
  • the state in which the touch area is greater than or equal to the first size indicates a state in which the total area of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of the wearing unit is greater than or equal to the first size. You can.
  • the state in which the touch shape has the first shape is when the arrangement shape of at least one touched touch cell among the plurality of touch cells disposed on the inner surface of the wearing unit corresponds to the first shape. It can indicate status.
  • the first shape may be, for example, a square or oval with one long side.
  • the state in which the number of touches is greater than or equal to the first number may indicate a state in which the number of at least one touched touch cell among a plurality of touch cells disposed on the inner surface of the wearing unit is greater than or equal to the first number.
  • the HMD When the HMD is worn on the user's head (i.e., the pattern of the touch input has the first pattern), the HMD changes the pattern of the touch input from the first pattern to the second pattern in operation 910. You can determine whether it has been done.
  • the second pattern may be, for example, the touch position is a second position different from the first position, the touch area is less than the first size, or the touch shape has a second shape different from the first shape. Alternatively, it may indicate a state in which the number of touches is less than the first number, or a combination thereof.
  • the HMD may re-perform operation 910. For example, the HMD may monitor changes in the pattern of the touch input continuously or at regular intervals until the pattern of the touch input changes.
  • the HMD may maintain activation of the system of the HMD and deactivate the display in operation 920.
  • the HMD can maintain the processor's activation level and data loaded into memory. Additionally, the HMD can turn off the screen of the display.
  • the HMD may determine whether the touch input has ended. For example, the HMD can check whether the touch input is not detected through the touch circuit disposed on the inner surface of the wearable unit.
  • the HMD may enter the HMD's system into a rest period in operation 940. For example, if the touch input is not detected through the touch circuit disposed on the inner surface of the wearable unit, the HMD may determine that the HMD has been removed from the user's head. Accordingly, the HMD can control the processor to operate from a normal mode to a low-power mode, thereby lowering the activation level of the processor.
  • the HMD may determine whether the pattern of the touch input has changed from the second pattern to the first pattern in operation 950. For example, the HMD may determine whether a touch input detected through the touch circuit disposed on the inner surface of the wearable unit has the first pattern again.
  • the HMD may re-perform operation 920. For example, the HMD may keep the HMD's system activated and the display deactivated.
  • the HMD may activate the display in operation 960. For example, if the touch input detected through the touch circuit disposed on the inner surface of the wearing unit again has the first pattern, the HMD may determine that the HMD has been reworn on the user's head. Accordingly, the HMD can turn on the screen of the display again.
  • FIG. 10 is a diagram for explaining a method of operating an HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.
  • an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 3) so that the user can wear it.
  • a wearing part e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts of FIGS. 4 and 5) connected to a portion of the main frame 210 or the main frame 410 of FIGS. 4 and 5. It may include (421, 422) or the wearing part 600 of FIG. 6.
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS.
  • the wearing state of the HMD can be detected using 613) (or the third part 633 of the integrated touch circuit).
  • at least one of the wearable parts may have a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit 631)) or a conductor disposed on the outer surface. .
  • the HMD may determine whether separation of the wearing parts has been detected. For example, a situation in which the wearing parts are separated may indicate a situation in which the wearing parts are spaced apart from each other, and when the wearing parts are provided in the form of legs of glasses, it may represent a situation in which the legs of the glasses are spread out.
  • the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. If the pattern of the first touch input and the second touch input is changed or terminated while the second touch input is detected, it may be determined that the wearable parts are separated.
  • the HMD has a first pattern of touch input detected through a touch circuit disposed on the inner surface of one of the wearable parts, and the pattern of the touch input is the first pattern.
  • the pattern is changed to the second pattern or the touch input is terminated, it may be determined that the wearing parts are separated.
  • a situation in which the pattern of the touch input has the first pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where a person is close to or in contact with a body.
  • a situation in which the pattern of the touch input has the second pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts is disposed on the outer surface of the other one of the wearable parts. It can represent a situation where the conductor is separated by a certain distance or more.
  • the HMD may re-perform operation 1010. For example, the HMD may monitor the separation of the wearing parts continuously or at regular intervals until the separation of the wearing parts is detected.
  • the HMD may perform preprocessing in operation 1020.
  • the HMD may increase the activation level of the processor.
  • the HMD can control the processor to operate from a low-power mode to a normal mode.
  • the HMD can increase the driving frequency of the processor.
  • the processor may include, for example, an application processor.
  • the HMD may pre-load execution data of a designated application into memory to prevent additional delays such as memory loading.
  • the HMD may determine whether a touch input has been detected.
  • the HMD can detect the touch input using a touch circuit disposed on the inner surface of at least one of the wearable parts. For example, when an HMD is worn on a user's head, a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect the touch input according to the contact. there is. Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.
  • the HMD may re-perform operation 1010.
  • the HMD may activate the display in operation 1040 and display information through the activated display. For example, when the touch input is detected, the HMD may determine that the HMD is worn on the user's head, turn on the screen of the display to perform an operation according to wearing the HMD, and display the operation on the screen. Information can be displayed.
  • the HMD may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.
  • FIG. 11 is a diagram for explaining another method of operating the HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.
  • an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 3) so that the user can wear it.
  • a wearing part e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts of FIGS. 4 and 5) connected to a portion of the main frame 210 or the main frame 410 of FIGS. 4 and 5. It may include (421, 422) or the wearing part 600 of FIG. 6.
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS.
  • the wearing state of the HMD can be detected using 613) (or the third part 633 of the integrated touch circuit).
  • at least one of the wearable parts may have a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit 631)) or a conductor disposed on the outer surface. .
  • the HMD may determine whether separation of the wearing parts has been detected. For example, a situation in which the wearing parts are separated may indicate a situation in which the wearing parts are spaced apart from each other, and when the wearing parts are provided in the form of legs of glasses, it may represent a situation in which the legs of the glasses are spread out.
  • the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. If the pattern of the first touch input and the second touch input is changed or terminated while the second touch input is detected, it may be determined that the wearable parts are separated.
  • the HMD has a first pattern of touch input detected through a touch circuit disposed on the inner surface of one of the wearable parts, and the pattern of the touch input is the first pattern.
  • the pattern is changed to the second pattern or the touch input is terminated, it may be determined that the wearing parts are separated.
  • a situation in which the pattern of the touch input has the first pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where a person is close to or in contact with a body.
  • a situation in which the pattern of the touch input has the second pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts is disposed on the outer surface of the other one of the wearable parts. It can represent a situation where the conductor is separated by a certain distance or more.
  • the HMD may re-perform operation 1110. For example, the HMD may monitor the separation of the wearing parts continuously or at regular intervals until the separation of the wearing parts is detected.
  • the HMD may perform preprocessing and activate the display in operation 1120.
  • the HMD may increase the activation level of the processor.
  • the HMD can control the processor to operate from a low-power mode to a normal mode.
  • the HMD can increase the driving frequency of the processor.
  • the processor may include, for example, an application processor.
  • the HMD may preload execution data of a designated application into memory to prevent additional delays such as memory loading. Additionally, the HMD can turn on the screen of the display.
  • the HMD may determine whether a touch input has been detected.
  • the HMD can detect the touch input using a touch circuit disposed on the inner surface of at least one of the wearable parts. For example, when an HMD is worn on a user's head, a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect the touch input according to the contact. there is. Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.
  • the HMD may re-perform operation 1110.
  • the HMD may display information through the activated display in operation 1140. For example, when the touch input is detected, the HMD may determine that the HMD is worn on the user's head, and in order to perform an operation according to wearing the HMD, information according to the operation may be displayed on the screen of the display. You can.
  • the HMD may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.
  • the HMD may deactivate the display if the touch input is not detected within a specified time (eg, 10 seconds) after the separation of the wearable parts is detected. For example, the HMD can turn off the screen of the display.
  • FIG. 12 is a diagram illustrating a method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.
  • the HMD 1200 (e.g., the HMD 200 in Figures 2 and 3 or the HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 5) so that the user can wear it.
  • Wearing parts 1210 and 1220 connected to a portion of the main frame 210 in Figure 3 or the main frame 410 in Figures 4 and 5 (e.g., wearing parts 221 and 222 in Figures 2 and 3, It may include the wearing parts 421 and 422 of FIGS. 4 and 5 or the wearing part 600 of FIG. 6 .
  • At least one of the wearing parts 1210 and 1220 has a touch circuit 1211 disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, FIG. 4 and The wearing state of the HMD 1200 can be detected using the touch circuits 491 and 492 of FIG. 5 or the first touch circuit 613 of FIG. 6 (or the third part 633 of the touch circuit formed integrally). You can.
  • at least one of the wearing parts 1210 and 1220 e.g., the second wearing part 1220
  • has a touch circuit 1221 e.g., the second touch circuit 611 of FIG. 6 (or integrally) on the outer surface.
  • the first portion 631) of the formed touch circuit may be disposed.
  • the HMD 1200 when the HMD 1200 detects separation of the wearing parts 1210 and 1220, it may determine that the wearing parts 1210 and 1220 are spaced apart from each other. For example, as shown in FIG. 12 , when the wearing parts 1210 and 1220 are provided in the form of glasses legs, the HMD 1200 may determine that the glasses legs are spread.
  • the HMD 1200 includes a touch circuit (e.g., a first touch circuit) disposed on the inner surface of one of the wearable parts 1210 and 1220 (e.g., the first wearable part 1210).
  • a first touch input is detected through the circuit 1211, and a touch circuit (e.g., a touch circuit) disposed on the outer surface of another of the wearable parts 1210 and 1220 (e.g., the second wearing part 1220).
  • the wearing parts 1210 and 1220 are separated. It can be judged that it has been done.
  • FIG. 13 is a diagram illustrating another method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.
  • the HMD 1300 (e.g., the HMD 200 in FIGS. 2 and 3 or the HMD 400 in FIGS. 4 and 5) has a main frame (e.g., HMD 200 in FIGS. 2 and 3) so that the user can wear it.
  • Wearing parts 1310 and 1320 connected to a portion of the main frame 210 in Figure 3 or the main frame 410 in Figures 4 and 5 (e.g., wearing parts 221 and 222 in Figures 2 and 3, It may include the wearing parts 421 and 422 of FIGS. 4 and 5 or the wearing part 600 of FIG. 6 .
  • At least one of the wearing parts 1310 and 1320 has a touch circuit 1311 disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, FIG. 4 and The wearing state of the HMD 1300 can be detected using the touch circuits 491 and 492 of FIG. 5 or the first touch circuit 613 of FIG. 6 (or the third part 633 of the touch circuit formed integrally). You can. Additionally, a conductor 1321 may be disposed on the outer surface of at least one of the wearing parts 1310 and 1320 (eg, the second wearing part 1320).
  • the HMD 1300 when the HMD 1300 detects separation of the wearing parts 1310 and 1320, it may determine that the wearing parts 1310 and 1320 are spaced apart from each other. For example, as shown in FIG. 13 , when the wearing parts 1310 and 1320 are provided in the form of glasses legs, the HMD 1300 may determine that the glasses legs are spread.
  • the HMD 1300 detects the sensor through the touch circuit 1311 disposed on the inner surface of any one of the wearable parts 1310 and 1320 (e.g., the first wearing part 1310).
  • the pattern of the touch input has a first pattern
  • the pattern of the touch input changes from the first pattern to the second pattern or the touch input is terminated it is determined that the wearable parts 1310 and 1320 are separated. can do.
  • a situation in which the pattern of the touch input has the first pattern is, for example, a touch disposed on the inner surface of any one of the wearing parts 1310 and 1320 (e.g., the first wearing part 1310).
  • a situation in which the pattern of the touch input has the second pattern is, for example, disposed on the inner surface of one of the wearing parts 1310 and 1320 (e.g., the first wearing part 1310).
  • a situation in which the touch circuit 1311 is separated from the conductor 1321 disposed on the outer surface of another of the wearing parts 1310 and 1320 (e.g., the second wearing part 1320) by a certain distance or more. can indicate.
  • FIG. 14 is a diagram for explaining a method of operating an HMD when wearing parts of the HMD are in contact according to an embodiment of the present disclosure.
  • the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user.
  • a wearing portion e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn.
  • Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320) may be included.
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. .
  • at least one of the wearable parts has a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit) of FIG. 6 or the second touch circuit of FIG. 12) on the outer surface. (1221)) or a conductor (eg, conductor 1321 in FIG. 13) may be disposed.
  • the HMD may determine whether contact between the wearing parts is detected. For example, a situation in which the wearing parts are in contact may represent a situation in which the legs of the glasses are folded when the wearing parts are provided in the form of legs of glasses.
  • the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. When a second touch input is detected, it may be determined that the wearing parts are in contact.
  • the HMD when the pattern of a touch input detected through a touch circuit disposed on the inner surface of any one of the wearable parts has a designated pattern (e.g., a first pattern), the HMD makes contact with the wearable parts. It can be judged that it has been done.
  • a situation in which the pattern of the touch input has the specified pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where one is close to or in contact with.
  • the HMD may re-perform operation 1410. For example, the HMD may monitor the contact of the wearing parts continuously or at regular intervals until the contact of the wearing parts is detected.
  • the HMD may deactivate the display and lower the activation level of the processor in operation 1420. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.
  • FIG. 15 is a diagram for explaining another method of operating an HMD when wearing parts of the HMD are in contact, according to an embodiment of the present disclosure.
  • the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user.
  • a wearing portion e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5
  • wearing parts 600 of FIG. 6 wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. .
  • at least one of the wearable parts has a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit) of FIG. 6 or the second touch circuit of FIG. 12) on the outer surface. (1221)) or a conductor (eg, conductor 1321 in FIG. 13) may be disposed.
  • the HMD may determine whether contact between the wearing parts is detected. For example, a situation in which the wearing parts are in contact may represent a situation in which the legs of the glasses are folded when the wearing parts are provided in the form of legs of glasses. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. When a second touch input is detected, it may be determined that the wearing parts are in contact.
  • the HMD when the pattern of a touch input detected through a touch circuit disposed on the inner surface of any one of the wearable parts has a designated pattern (e.g., a first pattern), the HMD makes contact with the wearable parts. It can be judged that it has been done.
  • a situation in which the pattern of the touch input has the specified pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where one is close to or in contact with.
  • the HMD may re-perform operation 1510. For example, the HMD may monitor the contact of the wearing parts continuously or at regular intervals until the contact of the wearing parts is detected.
  • the HMD may deactivate the display in operation 1520. For example, the HMD can turn off the screen of the display.
  • the HMD may determine whether the HMD is seated in the case.
  • the case can accommodate the HMD and protect the HMD from external shock.
  • the case may include a sensor that can check whether the HMD is seated.
  • the case may include a charging terminal, and when the HMD is seated, the HMD may be connected to the charging terminal. In this case, the case may charge the HMD.
  • the HMD may re-perform operation 1520. For example, the HMD may remain inactive with the display.
  • the HMD may lower the activation level of the processor in operation 1540.
  • the HMD can control the processor to operate from a normal mode to a low-power mode.
  • the HMD may lower the driving frequency of the processor.
  • FIG. 16 is a diagram for explaining a method of operating an HMD when the HMD enters a charger according to an embodiment of the present disclosure.
  • the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user.
  • a wearing portion e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5
  • wearing parts 600 of FIG. 6 wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. .
  • at least one of the wearable parts has a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit) of FIG. 6 or the second touch circuit of FIG. 12) on the outer surface. (1221)) or a conductor (eg, conductor 1321 in FIG. 13) may be disposed.
  • the HMD may determine whether the HMD has entered the charger. For example, when the HMD is connected to the charging terminal of the charger, the HMD and the charger may determine that the HMD has entered the charger.
  • the HMD may re-perform operation 1610. For example, the HMD may monitor entry into the charger continuously or at regular intervals until the HMD enters the charger.
  • the HMD may determine whether contact with the wearing parts has been detected in operation 1620. For example, a situation in which the wearing parts are in contact may represent a situation in which the legs of the glasses are folded when the wearing parts are provided in the form of legs of glasses. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. When a second touch input is detected, it may be determined that the wearing parts are in contact.
  • the HMD when the pattern of a touch input detected through a touch circuit disposed on the inner surface of any one of the wearable parts has a designated pattern (e.g., a first pattern), the HMD makes contact with the wearable parts. It can be judged that it has been done.
  • a situation in which the pattern of the touch input has the specified pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where one is close to or in contact with.
  • the HMD may receive charging power from the charger in operation 1630.
  • the charger can charge an HMD.
  • the HMD may provide a notification in operation 1640. For example, if the HMD determines that no contact between the wearing parts is detected, it may determine that the glasses have entered the charger with the legs not properly stacked. That is, the HMD may determine that the HMD is incompletely connected to the charging terminal of the charger. Accordingly, the HMD can provide information indicating that the HMD has been incompletely inserted into the charger. According to one embodiment, the HMD may transmit the information to an external electronic device (e.g., a smartphone) connected through a communication circuit, and the external electronic device may output the information through at least one of a display or a speaker. .
  • an external electronic device e.g., a smartphone
  • the HMD may output the information through a speaker or output a signal corresponding to the information through a light emitting unit (eg, LED).
  • the charger may output the information through a speaker or output a signal corresponding to the information through a light emitting unit (eg, LED).
  • FIG. 17 is a diagram for explaining a method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.
  • the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user.
  • a wearing portion e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5
  • wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320) may be included.
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. .
  • a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect a touch input according to the contact. .
  • the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.
  • the touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells).
  • the touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.
  • the HMD may determine that the HMD is worn on the user's head.
  • the first pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or more, or It can represent a combination state.
  • the touch position is the first position, at least one touch cell arranged in the end direction of the wearable part among the plurality of touch cells arranged on the inner surface of at least one of the wearable parts is used by the user. It may indicate contact with the ear or the part of the temple adjacent to the ear.
  • the state in which the touch area is equal to or greater than the first size means that the total area of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearing units is the first size. It can indicate an abnormal state.
  • the state in which the touch shape has the first shape means that the arrangement shape of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearable parts is the first shape. It can represent the state corresponding to the shape.
  • the first shape may be, for example, a square or oval with one long side.
  • the state in which the number of touches is greater than or equal to the first number means that the number of at least one touch cell contacted among a plurality of touch cells disposed on the inner surface of at least one of the wearing units is greater than or equal to the first number. It can indicate status.
  • the HMD may determine the distance between the lens of the HMD and the user's eyes.
  • the HMD can calculate the distance between the lens and the eye using the acquired touch information.
  • the HMD may determine the distance between the lens and the eye based on at least one of the touch location, the touch area, the touch type, or the number of touches.
  • the HMD may determine the distance between the lens and the eye using history information of touch input detected through the touch circuit disposed on the inner surface of at least one of the wearable parts.
  • the touch input history information may include touch information corresponding to a touch input detected through the touch circuit disposed on the inner surface of at least one of the wearing parts when the user previously wore the HMD. You can. That is, the touch input history information may include the touch information acquired at a previous time or accumulated up to a previous time.
  • the HMD may determine whether the determined distance is within a reference range. For example, the HMD may determine whether the distance between the lens and the eye is within the reference range.
  • the HMD may display information through the display in operation 1730. For example, if it is determined that the distance between the lens and the eye is within the reference range, the HMD may determine that the HMD is normally worn on the user's head. Accordingly, in order to perform an operation according to wearing the HMD, the HMD may display information according to the operation on the screen of the display.
  • the HMD may provide a notification in operation 1740. For example, if it is determined that the distance between the lens and the eye is not within the reference range, the HMD may determine that the HMD is abnormally worn on the user's head. Accordingly, the HMD can provide information indicating that the HMD is abnormally worn on the user's head. For example, the HMD can display the information on the display screen or output it through speakers. Afterwards, the HMD may re-perform operation 1720. For example, the HMD can continuously or at regular intervals monitor whether the HMD is properly worn on the user's head.
  • FIG. 18 is a diagram for explaining another method of operating an HMD related to the wearing posture of the HMD according to an embodiment of the present disclosure.
  • the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user.
  • a wearing portion e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5
  • wearing parts 600 of FIG. 6 wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320
  • At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. .
  • a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect a touch input according to the contact. .
  • the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.
  • the touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells).
  • the touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.
  • the HMD may determine that the HMD is worn on the user's head.
  • the first pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or more, or It can represent a combination state.
  • the touch position is the first position, at least one touch cell arranged in the end direction of the wearable part among the plurality of touch cells arranged on the inner surface of at least one of the wearable parts is used by the user. It may indicate contact with the ear or the part of the temple adjacent to the ear.
  • the state in which the touch area is equal to or greater than the first size means that the total area of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearing units is the first size. It can indicate an abnormal state.
  • the state in which the touch shape has the first shape means that the arrangement shape of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearable parts is the first shape. It can represent the state corresponding to the shape.
  • the first shape may be, for example, a square or oval with one long side.
  • the state in which the number of touches is greater than or equal to the first number means that the number of at least one touch cell contacted among a plurality of touch cells disposed on the inner surface of at least one of the wearing units is greater than or equal to the first number. It can indicate status.
  • the HMD may determine the distance between the HMD's lenses and the user's eyes.
  • the HMD can calculate the distance between the lens and the eye using the acquired touch information.
  • the HMD may determine the distance between the lens and the eye based on at least one of the touch location, the touch area, the touch type, or the number of touches.
  • the HMD may determine the distance between the lens and the eye using history information of touch input detected through the touch circuit disposed on the inner surface of at least one of the wearable parts.
  • the touch input history information may include touch information corresponding to a touch input detected through the touch circuit disposed on the inner surface of at least one of the wearing parts when the user previously wore the HMD. You can. That is, the touch input history information may include the touch information acquired at a previous time or accumulated up to a previous time.
  • the HMD may determine whether the determined distance is within a reference range. For example, the HMD may determine whether the distance between the lens and the eye is within the reference range.
  • the HMD may display information through the display in operation 1830. For example, if it is determined that the distance between the lens and the eye is within the reference range, the HMD may determine that the HMD is normally worn on the user's head. Accordingly, in order to perform an operation according to wearing the HMD, the HMD may display information according to the operation on the screen of the display.
  • the HMD may adjust the focal length of the lens in operation 1840. For example, if the determined distance is smaller than the reference range, the HMD may determine that the distance between the lens and the eye is close. In this case, the HMD can closely adjust the focal length of the lens. As another example, if the determined distance is greater than the reference range, the HMD may determine that the distance between the lens and the eye is long. In this case, the HMD can adjust the focal length of the lens to a greater distance. Afterwards, the HMD may re-perform operation 1820. For example, the HMD can continuously or at regular intervals monitor whether the HMD is properly worn on the user's head.
  • FIG. 19 is a diagram for explaining another method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.
  • the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user.
  • a wearing portion e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn.
  • Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320) may be included.
  • the wearable parts include touch circuits disposed on the inner side (e.g., touch circuits 291 and 292 in Figure 3, touch circuits 491 and 492 in Figures 4 and 5, and first touch circuit 613 in Figure 6 ( Alternatively, the wearing state of the HMD can be detected using the third part 633 of the integrated touch circuit, the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13). For example, when the HMD is worn on the user's head, the touch circuit disposed on the inner surface of the wearing parts may contact a portion of the head and detect a touch input according to the contact.
  • the first touch circuit disposed on the inner surface of the first wearable part among the wearable parts detects the first touch input according to the contact
  • the second touch circuit disposed on the inner surface of the second wearable part among the wearable parts Can detect a second touch input according to the contact.
  • the HMD may determine the wearing state of each of the wearing parts. For example, the HMD determines the wearing state of the first wearable part using the first touch information corresponding to the first touch input detected through the first touch circuit disposed on the inner surface of the first wearable part among the wearable parts. And, the wearing state of the second wearing part can be determined using second touch information corresponding to the second touch input detected through the second touch circuit disposed on the inner surface of the second wearing part among the wearing parts.
  • the first touch information and the second touch information include, for example, a touch location (e.g., the position of a touched touch cell among touch cells), a touch area (e.g., the total area of a touched touch cell among touch cells), and touch It may include at least one of a shape (e.g., arrangement form of touched touch cells among touch cells) or the number of touches (e.g., number of touch cells among touch cells).
  • the first touch information and the second touch information may be referred to as a touch pattern expressed by at least one of a touch location, touch area, touch shape, or number of touches. For example, when the first touch information and the second touch information are different in at least one of the touch location, touch area, touch type, or number of touches, the touch patterns may be expressed as being different.
  • the HMD may determine whether the deviation of the wearing positions of the wearing parts is within a reference range.
  • the HMD may determine the wearing position of the first wearing part using the first touch information, and determine the wearing position of the second wearing part using the second touch information.
  • the wearing position may correspond to the distance between the lens of the HMD and the user's eyes. For example, when the wearing positions of the wearing parts are pulled toward the user's eyes, the distance between the lens and the eye is smaller than the reference range, and when the wearing positions of the wearing parts are worn far from the user's eyes, the The distance between the lens and the eye may be greater than the reference range.
  • the deviation of the wearing positions of the wearing parts may be, for example, when the wearing position of the first wearing part is the first position and the wearing position of the second wearing part is the second position, the first position and the second position. It can correspond to the difference value of .
  • the HMD may display information through the display in operation 1930. For example, if it is determined that the deviation of the wearing positions of the wearing parts is within the reference range, the HMD may determine that the HMD is normally worn on the user's head. Accordingly, in order to perform an operation according to wearing the HMD, the HMD may display information according to the operation on the screen of the display.
  • the HMD may provide a notification in operation 1940. For example, if it is determined that the deviation of the wearing positions of the wearing parts is not within the reference range, the HMD may determine that the HMD is worn abnormally (eg, crookedly) on the user's head. Accordingly, the HMD can provide information indicating that the HMD is abnormally worn on the user's head. For example, the HMD can display the information on the display screen or output it through speakers. Afterwards, the HMD may re-perform operation 1920. For example, the HMD can continuously or at regular intervals monitor whether the HMD is properly worn on the user's head.
  • the HMD may determine that the HMD is worn abnormally (eg, crookedly) on the user's head. Accordingly, the HMD can provide information indicating that the HMD is abnormally worn on the user's head. For example, the HMD can display the information on the display screen or output it through speakers. Afterwards, the HMD may re-perform operation 1920. For example
  • a head mounted display device e.g., the HMD 200 of FIGS. 2 and 3, the HMD 400 of FIGS. 4 and 5, the HMD 1200 of FIG. 12, or the HMD 1200 of FIG. 13
  • the method of detecting the wearing state of the HMD (1300) includes wearing parts (e.g., wearing parts 221 and 222 in FIGS. 2 and 3) that are respectively connected to both ends of the frame of the head mounted display device and extend in one direction. , at least one of the wearing parts 421 and 422 of FIGS. 4 and 5, the wearing part 600 of FIG. 6, the wearing parts 1210 and 1220 of FIG. 12, or the wearing parts 1310 and 1320 of FIG. 13.
  • a first touch circuit disposed on the inner surface of the wearing part e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit 613 in FIG. 6).
  • An operation of detecting a first touch input through (or the third part 633 of the touch circuit formed integrally), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13 e.g., FIG. Operation 730 of 7, operation 830 of FIG. 8, operation 1030 of FIG. 10, or operation 1130 of FIG. 11
  • This may include an operation of determining a wearing state of the head mounted display device.
  • a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on the outer surface of at least one of the wearing parts (e.g., in FIG. 6).
  • an operation of activating the display of the head mounted display device eg, operation 740 of FIG. 7 may be further included.
  • a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on the outer surface of at least one of the wearing parts (e.g., in FIG. 6).
  • a method for detecting a wearing state of a head mounted display device maintains activation of the system of the head mounted display device when the pattern of the first touch input changes from a first pattern to a second pattern,
  • An operation of deactivating the display of the head mounted display device e.g., operation 920 of FIG. 9
  • a pattern of the first touch input in a state where the pattern of the first touch input is changed from the first pattern to the second pattern.
  • an operation of activating the display eg, operation 960 of FIG. 9 may be further included.
  • a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on an outer surface of at least one of the first touch circuit and the wearable portion. (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally) or the second touch circuit 1221 of FIG. 12) or a conductor (e.g., the conductor of FIG. 13)
  • An operation of detecting separation of the worn parts using a sieve 1321 e.g., operation 1010 of FIG. 10
  • an operation of increasing the activation level of the processor of the head mounted display device when the worn parts are separated e.g., operation 1010 of FIG. : Operation 1020 of FIG. 10
  • operation of activating the display of the head mounted display device e.g., operation 1040 of FIG. 10. More may be included.
  • a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on an outer surface of at least one of the first touch circuit and the wearable portion. (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally) or the second touch circuit 1221 of FIG. 12) or a conductor (e.g., the conductor of FIG. 13)
  • An operation of detecting separation of the worn parts using a sieve 1321 e.g., operation 1110 of FIG. 11).
  • the activation level of the processor of the head mounted display device is increased and the head mounted display device is activated.
  • the method may further include activating the display of the display device (e.g., operation 1120 of FIG. 11 ), and deactivating the display if the first touch input is not detected within a specified time after the wearable parts are separated. there is.
  • a method of detecting a wearing state of a head mounted display device includes the first touch circuit and a second touch circuit disposed on an outer surface of at least one of the wearing parts (e.g., the second touch in FIG. 6).
  • a circuit 611 or the first portion 631 of the integrated touch circuit or the second touch circuit 1221 of FIG. 12
  • a conductor e.g., the conductor 1321 of FIG. 13
  • An operation to detect contact of the wearable parts e.g., operation 1410 of FIG. 14
  • an operation to deactivate the display of the head mounted display device and lower the activation level of the processor of the head mounted display device e.g. operation 1420 of FIG. 14
  • a method of detecting a wearing state of a head mounted display device includes the first touch circuit and a second touch circuit disposed on an outer surface of at least one of the wearing parts (e.g., the second touch in FIG. 6).
  • the circuit 611 or the first portion 631 of the integrated touch circuit or the second touch circuit 1221 of FIG. 12
  • a conductor e.g., the conductor 1321 of FIG. 13
  • An operation of detecting contact of the wearable parts e.g., operation 1510 of FIG. 15
  • an operation of deactivating the display of the head mounted display device when the wearable parts are contacted e.g., operation 1520 of FIG.
  • a method of detecting a wearing state of a head mounted display device includes an operation of determining whether the head mounted display device is connected to a charging terminal of a charger (e.g., operation 1610 of FIG. 16), the first touch circuit, and An operation of detecting contact between the wearing parts using a second touch circuit or a conductor disposed on the outer surface of at least one of the wearing parts (e.g., operation 1620 of FIG. 16), when the wearing parts are contacted , an operation of charging the head-mounted display device (e.g., operation 1630 of FIG. 16), and an operation of providing information indicating that the head-mounted display device is incompletely inserted into the charger if the wearing parts are not in contact (e.g. : Operation 1630 of FIG. 16) may be further included.
  • a method for detecting a wearing state of a head mounted display device includes the operation of determining the distance between the lens of the head mounted display device and the user's eyes based on the first touch information (e.g., in FIG. 17 Operation 1710 or operation 1810 of FIG. 18), an operation of determining whether the determined distance is within the reference range (e.g., operation 1720 of FIG. 17 or operation 1820 of FIG. 18), and an operation of determining whether the determined distance is within the reference range. If it is determined that it is not included, information is provided indicating that the head mounted display device is abnormally worn on the head (e.g., operation 1740 of FIG. 17), or an operation of adjusting the focal length of the lens (e.g., operation of FIG. 18) 1840) may be further included.
  • the wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, and the first touch circuit is connected to the first wearing part.
  • a method for detecting a wearing state of a head mounted display device comprising a second touch circuit disposed on an inner surface and a third touch circuit disposed on an inner surface of the second wearing unit, the second touch circuit detected through the second touch circuit.
  • An operation of determining a wearing position of the first wearing unit based on second touch information corresponding to the touch input e.g., operation 1910 of FIG. 19
  • a third touch input corresponding to the third touch input detected through the third touch circuit e.g., operation 1910 of FIG.
  • An operation of determining the wearing position of the second wearing part based on touch information e.g., operation 1910 of FIG. 19
  • An operation of determining e.g., operation 1920 of FIG. 19
  • an operation of providing information indicating that the head mounted display device is abnormally worn on the head e.g., operation 1920 of FIG. Operation 1940 of 19 may further be included.
  • Electronic devices may be of various types.
  • Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances.
  • Electronic devices according to embodiments of this document are not limited to the above-described devices.
  • first, second, or first or second may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited.
  • One (e.g. first) component is said to be “coupled” or “connected” to another (e.g. second) component, with or without the terms “functionally” or “communicatively”.
  • any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • a storage medium e.g., built-in memory 136 or external memory 138
  • a machine e.g., electronic device 101
  • It may be implemented as software (e.g., program 140) including instructions.
  • a processor e.g., processor 120
  • the one or more instructions may include code generated by a compiler or code that can be executed by an interpreter.
  • a storage medium that can be read by a device may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.
  • Computer program products are commodities and can be traded between sellers and buyers.
  • the computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online.
  • a machine-readable storage medium e.g. compact disc read only memory (CD-ROM)
  • an application store e.g. Play Store TM
  • two user devices e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online.
  • at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
  • each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is.
  • one or more of the components or operations described above may be omitted, or one or more other components or operations may be added.
  • multiple components eg, modules or programs
  • the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Est divulgué un appareil de visiocasque comprenant : un cadre comprenant une première surface orientée vers une première direction et une seconde surface orientée vers une seconde direction opposée à la première direction ; un écran exposé à l'extérieur à travers la seconde surface ; des parties d'usure reliées aux extrémités respectives du cadre et s'étendant dans une direction ; et un processeur disposé à l'intérieur du cadre et/ou des parties d'usure, chacune des parties d'usure comprenant une surface interne qui est en contact avec une partie de la tête lorsque le visiocasque est porté sur la tête d'un utilisateur, et une surface externe qui fait face à la surface interne, et au moins une partie d'usure parmi les parties d'usure comprend un premier circuit tactile disposé sur la surface interne. De plus, divers modes de réalisation identifiés par l'intermédiaire du présent document sont également possibles.
PCT/KR2023/014648 2022-09-26 2023-09-25 Appareil de visiocasque et procédé de détection d'état de port de celui-ci WO2024071903A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20220121798 2022-09-26
KR10-2022-0121798 2022-09-26
KR10-2022-0138584 2022-10-25
KR1020220138584A KR20240043031A (ko) 2022-09-26 2022-10-25 헤드 마운트 디스플레이 장치 및 그의 착용 상태 감지 방법

Publications (1)

Publication Number Publication Date
WO2024071903A1 true WO2024071903A1 (fr) 2024-04-04

Family

ID=90478655

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2023/014648 WO2024071903A1 (fr) 2022-09-26 2023-09-25 Appareil de visiocasque et procédé de détection d'état de port de celui-ci

Country Status (1)

Country Link
WO (1) WO2024071903A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110194029A1 (en) * 2010-02-05 2011-08-11 Kopin Corporation Touch sensor for controlling eyewear
KR20130029070A (ko) * 2010-07-20 2013-03-21 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 증강 현실 근접 감지
KR20150043816A (ko) * 2013-10-15 2015-04-23 엘지전자 주식회사 입체적 입력장치를 갖는 글래스형 단말기 및 그의 화면 제어방법
KR102028761B1 (ko) * 2013-07-26 2019-10-04 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 헤드 마운티드 디스플레이 및 그 제어 방법
KR20210104886A (ko) * 2018-12-27 2021-08-25 스냅 인코포레이티드 손가락 거리 또는 손 근접에 기초하는 페이드-인 사용자 인터페이스 디스플레이

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110194029A1 (en) * 2010-02-05 2011-08-11 Kopin Corporation Touch sensor for controlling eyewear
KR20130029070A (ko) * 2010-07-20 2013-03-21 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 증강 현실 근접 감지
KR102028761B1 (ko) * 2013-07-26 2019-10-04 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 헤드 마운티드 디스플레이 및 그 제어 방법
KR20150043816A (ko) * 2013-10-15 2015-04-23 엘지전자 주식회사 입체적 입력장치를 갖는 글래스형 단말기 및 그의 화면 제어방법
KR20210104886A (ko) * 2018-12-27 2021-08-25 스냅 인코포레이티드 손가락 거리 또는 손 근접에 기초하는 페이드-인 사용자 인터페이스 디스플레이

Similar Documents

Publication Publication Date Title
WO2022092517A1 (fr) Dispositif électronique pouvant être porté comprenant une unité d'affichage, procédé de commande d'affichage, système comprenant un dispositif électronique pouvant être porté et boîtier
WO2022102954A1 (fr) Dispositif électronique à porter sur soi comprenant un écran
WO2023017986A1 (fr) Procédé et système électronique pour délivrer en sortie des données vidéo et des données audio
WO2024071903A1 (fr) Appareil de visiocasque et procédé de détection d'état de port de celui-ci
WO2024076058A1 (fr) Dispositif électronique portable comprenant un capteur, et son procédé de fonctionnement
WO2024101747A1 (fr) Dispositif électronique à porter sur soi comprenant une caméra et procédé de fonctionnement du dispositif
WO2024071681A1 (fr) Procédé de fourniture d'image et dispositif électronique pouvant être porté le prenant en charge
WO2023080419A1 (fr) Dispositif électronique habitronique et procédé de commande de dispositif électronique à l'aide d'informations de vision
WO2024112017A1 (fr) Dispositif électronique porté sur la tête et procédé de fonctionnement associé
WO2023229199A1 (fr) Procédé de fonctionnement pour déterminer un mode d'affichage d'écran d'un dispositif électronique, et dispositif électronique
WO2024048937A1 (fr) Dispositif électronique pouvant être porté et système de charge le comprenant
WO2024043611A1 (fr) Procédé de commande de module d'affichage et dispositif électronique pour sa mise en œuvre
WO2024101718A1 (fr) Dispositif électronique portable comprenant un module de caméra
WO2023048462A1 (fr) Dispositif électronique qui ajuste la transmittance de lumière d'une lentille colorable et son procédé de commande
WO2023136533A1 (fr) Procédé d'annulation d'interférence et dispositif électronique pour sa mise en œuvre
WO2024029858A1 (fr) Procédé de commande de module d'affichage et dispositif électronique exécutant le procédé
WO2022255682A1 (fr) Dispositif électronique habitronique et procédé de commande de trajet d'alimentation de celui-ci
WO2023080420A1 (fr) Dispositif électronique habitronique comprenant une terre variable
WO2023106711A1 (fr) Dispositif électronique comprenant un dispositif lidar et son procédé de fonctionnement
WO2023101194A1 (fr) Procédé destiné à fournir un contenu de réalité augmentée dans un moyen de transport, et dispositif portable et dispositif électronique destiné à réaliser ce procédé
WO2023063572A1 (fr) Dispositif électronique habitronique ayant une transmittance de visière réglable et une luminosité d'affichage réglable
WO2024025126A1 (fr) Dispositif électronique pouvant être porté et procédé de fonctionnement associé
WO2022191497A1 (fr) Dispositif électronique pouvant être porté et comprenant un affichage
WO2024048986A1 (fr) Dispositif et procédé de commande d'appareil proche en tenant compte de l'intention d'un utilisateur
WO2024034825A1 (fr) Procédé et dispositif de détermination de contenu pour ordonner l'affichage par un dispositif de réalité augmentée

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23873020

Country of ref document: EP

Kind code of ref document: A1