WO2022010192A1 - Dispositif pouvant être porté et son procédé d'exploitation - Google Patents

Dispositif pouvant être porté et son procédé d'exploitation Download PDF

Info

Publication number
WO2022010192A1
WO2022010192A1 PCT/KR2021/008440 KR2021008440W WO2022010192A1 WO 2022010192 A1 WO2022010192 A1 WO 2022010192A1 KR 2021008440 W KR2021008440 W KR 2021008440W WO 2022010192 A1 WO2022010192 A1 WO 2022010192A1
Authority
WO
WIPO (PCT)
Prior art keywords
wearable device
state
user
released
sensor
Prior art date
Application number
PCT/KR2021/008440
Other languages
English (en)
Korean (ko)
Inventor
윤상호
고재우
구본곤
김도윤
신성환
김정원
한순섭
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2022010192A1 publication Critical patent/WO2022010192A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1698—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/10—Program control for peripheral devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Definitions

  • Various embodiments relate to a wearable device that switches some operations related to a function being executed when the wearable state of the wearable device is released, and an operation method thereof.
  • the augmented reality device enables viewing of a real scene and a virtual image together through a see-through display module disposed in front of the user's face while being worn on the user's face.
  • Augmented reality is a technology that projects a virtual image onto a physical environment space of the real world or a real world object and displays it as a single image.
  • At least one sensor embedded in the augmented reality device may detect a wearing state of the augmented reality device, and when the user takes off the augmented reality device worn on the face, continuously in relation to a service being provided while wearing the augmented reality device
  • An object of the present invention is to provide a wearable device for identifying a wearing state or a disposition state of the wearable device using a sensor embedded in the wearable device, and an operating method thereof.
  • Another object of the present invention is to provide a wearable device for switching some operations related to a function being executed when the wearing state of the wearable device is released, and a method of operating the same.
  • the technical problem to be solved is not limited to the technical problems as described above, and other technical problems may exist.
  • a wearable device includes at least one sensor, a memory for storing one or more instructions, and a processor for executing one or more instructions, wherein the processor includes the wearable device using the at least one sensor. Identifies the arrangement state of the wearable device as it detects that it is released from the wearing state worn on the face part, identifies the function that the wearable device is executing when detecting that it is released from the wearing state, and determines the arrangement of the wearable device based on the running function It can be switched to a predetermined action corresponding to the state.
  • a method of operating a wearable device includes the steps of identifying the arrangement state of the wearable device by detecting that the wearable device is released from the wearing state worn on the user's face using at least one sensor, releasing from the wearing state
  • the method may include identifying a function that is being executed by the wearable device when detecting that the wearable device is executing, and switching to a predetermined operation corresponding to an arrangement state of the wearable device based on the function being executed.
  • FIG. 1 is a diagram for describing sensors embedded in a wearable device according to an exemplary embodiment.
  • FIG. 2 is a diagram for explaining examples of arrangement states of wearable devices.
  • FIG. 3 is a block diagram of a wearable device according to an embodiment.
  • FIG. 4 is a flowchart illustrating an operation of a wearable device according to an exemplary embodiment.
  • FIG. 5 is a flowchart illustrating an example in which the wearable device operates when the wearable device is released.
  • FIG. 6 is a flowchart illustrating another example in which the wearable device operates when the wearable device is released.
  • FIG. 7 is a diagram for explaining an example of a peripheral device capable of interworking with a wearable device according to an embodiment.
  • FIG. 8 is a flowchart illustrating an example in which the wearable device operates in conjunction with a peripheral device when the wearable device is released.
  • FIG. 9 is a flowchart illustrating another example in which the wearable device operates in conjunction with a peripheral device when the wearable device is released.
  • FIG. 10 is a flowchart illustrating an operation of the wearable device according to detecting the wearable state of the wearable device or the release of the wearing state according to an exemplary embodiment.
  • FIG. 11 is a block diagram of a wearable device and a peripheral device according to an exemplary embodiment.
  • phrases such as “in some embodiments” or “in one embodiment” appearing in various places in this specification are not necessarily all referring to the same embodiment.
  • Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented in various numbers of hardware and/or software configurations that perform specific functions.
  • the functional blocks of the present disclosure may be implemented by one or more microprocessors, or may be implemented by circuit configurations for a given function.
  • the functional blocks of the present disclosure may be implemented in various programming or scripting languages.
  • the functional blocks may be implemented as an algorithm running on one or more processors.
  • the present disclosure may employ prior art for electronic configuration, signal processing, and/or data processing, and the like. Terms such as “mechanism”, “element”, “means” and “configuration” may be used broadly and are not limited to mechanical and physical components.
  • connecting lines or connecting members between the components shown in the drawings only exemplify functional connections and/or physical or circuit connections.
  • a connection between components may be represented by various functional connections, physical connections, or circuit connections that are replaceable or added.
  • AR augmented reality
  • 'Augmented Reality Device' refers to a device capable of expressing 'Augmented Reality', and is generally an augmented reality glasses device in the form of glasses worn by a user on a face part ( Augmented Reality Glasses), as well as a head mounted display device (HMD: Head Mounted Display Apparatus) worn on the head, and an augmented reality helmet (Augmented Reality Helmet).
  • Augmented Reality Glasses Augmented Reality Glasses
  • HMD Head Mounted Display Apparatus
  • a 'real scene' is a scene of the real world that a user sees through the augmented reality device, and may include a real world object.
  • a 'virtual image' is an image generated through an optical engine and may include both a static image and a dynamic image. Such a virtual image is observed together with a real scene, and may be an image representing information about a real object in the real scene, information about an operation of an augmented reality device, or a control menu.
  • a general augmented reality device uses an optical engine for generating a virtual image composed of light generated from a light source, and a transparent material to guide the virtual image generated by the optical engine to the user's eyes and view the scene in the real world together.
  • a formed light guide plate (Waveguide) is provided.
  • an optical element for changing the path of light having a basic straightness (Optical element) is required.
  • the optical path may be changed by using reflection by a mirror or the like, or the optical path may be changed through diffraction by a diffraction element such as a diffractive optical element (DOE) or a holographic optical element (HOE), but is not limited thereto.
  • DOE diffractive optical element
  • HOE holographic optical element
  • the wearing state of the wearable device 100 may mean a state in which the user is wearing the wearable device 100 on the face part.
  • the arrangement state of the wearable device 100 may mean a state in which the wearable device 100 is released from the worn state and arranged in a predetermined shape.
  • FIG. 1 is a diagram for describing sensors embedded in a wearable device according to an exemplary embodiment.
  • the wearable device 100 may be an augmented reality device.
  • the electronic device 100 may be a device implemented in the shape of glasses that can be worn on a user's face.
  • the wearable device 100 may be a device implemented in the shape of goggles, a helmet, a hat, etc. including a see-through display module disposed in front of the user's eyes, but is not limited thereto.
  • the wearable device 100 may include a sensing unit 150 ( FIG. 3 ) including at least one sensor. At least one sensor may be mounted in a built-in form in a specific area of the wearable device 100 .
  • the sensing unit 150 may include a pressure sensor 151 ( FIG. 3 ), a strain gauge 152 ( FIG. 3 ), and a bending sensor 153 ( FIG. 3 ).
  • the pressure sensor 151 is a sensor that measures pressure and converts the measurement result into an electrical signal and outputs it. When an object receives pressure, the pressure sensor 151 measures the pressure by using a characteristic that the portion receiving the pressure deforms or responds to the pressure.
  • the pressure sensor 151 is a pressure generated when a portion of the wearable device 100 directly touches the user's body while the wearable device 100 is worn on the user's face or disposed on the head. can be measured.
  • the pressure sensor 151 extends over the nose supports 11 and 12 that come into contact with the user's nose and the user's ear when the wearable device 100 is worn by the user. Earrings may be built into the earring parts (13, 14).
  • the strain gauge 152 is a sensor that measures deformation when an object is deformed by an external force.
  • the strain gauge 152 may be attached to or embedded in the surface of the object to measure the state and quantity of the deformation of the object.
  • Strain represents the degree of deformation or strain, and means a value expressed as a ratio of the length increased or decreased with respect to the original length when an object is subjected to an external force.
  • the strain gauge 152 detects the measured strain as an electrical signal.
  • the strain gauge 152 may measure a minute deformation generated by an external force applied to the wearable device 100 according to a wearing state or an arrangement state of the wearable device 100 .
  • the strain gauge 152 may be embedded in the lens frame lower ends 21 and 22 , the lens frame upper ends 23 and 24 , and the legs 25 and 26 of the wearable device 100 . can
  • the bending sensor 153 is a sensor that measures the degree of bending of an object.
  • the bending sensor 153 measures the bending degree by using the characteristic that the resistance value varies according to the bending degree of the object.
  • the bending sensor 153 may measure the folding or unfolding of the leg portion of the wearable device 100 .
  • the bending sensor 153 may be embedded in the connecting parts 31 and 32 including a hinge connecting the leg part of the wearable device 100 and the lens frame.
  • the wearable device 100 may identify a wearing state or an arrangement state of the wearable device 100 based on a combination of each sensing information obtained from the pressure sensor 151, the strain gauge 152, and the bending sensor 153. have.
  • the wearable device 100 may accurately determine a wearing state or an arrangement state of the wearable device 100 .
  • FIG. 1 is a diagram illustrating the wearable device 100 according to an embodiment, but is not limited thereto.
  • FIG. 2 is a diagram for explaining examples of arrangement states of wearable devices.
  • FIG. 2 shows examples of arrangement states 202-208 in which the wearable device is released from the wearing state 201 in which the wearable device is being worn on the face part and arranged in a predetermined shape.
  • the wearing state of the wearable device 100 means a state in which the user is wearing the wearable device 100 on the face part.
  • the arrangement state of the wearable device 100 means a state in which the wearable device 100 is released from the worn state and arranged in a predetermined shape.
  • the user may take off the wearable device 100 worn on the face and put it over the head or the nape of the neck.
  • the state arranged on the user's head includes a state in which the legs of the wearable device 100 are spread over the upper part of the forehead of the user 202 and a state in which the legs of the wearable device 100 are spread over the nape of the user 203 ) and the like.
  • the user may take off the wearable device 100 being worn on the face and put it on a clothes pocket or collar.
  • the state arranged on the user's clothes may include a state 204 draped over the user's collar in a state where the leg portion of the wearable device 100 is folded, a state 205 draped over the clothes pocket, and the like. have.
  • the user may take off the wearable device 100 that is being worn on the face and put it on the desk.
  • the state in which the legs are spaced apart from the user and arranged in an unfolded state is a state in which the lower end of the lens frame is placed in contact with the floor in a state in which the legs of the wearable device 100 are unfolded ( 206 ), and the upper end of the lens frame is placed on the floor. It may include a state 207 placed in contact with the .
  • the user may take off the wearable device 100 being worn on the face and put it on the desk with the legs folded.
  • the state in which the legs are separated from the user and arranged in a folded state is a state in which the legs of the wearable device 100 are placed on the floor in a folded state 208 , a state in which the legs are stored in a case in a folded state, etc. may include
  • FIG. 2 is illustrated to explain a wearing state or an arrangement state according to various embodiments, but is not limited thereto.
  • FIG. 3 is a block diagram of a wearable device according to an embodiment.
  • the wearable device 100 may be an augmented reality device that provides an augmented reality image having a communication function and a data processing function, but is not limited thereto.
  • the wearable device 100 includes a memory 130 and a processor 120 , a sensing unit 150 , a display 140 , a camera module 175 , a communication unit 180 , and a sound. It may include an output unit 185 , a vibration motor 187 , a microphone 190 , and a user input unit 195 .
  • the wearable device 100 may be implemented by more components than the components shown in FIG. 3 , or the wearable device 100 may be implemented by fewer components than the components shown in FIG. 3 .
  • the processor 120 of the wearable device 100 executes programs stored in the memory 130 , and thus the sensing unit 150 , the display 140 , the camera module 175 , the communication unit 180 , and the sound output unit 185 . ), the vibration motor 187 , the microphone 190 , the user input unit 195 , and the like can be generally controlled.
  • the memory 130 may store a program to be executed by the processor 120 , and may store data input to or output from the wearable device 100 .
  • the memory 130 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , may include at least one type of storage medium among optical disks.
  • Programs stored in the memory 130 may be classified into a plurality of software modules according to their functions.
  • the wearing identification module 131 the arrangement state identification mode 132 , the function identification module 133 , and the operation It may include a conversion module 134 and a peripheral device control module 135, but is not limited thereto, and may store some of them or further include other software modules.
  • the memory 130 may store information about a combination of sensing information corresponding to a wearing state or an arrangement state of the wearable device 100 .
  • Information on a combination of sensing information corresponding to a wearing state or an arrangement state may be stored in the memory 130 in a table format. In addition, it may be stored in the memory 130 in the form of an algorithm for detecting a wearing state or an arrangement state corresponding to a combination of the sensing information obtained by the sensing unit 130 .
  • information about a combination of sensing information corresponding to a wearing state or an arrangement state is mounted on the wearable device 100 in a wearing state or a predetermined arrangement state of the wearable device 100 as shown in the table below. It may include information on whether a valid sensing value is output from the plurality of sensors 11-14, 21-26, 31-32 (refer to FIG. 1).
  • the table below includes information on the presence or absence of a sensed value, but is not limited thereto.
  • the information about the combination of sensing information corresponding to the wearing state or the arrangement state may include a size of a sensing value that may be output by a plurality of sensors, respectively, and a range of the sensing value.
  • a valid sensing value is output from a plurality of sensors 11-14, 21-26, 31-32 (refer to FIG. 1) mounted on the wearable device 100 including the strain gauge 152 disposed in FIG. 1). At this time, it may be determined that the wearable device 100 is in a worn state.
  • the effective sensing value of the strain gauge 152 disposed on the lower end of the lens frame (21, 22, FIG. 1) or the strain gauge 152 disposed on the upper end of the lens frame (23, 24, FIG. 1) is When the output and a valid sensing value are output from the strain gauge 152 disposed on the leg parts 25 and 26 ( FIG. 1 ), the leg part of the wearable device 100 is placed on the floor in an unfolded state (206 or 207 ) , FIG. 2) can be determined.
  • a valid sensing value when a valid sensing value is output, it may be determined that the wearable device 100 is in a state disposed on the user's clothes. Referring to FIG. 2 , when the wearable device 100 is placed on the user's clothes, the wearable device 100 is mounted on either lens as a load is applied in the direction of either lens in the folded state. A valid sensed value may be output from the strain gauge 152 .
  • the effective first sensing value output from the strain gauge 152 disposed on the left lens frame 21 , 23 , FIG. 1 of the wearable device 100 and the right lens frame 22 , 24 with FIG. 1 When the difference between the effective second sensing values output from the strain gauge 152 is equal to or greater than a predetermined value, it may be determined that the wearable device 100 is placed on the user's clothes.
  • the processor 120 controls the overall operation of the wearable device 100 .
  • the processor 120 may control an operation or function performed by the wearable device 100 by executing instructions or programs stored in the memory 130 .
  • the processor 120 may include one or a plurality of processors.
  • the processor 120 is, for example, a central processing unit (Central Processing Unit), a microprocessor (microprocessor), a graphic processor (Graphic Processing Unit), ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), and FPGAs (Field Programmable Gate Arrays) may be configured of at least one hardware, but is not limited thereto.
  • a central processing unit Central Processing Unit
  • microprocessor microprocessor
  • a graphic processor Graphic Processing Unit
  • ASICs Application Specific Integrated Circuits
  • DSPs Digital Signal Processors
  • DSPDs Digital Signal Processing Devices
  • PLDs Programmable Logic Devices
  • FPGAs Field Programmable Gate Arrays
  • the processor 120 may identify whether the wearable device 100 is in the wearing state worn on the user's face part or the wearing state is released.
  • the wearable device 100 may determine the wearing state by using the sensing unit 150 .
  • the wearable device 100 may determine whether the wearable device 100 is in the wearing state or the wearing state is released based on a combination of sensing information acquired using the sensing unit 150 based on a preset time interval. .
  • the processor 120 wears the wearable device 100 by using a combination of sensing information obtained from the sensing unit 150 based on information on a combination of sensing information corresponding to the wearing state stored in advance in the memory 130 . State or wear state release may be identified.
  • the information on the combination of sensing information corresponding to the wearing state stored in advance in the memory 130 includes a plurality of sensors embedded in the wearable device 100 when the wearable device 100 is in the wearing state, respectively. It may include the presence or absence of a sensed value that can be output, the size of the sensed value, and the range of the sensed value.
  • the processor 120 receives the sensing information respectively obtained from the plurality of sensors included in the sensing unit 150 with information on a combination of the sensing information corresponding to the wearing state stored in advance in the memory 130 and can be compared The processor 120 determines that a combination of sensing information each obtained from a plurality of sensors included in the sensing unit 150 is stored in advance in the memory 130 within a predetermined range with information on a combination of sensing information corresponding to a wearing state. If it is determined that the wearable device 100 is similar, it may be determined that the user is wearing the wearable device 100 on the face part.
  • the processor 120 obtains sensing information from the sensing unit 150 based on a preset time interval, and the sensing information each obtained from a plurality of sensors included in the sensing unit 150 is stored in the memory 130 . If it is determined that the prestored information on the combination of the sensing information corresponding to the wearing state is not similar to the information within a predetermined range, the user may take off the wearable device 100 and determine that it is released from the wearing state.
  • the wearable device 100 may identify the placement state by executing the placement state identification module 132 upon determining that the wearing state of the wearable device 100 is released. Also, by executing the function identification module 133 , the wearable device 100 may identify a function that is being executed by the wearable device 100 when the wearable device is released from the wearing state. In addition, the wearable device 100 may switch to a predetermined operation corresponding to the arrangement state of the wearable device 100 based on the currently executing function of the wearable device 100 by executing the operation conversion module 134 .
  • the processor 120 may identify the arrangement state of the wearable device 100 by executing the arrangement state identification module 132 stored in the memory 130 .
  • the processor 120 may identify the arrangement state of the wearable device 100 by detecting that the wearable device 100 is released from the wearing state worn on the user's face using the sensing unit 150 .
  • the arrangement state of the wearable device 100 may be a state arranged on the user's head, a state arranged on the user's clothes, a state arranged in a state where the leg portion is spread apart from the user, or It may include a state in which the leg part is disposed in a folded state while being spaced apart from the user, but is not limited thereto.
  • the processor 120 uses a combination of sensing information obtained from the sensing unit 150 based on information on a combination of sensing information corresponding to an arrangement state stored in advance in the memory 130 to arrange the wearable device 100 . status can be identified.
  • the information on the combination of sensing information corresponding to the arrangement state may be obtained from the pressure sensor 151 , the strain gauge 152 , and the bending sensor 153 disposed in the wearable device 100 , respectively. This is information for determining which arrangement state the wearable device 100 is currently in according to a combination of sensing information.
  • Information about a combination of sensing information corresponding to the arrangement state stored in advance in the memory 130 is valid that can be output by a plurality of sensors built in the wearable device 100 when the wearable device 100 is in a predetermined arrangement state, respectively. It may include the presence or absence of a sensed value, the size of the sensed value, and the range of the sensed value.
  • a sensed value output from at least one sensor among a plurality of sensors built in the wearable device 100 indicates a valid sensing value, and there is no sensed value output from another at least one sensor or is at 0 It can be an approximate value.
  • a sensor disposed at a position where pressure or external force will not be generated when the user wears the wearable device 100 on a collar for example, a pressure sensor 151 disposed on the nose support portions 11 and 12 ( FIG. 1 ).
  • a pressure sensor 151 disposed on the nose support portions 11 and 12 may be a value close to 0.
  • the processor 120 may compare the sensing information each obtained from the plurality of sensors included in the sensing unit 150 with information on a combination of sensing information corresponding to the arrangement state previously stored in the memory 130 . For example, the processor 120 senses sensing values corresponding to a state in which sensing values obtained from a plurality of sensors included in the sensing unit 150 are stored in advance in the memory 130 and placed on the user's head. If it is determined that the information about the combination of information is similar to the information within a predetermined range, it may be determined that the information is in a state arranged on the user's head.
  • the processor 120 may identify the function being executed by the wearable device 100 when detecting that the wearable device 100 is released from the worn state.
  • the processor 120 determines which function is being executed when the wearable device 100 is released from the wearing state. .
  • the wearable device 100 may be running a video playback application or a music playback application. Also, for example, the wearable device 100 may be in a communication connection state with the counterpart device while a conference application or a phone application is running.
  • the processor 120 detects that the wearable device 100 is released from the worn state by executing the operation switching module 134 stored in the memory 130 , based on the function being executed, the arrangement state of the wearable device 100 . may be switched to a predetermined operation corresponding to .
  • the wearable device 100 when the wearable device 100 is released from the wearing state, the wearable device 100 performs the operation of the wearable device 100 to provide some functions based on the arrangement state of the functions that were being executed while being worn on the user's face. can be switched Accordingly, the wearable device 100 provides a use environment that provides a seamless service even when the user takes off the wearable device 100 and arranges it in a predetermined shape as well as when the user is wearing the wearable device 100. .
  • the wearable device 100 may control the display to stop outputting the video of the video being played.
  • the wearable device 100 may control the sound output unit 185 to change the sound output of the video being reproduced based on the arrangement state of the wearable device 100 identified by the arrangement state identification module 132. have.
  • the wearable device 100 determines that it is placed on the user's head, by controlling the sound output unit 185, the sound output of the video being reproduced may be continued in the bone conduction method.
  • the wearable device 100 controls the sound output unit 185 based on the state of being placed on the user's collar so that the sound output of the video being reproduced can be continued through beamforming control. have.
  • the wearable device 100 controls to obtain a user image by driving the built-in camera module 175, and uses the beamforming function of the microphone 190 to obtain the user's voice. can be controlled so that Also, the wearable device 100 may increase the sound output volume of the sound output unit 185, for example, a speaker.
  • the wearable device 100 will switch to the video call mode.
  • the wearable device 100 may switch the alarm function of the wearable device 100 to the vibration mode as it is determined that the wearing state of the wearable device 100 is released.
  • the wearable device 100 may provide an alarm as vibration by controlling the vibration motor 187 .
  • the wearable device 100 when the wearable device 100 is identified as being placed on the floor in a folded state, the wearable device 100 controls to switch to a power saving mode, thereby controlling to operate only a preset minimum function. have. Also, when the wearable device 100 is identified as being placed on the floor with the legs of the wearable device 100 folded, the wearable device 100 may control the power of the wearable device 100 to be turned off.
  • the processor 120 By executing the peripheral device control module 135 stored in the memory 130 , the processor 120 detects peripheral devices connectable to the wearable device 100 when it is detected that the wearable device 100 is released from the worn state, and You can control the device.
  • the wearable device 100 when the wearable device 100 detects that the wearable device is released from the wearing state, the wearable device 100 controls the peripheral device to perform at least some operations related to the function being executed, so that the peripheral device that is interworking or connectable with the wearable device 100 performs can
  • the peripheral device may be a smart phone, a smart watch, a wireless earphone, a tablet, a PC, a TV, and the like, but is not limited thereto.
  • the wearable device 100 may detect that the wearing state is released by the wearing identification module 131 while executing the video playback application, and detect a connectable nearby smart phone. By executing the peripheral device control module 135 , the wearable device 100 may transmit information about a video being reproduced to the smart phone and control to continue outputting the image through the display of the smart phone. Also, when the user is wearing the wireless earphone, the wearable device 100 may control to continue the sound output of the video being played through the wireless earphone.
  • the wearable device 100 detects that the wearing state is released by the wearing identification module 131 while the meeting application is running, and the arrangement state of the wearable device 100 by the placement state identification module 132 is detected, the wearable device 100 may switch to a video conference mode.
  • the wearable device 100 may detect a connectable nearby smart phone by executing the peripheral device control module 135 and communicate with the smart phone.
  • the wearable device 100 may control a video conference-related recommended application to be displayed through the display of the smart phone.
  • the wearable device 100 may control to output an image of the other party through the display of the smart phone.
  • the wearable device 100 may control to output a sound through the wireless earphone.
  • the sensing unit 150 may include a pressure sensor 151 , a strain gauge 152 , a bending sensor 153 , a motion sensor 155 , and a gaze tracking sensor 157 . Since the pressure sensor 151 , the strain gauge 152 , and the bending sensor 153 have been described above with reference to FIG. 1 , they will be omitted.
  • the motion sensor 155 may be an Inertial Measurement Unit (IMU).
  • IMU Inertial Measurement Unit
  • the IMU may be a combination of sensors configured to detect movement of an object in three-dimensional space, ie, changes in position and orientation.
  • the combination of sensors may include an accelerometer, a gyroscope, a geomagnetometer, and a gyroscope.
  • the motion sensor 150 may include at least one of an acceleration sensor, a magnetic sensor, and a gyroscope sensor.
  • the gaze tracking sensor 160 may detect gaze information of the user's eyes.
  • the gaze information may include at least one of a gaze direction viewed by the user's eye, a pupil position of the user's eye, or coordinates of a center point of the pupil.
  • the eye tracking sensor 160 may provide light to the user's eye (a left eye or a right eye) and sense the amount of light reflected from the user's eye.
  • the eye tracking sensor 160 may detect a gaze direction of the user's eye, a pupil position of the user's eye, coordinates of a center point of the pupil, and the like, based on the detected amount of light.
  • the eye tracking sensor 160 may provide light to the user's eyes and photograph the user's eyes.
  • the eye tracking sensor 160 may detect a gaze direction of the user's eye, a pupil position of the user's eye, coordinates of a center point of the pupil, and the like, based on the captured user's eye image.
  • the display 140 may output information processed by the processor 120 .
  • the display 140 may display a virtual object.
  • the display 140 may provide an augmented reality (AR) image.
  • the display 140 may include a waveguide and a display module.
  • the wave guide may be made of a transparent material through which a partial region of the rear surface is visible when the user wears the wearable device 100 .
  • the wave guide may be composed of a flat plate having a single-layer or multi-layer structure made of a transparent material through which light is reflected and propagated therein.
  • the wave guide may receive the light of the virtual image projected to face the emission surface of the display module.
  • the transparent material means a material through which light can pass, the transparency may not be 100%, and it may have a predetermined color.
  • the wave guide is formed of a transparent material
  • the user can see the virtual object of the virtual image through the display 140 as well as the external real scene, so that the wave guide is see-through. It may be referred to as a see through display.
  • the display 140 may provide an augmented reality image by outputting a virtual object of a virtual image through the wave guide.
  • the camera module 175 may photograph the surroundings of the wearable device 100 .
  • the camera module 175 may acquire an image frame, such as a still image or a moving picture, through an image sensor when an application requesting a photographing function is executed.
  • the image captured through the image sensor may be processed through the processor 120 or a separate image processing unit (not shown). Also, the captured image may be displayed on the display 140 .
  • the image frame processed by the processor 120 or a separate image processing unit may be stored in the memory 130 or transmitted to the outside through the communication unit 180 .
  • Two or more camera modules 175 may be provided depending on the configuration of the wearable device 100 .
  • the camera module 175 may be, for example, an RGB-Depth camera capable of acquiring an RGB image and depth information.
  • the communication unit 180 may include one or more components that enable communication between the wearable device 100 and the peripheral device 200 ( FIG. 11 ) or a server (not shown).
  • the communication unit 180 may include a short-distance communication unit and a mobile communication unit.
  • the short-distance communication unit includes a Bluetooth communication unit, a short-range wireless communication unit (NFC/RFID unit), a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, etc. may be included, but is not limited thereto.
  • the mobile communication unit transmits/receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.
  • the wearable device 100 may transmit a request signal to the peripheral device 200 to perform some operation related to a function being executed in the wearable device 100 through the communication unit 180 .
  • the sound output unit 185 outputs audio data received from the communication unit 180 or stored in the memory 130 . Also, the sound output unit 185 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the wearable device 100 .
  • a function eg, a call signal reception sound, a message reception sound, and a notification sound
  • the sound output unit 185 may include a speaker, a buzzer, and the like.
  • the sound output unit 185 according to an embodiment may be implemented in the form of an earphone mounted on the wearable device 100 or detachable. Also, the sound output unit 185 according to an embodiment may output sound in a bone conduction method.
  • the sound output unit 185 may output a sound of a video being played while a video playback application is running. Also, for example, the sound output unit 185 may output the sound of the meeting counterpart while the meeting application is running.
  • the vibration motor 187 may output a vibration signal.
  • the vibration motor 187 may output a vibration signal corresponding to the output of audio data or video data (eg, a call signal reception sound, a message reception sound, etc.).
  • the vibration motor 187 may output a vibration signal when a user input is received from the user input unit 195 .
  • the vibration motor 187 may provide a notification as vibration when the wearable device 100 operates in a vibration mode. Also, the vibration motor 187 may provide vibration according to the music rhythm when the wearable device 100 is playing music according to the execution of the music application.
  • the microphone 190 receives an external sound signal and processes it as electrical voice data.
  • the microphone 190 may receive an acoustic signal from an external device or a speaker.
  • the microphone 190 may receive a user's voice input for controlling the wearable device 100 .
  • the microphone 190 may use various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.
  • the microphone 190 may receive a user's voice while the wearable device 100 is executing a meeting application.
  • the user input unit 195 means a means for a user to input data for controlling the wearable device 100 .
  • the user input unit 195 may include a key pad, a dome switch, and a touch pad (contact capacitance method, pressure resistance film method, infrared sensing method, surface ultrasonic conduction method, integral type). It may include at least one of a tension measurement method, a piezo effect method, etc.), a jog wheel, or a jog switch, but is not limited thereto.
  • FIG. 4 is a flowchart illustrating an operation of a wearable device according to an exemplary embodiment.
  • the wearable device 100 detects that the wearable device 100 is released from the wearing state worn on the user's face using at least one sensor, and identifies the arrangement state of the wearable device 100 can do.
  • the wearable device 100 is based on a combination of sensing information obtained from at least one of the pressure sensor 151 ( FIG. 3 ), the strain gauge 152 ( FIG. 3 ), or the bending sensor 153 ( FIG. 3 ).
  • the pressure sensor 151 FIG. 3
  • the strain gauge 152 FIG. 3
  • the bending sensor 153 FIG. 3
  • the wearable device 100 determines that the wearable device 100 is being worn on the face of the user based on a comparison of the information on the combination of the acquired sensing information and the sensing information corresponding to the wearing state stored in advance in the memory 130 . It can be determined whether the wearing state is worn.
  • the wearable device 100 determines which arrangement state the wearable device 100 is in can do.
  • the wearable device 100 may determine the arrangement state of the wearable device 100 based on a comparison of the information on the combination of the acquired sensing information and the sensing information corresponding to the arrangement state previously stored in the memory 130 . have. For example, based on the combination of the acquired sensing information, the wearable device 100 is placed on the user's head, placed on the user's clothes, spaced apart from the user, and the legs are unfolded. It can be identified whether the arranged state or the arranged state in a state in which the legs are folded apart from the user.
  • the wearable device 100 when detecting that the wearable device 100 is released from the worn state, the wearable device 100 may identify a function that is being executed.
  • the wearable device 100 detects that the wearable device is released from the worn state, it is possible to identify which function the wearable device 100 is executing at the time when the wearable device 100 detects that the wearable state is released.
  • the wearable device 100 may be running a video playback application. Also, for example, the wearable device 100 may be in a communication connection state with the counterpart device while the conference application is running.
  • the wearable device 100 may switch to a predetermined operation corresponding to the arrangement state of the wearable device 100 based on the function being executed.
  • the wearable device 100 may continuously provide at least some of the functions being executed when it is detected that the wearable device 100 is released from the worn state, even in the deployed state, depending on the deployment state. can be converted into action.
  • the wearable device 100 detects that the wearing state is released while a video is being played, the image output of the display 140 is stopped, while the wearable device 100 is disposed in a bone conduction method, etc.
  • the sound output unit 185 may be controlled to continue the sound output of the video.
  • FIG. 5 is a flowchart illustrating an example in which the wearable device operates when the wearable device is released.
  • FIG. 5 when a user is watching a video while wearing the wearable device 100, an example in which the operation of the wearable device 100 is switched as the user takes off the wearable device 100 and switches to a predetermined arrangement state will be described. .
  • the wearable device 100 may execute a video playback application.
  • the wearable device 100 may be playing video data stored in the memory 130 or video data received through the communication unit 180 .
  • the wearable device 100 may detect the wear state release. For example, the user may put the wearable device 100 above the head and put it on the head. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can
  • the wearable device 100 may identify an arrangement state of the wearable device 100 .
  • the wearable device 100 is placed on the user's head based on a combination of sensing information obtained from at least one of the pressure sensor 151 , the strain gauge 152 , and the bending sensor 153 . state can be determined.
  • the wearable device 100 may stop outputting an image of a video being reproduced. As the wearable device 100 is released from the wearing state worn on the user's face, the wearable device 100 may stop the operation of outputting an image through the display 140 of the video being reproduced.
  • the wearable device 100 may control the sound output based on the arrangement state. As the wearable device 100 identifies that the wearable device 100 is placed on the user's head, the sound output operation through the sound output unit 185 of the video being reproduced continues in a bone conduction method. can be controlled
  • FIG. 6 is a flowchart illustrating another example in which the wearable device operates when the wearable device is released.
  • the wearable device 100 when the user wears the wearable device 100 and a meeting is in progress through the execution of the meeting application, the wearable device 100 is switched as the user takes off the wearable device 100 and switches to a predetermined arrangement state. An example is explained.
  • the wearable device 100 may execute a conference application.
  • a user wearing the wearable device 100 may be conducting a voice conference while being connected to another user device through the communication unit 180 .
  • the wearable device 100 may detect the wear state release. For example, the user may take off the wearable device 100 and place it on the desk with the legs extended. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can
  • the wearable device 100 may identify an arrangement state of the wearable device.
  • the wearable device 100 is spaced apart from the user based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, or the bending sensor 153, and the leg portion is arranged in an unfolded state. can judge
  • the wearable device 100 may control acquisition of a user image based on an arrangement state.
  • the wearable device 100 may acquire a user image by driving the camera module 175 .
  • the wearable device 100 may output a message requesting a direction change, a height change, an angle change, etc. in which the wearable device 100 is disposed to obtain a face image of the user through the sound output unit 185 .
  • the wearable device 100 may control the user's voice input based on the arrangement state.
  • the wearable device 100 may adjust the voice input volume to receive the user's voice input through the microphone 190 built in the wearable device 100 disposed to be spaced apart from the user by a predetermined distance.
  • the wearable device 100 may control the sound output based on the arrangement state.
  • the wearable device 100 may adjust the voice output volume so that the user can hear the voice of another user output through the sound output unit 185 built in the wearable device 100 disposed at a predetermined distance from the user. have.
  • FIG. 6 illustrates an example of operation when the wearable device 100 is released from the worn state while the conference application is running, but is not limited thereto. For example, if the wearable device 100 is disconnected from the wearing state and the disposition state of the wearable device 100 is separated from the user and the leg portion is unfolded when a call is connected while the phone application is running, video call mode can be switched.
  • FIG. 7 is a diagram for explaining an example of a peripheral device capable of interworking with a wearable device according to an embodiment.
  • the wearable device 100 may operate in conjunction with the peripheral device 200 ( FIG. 11 ) through the communication unit 180 .
  • the peripheral device 200 may be an earphone 201 , a smartphone 202 , a smart watch 203 , a notebook computer 204 , a tablet 205 , a TV 206 , and the like, but is not limited thereto. .
  • the wearable device 100 may be interworking with at least one peripheral device 200 within a Bluetooth communication range. Also, for example, the wearable device 100 may search for at least one peripheral device 200 within a Bluetooth communication range and request a connection.
  • the wearable device 100 when the wearable device 100 detects that the wearable device 100 is released from the worn state, the wearable device 100 interlocks at least one operation related to the function being executed with the wearable device 100 .
  • At least one peripheral device 200 in operation or connectable may be controlled to perform.
  • FIG. 8 is a flowchart illustrating an example in which the wearable device operates in conjunction with a peripheral device when the wearable device is released.
  • the wearable device 100 takes off the wearable device 100 and switches to a predetermined arrangement state, so that the first and second peripheral devices 201, 202) will be described.
  • the first peripheral device 201 may be an earphone
  • the second peripheral device 202 may be a smart phone.
  • the wearable device 100 may execute a video playback application.
  • the wearable device 100 may be playing video data stored in the memory 130 or video data received through the communication unit 180 .
  • the wearable device 100 may detect release of the wearing state of the wearable device. For example, while the wearable device 100 is running a video application, the user may put the wearable device 100 on the user's collar. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can
  • the wearable device 100 may detect a connectable peripheral device. For example, when the wearable device 100 detects that the wearing state of the wearable device 100 is released, the first and second peripheral devices 201 and 202 connectable within the Bluetooth communication range through the communication unit 180 are connected. can be detected.
  • the wearable device 100 may transmit a connection request signal to the first peripheral device 201 .
  • the wearable device 100 may receive a response signal from the first peripheral device 201 .
  • the wearable device 100 may be paired with the first peripheral device 201 based on a response signal received from the first peripheral device 201 .
  • the response signal received from the first peripheral device 201 may include information about the first peripheral device 201 (eg, device identification information, device type information, etc.).
  • the wearable device 100 may transmit a connection request signal to the second peripheral device 202 .
  • the wearable device 100 may receive a response signal from the second peripheral device 202 .
  • the wearable device 100 may be paired with the second peripheral device 202 based on a response signal received from the second peripheral device 202 .
  • the response signal received from the second peripheral device 202 may include information about the second peripheral device 202 (eg, device identification information, device type information, etc.).
  • the wearable device 100 may transmit a sound output request signal to the first peripheral device 201 .
  • the wearable device 100 may request a sound output from the first peripheral device 201 based on information about the first peripheral device 201 .
  • the wearable device 100 may transmit a sound output request signal including information about a function being executed (eg, information about a video being played).
  • the wearable device 100 may transmit an image output request signal to the second peripheral device 202 .
  • the wearable device 100 may request an image output from the second peripheral device 202 based on information about the second peripheral device 202 .
  • the wearable device 100 may transmit an image output request signal including information about a function being executed (eg, information about a video being played).
  • the wearable device 100 may stop outputting images and sounds.
  • the sound output unit 185) may stop the sound output, and the image output through the display 140 may be stopped.
  • the first peripheral device 201 may output a sound of a video being reproduced.
  • the first peripheral device 201 paired with the wearable device 100 may output a sound according to the execution of the video playback application of the wearable device 100 based on the sound output request signal.
  • the second peripheral device 202 may output an image of a video being reproduced.
  • the second peripheral device 202 paired with the wearable device 100 may output an image according to the execution of the video playback application of the wearable device 100 based on the image output request signal.
  • FIG. 9 is a flowchart illustrating another example in which the wearable device operates in conjunction with a peripheral device when the wearable device is released.
  • the wearable device 100 takes off the wearable device 100 and switches to a predetermined arrangement state.
  • the first peripheral device 201 may be an earphone
  • the second peripheral device 202 may be a smart phone.
  • the wearable device 100 may execute a conference application.
  • the wearable device 100 may be communicatively connected with other user devices according to the execution of the conference application.
  • the wearable device 100 may transmit/receive voice data to and from another user device through the communication unit 180 .
  • the wearable device 100 may detect release of the wearing state of the wearable device. For example, while the wearable device 100 is executing a meeting application, the user may take off the wearable device 100 and place it on a desk with the legs extended. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can
  • the wearable device 100 may identify an arrangement state of the wearable device.
  • the wearable device 100 is based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153, the arrangement state of the wearable device 100 is spaced apart from the user. It may be determined that the leg portion is in an unfolded state.
  • the wearable device 100 may detect a connectable peripheral device. For example, as the wearable device 100 identifies that the wearable device 100 is spaced apart from the user and the legs are unfolded, and the function being executed is a conference application, within the Bluetooth communication range through the communication unit 180 can detect the connectable first and second peripheral devices 201 and 202 .
  • the wearable device 100 may transmit a connection request signal to the first peripheral device 201 .
  • the wearable device 100 may receive a response signal from the first peripheral device 201 .
  • the wearable device 100 may be paired with the first peripheral device 201 based on a response signal received from the first peripheral device 201 .
  • the response signal received from the first peripheral device 201 may include information about the first peripheral device 201 (eg, device identification information, device type information, etc.).
  • the wearable device 100 may transmit a connection request signal to the second peripheral device 202 .
  • the wearable device 100 may receive a response signal from the second peripheral device 202 .
  • the wearable device 100 may be paired with the second peripheral device 202 based on a response signal received from the second peripheral device 202 .
  • the response signal received from the second peripheral device 202 may include information about the second peripheral device 202 (eg, device identification information, device type information, etc.).
  • the wearable device 100 may transmit a sound output request signal to the first peripheral device 201 .
  • the wearable device 100 may request a sound output from the first peripheral device 201 based on information about the first peripheral device 201 .
  • the wearable device 100 may transmit a sound output request signal including information on a function being executed (eg, information on a meeting application being executed).
  • the wearable device 100 may transmit an image output request signal to the second peripheral device 202 .
  • the wearable device 100 may request an image output from the second peripheral device 202 based on information about the second peripheral device 202 .
  • the wearable device 100 may transmit an image output request signal including information on a function being executed.
  • the wearable device 100 may stop sound output. According to an embodiment, in response to a request for sound output from the first peripheral device 201 , the wearable device 100 may stop sound output through the sound output unit 185 of the wearable device 100 .
  • the first peripheral device 201 may output a sound.
  • the first peripheral device 201 paired with the wearable device 100 may output a sound according to the execution of the conference application of the wearable device 100 based on the sound output request signal.
  • the second peripheral device 202 may output an image of the other party.
  • the second peripheral device 202 paired with the wearable device 100 may output an image according to the execution of the conference application of the wearable device 100 based on the image output request signal.
  • the wearable device 100 may control the user's image acquisition.
  • the wearable device 100 may control to acquire a user image by driving the camera module 175 .
  • the wearable device 100 may control the user's voice input.
  • the wearable device 100 may adjust the voice input volume to receive the user's voice input through the microphone 190 built in the wearable device 100 disposed to be spaced apart from the user by a predetermined distance.
  • FIG. 9 an operation example when the wearable device 100 is released from the worn state while the meeting application is running is described, but the present invention is not limited thereto.
  • the wearable device 100 is disconnected from the wearing state and the disposition state of the wearable device 100 is spaced apart from the user when a call is connected while the phone application is running, if it is determined that the leg portion is unfolded, the first , 2 It is possible to switch to the video call mode by using the peripheral devices (201, 202).
  • FIG. 10 is a flowchart illustrating an operation of the wearable device according to detecting the wearable state of the wearable device or the release of the wearing state according to an exemplary embodiment.
  • the wearable device 100 may acquire sensing information through the sensing unit 140 based on a predetermined time interval. The wearable device 100 determines whether the wearable device 100 is in a worn state or a worn state based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. It can be determined whether or not it has been released.
  • the wearable device 100 may acquire sensing information while operating in the wearing mode. According to an embodiment, when it is determined that the wearable device 100 is worn on the user's face, the wearable device 100 may operate in a wearing mode.
  • the wearing mode is a mode that operates in response to a predetermined user input or a predetermined control signal input when the user wears the wearable device 100 on the face part.
  • the wearable device 100 may acquire a combination of sensing information at predetermined time intervals through the sensing unit 140 when operating in the wearing mode.
  • the wearable device 100 may detect whether the wearing state is released based on a combination of the acquired sensing information.
  • the wearable device 100 may operate in a batch mode as the wearable state release is detected. According to an embodiment, the wearable device 100 may operate in a batch mode when the wearable state release is detected based on a combination of sensing information acquired through the sensing unit 140 .
  • the arrangement mode is a mode in which, when the user releases the wearable device 100 from the wearing state in which the wearable device 100 is worn on the face part, the user switches to a predetermined operation related to the function being executed in the wearing state and operates to be.
  • the wearable device 100 may switch to a predetermined operation related to the currently running function and operate. For example, the wearable device 100 may stop the image output through the display 140 and control the sound output through the sound output unit 185 based on the arrangement state.
  • video playback may be stopped. Thereafter, when the wearable device 100 operates in the wearing mode as the wearing state is detected, video playback may be resumed.
  • the wearable device 100 may acquire sensing information during the batch mode operation.
  • the wearable device 100 may acquire a combination of sensing information at a predetermined time interval through the sensing unit 140 .
  • the wearable device 100 may detect whether the wearable device is switched to a wearing state based on a combination of the acquired sensing information.
  • the wearable device 100 may operate in a wearing mode as the wearing state is detected. According to an embodiment, as the wearable device 100 detects that the wearable state has been switched to the wearing state based on the combination of the sensing information acquired through the sensing unit 140 , the wearable device 100 is in the worn state in relation to the function being operated in the deployment mode. It can be provided by converting it to a function that can be provided.
  • the wearable device 100 detects that a transition from a predetermined arrangement state to a worn state is detected while a video playback application is running, the wearable device 100 resumes outputting an image through the display 140 and based on the wearing state Thus, it is possible to control the sound output through the sound output unit 140 .
  • the wearable device 100 may automatically switch to the wearing mode or the deployed mode and operate by detecting whether the wearable device 100 is in the worn state or the deployed state. Accordingly, when the user puts on or takes off the wearable device 100 and arranges the wearable device 100 in a predetermined state, the currently executing function may be provided without a separate user input.
  • FIG. 11 is a block diagram of a wearable device and a peripheral device according to an exemplary embodiment.
  • the wearable device 100 may operate in conjunction with the peripheral device 200 .
  • the wearable device 100 may request the peripheral device 200 to perform at least some operations related to the function being executed.
  • the components of the wearable device 100 shown in FIG. 11 may correspond to the components of the wearable device 100 shown in FIG. 3 , so a description thereof will be omitted.
  • the peripheral device 200 illustrated in FIG. 11 may include a processor 220 , a memory 230 , a communication unit 280 , a display 240 , and a sound output unit 285 .
  • the components shown in FIG. 11 are not essential components of the peripheral device 200 .
  • the peripheral device 200 may be implemented by more components than the components shown in FIG. 11 , or the peripheral device 200 may be implemented by fewer components than the components shown in FIG. 11 .
  • the processor 220 may control the peripheral device 200 as a whole.
  • the processor 220 may include one or a plurality of processors.
  • the processor 220 according to an embodiment may execute one or more programs stored in the memory 230 .
  • the memory 230 may store various data, programs, or applications for driving and controlling the peripheral device 200 .
  • a program stored in the memory 230 may include one or more instructions.
  • a program (one or more instructions) or an application stored in the memory 230 may be executed by the processor 220 .
  • the memory 230 may store a program for processing and controlling the processor 220 .
  • Programs stored in the memory 230 may be classified into a plurality of modules according to their functions.
  • the communication unit 280 may include one or more components that allow communication between the peripheral device 200 and the wearable device 100 or between the peripheral device 200 and a server (not shown).
  • the communication unit 280 may include a short-distance communication unit and a mobile communication unit.
  • the short-distance communication unit includes a Bluetooth communication unit, a short-range wireless communication unit (NFC/RFID unit), a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, etc. may be included, but is not limited thereto.
  • the mobile communication unit transmits/receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.
  • the peripheral device 200 may receive an image output request signal from the wearable device 100 through the communication unit 280 . Also, the peripheral device 200 may receive a sound output request signal from the wearable device 100 through the communication unit 280 .
  • the display 240 displays and outputs information processed by the peripheral device 200 .
  • the display 240 outputs image data received from the communication unit 280 or stored in the memory 230 .
  • the display 240 may be used as an input device in addition to an output device.
  • the display 240 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display (3D). display) and at least one of an electrophoretic display.
  • the peripheral device 200 may include two or more displays 240 . In this case, two or more displays 240 may be disposed to face each other using a hinge.
  • the sound output unit 285 outputs audio data received from the communication unit 280 or stored in the memory 230 . Also, the sound output unit 285 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the peripheral device 200 .
  • the sound output unit 240 may include a speaker, a buzzer, and the like.
  • the above-described embodiment can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable medium.
  • the structure of the data used in the above-described embodiment may be recorded in a computer-readable medium through various means.
  • the above-described embodiment may be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer.
  • methods implemented as a software module or algorithm may be stored in a computer-readable recording medium as computer-readable codes or program instructions.
  • Computer-readable media may be any recording media that can be accessed by a computer, and may include volatile and nonvolatile media, removable and non-removable media.
  • the computer readable medium may include a magnetic storage medium, for example, a ROM, a floppy disk, a hard disk, etc. does not Additionally, computer-readable media may include computer storage media and communication media.
  • a plurality of computer-readable recording media may be distributed in network-connected computer systems, and data stored in the distributed recording media, for example, program instructions and codes may be executed by at least one computer. have.
  • ...unit and “module” mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.
  • Part and module are stored in an addressable storage medium and may be implemented by a program that can be executed by a processor.
  • part and module refer to components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and programs. It may be implemented by procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables.
  • A may include one of a1, a2, and a3" has a broad meaning that exemplary elements that may be included in the element A are a1, a2, or a3.
  • A may include a1, a2, or a3.
  • the above description does not necessarily mean that the elements constituting A are selectively determined within a predetermined set.
  • the above description is not necessarily to be construed as limiting that a1, a2, or a3 selected from the set including a1, a2 and a3 constitute component A.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Un dispositif portable comprend : au moins un capteur ; une mémoire stockant au moins une instruction ; et un processeur pour exécuter la ou les instructions. Le processeur peut : identifier l'état d'agencement du dispositif pouvant être porté en détectant que le dispositif portable a été libéré d'un état usé dans lequel le dispositif portable est porté sur le visage d'un utilisateur à l'aide du ou des capteurs ; identifier la fonction qui est exécutée par le dispositif vestimentaire lors de la détection du fait que le dispositif portable a été libéré de l'état porté ; et sur la base de la fonction qui est exécutée, commuter vers une opération prédéterminée correspondant à l'état d'agencement du dispositif pouvant être porté.
PCT/KR2021/008440 2020-07-09 2021-07-02 Dispositif pouvant être porté et son procédé d'exploitation WO2022010192A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2020-0084934 2020-07-09
KR1020200084934A KR20220006924A (ko) 2020-07-09 2020-07-09 웨어러블 디바이스 및 그 동작 방법

Publications (1)

Publication Number Publication Date
WO2022010192A1 true WO2022010192A1 (fr) 2022-01-13

Family

ID=79553300

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/008440 WO2022010192A1 (fr) 2020-07-09 2021-07-02 Dispositif pouvant être porté et son procédé d'exploitation

Country Status (2)

Country Link
KR (1) KR20220006924A (fr)
WO (1) WO2022010192A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023210961A1 (fr) * 2022-04-26 2023-11-02 삼성전자 주식회사 Dispositif à porter sur soi permettant de fournir une rétroaction différente en fonction de l'état de port, et procédé de commande associé
WO2024090896A1 (fr) * 2022-10-28 2024-05-02 삼성전자 주식회사 Dispositif électronique à porter sur soi comprenant une roue

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010079182A (ja) * 2008-09-29 2010-04-08 Nagoya Institute Of Technology ウェアラブル音認識装置
KR20140126027A (ko) * 2013-04-22 2014-10-30 엘지전자 주식회사 스마트 워치 및 제어 방법
KR20160007048A (ko) * 2014-07-10 2016-01-20 엘지전자 주식회사 전자 디바이스 및 그 제어방법
KR20160043321A (ko) * 2014-10-13 2016-04-21 현대자동차주식회사 웨어러블 디바이스를 이용한 차량 긴급 구난 서비스 제공 방법 및 시스템
KR20190048593A (ko) * 2017-10-31 2019-05-09 부산대학교 산학협력단 카메라 및 마이크를 이용한 스마트 미러 기반 개인 헬스케어 정보 보호 방법 및 시스템

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010079182A (ja) * 2008-09-29 2010-04-08 Nagoya Institute Of Technology ウェアラブル音認識装置
KR20140126027A (ko) * 2013-04-22 2014-10-30 엘지전자 주식회사 스마트 워치 및 제어 방법
KR20160007048A (ko) * 2014-07-10 2016-01-20 엘지전자 주식회사 전자 디바이스 및 그 제어방법
KR20160043321A (ko) * 2014-10-13 2016-04-21 현대자동차주식회사 웨어러블 디바이스를 이용한 차량 긴급 구난 서비스 제공 방법 및 시스템
KR20190048593A (ko) * 2017-10-31 2019-05-09 부산대학교 산학협력단 카메라 및 마이크를 이용한 스마트 미러 기반 개인 헬스케어 정보 보호 방법 및 시스템

Also Published As

Publication number Publication date
KR20220006924A (ko) 2022-01-18

Similar Documents

Publication Publication Date Title
WO2019147021A1 (fr) Dispositif de fourniture de service de réalité augmentée et son procédé de fonctionnement
WO2018038439A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2016060397A1 (fr) Procédé et appareil de traitement d'écran grâce à un dispositif
WO2016175412A1 (fr) Terminal mobile et son procédé de commande
WO2016036017A1 (fr) Terminal portatif et son procédé de commande
WO2016190458A1 (fr) Système et procédé d'affichage d'image virtuelle par un dispositif visiocasque (hmd)
WO2020159147A1 (fr) Dispositif électronique et procédé de commande d'objet graphique du dispositif électronique
WO2016064132A1 (fr) Dispositif portable, et procédé de transmission de contenu
WO2022010192A1 (fr) Dispositif pouvant être porté et son procédé d'exploitation
WO2020166911A1 (fr) Procédé d'utilisation d'écran et dispositif électronique le prenant en charge
WO2015194723A1 (fr) Terminal mobile et procédé de commande correspondant
WO2016182090A1 (fr) Terminal de type lunettes et son procédé de commande
WO2015174611A1 (fr) Terminal mobile et son procédé de commande
WO2015170832A1 (fr) Dispositif d'affichage, et procédé d'exécution d'appel vidéo correspondant
WO2021070982A1 (fr) Dispositif électronique de partage de contenu et procédé de commande correspondant
WO2020045862A1 (fr) Dispositif électronique et procédé de fourniture d'informations dans une réalité virtuelle
WO2016032039A1 (fr) Appareil pour projeter une image et procédé de fonctionnement associé
WO2020059925A1 (fr) Terminal mobile
WO2016093633A1 (fr) Procédé et dispositif d'affichage de contenu
WO2021230559A1 (fr) Dispositif électronique et procédé de fonctionnement associé
WO2015064935A1 (fr) Dispositif électronique et son procédé de commande
WO2019208915A1 (fr) Dispositif électronique pour acquérir une image au moyen d'une pluralité de caméras par ajustage de la position d'un dispositif extérieur, et procédé associé
WO2016024707A1 (fr) Terminal mobile et procédé de commande associé
WO2019177219A1 (fr) Dispositif optique et terminal mobile le comprenant
WO2022075686A1 (fr) Dispositif électronique et son procédé de fonctionnement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21838026

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21838026

Country of ref document: EP

Kind code of ref document: A1