WO2022010192A1

WO2022010192A1 - Wearable device and operation method therefor

Info

Publication number: WO2022010192A1
Application number: PCT/KR2021/008440
Authority: WO
Inventors: 윤상호; 고재우; 구본곤; 김도윤; 신성환; 김정원; 한순섭
Original assignee: 삼성전자 주식회사
Priority date: 2020-07-09
Filing date: 2021-07-02
Publication date: 2022-01-13
Also published as: KR20220006924A

Abstract

A wearable device comprises: at least one sensor; a memory storing at least one instruction; and a processor for executing the at least one instruction. The processor may: identify the arrangement state of the wearable device by detecting that the wearable device has been released from a worn state in which the wearable device is worn on a user's face by using the at least one sensor; identify the function being executed by the wearable device when detecting that the wearable device has been released from the worn state; and on the basis of the function being executed, switch to a predetermined operation corresponding to the arrangement state of the wearable device.

Description

Wearable device and its operation method

Various embodiments relate to a wearable device that switches some operations related to a function being executed when the wearable state of the wearable device is released, and an operation method thereof.

With the recent development of technology, various types of electronic devices that can be worn on the body have been developed. The augmented reality device enables viewing of a real scene and a virtual image together through a see-through display module disposed in front of the user's face while being worn on the user's face. Augmented reality is a technology that projects a virtual image onto a physical environment space of the real world or a real world object and displays it as a single image.

At least one sensor embedded in the augmented reality device may detect a wearing state of the augmented reality device, and when the user takes off the augmented reality device worn on the face, continuously in relation to a service being provided while wearing the augmented reality device There is a need for research on a method to provide a personalized service.

An object of the present invention is to provide a wearable device for identifying a wearing state or a disposition state of the wearable device using a sensor embedded in the wearable device, and an operating method thereof.

Another object of the present invention is to provide a wearable device for switching some operations related to a function being executed when the wearing state of the wearable device is released, and a method of operating the same.

The technical problem to be solved is not limited to the technical problems as described above, and other technical problems may exist.

A wearable device according to an aspect includes at least one sensor, a memory for storing one or more instructions, and a processor for executing one or more instructions, wherein the processor includes the wearable device using the at least one sensor. Identifies the arrangement state of the wearable device as it detects that it is released from the wearing state worn on the face part, identifies the function that the wearable device is executing when detecting that it is released from the wearing state, and determines the arrangement of the wearable device based on the running function It can be switched to a predetermined action corresponding to the state.

A method of operating a wearable device according to another aspect includes the steps of identifying the arrangement state of the wearable device by detecting that the wearable device is released from the wearing state worn on the user's face using at least one sensor, releasing from the wearing state The method may include identifying a function that is being executed by the wearable device when detecting that the wearable device is executing, and switching to a predetermined operation corresponding to an arrangement state of the wearable device based on the function being executed.

According to another aspect, it is possible to provide a computer-readable recording medium in which a program for executing the above-described method in a computer is recorded.

1 is a diagram for describing sensors embedded in a wearable device according to an exemplary embodiment.

2 is a diagram for explaining examples of arrangement states of wearable devices.

3 is a block diagram of a wearable device according to an embodiment.

4 is a flowchart illustrating an operation of a wearable device according to an exemplary embodiment.

5 is a flowchart illustrating an example in which the wearable device operates when the wearable device is released.

6 is a flowchart illustrating another example in which the wearable device operates when the wearable device is released.

7 is a diagram for explaining an example of a peripheral device capable of interworking with a wearable device according to an embodiment.

8 is a flowchart illustrating an example in which the wearable device operates in conjunction with a peripheral device when the wearable device is released.

9 is a flowchart illustrating another example in which the wearable device operates in conjunction with a peripheral device when the wearable device is released.

10 is a flowchart illustrating an operation of the wearable device according to detecting the wearable state of the wearable device or the release of the wearing state according to an exemplary embodiment.

11 is a block diagram of a wearable device and a peripheral device according to an exemplary embodiment.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be implemented in several different forms and is not limited to the embodiments described herein. In addition, in order to clearly explain the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

The terms used in the present disclosure have been described as general terms currently used in consideration of the functions mentioned in the present disclosure, but may mean various other terms depending on the intention or precedent of a person skilled in the art, the emergence of new technology, etc. can Therefore, the terms used in the present disclosure should not be construed only as the names of the terms, but should be interpreted based on the meaning of the terms and the contents of the present disclosure.

Also, terms such as first, second, etc. may be used to describe various components, but the components should not be limited by these terms. These terms are used for the purpose of distinguishing one component from another.

In addition, the terms used in the present disclosure are only used to describe specific embodiments, and are not intended to limit the present disclosure. Expressions in the singular include the plural meaning unless the context clearly implies the singular. In addition, throughout the specification, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element interposed therebetween. include Also, when a part "includes" a component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

As used herein, particularly in the claims, "the" and similar referents may refer to both the singular and the plural. Moreover, unless there is a description explicitly designating the order of steps describing a method according to the present disclosure, the described steps may be performed in an appropriate order. The present disclosure is not limited according to the description order of the described steps.

Phrases such as “in some embodiments” or “in one embodiment” appearing in various places in this specification are not necessarily all referring to the same embodiment.

Some embodiments of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented in various numbers of hardware and/or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors, or may be implemented by circuit configurations for a given function. Also, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented as an algorithm running on one or more processors. In addition, the present disclosure may employ prior art for electronic configuration, signal processing, and/or data processing, and the like. Terms such as “mechanism”, “element”, “means” and “configuration” may be used broadly and are not limited to mechanical and physical components.

In addition, the connecting lines or connecting members between the components shown in the drawings only exemplify functional connections and/or physical or circuit connections. In an actual device, a connection between components may be represented by various functional connections, physical connections, or circuit connections that are replaceable or added.

In the present disclosure, 'augmented reality (AR)' means showing a virtual image together in a physical environment space of the real world or showing a real object and a virtual image together.

In addition, the term 'Augmented Reality Device' refers to a device capable of expressing 'Augmented Reality', and is generally an augmented reality glasses device in the form of glasses worn by a user on a face part ( Augmented Reality Glasses), as well as a head mounted display device (HMD: Head Mounted Display Apparatus) worn on the head, and an augmented reality helmet (Augmented Reality Helmet).

Meanwhile, a 'real scene' is a scene of the real world that a user sees through the augmented reality device, and may include a real world object. Also, a 'virtual image' is an image generated through an optical engine and may include both a static image and a dynamic image. Such a virtual image is observed together with a real scene, and may be an image representing information about a real object in the real scene, information about an operation of an augmented reality device, or a control menu.

Therefore, a general augmented reality device uses an optical engine for generating a virtual image composed of light generated from a light source, and a transparent material to guide the virtual image generated by the optical engine to the user's eyes and view the scene in the real world together. A formed light guide plate (Waveguide) is provided. As described above, since the augmented reality device must be able to observe scenes in the real world as well, in order to guide the light generated by the optical engine to the user's eyes through the light guide plate, an optical element for changing the path of light having a basic straightness (Optical element) is required. In this case, the optical path may be changed by using reflection by a mirror or the like, or the optical path may be changed through diffraction by a diffraction element such as a diffractive optical element (DOE) or a holographic optical element (HOE), but is not limited thereto. .

According to an embodiment, the wearing state of the wearable device 100 may mean a state in which the user is wearing the wearable device 100 on the face part.

Also, according to an embodiment, the arrangement state of the wearable device 100 may mean a state in which the wearable device 100 is released from the worn state and arranged in a predetermined shape.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

The wearable device 100 according to an embodiment may be an augmented reality device. For example, as shown in FIG. 1 , the electronic device 100 may be a device implemented in the shape of glasses that can be worn on a user's face. In addition, the wearable device 100 may be a device implemented in the shape of goggles, a helmet, a hat, etc. including a see-through display module disposed in front of the user's eyes, but is not limited thereto.

According to an embodiment, the wearable device 100 may include a sensing unit 150 ( FIG. 3 ) including at least one sensor. At least one sensor may be mounted in a built-in form in a specific area of the wearable device 100 . The sensing unit 150 may include a pressure sensor 151 ( FIG. 3 ), a strain gauge 152 ( FIG. 3 ), and a bending sensor 153 ( FIG. 3 ).

The pressure sensor 151 is a sensor that measures pressure and converts the measurement result into an electrical signal and outputs it. When an object receives pressure, the pressure sensor 151 measures the pressure by using a characteristic that the portion receiving the pressure deforms or responds to the pressure.

According to an embodiment, the pressure sensor 151 is a pressure generated when a portion of the wearable device 100 directly touches the user's body while the wearable device 100 is worn on the user's face or disposed on the head. can be measured.

Referring to FIG. 1 , for example, the pressure sensor 151 extends over the nose supports 11 and 12 that come into contact with the user's nose and the user's ear when the wearable device 100 is worn by the user. Earrings may be built into the earring parts (13, 14).

The strain gauge 152 is a sensor that measures deformation when an object is deformed by an external force. The strain gauge 152 may be attached to or embedded in the surface of the object to measure the state and quantity of the deformation of the object. Strain represents the degree of deformation or strain, and means a value expressed as a ratio of the length increased or decreased with respect to the original length when an object is subjected to an external force. The strain gauge 152 detects the measured strain as an electrical signal.

According to an embodiment, the strain gauge 152 may measure a minute deformation generated by an external force applied to the wearable device 100 according to a wearing state or an arrangement state of the wearable device 100 .

Referring to FIG. 1 , for example, the strain gauge 152 may be embedded in the lens frame lower ends 21 and 22 , the lens frame upper ends 23 and 24 , and the

legs

25 and 26 of the wearable device 100 . can

The bending sensor 153 is a sensor that measures the degree of bending of an object. The bending sensor 153 measures the bending degree by using the characteristic that the resistance value varies according to the bending degree of the object.

According to an embodiment, the bending sensor 153 may measure the folding or unfolding of the leg portion of the wearable device 100 .

Referring to FIG. 1 , for example, the bending sensor 153 may be embedded in the connecting

parts

31 and 32 including a hinge connecting the leg part of the wearable device 100 and the lens frame.

The wearable device 100 may identify a wearing state or an arrangement state of the wearable device 100 based on a combination of each sensing information obtained from the pressure sensor 151, the strain gauge 152, and the bending sensor 153. have.

According to an embodiment, by appropriately disposing a plurality of sensors at various positions of the wearable device 100 , the wearable device 100 may accurately determine a wearing state or an arrangement state of the wearable device 100 .

FIG. 1 is a diagram illustrating the wearable device 100 according to an embodiment, but is not limited thereto.

FIG. 2 shows examples of arrangement states 202-208 in which the wearable device is released from the wearing state 201 in which the wearable device is being worn on the face part and arranged in a predetermined shape.

According to an embodiment, the wearing state of the wearable device 100 means a state in which the user is wearing the wearable device 100 on the face part.

Also, according to an embodiment, the arrangement state of the wearable device 100 means a state in which the wearable device 100 is released from the worn state and arranged in a predetermined shape.

Referring to FIG. 2 , for example, the user may take off the wearable device 100 worn on the face and put it over the head or the nape of the neck.

According to an embodiment, the state arranged on the user's head includes a state in which the legs of the wearable device 100 are spread over the upper part of the forehead of the user 202 and a state in which the legs of the wearable device 100 are spread over the nape of the user 203 ) and the like.

Also, for example, the user may take off the wearable device 100 being worn on the face and put it on a clothes pocket or collar.

According to an embodiment, the state arranged on the user's clothes may include a state 204 draped over the user's collar in a state where the leg portion of the wearable device 100 is folded, a state 205 draped over the clothes pocket, and the like. have.

Also, for example, the user may take off the wearable device 100 that is being worn on the face and put it on the desk.

According to an embodiment, the state in which the legs are spaced apart from the user and arranged in an unfolded state is a state in which the lower end of the lens frame is placed in contact with the floor in a state in which the legs of the wearable device 100 are unfolded ( 206 ), and the upper end of the lens frame is placed on the floor. It may include a state 207 placed in contact with the .

Also, for example, the user may take off the wearable device 100 being worn on the face and put it on the desk with the legs folded.

According to an embodiment, the state in which the legs are separated from the user and arranged in a folded state is a state in which the legs of the wearable device 100 are placed on the floor in a folded state 208 , a state in which the legs are stored in a case in a folded state, etc. may include

FIG. 2 is illustrated to explain a wearing state or an arrangement state according to various embodiments, but is not limited thereto.

3 is a block diagram of a wearable device according to an embodiment.

According to an embodiment, the wearable device 100 may be an augmented reality device that provides an augmented reality image having a communication function and a data processing function, but is not limited thereto.

Referring to FIG. 3 , the wearable device 100 according to an embodiment includes a memory 130 and a processor 120 , a sensing unit 150 , a display 140 , a camera module 175 , a communication unit 180 , and a sound. It may include an output unit 185 , a vibration motor 187 , a microphone 190 , and a user input unit 195 . However, not all of the components shown in FIG. 3 are essential components of the wearable device 100 . The wearable device 100 may be implemented by more components than the components shown in FIG. 3 , or the wearable device 100 may be implemented by fewer components than the components shown in FIG. 3 .

The processor 120 of the wearable device 100 executes programs stored in the memory 130 , and thus the sensing unit 150 , the display 140 , the camera module 175 , the communication unit 180 , and the sound output unit 185 . ), the vibration motor 187 , the microphone 190 , the user input unit 195 , and the like can be generally controlled.

The memory 130 according to an embodiment may store a program to be executed by the processor 120 , and may store data input to or output from the wearable device 100 .

The memory 130 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , may include at least one type of storage medium among optical disks.

Programs stored in the memory 130 may be classified into a plurality of software modules according to their functions. For example, the wearing identification module 131 , the arrangement state identification mode 132 , the function identification module 133 , and the operation It may include a conversion module 134 and a peripheral device control module 135, but is not limited thereto, and may store some of them or further include other software modules.

Also, according to an embodiment, the memory 130 may store information about a combination of sensing information corresponding to a wearing state or an arrangement state of the wearable device 100 . The information on the combination of sensing information corresponding to the wearing state or the arrangement state, the wearable device 100 according to a combination of sensing information obtained from the pressure sensor 151, the strain gauge 152, and the bending sensor 153, respectively. Information used to determine the current state.

Information on a combination of sensing information corresponding to a wearing state or an arrangement state may be stored in the memory 130 in a table format. In addition, it may be stored in the memory 130 in the form of an algorithm for detecting a wearing state or an arrangement state corresponding to a combination of the sensing information obtained by the sensing unit 130 .

For example, information about a combination of sensing information corresponding to a wearing state or an arrangement state is mounted on the wearable device 100 in a wearing state or a predetermined arrangement state of the wearable device 100 as shown in the table below. It may include information on whether a valid sensing value is output from the plurality of sensors 11-14, 21-26, 31-32 (refer to FIG. 1). The table below includes information on the presence or absence of a sensed value, but is not limited thereto. The information about the combination of sensing information corresponding to the wearing state or the arrangement state may include a size of a sensing value that may be output by a plurality of sensors, respectively, and a range of the sensing value.

For example, the pressure sensor 151 disposed on the

nose support part

11, 12, FIG. 1, the pressure sensor 151 disposed on the

earring part

13, 14, FIG. 1, the

leg parts

25, 26, A valid sensing value is output from a plurality of sensors 11-14, 21-26, 31-32 (refer to FIG. 1) mounted on the wearable device 100 including the strain gauge 152 disposed in FIG. 1). At this time, it may be determined that the wearable device 100 is in a worn state.

In addition, for example, the effective sensing value of the strain gauge 152 disposed on the lower end of the lens frame (21, 22, FIG. 1) or the strain gauge 152 disposed on the upper end of the lens frame (23, 24, FIG. 1) is When the output and a valid sensing value are output from the strain gauge 152 disposed on the leg parts 25 and 26 ( FIG. 1 ), the leg part of the wearable device 100 is placed on the floor in an unfolded state (206 or 207 ) , FIG. 2) can be determined.

Also, for example, the strain gauge 152 disposed on the left lens frame 21 , 23 ( FIG. 1 ) of the wearable device 100 or the strain gauge 152 disposed on the right lens frame 22 , 24 ( FIG. 1 ) of the wearable device 100 . ), when a valid sensing value is output, it may be determined that the wearable device 100 is in a state disposed on the user's clothes. Referring to FIG. 2 , when the wearable device 100 is placed on the user's clothes, the wearable device 100 is mounted on either lens as a load is applied in the direction of either lens in the folded state. A valid sensed value may be output from the strain gauge 152 .

Alternatively, the effective first sensing value output from the strain gauge 152 disposed on the

left lens frame

21 , 23 , FIG. 1 of the wearable device 100 and the

right lens frame

22 , 24 with FIG. 1 ) When the difference between the effective second sensing values output from the strain gauge 152 is equal to or greater than a predetermined value, it may be determined that the wearable device 100 is placed on the user's clothes.

The processor 120 controls the overall operation of the wearable device 100 . The processor 120 may control an operation or function performed by the wearable device 100 by executing instructions or programs stored in the memory 130 .

According to an embodiment, the processor 120 may include one or a plurality of processors. The processor 120 is, for example, a central processing unit (Central Processing Unit), a microprocessor (microprocessor), a graphic processor (Graphic Processing Unit), ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), and FPGAs (Field Programmable Gate Arrays) may be configured of at least one hardware, but is not limited thereto.

By executing the wearing identification module 131 stored in the memory 130 , the processor 120 may identify whether the wearable device 100 is in the wearing state worn on the user's face part or the wearing state is released.

The wearable device 100 may determine the wearing state by using the sensing unit 150 . The wearable device 100 may determine whether the wearable device 100 is in the wearing state or the wearing state is released based on a combination of sensing information acquired using the sensing unit 150 based on a preset time interval. .

The processor 120 wears the wearable device 100 by using a combination of sensing information obtained from the sensing unit 150 based on information on a combination of sensing information corresponding to the wearing state stored in advance in the memory 130 . State or wear state release may be identified.

According to an embodiment, the information on the combination of sensing information corresponding to the wearing state stored in advance in the memory 130 includes a plurality of sensors embedded in the wearable device 100 when the wearable device 100 is in the wearing state, respectively. It may include the presence or absence of a sensed value that can be output, the size of the sensed value, and the range of the sensed value.

According to an embodiment, the processor 120 receives the sensing information respectively obtained from the plurality of sensors included in the sensing unit 150 with information on a combination of the sensing information corresponding to the wearing state stored in advance in the memory 130 and can be compared The processor 120 determines that a combination of sensing information each obtained from a plurality of sensors included in the sensing unit 150 is stored in advance in the memory 130 within a predetermined range with information on a combination of sensing information corresponding to a wearing state. If it is determined that the wearable device 100 is similar, it may be determined that the user is wearing the wearable device 100 on the face part.

In addition, the processor 120 obtains sensing information from the sensing unit 150 based on a preset time interval, and the sensing information each obtained from a plurality of sensors included in the sensing unit 150 is stored in the memory 130 . If it is determined that the prestored information on the combination of the sensing information corresponding to the wearing state is not similar to the information within a predetermined range, the user may take off the wearable device 100 and determine that it is released from the wearing state.

According to an embodiment, the wearable device 100 may identify the placement state by executing the placement state identification module 132 upon determining that the wearing state of the wearable device 100 is released. Also, by executing the function identification module 133 , the wearable device 100 may identify a function that is being executed by the wearable device 100 when the wearable device is released from the wearing state. In addition, the wearable device 100 may switch to a predetermined operation corresponding to the arrangement state of the wearable device 100 based on the currently executing function of the wearable device 100 by executing the operation conversion module 134 .

The processor 120 may identify the arrangement state of the wearable device 100 by executing the arrangement state identification module 132 stored in the memory 130 .

The processor 120 may identify the arrangement state of the wearable device 100 by detecting that the wearable device 100 is released from the wearing state worn on the user's face using the sensing unit 150 .

According to an embodiment, the arrangement state of the wearable device 100 may be a state arranged on the user's head, a state arranged on the user's clothes, a state arranged in a state where the leg portion is spread apart from the user, or It may include a state in which the leg part is disposed in a folded state while being spaced apart from the user, but is not limited thereto.

The processor 120 uses a combination of sensing information obtained from the sensing unit 150 based on information on a combination of sensing information corresponding to an arrangement state stored in advance in the memory 130 to arrange the wearable device 100 . status can be identified.

According to an embodiment, the information on the combination of sensing information corresponding to the arrangement state may be obtained from the pressure sensor 151 , the strain gauge 152 , and the bending sensor 153 disposed in the wearable device 100 , respectively. This is information for determining which arrangement state the wearable device 100 is currently in according to a combination of sensing information.

Information about a combination of sensing information corresponding to the arrangement state stored in advance in the memory 130 is valid that can be output by a plurality of sensors built in the wearable device 100 when the wearable device 100 is in a predetermined arrangement state, respectively. It may include the presence or absence of a sensed value, the size of the sensed value, and the range of the sensed value. In the predetermined arrangement state, a sensed value output from at least one sensor among a plurality of sensors built in the wearable device 100 indicates a valid sensing value, and there is no sensed value output from another at least one sensor or is at 0 It can be an approximate value. For example, a sensor disposed at a position where pressure or external force will not be generated when the user wears the wearable device 100 on a collar, for example, a pressure sensor 151 disposed on the nose support portions 11 and 12 ( FIG. 1 ). ) may be a value close to 0.

The processor 120 may compare the sensing information each obtained from the plurality of sensors included in the sensing unit 150 with information on a combination of sensing information corresponding to the arrangement state previously stored in the memory 130 . For example, the processor 120 senses sensing values corresponding to a state in which sensing values obtained from a plurality of sensors included in the sensing unit 150 are stored in advance in the memory 130 and placed on the user's head. If it is determined that the information about the combination of information is similar to the information within a predetermined range, it may be determined that the information is in a state arranged on the user's head.

By executing the function identification module 133 stored in the memory 130 , the processor 120 may identify the function being executed by the wearable device 100 when detecting that the wearable device 100 is released from the worn state.

As the wearable device 100 senses that the wearable device 100 is released from the worn state by the wear identification module 131, the processor 120 determines which function is being executed when the wearable device 100 is released from the wearing state. .

For example, the wearable device 100 may be running a video playback application or a music playback application. Also, for example, the wearable device 100 may be in a communication connection state with the counterpart device while a conference application or a phone application is running.

When the processor 120 detects that the wearable device 100 is released from the worn state by executing the operation switching module 134 stored in the memory 130 , based on the function being executed, the arrangement state of the wearable device 100 . may be switched to a predetermined operation corresponding to .

According to an embodiment, when the wearable device 100 is released from the wearing state, the wearable device 100 performs the operation of the wearable device 100 to provide some functions based on the arrangement state of the functions that were being executed while being worn on the user's face. can be switched Accordingly, the wearable device 100 provides a use environment that provides a seamless service even when the user takes off the wearable device 100 and arranges it in a predetermined shape as well as when the user is wearing the wearable device 100. .

For example, when the wearable device 100 is released from the wearing state while the video playback application is running, the wearable device 100 may control the display to stop outputting the video of the video being played. In addition, the wearable device 100 may control the sound output unit 185 to change the sound output of the video being reproduced based on the arrangement state of the wearable device 100 identified by the arrangement state identification module 132. have. For example, as the wearable device 100 determines that it is placed on the user's head, by controlling the sound output unit 185, the sound output of the video being reproduced may be continued in the bone conduction method. . Also, for example, the wearable device 100 controls the sound output unit 185 based on the state of being placed on the user's collar so that the sound output of the video being reproduced can be continued through beamforming control. have.

Also, for example, if the user takes off the wearable device 100 and puts it on a desk while the user is in a voice conference with another user or while the conference application of the wearable device 100 is running, the wearable device 100 will switch to the video conference mode. can At this time, the wearable device 100 controls to obtain a user image by driving the built-in camera module 175, and uses the beamforming function of the microphone 190 to obtain the user's voice. can be controlled so that Also, the wearable device 100 may increase the sound output volume of the sound output unit 185, for example, a speaker.

Also, for example, if the user takes off the wearable device 100 and puts it on a desk while the user is in a voice call with another user or while the phone application of the wearable device 100 is running, the wearable device 100 will switch to the video call mode. can

Also, for example, the wearable device 100 may switch the alarm function of the wearable device 100 to the vibration mode as it is determined that the wearing state of the wearable device 100 is released. The wearable device 100 may provide an alarm as vibration by controlling the vibration motor 187 .

Also, for example, when the wearable device 100 is identified as being placed on the floor in a folded state, the wearable device 100 controls to switch to a power saving mode, thereby controlling to operate only a preset minimum function. have. Also, when the wearable device 100 is identified as being placed on the floor with the legs of the wearable device 100 folded, the wearable device 100 may control the power of the wearable device 100 to be turned off.

By executing the peripheral device control module 135 stored in the memory 130 , the processor 120 detects peripheral devices connectable to the wearable device 100 when it is detected that the wearable device 100 is released from the worn state, and You can control the device.

According to an embodiment, when the wearable device 100 detects that the wearable device is released from the wearing state, the wearable device 100 controls the peripheral device to perform at least some operations related to the function being executed, so that the peripheral device that is interworking or connectable with the wearable device 100 performs can According to an embodiment, the peripheral device may be a smart phone, a smart watch, a wireless earphone, a tablet, a PC, a TV, and the like, but is not limited thereto.

For example, the wearable device 100 may detect that the wearing state is released by the wearing identification module 131 while executing the video playback application, and detect a connectable nearby smart phone. By executing the peripheral device control module 135 , the wearable device 100 may transmit information about a video being reproduced to the smart phone and control to continue outputting the image through the display of the smart phone. Also, when the user is wearing the wireless earphone, the wearable device 100 may control to continue the sound output of the video being played through the wireless earphone.

Also, for example, the wearable device 100 detects that the wearing state is released by the wearing identification module 131 while the meeting application is running, and the arrangement state of the wearable device 100 by the placement state identification module 132 is detected, the wearable device 100 may switch to a video conference mode. The wearable device 100 may detect a connectable nearby smart phone by executing the peripheral device control module 135 and communicate with the smart phone. The wearable device 100 may control a video conference-related recommended application to be displayed through the display of the smart phone. Also, the wearable device 100 may control to output an image of the other party through the display of the smart phone. Also, when the user is wearing the wireless earphone, the wearable device 100 may control to output a sound through the wireless earphone.

The sensing unit 150 may include a pressure sensor 151 , a strain gauge 152 , a bending sensor 153 , a motion sensor 155 , and a gaze tracking sensor 157 . Since the pressure sensor 151 , the strain gauge 152 , and the bending sensor 153 have been described above with reference to FIG. 1 , they will be omitted.

The motion sensor 155 may be an Inertial Measurement Unit (IMU). The IMU may be a combination of sensors configured to detect movement of an object in three-dimensional space, ie, changes in position and orientation. For example, the combination of sensors may include an accelerometer, a gyroscope, a geomagnetometer, and a gyroscope.

Also, the motion sensor 150 may include at least one of an acceleration sensor, a magnetic sensor, and a gyroscope sensor.

The gaze tracking sensor 160 may detect gaze information of the user's eyes. According to an embodiment, the gaze information may include at least one of a gaze direction viewed by the user's eye, a pupil position of the user's eye, or coordinates of a center point of the pupil.

The eye tracking sensor 160 may provide light to the user's eye (a left eye or a right eye) and sense the amount of light reflected from the user's eye. The eye tracking sensor 160 may detect a gaze direction of the user's eye, a pupil position of the user's eye, coordinates of a center point of the pupil, and the like, based on the detected amount of light.

Alternatively, the eye tracking sensor 160 may provide light to the user's eyes and photograph the user's eyes. The eye tracking sensor 160 may detect a gaze direction of the user's eye, a pupil position of the user's eye, coordinates of a center point of the pupil, and the like, based on the captured user's eye image.

The display 140 may output information processed by the processor 120 . For example, the display 140 may display a virtual object.

According to an embodiment, the display 140 may provide an augmented reality (AR) image. The display 140 according to an embodiment may include a waveguide and a display module. The wave guide may be made of a transparent material through which a partial region of the rear surface is visible when the user wears the wearable device 100 . The wave guide may be composed of a flat plate having a single-layer or multi-layer structure made of a transparent material through which light is reflected and propagated therein. The wave guide may receive the light of the virtual image projected to face the emission surface of the display module. Here, the transparent material means a material through which light can pass, the transparency may not be 100%, and it may have a predetermined color.

In an embodiment, as the wave guide is formed of a transparent material, the user can see the virtual object of the virtual image through the display 140 as well as the external real scene, so that the wave guide is see-through. It may be referred to as a see through display. The display 140 may provide an augmented reality image by outputting a virtual object of a virtual image through the wave guide.

The camera module 175 may photograph the surroundings of the wearable device 100 . The camera module 175 may acquire an image frame, such as a still image or a moving picture, through an image sensor when an application requesting a photographing function is executed.

The image captured through the image sensor may be processed through the processor 120 or a separate image processing unit (not shown). Also, the captured image may be displayed on the display 140 .

In addition, the image frame processed by the processor 120 or a separate image processing unit (not shown) may be stored in the memory 130 or transmitted to the outside through the communication unit 180 . Two or more camera modules 175 may be provided depending on the configuration of the wearable device 100 . The camera module 175 may be, for example, an RGB-Depth camera capable of acquiring an RGB image and depth information.

The communication unit 180 may include one or more components that enable communication between the wearable device 100 and the peripheral device 200 ( FIG. 11 ) or a server (not shown).

For example, the communication unit 180 may include a short-distance communication unit and a mobile communication unit.

The short-distance communication unit includes a Bluetooth communication unit, a short-range wireless communication unit (NFC/RFID unit), a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared (IrDA) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, etc. may be included, but is not limited thereto.

The mobile communication unit transmits/receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

According to an embodiment, the wearable device 100 may transmit a request signal to the peripheral device 200 to perform some operation related to a function being executed in the wearable device 100 through the communication unit 180 .

The sound output unit 185 outputs audio data received from the communication unit 180 or stored in the memory 130 . Also, the sound output unit 185 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the wearable device 100 .

The sound output unit 185 according to an embodiment may include a speaker, a buzzer, and the like. The sound output unit 185 according to an embodiment may be implemented in the form of an earphone mounted on the wearable device 100 or detachable. Also, the sound output unit 185 according to an embodiment may output sound in a bone conduction method.

The sound output unit 185 according to an embodiment may output a sound of a video being played while a video playback application is running. Also, for example, the sound output unit 185 may output the sound of the meeting counterpart while the meeting application is running.

The vibration motor 187 may output a vibration signal. For example, the vibration motor 187 may output a vibration signal corresponding to the output of audio data or video data (eg, a call signal reception sound, a message reception sound, etc.). Also, the vibration motor 187 may output a vibration signal when a user input is received from the user input unit 195 .

The vibration motor 187 according to an embodiment may provide a notification as vibration when the wearable device 100 operates in a vibration mode. Also, the vibration motor 187 may provide vibration according to the music rhythm when the wearable device 100 is playing music according to the execution of the music application.

The microphone 190 receives an external sound signal and processes it as electrical voice data. For example, the microphone 190 may receive an acoustic signal from an external device or a speaker. Also, the microphone 190 may receive a user's voice input for controlling the wearable device 100 .

The microphone 190 may use various noise removal algorithms for removing noise generated in the process of receiving an external sound signal.

The microphone 190 according to an embodiment may receive a user's voice while the wearable device 100 is executing a meeting application.

The user input unit 195 means a means for a user to input data for controlling the wearable device 100 . For example, the user input unit 195 may include a key pad, a dome switch, and a touch pad (contact capacitance method, pressure resistance film method, infrared sensing method, surface ultrasonic conduction method, integral type). It may include at least one of a tension measurement method, a piezo effect method, etc.), a jog wheel, or a jog switch, but is not limited thereto.

In S401 of FIG. 4 , the wearable device 100 detects that the wearable device 100 is released from the wearing state worn on the user's face using at least one sensor, and identifies the arrangement state of the wearable device 100 can do.

According to an embodiment, the wearable device 100 is based on a combination of sensing information obtained from at least one of the pressure sensor 151 ( FIG. 3 ), the strain gauge 152 ( FIG. 3 ), or the bending sensor 153 ( FIG. 3 ). Thus, it is possible to detect whether the wearable device 100 is in a worn state worn on the face of the user or is released from the worn state.

The wearable device 100 determines that the wearable device 100 is being worn on the face of the user based on a comparison of the information on the combination of the acquired sensing information and the sensing information corresponding to the wearing state stored in advance in the memory 130 . It can be determined whether the wearing state is worn.

In addition, when it is determined that the wearable device 100 is released from the worn state worn on the user's face based on the combination of the acquired sensing information, the wearable device 100 determines which arrangement state the wearable device 100 is in can do.

The wearable device 100 may determine the arrangement state of the wearable device 100 based on a comparison of the information on the combination of the acquired sensing information and the sensing information corresponding to the arrangement state previously stored in the memory 130 . have. For example, based on the combination of the acquired sensing information, the wearable device 100 is placed on the user's head, placed on the user's clothes, spaced apart from the user, and the legs are unfolded. It can be identified whether the arranged state or the arranged state in a state in which the legs are folded apart from the user.

In S402 of FIG. 4 , when detecting that the wearable device 100 is released from the worn state, the wearable device 100 may identify a function that is being executed.

According to an embodiment, as the wearable device 100 detects that the wearable device is released from the worn state, it is possible to identify which function the wearable device 100 is executing at the time when the wearable device 100 detects that the wearable state is released.

For example, the wearable device 100 may be running a video playback application. Also, for example, the wearable device 100 may be in a communication connection state with the counterpart device while the conference application is running.

In S403 of FIG. 4 , the wearable device 100 may switch to a predetermined operation corresponding to the arrangement state of the wearable device 100 based on the function being executed.

According to an embodiment, the wearable device 100 may continuously provide at least some of the functions being executed when it is detected that the wearable device 100 is released from the worn state, even in the deployed state, depending on the deployment state. can be converted into action.

For example, as the wearable device 100 detects that the wearing state is released while a video is being played, the image output of the display 140 is stopped, while the wearable device 100 is disposed in a bone conduction method, etc. The sound output unit 185 may be controlled to continue the sound output of the video.

In FIG. 5 , when a user is watching a video while wearing the wearable device 100, an example in which the operation of the wearable device 100 is switched as the user takes off the wearable device 100 and switches to a predetermined arrangement state will be described. .

In S501 of FIG. 5 , the wearable device 100 may execute a video playback application. The wearable device 100 may be playing video data stored in the memory 130 or video data received through the communication unit 180 .

In S502 of FIG. 5 , the wearable device 100 may detect the wear state release. For example, the user may put the wearable device 100 above the head and put it on the head. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can

In S503 of FIG. 5 , the wearable device 100 may identify an arrangement state of the wearable device 100 . For example, the wearable device 100 is placed on the user's head based on a combination of sensing information obtained from at least one of the pressure sensor 151 , the strain gauge 152 , and the bending sensor 153 . state can be determined.

In S504 of FIG. 5 , the wearable device 100 may stop outputting an image of a video being reproduced. As the wearable device 100 is released from the wearing state worn on the user's face, the wearable device 100 may stop the operation of outputting an image through the display 140 of the video being reproduced.

In S505 of FIG. 5 , the wearable device 100 may control the sound output based on the arrangement state. As the wearable device 100 identifies that the wearable device 100 is placed on the user's head, the sound output operation through the sound output unit 185 of the video being reproduced continues in a bone conduction method. can be controlled

In FIG. 6 , when the user wears the wearable device 100 and a meeting is in progress through the execution of the meeting application, the wearable device 100 is switched as the user takes off the wearable device 100 and switches to a predetermined arrangement state. An example is explained.

In S601 of FIG. 6 , the wearable device 100 may execute a conference application. A user wearing the wearable device 100 may be conducting a voice conference while being connected to another user device through the communication unit 180 .

In S602 of FIG. 6 , the wearable device 100 may detect the wear state release. For example, the user may take off the wearable device 100 and place it on the desk with the legs extended. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can

In S603 of FIG. 6 , the wearable device 100 may identify an arrangement state of the wearable device. The wearable device 100 is spaced apart from the user based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, or the bending sensor 153, and the leg portion is arranged in an unfolded state. can judge

In S604 of FIG. 6 , the wearable device 100 may control acquisition of a user image based on an arrangement state. The wearable device 100 may acquire a user image by driving the camera module 175 . The wearable device 100 may output a message requesting a direction change, a height change, an angle change, etc. in which the wearable device 100 is disposed to obtain a face image of the user through the sound output unit 185 .

In S605 of FIG. 6 , the wearable device 100 may control the user's voice input based on the arrangement state. The wearable device 100 may adjust the voice input volume to receive the user's voice input through the microphone 190 built in the wearable device 100 disposed to be spaced apart from the user by a predetermined distance.

In S606 of FIG. 6 , the wearable device 100 may control the sound output based on the arrangement state. The wearable device 100 may adjust the voice output volume so that the user can hear the voice of another user output through the sound output unit 185 built in the wearable device 100 disposed at a predetermined distance from the user. have.

6 illustrates an example of operation when the wearable device 100 is released from the worn state while the conference application is running, but is not limited thereto. For example, if the wearable device 100 is disconnected from the wearing state and the disposition state of the wearable device 100 is separated from the user and the leg portion is unfolded when a call is connected while the phone application is running, video call mode can be switched.

According to an embodiment, the wearable device 100 may operate in conjunction with the peripheral device 200 ( FIG. 11 ) through the communication unit 180 . For example, the peripheral device 200 may be an earphone 201 , a smartphone 202 , a smart watch 203 , a notebook computer 204 , a tablet 205 , a TV 206 , and the like, but is not limited thereto. .

For example, the wearable device 100 may be interworking with at least one peripheral device 200 within a Bluetooth communication range. Also, for example, the wearable device 100 may search for at least one peripheral device 200 within a Bluetooth communication range and request a connection.

According to an embodiment, when the wearable device 100 detects that the wearable device 100 is released from the worn state, the wearable device 100 interlocks at least one operation related to the function being executed with the wearable device 100 . At least one peripheral device 200 in operation or connectable may be controlled to perform.

In FIG. 8 , when the user is watching a video while wearing the wearable device 100, the wearable device 100 takes off the wearable device 100 and switches to a predetermined arrangement state, so that the first and second peripheral devices 201, 202) will be described. For example, the first peripheral device 201 may be an earphone, and the second peripheral device 202 may be a smart phone.

In S801 of FIG. 8 , the wearable device 100 may execute a video playback application. The wearable device 100 may be playing video data stored in the memory 130 or video data received through the communication unit 180 .

In S802 of FIG. 8 , the wearable device 100 may detect release of the wearing state of the wearable device. For example, while the wearable device 100 is running a video application, the user may put the wearable device 100 on the user's collar. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can

In S803 of FIG. 8 , the wearable device 100 may detect a connectable peripheral device. For example, when the wearable device 100 detects that the wearing state of the wearable device 100 is released, the first and second

peripheral devices

201 and 202 connectable within the Bluetooth communication range through the communication unit 180 are connected. can be detected.

In S804 of FIG. 8 , the wearable device 100 may transmit a connection request signal to the first peripheral device 201 . In S805 , the wearable device 100 may receive a response signal from the first peripheral device 201 . The wearable device 100 may be paired with the first peripheral device 201 based on a response signal received from the first peripheral device 201 . For example, the response signal received from the first peripheral device 201 may include information about the first peripheral device 201 (eg, device identification information, device type information, etc.).

Also, in S806 , the wearable device 100 may transmit a connection request signal to the second peripheral device 202 . In S807 , the wearable device 100 may receive a response signal from the second peripheral device 202 . The wearable device 100 may be paired with the second peripheral device 202 based on a response signal received from the second peripheral device 202 . For example, the response signal received from the second peripheral device 202 may include information about the second peripheral device 202 (eg, device identification information, device type information, etc.).

In S808 of FIG. 8 , the wearable device 100 may transmit a sound output request signal to the first peripheral device 201 . According to an embodiment, the wearable device 100 may request a sound output from the first peripheral device 201 based on information about the first peripheral device 201 . The wearable device 100 may transmit a sound output request signal including information about a function being executed (eg, information about a video being played).

In S809 of FIG. 8 , the wearable device 100 may transmit an image output request signal to the second peripheral device 202 . According to an embodiment, the wearable device 100 may request an image output from the second peripheral device 202 based on information about the second peripheral device 202 . The wearable device 100 may transmit an image output request signal including information about a function being executed (eg, information about a video being played).

In S810 of FIG. 8 , the wearable device 100 may stop outputting images and sounds. According to an embodiment, as the wearable device 100 requests a sound output to the first peripheral device 201 and an image output is requested to the second peripheral device 202, the sound output unit ( 185) may stop the sound output, and the image output through the display 140 may be stopped.

In S811 of FIG. 8 , the first peripheral device 201 may output a sound of a video being reproduced. According to an embodiment, the first peripheral device 201 paired with the wearable device 100 may output a sound according to the execution of the video playback application of the wearable device 100 based on the sound output request signal.

Also, in S812 , the second peripheral device 202 may output an image of a video being reproduced. According to an embodiment, the second peripheral device 202 paired with the wearable device 100 may output an image according to the execution of the video playback application of the wearable device 100 based on the image output request signal.

In FIG. 9 , when a user is in a voice conference with another user while wearing the wearable device 100 , the wearable device 100 takes off the wearable device 100 and switches to a predetermined arrangement state. An example of operation in conjunction with the

devices

201 and 202 will be described. For example, the first peripheral device 201 may be an earphone, and the second peripheral device 202 may be a smart phone.

In S901 of FIG. 9 , the wearable device 100 may execute a conference application. The wearable device 100 may be communicatively connected with other user devices according to the execution of the conference application. The wearable device 100 may transmit/receive voice data to and from another user device through the communication unit 180 .

In S902 of FIG. 9 , the wearable device 100 may detect release of the wearing state of the wearable device. For example, while the wearable device 100 is executing a meeting application, the user may take off the wearable device 100 and place it on a desk with the legs extended. The wearable device 100 detects that the wearing state of the wearable device 100 is released based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. can

In S903 of FIG. 9 , the wearable device 100 may identify an arrangement state of the wearable device. The wearable device 100 is based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153, the arrangement state of the wearable device 100 is spaced apart from the user. It may be determined that the leg portion is in an unfolded state.

In S904 of FIG. 9 , the wearable device 100 may detect a connectable peripheral device. For example, as the wearable device 100 identifies that the wearable device 100 is spaced apart from the user and the legs are unfolded, and the function being executed is a conference application, within the Bluetooth communication range through the communication unit 180 can detect the connectable first and second

peripheral devices

201 and 202 .

In S905 of FIG. 9 , the wearable device 100 may transmit a connection request signal to the first peripheral device 201 . In S906 , the wearable device 100 may receive a response signal from the first peripheral device 201 . The wearable device 100 may be paired with the first peripheral device 201 based on a response signal received from the first peripheral device 201 . For example, the response signal received from the first peripheral device 201 may include information about the first peripheral device 201 (eg, device identification information, device type information, etc.).

Also, in S907 , the wearable device 100 may transmit a connection request signal to the second peripheral device 202 . In S908 , the wearable device 100 may receive a response signal from the second peripheral device 202 . The wearable device 100 may be paired with the second peripheral device 202 based on a response signal received from the second peripheral device 202 . For example, the response signal received from the second peripheral device 202 may include information about the second peripheral device 202 (eg, device identification information, device type information, etc.).

In S909 of FIG. 9 , the wearable device 100 may transmit a sound output request signal to the first peripheral device 201 . According to an embodiment, the wearable device 100 may request a sound output from the first peripheral device 201 based on information about the first peripheral device 201 . The wearable device 100 may transmit a sound output request signal including information on a function being executed (eg, information on a meeting application being executed).

In S910 of FIG. 9 , the wearable device 100 may transmit an image output request signal to the second peripheral device 202 . According to an embodiment, the wearable device 100 may request an image output from the second peripheral device 202 based on information about the second peripheral device 202 . The wearable device 100 may transmit an image output request signal including information on a function being executed.

In S911 of FIG. 9 , the wearable device 100 may stop sound output. According to an embodiment, in response to a request for sound output from the first peripheral device 201 , the wearable device 100 may stop sound output through the sound output unit 185 of the wearable device 100 .

In S912 of FIG. 9 , the first peripheral device 201 may output a sound. According to an embodiment, the first peripheral device 201 paired with the wearable device 100 may output a sound according to the execution of the conference application of the wearable device 100 based on the sound output request signal.

In S913 of FIG. 9 , the second peripheral device 202 may output an image of the other party. According to an embodiment, the second peripheral device 202 paired with the wearable device 100 may output an image according to the execution of the conference application of the wearable device 100 based on the image output request signal.

In S914 of FIG. 9 , the wearable device 100 may control the user's image acquisition. The wearable device 100 may control to acquire a user image by driving the camera module 175 .

In S915 of FIG. 9 , the wearable device 100 may control the user's voice input. The wearable device 100 may adjust the voice input volume to receive the user's voice input through the microphone 190 built in the wearable device 100 disposed to be spaced apart from the user by a predetermined distance.

In FIG. 9 , an operation example when the wearable device 100 is released from the worn state while the meeting application is running is described, but the present invention is not limited thereto. For example, when the wearable device 100 is disconnected from the wearing state and the disposition state of the wearable device 100 is spaced apart from the user when a call is connected while the phone application is running, if it is determined that the leg portion is unfolded, the first , 2 It is possible to switch to the video call mode by using the peripheral devices (201, 202).

According to an embodiment, the wearable device 100 may acquire sensing information through the sensing unit 140 based on a predetermined time interval. The wearable device 100 determines whether the wearable device 100 is in a worn state or a worn state based on a combination of sensing information obtained from at least one of the pressure sensor 151, the strain gauge 152, and the bending sensor 153. It can be determined whether or not it has been released.

In S1001 of FIG. 10 , the wearable device 100 may acquire sensing information while operating in the wearing mode. According to an embodiment, when it is determined that the wearable device 100 is worn on the user's face, the wearable device 100 may operate in a wearing mode.

According to an embodiment, the wearing mode is a mode that operates in response to a predetermined user input or a predetermined control signal input when the user wears the wearable device 100 on the face part. The wearable device 100 may acquire a combination of sensing information at predetermined time intervals through the sensing unit 140 when operating in the wearing mode. The wearable device 100 may detect whether the wearing state is released based on a combination of the acquired sensing information.

In S1002 of FIG. 10 , the wearable device 100 may operate in a batch mode as the wearable state release is detected. According to an embodiment, the wearable device 100 may operate in a batch mode when the wearable state release is detected based on a combination of sensing information acquired through the sensing unit 140 .

According to an embodiment, the arrangement mode is a mode in which, when the user releases the wearable device 100 from the wearing state in which the wearable device 100 is worn on the face part, the user switches to a predetermined operation related to the function being executed in the wearing state and operates to be.

For example, when the wearable device 100 detects that the wearing state is released while the video playback application is running, the wearable device 100 may switch to a predetermined operation related to the currently running function and operate. For example, the wearable device 100 may stop the image output through the display 140 and control the sound output through the sound output unit 185 based on the arrangement state.

Also, for example, when the wearable device 100 operates in the batch mode, video playback may be stopped. Thereafter, when the wearable device 100 operates in the wearing mode as the wearing state is detected, video playback may be resumed.

In S1003 of FIG. 10 , the wearable device 100 may acquire sensing information during the batch mode operation. When the wearable device 100 operates in the batch mode, the wearable device 100 may acquire a combination of sensing information at a predetermined time interval through the sensing unit 140 . The wearable device 100 may detect whether the wearable device is switched to a wearing state based on a combination of the acquired sensing information.

In S1004 of FIG. 10 , the wearable device 100 may operate in a wearing mode as the wearing state is detected. According to an embodiment, as the wearable device 100 detects that the wearable state has been switched to the wearing state based on the combination of the sensing information acquired through the sensing unit 140 , the wearable device 100 is in the worn state in relation to the function being operated in the deployment mode. It can be provided by converting it to a function that can be provided.

For example, as the wearable device 100 detects that a transition from a predetermined arrangement state to a worn state is detected while a video playback application is running, the wearable device 100 resumes outputting an image through the display 140 and based on the wearing state Thus, it is possible to control the sound output through the sound output unit 140 .

According to an embodiment, the wearable device 100 may automatically switch to the wearing mode or the deployed mode and operate by detecting whether the wearable device 100 is in the worn state or the deployed state. Accordingly, when the user puts on or takes off the wearable device 100 and arranges the wearable device 100 in a predetermined state, the currently executing function may be provided without a separate user input.

According to an embodiment, the wearable device 100 may operate in conjunction with the peripheral device 200 . The wearable device 100 may request the peripheral device 200 to perform at least some operations related to the function being executed.

The components of the wearable device 100 shown in FIG. 11 may correspond to the components of the wearable device 100 shown in FIG. 3 , so a description thereof will be omitted.

The peripheral device 200 illustrated in FIG. 11 may include a processor 220 , a memory 230 , a communication unit 280 , a display 240 , and a sound output unit 285 . However, the components shown in FIG. 11 are not essential components of the peripheral device 200 . The peripheral device 200 may be implemented by more components than the components shown in FIG. 11 , or the peripheral device 200 may be implemented by fewer components than the components shown in FIG. 11 .

The processor 220 according to an embodiment may control the peripheral device 200 as a whole. The processor 220 may include one or a plurality of processors. The processor 220 according to an embodiment may execute one or more programs stored in the memory 230 .

The memory 230 according to an embodiment may store various data, programs, or applications for driving and controlling the peripheral device 200 . A program stored in the memory 230 may include one or more instructions. A program (one or more instructions) or an application stored in the memory 230 may be executed by the processor 220 .

The memory 230 according to an embodiment may store a program for processing and controlling the processor 220 . Programs stored in the memory 230 may be classified into a plurality of modules according to their functions.

The communication unit 280 may include one or more components that allow communication between the peripheral device 200 and the wearable device 100 or between the peripheral device 200 and a server (not shown).

For example, the communication unit 280 may include a short-distance communication unit and a mobile communication unit.

According to an embodiment, the peripheral device 200 may receive an image output request signal from the wearable device 100 through the communication unit 280 . Also, the peripheral device 200 may receive a sound output request signal from the wearable device 100 through the communication unit 280 .

The display 240 displays and outputs information processed by the peripheral device 200 . The display 240 outputs image data received from the communication unit 280 or stored in the memory 230 .

When the display 240 and the touchpad form a layer structure to form a touch screen, the display 240 may be used as an input device in addition to an output device. The display 240 includes a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display (3D). display) and at least one of an electrophoretic display. Also, depending on the implementation form of the peripheral device 200 , the peripheral device 200 may include two or more displays 240 . In this case, two or more displays 240 may be disposed to face each other using a hinge.

The sound output unit 285 outputs audio data received from the communication unit 280 or stored in the memory 230 . Also, the sound output unit 285 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, and a notification sound) performed by the peripheral device 200 . The sound output unit 240 may include a speaker, a buzzer, and the like.

Meanwhile, the above-described embodiment can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable medium. In addition, the structure of the data used in the above-described embodiment may be recorded in a computer-readable medium through various means. In addition, the above-described embodiment may be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. For example, methods implemented as a software module or algorithm may be stored in a computer-readable recording medium as computer-readable codes or program instructions.

Computer-readable media may be any recording media that can be accessed by a computer, and may include volatile and nonvolatile media, removable and non-removable media. The computer readable medium may include a magnetic storage medium, for example, a ROM, a floppy disk, a hard disk, etc. does not Additionally, computer-readable media may include computer storage media and communication media.

In addition, a plurality of computer-readable recording media may be distributed in network-connected computer systems, and data stored in the distributed recording media, for example, program instructions and codes may be executed by at least one computer. have.

The specific implementations described in the present disclosure are merely exemplary, and do not limit the scope of the present disclosure in any way. For brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

The description of the present disclosure described above is for illustration, and those of ordinary skill in the art to which the present disclosure pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present disclosure. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The use of all examples or exemplary terms, for example, “etc.,” in the present disclosure is merely for the purpose of describing the present disclosure in detail, and unless limited by the claims, the scope of the present disclosure due to the examples or exemplary terminology. is not limited.

In addition, unless specifically stated as "essential", "importantly", etc., the components described in the present disclosure may not necessarily be components for the implementation of the present disclosure.

A person of ordinary skill in the art related to the embodiments of the present disclosure will understand that it may be implemented in a modified form without departing from the essential characteristics of the description.

As the present disclosure can apply various transformations and can have various embodiments, the present disclosure is not limited by the specific embodiments described in the specification, and all transformations and equivalents included in the spirit and scope of the present disclosure It should be understood that alternatives are included in the present disclosure. Therefore, the disclosed embodiments are to be understood in an illustrative rather than a restrictive sense.

The scope of the present disclosure is indicated by the claims rather than the detailed description of the invention, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present disclosure.

As used herein, terms such as “…unit” and “module” mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software.

“Part” and “module” are stored in an addressable storage medium and may be implemented by a program that can be executed by a processor.

For example, “part” and “module” refer to components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and programs. It may be implemented by procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, database, data structures, tables, arrays and variables.

In this specification, the description "A may include one of a1, a2, and a3" has a broad meaning that exemplary elements that may be included in the element A are a1, a2, or a3.

The above description is not necessarily limited to a1, a2, or a3 elements constituting the element A. Therefore, it should be noted that the elements constituting A are not exclusively interpreted as meaning excluding other elements not exemplified other than a1, a2, and a3.

In addition, the above description means that A may include a1, a2, or a3. The above description does not necessarily mean that the elements constituting A are selectively determined within a predetermined set. For example, it should be noted that the above description is not necessarily to be construed as limiting that a1, a2, or a3 selected from the set including a1, a2 and a3 constitute component A.

Claims

In a wearable device,

at least one sensor;

a memory storing one or more instructions; and

Including; a processor that executes the one or more instructions;

The processor is

Identifies the arrangement state of the wearable device by detecting that the wearable device is released from the wearing state worn on the user's face using the at least one sensor,

Identifies a function that the wearable device is executing when detecting that it is released from the wearing state,

and switching to a predetermined operation corresponding to an arrangement state of the wearable device based on the function being executed.
According to claim 1,

the at least one sensor,

A wearable device comprising at least one of a pressure sensor, a strain gauge, or a bend sensor.
According to claim 1,

the at least one sensor,

Built in at least one of the nose support part, the lens frame upper part, the lens frame lower part, the leg part, the connection part, and the earring part of the wearable device, a wearable device.
According to claim 1,

The arrangement state of the wearable device is,

A state arranged on the user's head, a state arranged on the user's clothes, a state spaced apart from the user and arranged in an unfolded state, or a state spaced apart from the user and arranged in a folded state A wearable device comprising a state.
According to claim 1,

Further comprising a communication unit,

The processor is

detecting peripheral devices connectable to the wearable device when it is detected that the wearable device is released from the wearing state;

A wearable device that controls the peripheral device to perform at least some operations related to the function being executed through the communication unit.
According to claim 1,

sound output unit; and

further comprising a display;

The processor is

When it is detected that the wearable device is released from the wearing state, the wearable device identifies that a video playback application is running, and controls the display to stop outputting an image of the video being played, and based on the arrangement state of the wearable device A wearable device for controlling the sound output unit to control the sound output of the video being reproduced.
According to claim 1,

sound output unit; and

and a microphone,

The processor is

When it is detected that the wearable device is released from the wearing state, the wearable device identifies that a conference application is running, and controls the sound output of the sound output unit and the voice input of the microphone based on the arrangement state of the wearable device. .
In the method of operating a wearable device,

identifying an arrangement state of the wearable device according to detecting that the wearable device is released from a worn state worn on the user's face using at least one sensor;

identifying a function that the wearable device is executing when detecting that the wearable device is released from the worn state; and

and switching to a predetermined operation corresponding to an arrangement state of the wearable device based on the function being executed.
9. The method of claim 8,

the at least one sensor,

A method of operation comprising at least one of a pressure sensor, a strain gauge, or a bend sensor.
9. The method of claim 8,

the at least one sensor,

Built in at least one of the nose support part, the lens frame upper part, the lens frame lower part, the leg part, the connection part, and the earring part of the wearable device, the operating method.
9. The method of claim 8,

The arrangement state of the wearable device is,

A state arranged on the user's head, a state arranged on the user's clothes, a state spaced apart from the user and arranged in an unfolded state, or a state spaced apart from the user and arranged in a folded state A method of operation comprising a state.
9. The method of claim 8,

detecting a peripheral device connectable to the wearable device when it is detected that the wearable device is released from the wearing state; and

and controlling the peripheral device so that the peripheral device performs at least some operations related to the function being executed.
9. The method of claim 8,

The step of switching to the predetermined operation comprises:

controlling the display to stop outputting an image of the currently playing video when it is detected that the wearable device is released from the wearing state and the wearable device identifies that a video playback application is being executed; and

and controlling the sound output unit to control the sound output of the video being reproduced based on the arrangement state of the wearable device.
9. The method of claim 8,

The step of switching to the predetermined operation comprises:

Controlling the sound output of the sound output unit and the voice input of the microphone based on the arrangement state of the wearable device as the wearable device identifies that the conference application is running when it is detected that the wearable device is being released from the wearing state to do, the way it works.
A computer-readable recording medium recording a program for executing the method of claim 8 on a computer.