WO2022182116A1

WO2022182116A1 - Wearable device and screen control method therefor

Info

Publication number: WO2022182116A1
Application number: PCT/KR2022/002633
Authority: WO
Inventors: 지동섭; 길광민; 이종민; 조명재
Original assignee: 삼성전자 주식회사
Priority date: 2021-02-25
Filing date: 2022-02-23
Publication date: 2022-09-01
Also published as: KR20220121565A

Abstract

An electronic device according to one embodiment of the present disclosure comprises: a wireless communication circuit; a display; a sensor, which is based on first, second and third axes that are orthogonal to each other, and has a plane which is formed by the first axis and the second axis and which is parallel to the screen of the display; and a processor electrically connected to the display, the wireless communication circuit, and the sensor, wherein the processor can be configured to: acquire, through the sensor, first inclination information including an inclination value changed with respect to an initial value of the third axis; receive, through the wireless communication circuit, second inclination information about the external electronic device from an external electronic device connected to enable communication with the electronic device, the second inclination information including an inclination value changed with respect to the initial value of a fourth axis of the external electronic device corresponding to the gaze direction of the user while the external electronic device is worn by the user; and determine whether to output the first content onto the screen on the basis of the angle between the third and fourth axes acquired by means of the first inclination information and the second inclination information.

Description

Wearable device and its screen control method

Embodiments disclosed in this document relate to a wearable device and a screen control method thereof.

A smart watch, which is a wearable device, may switch a screen from an off state to an on state as the smart watch detects a motion of the wrist worn by the smart watch. In this case, there may be cases where the screen does not turn on depending on the angle of rotation even though the user rotates the wrist to turn on the screen of the smart watch.

Alternatively, the smart watch may be maintained in an Always On Display state. However, if the display of the smart watch is always on, battery consumption may be large.

An object of the present invention is to provide a wearable device for more conveniently displaying the screen of a smart watch to a user by using a wireless earphone and displaying the screen in a user's desired direction, and an operating method thereof.

However, the problems to be solved in the present disclosure are not limited to the above-mentioned problems, and may be variously expanded without departing from the spirit and scope of the present disclosure.

An electronic device according to an embodiment of the present disclosure includes a wireless communication circuit, a display, a sensor based on first, second, and third axes orthogonal to each other, and a plane formed by the first axis and the second axis and a processor that is parallel to the screen of the display and electrically connected to the display, the wireless communication circuit, and the sensor, wherein the processor includes a gradient value changed from the initial value of the third axis through the sensor. 1 obtains tilt information, receives second tilt information of the external electronic device from an external electronic device connected to enable communication with the electronic device through the wireless communication circuit, and the second tilt information is transmitted by the external electronic device In a state worn by the user, the fourth axis of the external electronic device corresponding to the user's gaze direction includes a changed inclination value compared to an initial value, and is obtained by the first inclination information and the second inclination information. It may be configured to determine whether to output the first content on the screen based on an angle between the third axis and the fourth axis.

In a screen control method of an electronic device according to an embodiment of the present disclosure, first inclination information including a gradient value changed compared to an initial value of a third axis is obtained through a sensor of the electronic device, and the sensor is a first inclination value that is orthogonal to each other The first axis, the second axis, and the third axis are the reference, and a plane formed by the first axis and the second axis is parallel to the screen, and the external electronic Receive second tilt information of the device through a wireless communication circuit of the electronic device, and the second tilt information is the second tilt information of the external electronic device corresponding to the gaze direction of the user when the external electronic device is worn by the user It includes a gradient value changed from an initial value with respect to 4 axes, and an acute angle value formed between the third axis and the fourth axis is obtained based on the first inclination information and the second inclination information, and the acute angle value is a critical value When the value is less than or equal to the value, it may be configured to output the first content to the screen.

According to various embodiments of the present disclosure, by using a wireless earphone, it is possible to control the screen of the smart watch and control the display direction of the content according to the user's gaze, thereby improving the convenience of the user using the smart watch.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. will be.

1 is a perspective view of a front side of a mobile electronic device according to an exemplary embodiment;

FIG. 2 is a perspective view of a rear surface of the electronic device of FIG. 1 .

3 is an exploded perspective view of the electronic device of FIG. 1 .

4 is a block diagram of a first electronic device according to an exemplary embodiment.

5 is a flowchart illustrating an operation of a first electronic device according to an exemplary embodiment.

6 is a diagram illustrating a first electronic device according to an exemplary embodiment.

7 is a diagram illustrating a shape of a second electronic device according to an exemplary embodiment.

8 is a block diagram illustrating a configuration of a second electronic device according to an exemplary embodiment.

9 is a diagram for describing operations of a first electronic device and a second electronic device according to an exemplary embodiment.

10 is a flowchart illustrating an operation of a first electronic device according to an exemplary embodiment.

11 is a diagram for describing operations of a first electronic device and a second electronic device according to an exemplary embodiment.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives of the embodiments of the present invention are included.

1 and 2 , the first electronic device 100 according to an exemplary embodiment includes a first surface (or front) 110A, a second surface (or rear) 110B, and a first surface 110A. ) and a side surface 110C surrounding the space between the second surface 110B, the housing 110 is connected to at least a part of the housing 110 and the first electronic device 100 is connected to the user's body. It may include fastening

members

150 and 160 configured to be detachably attached to a portion (eg, wrist, ankle, etc.). In another embodiment (not shown), the housing may refer to a structure that forms part of the first surface 110A, the second surface 110B, and the side surface 110C of FIGS. 1 and 2 . According to an embodiment, the first surface 110A may be formed by the front plate 101 (eg, a glass plate including various coating layers or a polymer plate) at least a portion of which is substantially transparent. The second surface 110B may be formed by a substantially opaque back plate 107 . The back plate 107 is formed by, for example, coated or tinted glass, ceramic, polymer, metal (eg, aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the above materials. can be The side surface 110C is coupled to the front plate 101 and the rear plate 107 and may be formed by a side bezel structure (or "side member") 106 including a metal and/or a polymer. In some embodiments, the back plate 107 and the side bezel structure 106 are integrally formed and may include the same material (eg, a metal material such as aluminum). The

binding members

150 and 160 may be formed of various materials and shapes. A woven fabric, leather, rubber, urethane, metal, ceramic, or a combination of at least two of the above materials may be used to form an integral and a plurality of unit links to be able to flow with each other.

According to an embodiment, the first electronic device 100 includes a display 120 (refer to FIG. 3 ),

audio modules

105 and 108 , a sensor module 111 ,

key input devices

102 , 103 , 104 , and a connector. At least one of the holes 109 may be included. In some embodiments, the first electronic device 100 omits at least one of the components (eg, the

key input device

102 , 103 , 104 , the connector hole 109 , or the sensor module 111 ) or Other components may be additionally included.

The display 120 may be exposed through a substantial portion of the front plate 101 , for example. The shape of the display 120 may be a shape corresponding to the shape of the front plate 101 , and may have various shapes such as a circle, an oval, or a polygon. The display 120 may be disposed in conjunction with or adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and/or a fingerprint sensor.

The

audio modules

105 and 108 may include a microphone hole 105 and a speaker hole 108 . In the microphone hole 105, a microphone for acquiring an external sound may be disposed therein, and in some embodiments, a plurality of microphones may be disposed to sense the direction of the sound. The speaker hole 108 can be used as an external speaker and a receiver for calls. In some embodiments, the speaker hole 108 and the microphone hole 105 may be implemented as a single hole, or a speaker may be included without the speaker hole 108 (eg, a piezo speaker).

The sensor module 111 may generate an electrical signal or data value corresponding to an internal operating state of the first electronic device 100 or an external environmental state. The sensor module 111 may include, for example, a biometric sensor module 111 (eg, an HRM sensor) disposed on the second surface 110B of the housing 110 . The first electronic device 100 includes a sensor module (not shown), for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, and a temperature. It may further include at least one of a sensor, a humidity sensor, and an illuminance sensor.

The

key input device

102 , 103 , 104 includes a wheel key 102 disposed on a first surface 110A of the housing 110 and rotatable in at least one direction, and/or a side surface 110C of the housing 110 . ) may include

side key buttons

102 and 103 disposed in the . The wheel key may have a shape corresponding to the shape of the front plate 101 . In another embodiment, the first electronic device 100 may not include some or all of the above-mentioned

key input devices

102, 103, 104, and may not include the

key input devices

102, 103, 104. may be implemented in other forms such as soft keys on the display 120 . The connector hole 109 may accommodate a connector (eg, a USB connector) for transmitting/receiving power and/or data with an external electronic device and may receive a connector for transmitting/receiving an audio signal with an external electronic device Another connector hole (not shown)) may be included. The first electronic device 100 may further include, for example, a connector cover (not shown) that covers at least a portion of the connector hole 109 and blocks the inflow of foreign substances into the connector hole.

The

binding members

150 and 160 may be detachably attached to at least a partial region of the housing 110 using the

locking members

151 and 161 . The

binding members

150 and 160 may include one or more of a fixing member 152 , a fixing member fastening hole 153 , a band guide member 154 , and a band fixing ring 155 .

The fixing member 152 may be configured to fix the housing 110 and the

binding members

150 and 160 to a part of the user's body (eg, wrist, ankle, etc.). The fixing member fastening hole 153 may fix the housing 110 and the

coupling members

150 and 160 to a part of the user's body in correspondence to the fixing member 152 . The band guide member 154 is configured to limit the range of motion of the fixing member 152 when the fixing member 152 is fastened with the fixing member coupling hole 153, so that the

fixing members

150 and 160 are attached to a part of the user's body. It can be made to adhere and bind. The band fixing ring 155 may limit the range of movement of the fixing

members

150 and 160 in a state in which the fixing member 152 and the fixing member coupling hole 153 are fastened.

Referring to FIG. 3 , the first electronic device 100 includes a side bezel structure 310 , a wheel key 320 , a front plate 101 , a display 120 , a first antenna 350 , and a second antenna ( 355 ), a support member 360 (eg, a bracket), a battery 370 , a printed circuit board 380 , a sealing member 390 , a back plate 393 , and binding

members

395 and 397 . have. At least one of the components of the first electronic device 100 may be the same as or similar to at least one of the components of the first electronic device 100 of FIG. 1 or 2 , and overlapping descriptions omitted below. The support member 360 may be disposed inside the first electronic device 100 and connected to the side bezel structure 310 , or may be integrally formed with the side bezel structure 310 . The support member 360 may be formed of, for example, a metallic material and/or a non-metallic (eg, polymer) material. The support member 360 may have a display 120 coupled to one surface and a printed circuit board 380 coupled to the other surface. The printed circuit board 380 may be equipped with a processor, memory, and/or an interface. The processor may include, for example, one or more of a central processing unit, an application processor, a graphic processing unit (GPU), an application processor, a sensor processor, or a communication processor.

Memory may include, for example, volatile memory or non-volatile memory. The interface may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, and/or an audio interface. The interface may, for example, electrically or physically connect the first electronic device 100 to the second electronic device that is an external electronic device, and may include a USB connector, an SD card/MMC connector, or an audio connector. .

The battery 370 is a device for supplying power to at least one component of the first electronic device 100 , and includes, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. can do. At least a portion of the battery 370 may be disposed substantially on the same plane as the printed circuit board 380 . The battery 370 may be integrally disposed inside the first electronic device 100 , or may be detachably disposed with the first electronic device 100 .

The first antenna 350 may be disposed between the display 120 and the support member 360 . The first antenna 350 may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. The first antenna 350 may, for example, perform short-range communication with an external device or wirelessly transmit/receive power required for charging, and may transmit a magnetic-based signal including a short-range communication signal or payment data. . In another embodiment, the antenna structure may be formed by a part of the side bezel structure 310 and/or the support member 360 or a combination thereof.

The second antenna 355 may be disposed between the circuit board 380 and the rear plate 393 . The second antenna 355 may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and/or a magnetic secure transmission (MST) antenna. The second antenna 355 may, for example, perform short-range communication with an external device or wirelessly transmit/receive power required for charging, and may transmit a magnetic-based signal including a short-range communication signal or payment data. . In another embodiment, an antenna structure may be formed by a part of the side bezel structure 310 and/or the rear plate 393 or a combination thereof.

The sealing member 390 may be positioned between the side bezel structure 310 and the rear plate 393 . The sealing member 390 may be configured to block moisture and foreign substances from flowing into the space surrounded by the side bezel structure 310 and the rear plate 393 from the outside.

Hereinafter, an electronic device according to an exemplary embodiment will be described with reference to FIGS. 4 and 5 . The same components as those of the above-described embodiment may be referred to by the same reference numerals, and a description thereof may be omitted.

4 is a block diagram 400 of a first electronic device according to an exemplary embodiment. 5 is a flowchart illustrating an operation of a first electronic device according to an exemplary embodiment.

Referring to FIG. 4 , according to an embodiment, the first electronic device 100 may correspond to the smart watch illustrated in FIGS. 1 to 3 . Also, the first electronic device 100 is not limited to a smart watch, and may correspond to various wearable devices that a user can wear.

The first electronic device 100 may include a first display 120 , a first sensor module 111 , a first processor 410 , a first communication module 420 , and a first memory 430 . have.

The first display 120 may visually provide information to the outside (eg, a user) of the first electronic device 100 . The first display 120 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the first display module 120 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The first sensor module 111 detects a state (eg, tilt, position, movement, etc.) of the first electronic device 100 or an external environmental state (eg, user state), and generates electricity corresponding to the sensed state. It can generate signals or data values. According to an embodiment, the first sensor module 111 may include a gyro sensor and an acceleration sensor, and may further include a biometric sensor, a temperature sensor, a humidity sensor, and the like.

The first processor 410 may, for example, execute software to control at least one other component (eg, hardware or software component) of the first electronic device 100 connected to the first processor 410 . and can perform various data processing or operations. According to an embodiment, as at least a part of data processing or operation, the first processor 410 receives a command or data received from another component (eg, the first sensor module 111 or the first communication module 420 ). may be processed, and the result data may be stored in the first memory 430 .

The first communication module 420 establishes a direct (eg, wired) communication channel or a wireless communication channel between the first electronic device 100 and a second electronic device that is an external electronic device, and performs communication through the established communication channel. can support The first communication module 420 may include one or more communication processors that operate independently of the first processor 410 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to an embodiment, the first communication module 420 is a wireless communication module (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (eg, a local area network (LAN) communication module). area network) communication module, or a power line communication module). Among these communication modules, the corresponding communication module is a first network (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct or IrDA (infrared data association)) or a second network (eg, a legacy cellular network, a 5G network, It may communicate with an external electronic device through a next-generation communication network, the Internet, or a telecommunication network such as a computer network (eg, LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module identifies or authenticates the first electronic device 100 within a communication network such as the first network or the second network using subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module. can

The first memory 430 may store various data used by at least one component of the first electronic device 100 (eg, the first processor 410 or the first sensor module 111 ). may include, for example, input data or output data for software (eg, a program and instructions related thereto).

Hereinafter, a screen setting process of the first electronic device will be described with reference to FIG. 5 . Referring to FIG. 5 , according to an exemplary embodiment, a first processor (eg, the first processor 410 of FIG. 4 ) of the first electronic device (eg, the first electronic device 100 of FIG. 4 ) is performed in operation 501 . A second electronic device, which is an external electronic device, may be communicatively connected. According to an embodiment, the second electronic device may be a wireless earphone (eg, a Bluetooth earphone), but is not limited thereto, and may correspond to various wearable devices that can be worn on the user's head. According to an embodiment, the first electronic device may be connected to the second electronic device through wireless communication (eg, Bluetooth communication).

In operation 503, the first processor of the first electronic device may start a screen setting process of the first electronic device. According to an embodiment, the screen setting process includes setting an on/off condition of a screen of a first display (eg, the display 120 of FIG. 3 and/or the first display 120 of FIG. 4 ) of the first electronic device. It can be a process.

In operation 505, the first processor of the first electronic device may identify a change value of the inclination of the third axis of the first electronic device. Hereinafter, a method of identifying a tilt change value of the third axis of the first electronic device will be described with reference to FIG. 6 . FIG. 6 is a view showing a main part of the housing including the side housing 310 and the rear plate 393 of the first electronic device 100 of FIG. 3 .

Referring to FIG. 6 , the first electronic device 100 includes a first electronic device 100 having a screen exposed to the front part of the first electronic device 100 and included in a housing including a side housing 310 and a rear plate 393 . One display 120 may be included. Also, the first electronic device 100 may include a first sensor module (not shown) inside the housing. According to an embodiment, the first sensor module (not shown) may include at least one of an acceleration sensor and a gyro sensor. The first sensor module (not shown) may have reference axes of an x-axis, a y-axis, and a z-axis that are standards for measuring a movement direction, inclination, and the like. A center at which the reference axes of the x-axis, y-axis, and z-axis cross each other may be located at the center of the first sensor module. Hereinafter, in the present specification, an x-axis of the first sensor module may be referred to as a first axis, a y-axis may be referred to as a second axis, and a z-axis may be referred to as a third axis. The first axis, the second axis, and the third axis may be orthogonal to each other, and a plane formed by the first axis and the second axis may be parallel to the screen of the first display 120 . Also, the third axis may be a direction normal to the screen of the first display 120 .

According to an exemplary embodiment, the acceleration sensor may measure acceleration using gravitational acceleration. The degree of inclination of the acceleration sensor can be measured by measuring the effect of gravitational acceleration in three axes: the x-axis, the y-axis, and the z-axis.

According to an exemplary embodiment, the gyro sensor is a sensor capable of measuring angular velocity, and may measure physical quantities of three axes of x, y, and z to detect movement of the angular velocity sensor and measure a slope.

The degree of inclination measured by the acceleration sensor and the angular velocity sensor may correspond to the degree of inclination of the first electronic device 100 . Accordingly, the degree of inclination of the first electronic device 100 from the initial values (initial values) of the first axis, the second axis, and the third axis of the first electronic device 100 using at least one of the acceleration sensor and the angular velocity sensor; That is, a change value from an initial value (initial value) of the first axis, the second axis, and the third axis may be measured. The first processor of the first electronic device 100 may receive the change values of the first axis, the second axis, and the third axis of the first electronic device 100 from the first sensor module.

Referring back to operation 505 of FIG. 5 , the first processor of the first electronic device 100 receives the change value of the inclination of the third axis corresponding to the normal direction of the screen of the first display 120 received from the first sensor module. can be identified.

In operation 507 , the first processor of the first electronic device 100 may receive a change value of the inclination of the fourth axis of the second electronic device. Hereinafter, a method of receiving a tilt change value of the fourth axis of the second electronic device will be described with reference to FIGS. 7 and 8 . 7 is a diagram illustrating the shape of the second electronic device 700 , and FIG. 8 is a block diagram 800 illustrating the configuration of the second electronic device 700 .

7 and 8 , the second electronic device 700 may be a wireless earphone (eg, a Bluetooth earphone) that can be worn on the user's ear. However, this corresponds to an example, and the second electronic device may correspond to various wearable electronic devices that can be worn on a user's head. The second electronic device 700 may include a second sensor module 810 , a second processor 820 , a second communication module 830 , and a second memory 840 .

The second sensor module 810 detects a state (eg, tilt, position, movement, etc.) of the second electronic device 700 or an external environmental state (eg, a user state), and generates electricity corresponding to the sensed state. It can generate signals or data values. According to an embodiment, the second sensor module 810 may include a gyro sensor and an acceleration sensor.

The second processor 820 may execute, for example, software to control at least one other component (eg, a hardware or software component) of the second electronic device 700 connected to the second processor 820 . and can perform various data processing or operations. According to an embodiment, as at least a part of data processing or operation, the second processor 820 receives a command or data received from another component (eg, the second sensor module 810 or the second communication module 830 ). processed, and the result data may be stored in the second memory 840 .

The second communication module 830 establishes a wireless communication channel between the second electronic device 700 and a first electronic device that is an external electronic device (eg, the first electronic device 100 of FIG. 6 ), and establishes the established communication channel. It can support performing communication through According to an embodiment, the second communication module 830 may include a short-range wireless communication module. The short-range communication module according to an embodiment may communicate with an external electronic device through a first network (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)).

The second memory 840 may store various data used by at least one component (eg, the second processor 820 or the second sensor module 810) of the second electronic device 700. The data is , for example, may include input data or output data for software (eg, a program and instructions related thereto).

According to an embodiment, the second sensor module 810 may include at least one of an acceleration sensor and a gyro sensor. Hereinafter, in the present specification, the second sensor module 810 mounted on the second electronic device 700 may be Based on the center, the x-axis may be referred to as a fourth axis, the y-axis may be referred to as a fifth axis, and the z-axis may be referred to as a sixth axis. The fourth axis, the fifth axis, and the sixth axis may be orthogonal to each other, and when the user wears the second electronic device 700 in an upright posture, the fourth axis is the user's gaze direction and the fifth axis is the direction toward the ground , the second sensor module 810 may be built-in (set) so that the sixth axis faces the normal direction of the housing of the second electronic device 700 .

The degree of inclination measured by the acceleration sensor and the angular velocity sensor may correspond to the degree of inclination of the second electronic device 700 . Accordingly, the degree of inclination of the second electronic device 700 from the initial values (initial values) of the fourth axis, the fifth axis, and the sixth axis of the second electronic device 700 using at least one of the acceleration sensor and the angular velocity sensor; That is, a change value from an initial value (initial value) of the fourth axis, the fifth axis, and the sixth axis may be measured. The second processor 820 of the second electronic device 700 may receive the change values of the fourth axis, the fifth axis, and the sixth axis of the second electronic device 700 from the second sensor module 810 .

The second electronic device 700 may transmit the tilt change value of the fourth axis corresponding to the user's gaze direction to the first electronic device 100 through the second communication module 830 .

Referring back to operation 507 of FIG. 5 , the first electronic device 100 may receive a change in inclination value of the fourth axis of the second electronic device 700 through the first communication module. The second electronic device 700 may transmit a gradient change value of the fourth axis of the second electronic device 700 to the first electronic device 100 .

In operation 509 , the first processor of the first electronic device 100 may identify the size of the acute angle formed by the third axis of the first electronic device 100 and the fourth axis of the second electronic device 700 . Hereinafter, a method for the first electronic device 100 to identify the size of the acute angle formed by the third axis and the fourth axis will be described with reference to FIG. 9 .

Referring to FIG. 9 , the user can view the screen of the first electronic device 100 while wearing the first electronic device 100 and the second electronic device 700 . In this case, the fourth axis (x-axis) of the second electronic device 700 corresponding to the user's gaze direction corresponds to the third axis of the first electronic device 100 corresponding to the normal direction of the screen of the first electronic device 100 . oriented in the axis (z-axis), the third and fourth axes may form an angle. The first electronic device 100 sets an acute angle 910 between the third axis and the fourth axis based on the change value of the third axis measured by itself and the change value of the fourth axis received from the second electronic device 700 . ) can be measured.

Referring back to FIG. 5 , in operation 511 , when the size of the identified acute angle 910 is equal to or less than a threshold value, the first electronic device 100 may set content to be output on the screen of the first electronic device 100 . The threshold can be set by the user, so the user can move the 3rd and 4th axes, including a frontal gaze where the 3rd and 4th axes are completely coincident, so that the acute angle 910 is within the threshold range. The content may be set to be output on the screen of the first electronic device 100 within a range desired by the user until the time of entry. Outputting content to the screen of the first electronic device 100 may mean changing the screen of the first electronic device 100 that was in an off state due to low power driving to an on state. According to an embodiment, the first electronic device 100 may output watch screen content while turning on the screen. However, the present invention is not limited thereto, and when the size of the acute angle 910 satisfies the threshold value or less, the screen of the first electronic device 100 that has output the watch screen content is set to switch to another content (eg, a specific application screen). may be

When the size of the identified acute angle 910 is equal to or less than the threshold value, the first electronic device 100 sets the content to be output on the screen of the first electronic device 100, so that it is not necessary to always keep the screen turned on. can save Since the screen of the first electronic device 100 is turned on when the second user only looks at the screen of the first electronic device 100 while wearing the electronic device 700, it is convenient to use the first electronic device ( 100) screen can be controlled. In addition, when the size of the identified acute angle 910 is maintained below the threshold value, since the first electronic device 100 maintains the content output on the screen, the user's gaze direction is maintained as the screen of the first electronic device 100 . You can solve the inconvenience of turning off the screen while it is being used.

Hereinafter, an operation of the first electronic device will be described with reference to FIG. 10 . 10 is a flowchart illustrating an operation of the first electronic device. Hereinafter, in the description with reference to FIG. 10 , the first electronic device may refer to the first electronic device 100 of FIG. 9 , and the second electronic device may refer to the second electronic device 700 of FIG. 9 . A description of the same configuration as in the above-described embodiment may be omitted.

Referring to FIG. 10 , in operation 1001 , the first electronic device 100 is connected to communicate with the second electronic device 700 through a first wireless communication module (eg, the first communication module 420 of FIG. 4 ). can The first electronic device 100 may be communicatively connected to the second electronic device 700 through a third electronic device (eg, a smart phone), or may be directly connected to the second electronic device 700 . The first electronic device 100 may be connected to communicate directly or indirectly with the second electronic device 700 through short-range communication (eg, Bluetooth communication).

In operation 1003 , the first processor of the first electronic device 100 (eg, the first processor 410 of FIG. 4 ) may determine whether a setting value is stored. According to an embodiment, the setting value may mean a value set through the screen setting process described above with reference to FIG. 5 . That is, it may include at least one of whether the screen is set through the screen setting process, a threshold value, and an operation of the screen when the threshold value is satisfied.

If it is determined in operation 1003 that the setting value is not stored, in operation 1005 , the first electronic device 100 may operate as an existing setting. According to an embodiment, the existing setting may correspond to an initial setting when the first electronic device 100 is manufactured. According to an embodiment, the initial setting may be a setting that maintains an always on display of the screen of the first electronic device 100 . Alternatively, according to an embodiment, the initial setting may be a setting in which the screen of the first electronic device 100 is turned on when the first electronic device 100 senses a movement of a worn wrist.

If it is determined in operation 1003 that the set value is stored, in operation 1007 , the first electronic device 100 performs a third operation corresponding to the normal direction of the screen of the first electronic device 100 (eg, the Z direction in FIG. 6 ). It is possible to identify the change value of the tilt of the axis. According to an embodiment, the method of identifying the inclination change value of the third axis may be the same as the method of the embodiment described above with reference to operation 505 of FIG. 5 and FIG. 6 .

In operation 1009 , the first electronic device 100 may receive a change value of the inclination of the fourth axis of the second electronic device 700 corresponding to the user's gaze direction (eg, the X direction of FIG. 7 ). According to an embodiment, the method of receiving the inclination change value of the fourth axis may be the same as the method of the embodiment described above with reference to operation 507 of FIG. 5 and FIG. 7 .

In operation 1011 , the first electronic device 100 may identify the size of the acute angle formed by the third axis of the first electronic device 100 and the fourth axis of the second electronic device 700 . According to an embodiment, a method of identifying the magnitude of the acute angle formed by the third axis and the fourth axis may be the same as the method of the embodiment described with reference to operation 509 of FIG. 5 and FIG. 9 .

In operation 1013 , the first electronic device 100 may determine whether the magnitude of the acute angle identified in operation 1011 is equal to or less than a threshold value.

When it is determined that the size of the acute angle identified in operation 1013 is less than or equal to the threshold value, in operation 1015 , the first electronic device 100 recognizes that the user is viewing the screen of the first electronic device 100 and the screen is turned off. can be turned on to output content on the screen. According to an embodiment, the content output to the first electronic device 100 may be a watch screen.

When it is determined that the size of the acute angle identified in operation 1013 exceeds the threshold value, in operation 1017 , the first electronic device 100 determines that the user is not looking at the screen of the first electronic device 100 and thus is turned off. You can keep the screen.

Hereinafter, operations of the first electronic device and the second electronic device will be described with reference to FIG. 11 . 11 is a diagram for describing operations of a first electronic device and a second electronic device. The same components as those of the above-described embodiment may be referred to by the same reference numerals, and a description thereof may be omitted.

Referring to the first state 1110 of FIG. 11 , the user may be in a state in which the first electronic device 100 and the second electronic device 700 are worn. The first electronic device 100 may align the content with the reference axis corresponding to the second axis (y-axis) of the first electronic device 100 and output it on the screen.

Referring to the second state 1120 of FIG. 11 , according to an embodiment, the current reference axis may be Y1. According to an embodiment, the first electronic device 100 may output the content so that a horizontal line of the content is perpendicular to the reference axis Y1 of the first electronic device 100 . For example, when the first electronic device 100 outputs the watch screen content to the screen, a virtual line 1121 connecting the number plate 12 and the number plate 6 of the watch screen is the reference axis Y1 of the first electronic device 100 . ) and an imaginary line 1122 connecting the number panel 9 and the number panel 3 may be perpendicular to the reference axis Y1 to output the contents of the watch screen.

Referring back to the first state 1110 of FIG. 11 , the second electronic device 700 includes a second sensor module built into the second electronic device 700 (eg, the second sensor module 810 of FIG. 8 ). Through , the change value of the inclination of the fifth axis (y-axis) of the second electronic device 700 may be measured. For example, when the user tilts his/her body or moves his/her head, the fifth axis (y-axis) of the second electronic device 700 corresponds to a time when the second sensor module is manufactured or is embedded in the second electronic device 700 . It can be changed from the initial value.

The second electronic device 700 may transmit the changed value of the fifth axis (y-axis) to the first electronic device 100 through the second communication module (eg, the second communication module 830 of FIG. 8 ). . The first electronic device 100 may receive the change value of the fifth axis (y-axis) from the second electronic device 700 through the first communication module (eg, the first communication module 420 of FIG. 4 ). have.

Referring to the third state 1130 of FIG. 11 , the first electronic device 100 displays the first display 120 based on the change value of the inclination of the fifth axis (y-axis) received from the second electronic device 700 . ), you can adjust the horizontality of the displayed content. For example, if the reference axis of the first electronic device 100 before the inclination of the fifth axis (y-axis) received from the second electronic device 700 is changed is the Y1 axis, it is received from the second electronic device 700 . The reference axis may be changed to the Y2 axis so as to be parallel to one fifth axis (y axis). Accordingly, when the first electronic device 100 outputs the watch screen content to the first display 120 , the virtual line 1121 connecting the number plate 12 and the number plate 6 of the watch screen is changed in the first electronic device 100 . The watch screen content may be output so that a virtual line 1122 that is parallel to the reference axis (Y2) and connects the number panel 9 and the number panel 3 is perpendicular to the changed reference axis (Y2) axis.

According to an embodiment, the fifth axis (y-axis) received from the second electronic device 700 and the screen of the first display 120 of the first electronic device 100 are substantially the same plane (the first electronic device ( 100), the first electronic device 100 moves the fifth axis (y-axis) to the first display 120 when the first axis (x-axis) and the second axis (y-axis) are not positioned on the plane You can change the reference axis so that it is parallel to the axis projected on the same plane as the screen.

According to an embodiment, the first electronic device 100 communicates with the second electronic device 700 in real-time to move the user's head wearing the second electronic device 700 and/or the first electronic device 100 . By adjusting the level of the content output on the screen of the first electronic device 100 according to the movement of the wrist wearing the can

According to an embodiment, the function of adjusting the level of the content displayed on the first electronic device 100 may be activated or deactivated according to a user's setting.

According to an embodiment of the present disclosure, the third axis may correspond to a normal direction of the screen.

According to an embodiment of the present disclosure, the sensor may include at least one of a gyro sensor and an angular velocity sensor.

According to an embodiment of the present disclosure, the processor may be configured to output the first content to the screen in response to determining that the acute angle value is less than or equal to a threshold value in an off state of the screen.

According to an embodiment of the present disclosure, the processor may be configured to output the first content to the screen in response to determining that the acute angle value is less than or equal to a threshold value while the screen is outputting the second content can

According to an embodiment of the present disclosure, the processor may be configured to align the content horizontally and output it to the screen so that a reference axis corresponding to the second axis of the electronic device and a horizontal line of the content are perpendicular to each other.

According to an embodiment of the present disclosure, the second tilt information may include an initial value for a fifth axis of the external electronic device perpendicular to the fourth axis and corresponding to a ground direction in a state in which the external electronic device is worn by a user. It may include a changed slope value compared to the value.

According to an embodiment of the present disclosure, the processor may be configured to change the reference axis to be parallel to the fifth axis based on the received second inclination information.

According to an embodiment of the present disclosure, the threshold value may be set by the user.

According to an embodiment of the present disclosure, the second tilt information may be measured through at least one of a gyro sensor and/or an angular velocity sensor included in the external electronic device.

According to an embodiment of the present disclosure, when it is determined that the acute angle value is equal to or less than a threshold value in a state in which the screen is turned off, the first content may be output on the screen.

According to an embodiment of the present disclosure, when it is determined that the acute angle value is equal to or less than a threshold value while the screen is outputting the second content, the first content may be output on the screen.

According to an embodiment of the present disclosure, the content may be horizontally aligned and output to the screen such that a horizontal line of the content and a reference axis corresponding to the second axis of the electronic device are perpendicular to each other.

According to an embodiment of the present disclosure, the reference axis may be changed to be parallel to the fifth axis based on the received second inclination information.

Claims

In an electronic device,

radio communication circuit;

display;

a sensor based on a first axis, a second axis, and a third axis orthogonal to each other; A plane formed by the first axis and the second axis is parallel to the screen of the display,

a processor electrically connected to the display, the wireless communication circuit, and the sensor;

The processor is

Obtaining the first inclination information including the changed inclination value compared to the initial value of the third axis through the sensor,

Receives second tilt information of the external electronic device from an external electronic device connected to enable communication with the electronic device through the wireless communication circuit, and the second tilt information is stored in a state in which the external electronic device is worn by a user. and a gradient value changed from the initial value with respect to the fourth axis of the external electronic device corresponding to the user's gaze direction,

and determine whether to output the first content to the screen based on an angle between the third axis and the fourth axis obtained by the first inclination information and the second inclination information.
The method according to claim 1,

and the third axis corresponds to a normal direction of the screen.
The method according to claim 1,

The sensor includes at least one of a gyro sensor and an angular velocity sensor.
The method according to claim 1, wherein the processor,

and output the first content on the screen in response to determining that the acute angle value is less than or equal to a threshold value in a state in which the screen is turned off.
The method according to claim 1, wherein the processor,

and output the first content to the screen when it is determined that the acute angle value is equal to or less than a threshold value while the screen is outputting the second content.
The method according to claim 1, wherein the processor,

and output to the screen by aligning the content with a horizontal line of the content so that a reference axis corresponding to the second axis of the electronic device and a horizontal line of the content are perpendicular to each other.
7. The method of claim 6,

The second inclination information includes a gradient value changed from an initial value for a fifth axis of the external electronic device perpendicular to the fourth axis and corresponding to the ground direction in a state in which the external electronic device is worn by the user. electronic device.
The method according to claim 7, wherein the processor,

and change the reference axis to be parallel to the fifth axis based on the received second inclination information.
The method according to claim 1,

and the threshold value is set by the user.
The method according to claim 1,

The second tilt information is measured through at least one of a gyro sensor and/or an angular velocity sensor included in the external electronic device.
A method for controlling a screen of an electronic device, the method comprising:

Obtaining first inclination information including the changed inclination value compared to the initial value of the third axis through the sensor of the electronic device, - The sensor is based on the first axis, the second axis, and the third axis orthogonal to each other, a plane formed by the first axis and the second axis is parallel to the screen;

Receive second tilt information of the external electronic device from an external electronic device connected to enable communication with the electronic device through a wireless communication circuit of the electronic device, - The second tilt information is worn by the external electronic device to the user in the state where the inclination value is changed compared to the initial value with respect to the fourth axis of the external electronic device corresponding to the user's gaze direction;

obtaining an acute angle value formed between the third axis and the fourth axis based on the first inclination information and the second inclination information;

and outputting the first content to the screen when the acute angle value is equal to or less than a threshold value.
12. The method of claim 11,

and the third axis corresponds to a normal direction of the screen.
12. The method of claim 11,

The method of claim 1, wherein the sensor includes at least one of a gyro sensor and an angular velocity sensor.
12. The method of claim 11,

and outputting the first content to the screen when it is determined that the acute angle value is less than or equal to a threshold value in a state in which the screen is turned off.
12. The method of claim 11,

and outputting the first content to the screen in response to determining that the acute angle value is less than or equal to a threshold value while the screen is outputting the second content.