KR20190099847A - Electronic apparatus and method of correcting posture thereof - Google Patents

Abstract

Disclosed is an electronic device for correcting a user posture. According to an embodiment of the present invention, the electronic device comprises: a communication unit; an output unit; a memory including at least one command; and a processor connected to the communication unit, the output unit, and the memory to control the electronic device. The processor executes the at least one command to perform a communication connection with a wearable device worn by a user through the communication unit, receives sensing data sensed by the wearable device from the wearable device through the communication unit, and controls the output unit to output a message corresponding to a preset condition in order to guide the posture of the user when the received sensing data satisfies the preset condition.

Description

Electronic apparatus and method of correcting posture

The present disclosure relates to an electronic device and a method for correcting a posture thereof, and more particularly, to measure a distance to an object viewed by a user for protecting eyesight of a user, or to measure a peripheral illumination to correct a posture of a user. The present invention relates to an electronic device and a control method thereof capable of outputting or outputting a message for correcting a posture of a user by measuring a tilt of a user's head.

In recent years, many people use computers at work to perform office work. Office workers spend most of their day looking at computer monitors and watching a variety of content, including smartphones and video, in addition to working hours. As a result, eye fatigue is increasing rapidly, and one study found that between 50% and 90% of workers using computers experience eye fatigue and eye-related discomfort. For example, while people know that a posture as shown on the right side of FIG. 1 is a correct posture, people often perform work in an incorrect posture, as shown on the left side of FIG. Many people work long hours without knowing their positions are wrong.

Meanwhile, recently, methods for guiding a lifestyle or posture correction of a user through various wearable devices have been disclosed. However, conventional wearable devices provide functions for informing a user by measuring a user's sleep habits, correcting a walking posture, a daily exercise amount, etc., but do not measure and provide data related to eye fatigue of the user.

The present disclosure is to solve the above-described problem, and relates to an electronic device and a wearable device for helping a user correct posture.

An electronic device for correcting a user's posture according to an exemplary embodiment of the present disclosure for solving the problem may include a communication unit, an output unit, a memory including at least one command, and a connection with the communication unit, the output unit, and the memory. And a processor configured to control an electronic device, wherein the processor performs a communication connection with a wearable device worn by a user through the communication unit by executing the at least one instruction, and from the wearable device through the communication booth. The controller may be configured to receive sensing data sensed by the wearable device and to output a message corresponding to the preset condition to guide the user's posture when the received sensing data satisfies a preset condition.

In this case, the sensing data may include data about a distance between the external device and an object detected by the distance measuring sensor of the wearable device, data about an angle detected by the gyro sensor of the wearable device, and illuminance of the wearable device. It may include at least one of the data on the illumination sensed by the sensor.

In this case, when the sensing data is data on the distance between the wearable device and the object detected by the distance measuring sensor, the processor guides the posture of the user when the detected distance is less than or equal to a first threshold. The output unit may be controlled to output information for performing the above operation.

In this case, the processor may match the detected distance with time information and store it in the memory, and output the information for guiding the posture of the user when the detected distance is less than or equal to the first threshold value for a preset time. In order to control the output unit.

In this case, when the sensing data is data about an angle detected by the gyro sensor, the processor outputs information for guiding the posture of the user when the detected angle is less than or equal to a second threshold. The output can be controlled.

In this case, the processor matches the detected angle with the time information and stores it in the memory, and outputs information for guiding the posture of the user when the detected angle is less than or equal to the second threshold for a preset time. In order to control the output unit.

In this case, when the sensing data is data on illuminance detected by the illuminance sensor, the processor outputs information for guiding the posture of the user when the sensed illuminance is greater than or equal to a third threshold. The output can be controlled.

At this time, the processor, the first sensing data obtained from the first sensor for detecting the illumination around the wearable device through the communication unit and a second for sensing the illumination of the area viewed by the user wearing the wearable device When the second sensing data obtained from the sensor is received and the difference between the first illuminance value obtained from the first sensing data and the second illuminance value obtained from the second sensing data is greater than or equal to a fourth threshold value, The output unit may be controlled to output information for guiding a posture.

On the other hand, the control method of the electronic device for correcting the user posture according to another embodiment of the present disclosure for solving the above-described problem, the step of performing a communication connection with the wearable device worn by the user, from the wearable device Receiving sensing data sensed by the wearable device and outputting a message corresponding to the preset condition to guide the posture of the user when the received sensing data satisfies a preset condition.

In this case, the sensing data may include data about a distance between the external device and an object detected by the distance measuring sensor of the wearable device, data about an angle detected by the gyro sensor of the wearable device, and illuminance of the wearable device. It may include at least one of the data on the illumination sensed by the sensor.

In this case, the outputting of the sensing data may include data about a distance between the wearable device and an object detected by the distance measuring sensor, and when the detected distance is less than or equal to a first threshold value, the posture of the user. Information for guiding can be output.

In this case, the outputting may include matching the detected distance with time information and outputting information for guiding the posture of the user when the detected distance is less than or equal to the first threshold value for a preset time. It may include.

In this case, the outputting may include outputting information for guiding the posture of the user when the sensing data is data about an angle detected by the gyro sensor and the detected angle is less than or equal to a second threshold. have.

The outputting may include matching the detected angle with time information and outputting information for guiding a user's posture when the detected angle is less than or equal to the second threshold for a preset time. It may include.

In this case, the outputting may include outputting information for guiding a user's posture when the sensing data is data on illuminance detected by the illuminance sensor and the detected illuminance is greater than or equal to a third threshold value. .

In this case, the receiving of the first sensing data obtained from the first sensor for detecting the illumination around the wearable device and the illumination of the area viewed by the user wearing the wearable device through the communication unit. And receiving second sensing data obtained from a second sensor, and outputting the first illuminance value obtained from the first sensing data and the second illuminance value obtained from the second sensing data. If the difference is greater than or equal to the fourth threshold value, information for guiding the posture of the user may be output.

According to various embodiments of the present disclosure, the electronic device may output a message for correcting the posture of the user by measuring at least one of an object viewed by the user, an ambient illuminance, and a tilt of the neck of the user.

1 is an exemplary view for explaining the wrong posture and correct posture of the conventional people.
2A and 2B are exemplary views illustrating a posture correcting system according to an embodiment of the present disclosure.
3A is a block diagram illustrating a configuration of an electronic device 100 according to an embodiment of the present disclosure.
3B is a block diagram illustrating in detail the configuration of the electronic device 100 according to an embodiment of the present disclosure.
4 is a block diagram illustrating a configuration of a wearable device according to an embodiment of the present disclosure.
5A to 5C are exemplary views for describing a method of determining a distance between a user and an object and outputting a message for guiding a posture of the user according to the determined result according to an embodiment of the present disclosure.
6A to 6E are exemplary views for describing a method of determining a tilt of a user's neck and outputting a message for guiding a posture of a user according to the determined result, according to an exemplary embodiment.
7A to 7D are exemplary views for describing a method of determining illuminance around a user and outputting a message for guiding a posture of the user according to the determined result, according to an embodiment of the present disclosure.
8 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

Terms used herein will be briefly described, and the present disclosure will be described in detail.

The terms used in the embodiments of the present disclosure selected general terms widely used as far as possible in consideration of functions in the present disclosure, but may vary according to the intention or precedent of a person skilled in the art, the emergence of new technologies, and the like. . In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present disclosure should be defined based on the meanings of the terms and the contents throughout the present disclosure, rather than simply the names of the terms.

Embodiments of the present disclosure may be variously modified and have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the scope to the specific embodiments, it should be understood to include all transformations, equivalents, and substitutes included in the scope of the disclosed spirit and technology. In describing the embodiments, when it is determined that the detailed description of the related known technology may obscure the gist, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are only used to distinguish one component from another.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "consist" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described in the specification, and one or more other It is to be understood that the present invention does not exclude the possibility of the presence or the addition of features, numbers, steps, operations, components, parts, or a combination thereof.

In an embodiment of the present disclosure, the 'module' or 'unit' performs at least one function or operation, and may be implemented in hardware or software or in a combination of hardware and software. In addition, the plurality of modules or the plurality of units may be integrated into at least one module except for the modules or units that need to be implemented with specific hardware, and are implemented as at least one processor (not shown). Can be.

In an embodiment of the present disclosure, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element in between. Also includes. In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present disclosure. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted for simplicity of explanation, and like reference numerals designate like parts throughout the specification.

In addition, in an embodiment of the present disclosure, an "application" refers to a series of computer program sets designed to perform a specific task. In an embodiment of the present disclosure, the application may vary. For example, game applications, video playback applications, map applications, memo applications, calendar applications, phone book applications, broadcast applications, workout support applications, payment applications, photo folder applications, medical device control applications, user interface of many medical devices. There may be a providing application, but is not limited thereto.

2A is an exemplary diagram for describing a posture correction system according to an embodiment of the present disclosure.

As described in FIG. 2A, the posture correcting system 100 may be configured of the electronic device 100 and the wearable device 200.

The electronic device 100 is configured to determine whether a user's posture is wrong based on the sensing data received from the wearable device 200, and output a message for correcting the posture.

In this case, the electronic device 100 may be implemented as a smart phone, but this is only an example, and may include a smartphone, a tablet personal computer, a mobile phone, a video phone, an e-book. E-book readers, desktop PCs, laptop PCs, netbook computers, workstations, servers, personal digital assistants, portable multimedia players (PMPs) It may include at least one of the MP3 player.

In another embodiment, the electronic device 100 may be a home appliance. Home appliances are, for example, televisions, digital video disk players, audio, refrigerators, air conditioners, cleaners, ovens, microwave ovens, washing machines, air cleaners, set-top boxes, home automation Home automation control panel, security control panel, TV box (e.g. Samsung HomeSync ™, Apple TV ™, or Google TV ™), game console (e.g. Xbox ™, PlayStation ™), electronics It may include at least one of a dictionary, an electronic key, a camcorder, or an electronic picture frame.

The wearable device 200 is a component for collecting sensing data. In this case, the wearable device 200 may be an accessory type (eg, watch, ring, bracelet, anklet, necklace, glasses, contact lens, or head-mounted-device (HMD)), earphone, headphone, It may include at least one of a fabric or clothing integral type (e.g., electronic garment), a body attachment type (e.g., skin pad or tattoo), or a living implantable type (e.g., implantable circuit).

In another embodiment, the wearable device 200 may be an independent device. In detail, as illustrated in FIG. 2B, the wearable device may be an independent device including a configuration capable of collecting sensing data, and may be attached to various external devices. For example, the wearable device 200 may be configured to be attached to various accessories worn on a user's head, such as glasses, earphones, a headband, and headphones. In the present disclosure, the wearable device 200 is described as being a device attached to a device worn on a user's head or a device worn on a user's head, but is not limited thereto, and may be worn or attached to various positions. to be.

3A is a block diagram illustrating a configuration of an electronic device 100 according to an embodiment of the present disclosure. As shown in FIG. 3A, the electronic device 100 includes a communication unit 110, an output unit 120, a memory 130, and a processor 140.

The communication unit 110 is a component for performing communication with an external device. In detail, the electronic device 100 may be connected to the wearable device 200 through the communication unit 110. In addition, the electronic device 100 may transmit and receive various data to and from another external device through the communication unit 110.

The output unit 120 is a component for outputting various data of the electronic device 100. In detail, the electronic device 100 may output a message for correcting the posture of the user through the output unit 120. In this case, the message output through the output unit 120 may be a UI screen related to posture correction or an audio signal related to posture correction.

The memory 130 may store various programs and data necessary for the operation of the electronic device 100. The memory 130 may be implemented as a nonvolatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). In detail, the memory 130 may include at least one instruction, and the processor 140 may execute at least one instruction.

The processor 140 controls the overall operation of the electronic device 100. In detail, the processor 140 may control the communication unit 110 to perform a communication connection with the wearable device 200 and to receive sensing data from the wearable device 200. When the received sensing data satisfies the preset condition, the processor 140 may control the output unit 120 to output a message corresponding to the preset condition to guide the posture of the user.

In this case, the sensing data may be data detected by a distance sensor, a gyro sensor, an illumination sensor, or the like included in the wearable device 200. In detail, the sensing data may include at least one of distance data from the wearable device 200 to an object, gradient data of the wearable device 200, and peripheral illumination data.

The preset condition may vary depending on the type of sensing data. Specifically, when the sensing data is data on the distance between the wearable device 200 and the object detected by the distance measuring sensor of the wearable device 200, the preset condition is that the distance between the wearable device 200 and the object is determined. It may be a condition for whether the first threshold value or less. Alternatively, the preset condition may be a condition related to a time during which the distance between the wearable device 200 and the object is maintained below a first threshold value. The preset condition may be a condition for whether the average value of the distance between the wearable device 200 and the object is equal to or less than the first threshold value.

In another embodiment, when the sensing data is tilt data detected by the gyro sensor of the wearable device 200, the preset condition is a condition of whether the tilt of the wearable device 200 is greater than or equal to a second threshold value or less. Can be. Alternatively, the preset condition may be a condition related to a time during which the inclination of the wearable device 200 maintains a state below the second threshold. Alternatively, the preset condition may be a condition regarding whether the average slope value of the wearable device 200 is less than or equal to the second threshold value.

In another embodiment, when the sensing data is illuminance data detected by the illuminance sensor of the wearable apparatus 200, the preset condition is whether the illuminance around the wearable apparatus 200 is greater than or equal to a third threshold value or less. Can be condition. Alternatively, the preset condition may be a condition related to a time during which the illuminance around the wearable device 200 maintains a state where the illuminance around the wearable device 200 is less than or equal to the third threshold value. Alternatively, the preset condition may be a condition of whether the difference between the illuminance value around the wearable device 200 and the illuminance value of the object region is greater than or equal to a fourth threshold value or less. The preset condition described above will be described in detail in various embodiments described below.

3B is a block diagram illustrating in detail the configuration of the electronic device 100 according to an embodiment of the present disclosure. As shown in FIG. 3B, the electronic device 100 may further include an input unit 150, an audio processor 160, etc. in addition to the communication unit 110, the output unit 120, the memory 130, and the processor 140. Can be. However, the present invention is not limited to the above-described configuration, and some configurations may be added or omitted as necessary.

The communication unit 110 may communicate with an external device. In particular, the communication unit 110 may include various communication chips such as a Wi-Fi chip 111, a Bluetooth chip 112, a wireless communication chip 113, and an NFC chip 114. In this case, the Wi-Fi chip 111, the Bluetooth chip 112, and the NFC chip 114 communicate with each other by a LAN method, a WiFi method, a Bluetooth method, and an NFC method. In the case of using the Wi-Fi chip 111 or the Bluetooth chip 112, various connection information such as SSID and session key may be first transmitted and received, and then various communication information may be transmitted and received using the same. The wireless communication chip 113 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), and the like.

The output unit 120 is a component for outputting various data of the electronic device 100. In detail, the output unit 120 may include a display 121 and an audio output unit 122.

The display 121 may display various screens as described above. In this case, the display 121 may be implemented as various types of display panels. For example, the display panel may be a liquid crystal display (LCD), organic light emitting diodes (OLED), active-matrix organic light-emitting diode (AM-OLED), liquid crystal on silicon (LcoS), or digital light processing (DLP). It can be implemented with various display technologies.

In addition, the display 121 may be coupled to at least one of a front region, a side region, and a rear region of the electronic device 100 in the form of a flexible display. The flexible display may be characterized by being able to bend, bend or roll without damage through a paper-thin and flexible substrate. Such a flexible display may be manufactured using a plastic substrate as well as a commonly used glass substrate. When using a plastic substrate, it can be formed using a low temperature manufacturing processor without using a conventional manufacturing processor to prevent damage to the substrate. In addition, the glass substrate surrounding the flexible liquid crystal may be replaced with a plastic film, thereby giving flexibility to fold and unfold. Such a flexible display is not only thin and light, but also strong in impact, and can be bent or bent and manufactured in various forms.

The audio output unit 122 is configured to output not only various audio data on which various processing tasks such as decoding, amplification, and noise filtering are performed by the audio processor 160, but also various notification sounds or voice messages. In detail, the audio processor 160 is a component that processes audio data. The audio processor 160 may perform various processing such as decoding, amplification, noise filtering, and the like on the audio data. The audio data processed by the audio processor 160 may be output to the audio output unit 160. In particular, the audio output unit 122 may be implemented as a speaker, but this is only an example and may be implemented as an output terminal capable of outputting audio data.

The input unit 150 may include a touch panel 151, a pen sensor 152, a key 153, and a microphone 154 to receive various inputs. The touch panel 151 may be configured by combining the display 121 and a touch sensor (not shown), and the touch sensor may use at least one of capacitive, pressure sensitive, infrared, and ultrasonic methods. The touch panel may have a function of detecting not only a display function but also a touch input position, a touched area, as well as a touch input pressure, and a function of detecting a proximity touch as well as a real touch. Can be. The pen sensor 152 may be implemented as part of the touch panel 151 or may include a separate sheet for recognition. The key 153 may include a physical button, an optical key or a keypad. The microphone 154 may include at least one of an internal microphone or an external microphone.

In particular, the input unit 150 may receive an external command from the various components described above and transmit it to the processor 140. The processor 140 may generate a control signal corresponding to the received input to control the electronic device 100.

The processor 140 may control overall operations of the electronic device 100 using various programs stored in the memory 130.

The processor 140 may include a RAM 141, a ROM 142, a graphics processor 143, a main CPU 144, a first to n interface 145-1 to 145-n, and a bus 146. have. In this case, the RAM 141, the ROM 142, the graphic processor 143, the main CPU 144, and the first to n-th interfaces 145-1 to 145-n may be connected to each other through the bus 146. .

The RAM 141 stores an O / S and an application program. In detail, when the electronic device 100 is booted, the O / S may be stored in the RAM 141, and various application data selected by the user may be stored in the RAM 141.

The ROM 142 stores a command set for system booting. When the turn on command is input and power is supplied, the main CPU 144 copies the O / S stored in the memory 110 to the RAM 141 according to the command stored in the ROM 142, and executes the O / S. Boot the system. When booting is completed, the main CPU 144 copies various application programs stored in the memory 130 to the RAM 141 and executes the application programs copied to the RAM 141 to perform various operations.

The graphic processor 143 generates a screen including various objects such as an item, an image, and a text by using a calculator (not shown) and a renderer (not shown). Here, the operation unit may be configured to calculate attribute values such as coordinate values, shapes, sizes, colors, etc. of each object to be displayed according to the layout of the screen using the control command received from the input unit 150. The renderer may be configured to generate screens of various layouts including objects based on the attribute values calculated by the calculator. The screen generated by the renderer may be displayed in the display area of the display 121.

The main CPU 144 accesses the memory 130 and performs booting using an OS stored in the memory 130. The main CPU 144 performs various operations using various programs, contents, data, and the like stored in the memory 130.

The first to n interfaces 145-1 to 145-n are connected to the various components described above. One of the first to n-th interfaces 145-1 to 145-n may be a network interface connected to an external device through a network.

4 is a block diagram illustrating a configuration of a wearable device according to an embodiment of the present disclosure. As shown in FIG. 4, the wearable device 200 includes a communication unit 210, a sensor 220, and a processor 230.

The communication unit 210 is configured to perform communication with an external device, and as described above, may include various communication chips such as a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, an NFC chip, and the like. The communicator 210 may transmit various sensing data sensed by the sensor 220 to the electronic device 100.

The sensor 220 is a component for sensing various sensing data. As shown in FIG. 4, the sensor 220 may include a distance sensor, an illumination sensor, a noise sensor, a gyro sensor, and the like.

The distance measuring sensor is a sensor for measuring the distance between the wearable device 200 and the object. In this case, the distance sensor may be configured as an optical sensor, but is not limited thereto. If necessary, the distance sensor may be configured as an infrared sensor or an ultrasonic sensor.

The illuminance sensor is a configuration for measuring the ambient illuminance. At this time, the illuminance sensor may be composed of two or more. In detail, when the illuminance sensor includes a first illuminance sensor and a second illuminance sensor, the first illuminance sensor detects the illuminance around the wearable device 200, and the second illuminance sensor measures the illuminance near the area where the object is located. I can detect it.

The noise measuring sensor is a component for measuring ambient noise, and the gyro sensor is a sensor that recognizes more detailed and precise motion by inserting rotations into the existing acceleration sensor and recognizes 6-axis directions, and is a wearable device ( 200 is a configuration for detecting the position.

The sensor 220 may include various types of sensors, such as an acceleration sensor, a proximity sensor, an impact sensor, a gravity sensor, and a geomagnetic sensor, in addition to the above configurations.

The processor 230 is a component for controlling the wearable device 200 and may control the communication unit 210 to transmit various information sensed by the sensor 220 to the electronic device 100.

Meanwhile, the wearable device 200 may further include additional components as necessary in addition to the above-described components. For example, when the wearable device 200 is implemented as an earphone, the wearable device 200 may further include an audio output unit. In this case, the wearable device 200 may receive and output data about an audio message related to posture correction from the electronic device 100. Alternatively, when the wearable device 200 is implemented as a head mounted display HMD, the wearable device 200 may further include a display. In this case, the wearable device 200 may receive and output data on a UI message related to posture correction from the electronic device 100. In addition, various configurations may be added according to which device the wearable device 200 is implemented.

Hereinafter, various posture correction methods will be described with reference to FIGS. 5A to 7C.

5A to 5C are exemplary views for describing a method of determining a distance between a user and an object and outputting a message for guiding a posture of the user according to the determined result according to an embodiment of the present disclosure.

Staring at an object too close or staring at an object of the same distance for a long time may cause diseases such as astigmatism or myopia. Therefore, the electronic device 100 needs to guide the posture of the user by measuring the distance to the object and the object gaze time gaze at the user.

As illustrated in FIG. 5A, the distance measuring sensor 221 of the wearable device 200 may measure the distance w between the wearable device 200 and the object 500 and transmit the measured distance w to the electronic device 100. In this case, the wearable device 200 may measure the distance data at a predetermined time interval (for example, at 10 second intervals) and transmit the distance data to the electronic device 100. In this case, the transmission method of the distance w may vary. For example, the wearable device 100 may transmit the distance data to the electronic device 100 whenever the data for the distance w is obtained, or may transmit the data at a predetermined time interval.

The electronic device 100 may determine the posture of the user by analyzing the distance data received from the wearable device 200. For example, when the distance between the wearable device 200 and the object is equal to or less than the first threshold value (eg, 0.4 m), the electronic device 100 may determine that the posture correction of the user is necessary. The method for determining the threshold will be described later.

In this case, when the distance between the wearable device 200 and the object becomes less than or equal to the first threshold value (for example, 0.4 m), the electronic device 100 may output a message for guiding the posture of the user. For example, as shown in FIG. 5B, the electronic device 100 may output a message UI such as "The distance to the front object is too close. Please maintain the proper distance for eye health." have. In this case, to inform that the message UI is output, the electronic device 100 may vibrate the electronic device 100 or output an alarm sound when the message UI is displayed. In this case, the data about the message UI may be transmitted to the wearable device 200 and displayed by the wearable device 200. That is, when the wearable device 200 is a head mounted display device, the message UI may be output from the wearable device 200.

In another embodiment, the message UI may be output in the form of audio data. As described above, depending on the type of the electronic device 100 or the wearable device 200, the audio data "The distance from the front object is too close. Please keep the proper distance for eye health." It may be output from the device 100 or the wearable device 200.

As illustrated in FIG. 5C, the electronic device 100 may store the received distance data by matching the time information. The electronic device 100 may obtain an average gaze distance at which a user gazes at an object based on distance data matched with time information. When the obtained average gaze distance is equal to or less than the first threshold value (eg, 0.4 m), the electronic device 100 may output a message guiding a posture of the user.

In another embodiment, the electronic device 100 may measure a change in distance data over time. If the distance data does not change for a preset time, the electronic device 100 may output a message guiding a posture of the user. For example, the electronic device 100 "looks at the same distance for too long. Look at the distance for eye health." You can print a message like this:

In conclusion, the electronic device 100 may use distance data to determine whether 1) an object that the user gazes near, 2) an average distance of an object that the user gazes near, and 3) the same object (the same). It is possible to determine how long the user is staring at an object located on the street and output a message guiding the user's posture.

6A to 6E are exemplary views for describing a method of determining a tilt of a user's neck and outputting a message for guiding a posture of a user according to the determined result, according to an exemplary embodiment.

Incorrect head posture can lead to vaginal tension, tiredness, turtle neck syndrome, and headaches. Therefore, as shown in FIG. 6A, the electronic device 100 needs to guide the posture of the user by measuring the posture of the user's head and the inclination of the neck.

In detail, the electronic device 100 may measure the inclination of the neck of the user using a gyro sensor, a gravity sensor, a geomagnetic sensor, or the like. As illustrated in FIG. 6B, the electronic device 100 may receive angle data of an inclination of the wearable device 200 from the wearable device 200 based on the gravity direction. When the received angle data is greater than or equal to the second threshold value (eg, 30 degrees), the electronic device 100 may output a message for guiding the posture of the user. For example, as illustrated in FIG. 6C, the electronic device 100 may output a message UI such as "Please maintain a correct posture for neck health." In this case, to inform that the message UI is output, the electronic device 100 may vibrate the electronic device 100 or output an alarm sound when the message UI is displayed. In this case, the data about the message UI may be transmitted to the wearable device 200 and displayed by the wearable device 200. That is, when the wearable device 200 is a head mounted display device, the message UI may be output from the wearable device 200.

In another embodiment, the message UI may be output in the form of audio data. As described above, according to the type of the electronic device 100 or the wearable device 200, the audio data “Please maintain a correct posture for neck health” is the electronic device 100 or the wearable device 200. Can be output from

On the other hand, in order to obtain accurate angle data, it is necessary to wear the wearable device 200 correctly. That is, the user may wear the wearable device 200 such that the inclination measured by the sensor at the correct posture becomes 0, so that the posture of the user of the electronic device 100 may be accurately determined. To this end, the electronic device 100 may output a message for guiding the wearing of the wearable device.

In detail, as illustrated in FIG. 6D, the electronic device 100 may display a message UI that guides the user to wear the wearable device 200 correctly. For example, the electronic device 100 may output a message UI such as "Please wear a wearable device. If the user presses OK, the process proceeds to adjusting the position of the wearable device."

When the confirmation command is input through the message UI, the electronic device 100 may display a UI for adjusting the position of the wearable device 200 as illustrated in FIG. 6E. If the confirmation command is input after the position of the wearable device 200 is adjusted so that the angle measured by the sensor is zero, the electronic device 100 determines that the wearing of the wearable device 200 is completed, and uses the sensing data. The posture of the user can be determined.

Meanwhile, as in the case of FIGS. 5A to 5C, the electronic device 100 may match the angle data with the time information. The electronic device 100 may obtain an average time when the user's head is inclined based on the angle data matched with the time information. When the obtained average time is greater than or equal to a second threshold value (eg, 0.4 m), the electronic device 100 may output a message guiding a posture of the user.

In another embodiment, the electronic device 100 may measure a change in angle data over time. If the angle data does not change for a preset time, the electronic device 100 may output a message guiding a posture of the user. For example, the electronic device 100 "holds the same posture for a long time. Please stretch for neck health." You can print a message like this:

7A to 7D are exemplary views for describing a method of determining illuminance around a user and outputting a message for guiding a posture of the user according to the determined result, according to an embodiment of the present disclosure.

Ambient illuminance values may affect the user's vision. Therefore, the electronic device 100 may determine the peripheral illumination and the illumination of the object region and guide the peripheral illumination value.

In detail, the electronic device 100 may receive peripheral illumination data from the wearable device 200. If the received ambient illuminance is above (or below) the third threshold (for example 500 lux), the electronic device 100 may show, "Ambient light is too bright. As shown in FIG. 7B. You can print a message UI such as "Please," or "The surroundings are too dark. Please increase the illuminance for eye health." As described above, the message may be output as audio or may be output from the wearable device 200.

On the other hand, as shown in Figure 7c, the object may be a light source that emits light. In this case, the electronic device 100 may determine the health state of the user by determining the ambient illumination and the intensity of light emitted by the object. For example, if the difference between the peripheral illumination value and the illumination value of the object area is greater than or equal to the fourth threshold value, the electronic device 100 may display the "brightness of the monitor too bright as shown in FIG. 7D. Shorten the message UI. " However, if necessary, the electronic device 100 may display "The brightness of the monitor is too dark. Please brighten the monitor", "The ambient light is too bright. Lower the illuminance for eye health" or "The ambient light is too dark." Increase the illuminance for eye health. "

Hereinafter, a method of determining the above-described various threshold values (threshold values related to the distance between the wearable device 200 and the object, the slope of the wearable device 200, the peripheral illumination, and the illumination of the object region) will be described. The various thresholds described above may be determined by the electronic device 100 or may be determined by an external server. In the following description, the external server determines the threshold.

First, the external server can collect medically approved raw data. At this time, the raw data obtained from all the sensors for a given time may be represented by the variable vector Vi. Collected data can be classified by various experts. Experts can then add binary marks to the raw data. That is, the raw data can be appended with a binary mark of either 0 (e.g. bad posture) or 1 (e.g. correct posture).

The external server can classify the raw data with the binary mark added in various ways. For example, an external server can train a classifier trained to automatically select key segments by a programmable counter array (PCA). In this case, the classifier may be implemented as a Naive Bayes Classifier, but is not limited thereto. For example, raw data may be classified through supervised learning. Alternatively, the raw data may be self-learned using the training data without any guidance, and thus, the raw data may be classified through unsupervised learning that discovers a classification criterion.

Alternatively, the raw data classification model may be based on a neural network model. Neural network models can be designed to simulate the human brain structure on a computer. The neural network model may include a plurality of weighted network nodes that simulate the neurons of a human neural network. The plurality of network nodes may form a connection relationship so that neurons simulate synaptic activity through which signals are sent and received through synapses. Furthermore, the raw data classification model may include a neural network model or a deep learning model developed from the neural network model. In the deep learning model, a plurality of network nodes may be located at different depths (or layers) and exchange data according to a convolutional connection relationship.

For example, a model such as a deep neural network (DNN), a recurrent neural network (RNN), and a bidirectional recurrent deep neural network (BRDNN) may be used as the classification model, but is not limited thereto. The various models described above may be trained using learning algorithms including error back-propagation or gradient descent.

The electronic device 100 may receive the information on the above-described various threshold values from the external server, and determine the posture of the user by comparing the sensing data received from the wearable device 200 with the threshold values received from the external server. . In this case, the electronic device 100 may receive the information on the threshold value from the external server at a predetermined cycle. Alternatively, when the threshold value determined by the external server is changed, the electronic device 100 may receive information about the changed threshold value.

Meanwhile, in the above-described embodiment, the electronic device 100 receives the information on the threshold value from the external server. However, the electronic device 100 may acquire the threshold value through the above-described method.

8 is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure.

The electronic device 100 may perform a communication connection with the wearable device 200 (S810).

The electronic device 100 may receive sensing data sensed by the wearable device 200 from the wearable device 200 that is connected in communication (S820). As described above, the sensing data received by the electronic device 100 includes data about a distance between objects of the wearable device 200 detected by the distance measuring sensor of the wearable device 200, and a gyro sensor of the wearable device 200. It may be at least one of data about an angle detected by the data and data about the illumination sensed by the illumination sensor of the wearable device 200.

When the received sensing data satisfies a preset condition, the electronic device 100 may output a message corresponding to the preset condition in order to guide the posture of the user (S830). In this case, the preset condition may be a condition for sensing data and a threshold value corresponding to the sensing data. In detail, when the sensing data is distance data between the wearable device 200 and the object, the preset condition may be a condition of whether the distance between the wearable device 200 and the object is equal to or less than a first threshold value. Alternatively, the preset condition may be a condition of whether the distance between the wearable device 200 and the object is maintained at a predetermined time (for example, 5 minutes) or more in a state where the distance between the wearable device 200 and the object is less than or equal to the first threshold value. In another embodiment, when the sensing data is angle data detected by the gyro sensor, the preset condition may be a condition of whether the angle of the wearable device 200 is equal to or less than a second threshold value. Alternatively, the preset condition may be a condition of whether the angle of the wearable device 200 is maintained for a preset time (for example, 5 minutes) or more in a state where the angle of the wearable device 200 is less than or equal to the second threshold value. In another embodiment, when the sensing data is illuminance data sensed by the illuminance sensor, the preset condition may be a condition as to whether the ambient illuminance is less than or equal to the third threshold. Alternatively, the preset condition may be a condition as to whether or not the peripheral illuminance has been maintained for a preset time (for example, 5 minutes) or less in a state of being less than or equal to the third threshold value. Alternatively, the preset condition may be a difference between the peripheral illuminance obtained from the first illuminance sensor of the wearable device 200 and the illuminance of the area viewed by the user obtained from the second illuminance sensor of the wearable device 200 by at least a fourth threshold value. May be a condition for cognition.

The methods described above may be embodied in the form of program instructions that may be executed by various computer means and may be recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Although the present disclosure has been described with reference to the limited embodiments and the drawings, the present disclosure is not limited to the above embodiments, and those skilled in the art to which the present disclosure pertains may make various modifications and variations from such descriptions. This is possible. Therefore, the scope of the present disclosure should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

100: electronic device 110: communication unit
120: output unit 130: memory
140: processor 200: wearable device

Claims (16)

An electronic device for correcting a user's posture,
Communication unit;
An output unit;
A memory containing at least one instruction; and
And a processor connected to the communication unit, the output unit, and the memory to control the electronic device.
The processor executes the at least one instruction,
Performs a communication connection with the wearable device worn by the user through the communication unit,
Receive sensing data sensed by the wearable device from the wearable device through the communication booth,
And when the received sensing data satisfies a preset condition, controlling the output unit to output a message corresponding to the preset condition to guide the posture of the user.
The method of claim 1,
The sensing data may include data about a distance between the wearable device and an object detected by the distance measuring sensor of the wearable device, data about an angle detected by the gyro sensor of the wearable device, and an illumination sensor of the wearable device. And at least one of data on illuminance sensed by the electronic device.
The method of claim 2,
When the sensing data is data about the distance between the wearable device and the object detected by the distance measuring sensor,
And the processor controls the output unit to output information for guiding the posture of the user when the sensed distance is equal to or less than a first threshold value.
The method of claim 3,
The processor,
Control the output unit to output the information for guiding the user's posture when the detected distance is matched with time information and stored in the memory and the detected distance is equal to or less than the first threshold value for a preset time. An electronic device, characterized in that.
The method of claim 2,
When the sensing data is data on the angle detected by the gyro sensor,
And the processor controls the output unit to output information for guiding the posture of the user when the sensed angle is equal to or less than a second threshold value.
The method of claim 5,
The processor,
The output unit is controlled to match the time information with the time information and store it in the memory, and to output information for guiding the posture of the user when the detected angle is less than or equal to the second threshold value for a preset time. An electronic device, characterized in that.
The method of claim 2,
When the sensing data is data on the illuminance detected by the illuminance sensor,
The processor may control the output unit to output information for guiding the posture of the user when the sensed illuminance is greater than or equal to a third threshold value.
The method of claim 7, wherein
The processor,
First sensing data acquired from a first sensor for detecting illuminance around the wearable device through the communication unit, and a second sensor obtained from a second sensor for detecting illuminance of an area viewed by a user wearing the wearable device. Receive sensing data,
The output to output information for guiding the user's posture when a difference between a first illuminance value obtained from the first sensing data and a second illuminance value obtained from the second sensing data is greater than or equal to a fourth threshold value; Electronic device that controls wealth.
In the control method of the electronic device for the user posture correction,
Performing a communication connection with a wearable device worn by a user;
Receiving sensing data sensed by the wearable device from the wearable device;
Outputting a message corresponding to the preset condition to guide the posture of the user when the received sensing data satisfies the preset condition; Control method comprising a.
The method of claim 9,
The sensing data may include data about a distance between the wearable device and an object detected by the distance measuring sensor of the wearable device, data about an angle detected by the gyro sensor of the wearable device, and an illumination sensor of the wearable device. And at least one of the data on the illuminance sensed by the control method.
The method of claim 10,
The outputting step,
And outputting information for guiding the user's posture when the sensing data is data about a distance between the wearable device and the object detected by the distance measuring sensor and the detected distance is equal to or less than a first threshold value. Way.
The method of claim 11,
The outputting may include: matching the sensed distance with time information; And
Outputting information for guiding the posture of the user when the detected distance is less than or equal to the first threshold value for a preset time; Control method comprising a.
The method of claim 10,
The outputting step,
And the sensing data is data about an angle detected by the gyro sensor, and outputs information for guiding the user's posture when the detected angle is less than or equal to a second threshold.
The method of claim 13,
The outputting step,
Matching the sensed angle with time information; And
Outputting information for guiding a user's posture when the detected angle is less than or equal to the second threshold value for a preset time; Control method comprising a.
The method of claim 10,
The outputting step,
And if the sensing data is data about illuminance detected by the illuminance sensor and the detected illuminance is greater than or equal to a third threshold value, outputting information for guiding a user's posture.
The method of claim 15,
The receiving step,
First sensing data acquired from a first sensor for detecting illuminance around the wearable device through the communication unit, and a second sensor obtained from a second sensor for detecting illuminance of an area viewed by a user wearing the wearable device. Receiving sensing data; Including,
The outputting step,
And outputting information for guiding a user's posture when a difference between a first illuminance value obtained from the first sensing data and a second illuminance value obtained from the second sensing data is greater than or equal to a fourth threshold value.

Images