KR102550820B1 - Electronic device providing shoulder joint improvement solutions and program of the same - Google Patents

Abstract

An electronic device according to an aspect of the present invention includes a display unit, an acceleration sensor for sensing acceleration information on the movement of a user's arm, a gyro sensor for sensing angular velocity information on the movement of the user's arm, and the user's opinion received from a server. A guide image for guiding the user to move the arm, which is generated based on diagnostic data on the joint, is displayed on the display unit, and shoulder joint movement information according to the movement of the arm based on the acceleration information and the angular velocity information. Calculate , generate a motion image displayed on the guide image using the shoulder joint motion information, output the guide image and the motion image, transmit the shoulder joint motion information to the server, and and a control unit that receives a shoulder joint recovery solution corresponding to the diagnostic data and the shoulder joint motion information from and outputs it to the display unit.

Description

Electronic devices and programs that provide shoulder joint recovery solutions {ELECTRONIC DEVICE PROVIDING SHOULDER JOINT IMPROVEMENT SOLUTIONS AND PROGRAM OF THE SAME}

The present invention relates to an electronic device that provides a shoulder joint recovery solution and a program implementing the same, and more particularly, to an electronic device that acquires a user's arm movement using a sensor included in the electronic device.

Recently, as the number of people enjoying home training due to the rapid increase in the elderly population, excessive use of smartphones, golf, tennis, and corona era increases, the number of people with shoulder joint disease is increasing rapidly every year.

However, due to the nature of many degenerative diseases, patients do not visit the hospital on their own until they are accompanied by unbearable pain. The biggest reason is that access to medical information is very difficult for the general public, making it difficult to determine one's current condition.

In particular, in the case of frozen shoulder (frozen shoulder), in which the shoulder gradually hardens, early prevention and treatment are effective. .

In addition, most patients who have undergone shoulder surgery require steady rehabilitation treatment to restore the normal range of motion of the joint after surgery.

However, compared to other patients, there is no information on how the patient's condition is, so it is difficult to continue rehabilitation treatment.

Patent Publication No. KR 10-2017-0132509, 2017.12.04

An object to be solved by the present invention is to provide an electronic device that senses a movable range of an arm of a shoulder joint patient through a gyro sensor in order to provide a continuous and efficient health care solution to the shoulder joint patient.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

An electronic device according to an aspect of the present invention for solving the above problems includes a display unit and an acceleration sensor for sensing acceleration information about the movement of a user's arm

A guide image for guiding the user to move the arm, generated based on the diagnostic data on the user's shoulder joint received from the gyro sensor and the server for sensing the angular velocity information of the movement of the arm, is displayed on the display unit. and calculating shoulder joint motion information according to the movement of the arm based on the acceleration information and the angular velocity information, generating a motion image displayed on the guide image using the shoulder joint motion information, and generating the guide image and a control unit that outputs the motion image, transmits the shoulder joint motion information to the server, receives the diagnosis data and a shoulder joint recovery solution corresponding to the shoulder joint motion information from the server, and outputs the result to the display unit. include,

The shoulder joint improvement solution maps the diagnostic data and the shoulder joint motion information to the shoulder joint recovery guideline data stored in the server so that muscles in a predetermined area around the user's shoulder joint contract or relax. It includes content that guides the movement of the arm.

In addition, the control unit may perform a predetermined operation for improving an error of the angular velocity information using the acceleration information, and determine movable range information of the shoulder joint based on the angular velocity information with an improved error and the acceleration information. there is.

In addition, the control unit merges low-frequency acceleration information calculated by applying a predetermined low-pass filter to the acceleration information and high-frequency angular velocity information calculated by applying a predetermined high-pass filter to the angular velocity information to obtain movement information of the shoulder joint and the boundary frequency of the low pass filter and the high pass filter may be determined to be the same frequency.

Also, the controller may determine a similarity between the guide image and the motion image, and output a feedback message to the display unit based on the similarity.

In addition, the control unit receives average recovery data composed of recovery histories of a plurality of other users from the server, compares the average recovery data with information about the range of motion of the shoulder joint and the diagnosis data, and sends a feedback message to the display unit. can be printed out.

In addition, the control unit performs supervised learning by using recovery result data included in the average recovery data as correct answer data and rehabilitation history data included in the average recovery data as input data, and learning data formed by performing supervised learning at predetermined intervals. receiving and displaying the guide image optimized for the user on the display unit based on the learning data, the diagnosis data corresponding to the user, and shoulder joint motion information;

The learning data may be formed by applying at least one weight determined based on the shoulder joint motion information to at least one layer among a plurality of layers performing the supervised learning.

Also, the control unit may output a notification message for inducing movement of the user's shoulder joint to the display unit at a time point determined based on the diagnosis data.

Also, the control unit may receive a degree of recovery of the user determined using the diagnosis data and the shoulder joint motion information from the server, and output a state image corresponding to the degree of recovery to the display unit.

At this time, the acceleration sensor and the angular velocity sensor sense angular velocity information and acceleration information about the movement of the arm from the user's arm fixed with a mechanism provided to fix the arm at a predetermined angle,

Also, the control unit may determine movement information of the shoulder joint based on the predetermined angle.

In addition, the program according to an embodiment may be combined with a computer that is hardware and stored in a computer readable recording medium to execute the operation of the electronic device.

Other specific details of the invention are included in the detailed description and drawings.

An electronic device according to an embodiment may provide a continuous and efficient health care solution to a shoulder joint patient by sensing a range of motion of the arm of the shoulder joint patient.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a control block diagram of an electronic device according to an exemplary embodiment.
2 is a diagram illustrating a signal flow between an electronic device and a server according to an exemplary embodiment.
3 is a diagram illustrating that an electronic device is attached to a part of a user's arm in order to perform a shoulder joint solution according to an embodiment.
4 is a diagram for explaining an operation of contracting or relaxing muscles of a user's body through a shoulder joint solution according to an embodiment.
5 is a diagram illustrating an embodiment in which a user performs a shoulder joint solution according to an embodiment.
6A is a diagram showing a guide image and a motion image according to an embodiment, FIG. 6B is a diagram showing an output form of an image when the similarity between the guide image and the motion image is high, and FIG. 6C is a diagram showing the similarity between the guide image and the motion image. 6D is a diagram showing an output form of a guide image and a motion image of another form according to an embodiment.
7 is a diagram illustrating output of a state image of a user according to an exemplary embodiment.
8A and 8B are diagrams illustrating a form in which a feedback image is output to an electronic device according to an exemplary embodiment.
9 is a diagram illustrating a form in which a notification message is output to an electronic device according to an embodiment.
10A, 10B, and 10C are diagrams for explaining an operation in which an electronic device derives shoulder joint motion information using data sensed by a gyro sensor and an acceleration sensor, according to an exemplary embodiment.
11 is a diagram for explaining an operation of deriving an optimal shoulder joint improvement solution for a user through supervised learning according to an embodiment.
12 is a flow chart illustrating the operation of the present invention according to one embodiment.

Advantages and features of the present invention, and methods of achieving them, will become clear with reference to the detailed description of the following embodiments taken in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, only these embodiments are intended to complete the disclosure of the present invention, and are common in the art to which the present invention belongs. It is provided to fully inform the person skilled in the art of the scope of the invention, and the invention is only defined by the scope of the claims.

Terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, "comprises" and/or "comprising" does not exclude the presence or addition of one or more other elements other than the recited elements. Like reference numerals throughout the specification refer to like elements, and “and/or” includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first element mentioned below may also be the second element within the technical spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which the present invention belongs. In addition, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless explicitly specifically defined.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a control block diagram of an electronic device according to an embodiment, and FIG. 2 is a diagram illustrating a signal flow between an electronic device and a server according to an embodiment.

Referring to FIGS. 1 and 2 , the electronic device may include a communication unit, a display unit, a sensor unit, and a control unit.

In the present invention, the electronic device 10 may be implemented as a computer or a portable terminal. Here, the computer includes, for example, a laptop, a desktop, a laptop, a tablet PC, a slate PC, etc. equipped with a web browser, and a portable terminal, for example, has portability and mobility. As a guaranteed wireless communication device, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, smart phone (Smart Phone) based on all types of handhelds It may include a wireless communication device and a wearable device such as a watch, ring, bracelet, anklet, necklace, glasses, contact lens, or head-mounted-device (HMD).

Also, the electronic device 10 may be provided as a separate module including a gyro sensor and an acceleration sensor.

In this case, the electronic device 10 may be attached to the user's arm and detect the movement of the user's arm.

Also, the electronic device 10 may further include a camera. That is, the electronic device 100 may be provided with a module capable of calculating the movement of the arm, that is, the movement range of the joint, through the image of the arm acquired by the camera.

The communication unit 120 may include one or more modules enabling wireless communication between the electronic device 10 and the server 20 .

Also, the communication unit 120 may include one or more modules that connect the electronic device 10 to one or more networks.

The communication unit 120 may include at least one of a broadcast receiving module, a mobile communication module, a wireless Internet module, a short-distance communication module, and a location information module.

The display unit 130 displays (outputs) information processed by the terminal. For example, the display unit may display execution screen information of an application program driven in the terminal, or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information.

The display unit 130 may implement a touch screen by forming a mutual layer structure or integrally with the touch sensor. Such a touch screen may function as a user input unit providing an input interface between the terminal and the user and provide an output interface between the terminal 100 and the user.

The sensor unit 140 may include one or more sensors for sensing at least one of information within the terminal, surrounding environment information surrounding the terminal, and user information.

In the present invention, the sensor unit 140 may include a gyro sensor 142 and an acceleration sensor 141 .

The acceleration sensor 141 may sense acceleration information about the movement of the user's arm.

The acceleration sensor 141 may be implemented as a 3-axis sensor. The acceleration sensor may be implemented to obtain acceleration information in x-axis, y-axis, and z-axis directions when the user's arm moves in three dimensions.

The gyro sensor 142 may sense angular velocity information about arm movement.

The gyro sensor 142 senses an angular velocity, unlike an acceleration sensor that measures acceleration. Specifically, the gyro sensor 142 may be provided as a sensor capable of measuring an angular velocity of an object by using a property of maintaining an initially set direction.

The controller 110 receives a guide image D103 for guiding the user to move the arm based on the diagnosis data D203 for the user's shoulder joint received from the server 20, and displays the guide image D103 on the display unit 130. can be displayed

Specifically, the server diagnoses the user's shoulder joint condition and transmits pre-formed diagnostic data (D203) to the electronic device, and the control unit uses the diagnostic data (D203) to guide the most suitable shoulder joint movement for the user. An image D203 can be calculated and transmitted.

The server may store diagnostic data D203 for diagnosing the condition of the user's shoulder joint.

The server 20 may include a communication module for communicating with an electronic device, a memory, and at least one processor.

The guide image D103 is an image capable of guiding the movement of the user's arm to stimulate muscles around the shoulder joint, and the shape is not limited.

The controller 110 may calculate shoulder joint movement information according to the movement of the arm based on the acceleration information and the angular velocity information.

The shoulder joint motion information may be calculated by predicting the movement of the shoulder based on the movement of the user's arm derived based on the acceleration information and the angular velocity information of the user's arm.

Meanwhile, the controller 110 may generate a motion image D104 displayed on the guide image by using the shoulder joint motion information.

The motion image is generated corresponding to the user's arm movement, but may be formed by reflecting the user's shoulder movement.

The controller 110 may transmit shoulder joint motion information to the server.

In detail, the control unit 110 may transmit shoulder joint motion information to the server through the communication unit 120, and the server may receive it and diagnose the user's condition.

Meanwhile, the controller 110 may receive the diagnosis data D203 and the shoulder joint recovery solution D202 corresponding to the shoulder joint motion information from the server and output the received diagnosis data D203 to the display unit.

The shoulder joint recovery solution D202 may include all contents capable of improving the user's shoulder joint motion.

That is, the shoulder joint recovery solution (D202) matches the diagnostic data (D203) and shoulder joint motion information to the shoulder joint recovery guideline data (D204) stored in the server, so that the muscles of a predetermined area around the user's shoulder joint are restored. It may include content that guides the user's arm movement to contract or relax. These contents may include the aforementioned guide images and the like.

The shoulder joint recovery guideline data D204 may refer to data in which the server has accumulated a history of shoulder joint improvement of a number of users.

The controller 110 may perform a predetermined operation to improve an error of angular velocity information using acceleration information.

In addition, the control unit 110 may determine the movable range information of the shoulder joint based on the angular velocity information and the acceleration information with improved error.

The predetermined operation performed by the control unit 110 is a combination of high-frequency angular velocity information calculated by applying a predetermined low-pass filter to angular velocity information and low-frequency angular velocity information calculated by applying a predetermined high-pass filter to acceleration information. It may include an operation to determine operation information.

Meanwhile, the boundary frequency of the low pass filter and the high pass filter used by the controller 110 may be determined to be the same frequency. A detailed description of a predetermined operation performed by the control unit 110 will be described later.

The controller 110 may determine a similarity between the guide image and the motion image, and output a feedback message D101 to the display unit based on the similarity.

The controller 110 may receive average recovery data D201 composed of recovery histories of a plurality of other users from the server.

The average recovery data D201 may refer to data including an average state of improvement by accumulating recovery data of the shoulder joint of not only the user but also other users.

Meanwhile, the controller 110 may output a feedback message to the display unit by comparing the average recovery data with information on the range of motion of the shoulder joint and diagnosis data D203.

In detail, the controller 110 may form and output a feedback message based on whether the user's shoulder joint motion is better than the average.

The control unit 110 uses the recovery result data included in the average recovery data D201 as correct answer data, and performs supervised learning using the rehabilitation history data included in the average recovery data D201 as input data to obtain learning data formed. It can be received at every predetermined period.

Supervised learning is a method of machine learning for inferring a function from training data. A detailed description of supervised learning will be described later.

Meanwhile, the learning data may be formed by applying at least one weight determined based on shoulder joint motion information to at least one layer among a plurality of layers performing supervised learning.

An operation in which the control unit 110 performs this operation will be described in detail below.

The controller 110 may form a guide image using the learning data.

In addition, the controller 110 may output a notification message for inducing movement of the user's shoulder joint to the display unit at a time point determined based on the diagnosis data.

The controller 110 may determine the degree of recovery of the user by using the diagnosis data D203 and the shoulder joint motion information.

The degree of recovery can be derived by comparing shoulder motion information and diagnostic data with average recovery data.

In detail, the server may determine that the recovery rate of the user is high if the recovery speed of the user is faster than that of other general users.

The controller 110 may output a state image corresponding to the degree of recovery to the display unit.

The acceleration sensor 141 and the gyro sensor 142 are mechanisms provided to fix the arm at a predetermined angle, and can sense angular velocity information and acceleration information about the motion of the user's arm, which is fixed to the user's arm.

The mechanism for fixing the arm will be described in detail below.

The controller 110 generally controls overall operations of the electronic device in addition to operations related to the application program. The control unit may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the components described above or by driving an application program stored in a memory.

The control unit 110 includes a memory (not shown) for storing data for an algorithm or a program for reproducing the algorithm for controlling the operation of components in the electronic device, and a processor for performing the above-described operation using the data stored in the memory. (not shown) may be implemented. In this case, the memory and the processor may be implemented as separate chips. Alternatively, the memory and the processor may be implemented as a single chip.

At least one component may be added or deleted corresponding to the performance of the components of the electronic device shown in FIGS. 1 and 2 . In addition, it will be easily understood by those skilled in the art that the mutual positions of the components may be changed corresponding to the performance or structure of the system.

Meanwhile, each component shown in FIGS. 1 and 2 means software and/or hardware components such as a Field Programmable Gate Array (FPGA) and Application Specific Integrated Circuit (ASIC).

3 is a diagram showing that the electronic device 10 is attached to a part of the user's arm in order to perform a shoulder joint solution according to an embodiment.

Referring to FIG. 3 , it is shown that the electronic device 10 is attached to the user's arm.

As described above, an acceleration sensor and a gyro sensor may be provided in the electronic device, and based on these, the electronic device 10 may sense the movement of the user's arm.

Meanwhile, when the electronic device senses the motion of the user's arm, the arm may be fixed using a mechanism K3 provided to fix the arm at a predetermined angle.

The user may perform operations such as raising the arm upward, turning the arm outward, and turning the arm inward based on the above-described guide image.

When the electronic device 10 measures the angle of the user's arm, the outward rotation and inward rotation of the arm can be accurately measured only when the elbow is bent to 90 degrees.

However, since the movement of the arm is rarely measured in a state in which the elbow is bent accurately, in the present invention, the movement of the user's arm while the user's arm is fixed using the mechanism (K3) for fixing the angle of the user's arm can sense.

This mechanism (K3) can be configured to measure the angle when the user performs an outward rotation and an inward rotation of the arm by allowing the elbow to be bent only up to 90 degrees when the elbow is bent.

While wearing the device K3 described above, the user can attach the electronic device 10 to the device K3, and the gyro sensor and acceleration sensor included in the electronic device 10 can sense the movement of the user's arm. can

The sensed angular velocity and acceleration of the user's arm may be used to determine shoulder joint motion information.

A detailed description of this will be given later.

4 is a diagram for explaining an operation of contracting or relaxing muscles of a user's body through a shoulder joint solution according to an embodiment.

On the other hand, if the shoulder joint improvement solution is provided through the present invention, the user can perform contraction or relaxation of muscles around the shoulder joint.

The shoulder joint is composed of three bones, the collarbone, the shoulder blade, and the upper arm bone, and is composed of muscles, ligaments, and tendons related to them. In a narrow sense, the shoulder joint refers to a joint formed by the meeting of the collarbone and shoulder blade with the upper arm bone, but in a broad sense, it may refer to all joints formed by the meeting of these three bones.

In FIG. 4, levator scapula muscle (M41), supraspinatus muscle (M42), scapula muscle (M43), and infraspinatus muscle (M44) are presented as examples of muscles around the shoulder joint.

In addition, although not explicitly mentioned in FIG. 4, joint exercises can be performed with various muscles such as the infraspinatus, subscapularis, and teres minor muscles through the shoulder joint solution provided in the present invention.

The user can improve the mobility of the shoulder joint by contracting or relaxing the muscles around the shoulder joint based on the above-described operation.

Meanwhile, when the user moves the arm in response to the shoulder joint improvement solution based on the above-mentioned or later-described operation, the movement ability of the shoulder joint can be improved by contracting or relaxing the muscles around the shoulder joint.

5 is a diagram illustrating an embodiment in which a user performs a shoulder joint solution according to an embodiment.

Referring to FIGS. 5 and 4 together, the user can change the angle of the arm relative to the torso based on the guide image output on the electronic device.

Specifically, the user may move the arm so that the output guide image and the motion image of the arm correspond to each other according to an operation described later. 5 shows that the user's arm is raised 120 degrees above the user's torso (A5).

For example, the electronic device may output a guide image for the user to perform an arm raising exercise up to the point T5.

When the user's arm is raised based on the user's torso, the electronic device attached to the user's arm can obtain the movement of the user's arm using the gyro sensor and the acceleration sensor, and derive shoulder joint path information using this. there is.

Based on this motion, the user can contract or relax the muscles around the shoulder joint shown in FIG. 4 to improve the shoulder joint movement ability.

According to one embodiment of the present invention, the user contracts or contracts the levator scapula muscle (M41), supraspinatus muscle (M42), scapula muscle (M43), and infraspinatus muscle (M44) through the motion of raising the arm through the shoulder joint solution provided by the electronic device. relaxation can be performed.

In addition, the user can perform joint exercises with various muscles such as the subscapularis, subscapularis, and teres minor muscles through the shoulder joint solution.

These supraspinatus exercises can improve the movement of the shoulder joint.

On the other hand, the contents described in FIGS. 4 and 5 are diagrams for explaining the shoulder joint muscles contracted or relaxed through the operation of the present invention, and there is no limit to the muscles around the shoulder joint whose motor ability is improved through the operation of the present invention. .

6A is a diagram showing a guide image and a motion image according to an embodiment, FIG. 6B is a diagram showing an output form of an image when the similarity between the guide image and the motion image is high, and FIG. 6C is a diagram showing the similarity between the guide image and the motion image. 6D is a diagram showing an output form of a guide image and a motion image of another form according to an embodiment.

Referring to Figure 6a shows a graph of the angle of the arm over time.

As described above, the electronic device may derive a guide image G6a for guiding the user to move the arm based on the diagnosis data on the user's shoulder joint received from the server.

The guide image G6a may correspond to information about the angle of the arm that can improve the user's shoulder movement ability based on the user's current condition. Therefore, the user can recognize the guide image and move the user's arm to correspond with the guide image.

The electronic device may obtain acceleration information and angular velocity information using the motion of the arm and derive a motion image M6a corresponding to the motion of the arm.

The motion image M6a derived by the electronic device may be output to the user terminal together with the guide image G6a as shown in FIG. 6a.

Referring to FIG. 6B, an output form when the similarity between the guide image and the motion image is high is shown, and referring to FIG. 6C, the output form when the similarity between the guide image and the motion image is low is shown.

The electronic device may determine a similarity between the guide image and the motion image, and output a feedback message to the display unit based on the similarity.

As shown in FIG. 6B, when the guide image G6b and the motion image M6b are similar, since the user performed an arm movement corresponding to the guide image, the electronic device outputs a feedback image F6b such as "GOOD!!!" can do.

On the other hand, as shown in FIG. 6c, when the guide image G6c and the motion image M6c are different, the user did not properly perform the arm movement corresponding to the guide image, and the electronic device displays a feedback image (F6c) such as "Just a little more!" ) can be output.

Meanwhile, the user can recognize the feedback images output in FIGS. 6B and 6C and maintain the existing arm movement state or perform arm movement so that the motion image is more consistent with the guide image. Meanwhile, there is no limitation on the shape of the output guide image and the motion image corresponding to the user's arm movement.

Referring to FIG. 6D , the electronic device may provide motion guides for “raising the arm”, “rotating the arm outside”, and “rotating the arm inside” through a guide image G6d.

In addition, when the guide image (G6d) is output in the form of a two-dimensional triangle as shown in FIG. can be output.

FIG. 6D shows that the user performed "rotate the arm outward" and "turn the arm inward" a lot, and "raise the arm upward" a little.

Each motion is output so that it can be confirmed at a glance, so that the user can determine how much he or she has performed the motion guided by the electronic device.

Meanwhile, the guide image, motion image, and feedback image shown in FIGS. 6a, 6b, 6c, and 6d are only one embodiment of the present invention, and can induce the user's arm movement to improve the user's shoulder joint movement. As long as it is in the form of an image, the embodiment is not limited.

7 is a diagram illustrating output of a user state image S7 according to an exemplary embodiment.

Fig. 7 is a diagram showing the user's condition in terms of exercise level during the month of March.

A server that communicates with the electronic device may derive the determined degree of recovery of the user using the diagnosis data and shoulder motion information.

Diagnosis data is information about the user's shoulder joint treatment progress, etc., and if the diagnosis data and shoulder joint motion information are compared, the degree of recovery of the user at a specific point in time can be derived.

Based on this, the user's exercise level can be determined as 6 in the 1st week, 4 in the 2nd week, 5 in the 3rd week, and 8 in the 4th week, and the electronic device can output the corresponding state image S7 as shown in FIG. 7. there is.

By outputting the user's state image in this way, the user can self-diagnose the movement state of the shoulder joint.

The embodiment of the present invention for the status message shown in FIG. 7 is not limited thereto.

8A and 8B are diagrams illustrating a form in which a feedback image is output to an electronic device according to an exemplary embodiment.

Referring to FIG. 8A , the electronic device outputs the average recovery data S8a and the feedback image F8a received from the server.

Specifically, the electronic device may receive average recovery data composed of recovery histories of a plurality of other users from the server.

8a shows the average exercise level (R8a) of other users for each week. The controller may compare the average recovery data of other users received from the server with the exercise level S8a corresponding to the user.

In FIG. 8a , since the user's exercise level S8a exceeds the average recovery data, it can be determined that the user's recovery is faster than other users.

In this case, the electronic device may output a feedback message F8a to the display unit by comparing the average recovery data received from the server with information about the range of motion of the shoulder joint and diagnosis data.

In FIG. 8A , since it is shown that the user faithfully performed the shoulder joint exercise, a feedback message (F8a) such as “You did very well” can be output.

Meanwhile, FIG. 8B shows outputting a feedback message (F8b) in a different form.

Specifically, FIG. 8B shows a feedback message F8b in a situation in which the user does not actively perform the shoulder joint exercise. The electronic device 10 may output a feedback message F8b such as "You have been very busy this week. You need more stretching."

Meanwhile, the feedback message F8b output by the electronic device 10 is not limited.

9 is a diagram illustrating a form in which a notification message is output to an electronic device according to an exemplary embodiment.

The electronic device 10 may output a notification message A9 for inducing movement of the user's shoulder joint to the display unit at a time point determined based on the diagnosis data.

9 shows that a notification message (A9) for allowing the user to perform shoulder joint stretching in the morning is output.

Specifically, in FIG. 9 , a notification message (A9) such as “It is time to start stretching in the morning” is output.

The control unit of the electronic device 10 may determine a notification period in which the user can optimize the effect of shoulder joint stretching based on the user's diagnosis data, and output a notification message A9 for each corresponding period. In the case of FIG. 9, a notification message (A9) is output every morning at 8:30 to inform the user, and the user can perform the shoulder joint exercise when viewing the notification message.

Meanwhile, there is no limitation on the form of the notification message, and there is no limitation on the output period of the notification message.

10A and 10B are diagrams for explaining an operation of deriving shoulder joint motion information by using data sensed by a gyro sensor and an acceleration sensor by an electronic device according to an embodiment.

The controller may perform a predetermined operation for improving an error of angular velocity information obtained by the gyro sensor using acceleration information obtained by the acceleration sensor.

The predetermined operation may refer to a complementary filter to be described later.

Specifically, the controller may calculate high-frequency angular velocity information by applying a predetermined high pass filter to the angular velocity information.

In addition, the controller may calculate the low frequency speed by applying a predetermined low pass filter to the acceleration information.

10A shows a high-pass filter L101 applied to angular velocity information and a low-pass filter L102 applied to acceleration information.

Acceleration sensors have a disadvantage of high noise, and gyro sensors are relatively accurate, but have a disadvantage of accumulating integration errors.

Accordingly, the controller may use a high pass filter L101 for the angular velocity sensor and a low pass filter L102 for the gyro sensor, and use a complementary filter integrating them.

Such a complementary filter may be derived based on Equation 1 below.

Referring to Equation 1, θ _f denotes a complementary filter performed by the controller, θ _a denotes acceleration information acquired by the acceleration sensor, and θ _g denotes angular velocity information obtained by the gyro sensor. t denotes a time constant of the complementary filter and s may denote a frequency variable.

Meanwhile, the time constant may be determined based on the frequency f10a of the intersection of the high pass filter L101 applied to the angular velocity and the low pass filter L102 applied to the acceleration.

10A shows that a high-pass filter applied to angular velocity and a low-pass filter applied to acceleration form an intersection at f10a.

In forming the complementary filter, in order to prevent distortion of information in the middle, the value of the time constant serving as the criterion for the cut-off frequency must be determined equally for both the low-pass filter and the high-pass filter.

Accordingly, the time constant corresponding to the complementary filter may be determined as an intersection of the Bode diagrams of the high pass filter and the low pass filter. Therefore, in FIG. 10A, f10a can be determined as the cut-off frequency of the complementary filter.

Meanwhile, the control unit may finally determine movement information of the shoulder joint by merging the high-frequency angular velocity and the low-frequency acceleration calculated through the complementary filter shown in FIG. 10A.

Meanwhile, the control unit may additionally use a band pass filter in the complementary filter of FIG. 10A.

Referring to FIG. 10B, since the control unit uses a complementary filter, the sensed data is blocked based on f10b, and thus data distortion may occur.

Accordingly, the control unit may additionally provide a band pass filter T10b capable of amplifying data of a corresponding frequency band.

10B shows that a band pass filter T10b applied to sensing data around a f10b frequency is provided.

Meanwhile, the band pass filter T10b may normalize the entire data by amplifying data around f10b.

Meanwhile, FIG. 10C shows the final sequence of these operations.

Referring to FIG. 10C , the controller may obtain information on the acceleration and angular velocity of the arm through the aforementioned acceleration sensor and gyro sensor (S1001).

In addition, the control unit may calculate acceleration information of low-frequency components and angular velocity information of high-frequency components using the above-described complementary filter (S1002).

Next, the control unit may finally apply a band-pass filter to the low-frequency acceleration information and the high-frequency angular velocity information calculated through the complementary filter to calculate shoulder movement information of the user (S1003).

Meanwhile, the operation related to the complementary filter of the present invention described in FIGS. 10A, 10B, and 10C is only an example of the complementary filter operation of the present invention, and the operation of the present invention for improving the accuracy of data sensed through the acceleration sensor and the gyro sensor. There are no restrictions on motion.

11 is a diagram for explaining an operation of deriving an optimal shoulder joint improvement solution for a user through supervised learning according to an embodiment.

Supervised learning (SUPERVISED LEARNING) is already a method of machine learning (MACHINE LEARNING) for inferring a function from input data (ID11), that is, training data (TRAINING DATA).

Training data generally includes attributes of input objects in the form of vectors, and may include desired results for each vector.

Meanwhile, this supervised learning requires correct answer data RD11.

The answer data RD11 may mean ultimate target data that presents a direction of data in machine learning.

Since the server needs to calculate learning data that serves as a guide for recovery for the user's shoulder joint recovery, recovery result data included in the average recovery data included in the server can be used as the correct answer data RD11.

That is, the recovery result data included in the average recovery data may be input as correct answer data RD11 to the layer L11 constituting the learning model.

The recovery result data may refer to a set of data when users are recovered from the average recovery data.

In a learning model that performs supervised learning, rehabilitation history data ID11 may be input as input data to the input layer IL11.

The server may form learning data OD11 by performing supervised learning using rehabilitation history data included in the average recovery data as input data.

Meanwhile, the electronic device may receive the learning data OD11 at predetermined intervals.

Meanwhile, the user terminal may generate a guide image optimized for the user based on learning data, diagnostic data corresponding to the user, and shoulder joint motion information, and display the guide image on the display unit.

Meanwhile, the learning data OD11 calculated by the server is formed by applying at least one weight W11 determined based on the shoulder joint motion information to at least one layer among the plurality of layers L11 performing the supervised learning. It can be.

When the server performs supervised learning, a learning model including a plurality of layers L11 may be formed as shown in FIG. 10B.

Meanwhile, a weight W11 applied to received data may be applied to each layer L11, and the weight W11 may be determined using at least one piece of shoulder joint motion information received through an electronic device.

Meanwhile, the supervised learning operation performed by the server described in FIG. 11 is only one embodiment of the present invention, and the operation in which the server performs learning using various data and the electronic device outputs a guide image using the learned data no limits.

12 is a flow chart illustrating the operation of the present invention according to one embodiment.

Referring to FIG. 12 , the electronic device may sense the arm's acceleration information and angular velocity information (S1210).

Meanwhile, the electronic device may derive shoulder joint motion information using the obtained acceleration information and angular velocity information and a complementary filter (S1220).

The electronic device may transmit the derived shoulder joint motion information to the server (S1230).

Meanwhile, the server may generate a shoulder joint improvement solution capable of improving the user's shoulder joint using the shoulder joint motion information, and the electronic device may receive the shoulder joint solution (S1240).

Subsequently, the electronic device may output the guide image included in the shoulder joint solution to the electronic device (S1250).

Then, when the user moves the arm in response to the guide image, the electronic device may acquire the user's arm movement again and continue to perform the above-described operation.

The disclosed embodiments may be implemented as a S/W program including instructions stored in computer-readable storage media.

A computer is a device capable of calling instructions stored in a storage medium and performing operations according to the disclosed embodiments according to the called instructions, and may include an ultrasound diagnosis apparatus according to the disclosed embodiments.

The computer-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium does not contain a signal and is tangible, but does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

Also, the ultrasound diagnosis apparatus or method according to the disclosed embodiments may be included in a computer program product and provided. Computer program products may be traded between sellers and buyers as commodities.

A computer program product may include a S/W program and a computer-readable storage medium in which the S/W program is stored. For example, the computer program product may include a product (eg, downloadable app) in the form of a S/W program electronically distributed through a manufacturer of an ultrasound diagnosis device or an electronic market (eg, Google Play Store, App Store). can For electronic distribution, at least a part of the S/W program may be stored in a storage medium or temporarily generated. In this case, the storage medium may be a storage medium of a manufacturer's server, an electronic market server, or a relay server temporarily storing SW programs.

Steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, implemented in a software module executed by hardware, or implemented by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any form of computer readable recording medium well known in the art to which the present invention pertains.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

10: electronic devices
110: control unit
120: communication department
141: acceleration sensor
142: gyro sensor

Claims (10)

display unit;
an acceleration sensor for sensing acceleration information about the movement of a user's arm;
a gyro sensor for sensing angular velocity information about the movement of the arm;
a mechanism provided to fix the arm at a predetermined angle;
displaying a guide image for guiding the user to move the arm, which is generated based on diagnostic data on the user's shoulder joint received from the server, on the display;
Based on the acceleration information and the angular velocity information, shoulder joint motion information according to the movement of the arm is calculated;
generating a motion image displayed on the guide image using the shoulder joint motion information;
Outputting the guide image and the motion image, displaying them in the form of a graph for the angle of the arm over time;
Transmitting the shoulder joint motion information to the server;
A control unit for receiving the diagnostic data and the shoulder joint recovery solution corresponding to the shoulder joint motion information from the server and outputting the received solution to the display unit;
The shoulder joint recovery solution,
Corresponding the diagnosis data and the shoulder joint motion information to the shoulder joint recovery guideline data stored in the server,
Includes content that guides the user's arm movement so that muscles in a predetermined area around the user's shoulder joint contract or relax;
The acceleration sensor and the gyro sensor sense angular velocity information and acceleration information about movement of the user's arm fixed at a predetermined angle by the device,
The mechanism is configured so that when the user bends the elbow, the elbow is bent at a predetermined angle so that the angle can be measured when the user performs outward rotation and inward rotation of the arm,
The control unit,
determining the shoulder joint motion information based on the predetermined angle;
The similarity between the guide image and the motion image is determined, and based on the similarity, whether or not the user performed an arm movement corresponding to the guide image is determined to maintain an existing state of arm movement on the display unit, or outputting a feedback message allowing the arm exercise to be matched with the guide image,
Average recovery data consisting of recovery histories of a plurality of other users is received from the server, and the average recovery data is compared with information about the range of movement of the shoulder joint and the diagnosis data, so that the improvement state of the user's shoulder joint movement is better than the average. An electronic device that outputs a feedback message formed based on whether or not the According to claim 1,
The control unit,
Performing a predetermined operation to improve an error of the angular velocity information using the acceleration information;
An electronic device that determines motion range information of the shoulder joint based on the angular velocity information and the acceleration information with improved errors. According to claim 2,
The control unit,
Determining movement information of the shoulder joint by merging low-frequency acceleration information calculated by applying a predetermined low-pass filter to the acceleration information and high-frequency angular velocity information calculated by applying a predetermined high-pass filter to the angular velocity information;
The electronic device of claim 1 , wherein a boundary frequency of the low pass filter and the high pass filter is determined to be the same frequency. delete delete According to claim 1,
The control unit,
Receiving learning data formed by performing supervised learning by using recovery result data included in the average recovery data as correct answer data and using rehabilitation history data included in the average recovery data as input data at predetermined intervals;
displaying the guide image to the user on the display unit based on the learning data, the diagnosis data corresponding to the user, and shoulder joint motion information;
The learning data,
An electronic device formed by applying at least one weight determined based on the shoulder joint motion information to at least one layer among a plurality of layers performing the supervised learning. According to claim 1,
The control unit,
An electronic device that outputs a notification message for inducing movement of the user's shoulder joint to the display unit at a point in time determined based on the diagnostic data. According to claim 1,
The control unit,
Receiving a degree of recovery of the user determined using the diagnosis data and the shoulder joint motion information from the server;
An electronic device that outputs a state image corresponding to the degree of recovery to the display unit. delete A program that is combined with a computer that is hardware and stored in a computer-readable recording medium to execute the operation of the electronic device according to any one of claims 1 to 3 and 6 to 8.

Images