KR20170106289A - Method, device, system and non-transitory computer-readable recording medium for providing feedback - Google Patents

Abstract

According to one aspect of the present invention there is provided a method for providing feedback comprising the steps of obtaining information about the attitude or motion of at least one device worn by a user, , Recognizing a trajectory and a speed of an operation performed by the user, and when the user determines that the trajectory and the speed are repeatedly performing similar operations at a predetermined level or more, referring to the trajectory and speed of the repetitive operation Determining a motion that the user is performing, and controlling an attribute of feedback to be provided to the user with reference to the specified motion.

Description

METHOD, DEVICE, SYSTEM AND NON-TRANSITORY COMPUTER READABLE RECORDING MEDIUM FOR PROVIDING FEEDBACK BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]

The present invention relates to methods, devices, systems and non-transitory computer-readable media for providing feedback.

In recent years, mobile smart devices having various communication and sensing functions and powerful computing functions such as smart phones and smart pads are widely used. Some of these mobile smart devices include a relatively small size that can be worn on the body by a user (e.g., smart devices in the form of smart glasses, smart watches, smart bands, rings or broaches, Smart devices that are attached or embedded).

In particular, technology has been introduced to provide information on the operation performed by the user by utilizing various sensors provided in the device worn by the user. According to the conventional technology, the number of steps, the moving distance, the exercise time And so on, it is difficult to provide intuitive feedback on the actions the user is performing.

It is an object of the present invention to solve all the problems described above.

In addition, the present invention acquires information on the attitude or motion of at least one device worn by the user, recognizes the trajectory and velocity of the motion performed by the user with reference to the obtained attitude or motion information If the user determines that the trajectory and the speed are repeatedly performing similar operations repeatedly at a predetermined level or more, the user is specified with reference to the trajectory and speed of the repetitively performed operation, It is another object of the present invention to provide various feedbacks on the exercise intuitively to a user who is performing a motion composed of repetitive unit motions by determining the feedback to be provided to the user with reference to motions.

In order to accomplish the above object, a representative structure of the present invention is as follows.

According to one aspect of the present invention there is provided a method for providing feedback comprising the steps of obtaining information about the attitude or motion of at least one device worn by a user, , Recognizing a trajectory and a speed of an operation performed by the user, and when the user determines that the trajectory and the speed are repeatedly performing similar operations at a predetermined level or more, referring to the trajectory and speed of the repetitive operation Determining a motion that the user is performing, and controlling an attribute of feedback to be provided to the user with reference to the specified motion.

According to another aspect of the present invention there is provided a device for providing feedback comprising: a sensor module for obtaining information about the attitude or motion of at least one device worn by a user; Recognizes the trajectory and speed of the operation performed by the user, and when the user determines that the trajectory and the speed are repeatedly performing similar operations at a predetermined level or higher, the trajectory and speed of the repeated operation are referred to And a program module for specifying a motion performed by the user and controlling an attribute of feedback to be provided to the user with reference to the specified motion.

According to another aspect of the present invention, there is provided a system for providing feedback, comprising: obtaining information about the attitude or motion of at least one device worn by a user, and referring to information about the obtained attitude or motion Recognizes the trajectory and speed of the operation performed by the user, and when the user determines that the trajectory and the speed are repeatedly performing similar operations at a predetermined level or higher, referring to the trajectory and speed of the repetitive operation A control unit for specifying an exercise performed by the user and controlling an attribute of feedback to be provided to the user with reference to the specified exercise, and a storage for storing information provided from the at least one device / RTI >

In addition, there is further provided a non-transitory computer-readable recording medium for recording a computer program for carrying out the method and a device, system, and other methods for implementing the invention.

According to the present invention, even when a user performs a motion that is not selected or stored beforehand, that is, even when there is no prior information for recognizing the motion or specifying the motion, It is possible to recognize the strength and to specify the exercise performed by the user based on the recognition result.

In addition, according to the present invention, it is possible to intuitively provide various feedbacks regarding the exercise to a user who is performing exercise composed of repetitive unit motions, so that the user can easily and quickly determine whether or not he / The effect of being able to grasp is achieved.

In addition, according to the present invention, a user who is performing a motion can provide information on a motion performed by another user associated with the user, so that the user can grasp not only his / her own motion state, but also other user's motion state, Further, the effect of increasing the motional performance is achieved.

1 is a diagram showing a schematic configuration of an overall system for providing feedback according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a situation in which a user wearing a first device and a second device on both wrists performs an operation for a movement according to an embodiment of the present invention.
3 is a diagram illustrating a situation in which a user wearing a device on his / her wrist performs various operations according to an embodiment of the present invention.
4 is a diagram exemplarily showing a configuration for controlling an attribute of a feedback based on whether or not an operation performed by a user is similar to a unit operation constituting a motion according to an embodiment of the present invention.
5 is an exemplary diagram illustrating various feedbacks that may be provided to a user in accordance with an embodiment of the present invention.
FIG. 6 is a diagram illustrating an exemplary configuration for controlling an attribute of feedback provided to a user according to an exemplary embodiment of the present invention. Referring to FIG.
7 is a diagram illustrating exemplary information provided to a user according to an embodiment of the present invention.
8 is a diagram exemplarily showing a configuration for grouping a plurality of users performing similar motions according to an embodiment of the present invention.
FIG. 9 is a diagram illustrating a configuration for recognizing an operation with reference to a bio-electrical signal according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

Configuration of the entire system

1 is a diagram showing a schematic configuration of an overall system for providing feedback according to an embodiment of the present invention.

1, an overall system according to an embodiment of the present invention may include a communication network 100, a feedback providing system 200, and at least one device 310, 320.

First, the communication network 100 according to an embodiment of the present invention may be configured without regard to communication modes such as wired communication and wireless communication, and may be a LAN (Local Area Network), a Metropolitan Area Network ), A wide area network (WAN), and the like. Preferably, the communication network 100 referred to herein may be the well-known Internet or World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wire / wireless data communication network, a known telephone network, or a known wire / wireless television communication network, without being limited thereto. In addition, the communication network 100 may include at least a known short range wireless communication network implemented by Wi-Fi, Bluetooth, RFID, NFC, or the like.

Next, the feedback providing system 200 according to an exemplary embodiment of the present invention may be a digital device having memory means and equipped with a microprocessor and capable of computing. This feedback providing system 200 may be a server system. The feedback providing system 200 may provide the information or control command to one of the devices 310 and 320 through the communication network 100 or mediate one of the devices 310 and 320 to receive a predetermined information or control command from the other Function can be performed.

To this end, the feedback providing system 200 according to an embodiment of the present invention acquires information about the attitude or movement of at least one device 310, 320 worn by the user, as will be described in detail below And recognizes the trajectory and speed of the operation performed by the user with reference to the obtained attitude or information on the motion. If it is determined that the user is repeatedly performing the similar operation with the trajectory and speed at a predetermined level or higher, By referring to the trajectory and velocity of the repetitive motion of the user, and by controlling the attribute of the feedback to be provided to the user with reference to the motion specified above, A function that allows various feedbacks about the exercise to be intuitively provided to the user It can be carried out.

Such feedback may be performed by a control unit (not shown) included in the feedback providing system 200. Such control may be in the form of a program module within the feedback providing system 200. Such program modules may take the form of an operating system, application program modules or other program modules. The program module may also be stored in a remote storage device that is communicable with the feedback providing system 200. A program module, on the other hand, encompasses but is not limited to routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or perform particular abstract data types as described below in accordance with the present invention.

Also, the feedback providing system 200 according to an embodiment of the present invention stores information on the attitude or motion provided from the at least one device 310, 320, and this information is transmitted to at least one device 310, 320 And can be further utilized. The above-described storage may be performed by a repository (not shown) included by the feedback providing system 200. Such a repository is a concept including a computer-readable recording medium, and may be a broad database including a data base based on a file system as well as a consultation database.

The function of the feedback providing system 200 will be described in more detail below. Although described above with respect to the feedback providing system 200, this description is exemplary and it should be understood that at least some of the functions or components required of the feedback providing system 200 may include at least one It will be apparent to those skilled in the art that devices 310 and 320 may be implemented or included.

Finally, the device 310 in accordance with an embodiment of the present invention may include a feedback providing system 200 or other device 320 (preferably, the device 310 and the other device 320 are separate or external to each other) the device 310 may be any digital device equipped with a memory means and equipped with a microprocessor and capable of computation, 320). Devices 310 and 320 may be smart devices such as smart phones, smart pads, smart glasses, smart watches, smart bands, smart rings, and the like, or may be a desktop computer, a laptop computer, a workstation, a PDA, a web pad, , A keyboard, an electronic pen, and the like. In addition, the devices 310 and 320 may be IoT (Internet of Things) devices such as remote controllers and home appliances.

In particular, according to one embodiment of the present invention, the devices 310 and 320 may include at least one technical means capable of receiving an operation from a user. Examples of such technical means include a touch panel, a pointing tool (e.g., a mouse, a stylus, an electronic pen, etc.), a graphical object that can be operated by a user, a keyboard, a toggle switch, A recognition sensor, a distance sensor, and the like.

In addition, according to an embodiment of the present invention, the device 310 or 320 may include at least one technical means capable of generating feedback provided to the user. Examples of such technical means include a display panel, a vibration actuator, a speaker, and the like, which are known components.

According to an embodiment of the present invention, the devices 310 and 320 are provided with at least one technical means (i.e., a sensor module) capable of acquiring physical information about the posture or movement of the devices 310 and 320 . (GPS module, beacon-based positioning module or the like), a barometer, a distance sensor, a camera, and the like, which are known components of this technical means, which are known components such as a motion sensor, an acceleration sensor, a gyroscope, And the like.

According to an embodiment of the present invention, technology means (i.e., a sensor module) capable of acquiring biometric information acquired from a human body of a user holding the devices 310 and 320 is provided in the devices 310 and 320 . Examples of such technical means include an electromyogram signal measuring apparatus and the like.

Further, the devices 310 and 320 may further include an application program for generating information or control commands necessary for controlling the above-mentioned various technical means. Such an application may exist in the form of a program module within the device 310, 320. The nature of such a program module may be generally similar to the control of the feedback providing system 200 as described above. Here, the application may be replaced with a hardware device or a firmware device, at least some of which can perform substantially the same or equivalent functions as necessary.

Meanwhile, according to an embodiment of the present invention, the first device 310 and the second device 320 may have a predetermined relationship (for example, a relation that they belong to the same user, a relation that they function for the same user, , It is recognized that one of them is reasonable to authenticate or permit the other), the first device 310 and the second device 320 May be performed by the feedback providing system 200 or may be performed by the first device 310 and the second device 320. For example,

Examples

Hereinafter, a specific example in which the feedback providing system 200 according to the present invention provides feedback in a state where at least one device 310, 320 is interposed according to various embodiments will be described in detail.

According to an embodiment of the present invention, the feedback providing system 200 may obtain information about the attitude or movement of at least one device 310, 320 worn by the user, And when the user determines that the trajectory and the speed are repeatedly performing the similar operation at a predetermined level or higher, the trajectory and speed of the above-described repeated operation The user can specify the exercise performed by the user and control the attribute of the feedback to be provided to the user with reference to the specified exercise. According to one embodiment of the present invention, such feedback may be generated by the device 310, 320 worn by the user.

Specifically, according to one embodiment of the present invention, the device 310, 320 can move in conjunction with at least a portion of the body of the user wearing it. For example, the device 310, 320 may be a smart watch that can be worn on the wearer's wrist. In addition, in accordance with an embodiment of the present invention, the feedback providing system 200 may be configured such that the device 310, 320, in addition to information about the attitude or movement of the device 310, 320, With reference to the information, it is possible to recognize the trajectory and speed of the operation performed by the user.

In addition, the feedback providing system 200 according to an embodiment of the present invention compares the trajectory or speed of the unit operation constituting the specified movement with the trajectory or speed of the operation performed by the user, And can control the attributes of the feedback to be provided to the user by reference. Thus, according to one embodiment of the present invention, it is possible to provide feedback as to whether or not the user is accurately performing the unit operation constituting the motion.

According to an embodiment of the present invention, the feedback providing system 200 may further recognize the intensity of the operation performed by the user with reference to the information about the user's bio-signals obtained from the devices 310 and 320 . Further, according to an embodiment of the present invention, when the user determines that the trajectory, velocity, and intensity are repeatedly performing a similar unit operation at a predetermined level or more, the feedback providing system 200 may repeat the above- The motion that the user is performing can be specified with reference to the trajectory, speed, and intensity of the motion.

Meanwhile, according to an embodiment of the present invention, the feedback providing system 200 can refer to only the information about the user's bio-signal without the information about the motion or attitude of the devices 310 and 320 worn by the user's body Thereby recognizing the operation performed by the user.

FIG. 9 is a diagram illustrating a configuration for recognizing an operation with reference to a bio-electrical signal according to an embodiment of the present invention.

Referring to FIG. 9, the feedback providing system 200 according to an embodiment of the present invention repeatedly performs a fist-holding operation based on a pattern 910 appearing in an EMG signal measured at a user's wrist area Can be recognized.

Meanwhile, according to an embodiment of the present invention, the feedback providing system 200 may be configured such that, when specifying a motion constituted by an operation repeatedly performed by a user, By including the number of repetitive operations in the total number of repetitions of the operations constituting the motion, it is possible to prevent the repetition number of operations performed at the beginning of the motion from being missed in counting the total repetition number of the motions constituting the motion.

For example, it is specified that the user performs a motion called bench press based on the trajectory and velocity of the motion repeatedly performed by the user from one to three times, and after the motion is specified, Lt; RTI ID = 0.0 > 7 < / RTI > times. In such a case, the feedback providing system 200 according to an embodiment of the present invention is a reference in specifying the motion, in addition to seven times of the number of times the operation is repeatedly performed after the motion is specified, It is possible to determine that the user has repeated a total of 10 operations while performing a motion called bench press by counting three times, which is the number of times that the action performed before being repeatedly performed.

FIG. 2 is a diagram illustrating a situation in which a user wearing a first device and a second device on both wrists performs an operation for a movement according to an embodiment of the present invention.

Referring to FIG. 2, in response to the user repeatedly performing an operation 330 of raising and lowering a dumbbell in both arms by wearing a device 310, 320 on both wrists, The feedback providing system 200 according to the embodiment can determine that similar operations are repeatedly performed with a locus, speed, and intensity equal to or higher than a predetermined level, and refer to the trajectory, velocity, and intensity of the repetitive operation To specify the motion the user is performing and to generate feedback as to whether the user is performing a dumbbell exercise with the correct motion, as described below.

3 is a diagram illustrating a situation in which a user wearing a device on his / her wrist performs various operations according to an embodiment of the present invention.

Meanwhile, the feedback providing system 200 according to an exemplary embodiment of the present invention may be configured such that the trajectory, speed, and intensity of a unitary operation constituting a movement specified by the user and the trajectory, speed, If it is determined that the user is correctly performing the unit operation constituting the specific motion with reference to the similarity degree, the first feedback can be generated. On the other hand, if it is determined that the user is not performing the unit operation constituting the specific motion correctly, Feedback can be generated.

In addition, the feedback providing system 200 according to the embodiment of the present invention generates the feedback at the time point when the devices 310 and 320 are positioned at a specific point in the trajectory defining the unit operation .

4 is a diagram exemplarily showing a configuration for controlling an attribute of a feedback based on whether or not an operation performed by a user is similar to a unit operation constituting a motion according to an embodiment of the present invention.

Referring to FIG. 4, it can be assumed that a user wearing the devices 310 and 320 on both wrists is performing a squat movement in which the user walks with the backbone placed on his or her shoulder and repeats the rising motion . In this case, if the user is performing the correct operation, the first feedback can be generated (refer to FIG. 4A), and if the user is not performing the correct operation, the second feedback, which is distinguished from the first feedback, (See Fig. 4 (b)). The time at which the feedback is generated may be the time when the devices 310 and 320 are located at the highest points 411 and 421 and the lowest points 412 and 422 in the locus defining the above operation, May be located at the start point 411, 421 and the end point 412, 422 of the locus defining the above operation.

5 is an exemplary diagram illustrating various feedbacks that may be provided to a user in accordance with an embodiment of the present invention.

5, various types of feedback may be provided to the user, including visual feedback 532, auditory feedback 531, tactile feedback 533, and the like.

Meanwhile, the feedback providing system 200 according to an exemplary embodiment of the present invention controls the attribute of the feedback provided to the user with reference to the context information of the user's exercise time, exercise performance, condition, .

FIG. 6 is a diagram illustrating an exemplary configuration for controlling an attribute of feedback provided to a user according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 6, as the user's exercise time 611, 612 becomes longer, feedback can be provided more frequently to the user. As the condition based on the bio-signal acquired from the user's muscles 621, 622 is worse, It is possible to provide feedback to the user with a weaker intensity.

On the other hand, the attribute of the feedback that can be provided to the user in the present invention is not necessarily limited to the above-mentioned specific embodiments, but can be changed within a range that can achieve the object of the present invention Leave.

In addition, the feedback providing system 200 according to an embodiment of the present invention may provide information about various data obtained in the process of the user's motion to the devices 310 and 320, And the like.

7 is a diagram illustrating exemplary information provided to a user according to an embodiment of the present invention.

Referring to FIG. 7, various information such as a user's number of steps, heart rate, moving distance, and calorie consumption may be displayed on the devices 310 and 320 worn by the user.

Meanwhile, according to one embodiment of the present invention, the feedback providing system 200 can determine guide information to be provided to a user by referring to a motion performed by at least one other user belonging to the same group as the user. Here, at least one other user belonging to the same group as the user may be a user who is similar to the user in a physical state, a health state, or a movement state by a predetermined level or more, a predetermined relationship with the user on the social network service (SNS) And other users who have affiliations with the user.

Specifically, according to one embodiment of the present invention, the feedback providing system 200 provides information about the locus, velocity, or intensity of a unitary motion that constitutes a motion performed by at least one other user belonging to the same group as the user can do. For example, a message such as "as big as others "," lack of exercise quantity compared to friend ", and " Information can be provided.

8 is a diagram exemplarily showing a configuration for grouping a plurality of users performing similar motions according to an embodiment of the present invention.

8, a first user, a second user, and a third user, which appear to perform motions such as a bench press 821, a squat 823, etc., can be grouped into the same group have.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a non-transitory computer readable recording medium. The non-transitory computer readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the non-transitory computer-readable recording medium may be those specially designed and constructed for the present invention or may be those known to those skilled in the computer software arts. Examples of non-transitory computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, magneto-optical media such as floppy disks magneto-optical media), and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.

Therefore, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the following claims, I will say.

100: Network
200: feedback providing system
310: first device
320: second device

Claims (1)

A method for providing feedback.

Images