KR20220090961A - Feedback providing device, physical activity feedback providing system and method using the same - Google Patents

Abstract

The event information prepared to be performed by the user is stored, and event information matching the physical and psychological characteristics input from the user is outputted, the user's exercise motion is recognized, and the motion according to the event information and the user's exercise motion is displayed. To provide a system for providing feedback on physical activity that compares and generates difference information and outputs feedback information matching the difference information.

Description

Feedback providing device, system and method for providing feedback on physical activity using the same

The present invention relates to a feedback providing device, a system and method for providing feedback on physical activity using the same, and more particularly, to a feedback providing device for providing an exercise suitable for a user and providing feedback on the user's motion, and physical activity using the same It relates to a system and method for providing feedback.

Conventionally, as a method for coaching a user on various physical activities such as health, sports, and yoga, it is generally provided for the user to watch and follow a prepared image. In addition, in order to learn a specific motion, the user repeatedly watches a scene in which a professional athlete succeeds in the corresponding motion in an actual sports game.

However, in this method, the user or an educator coaching the user directly checks and corrects the user's motion while repeating a specific motion, which is the educator's habits or characteristics, or There is a disadvantage in that the user acquires an inaccurate motion according to the exercise ability.

Accordingly, there is a need for a method of providing a sport suitable for the user's exercise level and providing an appropriate feedback for the motion in which the user performs the exercise.

The technical problem to be solved by the present invention is to provide a feedback providing device that provides an exercise suitable for a user's characteristics, and a suitable feedback according to the user's motion following the provided exercise, and a system and method for providing feedback on physical activity using the same will be.

According to an aspect of the present invention, there is provided an exercise recommendation apparatus for storing a plurality of event information provided to be performed by a user, extracting event information matching the physical and psychological characteristics input from the user, and outputting the event information; and recognizing the user's exercise motion based on the event information, generating difference information by comparing the motion according to the event information with the user's exercise motion, and extracting and outputting feedback information matching the difference information A provision device may be included.

In addition, the exercise recommendation apparatus may further receive, from the user, prior activity information indicating an activity performed by the user in advance and nutrition intake information indicating nutrition of the food consumed by the user in advance.

In addition, the exercise recommendation apparatus may receive and analyze the user's face or voice to perform user recognition, and store physical and psychological characteristics input by the user to match the recognized user.

In addition, the feedback providing device receives a command for selecting one shape information from among a plurality of shape information indicating a shape to which feedback information provided in advance is output, and a motion according to the event information according to the selected shape information The command may be transmitted to the exercise recommendation device to output .

In addition, the shape information includes character shape information provided so that an arbitrary character prepared in advance performs a motion according to the event information, expert shape information indicating an image in which an arbitrary expert performs a motion according to the event information, and The virtual person whose shape is changed according to the body characteristics may include user shape information provided to perform a motion according to the event information.

In addition, the feedback providing device provides a command for selecting a shape from which feedback information is output from the user, a command for performing comparison on a specific part appearing in the exercise motion, and event information different from the event information output from the exercise recommendation device. A natural language representing at least one of a command for controlling output and a command for setting the difficulty level of motion according to the event information is input, analyzing the natural language to extract a machine language matching the natural language, and a command according to the machine language can be performed.

In addition, the feedback providing device receives the physical characteristics and the psychological characteristics from the exercise recommendation device, and allows the difference between the motion according to the event information and the user's exercise motion according to the physical characteristics and the psychological characteristics. You can set the range.

Another aspect of the present invention, one or more sensors are provided, the motion sensor unit for recognizing the user's motion; a feedback controller for generating difference information by comparing the motion according to the event information with the user's exercise motion, and extracting feedback information matching the difference information; and a feedback output unit for outputting the feedback information.

Another aspect of the present invention provides a method for providing physical activity feedback in a system for providing feedback on physical activity, the method comprising: receiving, in an exercise recommendation apparatus, physical characteristics and psychological characteristics from a user; a step of storing, in an exercise recommendation apparatus, a plurality of event information provided to be performed by a user, extracting event information matching the physical and psychological characteristics input from the user, and outputting the event information; Recognizing, in a feedback providing device, a user's exercise motion based on the event information; generating, in a feedback providing device, difference information by comparing the motion according to the event information with the user's exercise motion; and extracting and outputting feedback information matching the difference information in the feedback providing apparatus.

In addition, the step of receiving the input of the physical and psychological characteristics may further receive input from the user, prior activity information indicating an activity performed by the user in advance, and nutrition intake information indicating the nutrition of the food consumed by the user in advance.

In addition, in the step of receiving the input of the physical characteristics and psychological characteristics, the user's face or voice is input and analyzed to perform user recognition, and the body characteristics and psychological characteristics input from the user to match the recognized user may be stored. have.

In addition, the user receives a command to select one shape information from among a plurality of shape information indicating a shape to which feedback information provided in advance is output, and outputs the command to output a motion according to the event information according to the selected shape information. The method may further include transmitting to the exercise recommendation device.

In addition, the shape information includes character shape information provided so that an arbitrary character prepared in advance performs a motion according to the event information, expert shape information indicating an image in which an arbitrary expert performs a motion according to the event information, and The virtual person whose shape is changed according to the body characteristics may include user shape information provided to perform a motion according to the event information.

In addition, a command for selecting a shape from which feedback information is output from the user, a command for comparing a specific part in the exercise motion, a command for controlling the output of event information different from the event information output from the exercise recommendation device, the command; The method further includes receiving a natural language representing at least one command among commands for setting the difficulty of motion according to event information, analyzing the natural language to extract a machine language matching the natural language, and executing the command according to the machine language can do.

In addition, the generating of the difference information includes receiving the physical characteristics and the psychological characteristics from the exercise recommendation device, and according to the physical characteristics and the psychological characteristics, a difference between the motion according to the event information and the exercise motion of the user. You can set the allowable range for .

According to one aspect of the present invention described above, by providing a feedback providing apparatus, and a system and method for providing feedback on physical activity using the same, an exercise suitable for a user's characteristics is provided, and a suitable feedback is provided according to the user's motion following the provided exercise. can provide

1 is a schematic diagram of a system for providing feedback on physical activity according to an embodiment of the present invention.
FIG. 2 is a control block diagram of the exercise recommendation apparatus of FIG. 1 .
3 is a control block diagram of an apparatus for providing feedback according to an embodiment of the present invention.
4 is a block diagram illustrating a process of extracting item information from the item control unit of FIG. 2 .
5 is a block diagram illustrating a process of extracting feedback information from the feedback control unit of FIG. 3 .
6 is a flowchart of a method for providing feedback on physical activity according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] Reference is made to the accompanying drawings, which show by way of illustration specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein with respect to one embodiment may be implemented in other embodiments without departing from the spirit and scope of the invention. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description set forth below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scope equivalents as those claimed. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the drawings.

1 is a schematic diagram of a system for providing feedback on physical activity according to an embodiment of the present invention.

The physical activity feedback providing system 1 may recommend an exercise item suitable for the user's physical condition, and the physical activity feedback providing system 1 may output the recommended exercise item so that the user can recognize it. In this case, the physical activity feedback providing system 1 may output an image or an image prepared in advance according to a recommended exercise item.

Accordingly, the physical activity feedback providing system 1 may recognize the user's motion following the output image or the image, and in this case, the physical activity feedback providing system 1 may recognize the motion and the user from the recommended exercise. The difference may be calculated by comparing the motions of , and the physical activity feedback providing system 1 may provide feedback according to the difference to the user.

In this case, the physical activity feedback providing system 1 may output an image or an image prepared in advance according to the feedback provided to the user.

As such, the physical activity feedback providing system 1 may provide an appropriate exercise method according to the user's characteristics and provide an appropriate feedback according to the user's motion.

To this end, the physical activity feedback providing system 1 may include the exercise recommendation apparatus 100 and the feedback providing apparatus 200 .

In addition, the physical activity feedback providing system 1 may be implemented by more components than the components shown in FIG. 1 , and may be implemented by fewer components. Alternatively, in the physical activity feedback providing system 1 , at least two components provided in the physical activity feedback providing system 1 may be integrated into one component, and one component may perform a complex function.

The exercise recommendation apparatus 100 may store a plurality of event information provided to be performed by the user, and the exercise recommendation apparatus 100 extracts event information matching the physical and psychological characteristics input from the user, information can be printed.

Here, the event information may refer to a type of exercise action prepared to be performed by the user. For example, the event information may include open arms jumping, a plank, a squat, a crunch, and a lunge ( Lunge) and the like may be included.

In addition, the event information may include different types of exercise according to the type of exercise set in advance for the exercise recommendation apparatus 100 , for example, the event information is preset for the exercise recommendation apparatus 100 . When the type of exercise is basketball, it may include motions such as dribble, shooting, pivot, and hand check. Also, when the exercise type preset for the exercise recommendation apparatus 100 is ballet, the event information may include basic motions of different ballet and motions such as different foot positions.

In addition, the event information may include a repeated operation in which a random operation is repeated, and the stock information may include a connection operation in which different arbitrary operations are prepared according to a preset order.

Meanwhile, the event information may include an image or image indicating a shape in which the event information is performed by professional players or characters having different physical characteristics or different psychological characteristics for the same motion.

Accordingly, the exercise recommendation apparatus 100 may store one or more images or images matching the same event information.

In addition, the body characteristics may include information such as the user's age, height, weight, body type, and body fat, and the body characteristics may further include information indicating flexibility such as the user's maximum shoulder rotation angle and maximum leg tear angle. In addition, the body characteristics may further include abnormal parts such as ankles, shoulders, necks, and wrists.

In addition, the psychological characteristics may be information provided to determine the user's psychological factors, and accordingly, the psychological characteristics may include information such as the user's psychological anxiety level, drug use history, caffeine intake, and the like. To this end, the exercise recommendation apparatus 100 may output one or more options to determine the user's psychological characteristics, and the exercise recommendation apparatus 100 may collect information input from the user based on the output options. have. Accordingly, the exercise recommendation apparatus 100 may determine the user's psychological characteristics according to the collected information.

For example, the exercise recommendation apparatus 100 may be provided to perform a psychological test or a personality test to determine the user's psychology or personality based on the user's answers to a plurality of fingerprints prepared in advance.

Through this, the exercise recommendation apparatus 100 may recommend item information most suitable to the user's physical and psychological characteristics from among item information prepared in advance to the user.

To this end, the exercise recommendation apparatus 100 may store at least one of physical characteristics, psychological characteristics, and event information. In addition, the exercise recommendation apparatus 100 may provide a separate database device to store at least one of physical characteristics, psychological characteristics, and event information. In this case, the separately provided database device may include physical characteristics and psychological characteristics It may be stored so that the item information is matched.

Accordingly, the exercise recommendation apparatus 100 may extract event information matching the physical and psychological characteristics input from the user, and output the extracted event information.

In this regard, the exercise recommendation apparatus 100 may include an input device such as a keyboard, a mouse, or a remote control, and the exercise recommendation apparatus 100 receives a body message from the user through the input device. Characteristics or psychological characteristics may be input.

In this case, the exercise recommendation apparatus 100 may include an output device such as a TV (Television) or a monitor, and the exercise recommendation apparatus 100 selects an arbitrary selection button among a plurality of selection buttons output from the output device. Input can be received through an input device.

For example, the exercise recommendation apparatus 100 may output a male button and a female button through an output device to receive a gender input from the user. Accordingly, in the exercise recommendation apparatus 100, one of a male button or a female button may be selected from the user through the input device, and then, the exercise recommendation apparatus 100 receives the height, weight, exercise history, etc. from the user. A plurality of selection buttons may be output through an output device to be selected.

Meanwhile, the exercise recommendation apparatus 100 may be provided to receive identification information from a user. In this case, the exercise recommendation apparatus 100 may further include a recording device such as a camera or a voice input device such as a microphone. Here, the identification information may mean information generated from the user's face or the user's voice.

Accordingly, the exercise recommendation apparatus 100 may generate a facial image by photographing the user's face through a photographing device. In this case, the exercise recommending apparatus 100 may extract one or more feature points from the user's face appearing from the facial image, and the exercise recommending apparatus 100 may determine the position of one or more feature points, a difference in position with other feature points, and the like. By determining, it may be provided to distinguish faces of different users.

For example, the feature point may include points of the user's face, such as an eyebrow start point, an eye head point, an eye tail point, a cheek protrusion point, both ends of the lips, an upper lip point, a lower lip point, and a center point of the chin. .

Here, the exercise recommendation apparatus 100 may store information on the face classified for an arbitrary user, and accordingly, the exercise recommendation apparatus 100 analyzes the user's facial image and analyzes the stored feature points. The same feature points as the extracted feature points may be extracted from the user's face, and through this, the exercise recommendation apparatus 100 may recognize the user according to the extracted feature points.

In this case, the exercise recommendation apparatus 100 may store physical characteristics and psychological characteristics input from the corresponding user to match the user identified through the facial image, and through this, the exercise recommendation apparatus 100 allows any user to It may be provided so that event information is extracted according to input or performed arbitrary information.

Also, the exercise recommendation apparatus 100 may receive a user's voice through a voice input device and generate voice information. In this case, the exercise recommendation apparatus 100 may extract one or more pattern information from the user's voice pattern appearing from the voice information, and the exercise recommendation apparatus 100 distinguishes the voices of different users according to the one or more pattern information. can be provided.

For example, the pattern information may include information such as a frequency of a user's voice, a noise pattern, a voice pattern for each frequency band, and an amplitude pattern.

Here, the exercise recommendation apparatus 100 may store information on a voice divided for an arbitrary user, and accordingly, the exercise recommendation apparatus 100 analyzes the user's voice information and analyzes the voice information analyzed among the stored voice information. The same voice information as the extracted voice information may be extracted from the user's voice, and through this, the exercise recommendation apparatus 100 may recognize the user according to the extracted voice information.

In this case, the exercise recommendation apparatus 100 may store physical characteristics and psychological characteristics input from the corresponding user so as to match the user identified through voice information, and through this, the exercise recommendation apparatus 100 allows any user to It may be provided so that event information is extracted according to input or performed arbitrary information.

As such, the exercise recommendation apparatus 100 may perform user recognition by recognizing the user's face or voice, and through this, the exercise recommendation apparatus 100 may provide a history input or performed by the recognized user in the past. can be arranged to use.

Meanwhile, the exercise recommendation apparatus 100 may be provided so that operations such as creation, correction, and removal of information such as event information and identification information can be performed by an administrator.

In this case, the exercise recommendation apparatus 100 may allocate authentication information such as an ID and password to the administrator so that authentication of the administrator is possible. Accordingly, the exercise recommendation apparatus 100 authenticates the ID and password input from the administrator. Administrator authentication may be performed by comparing the information with authentication information such as an ID and password previously assigned to the same administrator.

Hereinafter, the exercise recommendation apparatus 100 for extracting event information matching the user's physical and psychological characteristics will be described in more detail.

The feedback providing apparatus 200 may recognize the user's exercise motion based on the item information, and the feedback providing apparatus 200 may generate difference information by comparing the user's exercise motion with the motion according to the item information, The feedback providing apparatus 200 may extract and output feedback information matching the difference information.

Here, the user's exercise motion may mean a user's motion following the event information output from the exercise recommendation apparatus 100 according to the event information. may include Accordingly, the photographing device may generate image information by photographing the user's whole body.

In this case, the feedback providing apparatus 200 may extract the user's shape from the image information, and the feedback providing apparatus 200 may determine the user's exercise motion according to the change in the user's shape.

For example, the feedback providing device 200 takes an exercise motion in which the user changes from a standing state to a sitting state when the user's shape shown in the image information changes from a long rectangular shape to a short rectangular shape. can be judged as

In this regard, the feedback providing apparatus 200 may determine the user's exercise motion by using one or more sensors mounted on the user's body or provided to be carried.

For example, the feedback providing apparatus 200 may include a rod-shaped sensor provided to be held by a user in both hands, and in this case, the rod-shaped sensor may include a gyro sensor or an acceleration sensor. In addition, the rod-shaped sensor may use a rotary encoder that converts an angle, rotation amount, and rotation speed into a digital format, or a load cell that outputs power proportional to an applied load.

Accordingly, the feedback providing apparatus 200 may determine a path in which the rod-shaped sensor moves or rotates by the user, and through this, the feedback providing apparatus 200 is an exercise in which the user performs strength exercise while holding a dumbbell. It may be provided to determine the motion.

In addition, the feedback providing device 200 may include a sensor provided to be attached to or mounted on the user's waist or both legs. In this case, the sensor may include an acceleration sensor or a gyro sensor. In addition, the sensor may use a rotary encoder that converts an angle, rotation amount, and rotation speed into a digital format, or a load cell that outputs power proportional to an applied load.

Accordingly, the feedback providing device 200 may determine a path in which the sensor moves or rotates by the user, and through this, the feedback providing device 200 may perform a squat, plank, etc. in a state in which the user attaches or mounts the sensor. It may be provided so as to determine an exercise motion for performing a muscle strength exercise.

In this case, it goes without saying that the feedback providing device 200 may be provided to recognize the user's exercise motion by combining different sensors, photographing devices, and the like.

Accordingly, the feedback providing apparatus 200 may generate difference information by comparing the motion provided in the event information with the user's exercise motion.

In this regard, the feedback providing apparatus 200 may compare a preset motion of a part with a motion of the same part appearing from the user's exercise motion according to the event information.

In this case, the preset part may be set to one or more parts. For example, when the event information is set to soccer dribbling, the feedback providing apparatus 200 uses the preset part as the up-and-down angle of the face; The bending angle of the knee and the angle of the ankle may be set.

Also, the feedback providing apparatus 200 may generate difference information in consideration of the physical and psychological characteristics transmitted from the exercise recommendation apparatus 100 .

Here, the feedback providing device 200 generates the difference information in consideration of the physical and psychological characteristics to set the allowable range for the difference between the motion according to the event information and the user's exercise motion according to the physical and psychological characteristics. can be understood as

In this case, the feedback providing apparatus 200 may set an allowable range for a preset portion, respectively, according to the event information.

For example, when the user has an injury to his right arm, the feedback providing apparatus 200 compares the motion according to the event information and the user's exercise motion, the motion of the user's right arm and the motion of the right arm according to the event information. may not generate the difference information of

Accordingly, the feedback providing apparatus 200 may extract feedback information matching the difference information indicating the difference between the motion according to the event information and the user's exercise motion.

To this end, the feedback providing apparatus 200 may store at least one of physical characteristics, psychological characteristics, difference information, and feedback information. In addition, the feedback providing device 200 may provide a separate database device to store at least one of body characteristics, psychological characteristics, difference information, and feedback information. In this case, a separately provided database device may be Feedback information may be stored to match at least one of characteristics, psychological characteristics, and difference information.

Accordingly, the feedback providing apparatus 200 may extract feedback information that matches at least one of physical characteristics, psychological characteristics, and difference information transmitted from the exercise recommendation apparatus 100 , and may output the extracted feedback information. .

In this case, the feedback providing apparatus 200 may include an output device such as a TV (Television) or a monitor, and output feedback information through it.

On the other hand, the feedback information may be information provided to provide the user with the difference between the motion according to the event information and the user's motion according to the difference information. An image or an image may be output.

Also, the feedback providing apparatus 200 may receive a natural language input from the user, and accordingly, the feedback providing apparatus 200 may analyze the natural language input from the user.

Here, it can be understood that the feedback providing apparatus 200 analyzes the natural language as performing a command according to the natural language input from the user. For this, the feedback providing apparatus 200 performs a morphological analysis of the natural language. By performing lexical analysis, syntax analysis, semantic analysis, and discourse analysis, a machine language matching the input natural language may be extracted.

Accordingly, the feedback providing apparatus 200 may perform a command according to the user's natural language. For example, the command may include selection of a shape in which feedback information is output, comparison of motions for a specific part, and selection of other sports. , may include commands such as setting the difficulty of motion according to event information.

Hereinafter, the feedback providing apparatus 200 for extracting the feedback information matching the difference information due to the difference between the motion according to the event information and the user's motion information will be described in more detail.

FIG. 2 is a control block diagram of the exercise recommendation apparatus of FIG. 1 .

The exercise recommendation apparatus 100 may include a characteristic input unit 110 , an event storage unit 120 , an event controller 130 , an event output unit 140 , and a characteristic communication unit 150 .

In addition, the exercise recommendation apparatus 100 may be implemented by more components than the components shown in FIG. 2 , and may be implemented by fewer components than that. Alternatively, in the exercise recommendation apparatus 100 , at least two components provided in the exercise recommendation apparatus 100 may be integrated into one component, and one component may perform a complex function.

The characteristic input unit 110 may receive a physical characteristic or a psychological characteristic from the user.

To this end, a selection for an arbitrary selection button among a plurality of selection buttons output from the characteristic input unit 110 and the item output unit 140 may be input.

Meanwhile, the characteristic input unit 110 may further include a recording device such as a camera or a voice input device such as a microphone from the user, and through this, the characteristic input unit 110 may generate a facial image in which the user's face is photographed. In addition, the characteristic input unit 110 may generate voice information in which the user's voice is recorded.

The characteristic input unit 110 may further receive, from the user, pre-activity information indicating an activity performed by the user in advance or nutrition intake information indicating the nutrition of the food the user has consumed in advance.

In this case, the prior activity information may mean information such as a time interval and number of repetitions performed by the user for any event information, and the nutritional intake information includes the type of food consumed within an arbitrary time range from the current time, It may mean information such as calorie intake.

Accordingly, when the characteristic input unit 110 receives the pre-activity information, it may be to receive information such as the user's execution time interval and repetition number for arbitrary event information included in the pre-activity information from the user. When the characteristic input unit 110 receives the influence intake information, it may be that the user receives information such as the type of food consumed within an arbitrary time range from the current time included in the nutrition intake information, the calorie intake, and the like.

The item storage unit 120 may store a plurality of item information provided to be performed by the user.

In this regard, the event storage unit 120 may store at least one of physical characteristics, psychological characteristics, and event information.

In addition, the event storage unit 120 is provided as a separate database device, and at least one of physical characteristics, psychological characteristics, and event information may be stored. In this case, the separately provided database device includes physical characteristics and psychological characteristics. It may be stored so that the item information is matched.

The item controller 130 may recommend item information most suitable to the user's physical and psychological characteristics among item information prepared in advance to the user.

To this end, the event controller 130 may extract event information matching the user's physical and psychological characteristics, and the event controller 130 may control to output the extracted event information.

On the other hand, the event control unit 130 may extract one or more feature points from the user's face that appears from the facial image generated by the feature input unit 110 , and the event controller 130 controls the location of the one or more feature points and other feature points. It may be provided to distinguish the faces of different users by determining a difference in position with the .

The event control unit 130 may control to store information on the face classified for an arbitrary user, and accordingly, the event control unit 130 analyzes the user's face image, The same feature points as those extracted from the face may be extracted, and through this, the event control unit 130 may recognize the user according to the extracted feature points.

In this case, the event control unit 130 may control to store the physical characteristics and psychological characteristics input from the corresponding user so as to match the user identified through the facial image, and through this, the event control unit 130 controls whether any user It may be provided so that event information is extracted according to input or performed arbitrary information.

In addition, the event control unit 130 may extract one or more pattern information from a user's voice pattern appearing from the voice information, and the event control unit 130 may be provided to distinguish the voices of different users according to the one or more pattern information. can

The event control unit 130 may control to store information on the divided voice for an arbitrary user, and accordingly, the event control unit 130 analyzes the user's voice information, It is also possible to extract the same voice information as the extracted voice information from the voice, and through this, the event control unit 130 may recognize the user according to the extracted voice information.

In this case, the event control unit 130 may control to store the physical characteristics and psychological characteristics input from the corresponding user so as to match the user classified through the voice information, and through this, the event control unit 130 allows any user to It may be provided so that event information is extracted according to input or performed arbitrary information.

The item output unit 140 may output item information extracted from the item control unit 130 . To this end, the item storage unit 120 may store an image or an image prepared to match the extracted item information. In this case, the item output unit 140 may output an image or image matching the item information extracted from the item control unit 130 .

The characteristic communication unit 150 may transmit at least one of physical characteristics, psychological characteristics, pre-activity information, and nutrition intake information input from the user to the feedback providing apparatus 200 .

Meanwhile, the characteristic communication unit 150 may receive a command for requesting a change of event information output from the feedback providing device 200 .

In this case, the item control unit 130 may extract item information according to the transmitted command, and the item control unit 130 may control the extracted item information to be output.

3 is a control block diagram of an apparatus for providing feedback according to an embodiment of the present invention.

The feedback providing apparatus 200 may include a motion sensor unit 210 , a feedback storage unit 220 , a command input unit 230 , a feedback control unit 240 , a feedback output unit 250 , and a feedback communication unit 260 . .

In addition, the feedback providing apparatus 200 may be implemented by more components than the components shown in FIG. 3 , and may be implemented by fewer components than that. Alternatively, in the feedback providing apparatus 200 , at least two components provided in the feedback providing apparatus 200 may be integrated into one component, and one component may perform a complex function.

The motion sensor unit 210 may recognize the user's exercise motion based on the event information, and for this, the feedback communication unit 260 may receive the event information from the exercise recommendation apparatus 100 .

In this regard, the motion sensor unit 210 may include a photographing device such as a camera, and accordingly, the motion sensor unit 210 may generate image information by photographing the user's whole body.

In addition, the motion sensor unit 210 may include one or more sensors mounted on the user's body or provided to be carried.

The feedback storage unit 220 may store a plurality of pieces of feedback information provided to be performed by a user. More specifically, the feedback storage unit 220 may store at least one of physical characteristics, psychological characteristics, difference information, and feedback information. Information may be stored.

In addition, the feedback storage 220 may be provided as a separate database device, and at least one of body characteristics, psychological characteristics, difference information, and feedback information may be stored. In this case, a separately provided database device may store body characteristics , feedback information may be stored to match at least one of psychological characteristics and difference information.

The command input unit 230 may receive a natural language input from the user. Specifically, the command input unit 230 provides a command for selecting a shape from which feedback information is output from the user, a command for comparing a specific part appearing in an exercise motion, and a sport different from the event information output from the exercise recommendation device 100 . A natural language indicating at least one of a command for controlling to output information and a command for setting the difficulty level of motion according to event information may be input. In addition, the command input unit 230 may receive an arbitrary command for controlling the exercise recommendation apparatus 100 or the feedback providing apparatus 200 through natural language from the user.

To this end, the command input unit 230 may be provided as a voice input device such as a microphone, and the feedback storage unit 220 may analyze morpheme, syntax, and meaning to analyze the natural language input from the user. A natural language required for analysis and discourse analysis and the like and a machine language matching it may be stored.

For example, the command input unit 230 may receive a command for selecting one shape information from among a plurality of shape information indicating a shape to which feedback information provided in advance is output, in this case, the feedback control unit ( 240) may control to output a motion according to the event information according to the selected shape information.

In this case, controlling the feedback control unit 240 to output the motion according to the event information is to transmit a command provided to the feedback control unit 240 to output the motion according to the event information through the feedback communication unit 260 to the exercise recommendation apparatus 100 . may be transmitted to

Here, the shape information includes character shape information provided so that an arbitrary character prepared in advance performs a motion according to the event information, expert shape information indicating an image in which an arbitrary expert performs a motion according to the event information, and input from the user. A virtual person whose shape is changed according to the specified body characteristics may include user shape information provided to perform a motion according to the event information.

In this case, each of the character shape information, the expert shape information, and the user shape information may include a plurality of different detailed shape information so that different shapes appear according to different body characteristics, and in this regard, the detailed shape information is input from the user. The shape characteristics may be set to enable comparison with respect to the body characteristics.

In addition, the user shape information may be provided so that shapes such as height, arm length, leg length, weight, and body fat amount are changed and output according to the user's body characteristics. In this case, the user shape information may be provided such that a silhouette having a shape changed according to the user's body characteristics is output.

Accordingly, the feedback controller 240 compares the body characteristic input from the user with the shape characteristic set in the detailed shape information, and controls to output the detailed shape information in which the shape characteristic closest to the body characteristic input from the user is set. .

The feedback controller 240 may generate difference information by comparing the motion according to the event information with the user's exercise motion.

To this end, the feedback controller 240 may compare the motion of a preset part with the motion of the same part appearing from the user's exercise motion according to the event information.

Here, the preset motion of the part may be set according to the position of the sensor attached to the user's body.

Accordingly, the feedback control unit 240 for the motion according to the event information, the motion sensor unit 210 at the same site as the information such as the preset movement speed, rotation angle, and magnitude of force for the pre-set site. Difference information can be generated by comparing information such as movement speed, rotation angle, and magnitude of force generated in the .

In addition, the feedback control unit 240 may generate difference information in consideration of the physical and psychological characteristics transmitted from the exercise recommendation apparatus 100 . To this end, the feedback communication unit 260 receives the body from the exercise recommendation apparatus 100 . Characteristics and psychological characteristics can be transmitted.

Here, the feedback control unit 240 generates the difference information in consideration of the physical and psychological characteristics by setting the allowable range for the difference between the motion according to the event information and the user's exercise motion according to the physical and psychological characteristics. I can understand.

Here, the allowable range may mean a range in which feedback information is not provided with respect to a difference between a motion according to event information and a user's exercise motion.

Accordingly, when the difference information between the motion according to the event information and the user's exercise motion is out of the allowable range, the feedback controller 240 may extract feedback information matching the corresponding difference information.

In this case, the feedback control unit 240 may set an allowable range for each part set in advance according to the event information.

In this regard, the feedback control unit 240 may generate only difference information in a region according to the input command when a command for performing comparison on a specific region appearing in the motion is input from the command input unit 230 . have.

The feedback controller 240 may extract feedback information matching the difference information.

To this end, the feedback control unit 240 may generate a learning model through a process of learning by collecting a plurality of pieces of information in advance, and in this case, the feedback control unit 240 may match the difference information based on the learning model. Feedback information can be extracted.

Here, the feedback control unit 240 is machine learning (Machine Learning), deep learning (Deep Learning), K-nearest neighbor algorithm (K-NN: K-Nearest Neighbor) and support vector machines (SVMs: Support Vector Machines) It is possible to create a learning model using a technique such as

At this time, machine learning can be understood as a technique for generating a learning model to classify a plurality of information into one or more groups based on a plurality of pieces of information, and classifying arbitrary information based on the generated learning model. , machine learning is supervised learning that creates a learning model to classify arbitrary information according to a plurality of information classified by an administrator, analyzes a plurality of information itself, or performs a clustering process to develop a learning model. Unsupervised learning that generates, semi-supervised learning that creates a learning model by mixing supervised learning and unsupervised learning, and rewards generated in the process of performing arbitrary actions on multiple pieces of information It may include reinforcement learning (Reinforcement Learning) that generates a learning model according to the

The feedback control unit 240 may analyze the natural language input from the command input unit 230 to extract a machine language matching the natural language, and accordingly, the feedback control unit 240 may perform a command according to the extracted machine language. .

In this regard, when a command for selecting a shape from which feedback information is output is inputted from the command input unit 230 , the feedback control unit 240 may control to output shape information according to the input command.

Also, when a command for controlling to output event information different from the event information output from the exercise recommendation apparatus 100 is input from the command input unit 230 , the feedback control unit 240 sends the feedback communication unit 260 to recommend an exercise A command for controlling the output of event information different from the event information output from the device 100 may be controlled to be transmitted to the exercise recommendation apparatus 100 , and accordingly, the exercise recommendation apparatus 100 may perform a different command according to the transmitted command. It may be provided to output item information.

In addition, when a command for setting the difficulty of motion according to the event information is input from the command input unit 230 , the feedback control unit 240 receives a command for the feedback communication unit 260 to set the difficulty of the motion according to the event information. It can be controlled to be transmitted to the exercise recommendation apparatus 100 , and accordingly, the exercise recommendation apparatus 100 may be provided to output event information according to the transmitted command.

The feedback output unit 250 may output the feedback information extracted from the feedback control unit 240 . To this end, the feedback storage 220 may store an image or an image prepared to match the extracted feedback information. In this case, the feedback output unit 250 may output an image or an image matching the feedback information extracted from the feedback control unit 240 .

4 is a block diagram illustrating a process of extracting item information from the item control unit of FIG. 2 .

Referring to FIG. 4 , the characteristic input unit 110 may receive physical characteristics or psychological characteristics from the user, and the characteristic input unit 110 may include dictionary activity information or a dictionary indicating an activity previously performed by the user from the user. The user may receive further input of nutritional intake information indicating the nutrition of the food consumed by the user.

In this case, the event storage unit 120 may store a plurality of event information provided to be performed by the user. In this regard, the event storage unit 120 stores at least one of physical characteristics, psychological characteristics and event information can also be saved.

Accordingly, the item controller 130 may recommend item information most suitable to the user's physical and psychological characteristics among item information prepared in advance to the user.

To this end, the event controller 130 may extract event information matching the user's physical and psychological characteristics, and the event controller 130 may control to output the extracted event information.

The item output unit 140 may output item information extracted from the item control unit 130 .

Also, the characteristic communication unit 150 may transmit at least one of physical characteristics, psychological characteristics, pre-activity information, and nutrition intake information input from the user to the feedback providing apparatus 200 .

Meanwhile, the characteristic communication unit 150 may receive a command for requesting a change of event information output from the feedback providing device 200 .

In this case, the item control unit 130 may extract item information according to the transmitted command, and the item control unit 130 may control the extracted item information to be output.

5 is a block diagram illustrating a process of extracting feedback information from the feedback control unit of FIG. 3 .

Referring to FIG. 5 , the motion sensor unit 210 may recognize the user's exercise motion based on the event information. To this end, the feedback communication unit 260 may receive the event information from the exercise recommendation device 100 . have.

In this case, the feedback storage unit 220 may store a plurality of feedback information provided to be performed by the user, and more specifically, the feedback storage unit 220 may store at least one of physical characteristics, psychological characteristics, difference information, and feedback information. One piece of information may be stored.

Also, the command input unit 230 may receive a natural language input from the user. Specifically, the command input unit 230 provides a command for selecting a shape from which feedback information is output from the user, a command for comparing a specific part appearing in an exercise motion, and a sport different from the event information output from the exercise recommendation device 100 . A natural language indicating at least one of a command for controlling to output information and a command for setting the difficulty level of motion according to event information may be input. In addition, the command input unit 230 may receive an arbitrary command for controlling the exercise recommendation apparatus 100 or the feedback providing apparatus 200 through natural language from the user.

Accordingly, the feedback controller 240 may generate difference information by comparing the motion according to the event information with the user's exercise motion.

To this end, the feedback controller 240 may compare the motion of a preset part with the motion of the same part appearing from the user's exercise motion according to the event information.

Accordingly, the feedback control unit 240 for the motion according to the event information, the motion sensor unit 210 at the same site as the information such as the preset movement speed, rotation angle, and magnitude of force for the pre-set site. Difference information can be generated by comparing information such as movement speed, rotation angle, and magnitude of force generated in the .

The feedback controller 240 may extract feedback information matching the difference information.

To this end, the feedback control unit 240 may generate a learning model through a process of learning by collecting a plurality of pieces of information in advance, and in this case, the feedback control unit 240 may match the difference information based on the learning model. Feedback information can be extracted.

Accordingly, the feedback output unit 250 may output the feedback information extracted from the feedback control unit 240 . To this end, the feedback storage 220 may store an image or an image prepared to match the extracted feedback information. In this case, the feedback output unit 250 may output an image or an image matching the feedback information extracted from the feedback control unit 240 .

6 is a flowchart of a method for providing feedback on physical activity according to an embodiment of the present invention.

Since the method for providing physical activity feedback according to an embodiment of the present invention proceeds in substantially the same configuration as that of the system 1 for providing feedback on physical activity shown in FIG. The same reference numerals are assigned to the elements, and repeated descriptions will be omitted.

The method for providing feedback on physical activity includes receiving input of physical and psychological characteristics (600), outputting event information (610), recognizing the user's exercise motion (620), and generating difference information (630) and extracting and outputting the feedback information (640).

The step 600 of receiving the input of the physical characteristics and the psychological characteristics may be a step of receiving the input of the physical characteristics and the psychological characteristics from the user in the exercise recommendation apparatus 100 .

In the step 610 of outputting the event information, the exercise recommendation device 100 stores a plurality of event information prepared to be performed by the user, and extracts event information matching the physical and psychological characteristics input from the user. , it may be a step of outputting item information.

Recognizing the exercise motion of the user 620 may be a step of recognizing the exercise motion of the user based on the event information in the feedback providing apparatus 200 .

The step 630 of generating the difference information may be a step of generating the difference information by comparing the motion according to the event information with the user's exercise motion in the feedback providing apparatus 200 .

The step 640 of extracting and outputting the feedback information may be a step of extracting and outputting feedback information matching the difference information in the feedback providing apparatus 200 .

Although the above has been described with reference to the embodiments, those skilled in the art will understand that various modifications and changes can be made to the present invention without departing from the spirit and scope of the present invention as set forth in the following claims. will be able

1: Physical activity feedback system
100: exercise recommendation device
200: feedback providing device

Claims (15)

an exercise recommendation apparatus storing a plurality of event information provided to be performed by the user, extracting event information matching the physical and psychological characteristics input from the user, and outputting the event information; and
Provides feedback that recognizes the user's exercise motion based on the event information, compares the motion according to the event information with the user's exercise motion, generates difference information, and extracts and outputs feedback information matching the difference information A system for providing physical activity feedback, comprising a device.
According to claim 1, wherein the exercise recommendation device,
A system for providing a physical activity feedback, which further receives from the user pre-activity information indicating the activity performed by the user in advance and nutritional intake information indicating the nutrition of the food the user has eaten in advance.
According to claim 1, wherein the exercise recommendation device,
A system for providing a body activity feedback that receives and analyzes a user's face or voice, performs user recognition, and stores physical characteristics and psychological characteristics input from the user so as to match the recognized user.
According to claim 1, wherein the feedback providing device,
The user receives a command to select one shape information from among a plurality of shape information indicating a shape to which feedback information provided in advance is output, and executes the command to output a motion according to the event information according to the selected shape information. A system for providing physical activity feedback, which is transmitted to a recommendation device.
According to claim 4, wherein the shape information,
Character shape information provided in advance so that an arbitrary character performs a motion according to the event information, expert shape information indicating an image in which an arbitrary expert performs a motion according to the event information, and a shape according to the body characteristics A system for providing physical activity feedback, including user shape information provided so that a virtual person provided to be changed performs a motion according to the event information.
According to claim 1, wherein the feedback providing device,
A command to select a shape from which feedback information is output from a user, a command to compare a specific part appearing in the exercise motion, a command to control to output event information different from the event information output from the exercise recommendation device, the event Providing physical activity feedback that receives a natural language representing at least one command among commands for setting the difficulty of motion according to information, analyzes the natural language to extract a machine language matching the natural language, and executes the command according to the machine language system.
According to claim 1, wherein the feedback providing device,
Physical activity feedback for receiving the physical characteristics and the psychological characteristics from the exercise recommendation device, and setting an allowable range for a difference between the motion according to the event information and the user's exercise motion according to the physical characteristics and the psychological characteristics delivery system.
One or more sensors are provided, the motion sensor unit for recognizing the user's motion;
a feedback control unit for generating difference information by comparing the motion according to the event information set in advance with the user's exercise motion, and extracting feedback information matching the difference information; and
and a feedback output unit for outputting the feedback information.
A method for providing feedback on physical activity in a system for providing feedback on physical activity, the method comprising:
In the exercise recommendation apparatus, the step of receiving input from a user physical characteristics and psychological characteristics;
a step of storing, in an exercise recommendation apparatus, a plurality of event information provided to be performed by a user, extracting event information matching the physical and psychological characteristics input from the user, and outputting the event information;
Recognizing, in a feedback providing device, a user's exercise motion based on the event information;
generating, in a feedback providing device, difference information by comparing the motion according to the event information with the user's exercise motion; and
A method for providing feedback on physical activity, comprising the step of extracting and outputting feedback information matching the difference information in a feedback providing device.
10. The method of claim 9, wherein the step of receiving the physical characteristics and psychological characteristics,
A method for providing physical activity feedback, wherein the user further receives pre-activity information indicating an activity performed by the user in advance and nutritional intake information indicating the nutrition of the food eaten by the user in advance.
10. The method of claim 9, wherein the step of receiving the physical characteristics and psychological characteristics,
A method for providing physical activity feedback, in which a user's face or voice is received and analyzed to perform user recognition, and physical and psychological characteristics input from the user are stored to match the recognized user.
10. The method of claim 9,
The user receives a command to select one shape information from among a plurality of shape information indicating a shape to which feedback information provided in advance is output, and executes the command to output a motion according to the event information according to the selected shape information. The method of providing physical activity feedback, further comprising the step of forwarding to the recommendation device.
The method of claim 12, wherein the shape information,
Character shape information provided in advance so that an arbitrary character performs a motion according to the event information, expert shape information indicating an image in which an arbitrary expert performs a motion according to the event information, and a shape according to the body characteristics A method for providing physical activity feedback, comprising user shape information provided so that a virtual person provided to be changed performs a motion according to the event information.
10. The method of claim 9,
A command to select a shape from which feedback information is output from a user, a command to compare a specific part in the exercise motion, a command to control to output event information different from the event information output from the exercise recommendation device, the event information receiving a natural language representing at least one command among commands for setting the difficulty of motion according to How to provide physical activity feedback.
The method of claim 9, wherein the generating of the difference information comprises:
Physical activity feedback for receiving the physical characteristics and the psychological characteristics from the exercise recommendation device, and setting an allowable range for a difference between the motion according to the event information and the user's exercise motion according to the physical characteristics and the psychological characteristics How to provide.

Images