KR102000763B1 - Smart mirror device for providing personal training service - Google Patents

Abstract

The present invention is to provide a smart mirror device for providing a personal training service. The smart mirror device comprises: a display unit displaying at least one of a photographed image of a user and exercise-related information; an image obtaining unit obtaining the image of the user; and a control unit recognizing a motion of the user in the image of the user, generating exercise-related information based on the recognized motion of the user and determining whether to display the exercise-related information on the display unit. According to the present invention, the smart mirror device can show right exercise methods to users.

Description

[0001] SMART MIRROR DEVICE FOR PROVIDING PERSONAL TRAINING SERVICE [0002]

The present disclosure relates to a mirror display apparatus, and more particularly to a mirror display apparatus capable of coaching a motion to a user.

In general, those who want weight training can use a fitness center equipped with various fitness equipment. However, each individual user has different physical characteristics, preference exercise, his / her current state, and his or her own state changing by exercising, and judging this by himself / herself can lead to various side effects and injuries, It is a fact that it is not easy for modern people who are busy to carry out all the exercises in the right way in the right side individually.

Therefore, it is common to employ a personal trainer to maximize the effect of exercise while minimizing the risks and injuries that may occur during exercise.

However, the cost of hiring a personal trainer can be inconvenient as the trainer's skill level fluctuates, and there are limits to the number of people trained by a personal trainer. There are only a handful of them, and there is a problem that many people give exercise in the middle by doing exercise in the wrong way. There is therefore a need in the art for a low cost, standardized exercise management solution.

KR 10-2014-0153799

This disclosure is devised in response to the background art described above and provides a smart mirror device for informing a user of a correct exercise method.

In one embodiment of the present disclosure for solving the foregoing problems, there is provided a smart mirror device for providing a personal training service. The smart mirror device includes a display unit for displaying motion-related information; An image acquiring unit acquiring an image of a user; And a controller for recognizing the user's motion in the user's image, generating motion-related information based on the recognized motion of the user, and determining to display the motion-related information on the display unit.

Alternatively, the display unit may further display an image of the user acquired by the image acquisition unit.

The smart mirror device may further include a mirror unit positioned at a front surface of the smart mirror device and capable of reflecting the user's appearance, and the display unit may display the motion- And a display unit.

Alternatively, the image acquiring unit may include at least one of an RGB camera, an infrared projector, and a depth sensor, and may include a color view photographed by an RGB camera, a depth view of the photographed image, And a user's skeleton view based on at least one of the user's and the user's skeleton view.

Alternatively, the image acquiring unit may photograph a still image of the user based on a predetermined time interval, and when the still image of the user is photographed, at least one of the still images may be provided to the user terminal Can be determined.

Alternatively, the motion-related information may include motion-performing information including information on the accuracy and frequency of motion performed by the user, basic motion information including basic information related to the motion performed by the user, And motion set information.

Alternatively, the operation-performing information may include at least one of the following: recognizing the user's motion in the obtained user's image at the control unit, determining a motion being performed by the user based on the recognized motion, And the operation of the user.

Alternatively, the operation performance information may be generated by comparing the operation of the user recognized in the obtained user's image with the standard operation of the predetermined movement in the control section.

Alternatively, the motion basic information may include at least one of a name of a motion performed by the user, a basic effect of the motion, a custom effect of the motion, and a trainer image.

Alternatively, the motion set information may include at least one of a number of times of performing a target, a current execution count, a performance time information, and a resting time information in a specific set in which the user performs a motion.

Alternatively, the control unit recognizes the position of each joint of the user on the acquired image of the user, determines a joint connection line connecting the recognized joints, and determines a joint between the joint connection lines The operation of the user can be recognized based on the joint connecting line angle.

Alternatively, the control unit may determine a standard joint line angle between joint joints at each joint of the standard motion of the movement being performed by the user, and a standard joint joint angle between joint joint lines at each joint of the user extracted from the obtained user ' And the operation information can be generated by comparing the joint line angles with each other.

Alternatively, the apparatus may further include a user state measuring unit capable of measuring a current physical state of the user.

Alternatively, the user condition measuring unit may include at least two electrode units, and may measure the user's current physical condition based on the measured impedance values of the body through the at least two electrode units.

Alternatively, the apparatus may further include a network unit receiving the current physical condition information of the user.

Alternatively, the network unit may provide the image of the user to the trainer terminal, and receive feedback information based on the image of the user from the trainer terminal.

Alternatively, a user input unit for receiving the current state of the user may be further included.

Alternatively, the control unit may further generate customized effect information based on the current state of the user and the recognized user's actions, predict the improvement direction through calculation of the consumed calories of the user, It may be determined to display the recommendation of the item on the display unit.

Alternatively, the control unit may further generate calibration information for calibrating the motion of the user based on at least one of the motion-performing information and the motion-based information, and the display unit may further include: have.

Alternatively, the calibration information may include at least one of a normal operation range of the connection lines of the user's joints and joints, a highlight indication of connection lines of the user's joints and joints that deviate from the normal operation range, Based on at least one, a highlight indication relating to a significant body part in an ongoing sports event by the user.

Alternatively, the apparatus may further include an audio output unit outputting the motion-related information as audio.

In another embodiment of the present disclosure, a method of providing a personal training service is disclosed. The method includes obtaining an image of a user; Recognizing the motion of the user on the acquired user's image, generating motion-related information based on the motion of the recognized user, and determining to display the motion-related information on the display unit; And displaying motion-related information.

In another embodiment of the present disclosure, a computer program stored on a computer readable medium executable by one or more processors is disclosed. The computer program causing the one or more processors to perform the following operations: obtaining an image of a user; Recognizing the motion of the user in the acquired user's image, generating motion-related information based on the motion of the recognized user, and determining to display the motion-related information on the display unit; And displaying motion-related information.

The present disclosure can provide a smart mirror device for informing the user of the correct motion method.

Various aspects are now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following examples, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will be apparent that such aspect (s) may be practiced without these specific details.
Figure 1 shows a block diagram of a smart mirror device providing personal training services in accordance with an embodiment of the present disclosure.
FIG. 2 illustrates an exemplary view of a smart mirror device in accordance with an embodiment of the present disclosure.
FIG. 3 illustrates an example of displaying a user's view and motion-related information in a smart mirror device associated with an embodiment of the present disclosure.
4 shows an example of displaying a user's view and motion related information in a smart mirror device related to an embodiment of the present disclosure.
FIG. 5 illustrates an example of displaying a user's view and motion-related information in a smart mirror device according to an embodiment of the present disclosure.
Figure 6 shows an exemplary view of a set result screen displayed after a corresponding set termination associated with an embodiment of the present disclosure.
Figure 7 illustrates an exemplary diagram of a final result screen associated with an embodiment of the present disclosure.
Figure 8 shows a flowchart of a method of providing a personal training service performed in a smart mirror device in accordance with one embodiment of the present disclosure.
Figure 9 is a block diagram illustrating the means for implementing a method of providing personal training services performed in a smart mirror device in accordance with one embodiment of the present disclosure.
10 is a block diagram illustrating a module for implementing a method of providing personal training services performed in a smart mirror device in accordance with one embodiment of the present disclosure.
11 is a block diagram illustrating logic for implementing a method for providing a personal training service performed in a smart mirror device in accordance with one embodiment of the present disclosure.
12 is a block diagram illustrating a circuit for implementing a method for providing personal training services performed in a smart mirror device in accordance with one embodiment of the present disclosure;

Various embodiments and / or aspects are now described with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more aspects. However, it will also be appreciated by one of ordinary skill in the art that such aspect (s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. It is to be understood, however, that such aspects are illustrative and that some of the various ways of practicing various aspects of the principles of various aspects may be utilized, and that the description set forth is intended to include all such aspects and their equivalents.

As used herein, the terms "an embodiment," "an embodiment," " an embodiment, "" an embodiment ", etc. are intended to indicate that any aspect or design described is better or worse than other aspects or designs. .

In addition, the term "or" is intended to mean " exclusive or " That is, it is intended to mean one of the natural inclusive substitutions "X uses A or B ", unless otherwise specified or unclear in context. That is, X uses A; X uses B; Or when X uses both A and B, "X uses A or B" can be applied to either of these cases. It should also be understood that the term "and / or" as used herein refers to and includes all possible combinations of one or more of the listed related items.

It is also to be understood that the term " comprises "and / or" comprising " means that the feature and / or component is present, but does not exclude the presence or addition of one or more other features, components and / It should be understood that it does not. Also, unless the context clearly dictates otherwise or to the contrary, the singular forms in this specification and claims should generally be construed to mean "one or more. &Quot;

Figure 1 shows a block diagram of a smart mirror device 1000 providing personal training services in accordance with an embodiment of the present disclosure.

According to one embodiment of the present disclosure, the smart mirror device 1000 includes a display unit 1100, an image acquisition unit 1200, a user status measurement unit 1300, a network unit 1400, a user input unit 1500, An output unit 1600, a control unit 1700, and a mirror unit 1800. [

The components of the smart mirror device 1000 shown in FIG. 1 are exemplary. Only some of the components may constitute the smart mirror device 1000. In addition, the smart mirror device 1000 may include an additional component (s) in addition to the components.

A personal training service provided to the user 2000 in the smart mirror device 1000 according to an embodiment of the present disclosure will be described.

According to one embodiment of the present disclosure, the smart mirror device 1000 may provide a personal training service to the user 2000. For example, the smart mirror device 1000 may display motion-related information on the current motion image of the user 2000 and provide the motion-related information to the user 2000. More specifically, the motion-related information provided by the smart mirror device 1000 to the user 2000 includes operation-related information including information on the accuracy and the number of operations performed by the user 2000, And may include at least one of motion basic information including basic information related to the motion of the user 2000, elapsed time of the motion of the user 2000, and set information about the set of the motion.

In addition, according to one embodiment of the present disclosure, the smart mirror device 1000 may additionally display calibration information for the operation of the user 2000. The smart mirror device 1000 may output calibration information on the operation of the user 2000 through the audio output unit 1600 to enable posture correction of the user 2000. In addition, the smart mirror device 1000 may additionally generate customized effect information that is in accordance with the current physical condition of the user 2000 based on at least one of input information and measurement information about the body of the user 2000. The customization effect information may be one of a prediction about a motion improvement direction through the calorie consumption calculation of the user 2000, a recommendation amount for the exercise, and a recommended exercise item required for the user 2000, but is not limited thereto.

Accordingly, the smart mirror device 1000 can provide the user 2000 with a personal training service such as an exercise suitable for oneself, a goal, a correct exercise method, and a future improvement direction. Thus, the user 2000 can maximize the effect of exercise while minimizing side effects and injuries to the exercise.

According to an embodiment of the present disclosure, the display unit 1100 can display an operation of the user 2000 acquired through the image acquisition unit 1200. [ For example, when the image acquisition unit 1200 acquires a motion of the user 2000, the image acquisition unit 1200 can be displayed on the display unit 1100 in real time. In addition, the display unit 1100 can display the time together with the operation of the user 2000. [ For example, as shown in FIG. 3, the display unit 1100 may display the time at which the user 2000 performs the motion operation at the position of reference numeral 307 when the user 2000 performs the motion . The position of the time displayed on the display unit 1100 may be the lower right end of the display unit 1100, but the present disclosure is not limited thereto. The time displayed on the display unit 1100 may provide a timer function. More specifically, the time can be counted up sequentially, or vice versa.

Also, the display unit 1100 may display at least one of the operation calibration information of the user 2000, exercise related information, a set result screen, a final result screen, and an image of a professional trainer. The images and / or screens displayed on the display unit 1100 are merely examples, but the present invention is not limited thereto.

The display unit 1100 may display calibration information on the operation of the user 2000. [ The display unit 1100 may display the calibration information by at least partially superimposing the calibration information on the image of the user 2000 captured by the image obtaining unit 1200. Specifically, when the user 2000 performs a motion, the display unit 1100 may display calibration information around an important body part according to the exercise item to be performed.

The display unit 1100 can display motion-related information. The motion related information includes motion performing information including information on the accuracy of the motion performed by the user 2000, motion basic information including basic information related to the motion performed by the user 2000, And information on the set of the movement, and may include any information related to the motion the user 2000 is performing.

The display unit 1100 can display a set result screen. The set result screen may be a screen for organizing the record of the set in detail when the set of the sports items performed by the user 2000 is finished and providing the user 2000 with information on performing the exercise .

The display unit 1100 may display a final result screen. The final result screen is a screen for providing detailed information on all sets of the sports items to the user 2000 and providing information on exercise performance to the user 2000 when the user finishes the sports items performed by the user 2000 Lt; / RTI >

The display unit 1100 can display an image of a professional trainer. The professional trainer image may include an image for each sports item and an image for each trainer, but the present disclosure is not limited thereto.

The display unit 1100 displays at least one of the exercise item information that the user 2000 should perform on the same day, the exercise example information on the specific exercise, and the exercise apparatus information on the exercise apparatus required for the specific exercise, according to the determination of the controller 1700 Can be displayed. Also, the display unit 1100 can display the sports item information, the exercise example information, and the fitness equipment information in a character format or a moving picture format.

In addition, the display unit 1100 can display an image of the user 2000 obtained by the plurality of image acquisition units 1200 in a plurality of ways. At this time, the number of divisions of the display unit 1100 may be divided according to the number of the image obtaining units 1200. More specifically, the display unit 1100 includes at least two images of the user 2000 divided into a plurality of images, and the images of the user 2000 obtained by the image obtaining unit 1200 at various angles The image can be divided and displayed on the display unit 1100. For example, when the image acquisition unit 1200 is positioned at three positions on the front, side, and rear sides of the user 2000 to acquire the image of the user 2000, the display unit 1100 displays the front image, And the rear image can be displayed in each of the divided areas of the display unit.

According to one embodiment of the present disclosure, the image acquisition unit 1200 may acquire an image of the user 2000 and may include any imaging means for acquiring the image of the user 2000. [ The image acquiring unit 1200 may include at least one of an RGB camera, an infrared projector, and a depth sensor. The image acquiring unit 1200 acquires the image of the user 2000 based on at least one of a color view photographed by the RGB camera, a depth view of the photographed image, and a skeleton view of the user 2000, Information that changes the joints of the joints according to the operation of the robot 2000 can be obtained.

According to an embodiment of the present disclosure, the image acquiring unit 1200 may be provided at an upper end of the smart mirror apparatus 1000 so that the operation of the user 2000 can be easily photographed. Do not. Also, the image acquisition unit 1200 may be provided outside the smart mirror device 1000. When the image acquiring unit 1200 is provided at the upper end of the smart mirror, the photographing angle of the image acquiring unit 1200 may be adjusted by the user 2000. In addition, the image acquiring unit 1200 may be provided in plurality and may be separated from the smart mirror device 1000. [ For example, the image acquiring unit 1200 included in the smart mirror apparatus 1000 may be separated from the user 2000 and placed on the rear surface instead of the front surface, thereby photographing the rear view of the user 2000. In addition, the image acquiring unit 1200 may be provided to acquire images of various angles of the user 2000. For example, when the image acquiring unit 1200 includes at least three cameras, the image acquiring unit 1200 photographs the operation of the user 2000 at various angles by positioning the one at the front side, the other at the side, and the remaining one at the rear side, It is possible to obtain the motion information of the robot 2000.

According to one embodiment of the present disclosure, the image acquisition unit 1200 may capture a still image of the user 2000 based on a predetermined time interval. Specifically, the image acquisition unit 1200 can capture still image information according to a time period desired by the user 2000. [ For example, if the user 2000 desires still image information at intervals of one week, the image acquiring unit 1200 may capture the physical condition of the user 2000 at intervals of one week. The smart mirror device 1000 can take a change in the physical condition of the user 2000 at a predetermined time interval so that the user 2000 can confirm the change in the physical condition.

According to one embodiment of the present disclosure, the user state measurement unit 1300 may measure the current state of the user 2000. [ The present state of the user 2000 may include body composition such as body fat, muscle mass, water amount, skeleton amount, basic metabolic rate obtained using the body composition, body age, and the like, and the present disclosure is not limited thereto . The current state of the user 2000 is obtained by measuring body composition. The user status measuring unit 1300 may be disposed at the lower end of the smart mirror device. The position where the user state measurement unit 1300 is disposed is merely an example, and the position is not limited.

According to one embodiment of the present disclosure, the user state measurement unit 1300 may measure the current state of the user 2000 in response to basic information input by the user 2000 to the input unit 1500.

According to one embodiment of the present disclosure, the user state measurement unit 1300 includes at least two electrode units. The user state measuring unit 1300 may measure the current physical state of the user 2000 based on the impedance values of the body measured through at least two electrode units. The user state measurement unit 1300 can measure the current state of the user's body based on the impedance value of the body and the basic information of the body (e.g., information on the height, weight, sex, age, etc.). User 2000 The present state of the body may include body composition such as body fat, muscle mass, water amount, skeletal quantity in the body, basic metabolic rate obtained using the body composition, body age, and the like, and the disclosure is not limited thereto .

In one embodiment of the present disclosure, the user state measurement unit 1300 may measure the body composition of the user 2000 in any manner. For example, the user state measuring unit 1300 can measure body composition by the BIA method. The BIA method is a technique in which a technique of obtaining the volume of a conductor using the length and impedance of a conductor is applied to a human body. The user state measuring unit 1300 can measure an impedance by flowing current to the human body. The impedance may vary depending on the amount of water in the human body. Therefore, the user state measuring unit 1300 can measure the total body water amount of the human body by obtaining the impedance index using the basic information of the user 2000 and the measured impedance, and calculate the body fat mass through the measured body water amount .

Through the above process, the user state measuring unit 1300 can measure the basic metabolism amount, the body age, and the like using the body composition such as body fat, muscle mass, water amount, skeleton and the body composition in the body.

According to one embodiment of the present disclosure, the shape of the electrode portion of the user state measurement portion 1300 may be formed in the same shape as the number "6 ". The two or more electrode units may include a hook portion for hanging the smart mirror device 1000 and a ring-shaped handle portion for allowing the user 2000 to grasp the two or more electrode portions. However, the shape of the electrode portion is not limited thereto, and may be formed in various shapes.

According to one embodiment of the present disclosure, the user input unit 1500 is provided in the smart mirror device 1000 and may be configured as an input button, a touch screen, or a combination thereof. The user input unit 1500 may receive information of the user 2000. For example, the user input unit 1500 may receive at least one user's body information from the user 2000, such as the height, weight, waist circumference, and chest circumference of the user 2000. Also, the user input unit 1500 may receive at least one of the age and sex of the user 2000, but is not limited thereto.

According to one embodiment of the present disclosure, the user input unit 1500 may comprise an input button provided on the smart mirror device 1000, or a touch screen of the display unit 1100.

In addition, the user input unit 1500 may receive a selection input of the user 2000 relating to a specific motion operation. For example, when the user 2000 inputs a motion motion to be performed by the user 2000 to the user input unit 1500, the smart mirror device 1000 transmits motion related information related to the motion motion selected by the user 2000 to the user 2000 .

According to an embodiment of the present disclosure, the network unit 1400 can receive user 2000 information input from an external device or an application other than the smart mirror device 1000. Examples of the external device include a PC, a portable terminal, and a wearable device. The network unit 1400 may form a channel for data communication between the display unit 1100, the control unit 1700, the user state measurement unit 1300, and the user input unit 1500.

According to an embodiment of the present disclosure, the network unit 1400 can transmit an image of the user 2000 photographed by the image obtaining unit 1200 to another user 2000 terminal. For example, the network unit 1400 may transmit an image of the motion of the user 2000 to a terminal of a professional trainer. Also, the network unit 1400 may receive expert feedback information about the image in the motion of the user 2000. At this time, the expert feedback information may be in the form of at least one of a character format, an audio format, and an image format, but is not limited thereto. For example, the network unit 1400 may transmit an image of the motion of the user 2000 to the trainer terminal and receive feedback information on the motion operation performed by the user 2000 from the trainer terminal.

 The network portion 1400 includes one or more modules that enable wireless communication between the smart mirror device 1000 and the wire / wireless communication system or between the smart mirror device 1000 and the network in which the smart mirror device 1000 is located . In one embodiment of the present disclosure, the network portion 1400 may include a transmitter and a receiver. The network unit 1400 may include a wired / wireless Internet module for network connection. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies. Wired Internet technologies include XDSL (Digital Subscriber Line), FTTH (Fiber to the home), and PLC (Power Line Communication).

In addition, the network unit 1400 may transmit data to and receive data from an electronic device including a short distance communication module and located relatively close to the smart mirror device 1000. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology. In one embodiment of the present disclosure, the network portion 1400 can sense the connection state of the network and the transmission / reception speed of the network. The data received through the network unit 1400 may be displayed through the display unit 1100 or transmitted to other electronic devices located near by the local communication module. For example, when the network unit 1400 performs near-field communication using infrared communication, the external console device may be an infrared remote controller. Alternatively, when the network unit 1400 performs short-range communication using the Bluetooth function, the external console device may be a mobile device including a Bluetooth module. The mobile device including the Bluetooth module may be, for example, a smart phone including a Bluetooth module.

According to one embodiment of the present disclosure, the operation of the user 2000 may be recognized through the control unit 1700 (820). The control unit 1700 can recognize the position of each joint of the user 2000 from the image of the user 2000 photographed by the image obtaining unit 1200. [

The control unit 1700 may provide the still image of the user 2000 to the user terminal 2000 when the image obtaining unit 1200 has captured at least one still image of the user 2000 You can decide. Specifically, the control unit 1700 may determine to provide the still image of the user 2000 to the user terminal according to the time interval determined by the user 2000. [ Accordingly, the user 2000 can easily confirm the change state of the user's body during a specific period through the still image provided from the smart mirror device 1000.

Further, the controller 1700 may determine a joint connection line connecting the recognized joints, and recognize the operation of the user 2000 based on the joint joint line angle between the joint connection lines at each joint . For example, when the user 2000 carries out exercising exercises, the controller 1700 can recognize joints between the arms of the user 2000, that is, elbows. In addition, the angle of the user 2000 can be derived through the connection line from the recognized elbow to the shoulder or wrist. Accordingly, the controller 1700 can recognize the operation of the user 2000 through the derived angle.

In addition, the controller 1700 may determine to display on the display unit 1100 at least one of the exercise item information that the user 2000 should perform on the same day, the exercise example information on the specific exercise, have.

In addition, the controller 1700 may determine a motion that the user 2000 is performing based on the recognized motion of the user 2000 (830). A standard joint line angle between joint joints at each joint of the standard motion of the user 2000 performed by the user 2000 and a standard joint joint angle between joint joint lines at each joint of the user 2000 extracted from the image of the taken user 2000 The operation performing information can be generated by comparing the angles of the user's joint connecting lines. The control unit 1700 may compare the motion of the user 2000 photographed by the image acquiring unit 1200 provided in the control unit 1700 with a standard joint connection line of a database established in advance to generate operation execution information . Therefore, the controller 1700 can determine the exercise performed by the user 2000 through the operation performance information.

In addition, the control unit 1700 can recognize whether or not the user performs the predetermined motion operation. The user 2000 may input the motion motion to be performed through the user input unit 1500. [ In this case, the control unit 1700 can determine the motion operation to be performed by the predetermined user 2000 based on the input of the user input unit 1500, and can recognize the standard motion of the predetermined motion and the motion of the user 2000 The motion of the user 2000 can be counted by comparing the motion of the user 2000. At this time, if the user 2000 performs an operation irrespective of the inputted motion operation, the control unit 1700 may not count the corresponding operation. For example, when the user 2000 inputs a desire to perform a squat movement through the user input unit 1500, the control unit 1700 compares the operation of the recognized user 2000 with the standard operation of the squat movement, It is possible to count the number of times when the robot 2000 performs a squat operation. The predetermined motion described above may be a motion selected by the user. For example, the smart mirror 1000 may select a type of motion from the user 2000. In addition, the description of the predetermined movement is only an example, and the present disclosure is not limited thereto. That is, the control unit 1700 of the present disclosure recognizes the operation performed by the user 2000 and recognizes the type of exercise performed by the user 2000, thereby counting the number of exercise operations of the user 2000, 2000 may count the number of exercises of the user 2000 according to a predetermined type of exercise.

In addition, the control unit 1700 may generate operation performing information including information on the accuracy of the operation performed by the user 2000. [ The control unit 1700 controls the standard joint line angle between the joint joints at each joint of the standard motion of the user 2000 and the joint joint angle of each joint of the user 2000 extracted from the image of the taken user 2000 The operation link information may be generated by comparing the joint line angles of the user 2000 between the joint link lines. Here, the standard operation may be a database stored in advance with respect to the correct posture according to the sports item.

Also, the control unit 1700 may generate calibration information on the motion of the user 2000. [ The calibration information may be generated based on at least one of operation performance information and motion basic information. The calibration information may include a normal operation range of joints and joints of the user 2000 and a highlight indication of a joint of joints and joints of the user 2000 that deviates from the normal operation range. For example, the calibration information may be highlighted on the display unit 1100 when the user 2000 moves at an angle greater than the range of motion when exercising, so that the user 2000 can easily recognize his / . In addition, the calibration information may include a highlight indication of a significant body part in an exercise item that the user 2000 is proceeding to, based on at least one of performance information and motion basic information. For example, if the user 2000 is performing a squat operation, highlight the waist angle and knee angle that are important for squat operation. The display unit 1100 can display a highlight on the waist portion and the knee portion of the user 2000 according to the calibration information. Here, the highlighting signifies emphasis of a specific part, and may be a circular shape or a square shape, but is not limited thereto.

In addition, the controller 1700 may display information on the most important body parts for the exercise performed by the user 2000. FIG. The important body parts can be changed according to the exercise performed by the user 2000. Specifically, the control unit 1700 of the smart mirror device can determine a significant body part in the exercise. At this time, the controller 1700 recognizes the operation of the user 2000 and can determine based on exercise-related information. For example, as shown in FIG. 3, when the user 2000 performs an arm motion, the angle of the arm that the user 2000 should watch for an important posture in the exercise can be displayed. At this time, the controller 1700 may determine to display the displayed angle and the name of the body part together.

In addition, the control unit 1700 may generate customized effect information based on the current state of the user 2000 and the operation of the recognized user 2000. [ The current state of the user 2000 may be based on at least one of the body information of the user 2000 input to the user input unit 1500 and the body composition of the user 2000 measured through the user state measurement unit 1300 . That is, the control unit 1700 can generate motion effect information expected based on the current body composition information of the user 2000 and the exercise performed by the user 2000. For example, the control unit 1700 may generate customized exercise effect information about how much the muscle mass of the leg portion is to be increased when the user 2000 having a total muscle mass of 35 kg performs a squat exercise.

In addition, the controller 1700 generates calibration information for calibrating the motion of the user 2000 based on at least one of the operation performance information and the motion basic information, and further displays, on the display unit 1100, As shown in FIG.

Further, the control unit 1700 can display the set result screen on the display unit 1100. [ When the user 2000 is out of the photographable area of the image acquisition unit 1200, the control unit 1700 recognizes that the user 2000 has completed the set of motion, and displays the set result screen on the display unit 1100 Can be displayed. The set result screen may be displayed on the display unit 1100 according to the determination of the controller 1700 when the user 2000 achieves the target number of motions in one set. In detail, the controller 1700 recognizes the motion of the user 2000 and can determine the motion performed by the user 2000. At this time, the control unit 1700 can count the exercise performed by the user 2000 based on the exercise-related information, and can determine that the target exercise frequency is reached by counting the exercise.

Further, the control unit 1700 can determine the set change. More specifically, the control unit 1700 can determine the set to be performed and the next set based on at least one of the number of motions of the user 2000 and the image of the user 2000 acquired from the image acquiring unit. The controller 1700 can determine that the set performed by the user 2000 has been completed when the count of the number of motions performed by the user 2000 in the set reaches the target number of motions. In addition, the controller 1700 may determine that the set 2000 is terminated if the user 2000 moves out of the photographable area of the image acquisition unit 1200.

In addition, the controller may determine (1700) to display the final result screen on the display unit 1100. Specifically, the controller 1700 determines whether the user 2000 has completed the motion for the last set and when the user 2000 is out of the shooting range of the image obtaining unit 1200 in the last set. And to display the final result screen on the display unit 1100. [

In addition, the control unit 1700 can determine the break time between the set and the set. Specifically, the control unit 1700 may determine a motion during which the user 2000 is performing, and may determine a resting time based on at least one of the physical condition and motion-related information of the user 2000. For example, in consideration of the weight of the user 2000, the rest time may be shorter than the rest time according to the basic information in the exercise. For example, the control unit 1700 can determine the resting time longer than the resting time according to the basic information in the exercise, considering the small muscle strength of the user 2000 measured by the user state measuring unit 1300. [ In addition, the controller 1700 may provide a notification to the user 2000 after the break time has elapsed. The notification may be output as an image or sound.

In addition, the controller 1700 can predict an improvement direction by calculating the calorie consumption of the user 2000, and can provide a recommendation amount of exercise and recommend an exercise item necessary for the user 2000.

In addition, the controller 1700 may determine information to be displayed on the display unit 1100 according to the input of the user input unit 1500. For example, when motion information related to a motion is displayed on the display unit 1100 and the user 2000 touches the information, the controller 1700 can reproduce motion information related to the motion.

In addition, the controller 1700 may determine information to be displayed on the display unit 1700 through motion recognition of the user 2000. The control unit 1700 recognizes the operation of the user 2000 acquired by the image acquisition unit 1100 and outputs a pointer that moves according to the operation of the user 2000 to the display unit 1700. For example, when the user 2000 spreads his / her palm, a pointer can be generated, and the generated pointer can move along with the movement of the hand of the user 2000. Accordingly, the control unit 1700 recognizes the motion of the user 2000 and can easily determine information desired by the user 2000 and display the information on the display unit 1100. The above description of the gesture for pointer manipulation is merely an example, and the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, the mirror portion 1800 may be located on the front side of the smart mirror device to reflect the appearance of the user 2000. For example, the mirror portion 1800 may reflect the appearance of the user 2000 as a mirror. In addition, the display unit 1100 may display motion-related information corresponding to the shape of the user 2000 reflected on the mirror unit 1800. Accordingly, the smart mirror device 1000 can reflect the appearance of the user 2000 through the mirror part 1800 and can display the motion related information corresponding to the operation of the reflected user 2000, Lt; / RTI >

FIG. 2 illustrates an exemplary view of a smart mirror device 1000 in accordance with one embodiment of the present disclosure.

According to one embodiment of the present disclosure, the smart mirror device 1000 can recognize the operation of the user 2000. The smart mirror device 1000 can recognize the operation of the user 2000 within a predetermined area, and the image acquisition unit 1200 includes an area where the user 2000 can photograph the operation.

As shown in FIG. 2, the image acquiring unit 1200 may be provided at the upper end of the smart mirror apparatus 1000 to photograph the motion of the user 2000. At this time, the image acquiring unit 1200 may be provided in plural, and may be separated from the smart mirror device 1000. For example, the user 2000 can separate the image acquisition unit 1200 included in the smart mirror apparatus 1000 and position the image acquisition unit 1200 on the rear surface rather than the front surface, thereby photographing the rear view of the user 2000. In addition, a plurality of image acquisition units 1200 may be provided. For example, when three image acquiring units 1200 are provided, the user 2000 can photograph the operation of the user 2000 at various angles by positioning the one at the front side, the other at the side, and the remaining one at the rear side, Can be obtained.

According to an embodiment of the present invention, when a plurality of the image acquisition units 1200 are provided, the display unit 1100 may divide and display a plurality of images of the user 2000 corresponding to the image acquisition unit 1200 have. Therefore, the user 2000 can easily view the motion of the user 2000, which is photographed at various angles, through the divided display unit 1100.

According to one embodiment of the present disclosure, the user input unit 1500 is provided in the smart mirror apparatus 1000, and can be configured with an input button, a touch screen, or a combination thereof. The user input unit 1500 may receive information of the user 2000. For example, the user input unit 1500 may receive at least one user's body information from the user 2000, such as the height, weight, waist circumference, and chest circumference of the user 2000. Also, the user input unit 1500 may receive at least one of the age and sex of the user 2000, but is not limited thereto.

According to one embodiment of the present disclosure, the user input unit 1500 may be input to an input button provided in the smart mirror apparatus 1000, or a touch screen of the display unit 1100. [

According to an embodiment of the present disclosure, the user status measuring unit 1300 may be provided outside the smart mirror apparatus 1000. [ The user state measuring unit 1300 may be provided at a position where the user 2000 can easily contact the user 2000 to measure the current physical state of the user 2000. [ For example, as shown in FIG. 2, it may be provided at the lower end of the smart mirror device 1000, but the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, the user state measurement unit 1300 may be configured to measure the current state of the user 2000 by contacting the body of the user 2000 through the two or more electrodes based on the information input by the user input unit 1500, The body composition can be measured.

In one embodiment of the present disclosure, the user state measurement unit 1300 can measure body composition in a BIA scheme. The BIA method is a technique in which a technique of obtaining the volume of a conductor using the length and impedance of a conductor is applied to a human body. The user state measuring unit 1300 can measure an impedance by flowing current to the human body. The impedance may vary depending on the amount of water in the human body. Therefore, the user state measuring unit 1300 can measure the total body water amount of the human body by obtaining the impedance index using the theoretical information and the measured impedance of the user 2000, and calculate the body fat mass through the measured body water amount .

Through the above process, the user state measuring unit 1300 can measure the basic metabolism amount, the body age, and the like using the body composition such as body fat, muscle mass, water amount, skeleton and the body composition in the body.

FIGS. 3 and 4 illustrate exemplary displays in which a smart mirror device 1000 associated with one embodiment of the present disclosure displays a user 2000 and motion-related information together.

According to one embodiment of the present disclosure, reference numeral 301 may be a numeric display of information on muscle strength used by the user 2000 in a motion displayed on a display device when the user performs a motion. Specifically, the smart mirror device 1000 recognizes the motion of the user 2000, recognizes the state of the user 2000 based on the angle of the joint according to the motion of the user 2000, The amount of muscle power currently used by the user 2000 can be derived based on the state of the user. The smart mirror device 1000 can derive and display the type of exercise performed by the user 2000 and the amount of muscle power used according to the operation performed by the user 2000. [ 3, the amount of muscle power used by the user 2000 is 4% when the user 2000 does not use the muscle strength (i.e., the state where the inverse is fixed) . ≪ / RTI > On the other hand, as shown in FIG. 4, when the user 2000 uses the muscle force (i.e., lifts the weft), the amount of muscle power used by the user 2000 is displayed in the reference area 401 as' 64% . The positions of the reference numeral 301 and the reference numeral 401 shown in Figs. 3 and 4 on the display portion 1100 are merely examples, and the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, the information shown at 302 refers to counting the number of motions of the user 2000. The number of exercises may be counted when the user 2000 has completed the operation. More specifically, when the user 2000 performs a motion operation in a photographable region of the image acquisition unit 1200, the control unit 1700 of the smart mirror apparatus recognizes the motion of the user 2000 and determines a motion to be performed can do. In addition, the controller 1700 can recognize the motion for the determined motion and count the number of times the motion is performed. In addition, in the area 302, the user 2000 can simultaneously display the number of times of exercise within a set and the number of times of exercise within a set in which the current user 2000 is in progress, and the number of exercises currently being performed is continuously counted and displayed . For example, as shown in reference numeral 302 in FIG. 3, '4/12' may indicate that when one set is performed, the required number of target movements is 12 and the current 4 runs are performed. As another example, as shown in FIG. 4, the information displayed in reference numeral 402 may be counted when the user 2000 is lifted with the lifting device lifted. At this time, the counted information may be '5/12'. The positions of the reference numerals 302 and 402 on the display portion 1100 are merely examples, and the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, the reference information 303 and the reference numeral 403 may indicate set information about the motion performed by the user 2000. [ The set information may be information on start, end, and in-progress status of the set. For example, if the user 2000 is currently proceeding with one set, it may be displayed as '1 set' as shown in FIG. If the user 2000 is proceeding with two sets, it may be displayed as '2 set' as shown by reference numeral 303 in FIG. Such a set change can be determined through the control unit 1700 of the smart mirror device. More specifically, the control unit 1700 can determine the distinction between the set to be performed and the next set. The controller 1700 can determine that the set performed by the user 2000 has been completed when the count of the number of motions performed by the user 2000 in the set reaches the target number of motions. In addition, the controller 1700 may determine that the set 2000 is terminated if the user 2000 moves out of the photographable area of the image acquisition unit 1200. The control unit 1700 can additionally determine the break time between the set and the set. Specifically, the control unit 1700 can determine a resting time based on at least one of the physical condition and the exercise related information of the user 2000, determining the exercise being performed by the user 2000, and the like. In addition, the control unit 1700 may provide a notification to the user 2000 after the break time is over. The notification may be output as an image or sound. The control unit 1700 recognizes the motion of the user 2000 in the image captured by the image obtaining unit 1200 and controls the user 2000 in case the motion of the user 2000 does not correspond to the motion operation performed by the user 2000 ) Can be judged to be resting. In this case, the control unit 1700 may count the break time of the user 2000 and may decide to provide the user 2000 with a notification if the break time of the user 2000 exceeds a predetermined break time.

According to one embodiment of the present disclosure, the set information indicated by reference numerals 303 and 403 may start the next set of counting if the user 2000 achieves a set number of target movements. For example, when the user 2000 has 12 target motions, the next set can be counted when the user 2000 completes 12 motions. The next set of indications can be changed, for example, from '1 set' to '2 set'. The display of the next set can be changed by the judgment of the control section 1700 after the elapse of the rest time after the end of the set.

In addition, the set information indicated by reference numerals 303 and 403 can be changed to a next set of display if the user 2000 is out of the shooting range of the image obtaining unit 1200. For example, when the user 2000 performs a set of exercises and moves out of the region to be imaged by the image acquiring unit 1200, the control unit 1700 determines that the user 2000 has finished a set of exercises, The set information can be counted and displayed at 303 and 403. The positions of the reference numerals 303 and 403 on the display portion 1100 are merely examples, and the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, reference numeral 304 may indicate the angle of the upper body of the user 2000. As shown in FIG. 3, the angle of the upper body and lower body of the user 2000 can be displayed. The displayable angle may be -180 degrees to +180 degrees. For example, as indicated by reference numeral 304 in FIG. 3, if the upper body of the user 2000 is not tilted backward, it may be displayed as '-1 degrees'. On the other hand, as shown in the reference numeral 404 in FIG. 4, the user 2000 may be displayed as '-6 degrees' when the upper body is tilted backward using muscle strength. Also, when the user 2000 carries out an exercise at an angle deviating from the normal operation range according to the exercise performed by the user, the information of reference numerals 304 and 404 may be displayed in red. 3, when the normal operation range of the angle at which the upper body of the user 2000 is bent back is from 0 to -8 degrees when the user lifts the weft lifter, the user 2000 If the operation is performed so as to deviate from -8 degrees, it can be displayed in red for angles above -8 degrees. Further, when the user 2000 corrects the angle within the normal operation range, the angle can be displayed again in the original state of white. The color expressed in the above is merely an example, but it is not limited thereto. The positions of the reference numerals 304 and 404 on the display portion 1100 are merely examples, and the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, reference numerals 305 and 306 may indicate information about a body part that is most important to the user's 2000 movement. The important body parts can be changed according to the exercise performed by the user 2000. Specifically, the control unit 1700 of the smart mirror device can determine a significant body part in the exercise. At this time, the controller 1700 recognizes the operation of the user 2000 and can determine a significant body part for the exercise based on the exercise-related information. For example, as shown in FIG. 3, when the user 2000 performs an arm motion, the angle of the arm that the user 2000 should watch for an important posture in the exercise can be displayed. At this time, the displayed angle may be displayed together with the name of the body part. As shown in FIG. 3, reference numerals 305 and 306 indicate that when the user 2000 is descending, the angle of the arms of the user 2000 may be derived to be '157 degrees' and '158 degrees' . On the other hand, when the user 2000 lifts the weft, as shown in FIG. 4, reference numerals 405 and 406, the angles of the arms of the user 2000 can be derived and displayed as '42 degrees 'and '42 degrees' .

According to another embodiment, information displayed at reference numerals 305, 306, 405, and 406 may also be displayed in red if motion is performed at an angle that deviates from the normal operating range according to the motion the user 2000 is performing. Further, when the user 2000 performs the exercise, the information of reference numbers 305 and 306 may be displayed in green for the angle of the posture that maximizes the effect of the exercise. Accordingly, the user 2000 can easily correct the posture by changing the color of the regions according to the angle. The positions of the reference numerals 305 and 306 on the display portion 1100 are merely examples, and the present disclosure is not limited thereto.

According to one embodiment of the present disclosure, reference numerals 307 and 407 may indicate timer function information for a time. More specifically, the timer function can be incremented sequentially, or conversely, counted down from a certain number.

According to an embodiment of the present disclosure, when the timer function to be counted up in the reference numbers 307 and 407 is displayed, when the user 2000 moves out of the exercising time within the exercisable time based on the exercise basic information, And 407 can be displayed in red. For example, assuming that the exercise performed by the user 2000 is performed within 30 seconds, the effect is maximized. Accordingly, the information of reference numerals 307 and 407 may be displayed in red from the counting after 30 seconds.

In addition, when the timer function to be counted down at the reference numbers 307 and 407 is displayed, the user 2000 can display in red if the exercise allowable time approaches 0 seconds based on the exercise basic information. For example, if the threshold time of the time indicated by reference numeral 307 is set to 10 seconds, the countdown time may be displayed in red below 10 seconds (for example, 10, 9, 8, 7, 6, 5 ..... are red)

FIG. 5 illustrates an exemplary view in which a smart mirror device 1000 associated with one embodiment of the present disclosure displays a user 2000 and motion-related information together.

According to one embodiment of the present disclosure, the smart mirror device 1000 can display the joint points of the user's body 2000 captured by the image acquiring unit 1200 with the body of the user 2000 together. In addition, the smart mirror device 1000 can display and display joint lines of joints between the joints and joints of the user's body photographed by the image acquiring unit 1200. 5, the smart mirror device 1000 displays a highlight image of the right joint point 505 of the body of the user 2000 and the right joint joint line 510 and the right joint joint line 520 . In addition, the smart mirror device 1000 can display and display the left joint point 506, the left upper joint joint line 530, and the lower left joint connection line 540 of the user 2000 in a highlighted manner. The names of the left and right joint points are given for the detailed description in the drawings shown in FIG. 5, but are not limited thereto.

The displayed joint point and the color of the joint line may be changed. The color of the joint point and the joint connecting line may be changed according to the angle formed by the joint connecting line. More specifically, the joints and joints of the user 2000 may be displayed in a different color from the angle at which the joint line of the motion is out of the normal range of motion. The normal range of motion may be generated based on motion-related information.

According to one embodiment of the present disclosure, the smart mirror device can determine the exercise performed by the user 2000 through the operation of the user 2000, and highlight the important body parts related to the exercise. For example, as shown in FIG. 5, when the user 2000 performs a squat operation, the smart mirror device may highlight an important knee angle in a squat operation. For example, the upper right joint point 510 and the lower right joint point 520 can be obtained based on the right joint point 505. At this time, an angle with respect to the operation of the user 2000 can be derived through an angle formed by the right upper joint connecting line 510 and the lower right joint connecting line 520. In addition, the left joint joint line 530 and the left joint joint line 540 can be obtained based on the left joint point 506. At this time, the angle of operation of the user 2000 can be derived through the angle formed by the left upper joint connecting line 530 and the lower left joint connecting line 540.

Figure 6 shows an exemplary view of a set result screen displayed after a corresponding set termination associated with an embodiment of the present disclosure.

According to one embodiment of the present disclosure, the smart mirror device 1000 may display to the user 2000 data relating to motion performed by the user 2000 per set. When the set is completed, a set result screen as shown in FIG. 6 is displayed on the display unit 1100. The set result screen is displayed on the display unit 1100 when the user 2000 leaves the photographable area of the image obtaining unit 1200. For example, if the user 2000 goes out of the area where the user 2000 can obtain the operation of the user 2000 through the image acquisition unit 1200 after the user 2000 proceeds to one set of motion, the control unit 1700 The set result screen can be displayed on the display unit 1100. When the user 2000 is out of the photographable area of the image acquisition unit 1200, the control unit 1700 recognizes that the user 2000 has completed the set of motion, and displays the set result screen on the display unit 1100 Display. The set result screen is displayed on the display unit 1100 according to the determination of the controller 1700 when the user 2000 achieves the target number of motions in one set. In detail, the controller 1700 recognizes the motion of the user 2000 and can determine the motion performed by the user 2000. At this time, the control unit 1700 can count the exercise performed by the user 2000 based on the exercise-related information, and can determine that the target exercise frequency is reached by counting the exercise.

According to one embodiment of the present disclosure, a set that the user 2000 has progressed may be displayed in the upper left of the set result screen. For example, if the user 2000 deviates from the screen displayed on the display unit 1100 after finishing the second set, it may be displayed as 'set 2'. If the image acquisition unit 1200 moves to an area where the operation of the user 2000 is not recognized after the user 2000 ends the third set, it may be displayed as 'set 3'.

According to one embodiment of the present disclosure, as shown in FIG. 6, reference numeral 610 may indicate at least one of motion duration information, motion duration information, and downtime information during a set. Also, reference numeral 610 can display the above-described information by dividing the target area and the result area. At this time, the displayed value of the target area of reference numeral 610 may vary depending on the item of the exercise performed by the user 2000. In addition, the information displayed in the target area of reference numeral 610 may vary depending on the current state of the user 2000. Specifically, the control unit 1700 generates the customized effect information based on the current state of the user 2000 and the operation of the recognized user 2000. Thus, the information displayed in the target area of reference numeral 610 may be displayed based on the customized effect information.

According to one embodiment of the present disclosure, as shown in FIG. 6, reference numeral 620 may display image information related to a motion-performing operation of the user 2000. For example, at the reference numeral 620, the user 2000 may display an image of the correct posture or poor posture of the user 2000 during the exercise. In addition, reference numeral 620 may additionally indicate comments regarding the corresponding set as characters. The comment may be a detailed description for the posture correction of the user 2000, such as 'pay attention to the angle of the waist' and 'pay attention to the angle of the arm'.

According to one embodiment of the present disclosure, as shown in FIG. 6, reference numeral 630 may indicate the time at which the user 2000 completes one set and then transitions to the next set. The time to move to the next set may be set based on user customization information. Also, the time indicated by reference numeral 630 may provide a timer function. Specifically, the timer function can be counted down from the set time based on the user-customized effect information. For example, if the time set based on the user-customized effect information is 50 seconds, it can be counted from 50 seconds to reach 0. At this time, the time indicated by reference numeral 630 is' 00:00. 00 ', it is possible to proceed to the next set.

According to one embodiment of the present disclosure, the controller 1700 may determine a break time between the set and the set. Specifically, the control unit 1700 can determine a resting time based on at least one of the physical condition and the exercise related information of the user 2000, determining the exercise being performed by the user 2000, and the like. For example, in consideration of the weight of the user 2000, the rest time may be shorter than the rest time according to the basic information in the exercise. For example, in consideration of the small muscle strength of the user 2000, the rest time may be determined longer than the rest time according to the basic information in the exercise. In addition, the controller 1700 may provide a notification to the user 2000 after the break time has elapsed. The notification may be output as an image or sound. The above screen information is merely an example, and may be changed according to need, and information about at least one screen may be omitted or added.

Figure 7 illustrates an exemplary diagram of a final result screen associated with an embodiment of the present disclosure.

According to one embodiment of the present disclosure, the smart mirror device 1000 may display the end result screen for the corresponding motion to the user 2000. The final result screen may be displayed on the display unit 1100 according to the determination of the controller 1700 when the user 2000 completes the last set. More specifically, the controller 1700 may determine to display the final result screen on the display unit 1100. The controller 1700 may determine the final result based on at least one of when the user 2000 completes the motion for the last set and when the user 2000 is out of the shooting range of the image acquisition unit 1200 in the last set It can be determined that the screen is to be displayed on the display unit 1100.

For example, the final result screen may be displayed on the display unit 1100 when the user 2000 completes the set for the ongoing motion. More specifically, if the user 2000 repeats twelve sets 10 times in one set of squat operations, the final result screen, which is a combination of data from 1 set to 12 sets, is displayed at the end of the last 12 sets. At this time, the combination of data from 1 set to 12 sets may be an average value for each item.

In another example, when the user 2000 in the last set is out of the shooting range of the image acquisition unit 1200, the final result screen may be displayed on the display unit 1100. [

Accordingly, the final result screen can be displayed based on the determination of the control unit 1700 included in the smart mirror apparatus 1000. [

According to one embodiment of the present disclosure, an item of exercise in which the user 2000 has progressed may be displayed in the upper left of the final result screen, and may be displayed as 'final' and 'final'.

According to one embodiment of the present disclosure, as shown in FIG. 7, reference numeral 710 may indicate at least one of last motion duration count information, last motion duration information, and downtime information during final motion. Also, the reference numeral 710 may display the information as the target area and the result area. In this case, the information displayed in the target area of the reference numeral 710 may vary depending on the item of the exercise performed by the user 2000. In addition, the information displayed in the target area of reference numeral 710 may vary depending on the current state of the user 2000. Specifically, the control unit 1700 generates the customized effect information based on the current state of the user 2000 and the operation of the recognized user 2000. Therefore, the information displayed in the target area of reference numeral 710 may be displayed based on the customized effect information. The above screen information is merely an example, and may be changed according to need, and information about at least one screen may be omitted or added.

According to one embodiment of the present disclosure, the result value indicated by reference numeral 710 may be displayed as the result information for the motion performed by the user 2000. For example, when the user 2000 repeats 12 sets of ten consecutive exercises, the number of consecutive exercises may be displayed as '120' in the result information area indicated by reference numeral 710 as shown in FIG. 3 have. Also, if the total motion duration of the user 2000 is 15 minutes and 20 seconds, as shown in FIG. 3, it may be indicated as '15 minutes 20 seconds' in the result information area at reference numeral 710.

According to one embodiment of the present disclosure, reference numeral 720 may indicate at least one of the calorie expenditure, the improvement direction, the next recommended motion, and the exercise recommendation amount. For example, reference numeral 720 may indicate a calorie expenditure. The calorie expenditure may be derived based on user customization information when the user 2000 performs all of the exercises. For another example, reference numeral 720 may indicate the improvement direction as a letter. The current state information of the user 2000 and the motion recognition of the user 2000 may include a message regarding the correct attitude to the motion of the user 2000. For example, it may be a message such as "Reduce the weight of the instrument used" or "Increase the weight of the instrument used". For another example, reference numeral 720 may display information about the next recommended motion. The next recommendation motion may be derived based on at least one of the current state information of the user, the motion recognition of the user 2000, and motion related information.

According to one embodiment of the present disclosure, reference numeral 730 may indicate the total time taken by the user 2000 to perform motion from one set to the last set. The total time taken may be the sum of the exercise time and the rest time of the user 2000.

FIG. 8 shows a flowchart of a method of providing personal training services performed in a smart mirror device 1000 in accordance with one embodiment of the present disclosure.

The smart mirror device 1000 includes a user information input and measuring step, a user motion sensing step, a motion recognition step performed by the user 2000, a calibration information providing step, a custom effect information providing, a calorie consumption calculation, It is possible to perform the recommendation step of the sports item.

The smart mirror device 1000 can receive the body information of the user 2000 from the user 2000 (810). For example, the smart mirror device 1000 may receive physical information of the user 2000 such as height, weight, waist circumference, chest circumference, etc. of the user 2000 from the user 2000. In addition, the smart mirror device 1000 can receive the age, sex, etc. of the user 2000. The smart mirror device 1000 may measure the body composition of the user 2000 based on the information input to the user input unit 1500 through the user state measurement unit 1300. [ For example, body composition such as body fat, muscle mass, water amount, and skeletal amount in the body and the body composition can be used to measure basic metabolism, body age, and the like.

The smart mirror device 1000 may recognize the operation of the user 2000 (820). The smart mirror device 1000 can recognize the position of each joint of the user 2000 from the image of the user 2000 photographed by the image acquisition unit 1200 through the control unit 1700. [ In addition, the smart mirror device 1000 derives a joint connecting line connecting the recognized joints, and recognizes the operation of the user 2000 based on the joint line angle of the user 2000 between the joint connecting lines at each joint . For example, when the user 2000 performs arm movements with dumbbells, the smart mirror device 1000 may recognize the joints, that is, the elbows, between the arms of the user 2000. In addition, the angle of the user 2000 can be derived through the connection line from the recognized elbow to the shoulder or wrist. Accordingly, the smart mirror device 1000 can recognize the operation of the user 2000 through the derived angle.

The smart mirror device 1000 may recognize the motion the user 2000 is performing based on the operation of the recognized user 2000 (830). A standard joint line angle between joint joints at each joint of the standard motion of the user 2000 performed by the user 2000 and a standard joint joint angle between joint joint lines at each joint of the user 2000 extracted from the image of the taken user 2000 The operation performing information can be generated by comparing the angles of the user's joint connecting lines. More specifically, the smart mirror device 1000 compares the motion of the user 2000 photographed by the image acquisition unit 1200 provided therein with the standard joint connection line of a database established in advance to generate motion information . Therefore, it is possible to recognize the exercise performed by the user 2000 through the operation performance information.

The smart mirror device 1000 generates calibration information for calibrating the motion of the user 2000 based on at least one of the operation performance information and the motion basic information and further displays on the display unit 1100 the calibration information (840). ≪ / RTI >

The smart mirror device 1000 can provide user customization information based on the current state of the user 2000 and the operation of the recognized user 2000 and can estimate the improvement direction And provide a recommended amount of exercise and recommendation of necessary sports items (850).

Figure 9 is a block diagram illustrating the means for implementing a method of providing personal training services performed in a smart mirror device in accordance with one embodiment of the present disclosure.

According to one embodiment of the present disclosure, the smart mirror device 1000 comprises: means 901 for acquiring an image of the user 2000; Means (902) for recognizing the operation of the acquired user (2000); Means (903) for generating motion related information based on operation of the recognized user (2000); And means 904 for displaying motion related information.

Alternatively, the means for displaying may further display an image of the user acquired by the means for acquiring the image.

The smart mirror device of claim 1, further comprising means for reflecting the appearance of the user located at the front of the smart mirror device, and wherein the means for displaying further comprises means for reflecting the user's appearance And display the motion-related information corresponding to the motion-related information.

Alternatively, the means for acquiring the image may include at least one of an RGB camera, an infrared projector, and a depth sensor, and may include a color view photographed with an RGB camera, a depth of the photographed image Based on at least one of a depth view and a skeleton view of the user, it is possible to acquire information that the joints of the joints change according to the operation of the user.

Alternatively, the means for acquiring the image may capture a still image of the user based on a predetermined time interval, and the means for controlling may comprise means for the still image of the user to include at least one If photographed, it can be determined to provide to the user terminal.

Alternatively, the motion-related information may include motion-performing information including information on the accuracy and frequency of motion performed by the user, basic motion information including basic information related to the motion performed by the user, And motion set information.

Alternatively, the operation-performing information may be information that the control means recognizes the user's operation on the acquired user's image, determines the exercise being performed by the user based on the recognized operation, And by comparing the motion of the user with the standard motion of the motion.

Alternatively, it may be generated by comparing the motion of the user recognized in the acquired user's image with the standard motion of the predetermined motion in the means for controlling.

Alternatively, the motion basic information may include at least one of a name of a motion performed by the user, a basic effect of the motion, a custom effect of the motion, and a trainer image.

Alternatively, the motion set information may include at least one of a number of times of performing a target, a current execution count, a performance time information, and a resting time information in a specific set in which the user performs a motion.

Alternatively, the means for controlling may recognize the position of each joint of the user on the obtained image of the user, determine a joint connection line connecting the recognized joints, and determine, on each joint, The user can recognize the operation of the user based on the angle of the joint joint line between the user and the user.

Alternatively, the means for controlling may be configured to determine the standard joint line angle between the joint lines at each joint of the standard motion of the movement being performed by the user and the standard joint line angle between the joint links at each joint of the user, Can be generated by comparing the angles of the user's joint connecting lines.

Alternatively, the apparatus may further include means for measuring a user state capable of measuring the current physical condition of the user.

Alternatively, the means for measuring the user condition may include at least two electrode portions, and may measure the user's current physical condition based on the impedance values of the body measured through the at least two electrode portions.

Alternatively, the apparatus may further include means for receiving current physical condition information of the user.

Alternatively, the means for receiving the information may provide the image of the user to the trainer terminal and receive feedback information based on the image of the user from the trainer terminal.

Alternatively, the apparatus may further include means for receiving the current state of the user.

Alternatively, the means for controlling may further comprise means for generating customized effect information based on the current state of the user and the recognized user's actions, predicting the direction of improvement through calculation of the user's calorie expenditure, And means for displaying a recommendation of the required sport item.

Alternatively, the means for controlling further generates calibration information for calibrating the motion of the user based on at least one of the motion-performing information and the motion-based information, and the means for displaying further comprises means for, Calibration information can be displayed.

Alternatively, the calibration information may include at least one of a normal operation range of the connection lines of the user's joints and joints, a highlight indication of connection lines of the user's joints and joints that deviate from the normal operation range, Based on at least one, a highlight indication relating to a significant body part in an ongoing sports event by the user.

Alternatively, the apparatus may further include means for outputting the motion-related information to audio.

10 is a block diagram illustrating a module for implementing a method of providing personal training services performed in a smart mirror device in accordance with one embodiment of the present disclosure.

The image comparison method according to one embodiment of the present disclosure may be implemented by the following module.

According to one embodiment of the present disclosure, the smart mirror device 1000 includes a module 1001 for acquiring an image of the user 2000; A module 1002 for recognizing the operation of the acquired user 2000; A module 1003 for generating motion related information based on the operation of the recognized user 2000; And a module 1004 for displaying motion-related information.

Alternatively, the smart mirror device may further include a module positioned on a front surface of the smart mirror device for reflecting the user's appearance, wherein the means for displaying includes means for reflecting the user's appearance reflected on the module for reflecting the user's appearance And display the motion-related information correspondingly.

Alternatively, the apparatus may further include a module for measuring a user's state, which can measure the current physical condition of the user.

Alternatively, a module for receiving the current physical condition information of the user may be further included.

Alternatively, a module for receiving the current state of the user may be further included.

Alternatively, a module for outputting the motion-related information to audio may be further included.

11 is a block diagram illustrating logic for implementing a method for providing a personal training service performed in a smart mirror device in accordance with one embodiment of the present disclosure.

According to one embodiment of the present disclosure, the image comparison method may be implemented by the following logic.

According to one embodiment of the present disclosure, the smart mirror device 1000 includes logic 1101 for acquiring an image of the user 2000; Logic 1102 for recognizing the operation of the acquired user 2000; Logic 1103 for generating motion related information based on motion of the recognized user 2000; And logic 1104 for displaying motion related information.

Alternatively, the smart mirror device further comprises logic for being positioned at a front surface of the smart mirror device and reflecting the user's appearance, wherein the means for displaying includes means for reflecting the user's appearance reflected on the logic for reflecting the user & And display the motion-related information correspondingly.

Alternatively, the apparatus may further include logic for measuring a user's state that can measure the current physical condition of the user.

Alternatively, the apparatus may further include logic for receiving the current physical condition information of the user.

Alternatively, logic for receiving the current state of the user may be further included.

Alternatively, the apparatus may further include logic for outputting the motion-related information to audio.

12 is a block diagram illustrating a circuit for implementing a method for providing personal training services performed in a smart mirror device in accordance with one embodiment of the present disclosure;

The image comparison method according to one embodiment of the present disclosure can be implemented by the following circuit.

According to one embodiment of the present disclosure, the smart mirror device 1000 includes a circuit 1201 for acquiring an image of the user 2000; Circuitry 1202 for recognizing the operation of the acquired user 2000; A circuit 1203 for generating motion related information based on the operation of the recognized user 2000; And circuitry 1204 for displaying motion related information.

Alternatively, the smart mirror device further includes circuitry positioned on the front surface of the smart mirror device for reflecting the appearance of the user, wherein the means for displaying includes means for displaying the reflected user on the circuit for reflecting the user ' And display the motion-related information correspondingly.

Alternatively, the apparatus may further include a circuit for measuring the user's state, which can measure the current physical condition of the user.

Alternatively, the apparatus may further include circuitry for receiving the current physical condition information of the user.

Alternatively, a circuit for receiving the current state of the user may be further included.

Alternatively, a circuit for outputting the motion-related information to audio may be further included.

Those skilled in the art will appreciate that the disclosure may be implemented in combination with other program modules and / or as a combination of hardware and software. For example, the present disclosure may be implemented by a computer-readable medium.

Any medium accessible by a computer may be a computer-readable medium, which may include volatile and non-volatile media, transitory and non-transitory media, removable and non-removable media, Removable media. By way of example, and not limitation, computer readable media can comprise computer readable storage media and computer readable transmission media.

Computer-readable storage media includes both volatile and nonvolatile media, both temporary and non-volatile media, both removable and non-removable, implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data Media. The computer-readable storage medium may be any form of storage device such as RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, Apparatus, or any other medium that can be used to store the desired information that can be accessed by a computer.

Computer readable transmission media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism, It includes all information delivery media. The term modulated data signal refers to a signal that has one or more of its characteristics set or changed to encode information in the signal. By way of example, and not limitation, computer readable transmission media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, or other wireless media. Combinations of any of the above described media are also intended to be included within the scope of computer readable transmission media.

Those skilled in the art will appreciate that the various illustrative logical blocks, modules, processors, means, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented or performed with a specific purpose, (Which may be referred to herein as "software") or a combination of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the design constraints imposed on the particular application and the overall system. Those skilled in the art may implement the described functions in various ways for each particular application, but such implementation decisions should not be interpreted as being outside the scope of the present disclosure.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and / or engineering techniques. The term "article of manufacture" includes a computer program, carrier, or media accessible from any computer-readable device. For example, the computer-readable storage medium can be a magnetic storage device (e.g., a hard disk, a floppy disk, a magnetic strip, etc.), an optical disk (e.g., CD, DVD, But are not limited to, memory devices (e. G., EEPROM, card, stick, key drive, etc.). The term "machine-readable medium" includes, but is not limited to, a wireless channel and various other media capable of storing, holding, and / or transferring instruction (s) and / or data.

It will be appreciated that the particular order or hierarchy of steps in the presented processes is an example of exemplary approaches. It will be appreciated that, based on design priorities, a particular order or hierarchy of steps in the processes may be rearranged within the scope of this disclosure. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

The description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure should not be construed as limited to the embodiments set forth herein, but is to be accorded the widest scope consistent with the principles and novel features presented herein.

Claims (23)

A smart mirror device for providing a personal training service,
A display unit for displaying motion-related information;
An image acquiring unit acquiring an image of a user; And
Determining a motion to be generated based on the acquired image of the user and displaying the motion related information; dividing the specific motion determined through the input of the user into at least one set having a target value based on the motion- Performing a counting on the number of motions of the user in units of one or more sets based on a comparison between a standard motion of a specific motion and a motion of a user recognized in an image of the obtained user, To display at least one of a set result screen and a final result screen, and when the predetermined user's operation is identified in the user's image, switching the information displayed on the display unit based on the gesture of the user Gesture recognition mode to start Control unit for;
, And
The exercise-
An exercise progress information including information about an accuracy and a frequency of an exercise performed by a user, basic exercise information including basic information related to an exercise performed by a user, exercise time information of a user, and exercise set information, ,
Wherein the operation-
Generating the motion of the user based on the recognized motion, determining the motion being performed by the user based on the recognized motion, comparing the motion of the user with the motion of the determined motion, and
The exercise set information includes:
Wherein the at least one of the target number of times, the current number of times of execution, the execution time information, and the resting time information in the specific set in which the user performs the exercise,
/ RTI >
A smart mirror device that provides personal training services.
The method according to claim 1,
The display unit may further include:
A display unit for displaying a user's image acquired by the image acquisition unit,
A smart mirror device that provides personal training services.
The method according to claim 1,
A mirror unit positioned on a front surface of the smart mirror device and capable of reflecting a state of the user;
Further comprising:
Wherein the display unit displays the motion-related information corresponding to a shape of a user reflected on the mirror unit.
A smart mirror device that provides personal training services.
The method according to claim 1,
The image acquiring unit may acquire,
An RGB camera, an infrared projector, and a depth sensor, and
Information that changes the connection of the joints according to a user's action based on at least one of a color view photographed with an RGB camera, a depth view of the photographed image, and a skeleton view of the user Lt; / RTI >
A smart mirror device that provides personal training services.
The method according to claim 1,
The image acquiring unit may acquire,
Taking a still image of the user based on a predetermined time interval, and
Wherein,
Determining if the still image of the user is to be provided to the user terminal,
A smart mirror device that provides personal training services.
delete The method according to claim 1,
Wherein the operation-
The control unit recognizes the user's motion in the obtained image of the user, determines the motion being performed by the user based on the recognized motion, and compares the motion of the determined motion with the motion of the user felled,
A smart mirror device that provides personal training services.
delete The method according to claim 1,
The motion basic information includes:
Comprising at least one of a name of a motion performed by the user, a basic effect of the motion, a custom effect of the motion, and a trainer image,
A smart mirror device that provides personal training services.
delete The method according to claim 1,
Wherein,
Determining a position of each joint of the user on the obtained user's image, determining a joint connection line connecting the recognized joints, and determining, based on the joint angle of the joint between the joint connection lines in each joint, Lt; RTI ID = 0.0 >
A smart mirror device that provides personal training services.
The method according to claim 1,
Wherein,
A standard joint line angle between joint joint lines at each joint of the standard motion of the movement being performed by the user is compared with an angle of a joint joint line between joint joint lines of each joint of the user extracted from the obtained user's image, Generating performance information,
A smart mirror device that provides personal training services.
The method according to claim 1,
A user state measurement unit capable of measuring a current physical state of the user;
≪ / RTI >
A smart mirror device that provides personal training services.
14. The method of claim 13,
Wherein the user state measuring unit comprises:
And at least two electrode portions,
Measuring a current physical condition of the user based on the impedance value of the body measured through the at least two electrode portions;
A smart mirror device that provides personal training services.
The method according to claim 1,
A network unit for receiving current physical condition information of the user;
≪ / RTI >
A smart mirror device that provides personal training services.
16. The method of claim 15,
The network unit includes:
Providing the user's image to the trainer terminal and receiving feedback information based on the user's image from the trainer terminal,
A smart mirror device that provides personal training services.
The method according to claim 1,
A user input unit for receiving the current state of the user;
≪ / RTI >
A smart mirror device that provides personal training services.
The method according to claim 1,
In addition,
Customized effect information is generated on the basis of the current state of the user and the recognized user's operation, the improvement direction is predicted through calculation of the consumed heat amount of the user, and the recommendation of the recommended exercise amount and recommendation of the necessary exercise item are displayed on the display unit To decide,
A smart mirror device that provides personal training services.
The method according to claim 1,
In addition,
Generating calibration information for calibrating a motion of the user based on at least one of the operation performance information and the motion basic information,
The display unit may further include:
And displaying the calibration information,
A smart mirror device that provides personal training services.
20. The method of claim 19,
The calibration information includes:
Based on at least one of a normal operation range of the connection lines of the user's joints and joints, a highlight indication of connection lines of the joints and joints of the user out of the normal operation range, and the operation performance information and the motion basic information, Which includes a highlighting of important body parts in an exercise item,
A smart mirror device that provides personal training services.
The method according to claim 1,
An audio output unit for outputting the motion-related information as audio;
≪ / RTI >
A smart mirror device that provides personal training services.
A method for providing a personal training service,
Acquiring an image of a user;
Determining to generate and display motion-related information based on the obtained user's image;
Dividing a specific motion determined through the input of the user into at least one set unit having a target value based on the motion-related information;
Performing a counting on the number of motions of the user in the one or more sets based on a comparison between a standard motion of the specific motion and a motion of a user recognized in an image of the obtained user;
Determining to display at least one of a set result screen and a final result screen based on the counting of the number of motions of the user; And
Determining to start a gesture recognition mode of switching information displayed on the display unit based on a gesture of a user when a predetermined user's action is identified in the user's image;
, And
The exercise-
An exercise progress information including information about an accuracy and a frequency of an exercise performed by a user, basic exercise information including basic information related to an exercise performed by a user, exercise time information of a user, and exercise set information, ,
Wherein the operation-
Generating the motion of the user based on the recognized motion, determining the motion being performed by the user based on the recognized motion, comparing the motion of the user with the motion of the determined motion, and
The exercise set information includes:
Wherein the at least one of the target number of times, the current number of times of execution, the execution time information, and the resting time information in the specific set in which the user performs the exercise,
A method for providing personal training services.
A computer program stored in a computer readable medium executable by one or more processors, the computer program causing the one or more processors to perform the following operations,
Obtaining an image of a user;
Determining to generate and display motion-related information based on the obtained user's image;
Dividing a specific motion determined through input of the user into at least one set unit having a target value based on the motion-related information;
Performing a counting on the number of motion of the user in the one or more sets based on a comparison of the standard motion of the specific motion and the motion of the user recognized in the acquired user's image;
Determining to display at least one of a set result screen and a final result screen based on the counting of the number of motions of the user; And
Determining to start a gesture recognition mode that switches information displayed on the display unit based on a user's gesture if a predetermined user's action in the user's image is identified;
And
The exercise-
An exercise progress information including information about an accuracy and a frequency of an exercise performed by a user, basic exercise information including basic information related to an exercise performed by a user, exercise time information of a user, and exercise set information, ,
Wherein the operation-
Generating the motion of the user based on the recognized motion, determining the motion being performed by the user based on the recognized motion, comparing the motion of the user with the motion of the determined motion, and
The exercise set information includes:
Wherein the at least one of the target number of times, the current number of times of execution, the execution time information, and the resting time information in the specific set in which the user performs the exercise,
A computer program stored in a computer-readable medium executable by one or more processors.

Images