WO2020153662A1

WO2020153662A1 - Body shape management apparatus

Info

Publication number: WO2020153662A1
Application number: PCT/KR2020/000820
Authority: WO
Inventors: 유수찬; 김명상; 박봉균
Original assignee: 엘지전자 주식회사
Priority date: 2019-01-25
Filing date: 2020-01-16
Publication date: 2020-07-30
Also published as: KR102648246B1; KR20200092618A

Abstract

A body shape management apparatus according to an embodiment of the present invention comprises a mirror apparatus and a mat apparatus. The mirror apparatus comprises: a communication unit; a camera for obtaining an image comprising a user; an output unit comprising a display and/or a speaker; a weight measurement module for measuring the weight of the user; a body composition measurement module for measuring the body composition of the user; and a control unit recognizing the user from the image. The mat apparatus comprises: a communication unit for connection with the mirror apparatus; a sensor unit obtaining sensing information relating to the exercise posture of the user; and a processor controlling the communication unit so as to transmit the obtained sensing information to the mirror apparatus.

Description

Body management device

The present invention relates to a body shape management device.

As people's interest in health care increases, various devices have recently appeared in the home that provide body care functions or enable simple exercise.

For example, the various devices are a body composition measuring device (for example, an in-body measuring device) that acquires body composition information such as a weight scale for measuring a user's weight, a user's body moisture, protein, minerals, body fat, skeletal muscle mass, abdominal fat percentage, and obesity diagnosis. And the like. However, since these devices are separately provided according to supported functions, the types of devices that can be provided in a limited space in the home may have limitations. Accordingly, there is a need to provide an integrated device capable of providing different body management functions according to various operation modes.

Meanwhile, an exercise mat among various devices may be used to protect a user's body from shock absorption and friction during exercise such as yoga.

As a prior art, in Patent Document 1 (Republic of Korea Patent Publication No. 10-2014-0065557, published on May 30, 2014), a piezoelectric element is disposed inside the mat to convert the energy applied to the piezoelectric element when the user moves on the mat as electrical energy. A momentum measuring mat is disclosed that converts and measures a user's momentum from the converted amount of electrical energy.

However, according to Patent Document 1, the exercise amount measurement mat can only measure the user's exercise amount, and does not provide a detection and guidance on whether the user's exercise is being performed correctly.

The problem to be solved by the present invention is to provide a body shape management device supporting various functions for managing the body shape of a user.

Another problem to be solved by the present invention is to provide a body shape management device capable of guiding a user's correct exercise.

Another problem to be solved by the present invention is to provide a body shape management device capable of more accurately acquiring information related to an exercise posture during a user's exercise.

Another problem to be solved by the present invention is to provide a body shape management device capable of maximizing an exercise effect by providing a posture correction guide during a user's exercise.

The apparatus for managing a body according to an embodiment of the present invention includes a communication unit, a camera for acquiring an image including a user, an output unit including at least one of a display and a speaker, a weight measurement module for measuring the weight of the user, and a body composition of the user Body composition measurement module for measuring, and a mirror device including a control unit for recognizing the user from the image, a communication unit for connecting to the mirror device, a sensor unit for obtaining sensing information related to the user's movement posture, and And a mat device including a processor that controls the communication unit to transmit the obtained sensing information to the mirror device.

The mirror device further includes an input unit that receives a selection input of an operation mode from the user, and when the selected operation mode is a body measurement mode, the controller measures the weight of the user by controlling the weight measurement module. , By controlling the body composition measurement module, the body composition of the user is measured, and body shape information including the measured body weight and body composition may be output through the output unit.

The control unit may output a body shape management guide corresponding to the body shape information through the output unit, and the body shape management guide may include at least one of a dietary guide and an exercise guide.

The control unit may transmit the body type information to the server through the communication unit and receive the body type management guide corresponding to the body type information from the server.

The control unit controls the camera to obtain an image including the user's whole body, measures the user's height based on the acquired image, and displays body shape information including the measured height, weight, and body composition. It can be output through the output section.

When the selected operation mode is the body type management mode, the controller may output the body type management content for the recognized user through the output unit.

The mirror device includes a main body part including a mirror, and a mat accommodating part provided on a rear surface of the main body part and having an accommodating space for accommodating the mat device, wherein the weight measurement module is accommodated inside the main body part. , In use, it can be pulled out by sliding from the inside of the main body.

According to an embodiment, the camera may be mounted on the upper portion of the main body and disposed to face a predetermined angle downward.

The mat device may include a mat portion deployed on a floor surface, and the sensor portion may include at least one sensor spaced apart from each other.

The sensor unit may include at least one of a pressure sensor unit including at least one pressure sensor and a distance sensor unit including at least one distance sensor.

The body shape management device according to an embodiment of the present invention includes a communication unit, a camera for acquiring an image of an exercise posture including an exercise posture during a user's exercise, an output unit including at least one of a display and a speaker, and a mirror device including a control unit. A mat device comprising a communication unit for connecting with the mirror device, a sensor unit for obtaining sensing information related to the user's movement posture, and a processor for controlling the communication unit to transmit the obtained sensing information to the mirror device. Including, the mirror device, and further comprises a recognition module for recognizing whether the user's exercise posture is correct based on the exercise posture image and the sensing information, and the controller corrects posture based on the recognition result of the recognition module The guide is output through the output unit.

The recognition module extracts a plurality of feature points related to the user's exercise pose from the exercise pose image, and determines whether the user's exercise pose is correct based on the extracted feature points and the sensing information. It may include a recognizer to recognize.

According to an embodiment, the plurality of feature points may include at least one of location, height, angle, and relative location information between body parts of the user's body parts.

The posture correction guide may include at least one of whether the user's exercise posture is correct and posture correction information for correcting the correct posture.

The sensor unit includes at least one of a pressure sensor unit including at least one pressure sensor and a distance sensor unit including at least one distance sensor, and the sensing information includes pressure sensing of each of the at least one pressure sensor. Value and at least one of the distance sensing values of each of the at least one distance sensor.

When the operation mode of the body management apparatus is set to the body management mode, the controller outputs a message requesting the installation of the mat device through the output unit, and acquires an image including the mat device through the camera, On the basis of the acquired image, correction information for moving the installation position of the mat device may be generated, and the generated correction information may be output through the output unit.

The control unit may detect an installation position of the mat device based on the acquired image, compare the detected installation position with a preset reference position, and generate the correction information based on the comparison result.

According to an embodiment of the present invention, the body shape management device may effectively provide various body shape information for the user through the body shape measurement mode. In addition, the body shape management device may induce effective user shape management by providing the body shape management information based on the user's body shape information.

In addition, the body shape management device may provide optimal content for managing the user's body shape through the body shape management mode, and recognize correctness of the user's exercise posture to guide correct exercise.

That is, the body type management apparatus according to an embodiment of the present invention can improve user convenience by providing various different functions according to an operation mode.

In addition, the body shape management device can guide the correct installation position of the mat device installed for the user's exercise. Accordingly, the body shape management apparatus may not only more effectively acquire an image including an exercise posture during the user's exercise, but also more accurately recognize the user's exercise posture from the image.

In addition, the body shape management device may recognize whether the exercise posture is correct through an artificial intelligence-based recognizer from information obtained in connection with the user's exercise posture, and provide a posture correction guide based on the recognition result. Accordingly, the body shape management device may maximize a user's exercise effect.

1 is a schematic configuration diagram of a system including a body type management device according to an embodiment of the present invention.

2 is a block diagram of an apparatus for managing a body according to an embodiment of the present invention.

3 is a perspective view showing an example of an implementation of a mirror device in the body management apparatus according to an embodiment of the present invention.

4 is a perspective view showing an example of an implementation of a mat device in a body type management device according to an embodiment of the present invention.

5 is a flowchart for explaining the operation of the body type management apparatus according to an embodiment of the present invention.

6 is an exemplary diagram related to the case where the operation mode of the body management apparatus is the body measurement mode.

7 to 8 are diagrams showing an embodiment in which the body shape management device guides the correct installation position of the mat device.

9 to 11 are views illustrating an embodiment in which the body shape management device recognizes whether the user's exercise posture is correct and provides a posture correction guide.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in the description of the embodiments disclosed herein, when it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed herein, detailed descriptions thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

When an element is said to be "connected" or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but there may be other components in between. It should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

1 is a schematic configuration diagram of a body type management system including a body type management device according to an embodiment of the present invention.

Referring to FIG. 1, the body type management system may include a body type management device 10 and a server 20.

The body shape management device 10 is disposed in a space such as a home, and may provide various functions for managing the body shape of the user.

For example, the body shape management apparatus 10 obtains body shape information including the user's weight or the user's body composition (body moisture, protein, minerals, body fat, etc.), and guides the user for managing the body shape based on the obtained body shape information ( Dietary guides, exercise content, etc.).

In addition, the body shape management device 10 provides a posture correction guide, etc. by acquiring image information or various sensing information to recognize whether an exercise is being performed in a correct posture during a user's exercise (eg, yoga, etc.) You may.

For example, the body shape management device 10 according to an embodiment of the present invention may include a mirror device and a mat device. Specific embodiments related to the body management apparatus 10 will be described later with reference to FIGS. 2 to 11.

The server 20 may be connected to the body type management device 10 through a communication module.

The server 20 may store and manage user information of the body type management device 10. The user information may include unique information such as a user's name or ID, body type information provided from the body type management device 10, image information, and/or sensing information. In particular, the body 20 may accumulate and store the body shape information, image information, and/or sensing information. In addition, the server 20 may further store information related to the body shape of the user determined based on the body shape information.

In addition, a plurality of guide information (eating habit guide, exercise content, etc.) for managing the user's body shape may be stored in the server 20. The body management apparatus 10 obtains guide information corresponding to the user's body shape information from the server 20 among a plurality of guide information stored in the server 20, and uses the obtained guide information to manage the body shape for the user You can provide a guide.

Meanwhile, the body type management device 10 may be connected to a terminal 30 such as a user's smartphone or tablet PC, and transmit guide information based on the body type information and the body type information. In addition, the body shape management apparatus 10 may transmit image information or sensing information acquired during a user's exercise, or a posture correction guide based on the acquired information, to the terminal 30.

Meanwhile, the server 20 may be connected to the user's terminal 30 and transmit guide information based on the body shape information, information related to the user's body shape based on the body shape information, and the like to the terminal 30.

Referring to FIG. 2, the body type management device 10 may include a mirror device 100 and a mat device 200. Here, the mirror device 100 may be understood as a main device (main device) of the body type management device 10, and the mat device 200 may be understood as an auxiliary device (sub device).

For example, the mirror device 100 may include a communication unit 110, an input unit 120, a camera 130, an output unit 140, a memory 170, and a control unit 180.

The communication unit 110 may include at least one communication module for connecting the mirror device 100 with the server 20 and/or the terminal 30. For example, the communication unit 110 supports a communication method according to a wireless Internet technology such as a mobile communication module supporting a communication method according to a mobile communication technology standard such as long term evolution (LTE), a wireless LAN (WLAN), and Wi-Fi. It may include a wireless Internet module.

Further, the communication unit 110 may include at least one communication module for connecting the mirror device 100 with the mat device 200 or the terminal 30. For example, the communication unit 110 may include a short-range communication module supporting a communication method according to a short-range communication technology such as Bluetooth (Bluetooth), Wi-Fi Direct.

According to an embodiment, the communication unit 110 may connect the mirror device 100 with various household appliances (refrigerator, water purifier, air conditioner, etc.) through the communication modules. In this case, the mirror device 100 may transmit and receive various types of data related to the user's body shape management or physical condition to and from the home appliances.

The input unit 120 may include at least one input means for receiving a request or command related to the function or operation of the body type management device 10 from the user. For example, the input unit 120 may include a button, a dial, a touch pad, and a microphone. According to an embodiment, the input unit 120 may be implemented as a touch screen combined with the display 142.

The camera 130 may be mounted at a predetermined position of the mirror device 100 to obtain image information on a predetermined area determined by an image sensor and a lens. The image information may include moving images and still images.

In particular, according to an embodiment of the present invention, the camera 130 acquires image information including the user's appearance, obtains image information related to the user's athletic posture, or guides the installation location of the mat device 200 In order to obtain image information including the current location of the mat device 200.

The output unit 140 may output various information based on a driving state, an operation mode, and the like of the body management apparatus 10. For example, the output unit 140 may include a display 142 for outputting the various information in a visual form such as graphic or text, and a speaker 144 for outputting the various information in audible form such as voice or sound. Can.

Meanwhile, the mirror device 100 according to an embodiment of the present invention may further include at least one of the weight measurement module 150 and the body composition measurement module 160 as a means for obtaining user's body shape information.

The weight measurement module 150 is a device for measuring a user's weight, and may include a weight scale of various methods known in the art.

The body composition measurement module 160 may include at least one sensor that measures a resistance value generated when a micro electric current passes through a user's body, and measures body components such as moisture, protein, minerals, and fat in the body. have.

The memory 170 may store various algorithms, program data, and the like related to functions or operations of the body type management device 10 or the mirror device 100. In addition, the memory 170 may store user information of the body type management device 10 or body type management guide information to be provided to the user. The memory 170 may include at least one volatile/nonvolatile memory.

The controller 180 may include at least one processor or controller that controls the overall operation of the mirror device 100.

The controller 180 may control the operation of at least one of the components included in the mirror device 100 based on the operation mode of the body measurement device 10. The controller 180 outputs information obtained or generated according to the control result of the at least one configuration through the output unit 140 or transmits it to the server 20 and/or the terminal 30 through the communication unit 110. Can.

The detailed control operation of the control unit 180 according to the operation mode of the body measurement apparatus 10 will be described in more detail through FIGS. 5 to 11 later.

On the other hand, the mat device 200, the processor 210 for controlling the overall operation of the mat device 200, the communication unit 220 for connection with the mirror device 100, and the algorithm related to the operation of the mat device 200 And/or a memory 230 for storing program data and the like. For example, the communication unit 220 may include a short-range communication module supporting a communication method according to short-range communication technology such as Bluetooth or Wi-Fi Direct.

In addition, the mat device 200 may include a pressure sensor unit 240 and/or a distance sensor unit 250 for obtaining sensing information related to a user's exercise posture.

The pressure sensor unit 240 may include at least one pressure sensor spaced apart from each other in the mat unit 201 (see FIG. 4) of the mat device 200. The distance sensor unit 250 may include at least one distance sensor, which is spaced apart from each other in the mat unit 201, similar to the pressure sensor unit 240. The distance sensor may be implemented with various well-known sensors for distance measurement, such as an ultrasonic sensor or a laser sensor.

The at least one pressure sensor may measure the pressure exerted by a body part during the user's exercise. The at least one distance sensor may measure a distance between a body part and the mat unit 201 during a user's exercise.

The processor 210 acquires sensing information by controlling the pressure sensor unit 240 and/or the distance sensor unit 250 during a user's exercise, and the obtained sensing information is transmitted through the communication unit 220 to the mirror device 100 Can be transferred to. The obtained sensing information may be used to recognize the accuracy of an exercise posture taken by the user during exercise.

According to an embodiment, the mat device 200 may include various sensors for acquiring the sensing information.

Hereinafter, an example of implementation of the above-described mirror device 100 and the mat device 200 will be described with reference to FIGS. 3 and 4.

Referring to FIG. 3, the body unit 101 of the mirror device 100 may be provided with a mirror that illuminates a user or the like in front through reflection of light. In this case, the display 142 of the mirror device 100 may be implemented as a mirror display, thereby simultaneously providing a mirror function and a display function. The appearance of the mirror device 100 shown in FIG. 3 is only an example for convenience of description, and the mirror device 100 according to an embodiment of the present invention is not limited thereto.

In the following specification, the direction in which the mirror of the mirror device 100 faces is defined as front, and the opposite direction is defined as rear.

The camera 130 is mounted on the upper portion of the main body 101, it can be arranged to face downward by a predetermined angle. Accordingly, the camera 130 may acquire an image including the user and/or the mat device 200 existing in front of the mirror device 100.

In the rear of the main body 101, a mat accommodating portion 102 forming an accommodating space accommodating the mat device 200 may be formed. When the user wants to use the mat device 200, the mat device 200 accommodated in the mat accommodating unit 102 may be taken out and the mat device 200 may be unfolded in front of the mirror device 100.

Meanwhile, the weight measurement module 150 may be provided below the main body 101. For example, the weight measurement module 150 is accommodated inside the body portion 101 when not in use, and can be pulled out by sliding from the inside of the body portion 101 when not in use.

Body composition measurement module 160 may be provided on the side of the body portion 101. For example, the body composition measurement module 160 may be formed in size and shape so that the user can grip it by hand. The body composition measurement module 160 may be connected to the main body 101 by a cable or a wire. For example, when the body composition measurement module 160 is not used, the cable or wire is accommodated into the body portion 101 through rolling or the like, and the body composition measurement module 160 is fixed to the side of the body portion 101. Can. When the user uses the body composition measurement module 160, the body composition measurement module 160 can be pulled by hand, and accordingly, the cable or wire is released to release the body composition measurement module 160 from being fixed. .

Referring to FIG. 4, the mat device 200 may include a mat unit 201 and an operation unit 202. The mat portion 201 is made of a material having ductility such as urethane and rubber, so that when a user exercises on the mat portion 201, it is possible to absorb shock, prevent slippage, and prevent body damage due to friction.

The mat unit 201 may be provided with a pressure sensor unit 240 and/or a distance sensor unit 250 for acquiring sensing information during a user's exercise. The pressure sensor unit 240 and/or the distance sensor unit 250 may include at least one pressure sensor and/or a distance sensor that are disposed spaced apart from each other on the mat unit 201.

When using the mat device 200, the mat unit 201 may be deployed on the floor surface by the user. At this time, the pressure sensor unit 240 may be arranged to measure the pressure in the vertical direction (vertical direction), the distance sensor unit 250 may be arranged to face the top (ceiling, etc.) rather than the bottom surface. have.

The operation unit 202 may be provided at one position of the mat unit 201. For example, the operation unit 202 may be implemented to be detachable at the one position of the mat unit 201. The processor 210, the communication unit 220, and the memory 230 described above in FIG. 2 may be implemented in the operation unit 202, but not necessarily, and may be implemented in the mat unit 201.

Meanwhile, a button or a touch screen for inputting a command related to a function or operation of the mat device 200 or the body type management device 10 may be implemented in the operation unit 202.

According to an embodiment, the operation unit 202 may be implemented as a terminal such as a user's smartphone. In this case, the mat device 200 may be connected to the terminal, and provide sensing information obtained from the pressure sensor unit 240 and/or the distance sensor unit 250 to the terminal.

Hereinafter, with reference to FIGS. 5 to 11, embodiments related to the operation of the body type management apparatus according to an embodiment of the present invention will be described.

Referring to FIG. 5, the body type management device 10 may detect a user who wants to use the body type management device 10 (S100).

Specifically, when the power is turned on by the manipulation of the input unit 120, the body shape management device 10 may detect a user using the camera 130 or the like.

For example, the controller 180 may acquire the image including the user through the camera 130 and detect the user by recognizing identification information such as a user's face from the acquired image. To this end, unique information for the user's detection may be stored in the memory 170.

According to an embodiment, the controller 180 may measure a user's weight using the weight measurement module 150 and may detect the user based on the measured weight. For example, the controller 180 compares the weight information of each of the plurality of users stored in the memory 170 with the weight measured by the weight measurement module 150, and compares the weight information to the weight information most similar to the measured weight. A corresponding user can be detected.

Similarly, the controller 180 may detect a user based on body composition information measured through the body composition measurement module 160, or may detect a user using various other means such as a microphone.

Depending on the embodiment, step S100 may be performed after step S110 or before a control operation according to the selected operation mode is started.

The body management apparatus 10 may receive a selection input of an operation mode from a user (S110).

In this specification, it is assumed that the operation mode of the body shape management device 10 includes a body shape measurement mode, a body shape management mode, and a mirror mode. The body shape measurement mode refers to a mode for measuring body shape information such as a user's weight and body composition. The body shape management mode may refer to a mode for providing a body shape management guide such as body shape management content (exercise program content, etc.) or real-time recognition and management of the user's exercise status based on the user's body shape information or body condition information. have. The mirror mode may mean a mode that provides only a simple mirror function or provides predetermined information (schedule, weather, news, etc.) through a mirror display.

When the selected operation mode is the body shape measurement mode (YES in S120), the body shape management device 10 may obtain the body shape information of the user using the weight measurement module 150 and/or body composition measurement module 160 ( S130).

The control unit 180 may control the weight measurement module 150 to measure a user's weight. In addition, the control unit 180 may control the body composition measurement module 160 to measure body components such as moisture, protein, minerals, and fat in the user's body. Accordingly, the controller 180 may obtain body shape information including the weight and/or body composition.

According to an embodiment, the controller 180 may acquire an image including the entire body of the user through the camera 130 and additionally measure the height (height) of the user based on the acquired image. That is, the controller 180 may obtain body shape information further including a user's height. To this end, an algorithm for measuring a user's height from an image acquired through the camera 130 may be stored in the memory 170.

The body type management device 10 may output the obtained body type information and related information (such as a body type management guide) based on the body type information (S140 ).

The controller 180 may output body shape information obtained through the weight measurement module 150 and/or body composition measurement module 160 through the output unit 140.

In addition, the controller 180 may transmit the body type information to the server 20 and receive relevant information corresponding to the body type information from the server 20. For example, the related information may include a body shape management guide (eating guide, exercise guide, etc.) according to the body shape information. According to an embodiment, related information (body management guide) for each of various body types information may be stored in the memory 170. In this case, the controller 180 may load the figure management guide corresponding to the obtained figure information from the memory 170.

Meanwhile, the server 20 may accumulate and store body type information for the user. The server 20 may provide the user with information related to the user's body shape change through the body type management device 10 or the terminal 30 based on the accumulated body type information.

The controller 180 may output the related information through the output unit 140. According to an embodiment, the controller 180 may transmit the body type information and related information to the user's terminal 30.

On the other hand, when the selected operation mode is the body type management mode (YES in S150), the body type management device 10 may acquire the body type management content based on the user information (S160), and provide the obtained body type management content to the user. (S170).

When the body type management mode is selected, the controller 180 obtains body type management content based on user information (for example, body type information) from the server 20 or the memory 170, and outputs the body type management content to the output unit 140. Can be output through

For example, the body type management content may include exercise program content such as yoga. That is, the controller 180 can output the body type management content through the display 142 and/or the speaker 144, and the user acts, such as an exercise for managing the body type, based on the body type management content output. You can do

Meanwhile, the controller 180 may acquire image information including the user using the camera 130 during the user's exercise. In addition, the controller 180 may acquire sensing information measured during a user's exercise from the mat device 200. The controller 180 may recognize whether the user's exercise posture is correct based on the acquired image information and/or sensing information, and provide a posture correction guide according to the recognition result.

Meanwhile, the controller 180 may store a user's workout record (date, time, number of times, etc.) in the memory 170 or transmit it to the server 20. The controller 180 or the server 20 may provide a notification to the terminal 30 to induce the user's exercise when the user has not performed the exercise for a predetermined period based on the user's exercise record.

When the selected operation mode is the mirror mode (NO in S150), the body shape management device 10 may deactivate the operation of the camera 130, the weight measurement module 150, and the body composition measurement module 160. Accordingly, the body shape management device 10 may provide a simple mirror function. According to an embodiment, the body type management device 10 may additionally provide information such as a schedule, weather, and news through the display 142.

Referring to FIG. 6, when the operation mode of the body shape management device 10 is the body shape measurement mode, the controller 180 may obtain body shape information using the weight measurement module 150 and/or body composition measurement module 160. Can.

In addition, the controller 180 may measure the height of the user 600 from the image acquired through the camera 130, or may acquire the whole body shape information based on the appearance of the user 600. According to an embodiment, the height may be input from the user 600 through the input unit 120.

The controller 180 may output measured body shape information and a body shape management guide based on the body shape information through the display 142.

For example, the screen 610 output to the display 142 may include weight information obtained by the weight measurement module 150 and appearance information 611 including height and body shape obtained from the image of the user 600. Can. Further, the screen 610 may include body composition information 612 obtained by the body composition measurement module 160. In addition, the screen 610 may include body shape management information 613 (eg, personalized exercise content, etc.) based on body shape information obtained for the user 600.

That is, the body shape management apparatus 10 may effectively provide various body shape information for the user 600 through the body shape measurement mode. In addition, the body shape management apparatus 10 may provide effective body shape management to the user by providing body shape management information based on the user's body shape information.

When the operation mode of the body management apparatus 10 is the body management mode, the controller 180 may provide body shape management content for managing the body shape of the user. For example, the body type management content may be content related to an exercise performed on the mat device 200 (eg, a yoga video, etc.).

At this time, the body type management device 10, the mat device 200 must be installed in the correct installation position, it is possible to more accurately recognize the user's exercise posture using the camera 130. Accordingly, the body shape management device 10 may guide the installation position of the mat device 200.

Referring to FIG. 7, the body shape management device 10 may detect the installation position of the mat device 200 (S700 ).

Specifically, when the operation mode is set to the body management mode, the controller 180 of the mirror device 100 may output a message requesting the installation of the mat device 200 through the output unit 140.

Thereafter, the controller 180 may acquire an image including the mat device 200 through the camera 130.

For example, when it is sensed that the mat device 200 is withdrawn from the mat accommodating unit 102, the controller 180 may control the camera 130 to obtain an image including the mat device 200. To this end, the mat accommodating part 102 may be provided with a sensor (weight sensor, switch, open/close detection sensor, etc.) that detects whether the mat device 200 is accommodated.

Alternatively, when the power of the mat device 200 is turned on and the communication connection between the mat device 200 and the mirror device 100 is established, the controller 180 may control the camera 130 to obtain the image. have.

The body type management apparatus 10 may check whether the detected installation location matches the reference location (S710), and generate and output correction information on the installation location of the mat device 200 based on the confirmation result. (S720).

The controller 180 may detect the installation position of the mat device 200 from the image acquired through the camera 130 and compare the detected installation position with a preset reference position. As a result of the comparison, when the installation position is different from the reference position, the controller 180 may generate correction information for moving the installation position of the mat device 200 and output the generated correction information through the output unit 140. have.

For example, as illustrated in FIG. 8, when it is confirmed that the installation position of the detected mat device 200 is 10 cm to the left from the reference position, the controller 180 moves the mat device 200 to the right 10 cm. You can output the correction information that guides you to do. For example, the correction information may include first correction information 811 in a graphic form output through the display 142 and second correction information 812 in a voice form output through the speaker 144.

The user may move the installation position of the mat device 200 based on the outputted

correction information

811 and 812.

The control unit 180 acquires an image including the mat device 200 by controlling the camera 130 during or after movement of the installation position of the mat device 200, and detects the installation position moved from the acquired image can do. When the moved installation position matches the reference position, the controller 180 outputs a message indicating that the mat device 200 is installed at the correct installation position through the output unit 140 and provides body type management content to the user. Can. The installation position of the mat device 200 coincides with the reference position may include not only the case where the installation position completely matches the reference position, but also a case where the difference between the installation position and the reference position is less than a threshold.

That is, according to the embodiment illustrated in FIGS. 7 to 8, the body shape management device 10 guides an accurate installation position of the mat device 200, thereby using the camera 130 to display an image related to the user's movement posture. It can be obtained more effectively.

Referring to FIG. 9, the body shape management apparatus 10 may acquire an image including a user's exercise posture through the camera 130 (S900).

The controller 180 of the mirror device 100 may output the body type management content through the output unit 140 when the operation mode of the body type management device 10 is the body type management mode.

The controller 180 may obtain an image including a user's workout posture through the camera 130 during output of the body type management content.

The body shape management device 10 may acquire sensing information through a sensor unit (a pressure sensor unit 240 and/or a distance sensor unit 250) provided in the mat device 200 (S910 ).

The processor 210 of the mat device 200 may acquire sensing information through the pressure sensor unit 240 and/or the distance sensor unit 250 while the user takes a specific exercise posture.

For example, the sensing information may include a pressure sensing value of each of the at least one pressure sensor and/or a distance sensing value of each of the at least one distance sensor (distance between the user's body and the mat unit 201).

The processor 210 may transmit the obtained sensing information to the mirror device 100 through the communication unit 220.

The body type management apparatus 10 may recognize whether the user's exercise posture is correct from the acquired image and/or sensing information (S920).

The controller 180 may analyze a user's movement posture using an image analysis technique known in advance from the acquired image. For example, the controller 180 may obtain information such as a position, height, angle, and relative position between body parts of the user based on the analysis result. The controller 180 may recognize whether the user's exercise posture is correct based on the obtained information.

In addition, the controller 180 obtains information such as the position, height, angle, and relative position between body parts of the user's body parts from the obtained sensing information, or information such as the center of gravity of the user, and the user's exercise posture. Can recognize whether is correct.

According to an embodiment, the mirror device 100 extracts a plurality of feature points related to the user's movement posture from the acquired image, and extracts the extracted feature points and the sensing information based on artificial intelligence (eg, machine learning) Can be entered as a recognizer. The mirror device 100 may recognize whether the user's movement posture is correct based on the recognition result of the recognizer. This will be described with reference to FIG. 10.

Referring to FIG. 10, the mirror device 100 determines whether the user's workout posture is correct based on the workout posture image 1000 representing the user's workout posture and the sensing information 1010 received from the mat device 200. A recognition module 190 for recognizing may be further included.

The recognition module 190 may be implemented in hardware, software, or a combination of hardware and software. When the recognition module 190 is implemented in software, various data such as program data or algorithms related to the recognition module 190 are stored in the memory 170, and the controller 180 processes the stored various data to recognize the recognition module The operation of 190 can be controlled.

The recognition module 190 may include an image analyzer 192 that extracts a plurality of feature points related to the user's exercise posture from the exercise posture image 1000. According to an embodiment, the image analyzer 192 may be included in the controller 180. For example, the image analyzer 192 may extract a plurality of feature points including the position, height, angle, and relative position between body parts of the user's body parts from the exercise posture image 100.

The recognition module 190 may include a plurality of feature points extracted by the image analyzer 192 and a recognizer 194 that recognizes whether a user's workout posture is correct from sensing information received from the mat device 200. have. For example, the recognizer 194 may include an artificial neural network (ANN) that is learned and built based on machine learning.

The machine learning may refer to a system that performs prediction based on empirical data and improves one's own performance through learning. Deep learning technology, which is a kind of machine learning, is based on data and goes down to deep levels to learn.

The artificial neural network may include an input layer, a hidden layer, and an output layer. Each layer includes a plurality of nodes, and each layer is connected to the next layer. Nodes between adjacent layers can be connected to each other with a weight.

Each node may operate based on the activation model, and an output value corresponding to an input value may be determined according to the activation model.

For example, the output value of a node of a specific level layer may be input to a node of the next level layer connected to the node. That is, the node of the next level layer can receive values output from the nodes of the previous level layer.

At this time, the input value of each node may be a value in which weight is applied to the output value of the node of the previous level layer. The weight may mean a connection strength between nodes.

The artificial neural network may extract feature information corresponding to each level using a learned layer corresponding to each level. The artificial neural network can be abstracted sequentially to recognize a predetermined object by using the highest level of feature information or to detect a predetermined situation. That is, the artificial neural network may output information having the highest weight among output values of the output layer as a recognition result or a detection result.

On the other hand, the artificial neural network may continuously update the weight between each node by learning using the recognition result or the detection result. To this end, data for learning the artificial neural network may be stored in the memory 170. According to an embodiment, data for learning of the artificial neural network may be stored in the server 20. In this case, the learning operation of the artificial neural network may be performed by the server 20. The mirror device 100 may receive data related to the learned artificial neural network from the server 20 and update the recognizer 194 of the recognition module 190 based on the received data.

The recognizer 194 may recognize whether the user's exercise posture is correct based on a plurality of feature points and sensing information 1010 of the exercise posture image 1000 extracted by the image analyzer 192. The recognition result of the recognizer 194 may include whether the exercise posture is correct/inaccurate. In addition, when the exercise posture is incorrect, the recognition result may further include posture correction information.

That is, the body shape management device 10 can recognize the user's exercise posture more accurately using the AI-based recognizer 194 and provide posture correction information accordingly, thereby inducing the user's correct exercise to improve the exercise effect. Can be maximized.

Based on the example of FIG. 10, the recognizer 194 may output posture correction information indicating that the user's exercise posture is inaccurate and that the height of the leg should be increased by about 5 cm.

9 will be described again.

The body shape management device 10 may provide a posture correction guide based on the recognition result (S930).

The controller 180 may provide the posture correction guide to the user according to the recognition result of whether the user's exercise posture is correct based on the image and/or sensing information.

For example, when it is recognized that the user's exercise posture is correct, the posture correction guide may include graphics, text, or voice indicating that the user's exercise posture is correct.

On the other hand, when it is recognized that the user's exercise posture is incorrect, the posture correction guide may include a message (graphic, text, voice message, etc.) indicating that the user's exercise posture is incorrect. In addition, the posture correction guide may further include posture correction information for correcting a correct exercise posture.

Referring to the embodiment of FIG. 11, the controller 180 of the mirror device 100 may output the body type management content 1111 through the display 142.

The controller 180 may acquire an exercise posture image of the user 1100 through the camera 130 during output of the body type management content 1111 and recognize whether an exercise posture is correct from the obtained exercise posture image.

The controller 180 may output a posture correction guide including a message indicating that the user's exercise posture is inaccurate and posture correction information when the user's 1100 exercise posture is incorrect. For example, the posture correction guide may be output in the form of a voice message 1112 through the speaker 144.

The user may perform correct exercise by correcting the exercise posture based on the output voice message 1112.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and variations without departing from the essential characteristics of the present invention.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments.

The scope of protection of the present invention should be interpreted by the claims below, and all technical spirits within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

Claims

Communication,

A camera that acquires an image that includes the user,

An output unit including at least one of a display and a speaker,

Weight measurement module for measuring the weight of the user,

Body composition measurement module for measuring the body composition of the user, and

A mirror device including a control unit that recognizes the user from the image; And

Communication unit for connecting with the mirror device,

A sensor unit for obtaining sensing information related to the user's exercise posture, and

And a mat device including a processor that controls the communication unit to transmit the obtained sensing information to the mirror device.
According to claim 1,

The mirror device,

Further comprising an input unit for receiving a selection input of the operation mode from the user,

The control unit,

When the selected operation mode is the body shape measurement mode, the body weight measurement module is controlled to measure the user's body weight, and the body composition measurement module is controlled to measure the user body composition,

A body shape management device that outputs body shape information including the measured weight and body composition through the output unit.
According to claim 2,

The control unit,

The body shape management guide corresponding to the body shape information is output through the output unit,

The body shape management guide body shape management device comprising at least one of a diet guide and exercise guide.
According to claim 3,

The control unit,

The body information is transmitted to the server through the communication unit,

A body shape management device that receives the body shape management guide corresponding to the body shape information from the server.
According to claim 2,

The control unit,

Control the camera to obtain an image that includes the entire body of the user,

The height of the user is measured based on the acquired image,

A body shape management device that outputs body shape information including measured height, weight, and body composition through the output unit.
According to claim 1,

The mirror device,

Further comprising an input unit for receiving a selection input of the operation mode from the user,

The control unit,

When the selected operation mode is the body type management mode, the body type management device that outputs the body type management content for the recognized user through the output unit.
According to claim 1,

The mirror device,

A body part including a mirror; And

It is provided on the rear surface of the body portion, and includes a mat accommodating portion having an accommodating space for accommodating the mat device,

The weight measurement module is accommodated in the interior of the body portion, the body shape management device that is used to slide out from the interior of the body portion when used.
The method of claim 7,

The camera is mounted on the upper portion of the body portion body shape management device is disposed to face a predetermined angle downward.
According to claim 1,

The mat device,

Includes a mat portion that is deployed on the bottom surface,

The sensor unit body management device comprising at least one sensor that is spaced apart from each other on the mat portion.
The method of claim 9,

The sensor unit,

A body type management device comprising at least one of a pressure sensor unit including at least one pressure sensor and a distance sensor unit including at least one distance sensor.
Communication,

A camera that acquires an image of an exercise posture including an exercise posture during a user's exercise,

An output unit including at least one of a display and a speaker, and

A mirror device including a control unit; And

Communication unit for connecting with the mirror device,

Sensor unit for obtaining the sensing information related to the user's exercise posture, and

And a mat device including a processor that controls the communication unit to transmit the obtained sensing information to the mirror device,

The mirror device,

Further comprising a recognition module for recognizing whether the user's exercise posture is correct based on the exercise posture image and the sensing information,

The control unit is a body shape management device for outputting a posture correction guide based on the recognition result of the recognition module through the output unit.
The method of claim 11,

The recognition module,

An image analyzer extracting a plurality of feature points related to the user's exercise posture from the exercise posture image; And

And a recognizer for recognizing whether the user's exercise posture is correct based on the extracted feature points and the sensing information.
The method of claim 12,

The plurality of feature points,

A body type management device including at least one of position, height, angle, and relative position information between body parts of the user's body parts.
The method of claim 11,

The posture correction guide,

And a posture correction information for correcting the user's exercise posture and correcting the posture for correct exercise posture.
The method of claim 11,

The mat device,

Includes a mat portion that is deployed on the bottom surface,

The body portion management device including at least one sensor spaced apart from each other on the mat portion.
The method of claim 15,

The sensor unit,

A pressure sensor unit including at least one pressure sensor, and at least one of a distance sensor unit including at least one distance sensor,

The sensing information,

And a pressure sensing value of each of the at least one pressure sensor and a distance sensing value of each of the at least one distance sensor.
The method of claim 11,

The control unit,

When the operation mode of the body management device is set to the body management mode, a message requesting the installation of the mat device is output through the output unit,

Obtaining an image including the mat device through the camera,

A body shape management device that generates correction information for moving the installation position of the mat device based on the acquired image, and outputs the generated correction information through the output unit.
The method of claim 17,

The control unit,

On the basis of the acquired image to detect the installation position of the mat device,

Compare the detected installation position with a preset reference position,

A body type management device that generates the correction information based on a comparison result.