KR20240003572A - Method and system for generating a balance information of body - Google Patents

Abstract

The present invention is to generate body balance information of a user, and for this purpose, an image product that generates and provides first image data by photographing the movement state of the body, including the soles of the feet and the feet, while the user is lying down. It is possible to provide a user body balance information generation system including an information processing device that generates body balance state information of the user through study and analysis of the first image data provided from the image provider.

Description

Body balance information generation system and method {METHOD AND SYSTEM FOR GENERATING A BALANCE INFORMATION OF BODY}

The present invention relates to a technology for obtaining body balance information for measuring a user's exercise ability.

Today's modern people maintain the same posture for long periods of time, such as sitting at a desk or driving. Like this, if an incorrect posture continues for a long time, a fatal imbalance appears in the human body, and such physical imbalance is bound to have a negative impact on the daily lives of modern people. In particular, modern people who suffer from busy daily lives lack the amount of exercise, and with the spread of smartphones and computers, they spend a lot of time in front of computers and often stare at smartphones, which causes problems with physical balance and exercise ability, such as stiff backs and sagging necks. Many problems are occurring.

In addition, when modern people do things such as crossing their legs while sitting on a chair, it can cause the body's balance to be lost.

Likewise, when body balance and exercise ability deteriorate, the structure and function of the muscles and bones that maintain the human body's posture become unbalanced, requiring excessive energy for activities, and exercise ability decreases, placing an undue burden on the musculoskeletal system. This may cause pain.

Additionally, if unbalanced postures and habits are maintained for a long time, damaged muscles and joints become abnormally active to compensate for the damage, which can result in secondary deformation of the body. This can cause musculoskeletal symptoms such as scoliosis (functional scoliosis).

Republic of Korea Patent Publication No. 10-2015-0059629

The present invention provides a body balance information generating system and method that can generate a user's body balance information using only foot-related images.

Additionally, the present invention provides a system and method for generating body balance information that can verify and correct the user's body balance information generated based on images related to feet.

The problems to be solved by the present invention are not limited to those mentioned above, and other problems to be solved that are not mentioned can be clearly understood by those skilled in the art from the description below. will be.

In order to solve the problem to be solved above, the body balance information generation system according to an embodiment of the present invention includes the soles of the feet while the user is lying down, and generates first image data through filming the movement state of the body including the feet. It may include an image providing unit that generates and provides an information processing device that generates body balance state information of the user through analysis of the first image data provided from the image providing unit.

According to an embodiment of the present invention, the image generator includes a first image capture device that captures an image of the sole of the user's feet in a lying state, and a lower part of the user's knee in the lying state. It includes a second image capture device, and the first and second image capture devices may generate first image data by capturing an image according to the movement of the user's foot according to a preset guide.

According to an embodiment of the present invention, the image generator includes at least one third image capture device that generates side view data by capturing the user at various angles while the user is standing, and the user's head. A fourth image capturing device is installed at the upper part of the vertical direction as a reference and generates at least one high angle shooting data through the user's shooting, and is installed at the rear of the treadmill on which an exercise guide is set and uses the exercise guide based on the exercise guide. It further includes a third image capture device that generates second image data by capturing the user's exercise on the treadmill, wherein the information processing device captures the second image data, the side view data, and the high angle shot. Based on the data analysis results, the final user's body balance information can be generated by verifying or correcting the body balance information analyzed for the first image data.

In order to solve the problem to be solved above, the method of generating body balance information according to an embodiment of the present invention includes the soles of the feet while the user is lying down in an information processing device, and photographs the movement state of the body including the feet. A step of receiving generated first image data (including toe shape data and an exercise image of a portion corresponding to the lower part of the user's knee, including the foot), and receiving the input toe shape data and reference toe shape data. Obtaining state information for each part of the toe (i.e., hindfoot, midfoot, and forefoot) through comparison between the toes, and determining a first state for the body part associated with each part based on the state information for each part. Inferring information, analyzing information about the degree of movement of the foot and movement of the calf in the exercise image to generate dynamic movement analysis information, based on the first state information and the dynamic movement analysis information It may include generating body balance information of the user.

According to an embodiment of the present invention, the method for generating body balance information includes receiving second image data generated by photographing the back of the user when the user exercises on a treadmill, and the user A step of receiving at least one side shooting data generated by shooting the user at various angles while standing, and one or more high angle images generated by shooting from a vertical direction above the user's head. A final user's body balance information step of receiving shooting data and verifying or correcting the user's body balance information based on the results of analyzing the second image data, side shooting data, and high angle shooting data. The step of generating may further be included.

According to the problem-solving means of the present invention described above, convenience in measuring body balance can be achieved by providing a body balance information generation system and method that can generate body balance information of a user using only images related to the feet. In addition, the accuracy of body balance measurement can be improved.

Figure 1 is a diagram showing the overall configuration of a body balance information generation system according to an embodiment of the present invention.
Figure 2 is a diagram showing the detailed structure of the second image providing unit according to an embodiment of the present invention.
3 and 4 are diagrams showing the detailed structure of the first image providing unit according to an embodiment of the present invention.
Figure 5 is a diagram showing the detailed structure of a third image providing unit according to an embodiment of the present invention.
Figure 6 is a flowchart showing a process in which an information processing device generates body balance information in the body balance information generation system according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. The detailed description below is provided to provide a comprehensive understanding of the methods, devices and/or systems described herein. However, this is only an example and the present invention is not limited thereto.

In describing the embodiments of the present invention, if it is determined that a detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. In addition, the terms described below are terms defined in consideration of functions in the present invention, and may vary depending on the intention or custom of the user or operator. Therefore, the definition should be made based on the contents throughout this specification. The terminology used in the detailed description is merely for describing embodiments of the present invention and should in no way be limiting. Unless explicitly stated otherwise, singular forms include plural meanings. In this description, expressions such as “comprising” or “comprising” are intended to indicate certain features, numbers, steps, operations, elements, parts or combinations thereof, and one or more than those described. It should not be construed to exclude the existence or possibility of any other characteristic, number, step, operation, element, or part or combination thereof.

Hereinafter, a system and method for generating body balance information will be described with reference to the attached drawings.

FIG. 1 is a diagram showing the overall configuration of a body balance information generation system according to an embodiment of the present invention, and FIG. 2 is a diagram showing the detailed structure of the second image providing unit according to an embodiment of the present invention, and FIGS. 3 to 3 FIG. 4 is a diagram showing the detailed structure of the first image providing unit according to an embodiment of the present invention, and FIG. 5 is a drawing showing the detailed structure of the third image providing unit according to an embodiment of the present invention.

As shown in FIG. 1, the user's body balance information generating system includes the first to third image providing units 100, 200, and 300 and the final user's body balance status information (hereinafter referred to as 'final body balance status information') ') may include an information processing device 400 provided with a status determination program 410 that determines.

In particular, the body balance information generation system according to an embodiment of the present invention can generate the final user's body balance state information based on image data provided from the second image provider 200. Here, the image data provided from the second image provider 200 includes the soles of the feet while the user is lying down, and may be generated through filming the movement state of the body, including the feet.

Additionally, the image data may be an image including the shape of the sole and toes, and may also include an image of movement in the inner and outer directions of the foot.

To this end, as shown in FIG. 2, the second image providing unit 200 includes a bed (not shown) on which the user can lie, and first and second image capture devices for photographing the user lying on the bed. (210, 220) can be provided. That is, the second image providing unit 200 is installed on a camera installation member (not shown) connected to the bed to photograph the part including the user's feet at a preset angle, for example, 50-70 degrees relative to the ground. It may include a first image capture device 210 and a second image capture device 220 installed on the camera installation member to capture images of the sole of the foot, the shape of the toe, and the inner and outer movement of the toe.

Guide lines (not shown) may be provided on the bed to guide the position of the user's feet when lying down.

In particular, the first image capture device 210 according to an embodiment of the present invention is installed at a position capable of capturing images of the lower part of the user's body with respect to the knees, and the second image capture device 220 is installed at a location where images can be captured of the lower part of the user's body with respect to the knees, and the second image capture device 220 is installed at a location where images can be captured of the lower part of the user's body with respect to the knees. It can be installed in a position where the shape and degree of spread of the feet can be photographed, that is, in a horizontal direction from the user's lying position.

In addition, the first and second image capture devices 210 and 220 generate static image data by shooting in a static position in which the user is lying down, and then capture the image according to the movement of the user's feet according to a preset guide while the user is lying down. Dynamic image data may be generated, and the generated static and dynamic image data may be transmitted to the information processing device 400.

As described above, the information processing device 400 provided from the first and second image capture devices 210 and 220 uses the state determination program 410 to convert toe shape data from static image data to the rearfoot, which is the heel region. , It is divided into the midfoot, which is the central part of the foot where the metatarsal bones are located, and the forefoot, which is the area where the phalanges of the toes (coronal, mid, and terminal phalanges) are located, and the degree of distortion is determined through comparison between the reference shape data of each part and the toes. can be calculated, and the user's basic body balance information can be obtained based on the calculated degree of distortion for each part. Specifically, the state judgment program 410 extracts parts of the midfoot, forefoot, and rearfoot from the toe shape data and then calculates the degree of distortion by comparing each extracted part with the toe reference shape data, and calculates the degree of distortion of each part. By analyzing the correlation between the degree and the body part information related to each part, status information for each body part can be obtained, and then basic body balance information can be obtained based on this.

In addition, the state determination program 410 according to an embodiment of the present invention provides correction data that can correct basic body balance information through analysis of the remaining static image data and dynamic image data excluding toe shape data. can be created. That is, the state determination program 410 may correct the basic body balance information based on the correction data to generate the final user's body balance information.

Meanwhile, the state determination program 410 according to an embodiment of the present invention can verify and correct the user's body balance information generated based on the image data provided from the second image provider 200. . Specifically, the state determination program 410 may analyze image data provided from the first and third image providers 100 and 300 to verify and correct the user's body balance information.

The first image provider 100 guides the user to stand in his usual posture, and photographs the user from various angles while the user is standing on the body balance measurement device on which the first image provider 100 is installed. In addition to acquiring side shooting data, it is installed at the top in the vertical direction based on the user's head, and can obtain high angle shooting data through the user's shooting and then provide it to the information processing device 400.

In order to acquire side shooting data and high angle shooting data, the body balance measuring device according to an embodiment of the present invention is provided with a seating portion 112 on which the user's feet can be seated, as shown in FIGS. 3 and 4. The main body 110, the support 130, and the seating unit 110 installed in connection with the side part of the main body 110 on the rear side of the seating unit 110 (i.e., in the direction opposite to the third image capture device 120). and a third image capture device 120 installed at a preset distance apart to capture each part of the user, a moving guide member 132 installed to protrude in the X-axis direction at one end of the support 130, and a moving guide member 132 It may include a fourth image capture device 140 installed on the guide member 132 and connected to a camera installation stand 134 movable on the X-axis.

In order to acquire side shooting data from various angles, the seating portion 112 according to an embodiment of the present invention is installed on the main body 110 to be rotatable by a rotation motor 150, and the seating portion 112 It may be rotated by the rotation motor 150 at preset time intervals.

In addition, the body balance measuring device according to an embodiment of the present invention may further include a camera installation member 122 installed at a position spaced apart from the seating portion 112 by a preset distance. A plurality of third image capture devices 120, for example, three or more, capable of photographing the user's side may be installed on the camera installation member 122.

That is, each of the third image capture devices 120 installed on the camera installation member 122 divides the entire body of the user standing on the seating unit 110, for example, into the upper body, torso, and lower body, and then captures the upper body. Side imaging data, torso side imaging data, and lower body side imaging data are generated, and each side imaging data can be transmitted to the information processing device 400 connected to a wired or wireless network.

In an embodiment of the present invention, the upper body is the part of the user's body including the head and shoulders, the torso is the part including the chest, abdomen, pelvis, and parts of the thighs, and the lower body is the part including other parts of the thighs, calves, and feet. This may be the part.

Meanwhile, the camera installation member 122 according to an embodiment of the present invention is installed to be movable in the You can. Specifically, the camera installation member 122 is a structure installed in the vertical direction (Z-axis direction) at a position spaced apart from the seating portion 120 by a preset distance, and includes a plurality of third image capture devices installed on the side facing the user. (120) can be installed.

According to an embodiment of the present invention as described above, it has been described as an example that three third image capture devices 120 are installed to capture the user's whole body divided into three parts, but four or more third image capture devices 120 An image capture device 120 may be installed.

Additionally, side imaging data of the user's entire body may be generated using a single third imaging device 120. In this case, the first image capture device 120 may acquire side image data by photographing the user standing on the seating unit 120 while moving in the Z-axis direction on the camera installation member 122.

In order to acquire side shooting data from various angles, the camera installation member 122 on which the third image capturing device 120 according to another embodiment of the present invention is installed rotates on a semicircular arc or rotates on a circular arc based on the user. You can move. To this end, a driving member 124 that allows the camera installation member 122 to rotate may be installed on the lower surface of the main body 110 according to another embodiment of the present invention. That is, the camera installation member 122 may rotate in a circular arc or a semicircular arc relative to the user, for example, based on the main body 110, by the driving motor 126 installed inside the driving member 124.

According to another embodiment of the present invention as described above, when the camera installation member 122 is moved on a semicircular arc or circular arc having a predetermined diameter based on the main body 110, the support 130 may be omitted. , the fourth image capturing device 140 may be fixedly installed on the ceiling.

The driving motor 126 and the rotation motor 150 may be controlled by a state determination program 410 within the information processing device 400. Specifically, the information processing device 400 transmits information set by the status determination program 410, that is, information such as operation time and movement distance, to a body balance measurement device connected through a wired or wireless network to determine the drive motor 126. and the rotation motor 150 can be controlled.

The information processing device 400 according to an embodiment of the present invention can collect image data provided from the first image providing unit 100, that is, side shooting data and high angle shooting data.

Additionally, the information processing device 400 according to an embodiment of the present invention may collect rear dynamic image data provided from the third image providing unit 300.

That is, as shown in FIG. 5, the third image providing unit 300 is connected to the rear part of the treadmill and is used to capture images according to the user's movement on the treadmill, that is, rear dynamic image data. An image capture device 310 may be provided.

The state determination program 410 according to an embodiment of the present invention analyzes the side shot data, high angle shot data, and rear dynamic image data provided from the first and third image providers 100 and 300 to determine the user's status. After generating the static and dynamic body balance information, the user's final body balance information generated based on the image data provided from the second image providing unit 200 can be verified and corrected using this information.

The process by which the information processing device 400 generates the user's body balance information in the user's body balance measurement system having the above-described configuration will be described with reference to FIG. 6.

Figure 6 is a flowchart showing a process in which an information processing device generates body balance information in the body balance information generation system according to an embodiment of the present invention.

As shown in FIG. 6, the information processing device 400 of the user body balance information generating system receives image data from the second image providing unit 200 (S500). Specifically, the information processing device 400 may receive image data captured by the first and second image capturing devices 210 and 220 of the second image providing unit 200 connected through a wired or wireless network. Here, the first image capturing device 210 is installed in the body balance measurement device corresponding to the second image providing unit 200 and captures image data generated through imaging of the exercise state of the body, including the feet (e.g., (including an exercise image of the body corresponding to the lower part of the user's knee), and the second image capture device 220 is installed toward the sole of the foot to provide image data including toe shape data. there is.

Thereafter, the information processing device 400 obtains status information for each part of the toe (i.e., rearfoot, midfoot, and forefoot) through comparison between the provided toe shape data and previously stored reference toe shape data (S502).

Then, the information processing device 400 infers first state information about the body part associated with each part based on the state information about each part (S504). Here, the first state information can be inferred through comparison between the state information for each part of the toe and the reference information data for the body part associated with each part of the toe.

Thereafter, the information processing device 400 generates dynamic motion analysis information by analyzing information about the degree of foot movement, movement shape, and movement of the calf portion in the exercise image (S506). Here, dynamic movement analysis information is generated through comparison between the degree of foot movement, movement shape, and movement of the calf area in the image when the user performs an exercise below the knee according to the guide and previously stored reference dynamic movement data. You can.

Then, the information processing device 400 generates the user's body balance information based on the first state information and dynamic movement analysis information (S508).

Thereafter, the information processing device 400 collects image data generated by photographing the back of the user when the user performs exercise on a treadmill on which the fifth image capturing device 310, which is the third image providing unit 300, is installed. (hereinafter referred to as 'rear image data') is provided from the third image provider 300 (S510).

In addition, the information processing device 400 captures at least one side image data generated by shooting the user at various angles while the user is standing, and captures a third image corresponding to the first image providing unit 100. It is provided from the device 120 (S512).

In addition, the information processing device 400 sends one or more high-angle shooting data generated through shooting from the vertical direction above the user's head to a fourth image capturing device (corresponding to the first image providing unit 100). 140) (S514).

Thereafter, the information processing device 400 verifies or corrects the user's body balance information based on the results of analyzing the rear image data, side shooting data, and high angle shooting data (S516) to determine the final user's body balance. Information can be generated. At this time, verification can be done by generating the user's body balance information for verification using rear image data, side shooting data, and high angle shooting data, and then comparing the body balance information generated in S508 with the body balance information for verification. . In addition, correction can be made by correcting the body balance information generated in S508 based on data corresponding to the difference when the difference between the body balance information for verification and the body balance information generated in S508 is outside the preset threshold range. .

The above description is merely an illustrative explanation of the technical idea of the present invention, and various modifications and variations can be made by those skilled in the art without departing from the essential characteristics of the present invention. Accordingly, the embodiments expressed in the present invention do not limit the technical idea of the present invention, but are for illustrative purposes, and the scope of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas that are equivalent or within the equivalent scope should be construed as being included in the scope of rights of the present invention.

100, 200, 300: 1st, 2nd, 3rd video provision section
400: Information processing device
410: Status judgment program

Claims (5)

an image providing unit that generates and provides first image data by photographing the movement state of the body, including the soles of the feet and the feet, while the user is lying down;
A user body balance information generating system comprising an information processing device that generates body balance state information of the user through analysis of first image data provided from the image provider.
According to paragraph 1,
The image generator,
a first image capture device for capturing an image of the soles of the user's feet in a lying state;
It includes a second image capture device that performs imaging of the lower part of the user's knee in the lying state,
The first and second image capture devices,
A user body balance information generation system that generates first image data by capturing images according to the movement of the user's feet according to a preset guide.
According to paragraph 1,
The image generator,
At least one third image capture device that generates side view data by taking photos of the user at various angles while the user is standing;
a fourth image capture device installed at a vertical direction relative to the user's head to generate at least one high-angle capture data through capture of the user;
It further includes a third image capturing device installed at the rear of the treadmill on which the exercise guide is set and generating second image data through filming as the user performs exercise on the treadmill based on the exercise guide,
The information processing device,
Generating the final user's body balance information by verifying or correcting the body balance information analyzed for the first image data based on the results of analyzing the second image data, side shot data, and high angle shot data. A user body balance information generation system.
In the information processing device of the user's body balance information generation system, first image data (toe shape data, the user's feet including the feet) is generated by photographing the exercise state of the body, including the soles of the feet and the feet, while the user is lying down. A step of receiving input (including an exercise image of the part corresponding to the lower part based on the knee of),
Obtaining status information for each part of the toe (i.e. rearfoot, midfoot, and forefoot) through comparison between the input toe shape data and reference toe shape data;
inferring first state information about a body part associated with each part based on the state information about each part;
Generating dynamic movement analysis information by analyzing information about the degree of movement of the foot and movement of the calf in the exercise image;
A method of generating body balance information of the user including the step of generating the body balance information of the user based on the first state information and the dynamic movement analysis information.
According to paragraph 4,
The method for generating the body balance information is,
receiving second image data generated by photographing the back of the user when the user exercises on a treadmill;
receiving at least one side photographing data generated by photographing the user at various angles while the user is standing;
receiving one or more high-angle shooting data generated through shooting from a vertical direction above the user's head;
Further comprising the step of generating final user body balance information by verifying or correcting the user's body balance information based on the results of analyzing the second image data, side shooting data, and high angle shooting data. How to generate user body balance information.

Images